<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article article-type="brief-report" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xml:lang="EN">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Child Adolesc. Psychiatry</journal-id>
<journal-title>Frontiers in Child and Adolescent Psychiatry</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Child Adolesc. Psychiatry</abbrev-journal-title>
<issn pub-type="epub">2813-4540</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/frcha.2023.1244671</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Child and Adolescent Psychiatry</subject>
<subj-group>
<subject>Perspective</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Key attributes of child psychiatry access programs</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes"><name><surname>Dvir</surname><given-names>Yael</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="corresp" rid="cor1">&#x002A;</xref><uri xlink:href="https://loop.frontiersin.org/people/34972/overview"/></contrib>
<contrib contrib-type="author"><name><surname>Straus</surname><given-names>John H.</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib>
<contrib contrib-type="author"><name><surname>Sarvet</surname><given-names>Barry</given-names></name>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref></contrib>
<contrib contrib-type="author"><name><surname>Byatt</surname><given-names>Nancy</given-names></name>
<xref ref-type="aff" rid="aff4"><sup>4</sup></xref></contrib>
</contrib-group>
<aff id="aff1"><label><sup>1</sup></label><addr-line>Division of Child and Adolescent Psychiatry, Department of Psychiatry</addr-line>, <institution>University of Massachusetts T.H. Chan Medical School, UMass Memorial Health</institution>, <addr-line>Worcester, MA</addr-line>, <country>United States</country></aff>
<aff id="aff2"><label><sup>2</sup></label><institution>Massachusetts Child Psychiatry Access Program/Carelon Behavioral Health</institution>, <addr-line>Boston, MA</addr-line>, <country>United States</country></aff>
<aff id="aff3"><label><sup>3</sup></label><addr-line>Department of Psychiatry</addr-line>, <institution>University of Massachusetts T.H. Chan Medical School-Baystate</institution>, <addr-line>Springfield, MA</addr-line>, <country>United States</country></aff>
<aff id="aff4"><label><sup>4</sup></label><addr-line>Lifeline for Families Division, Department of Psychiatry</addr-line>, <institution>University of Massachusetts T.H. Chan Medical School, UMass Memorial Health</institution>, <addr-line>Worcester, MA</addr-line>, <country>United States</country></aff>
<author-notes>
<fn fn-type="edited-by"><p><bold>Edited by:</bold> Eva M&#x00F6;hler, Saarland University Hospital, Germany</p></fn>
<fn fn-type="edited-by"><p><bold>Reviewed by:</bold> Vicki McKenzie, The University of Melbourne, Australia</p></fn>
<corresp id="cor1"><label>&#x002A;</label><bold>Correspondence:</bold> Yael Dvir <email>yael.dvir@umassmed.edu</email></corresp>
</author-notes>
<pub-date pub-type="epub"><day>25</day><month>07</month><year>2023</year></pub-date>
<pub-date pub-type="collection"><year>2023</year></pub-date>
<volume>2</volume><elocation-id>1244671</elocation-id>
<history>
<date date-type="received"><day>22</day><month>06</month><year>2023</year></date>
<date date-type="accepted"><day>13</day><month>07</month><year>2023</year></date>
</history>
<permissions>
<copyright-statement>&#x00A9; 2023 Dvir, Straus, Sarvet and Byatt.</copyright-statement>
<copyright-year>2023</copyright-year><copyright-holder>Dvir, Straus, Sarvet and Byatt</copyright-holder><license license-type="open-access" xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the <ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/licenses/by/4.0/">Creative Commons Attribution License (CC BY)</ext-link>. The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract>
<p>The gap between the need for and the availability of pediatric mental health providers is well documented. One solution is regional/state Child Psychiatry Access Programs (CPAPs), which aid in the assessment and management of youth with behavioral health (BH) concerns by providing consultation to Pediatric Primary Care Clinicians. Our authorship team and the National Network of Child Psychiatry Access Programs (NNCPAP) board worked to describe operational definitions for CPAPs elements and related outcome monitoring processes and data systems. CPAP elements include regional child psychiatry availability by phone; real time phone availability; referral and resource assistance; and, expedited face-to-face psychiatric evaluation. Defining a child psychiatry consultation program as a CPAP and describing key attributes for CPAPs is an important step in facilitating implementation of the model and advancing research into its effectiveness.</p>
</abstract>
<kwd-group>
<kwd>access programs</kwd>
<kwd>behavioral health</kwd>
<kwd>primary care clinicians</kwd>
<kwd>program evaluation</kwd>
<kwd>consultation</kwd>
</kwd-group>
<counts>
<fig-count count="0"/>
<table-count count="0"/><equation-count count="0"/><ref-count count="9"/><page-count count="0"/><word-count count="0"/></counts><custom-meta-wrap><custom-meta><meta-name>section-at-acceptance</meta-name><meta-value>Child Mental Health and Interventions</meta-value></custom-meta></custom-meta-wrap>
</article-meta>
</front>
<body>
<sec id="s1" sec-type="intro"><title>Introduction</title>
<p>The nationwide gap between the need for pediatric mental health providers and their availability in the United States (US) is well documented: only 20&#x0025; of youth with a mental health disorder receive care from a specialized Behavioral Health (BH) provider (<xref ref-type="bibr" rid="B1">1</xref>). While only one in three pediatricians report sufficient training to diagnose and treat children with behavioral disorders, pediatric primary care clinicians prescribe most psychiatric medications for children in outpatient settings (<xref ref-type="bibr" rid="B1">1</xref>). BH integration into primary care is a response important to the challenge of inadequate child BH workforce capacity (<xref ref-type="bibr" rid="B2">2</xref>). One approach to integrating behavioral health care into pediatric primary care is statewide Child Psychiatry Access Program model (CPAPs). CPAPs increase access to child mental health care by providing a system of regional children&#x0027;s BH consultation teams that help pediatric primary care clinicians and practices manage the BH of pediatric patients (<xref ref-type="bibr" rid="B4">4</xref>). The first CPAP was established in Massachusetts in 2004 to aid pediatric primary care clinicians in providing psychiatric treatment to youth through consultation and referral services (<xref ref-type="bibr" rid="B3">3</xref>). In regions with a statewide CPAP, children are significantly more likely to receive mental health services (<xref ref-type="bibr" rid="B5">5</xref>). The Health Resources and Services Administration (HRSA) funding for Pediatric Mental Health Care Access (PMHCA) in the US 2021 and 2022 (<xref ref-type="bibr" rid="B6">6</xref>) expanded pediatric BH integration and led to similar programs across and beyond the US. There are now 46 CPAPs under development and/or existing in 46 states, as well programs in the District of Columbia, two tribal communities and four US territories, and internationally in British Columbia, Canada, and Australia. As a model, CPAPs are designed to assist primary care clinicians with managing children with mild to moderate psychiatric illness by providing real time phone consultation, referral and resource assistance and expedited face-to-face psychiatric evaluation.</p>
<p>A systematic review by Bettencourt and colleagues of methods used to evaluate CPAPs published in 2020, reviewed 29 publications evaluating 13 programs in 11 states, focusing primarily on program utilization and provider satisfaction, practices, and self-efficacy. With respect to outcomes for patients and families, the authors noted that the available publications analyzed access to treatment rather than behavioral health outcomes because the studies being conducted where largely descriptive rather than experimental (<xref ref-type="bibr" rid="B7">7</xref>). Nevertheless, key findings from these studies suggest that primary care clinicians adopt the model, are satisfied with direct consultation for diagnostic assistance and medication related questions, and that their ability to manage more complex cases increases with time (<xref ref-type="bibr" rid="B7">7</xref>). Additionally, most studies evaluated the consultation/evaluation and referral service rather than the education/training component, making it difficult to draw conclusions about the different elements of the model. Likewise, there has been limited focus on patient outcomes (<xref ref-type="bibr" rid="B7">7</xref>).</p>
<p>A major barrier to the study of these programs is the absence of a consensus description and set of criteria defining the CPAP model. The National Network of Child Psychiatry Access Programs (NNCPAP) is a nation-wide association established in 2011 to support existing and emerging CPAPs by creating of a data base and toolkit for new programs, and collaboration on evaluation and research (<xref ref-type="bibr" rid="B8">8</xref>). In this perspective article, we outline CPAP operational definitions that were developed based on the existing literature and expert consensus. Experts included members of the NNCAP board and leaders of CPAP programs. The definitions were developed based on an initial consensus then refined based on interactive feedback from these experts.</p>
</sec>
<sec id="s2"><title>Definition and core elements</title>
<sec id="s2a"><title>Definition</title>
<p>Child Psychiatry Access Programs (CPAPs) are a model of care wherein pediatric primary care clinicians receive training and support in treating their patients with regard to mental health and substance use disorders via in-person, phone, or online case-based consultation from off-site mental health professionals.</p>
</sec>
<sec id="s2b"><title>Primary goal of CPAPs</title>
<p>Increase access to pediatric mental health and substance use services by providing consultation and training to pediatric primary care clinicians to increase their comfort and skills in managing mild to moderate mental health and substance use disorders.</p>
</sec>
<sec id="s2c"><title>CPAP elements</title>
<list list-type="simple">
<list-item><label>1.</label><p>Provision of on-demand telephonic consultation by child and adolescent psychiatrists and optionally other licensed children&#x0027;s mental health professionals to pediatric primary care clinicians and integrated behavioral health clinicians in the pediatric primary care practices in/for a defined region/population regarding diagnosis and management of mental health and substance use disorders.</p></list-item>
<list-item><label>2.</label><p>Real time response (calls returned within 30&#x2005;min when possible, or at least within same workday). Real time response can also be available through asynchronous communication (email, secure messaging).</p></list-item>
<list-item><label>3.</label><p>Provision of referrals and resource navigation.</p></list-item>
<list-item><label>4.</label><p>Availability of expedited in-person or virtual psychiatric evaluation when indicated.</p></list-item>
<list-item><label>5.</label><p>Formal continuing education sessions for pediatric primary care clinicians and assistance with practice transformation to integrate behavior health. Educational tools may include practice guidelines, website, webinars, and newsletters.</p></list-item>
</list>
</sec>
<sec id="s2d"><title>CPAP outcome and performance monitoring</title>
<p>CPAPs use a data system to monitor program performance and outcomes. Usage is monitored with an encounter database which captures demographic information about the patient served, the provider requesting help, the type of presenting mental health problem, the nature of the presenting need or question, and the type of service provided to the pediatric primary care clinicians and/or patient. In addition, a web-based database includes number of practices and/or pediatric primary care clinicians enrolled and annual utilization; pediatric primary care clinicians&#x0027; satisfaction; and pediatric primary care clinicians&#x2019; comfort and confidence with managing mental health concerns (change from baseline). Additional elements may include measures of provider practice change, including the use of screening, practice guidelines, measurement-based practice, and total practice BH outcomes; patient outcomes; and family member satisfaction with services. Performance measures include the degree to which the program reaches the entire geographic region population (percent of practices enrolled and utilizing).</p>
</sec>
</sec>
<sec id="s3" sec-type="discussion"><title>Discussion and next steps</title>
<p>CPAPs are a model for providing pediatric BH care created in response to unmet BH needs among children and adolescents, resource and workforce gaps, and deficits in graduate medical education training for pediatric primary care clinicians. The CPAP has grown in recent years and continues to grow. While there are currently CPAP versions in multiple states as well as international programs, there is limited multistate or nationwide research and no formal operational definitions of a CPAP. Taken together, this suggests that policy makers and funders are moving forward with supporting the CPAP model as a solution to pediatric behavioral health care access, without the benefit of clear data on the effectiveness of the model.</p>
<p>Better understanding of the different components of each program, and the establishment of consensus criteria for the model is an important first step in the development of measures that could facilitate outcome evaluation on a larger scale (<xref ref-type="bibr" rid="B9">9</xref>). In this paper, we present operational definitions of program elements, outcome measurement processes and database systems as a first step toward to facilitating such evaluation.</p>
</sec>
</body>
<back>
<sec id="s4" sec-type="data-availability"><title>Data availability statement</title>
<p>The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author.</p>
</sec>
<sec id="s5" sec-type="author-contributions"><title>Author contributions</title>
<p>All authors contributed to the writing of this article. All authors contributed to the article and approved the submitted version.</p>
</sec>
<ack><title>Acknowledgments</title>
<p>All authors have received salary and/or funding support from the Massachusetts Department of Mental Health via the Massachusetts Child Psychiatry Access Program. JS is the President of the National Network of Child Psychiatry Access Programs (a non-funded position). NB is the Medical Director of Research and Evaluation for MCPAP for Moms and the Executive Director of the Lifeline for Families Center at UMass Chan Medical School. She has received honoraria from Global Learning Collaborative. She has also served as a consultant for The Kinetix Group, VentureWell, and JBS International.</p>
</ack>
<sec id="s6" sec-type="COI-statement"><title>Conflict of interest</title>
<p>The author YD declared that they were an editorial board member of Frontiers, at the time of submission. This had no impact on the peer review process and the final decision.</p>
<p>The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec id="s7" sec-type="disclaimer"><title>Publisher&#x0027;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<ref-list><title>References</title>
<ref id="B1"><label>1.</label><citation citation-type="other"><collab>CDC. Behavioral Health Integration</collab>. <ext-link ext-link-type="uri" xlink:href="https://www.cdc.gov/childrensmentalhealth/documents/access-infographic.html">https://www.cdc.gov/childrensmentalhealth/documents/access-infographic.html</ext-link> <comment>(Accessed May 22, 2023)</comment>.</citation></ref>
<ref id="B2"><label>2.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wissow</surname><given-names>LS</given-names></name><name><surname>Platt</surname><given-names>R</given-names></name><name><surname>Sarvet</surname><given-names>B</given-names></name></person-group>. <article-title>Policy recommendations to promote integrated mental health care for children and youth</article-title>. <source>Acad Pediatr</source>. (<year>2021</year>) <volume>21</volume>(<issue>3</issue>):<fpage>401</fpage>&#x2013;<lpage>7</lpage>. <pub-id pub-id-type="doi">10.1016/j.acap.2020.08.014</pub-id><pub-id pub-id-type="pmid">32858263</pub-id></citation></ref>
<ref id="B3"><label>3.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Straus</surname><given-names>JH</given-names></name><name><surname>Sarvet</surname><given-names>B</given-names></name></person-group>. <article-title>Behavioral health care for children: the Massachusetts child psychiatry access project</article-title>. <source>Health Aff (Millwood)</source>. (<year>2014</year>) <volume>33</volume>(<issue>12</issue>):<fpage>2153</fpage>&#x2013;<lpage>61</lpage>. <pub-id pub-id-type="doi">10.1377/hlthaff.2014.0896</pub-id><pub-id pub-id-type="pmid">25489033</pub-id></citation></ref>
<ref id="B4"><label>4.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sullivan</surname><given-names>K</given-names></name><name><surname>George</surname><given-names>P</given-names></name><name><surname>Horowitz</surname><given-names>K</given-names></name></person-group>. <article-title>Addressing national workforce shortages by funding child psychiatry access programs</article-title>. <source>Pediatrics</source>. (<year>2021</year>) <volume>147</volume>(<issue>1</issue>):<fpage>e20194012</fpage>. <pub-id pub-id-type="doi">10.1542/peds.2019-4012</pub-id><pub-id pub-id-type="pmid">33277350</pub-id></citation></ref>
<ref id="B5"><label>5.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Stein</surname><given-names>BD</given-names></name><name><surname>Kofner</surname><given-names>A</given-names></name><name><surname>Vogt</surname><given-names>WB</given-names></name><name><surname>Yu</surname><given-names>H</given-names></name></person-group>. <article-title>A national examination of child psychiatric telephone consultation programs&#x2019; impact on children&#x2019;s mental health care utilization</article-title>. <source>J Am Acad Child Adolesc Psychiatry</source>. (<year>2019</year>) <volume>58</volume>(<issue>10</issue>):<fpage>1016</fpage>&#x2013;<lpage>9</lpage>. <pub-id pub-id-type="doi">10.1016/j.jaac.2019.04.026</pub-id></citation></ref>
<ref id="B6"><label>6.</label><citation citation-type="other"><collab>HRSA. Pediatric Mental Health Care Access Program (PMHCA)</collab>. <ext-link ext-link-type="uri" xlink:href="https://mchb.hrsa.gov/training/projects.asp?program=34">https://mchb.hrsa.gov/training/projects.asp?program&#x003D;34</ext-link> <comment>(Accessed May 22, 2023)</comment>.</citation></ref>
<ref id="B7"><label>7.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bettencourt</surname><given-names>AF</given-names></name><name><surname>Plesko</surname><given-names>CM</given-names></name></person-group>. <article-title>A systematic review of the methods used to evaluate child psychiatry access programs</article-title>. <source>Acad Pediatr</source>. (<year>2020</year>) <volume>20</volume>(<issue>8</issue>):<fpage>1071</fpage>&#x2013;<lpage>82</lpage>. <pub-id pub-id-type="doi">10.1016/j.acap.2020.07.015</pub-id><pub-id pub-id-type="pmid">32673763</pub-id></citation></ref>
<ref id="B8"><label>8.</label><citation citation-type="other"><collab>NNCPAP</collab>. <comment>About Us</comment>. <ext-link ext-link-type="uri" xlink:href="https://www.nncpap.org/about-us">https://www.nncpap.org/about-us</ext-link> <comment>(Accessed May 22, 2023)</comment>.</citation></ref>
<ref id="B9"><label>9.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bond</surname><given-names>GR</given-names></name><name><surname>Drake</surname><given-names>RE</given-names></name></person-group>. <article-title>Assessing the fidelity of evidence-based practices: history and current status of a standardized measurement methodology</article-title>. <source>Adm Policy Ment Health</source>. (<year>2020</year>) <volume>47</volume>:<fpage>874</fpage>&#x2013;<lpage>84</lpage>. <pub-id pub-id-type="doi">10.1007/s10488-019-00991-6</pub-id><pub-id pub-id-type="pmid">31691055</pub-id></citation></ref></ref-list>
</back>
</article>