<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Psychiatry</journal-id>
<journal-title>Frontiers in Psychiatry</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Psychiatry</abbrev-journal-title>
<issn pub-type="epub">1664-0640</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fpsyt.2023.1135135</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Psychiatry</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Carer involvement in the assessment of personal recovery: A naturalistic study of assertive community treatment in Norway</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Israel</surname> <given-names>Pravin</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/2155736/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Ruud</surname> <given-names>Torleif</given-names></name>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
<xref ref-type="aff" rid="aff4"><sup>4</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/533945/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Weimand</surname> <given-names>Bente</given-names></name>
<xref ref-type="aff" rid="aff4"><sup>4</sup></xref>
<xref ref-type="aff" rid="aff5"><sup>5</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/1620680/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Faculty of Social Sciences, University of Stavanger</institution>, <addr-line>Stavanger</addr-line>, <country>Norway</country></aff>
<aff id="aff2"><sup>2</sup><institution>Faculty of Health Studies, VID Specialized University</institution>, <addr-line>Oslo</addr-line>, <country>Norway</country></aff>
<aff id="aff3"><sup>3</sup><institution>Institute of Clinical Medicine, Faculty of Medicine, University of Oslo</institution>, <addr-line>Oslo</addr-line>, <country>Norway</country></aff>
<aff id="aff4"><sup>4</sup><institution>Division of Mental Health, Department of Special Psychiatry, Akershus University Hospital</institution>, <addr-line>L&#x000F8;renskog</addr-line>, <country>Norway</country></aff>
<aff id="aff5"><sup>5</sup><institution>Department of Health, Social, and Welfare Studies, University of South-Eastern Norway</institution>, <addr-line>Kongsberg</addr-line>, <country>Norway</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Helen Killaspy, University College London, United Kingdom</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Abraham Rudnick, Dalhousie University, Canada; Maria Monroe-DeVita, University of Washington, United States</p></fn>
<corresp id="c001">&#x0002A;Correspondence: Pravin Israel <email>pravin.israel&#x00040;uis.no</email></corresp>
<fn fn-type="other" id="fn001"><p>This article was submitted to Social Psychiatry and Psychiatric Rehabilitation, a section of the journal Frontiers in Psychiatry</p></fn></author-notes>
<pub-date pub-type="epub">
<day>27</day>
<month>03</month>
<year>2023</year>
</pub-date>
<pub-date pub-type="collection">
<year>2023</year>
</pub-date>
<volume>14</volume>
<elocation-id>1135135</elocation-id>
<history>
<date date-type="received">
<day>31</day>
<month>12</month>
<year>2022</year>
</date>
<date date-type="accepted">
<day>22</day>
<month>02</month>
<year>2023</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2023 Israel, Ruud and Weimand.</copyright-statement>
<copyright-year>2023</copyright-year>
<copyright-holder>Israel, Ruud and Weimand</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license> </permissions>
<abstract>
<sec>
<title>Background</title>
<p>The user and carer movements have come a long way in becoming embedded in mainstream mental health services for individuals with serious mental illness. However, implementing recovery-oriented practice continues to be plagued by an individualistic clinical focus. The carers do not feel integrated despite policies and best intentions. The implementation of Assertive Community Treatment (ACT) provided an opportunity to involve the carers and compare their assessment of personal recovery with the users.</p></sec>
<sec>
<title>Aims</title>
<p>The aims of this study were to examine (i) how family carers and users differed in their assessment of personal recovery, (ii) whether familial and personal relationships influenced how carers assess personal recovery of users, and (iii) if the experience of family carers with the ACT team was associated with personal recovery.</p></sec>
<sec>
<title>Methods</title>
<p>The naturalistic, explorative study recruited 69 users and 36 family carers from 12 Norwegian ACT teams. The users and carers assessed the user&#x00027;s personal recovery. Family carers also reported their experience and satisfaction with the ACT teams. Analyses included independent and paired sample T-tests and correlation analysis.</p></sec>
<sec>
<title>Results</title>
<p>Family carers were significantly more conservative than the users&#x00027; assessment of the intrapsychic and interpersonal subscales of personal recovery. The pattern held true whether the family carers were matched to the users or part of the total sample. Lastly, there was a significant negative correlation between the family carer&#x00027;s experience of cooperation with the ACT team and their assessment of the user&#x00027;s intrapersonal process of recovery.</p></sec>
<sec>
<title>Conclusions</title>
<p>The results of our study were consistent with previous research on carer involvement in MHS. However, it is the first study that engaged carers and assessed personal recovery of the users of ACT services. Discrepancy between carers and users is the rule. Clinicians are encouraged to embrace the discrepancy and diversity carers bring and learn the methodology of multi-informant assessments. There also is a need to address, update, and integrate the personal, familial, and relational aspects of recovery. Modification of recovery measures such as QPR and their creative use with carers has the potential to generate valuable third-party information and to involve them meaningfully in mental health services.</p></sec></abstract>
<kwd-group>
<kwd>personal recovery</kwd>
<kwd>recovery</kwd>
<kwd>family carers</kwd>
<kwd>caregivers</kwd>
<kwd>serious mental illness</kwd>
<kwd>psychosis</kwd>
<kwd>multi-informant method</kwd>
<kwd>assertive community treatment (ACT)</kwd>
</kwd-group>
<counts>
<fig-count count="1"/>
<table-count count="3"/>
<equation-count count="0"/>
<ref-count count="57"/>
<page-count count="8"/>
<word-count count="6656"/>
</counts>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="s1">
<title>Introduction</title>
<p>User and family-driven carer movements grew out of dissatisfaction with mainstream mental health services (MHS) and its perceived short-sighted and paternalistic attitude (<xref ref-type="bibr" rid="B1">1</xref>, <xref ref-type="bibr" rid="B2">2</xref>). Consequently, it raised awareness that service users (henceforth known as users) and family carers (henceforth known as carers) are key stakeholders in the design and delivery of contemporary MHS for individuals with serious mental illness (SMI). Their subsequent recruitment to influential posts on boards and committees of service organizations provided them with a strong voice and presence (<xref ref-type="bibr" rid="B3">3</xref>). Further, in recognition of the enormous contribution of carers and the risks they face, government policies and guidelines were promulgated to strengthen their position and participation. However, there is still discontent among carers who feel that they provide vital care and support to users, but feel excluded by MHS (<xref ref-type="bibr" rid="B4">4</xref>, <xref ref-type="bibr" rid="B5">5</xref>). In Norway, the association for carers feel that there is a gap between the need of carers for support and what they receive.</p>
<p>The user movement has had help from, among others, the recovery movement. Traditionally, recovery was defined by trained professionals from a medical model that characterized mental illness (<xref ref-type="bibr" rid="B6">6</xref>). Subsequently, clinical recovery was defined as the reduction or remission of symptoms and the restoration of functional levels. The recovery movement was characterized by internal, subjective, and lived experiences of pursuing a meaningful and satisfying life despite the limitations imposed by severe mental illness (<xref ref-type="bibr" rid="B7">7</xref>&#x02013;<xref ref-type="bibr" rid="B9">9</xref>). Consequently, recovery-based services focused on processes where users actively navigated unique and multiple pathways, facilitated by mental health professionals and peers (<xref ref-type="bibr" rid="B3">3</xref>). On the research front, the conceptual framework of recovery- CHIME defined personal recovery as a synthesis of connectedness, hope, identity, meaning in life, and empowerment, which provided a platform to launch future research and practice (<xref ref-type="bibr" rid="B10">10</xref>, <xref ref-type="bibr" rid="B11">11</xref>).</p>
<p>The carer movement has not yet reached the level of success as the user movement. From a service provider&#x00027;s perspective, involving carers is complicated given multiple barriers, such as the lack of consent from users, confidentiality, attitudes and beliefs of carers regarding specific clinical interventions, and individualistic focus of the mental health care system (<xref ref-type="bibr" rid="B12">12</xref>, <xref ref-type="bibr" rid="B13">13</xref>). Further, discrepancies in the information provided by carers and users are difficult for clinicians to interpret and apply to concrete clinical situations and plans. The literature on multiple informants in clinical services shows that the discrepancy between informants is the rule rather than the exception (<xref ref-type="bibr" rid="B14">14</xref>&#x02013;<xref ref-type="bibr" rid="B16">16</xref>). On the clinical side, more two decades ago, Brown &#x00026; Rutter (<xref ref-type="bibr" rid="B17">17</xref>) defined Expressed Emotion as the emotional environment in which the patient resides, as exhibited by the manner in which their relatives communicate about them. Studies around expressed emotions enriched our understanding of family dynamics that may be associated with the mental illness (<xref ref-type="bibr" rid="B18">18</xref>). Many studies documented the enduring reality of the carers&#x00027; high burden of care on, among others, their physical and mental health, social isolation, and negative impact on their quality of life (<xref ref-type="bibr" rid="B19">19</xref>). Nevertheless, there are also studies that demonstrated positive effects of carer involvement, such as treatment adherence (<xref ref-type="bibr" rid="B20">20</xref>), treatment outcomes (<xref ref-type="bibr" rid="B21">21</xref>), fewer hospital admissions and shorter inpatient stay (<xref ref-type="bibr" rid="B22">22</xref>), and effect sizes for family interventions are comparable to medications (<xref ref-type="bibr" rid="B23">23</xref>). Several family-based interventions were developed. For example, two clinical trials in family-assisted assertive community treatment demonstrated positive outcomes for patients with schizophrenia (<xref ref-type="bibr" rid="B24">24</xref>, <xref ref-type="bibr" rid="B25">25</xref>). A recent feasibility study aimed at systematically including carers (<italic>n</italic> = 30) reported improved communication between the users and carers, and the clinicians reported that the procedure was simple, straightforward, and helpful (<xref ref-type="bibr" rid="B26">26</xref>). However, many family-centered clinical interventions are time limited and do not meet the scope of mental health rehabilitation needs of people with SMI.</p>
<p>Previous studies show that carers have been involved in several ways. For example, a large clinical trial that evaluated the effectiveness and safety of the antipsychotic medication showed that systematic involvement of carers was associated with increased adherence to treatment and reduced need for rehospitalization (<xref ref-type="bibr" rid="B21">21</xref>). Furthermore, psycho-education programs were an important tool to prepare and train carers to provide, among others, support to the user outside the MHS context. Studies involving people with serious mental illnesses such as schizophrenia and bipolar disorder documented favorable results using the family psychoeducation model (<xref ref-type="bibr" rid="B27">27</xref>, <xref ref-type="bibr" rid="B28">28</xref>). A recent feasibility study aimed at systematically including carers (<italic>n</italic> = 30) reported improved communication between the users and carers, and the clinicians reported that the procedure was simple, straightforward, and helpful (<xref ref-type="bibr" rid="B26">26</xref>). At the organizational level factors such as satisfaction with MHS are also known to have an impact on user outcomes. In fact, the user satisfaction model was built on the notion that the perception of being included and cared for facilitated positive care processes and produced favorable treatment outcomes. Subsequent studies corroborated these assumptions, and user satisfaction came to be adopted as a proxy for quality of care (<xref ref-type="bibr" rid="B27">27</xref>, <xref ref-type="bibr" rid="B29">29</xref>). Although carers are not direct beneficiaries of MHS, their feeling of satisfaction with the services could play an important role, especially when users are indisposed due to episodes that render them incapable of making informed decisions. The carer&#x00027;s beliefs regarding the quality of services and expectations would influence the level of support and motivation they provide to the user.</p>
<p>Current practices in MHS are the foundation for the seeding and development of new ideologies, innovations, and models of care. However, inconsistencies and tensions arise as a natural part of reabsorbing, accommodating, and implementing these innovations in MHS. For instance, while government policies and guidelines mandate the inclusion of carers, there continues to be a lack of knowledge and training about the meaningful involvement of carers in the treatment and rehabilitation of users with SMI (<xref ref-type="bibr" rid="B3">3</xref>). Innovative and newer ideologies do not always come with explicit instructions, among others, on how to integrate it with ACT services or how to involve carers. Further, against the backdrop of an individualistic recovery agenda, researchers have noted recovery-oriented services overshadow interpersonal, relational, and social aspects of recovery, and by extension, carer involvement (<xref ref-type="bibr" rid="B30">30</xref>&#x02013;<xref ref-type="bibr" rid="B32">32</xref>). Better integration of carers into recovery-oriented services needs to address the current understanding of recovery at the conceptual, ideological level (<xref ref-type="bibr" rid="B1">1</xref>, <xref ref-type="bibr" rid="B33">33</xref>), and practical and operational level (<xref ref-type="bibr" rid="B34">34</xref>&#x02013;<xref ref-type="bibr" rid="B36">36</xref>). For instance, the concept of personal recovery has been criticized for being egocentric, placing undue responsibility on the individual, and diminishing the role of a strong supportive network to successfully navigate the recovery process (<xref ref-type="bibr" rid="B1">1</xref>, <xref ref-type="bibr" rid="B36">36</xref>). There are voices who wonder if personal recovery can be conceptualized in any other way than interpersonal, relational, and social (<xref ref-type="bibr" rid="B32">32</xref>, <xref ref-type="bibr" rid="B35">35</xref>, <xref ref-type="bibr" rid="B37">37</xref>).</p>
<p>The context for this study is the national implementation in Norway of the well-known and documented program called the Assertive Community Treatment (ACT). ACT is a highly individualized approach to the community-based care of individuals with severe and persistent mental illness (<xref ref-type="bibr" rid="B38">38</xref>) to support a life outside psychiatric institutions (<xref ref-type="bibr" rid="B39">39</xref>&#x02013;<xref ref-type="bibr" rid="B41">41</xref>). Multidisciplinary teams of mental health professionals provide a comprehensive range of services, including medication management, case management, crisis intervention, and psychosocial rehabilitation, which are tailored to the specific needs of each individual. The overarching goal of ACT is to provide individuals with the support they need to manage their mental illness, live independently in the community, and achieve their personal goals. Historically, the ACT teams targeted deinstitutionalized persons living alone or in group homes and took care of the whole range of needs. However, since carer involvement is mandated by the Norwegian authorities and all mental health services are bound by health legislation and clinical guidelines (<xref ref-type="bibr" rid="B40">40</xref>&#x02013;<xref ref-type="bibr" rid="B42">42</xref>), we expected carers to report satisfactory participation in ACT services for users. However, the carers of ACT users in Norway reported that while the new services were marginally better than the previous mainstream MHS, more than half did not feel included (<xref ref-type="bibr" rid="B43">43</xref>). Further, since recovery orientation has come to be an essential part of MHS, assessment of personal recovery is an important agenda. However, based on the CHIME study, an evaluation of MHS in Europe, Asia, Australia, and USA was undertaken, and the results showed recovery to be the least integrated measure in MHS (<xref ref-type="bibr" rid="B44">44</xref>). Given the non-existence of clinical studies showing carer involvement in services provided by ACT teams, this study sought to involve carers and provide them an opportunity to contribute by assessing, among others, personal recovery of the ACT service users.</p>
</sec>
<sec id="s2">
<title>Aims of the study</title>
<p>The overall aim of this study was to explore the clinical characteristics and possibilities of including carers&#x00027; assessment of personal recovery among Norwegian ACT users. Specific research questions were (i) How do carers and users differ in assessing the user&#x00027;s personal recovery? (ii) Does the familial, personal, and long-standing familiarity of users and carers influence their appraisal of personal recovery? (iii) Is there an associated between the family carer&#x00027;s experience of being included by the ACT team and their assessment of personal recovery?</p>
</sec>
<sec sec-type="methods" id="s3">
<title>Methods</title>
<sec>
<title>Design and participants</title>
<p>The study was carried out as a naturalistic and exploratory study. Participants were recruited from the national implementation of the ACT model in Norway. <xref ref-type="fig" rid="F1">Figure 1</xref> shows the recruitment pathway of the 178 service users recruited to 12 ACT teams and their carers. Seventy service users gave their consent to participate in the national evaluation, and one user dropped out of the study. At the same time that users consented to participate, they were also asked to point out a carer and consent to their participation in the current study. The average age of the users was 40 years, and 32 % were women, and the average age of the carers was 60 years, and 78 % were women. Carers in this study were close family members. There were 26 (72 %) parents and 7 (19 %) siblings. There was also one foster parent, one spouse/partner, and one child over the age of 18 years.</p>
<fig id="F1" position="float">
<label>Figure 1</label>
<caption><p>Flowchart showing recruitment of participants for the study.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fpsyt-14-1135135-g0001.tif"/>
</fig>
</sec>
<sec>
<title>Measures</title>
<p>The interview consisted of closed-ended items from the Questionnaire about the Process of Recovery- QPR (<xref ref-type="bibr" rid="B40">40</xref>, <xref ref-type="bibr" rid="B41">41</xref>). The QPR consists of 22 items with a 5-point Likert scale. In our analyses, we used 0 to mean &#x00022;completely disagree&#x0201D; and 4 to mean &#x0201C;completely agree&#x0201D;. The QPR consists of two subscales, the intrapsychic process and the interpersonal process. The instrument had good internal consistency for the intrapsychic process subscale (a = 0.94) and the interpersonal subscale (a = 0.77). The carers reported on a modified QPR, where the sentence structure was modified to third person to elicit the recovery of the user. For example, the item &#x0201C;I am able to develop positive relationships with other people&#x0201D; was modified to &#x0201C;the patient is able to develop positive relationships with other people.&#x0201D; Cronbach&#x00027;s alpha values for the modified QPR from our study were 0.93 for the intrapersonal process subscale and 0.84 for the interpersonal process scale. Furthermore, we collected data from carers using the Family Involvement and Alienation Questionnaire-FIAQ (<xref ref-type="bibr" rid="B42">42</xref>). The instrument was developed in Sweden and consists of two scales, the experience of approach (a = 0.97) and the feeling of alienation (a = 0.89). We used the experience of approach scale in our study, which consisted of three subscales, openness (a = 0.89), confirmation (a = 0.91), and cooperation (a = 0.90).</p>
</sec>
<sec>
<title>Data collection</title>
<p>Data was collected from the carers and the users by two independent research and co-research groups which used similar procedures. Data collection from the user group is described by Lofthus et al. (<xref ref-type="bibr" rid="B43">43</xref>). In short, a research group developed a questionnaire consisting of, among others, established instruments with acceptable psychometric properties. Co-researchers with lived experience as users of MHS (<italic>n</italic> = 9) conducted structured interviews with the ACT users after receiving appropriate training. Concordantly, the data collection from the carer group was collected by another research group which followed the same procedure for developing the questionnaire, recruiting co-researchers, and data collection. The co-researchers (<italic>n</italic> = 8) in the family carer group were carers of individuals with SMI and members of the National Association of Families of Mental Health (LPP in Norwegian). Their training consisted of a two-day didactic seminar that included a presentation of the ACT project, a scientific method for evaluating mental health, and dry runs of the questionnaire and structured interview process. There was a particular focus on biases and dilemmas in conducting research interviews. Additionally, the research group provided ongoing supervision during data collection.</p>
</sec>
<sec>
<title>Statistical analyses</title>
<p>We conducted three analyses to address the research questions. Two analyses were based on the data available from the total groups of carers (<italic>n</italic> = 36) and users (<italic>n</italic> = 69). We used independent group <italic>T</italic>-tests and effect size calculations to analyze the differences between the total groups. However, due to the naturalistic nature of the study and the difficulties in obtaining consent from users to recruit their caregivers, there were only 18 pairs of matched users and caregivers. Since the carers and users in the subgroup used the same assessment, we conducted paired sample <italic>T</italic>-tests to analyze the differences. Finally, we used Pearson&#x00027;s correlations to analyze the association between the carers (<italic>n</italic> = 36) experiences with the ACT teams and their assessment of personal recovery of the users.</p>
</sec>
<sec>
<title>Ethical approval</title>
<p>The study was approved by the Southeast Regional Ethics Committee for Medical and Health Research (Reg. No. 2010/1196a) and the data protection officer at Akershus University Hospital (Reg. No 2012/094).</p>
</sec>
</sec>
<sec sec-type="results" id="s4">
<title>Results</title>
<p>Independent between-group analyses presented in <xref ref-type="table" rid="T1">Table 1</xref> show the mean scores and standard deviation of the two scales of QPR (intrapsychic process and interpersonal process). The mean scores of the carer group were at the midpoint for both subscales. Independent group <italic>T</italic>-tests confirmed that carers reported significantly lower than the users on both the subscales of intrapsychic process and interpersonal process. The estimation of Cohen&#x00027;s D showed a medium effect size between the groups for both subscales (<italic>d</italic> = 0.69 for the intrapsychic process and <italic>d</italic> = 0.77 for the interpersonal process).</p>
<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption><p>The mean scores and standard deviation of the two scales of Questionnaire of Personal Recovery (QPR) for users (<italic>n</italic> = 69) and carers (<italic>n</italic> = 36).</p></caption> 
<table frame="box" rules="all">
<thead>
<tr style="background-color:&#x00023;919498;color:&#x00023;ffffff">
<th/>
<th valign="top" align="left"><bold>Informant</bold></th>
<th valign="top" align="center"><bold><italic>N</italic></bold></th>
<th valign="top" align="center"><bold>Mean</bold></th>
<th valign="top" align="center"><bold>SD</bold></th>
<th valign="top" align="left"><bold>Independent <italic>T</italic>-test</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">QPR intrapsychic process</td>
<td valign="top" align="left">Users</td>
<td valign="top" align="center">69</td>
<td valign="top" align="center">2.70</td>
<td valign="top" align="center">0.60</td>
<td valign="top" align="left"><italic>t</italic>(103) = 2.34, <italic>p = 0.0</italic>2</td>
</tr>
 <tr>
<td/>
<td valign="top" align="left">Carers</td>
<td valign="top" align="center">36</td>
<td valign="top" align="center">2.02</td>
<td valign="top" align="center">0.83</td>
<td/>
</tr> <tr>
<td valign="top" align="left">QPR interpersonal process</td>
<td valign="top" align="left">Users</td>
<td valign="top" align="center">69</td>
<td valign="top" align="center">2.71</td>
<td valign="top" align="center">0.69</td>
<td valign="top" align="left"><italic>t</italic>(103) = 3.45, <italic>p</italic> &#x0003C; 0.001</td>
</tr>
 <tr>
<td/>
<td valign="top" align="left">Carers</td>
<td valign="top" align="center">36</td>
<td valign="top" align="center">2.17</td>
<td valign="top" align="center">0.89</td>
<td/>
</tr></tbody>
</table>
</table-wrap>
<p>We analyzed the pattern of assessment of personal recovery in the matched carer-user subgroup (<italic>n</italic> = 18). Paired sample <italic>T</italic>-test presented in <xref ref-type="table" rid="T2">Table 2</xref> showed that close family reported significantly lower than the users both on the subscale of the intrapsychic process and on the subscale of the interpersonal process of personal recovery.</p>
<table-wrap position="float" id="T2">
<label>Table 2</label>
<caption><p>The mean scores and standard deviation of QPR sub-scales for users and carers in the matched sub-group (<italic>n</italic> = 18).</p></caption> 
<table frame="box" rules="all">
<thead>
<tr style="background-color:&#x00023;919498;color:&#x00023;ffffff">
<th/>
<th valign="top" align="left"><bold>Informants</bold></th>
<th valign="top" align="center"><bold>N</bold></th>
<th valign="top" align="center"><bold>Mean</bold></th>
<th valign="top" align="center"><bold>SD</bold></th>
<th valign="top" align="left"><bold>Paired sample <italic>T</italic>-test</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">QPR: Intrapsychic process</td>
<td valign="top" align="left">Users</td>
<td valign="top" align="center">18</td>
<td valign="top" align="center">2.84</td>
<td valign="top" align="center">0.48</td>
<td valign="top" align="left"><italic>t</italic>(17) = 3.27, <italic>p = 0.0</italic>04)</td>
</tr>
 <tr>
<td/>
<td valign="top" align="left">Carers</td>
<td valign="top" align="center">18</td>
<td valign="top" align="center">2.10</td>
<td valign="top" align="center">0.81</td>
<td/>
</tr> <tr>
<td valign="top" align="left">QPR: Interpersonal process</td>
<td valign="top" align="left">Users</td>
<td valign="top" align="center">18</td>
<td valign="top" align="center">2.82</td>
<td valign="top" align="center">0.56</td>
<td valign="top" align="left"><italic>t</italic>(17) = 2.53, <italic>p = 0.0</italic>21)</td>
</tr>
 <tr>
<td/>
<td valign="top" align="left">Carers</td>
<td valign="top" align="center">18</td>
<td valign="top" align="center">2.38</td>
<td valign="top" align="center">0.80</td>
<td/>
</tr></tbody>
</table>
</table-wrap>
<p>Next, we assessed if the carers&#x00027; experience and satisfaction with the ACT team were correlated with their evaluation of the users&#x00027; personal recovery. <xref ref-type="table" rid="T3">Table 3</xref> shows the correlation matrix between the Approach subscales of the FIA-Q and both subscales of the QPR. There was only one significant correlation between the various subscales of the carers&#x00027; experience and satisfaction with the ACT team and their assessment of personal recovery of users. The intrapsychic process had a significant negative correlation with the experience of cooperation subscale.</p>
<table-wrap position="float" id="T3">
<label>Table 3</label>
<caption><p>The correlation matrix between the subscales of FIA-Q and QPR reported by carers (<italic>n</italic> = 36).</p></caption> 
<table frame="box" rules="all">
<thead>
<tr style="background-color:&#x00023;919498;color:&#x00023;ffffff">
<th/>
<th valign="top" align="center" colspan="2"><bold>Descriptive statistics</bold></th>
<th valign="top" align="center" colspan="4"><bold>Pearson&#x00027;s correlations</bold></th>
</tr>
</thead>
<tbody>
 <tr style="background-color:&#x00023;919498;color:&#x00023;ffffff">
<td/>
<td valign="top" align="center"><bold>Mean</bold></td>
<td valign="top" align="center"><bold>SD</bold></td>
<td valign="top" align="center"><bold>1</bold></td>
<td valign="top" align="center"><bold>2</bold></td>
<td valign="top" align="center"><bold>3</bold></td>
<td valign="top" align="center"><bold>4</bold></td>
</tr> <tr>
<td valign="top" align="left">1. QPR intrapsychic process</td>
<td valign="top" align="center">2.03</td>
<td valign="top" align="center">0.83</td>
<td/>
<td/>
<td/>
<td/>
</tr> <tr>
<td valign="top" align="left">2. QPR interpersonal process</td>
<td valign="top" align="center">2.17</td>
<td valign="top" align="center">0.89</td>
<td valign="top" align="center">0.73<sup>&#x0002A;&#x0002A;</sup></td>
<td/>
<td/>
<td/>
</tr> <tr>
<td valign="top" align="left">3. FIAQ openness</td>
<td valign="top" align="center">9.21</td>
<td valign="top" align="center">4.06</td>
<td valign="top" align="center">&#x02212;0.18</td>
<td valign="top" align="center">&#x02212;0.16</td>
<td/>
<td/>
</tr> <tr>
<td valign="top" align="left">4. FIAQ confirmation</td>
<td valign="top" align="center">7.00</td>
<td valign="top" align="center">3.39</td>
<td valign="top" align="center">&#x02212;0.25</td>
<td valign="top" align="center">&#x02212;0.14</td>
<td valign="top" align="center">0.88<sup>&#x0002A;&#x0002A;</sup></td>
<td/>
</tr> <tr>
<td valign="top" align="left">5. FIAQ cooperation</td>
<td valign="top" align="center">11.45</td>
<td valign="top" align="center">5.21</td>
<td valign="top" align="center">&#x02212;0.37<sup>&#x0002A;</sup></td>
<td valign="top" align="center">&#x02212;0.26</td>
<td valign="top" align="center">0.86<sup>&#x0002A;&#x0002A;</sup></td>
<td valign="top" align="center">0.91<sup>&#x0002A;&#x0002A;</sup></td>
</tr></tbody>
</table>
<table-wrap-foot>
<p><sup>&#x0002A;&#x0002A;</sup>Correlation is significant at the 0.01 level (2-tailed).</p>
<p><sup>&#x0002A;</sup>Correlation is significant at the 0.05 level (2-tailed).</p>
</table-wrap-foot>
</table-wrap>
</sec>
<sec sec-type="discussion" id="s5">
<title>Discussion</title>
<p>To our knowledge, this is the first study to involve carers and users of ACT services, and assess personal recovery from their point of view. The results showed that the total sample of caregivers (<italic>n</italic> = 36) reported significantly lower than the total sample of users (<italic>n</italic> = 69) on both the intrapsychic process and the interpersonal subscales of personal recovery. Matching the carers and users (<italic>n</italic> = 18) also showed the same pattern. Our results also showed a significant negative correlation between the carers&#x00027; experience of cooperation with the ACT teams and their assessment of the intrapsychic recovery process.</p>
<sec>
<title>High user rating</title>
<p>Users rated themselves about one standard deviation above the mean on both subscales of personal recovery, placing themselves around or above the 84th percentile. The ACT is a novel approach compared to traditional MHS and expecting change is an important condition that affects the treatment process and outcome. Psychotherapy research shows a connection between expectation and outcome rating (<xref ref-type="bibr" rid="B45">45</xref>, <xref ref-type="bibr" rid="B46">46</xref>). However, the lack of pre- and post-measurement in our study limited the scope of the interpretation, and high user rating could be an artifact of the Hawthorne effect, where mere participation in a novel protocol produces better results (<xref ref-type="bibr" rid="B47">47</xref>). Furthermore, since carers did not actively participate in the ACT teams, the Hawthorne effect may not have been relevant to them.</p>
</sec>
<sec>
<title>Low carer rating</title>
<p>The low carer rating can be understood in several ways. First, the mean scores of the carers hovered around the middle of a 5-point Likert scale, which means that the informants neither agreed nor disagreed with the statements and remained neutral. However, the neutrality could be a wishful waiting and watching to see more changes over time and in various social/familial contexts. Second, carers&#x00027; feeling of being excluded by MHS is well documented (<xref ref-type="bibr" rid="B5">5</xref>). It is possible that carers&#x00027; expectancy was already low from the burden of care over a long time-period and poor previous experience with MHS. Therefore, they simply did not find enough reason to expect anything other than low personal recovery of the users. The carers of the ACT users in Norway corroborated this trend by reporting that ACT services were not different from their previous experience with MHS (<xref ref-type="bibr" rid="B16">16</xref>). Third, historically, ACT services have been directed toward users and no carer components were built into the model. Although carer involvement is mandated in Norway, they were neither the target group nor a part of the model driving the ACT services (<xref ref-type="bibr" rid="B48">48</xref>). Therefore, carers may have been excluded and the consequence was that they rated personal recovery more conservatively than did the users.</p>
</sec>
<sec>
<title>Role of a long-standing relationship</title>
<p>We assumed a long-term, close relationship between carers and users in the matched subgroup (<italic>n</italic> = 18) because carers were parents and siblings. Further, it is reasonable to expect that the matched carer-user subgroup is well acquainted with the idiosyncrasies specific to mental illness and to detect emotional and behavioral changes if present. Based on this assumption, it was interesting to note that intimate knowledge of the user showed a lower carer rating compared to the user. Subscribing to the theory of expressed emotion, the lower carer rating may be a function of being overly critical and overly involved with the user (<xref ref-type="bibr" rid="B49">49</xref>). However, since both the total sample and the matched sample in our study had similar results, it suggests that the carers were neutral and waiting to see recovery related benefits over time and across various contexts.</p>
</sec>
<sec>
<title>Association between carers&#x00027; feeling of involvement and rating of personal recovery</title>
<p>There was no significant association between the carer&#x00027;s experience with involvement and their evaluation of personal recovery, with one exception. There was a significant negative correlation between the FIA-Q cooperation subscale and the QPR intrapsychic process subscale. This was an unexpected result, and we conjecture that the ACT teams may have initiated contact and cooperated with carers to stabilize the user after an adverse illness-related episode. Therefore, carers may have associated high level of cooperation with the ACT team, with low level of the intrapersonal recovery process. It is not clear why only the intrapersonal process scale was associated with cooperation but not the interpersonal scale. There may be a technical explanation. Only 5 items of the QPR make up the interpersonal process sub-scale. Psychometric studies of the QPR found weak internal consistency for the interpersonal subscale and strong support for a single-factor solution consisting of 15 items (<xref ref-type="bibr" rid="B50">50</xref>, <xref ref-type="bibr" rid="B51">51</xref>). Therefore, regardless of the direction of the association, the intrapersonal subscale just may have better power to detect the correlation.</p>
</sec>
<sec>
<title>Discrepancy and multi-informant assessments</title>
<p>The discrepancy between informants is an inherent characteristic of multi-informant assessments (<xref ref-type="bibr" rid="B15">15</xref>, <xref ref-type="bibr" rid="B16">16</xref>, <xref ref-type="bibr" rid="B51">51</xref>&#x02013;<xref ref-type="bibr" rid="B55">55</xref>). Differing report of the same phenomenon by the carers and users in our study is neither new nor unexpected. There are ways to handle discrepancies in clinical assessments and test if the pattern of convergence and divergence of multi-informant reports can provide meaningful information. The framework of the Operations Triad Model (OTM) (<xref ref-type="bibr" rid="B56">56</xref>) proposes that there are expected and meaningful reasons for the divergence. For example, expecting divergent information on how the underlying pathology manifests in a different context (home vs. hospital) is intuitive and meaningful. Such expected differences enrich the information base and contribute toward better clinical decisions. However, divergence can occur due to measurement errors or methodological shortcomings, such as using measures with different content and psychometric properties. Differentiating between the two sources and critically assessing the information provides a way to expand the information base, minimize systematic errors in handling multi-informant assessments, and provide a rich information base to make clinical decisions.</p>
<p>However, it may be challenging to secure these strategies in the clinic, given that clinicians may prefer a simple one-source account from the user/patient. A recent experimental study highlighted the complexity of dealing with discrepant reports in MHS. Marsh et al. (<xref ref-type="bibr" rid="B57">57</xref>) conducted four experimental studies and showed that when faced with discrepant information, laypeople and MHS professionals choose to trust one of the informants. Additionally, the choice of whether to trust the client or the informant is based on the specific mental health condition (internalizing or externalizing), the relationship with the client (close or distant), and the nature of the report (optimism vs. pessimism). Carers close to the user who were pessimistic about internalizing conditions were deemed knowledgeable and credible. Likewise, carers who were distant and pessimistic informants of externalizing conditions were deemed more knowledgeable and credible. The information from this study informs how the various conditions could affect the caregiver&#x00027;s report, how they could be evaluated, and how they can be gainfully incorporated into MHS.</p>
</sec>
<sec>
<title>Clinical implications</title>
<p>The discussion above gives reason for optimism about including carers in assessing personal recovery and other clinical processes. The carers were neutral in their evaluation of personal recovery. Given the lack of experience with ACT services, one would expect neutrality. Therefore, we propose that carer rating would provide valuable third-party information beyond MHS context. Clinicians can be skeptical about various sources of information sources, especially if it is conflicting information. However, the framework of OTM (<xref ref-type="bibr" rid="B56">56</xref>) and the experimental study of Marsh et al. (<xref ref-type="bibr" rid="B57">57</xref>) showed that simply being a conservative or pessimistic informant does not disqualify or discredit carers. There are conditions and criteria for which conservative informants are considered knowledgeable and credible compared to caregivers who are optimistic informants. Listening to carers&#x00027; voices and carefully interpreting divergence/convergence of information provides a theoretical and methodological foundation to involve carers in planning, tailoring, and evaluating, ultimately benefiting the users.</p>
</sec>
</sec>
<sec id="s6">
<title>Limitations and future research</title>
<p>The strengths of our study were the use of the clinical sample and the conduct of the first study examining the participation of carers in ACT services in Norway. However, our study also has some limitations. First, to our knowledge, our study is the first to have modified the QPR for use with carers. Therefore, our findings rest on the notion that this approach is an acceptable way for carers to assess personal recovery. Since the alpha values for the modified QPR were high, we are optimistic. A related matter is that the present version of QPR may not have fully captured the interpersonal and relational aspects of personal recovery. Furthermore, our understanding of user reactions to carer evaluation of personal recovery is limited. Qualitative research may be necessary to obtain a more comprehensive understanding of this phenomenon, and future investigations may want to consider this approach. Third, ACT teams in Norway used the &#x0201C;Tool for Measurement of Assertive Community Treatment (TMACT) version 1. Therefore, our results should be understood in the context where there was a lack of systematic inclusion of carers and evaluation of family focused interventions in ACT teams, and generally in the broader clinical setting. Lastly, our study&#x00027;s limited number of participants and use of convenience sampling constrained the scope of research questions, statistical analyses, and generalizability. Future studies with larger sample sizes, particularly of matched pairs, together with a larger battery of measures and covariates, and a qualitative section, would provide more conclusive results and help critical appraisal of the familial and relational aspects of personal recovery.</p>
</sec>
<sec sec-type="conclusions" id="s7">
<title>Conclusions</title>
<p>Including the carers in the assessment of ACT services and the results when compared to the users, is in line with previous clinical literature regarding MHS to individuals with SMI. Discrepancy is an essential feature of the multi-informant methodology. As our study showed, understanding how informants differ and the conditions that affect the direction of the assessments provide a rationale for clinicians and stakeholders in MHS to involve the carers in the assessment and treatment of individuals with SMI. The proactive involvement of the carers would provide valuable third-party information, aid in the treatment process, and help improve the quality of the ACT teams.</p>
</sec>
<sec sec-type="data-availability" id="s8">
<title>Data availability statement</title>
<p>The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.</p>
</sec>
<sec sec-type="ethics-statement" id="s9">
<title>Ethics statement</title>
<p>The studies involving human participants were reviewed and approved by Southeast Regional Ethics Committee for Medical and Health Research (Reg. No. 2010/1196a) and the data protection officer at Akershus University Hospital (Reg. No. 2012/094). The patients/participants provided their written informed consent to participate in this study.</p>
</sec>
<sec sec-type="author-contributions" id="s10">
<title>Author contributions</title>
<p>PI wrote the first draft of the manuscript. All authors contributed to the conception and design of the study, data collection, contributed to the manuscript revision, and read and approved the submitted version.</p>
</sec>
</body>
<back>
<sec sec-type="funding-information" id="s11">
<title>Funding</title>
<p>Data collection and analyses were funded by the Norwegian Directorate of Health (Ref. No. 2009007315) as a part of a national evaluation of ACT teams in Norway. Writing the article was funded by the affiliations of the authors. Open access publication fee is funded by the Department of Social Sciences, University of Stavanger.</p>
</sec>
<sec sec-type="COI-statement" id="conf1">
<title>Conflict of interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="s12">
<title>Publisher&#x00027;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<ref-list>
<title>References</title>
<ref id="B1">
<label>1.</label>
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Adeponle</surname> <given-names>A</given-names></name> <name><surname>Whitley</surname> <given-names>R</given-names></name> <name><surname>Kirmayer</surname> <given-names>LJ</given-names></name></person-group>. <article-title>Cultural contexts and constructions of recovery</article-title>. In:<person-group person-group-type="editor"><name><surname>Rudnick</surname> <given-names>A</given-names></name></person-group>, editor. <source>Recovery of People with Mental Illness</source>. <publisher-loc>Oxford</publisher-loc>: <publisher-name>Oxford University Press</publisher-name> (<year>2013</year>). p. <fpage>109</fpage>&#x02013;<lpage>32</lpage>.</citation>
</ref>
<ref id="B2">
<label>2.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Barbato</surname> <given-names>A</given-names></name> <name><surname>D&#x00027;Avanzo</surname> <given-names>B</given-names></name> <name><surname>D&#x00027;Anza</surname> <given-names>V</given-names></name> <name><surname>Montorfano</surname> <given-names>E</given-names></name> <name><surname>Savio</surname> <given-names>M</given-names></name> <name><surname>Corbascio</surname> <given-names>CG</given-names></name></person-group>. <article-title>Involvement of users and relatives in mental health service evaluation</article-title>. <source>J Nerv Ment Dis.</source> (<year>2014</year>) <volume>202</volume>:<fpage>479</fpage>&#x02013;<lpage>86</lpage>. <pub-id pub-id-type="doi">10.1097/NMD.0000000000000148</pub-id><pub-id pub-id-type="pmid">24886948</pub-id></citation></ref>
<ref id="B3">
<label>3.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jacobson</surname> <given-names>N</given-names></name> <name><surname>Curtis</surname> <given-names>L</given-names></name></person-group>. <article-title>Recovery as policy in mental health services: strategies emerging from the states</article-title>. <source>Psychiatr Rehabil J.</source> (<year>2000</year>) <volume>23</volume>:<fpage>333</fpage>&#x02013;<lpage>41</lpage>. <pub-id pub-id-type="doi">10.1037/h0095146</pub-id></citation>
</ref>
<ref id="B4">
<label>4.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wilkinson</surname> <given-names>C</given-names></name> <name><surname>McAndrew</surname> <given-names>S</given-names></name></person-group>. <article-title>&#x0201C;I&#x00027;m not an outsider, I&#x00027;m his mother!&#x0201D; A phenomenological enquiry into carer experiences of exclusion from acute psychiatric settings</article-title>. <source>Int J Ment Health Nurs.</source> (<year>2008</year>) <volume>17</volume>:<fpage>392</fpage>&#x02013;<lpage>401</lpage>. <pub-id pub-id-type="doi">10.1111/j.1447-0349.2008.00574.x</pub-id><pub-id pub-id-type="pmid">19128286</pub-id></citation></ref>
<ref id="B5">
<label>5.</label>
<citation citation-type="web"><person-group person-group-type="author"><collab>Right Here Right Now: Mental Health Crisis Care Review - Care Quality Commission</collab></person-group>. Available online at: <ext-link ext-link-type="uri" xlink:href="https://www.cqc.org.uk/publications/major-report/right-here-right-now-mental-health-crisis-care-review">https://www.cqc.org.uk/publications/major-report/right-here-right-now-mental-health-crisis-care-review</ext-link> (accessed August 5, 2022).</citation>
</ref>
<ref id="B6">
<label>6.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Slade</surname> <given-names>M</given-names></name> <name><surname>Amering</surname> <given-names>M</given-names></name> <name><surname>Oades</surname> <given-names>L</given-names></name></person-group>. <article-title>Recovery: an international perspective</article-title>. <source>Epidemiol Psichiatr Soc.</source> (<year>2008</year>) <volume>17</volume>:<fpage>128</fpage>&#x02013;<lpage>37</lpage>. <pub-id pub-id-type="doi">10.1017/S1121189X00002827</pub-id><pub-id pub-id-type="pmid">18589629</pub-id></citation></ref>
<ref id="B7">
<label>7.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Anthony</surname> <given-names>WA</given-names></name></person-group>. <article-title>Recovery from mental illness: the guiding vision of the mental health service system in the 1990s</article-title>. <source>Psychosoc Rehabil J.</source> (<year>1993</year>) <volume>16</volume>:<fpage>11</fpage>&#x02013;<lpage>23</lpage>. <pub-id pub-id-type="doi">10.1037/h0095655</pub-id></citation>
</ref>
<ref id="B8">
<label>8.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Llewellyn-Beardsley</surname> <given-names>J</given-names></name> <name><surname>Rennick-Egglestone</surname> <given-names>S</given-names></name> <name><surname>Callard</surname> <given-names>F</given-names></name> <name><surname>Crawford</surname> <given-names>P</given-names></name> <name><surname>Farkas</surname> <given-names>M</given-names></name> <name><surname>Hui</surname> <given-names>A</given-names></name> <etal/></person-group>. <article-title>Characteristics of mental health recovery narratives: systematic review and narrative synthesis</article-title>. <source>PLoS ONE.</source> (<year>2019</year>) <volume>14</volume>:<fpage>e0214678</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0214678</pub-id><pub-id pub-id-type="pmid">30921432</pub-id></citation></ref>
<ref id="B9">
<label>9.</label>
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Slade</surname> <given-names>M</given-names></name></person-group>. <source>Personal recovery and mental illness: a guide for mental health professionals</source>. <publisher-loc>Cambridge</publisher-loc>: <publisher-name>Cambridge University Press</publisher-name> (<year>2009</year>). <pub-id pub-id-type="doi">10.1017/CBO9780511581649</pub-id></citation>
</ref>
<ref id="B10">
<label>10.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ballesteros-Urpi</surname> <given-names>A</given-names></name> <name><surname>Slade</surname> <given-names>M</given-names></name> <name><surname>Manley</surname> <given-names>D</given-names></name> <name><surname>Pardo-Hernandez</surname> <given-names>H</given-names></name></person-group>. <article-title>Conceptual framework for personal recovery in mental health among children and adolescents: A systematic review and narrative synthesis protocol</article-title>. <source>BMJ Open</source>. (<year>2019</year>) <volume>9</volume>:<fpage>e029300</fpage>. <pub-id pub-id-type="doi">10.1136/bmjopen-2019-029300</pub-id><pub-id pub-id-type="pmid">31420391</pub-id></citation></ref>
<ref id="B11">
<label>11.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Leamy</surname> <given-names>M</given-names></name> <name><surname>Bird</surname> <given-names>V</given-names></name> <name><surname>le Boutillier</surname> <given-names>C</given-names></name> <name><surname>Williams</surname> <given-names>J</given-names></name> <name><surname>Slade</surname> <given-names>M</given-names></name></person-group>. <article-title>Conceptual framework for personal recovery in mental health: systematic review and narrative synthesis</article-title>. <source>Br J Psychiatry.</source> (<year>2011</year>) <volume>199</volume>:<fpage>445</fpage>&#x02013;<lpage>52</lpage>. <pub-id pub-id-type="doi">10.1192/bjp.bp.110.083733</pub-id><pub-id pub-id-type="pmid">31420391</pub-id></citation></ref>
<ref id="B12">
<label>12.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bentley</surname> <given-names>KJ</given-names></name> <name><surname>Thissen</surname> <given-names>R</given-names></name></person-group>. <article-title>Family conundrums with psychiatric medication: an inquiry into experiences, beliefs, and desires</article-title>. <source>Commun Mental Health J.</source> (<year>2021</year>) <volume>58</volume>:<fpage>67</fpage>&#x02013;<lpage>77</lpage>. <pub-id pub-id-type="doi">10.1007/s10597-021-00792-y</pub-id><pub-id pub-id-type="pmid">33590382</pub-id></citation></ref>
<ref id="B13">
<label>13.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Slade</surname> <given-names>M</given-names></name> <name><surname>Pinfold</surname> <given-names>V</given-names></name> <name><surname>Rapaport</surname> <given-names>J</given-names></name> <name><surname>Bellringer</surname> <given-names>S</given-names></name> <name><surname>Banerjee</surname> <given-names>S</given-names></name> <name><surname>Kuipers</surname> <given-names>E</given-names></name> <etal/></person-group>. <article-title>Best practice when service users do not consent to sharing information with carers. National multimethod study</article-title>. <source>Br J Psychiatry.</source> (<year>2007</year>) <volume>190</volume>:<fpage>148</fpage>&#x02013;<lpage>55</lpage>. <pub-id pub-id-type="doi">10.1192/bjp.bp.106.024935</pub-id><pub-id pub-id-type="pmid">17267932</pub-id></citation></ref>
<ref id="B14">
<label>14.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Reuman</surname> <given-names>L</given-names></name> <name><surname>Thompson-Hollands</surname> <given-names>J</given-names></name> <name><surname>Abramowitz</surname> <given-names>JS</given-names></name></person-group>. <article-title>Better together: a review and recommendations to optimize research on family involvement in CBT for anxiety and related disorders</article-title>. <source>Behav Ther.</source> (<year>2021</year>) <volume>52</volume>:<fpage>594</fpage>&#x02013;<lpage>606</lpage>. <pub-id pub-id-type="doi">10.1016/j.beth.2020.07.008</pub-id><pub-id pub-id-type="pmid">33990236</pub-id></citation></ref>
<ref id="B15">
<label>15.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>de Los Reyes</surname> <given-names>A</given-names></name> <name><surname>Ohannessian</surname> <given-names>CM</given-names></name> <name><surname>Racz</surname> <given-names>SJ</given-names></name></person-group>. <article-title>Discrepancies between adolescent and parent reports about family relationships</article-title>. <source>Child Dev Perspect.</source> (<year>2019</year>) <volume>13</volume>:<fpage>53</fpage>&#x02013;<lpage>8</lpage>. <pub-id pub-id-type="doi">10.1111/cdep.12306</pub-id></citation>
</ref>
<ref id="B16">
<label>16.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Achenbach</surname> <given-names>TM</given-names></name></person-group>. <article-title>Commentary: Definitely more than measurement error: But how should we understand and deal with informant discrepancies?</article-title> <source>J Clin Child Adol Psychol.</source> (<year>2011</year>) <volume>40</volume>:<fpage>80</fpage>&#x02013;<lpage>6</lpage>. <pub-id pub-id-type="doi">10.1080/15374416.2011.533416</pub-id><pub-id pub-id-type="pmid">21229445</pub-id></citation></ref>
<ref id="B17">
<label>17.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Brown</surname> <given-names>GW</given-names></name> <name><surname>Rutter</surname> <given-names>M</given-names></name></person-group>. <article-title>The measurement of family activities and relationships: a methodological study</article-title>. <source>Human Relations.</source> (<year>1966</year>) <volume>19</volume>:<fpage>241</fpage>&#x02013;<lpage>63</lpage>. <pub-id pub-id-type="doi">10.1177/001872676601900301</pub-id></citation>
</ref>
<ref id="B18">
<label>18.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Barrowclough</surname> <given-names>C</given-names></name> <name><surname>Hooley</surname> <given-names>JM</given-names></name></person-group>. <article-title>Attributions and expressed emotion: a review</article-title>. <source>Clin Psychol Rev.</source> (<year>2003</year>) <volume>23</volume>:<fpage>849</fpage>&#x02013;<lpage>80</lpage>. <pub-id pub-id-type="doi">10.1016/S0272-7358(03)00075-8</pub-id><pub-id pub-id-type="pmid">14529701</pub-id></citation></ref>
<ref id="B19">
<label>19.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schulze</surname> <given-names>B</given-names></name> <name><surname>R&#x000F6;ssler</surname> <given-names>W</given-names></name></person-group>. <article-title>Caregiver burden in mental illness: review of measurement, findings and interventions in 2004&#x02013;2005</article-title>. <source>Curr Opin Psychiatry.</source> <volume>18</volume>:<fpage>684</fpage>&#x02013;<lpage>91</lpage>. <pub-id pub-id-type="doi">10.1097/01.yco.0000179504.87613.00</pub-id><pub-id pub-id-type="pmid">16639098</pub-id></citation></ref>
<ref id="B20">
<label>20.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ram&#x000ED;rez Garc&#x000ED;a</surname> <given-names>JI</given-names></name> <name><surname>Chang</surname> <given-names>CL</given-names></name> <name><surname>Young</surname> <given-names>JS</given-names></name> <name><surname>L&#x000F3;pez</surname> <given-names>SR</given-names></name> <name><surname>Jenkins</surname> <given-names>JH</given-names></name></person-group>. <article-title>Family support predicts psychiatric medication usage among Mexican American individuals with schizophrenia</article-title>. <source>Soc Psychiat Epidemiol.</source> (<year>2006</year>) <volume>41</volume>:<fpage>624</fpage>&#x02013;<lpage>31</lpage>. <pub-id pub-id-type="doi">10.1007/s00127-006-0069-8</pub-id><pub-id pub-id-type="pmid">16733631</pub-id></citation></ref>
<ref id="B21">
<label>21.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Glick</surname> <given-names>ID</given-names></name> <name><surname>Stekoll</surname> <given-names>AH</given-names></name> <name><surname>Hays</surname> <given-names>S</given-names></name></person-group>. <article-title>The role of the family and improvement in treatment maintenance, adherence, and outcome for schizophrenia</article-title>. <source>J Clin Psychopharmacol.</source> (<year>2011</year>) <volume>31</volume>:<fpage>82</fpage>&#x02013;<lpage>5</lpage>. <pub-id pub-id-type="doi">10.1097/JCP.0b013e31820597fa</pub-id><pub-id pub-id-type="pmid">21192148</pub-id></citation></ref>
<ref id="B22">
<label>22.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pfammatter</surname> <given-names>M</given-names></name> <name><surname>Junghan</surname> <given-names>UM</given-names></name> <name><surname>Brenner</surname> <given-names>HD</given-names></name></person-group>. <article-title>Efficacy of psychological therapy in schizophrenia: conclusions from meta-analyses</article-title>. <source>Schizophrenia Bull.</source> (<year>2006</year>) <volume>32</volume>(<supplement>Suppl. 1</supplement>):<fpage>S64</fpage>&#x02013;<lpage>80</lpage>. <pub-id pub-id-type="doi">10.1093/schbul/sbl030</pub-id><pub-id pub-id-type="pmid">16905634</pub-id></citation></ref>
<ref id="B23">
<label>23.</label>
<citation citation-type="book"><person-group person-group-type="author"><name><surname>McDonagh</surname> <given-names>MS</given-names></name> <name><surname>Dana</surname> <given-names>T</given-names></name> <name><surname>Selph</surname> <given-names>S</given-names></name> <name><surname>Devine</surname> <given-names>EB</given-names></name> <name><surname>Cantor</surname> <given-names>A</given-names></name> <name><surname>Bougatsos</surname> <given-names>C</given-names></name> <etal/></person-group>. <source>Treatments for Schizophrenia in Adults: A Systematic Review</source>. <publisher-loc>Rockville, MD</publisher-loc>: <publisher-name>Agency for Healthcare Research and Quality (US)</publisher-name> (<year>2017</year>).<pub-id pub-id-type="pmid">29537779</pub-id></citation></ref>
<ref id="B24">
<label>24.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>McFarlane</surname> <given-names>WR</given-names></name></person-group>. <article-title>Family interventions for schizophrenia and the psychoses: a review</article-title>. <source>Fam Process</source>. (<year>2016</year>) <volume>55</volume>:<fpage>460</fpage>&#x02013;<lpage>82</lpage>. <pub-id pub-id-type="doi">10.1111/famp.12235</pub-id><pub-id pub-id-type="pmid">27411376</pub-id></citation></ref>
<ref id="B25">
<label>25.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>McFarlane</surname> <given-names>WR</given-names></name> <name><surname>Dushay</surname> <given-names>RA</given-names></name> <name><surname>Stastny</surname> <given-names>P</given-names></name> <name><surname>Deakins</surname> <given-names>SM</given-names></name> <name><surname>Link</surname> <given-names>B</given-names></name></person-group>. <article-title>A comparison of two levels of family-aided assertive community treatment</article-title>. <source>Psychiatric Serv.</source> (<year>1996</year>) <volume>47</volume>:<fpage>744</fpage>&#x02013;<lpage>50</lpage>. <pub-id pub-id-type="doi">10.1176/ps.47.7.744</pub-id><pub-id pub-id-type="pmid">8807689</pub-id></citation></ref>
<ref id="B26">
<label>26.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kaselionyte</surname> <given-names>J</given-names></name> <name><surname>Conneely</surname> <given-names>M</given-names></name> <name><surname>Giacco</surname> <given-names>D</given-names></name></person-group>. <article-title>It&#x00027;s a matter of building bridges&#x02026; - feasibility of a carer involvement intervention for inpatients with severe mental illness</article-title>. <source>BMC Psychiatry</source>. (<year>2019</year>) <volume>19</volume>:<fpage>268</fpage>. <pub-id pub-id-type="doi">10.1186/s12888-019-2257-6</pub-id><pub-id pub-id-type="pmid">31481057</pub-id></citation></ref>
<ref id="B27">
<label>27.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lefley</surname> <given-names>HP</given-names></name></person-group>. <article-title>Family psychoeducation for serious mental illness</article-title>. <source>Fam Psychoeduc Serious Ment Illn.</source> (<year>2009</year>) <volume>1</volume>:<fpage>1</fpage>&#x02013;<lpage>208</lpage>. <pub-id pub-id-type="doi">10.1093/acprof:oso/9780195340495.003.0001</pub-id><pub-id pub-id-type="pmid">9117476</pub-id></citation></ref>
<ref id="B28">
<label>28.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lucksted</surname> <given-names>A</given-names></name> <name><surname>Mcfarlane</surname> <given-names>W</given-names></name> <name><surname>Downing</surname> <given-names>D</given-names></name> <name><surname>Dixon</surname> <given-names>L</given-names></name></person-group>. <article-title>Recent developments in family psychoeducation as an evidence-based practice</article-title>. <source>J Marital Fam Ther.</source> (<year>2012</year>) <volume>38</volume>:<fpage>101</fpage>&#x02013;<lpage>21</lpage>. <pub-id pub-id-type="doi">10.1111/j.1752-0606.2011.00256.x</pub-id><pub-id pub-id-type="pmid">22283383</pub-id></citation></ref>
<ref id="B29">
<label>29.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Priebe</surname> <given-names>S</given-names></name> <name><surname>Miglietta</surname> <given-names>E</given-names></name></person-group>. <article-title>Assessment and determinants of patient satisfaction with mental health care</article-title>. <source>World Psychiatry.</source> (<year>2019</year>) <volume>18</volume>:<fpage>30</fpage>&#x02013;<lpage>1</lpage>. <pub-id pub-id-type="doi">10.1002/wps.20586</pub-id><pub-id pub-id-type="pmid">30600613</pub-id></citation></ref>
<ref id="B30">
<label>30.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Topor</surname> <given-names>A</given-names></name> <name><surname>Boe</surname> <given-names>TD</given-names></name> <name><surname>Larsen</surname> <given-names>IB</given-names></name></person-group>. <article-title>The lost social context of recovery psychiatrization of a social process</article-title>. <source>Front Sociol.</source> (<year>2022</year>) <volume>4</volume>:<fpage>7</fpage>. <pub-id pub-id-type="doi">10.3389/fsoc.2022.832201</pub-id><pub-id pub-id-type="pmid">35463189</pub-id></citation></ref>
<ref id="B31">
<label>31.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Price-Robertson</surname> <given-names>R</given-names></name> <name><surname>Obradovic</surname> <given-names>A</given-names></name> <name><surname>Morgan</surname> <given-names>B</given-names></name></person-group>. <article-title>Relational recovery: beyond individualism in the recovery approach</article-title>. <source>Advances in Mental Health.</source> (<year>2016</year>) <volume>15</volume>:<fpage>108</fpage>&#x02013;<lpage>20</lpage>. <pub-id pub-id-type="doi">10.1080/18387357.2016.1243014</pub-id></citation>
</ref>
<ref id="B32">
<label>32.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rose</surname> <given-names>D</given-names></name></person-group>. <article-title>The mainstreaming of recovery</article-title>. <source>J Ment Health.</source> (<year>2014</year>) <volume>23</volume>:<fpage>217</fpage>&#x02013;<lpage>8</lpage>. <pub-id pub-id-type="doi">10.3109/09638237.2014.928406</pub-id><pub-id pub-id-type="pmid">24988317</pub-id></citation></ref>
<ref id="B33">
<label>33.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tew</surname> <given-names>J</given-names></name> <name><surname>Ramon</surname> <given-names>S</given-names></name> <name><surname>Slade</surname> <given-names>M</given-names></name> <name><surname>Bird</surname> <given-names>V</given-names></name> <name><surname>Melton</surname> <given-names>J</given-names></name> <name><surname>le Boutillier</surname> <given-names>C</given-names></name></person-group>. <article-title>Social factors and recovery from mental health difficulties: a review of the evidence</article-title>. <source>Br J Soc Work.</source> (<year>2012</year>) <volume>42</volume>:<fpage>443</fpage>&#x02013;<lpage>60</lpage>. <pub-id pub-id-type="doi">10.1093/bjsw/bcr076</pub-id></citation>
</ref>
<ref id="B34">
<label>34.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Foster</surname> <given-names>K</given-names></name> <name><surname>Goodyear</surname> <given-names>M</given-names></name> <name><surname>Grant</surname> <given-names>A</given-names></name> <name><surname>Weimand</surname> <given-names>B</given-names></name> <name><surname>Nicholson</surname> <given-names>J</given-names></name></person-group>. <article-title>Family-focused practice with EASE: a practice framework for strengthening recovery when mental health consumers are parents</article-title>. <source>Int J Ment Health Nurs.</source> (<year>2019</year>) <volume>28</volume>:<fpage>351</fpage>&#x02013;<lpage>60</lpage>. <pub-id pub-id-type="doi">10.1111/inm.12535</pub-id><pub-id pub-id-type="pmid">30191650</pub-id></citation></ref>
<ref id="B35">
<label>35.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Waller</surname> <given-names>S</given-names></name> <name><surname>Reupert</surname> <given-names>A</given-names></name> <name><surname>Ward</surname> <given-names>B</given-names></name> <name><surname>McCormick</surname> <given-names>F</given-names></name> <name><surname>Kidd</surname> <given-names>S</given-names></name></person-group>. <article-title>Family-focused recovery: perspectives from individuals with a mental illness</article-title>. <source>Int J Ment Health Nurs.</source> (<year>2019</year>) <volume>28</volume>:<fpage>247</fpage>&#x02013;<lpage>55</lpage>. <pub-id pub-id-type="doi">10.1111/inm.12528</pub-id><pub-id pub-id-type="pmid">30142231</pub-id></citation></ref>
<ref id="B36">
<label>36.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Onken</surname> <given-names>SJ</given-names></name> <name><surname>Craig</surname> <given-names>CM</given-names></name> <name><surname>Ridgway</surname> <given-names>P</given-names></name> <name><surname>Ralph</surname> <given-names>RO</given-names></name> <name><surname>Cook</surname> <given-names>JA</given-names></name></person-group>. <article-title>An analysis of the definitions and elements of recovery: a review of the literature</article-title>. <source>Psychiatr Rehabil J.</source> (<year>2007</year>) <volume>31</volume>:<fpage>9</fpage>&#x02013;<lpage>22</lpage>. <pub-id pub-id-type="doi">10.2975/31.1.2007.9.22</pub-id><pub-id pub-id-type="pmid">17694711</pub-id></citation></ref>
<ref id="B37">
<label>37.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ward</surname> <given-names>B</given-names></name> <name><surname>Reupert</surname> <given-names>A</given-names></name> <name><surname>McCormick</surname> <given-names>F</given-names></name> <name><surname>Waller</surname> <given-names>S</given-names></name> <name><surname>Kidd</surname> <given-names>S</given-names></name></person-group>. <article-title>Family-focused practice within a recovery framework: practitioners&#x00027; qualitative perspectives</article-title>. <source>BMC Health Serv Res.</source> (<year>2017</year>) <volume>17</volume>:<fpage>234</fpage>. <pub-id pub-id-type="doi">10.1186/s12913-017-2146-y</pub-id><pub-id pub-id-type="pmid">28340614</pub-id></citation></ref>
<ref id="B38">
<label>38.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bond</surname> <given-names>GR</given-names></name> <name><surname>Drake</surname> <given-names>RE</given-names></name> <name><surname>Mueser</surname> <given-names>KT</given-names></name> <name><surname>Latimer</surname> <given-names>E</given-names></name></person-group>. <article-title>Assertive community treatment for people with severe mental illness: critical ingredients and impact on patients</article-title>. <source>Dis Manag Health Outcomes.</source> (<year>2001</year>) <volume>9</volume>:<fpage>141</fpage>&#x02013;<lpage>59</lpage>. <pub-id pub-id-type="doi">10.2165/00115677-200109030-00003</pub-id></citation>
</ref>
<ref id="B39">
<label>39.</label>
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Allness</surname> <given-names>D</given-names></name> <name><surname>Knoedler</surname> <given-names>WH</given-names></name></person-group>. <source>A Manual for ACT Start-Up : Based on the PACT Model of Community Treatment for Persons With Severe and Persistent Mental Illnesses</source>. <publisher-loc>NAMI</publisher-loc>: <publisher-name>Arlington</publisher-name> (<year>2003</year>).</citation>
</ref>
<ref id="B40">
<label>40.</label>
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Stein</surname> <given-names>LL</given-names></name> <name><surname>Santos</surname> <given-names>AB</given-names></name></person-group>. <source>Assertive Community Treatment of Persons with Severe Mental Illness</source>. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Norton</publisher-name> (<year>1998</year>).</citation>
</ref>
<ref id="B41">
<label>41.</label>
<citation citation-type="web"><person-group person-group-type="author"><collab>Om Helsedirektoratets normerende produkter - Helsedirektoratet</collab></person-group>. Available online at: <ext-link ext-link-type="uri" xlink:href="https://www.helsedirektoratet.no/produkter/om-helsedirektoratets-normerende-produkter">https://www.helsedirektoratet.no/produkter/om-helsedirektoratets-normerende-produkter</ext-link> (accessed August 5, 2022).</citation>
</ref>
<ref id="B42">
<label>42.</label>
<citation citation-type="web"><person-group person-group-type="author"><collab>P&#x000E5;r&#x000F8;rendeveileder- Helsedirektoratet</collab></person-group>. Available online at: <ext-link ext-link-type="uri" xlink:href="https://www.helsedirektoratet.no/veiledere/parorendeveileder">https://www.helsedirektoratet.no/veiledere/parorendeveileder</ext-link> (accessed August 5, 2022).</citation>
</ref>
<ref id="B43">
<label>43.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Weimand</surname> <given-names>BM</given-names></name> <name><surname>Israel</surname> <given-names>P</given-names></name> <name><surname>Ewertzon</surname> <given-names>M</given-names></name></person-group>. <article-title>Families in assertive community treatment (ACT) teams in Norway: a cross-sectional study on relatives&#x00027; experiences of involvement and alienation</article-title>. <source>Community Ment Health J.</source> (<year>2018</year>) <volume>54</volume>:<fpage>686</fpage>&#x02013;<lpage>97</lpage>. <pub-id pub-id-type="doi">10.1007/s10597-017-0207-7</pub-id><pub-id pub-id-type="pmid">29127565</pub-id></citation></ref>
<ref id="B44">
<label>44.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Parameswaran</surname> <given-names>S</given-names></name> <name><surname>Spaeth-Rublee</surname> <given-names>B</given-names></name> <name><surname>Huynh</surname> <given-names>PT</given-names></name> <name><surname>Pincus</surname> <given-names>HA</given-names></name></person-group>. <article-title>Comparison of national mental health quality assessment programs across the globe</article-title>. <source>Psychiatric Serv.</source> (<year>2012</year>) <volume>63</volume>:<fpage>982</fpage>&#x02013;<lpage>8</lpage>. <pub-id pub-id-type="doi">10.1176/appi.ps.201100382</pub-id><pub-id pub-id-type="pmid">22855298</pub-id></citation></ref>
<ref id="B45">
<label>45.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Antichi</surname> <given-names>L</given-names></name> <name><surname>Cacciamani</surname> <given-names>A</given-names></name> <name><surname>Chelini</surname> <given-names>C</given-names></name> <name><surname>Morelli</surname> <given-names>M</given-names></name> <name><surname>Piacentini</surname> <given-names>S</given-names></name> <name><surname>Pirillo</surname> <given-names>GL</given-names></name></person-group>. <article-title>Expectations in psychotherapy: an overview</article-title>. <source>Ricerche di Psicologia.</source> (<year>2022</year>) <volume>1</volume>:<fpage>1</fpage>&#x02013;<lpage>19</lpage>. <pub-id pub-id-type="doi">10.3280/rip2022oa13574</pub-id></citation>
</ref>
<ref id="B46">
<label>46.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Thiruchselvam</surname> <given-names>T</given-names></name> <name><surname>Dozois</surname> <given-names>DJA</given-names></name> <name><surname>Bagby</surname> <given-names>RM</given-names></name> <name><surname>Lobo</surname> <given-names>DSS</given-names></name> <name><surname>Ravindran</surname> <given-names>LN</given-names></name> <name><surname>Quilty</surname> <given-names>LC</given-names></name></person-group>. <article-title>The role of outcome expectancy in therapeutic change across psychotherapy versus pharmacotherapy for depression</article-title>. <source>J Affect Disord.</source> (<year>2019</year>) <volume>251</volume>:<fpage>121</fpage>&#x02013;<lpage>9</lpage>. <pub-id pub-id-type="doi">10.1016/j.jad.2019.01.046</pub-id><pub-id pub-id-type="pmid">30921595</pub-id></citation></ref>
<ref id="B47">
<label>47.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>McCambridge</surname> <given-names>J</given-names></name> <name><surname>Witton</surname> <given-names>J</given-names></name> <name><surname>Elbourne</surname> <given-names>DR</given-names></name></person-group>. <article-title>Systematic review of the Hawthorne effect: New concepts are needed to study research participation effects</article-title>. <source>J Clin Epidemiol.</source> (<year>2014</year>) <volume>67</volume>:<fpage>267</fpage>&#x02013;<lpage>77</lpage>. <pub-id pub-id-type="doi">10.1016/j.jclinepi.2013.08.015</pub-id><pub-id pub-id-type="pmid">24275499</pub-id></citation></ref>
<ref id="B48">
<label>48.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Odden</surname> <given-names>S</given-names></name> <name><surname>Landheim</surname> <given-names>A</given-names></name> <name><surname>Clausen</surname> <given-names>H</given-names></name> <name><surname>Stuen</surname> <given-names>HK</given-names></name> <name><surname>Heiervang</surname> <given-names>KS</given-names></name> <name><surname>Ruud</surname> <given-names>T</given-names></name></person-group>. <article-title>Model fidelity and team members&#x00027; experiences of assertive community treatment in Norway: a sequential mixed-methods study</article-title>. <source>Int J Ment Health Syst.</source> (<year>2019</year>) <volume>13</volume>:<fpage>65</fpage>. <pub-id pub-id-type="doi">10.1186/s13033-019-0321-8</pub-id><pub-id pub-id-type="pmid">31636700</pub-id></citation></ref>
<ref id="B49">
<label>49.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Vaughn</surname> <given-names>C</given-names></name> <name><surname>Leff</surname> <given-names>J</given-names></name></person-group>. <article-title>The measurement of expressed emotion in the families of psychiatric patients</article-title>. <source>Br J Soc Clin Psychol.</source> (<year>1976</year>) <volume>15</volume>:<fpage>157</fpage>&#x02013;<lpage>65</lpage>. <pub-id pub-id-type="doi">10.1111/j.2044-8260.1976.tb00021.x</pub-id><pub-id pub-id-type="pmid">938822</pub-id></citation></ref>
<ref id="B50">
<label>50.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Williams</surname> <given-names>J</given-names></name> <name><surname>Leamy</surname> <given-names>M</given-names></name> <name><surname>Pesola</surname> <given-names>F</given-names></name> <name><surname>Bird</surname> <given-names>V</given-names></name> <name><surname>Le Boutillier</surname> <given-names>C</given-names></name> <name><surname>Slade</surname> <given-names>M</given-names></name></person-group>. <article-title>Psychometric evaluation of the questionnaire about the process of recovery (QPR)</article-title>. <source>Br J Psychiatry.</source> (<year>2015</year>) <volume>207</volume>:<fpage>551</fpage>&#x02013;<lpage>55</lpage>. <pub-id pub-id-type="doi">10.1192/bjp.bp.114.161695</pub-id><pub-id pub-id-type="pmid">26450585</pub-id></citation></ref>
<ref id="B51">
<label>51.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Law</surname> <given-names>H</given-names></name> <name><surname>Neil</surname> <given-names>S</given-names></name> <name><surname>Dunn</surname> <given-names>G</given-names></name> <name><surname>Morrison</surname> <given-names>A</given-names></name></person-group>. <article-title>Psychometric properties of the questionnaire about the process of recovery (QPR)</article-title>. <source>Schizophr Res</source>. (<year>2014</year>) <volume>156</volume>:<fpage>184</fpage>&#x02013;<lpage>9</lpage>. <pub-id pub-id-type="doi">10.1016/j.schres.2014.04.011</pub-id><pub-id pub-id-type="pmid">28696806</pub-id></citation></ref>
<ref id="B52">
<label>52.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hunsley</surname> <given-names>J</given-names></name> <name><surname>Mash</surname> <given-names>EJ</given-names></name></person-group>. <article-title>Evidence-based assessment</article-title>. <source>Annu Rev Clin Psychol.</source> (<year>2007</year>) <volume>3</volume>:<fpage>29</fpage>&#x02013;<lpage>51</lpage>. <pub-id pub-id-type="doi">10.1146/annurev.clinpsy.3.022806.091419</pub-id><pub-id pub-id-type="pmid">17716047</pub-id></citation></ref>
<ref id="B53">
<label>53.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lofthus</surname> <given-names>AM</given-names></name> <name><surname>Westerlund</surname> <given-names>H</given-names></name> <name><surname>Bj&#x000F8;rgen</surname> <given-names>D</given-names></name> <name><surname>Lindstr&#x000F8;m</surname> <given-names>JC</given-names></name> <name><surname>Lauveng</surname> <given-names>A</given-names></name> <name><surname>Clausen</surname> <given-names>H</given-names></name> <etal/></person-group>. <article-title>Are users satisfied with assertive community treatment in spite of personal restrictions?</article-title> <source>Commun Ment Health J.</source> (<year>2016</year>) <volume>52</volume>:<fpage>891</fpage>&#x02013;<lpage>7</lpage>. <pub-id pub-id-type="doi">10.1007/s10597-016-9994-5</pub-id><pub-id pub-id-type="pmid">26868646</pub-id></citation></ref>
<ref id="B54">
<label>54.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Neil</surname> <given-names>ST</given-names></name> <name><surname>Kilbride</surname> <given-names>M</given-names></name> <name><surname>Pitt</surname> <given-names>L</given-names></name> <name><surname>Nothard</surname> <given-names>S</given-names></name> <name><surname>Welford</surname> <given-names>M</given-names></name> <name><surname>Sellwood</surname> <given-names>W</given-names></name> <etal/></person-group>. <article-title>The questionnaire about the process of recovery (QPR): a measurement tool developed in collaboration with service users</article-title>. <source>Psychosis.</source> (<year>2009</year>) <volume>1</volume>:<fpage>145</fpage>&#x02013;<lpage>55</lpage>. <pub-id pub-id-type="doi">10.1080/17522430902913450</pub-id></citation>
</ref>
<ref id="B55">
<label>55.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ewertzon</surname> <given-names>M</given-names></name> <name><surname>L&#x000FC;tz&#x000E9;n</surname> <given-names>K</given-names></name> <name><surname>Svensson</surname> <given-names>E</given-names></name> <name><surname>Andershed</surname> <given-names>B</given-names></name></person-group>. <article-title>Developing the concept of family involvement and the alienation questionnaire in the context of psychiatric care</article-title>. <source>Int J Ment Health Nurs.</source> (<year>2008</year>) <volume>17</volume>:<fpage>439</fpage>&#x02013;<lpage>49</lpage>. <pub-id pub-id-type="doi">10.1111/j.1447-0349.2008.00570.x</pub-id><pub-id pub-id-type="pmid">19128291</pub-id></citation></ref>
<ref id="B56">
<label>56.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>de Los Reyes</surname> <given-names>A</given-names></name> <name><surname>Augenstein</surname> <given-names>TM</given-names></name> <name><surname>Wang</surname> <given-names>M</given-names></name> <name><surname>Thomas</surname> <given-names>SA</given-names></name> <name><surname>Drabick</surname> <given-names>DAG</given-names></name> <name><surname>Burgers</surname> <given-names>DE</given-names></name> <etal/></person-group>. <article-title>The validity of the multi-informant approach to assessing child and adolescent mental health</article-title>. <source>Psychol Bull.</source> (<year>2015</year>) <volume>141</volume>:<fpage>858</fpage>. <pub-id pub-id-type="doi">10.1037/a0038498</pub-id><pub-id pub-id-type="pmid">25915035</pub-id></citation></ref>
<ref id="B57">
<label>57.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Marsh</surname> <given-names>JK</given-names></name> <name><surname>Zeveney</surname> <given-names>AS</given-names></name> <name><surname>de Los Reyes</surname> <given-names>A</given-names></name></person-group>. <article-title>Informant discrepancies in judgments about change during mental health treatments</article-title>. <source>Clin Psychol Sci.</source> (<year>2020</year>) <volume>8</volume>:<fpage>318</fpage>&#x02013;<lpage>32</lpage>. <pub-id pub-id-type="doi">10.1177/2167702619894905</pub-id><pub-id pub-id-type="pmid">33175470</pub-id></citation></ref>
</ref-list> 
</back>
</article> 