<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="brief-report">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Vet. Sci.</journal-id>
<journal-title>Frontiers in Veterinary Science</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Vet. Sci.</abbrev-journal-title>
<issn pub-type="epub">2297-1769</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fvets.2021.769112</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Veterinary Science</subject>
<subj-group>
<subject>Brief Research Report</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Linguistic Validation of the Canine Brief Pain Inventory (CBPI) for Global Use</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Wells</surname> <given-names>Jane R.</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/436149/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Young</surname> <given-names>Alyson L.</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/1437677/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Crane</surname> <given-names>Alexandra</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/1441771/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Moyaert</surname> <given-names>Hilde</given-names></name>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/1437645/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Michels</surname> <given-names>Gina</given-names></name>
<xref ref-type="aff" rid="aff4"><sup>4</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/1437899/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Wright</surname> <given-names>Andrea</given-names></name>
<xref ref-type="aff" rid="aff5"><sup>5</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/886835/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Patient-Centered Outcomes, Adelphi Values Ltd, Adelphi Mill</institution>, <addr-line>Cheshire</addr-line>, <country>United Kingdom</country></aff>
<aff id="aff2"><sup>2</sup><institution>TransPerfect</institution>, <addr-line>New York, NY</addr-line>, <country>United States</country></aff>
<aff id="aff3"><sup>3</sup><institution>Veterinary Medicine Research and Development, Zoetis Belgium SA</institution>, <addr-line>Zaventem</addr-line>, <country>Belgium</country></aff>
<aff id="aff4"><sup>4</sup><institution>Veterinary Medicine Research and Development, Zoetis Inc</institution>, <addr-line>Kalamazoo, MI</addr-line>, <country>United States</country></aff>
<aff id="aff5"><sup>5</sup><institution>Outcomes Research, Zoetis Inc</institution>, <addr-line>Parsippany, NJ</addr-line>, <country>United States</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Lee Niel, University of Guelph, Canada</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Giorgia Della Rocca, University of Perugia, Italy; Ann Essner, IVC Evidensia Djurkliniken Gefle, Sweden</p></fn>
<corresp id="c001">&#x0002A;Correspondence: Jane R. Wells <email>jane.wells&#x00040;adelphivalues.com</email></corresp>
<fn fn-type="other" id="fn001"><p>This article was submitted to Animal Behavior and Welfare, a section of the journal Frontiers in Veterinary Science</p></fn></author-notes>
<pub-date pub-type="epub">
<day>29</day>
<month>11</month>
<year>2021</year>
</pub-date>
<pub-date pub-type="collection">
<year>2021</year>
</pub-date>
<volume>8</volume>
<elocation-id>769112</elocation-id>
<history>
<date date-type="received">
<day>01</day>
<month>09</month>
<year>2021</year>
</date>
<date date-type="accepted">
<day>08</day>
<month>11</month>
<year>2021</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2021 Wells, Young, Crane, Moyaert, Michels and Wright.</copyright-statement>
<copyright-year>2021</copyright-year>
<copyright-holder>Wells, Young, Crane, Moyaert, Michels and Wright</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license> 
</permissions>
<abstract><p>A valid and reliable quantitative measure of chronic pain is essential for developing and evaluating interventions that aim to treat pain. In dogs, the Canine Brief Pain Inventory (CBPI) was originally adapted from a human measure, the Brief Pain Inventory, to assess owner-perceived pain and the impact of such pain on a dog&#x00027;s daily functioning. To be reliable and valid, data collected using a translated instrument should have evidence it is an accurate representation of the original instrument and is culturally appropriate for use in the intended context. To achieve this, instruments should undergo a rigorous translation process and be debriefed in the intended population of use. The CBPI is widely accepted and has been fully validated for use in US-English, Swedish, Italian, and French (France); further translation and validation of the CBPI is required to increase access to and use in other languages and countries. The objective of this study was to linguistically validate the CBPI for global use (Australia, China, Germany, Hungary, Ireland, Japan, Netherlands and Portugal). In cognitive debriefing with a representative sample of dog owners in the target countries it was confirmed that the translations of the CBPI adequately convey the concepts in the original US-English version and that items are easily understood by dog owners. The results of the linguistic validation process thus produced measures that are conceptually equivalent to the original US-English-language CBPI and are culturally appropriate for use in the target countries.</p></abstract>
<kwd-group>
<kwd>linguistic validation</kwd>
<kwd>canine</kwd>
<kwd>translation</kwd>
<kwd>Canine Brief Pain Inventory</kwd>
<kwd>pain</kwd>
</kwd-group>
<contract-sponsor id="cn001">Zoetis<named-content content-type="fundref-id">10.13039/100012895</named-content></contract-sponsor>
<counts>
<fig-count count="1"/>
<table-count count="2"/>
<equation-count count="0"/>
<ref-count count="18"/>
<page-count count="7"/>
<word-count count="4810"/>
</counts>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="s1">
<title>Introduction</title>
<p>The often complex, multidimensional, and subjective nature of pain makes it difficult to assess. Valid and reliable measures of pain are therefore essential for developing and evaluating interventions (e.g., drugs or surgical procedures) that aim to treat such pain (<xref ref-type="bibr" rid="B1">1</xref>, <xref ref-type="bibr" rid="B2">2</xref>). In dogs, pain assessment tools have been developed and validated to capture owner-perceived pain in canines, specifically for osteoarthritis (<xref ref-type="bibr" rid="B2">2</xref>, <xref ref-type="bibr" rid="B3">3</xref>). One such assessment is the Canine Brief Pain Inventory (CBPI), which has been adapted from the human measure, the Brief Pain Inventory (BPI) (<xref ref-type="bibr" rid="B4">4</xref>&#x02013;<xref ref-type="bibr" rid="B6">6</xref>), to assess a dog&#x00027;s pain severity and pain interference in their daily activities. The CBPI draws on the owner&#x00027;s understanding and awareness of their dog&#x00027;s behavioral changes that might indicate pain (<xref ref-type="bibr" rid="B2">2</xref>, <xref ref-type="bibr" rid="B7">7</xref>). Items for the CBPI were generated in interviews and cognitively debriefed with dog owners, and psychometric validation has demonstrated adequate construct validity and criterion validity for measuring a dog&#x00027;s pain (<xref ref-type="bibr" rid="B2">2</xref>, <xref ref-type="bibr" rid="B7">7</xref>), as well as the ability to detect clinically important changes in a dog over time (<xref ref-type="bibr" rid="B8">8</xref>).</p>
<p>For broad adoption, translation of the CBPI is an essential step to ensure its use as a standardized, valid, and reliable measure in clinical research and practice. Linguistic validation is the process by which translated measures are assessed for cultural appropriateness and conceptual equivalence, and to ensure that content validity of the original measure has not been affected by translation (<xref ref-type="bibr" rid="B9">9</xref>). This mitigates the risk of data being invalid due to ambiguous or incorrect translation of items or instructions, and better ensures that any differences in responses between contributing populations are due to differences between groups rather than differences in how the data were collected (<xref ref-type="bibr" rid="B9">9</xref>, <xref ref-type="bibr" rid="B10">10</xref>). Evidence of linguistic validation means that a translated instrument can more confidently be used in populations where the participant&#x00027;s first language differs from that of the original instrument and for the resulting data to be aggregated and compared across cultures and languages because the same measure has been used (<xref ref-type="bibr" rid="B9">9</xref>, <xref ref-type="bibr" rid="B10">10</xref>).</p>
<p>Since its initial development in US English, the CBPI has been translated and validated for use in Swedish (<xref ref-type="bibr" rid="B11">11</xref>), French (<xref ref-type="bibr" rid="B12">12</xref>) and Italian (<xref ref-type="bibr" rid="B13">13</xref>), with initial psychometric validation of the French CBPI indicating evidence of construct validity, convergent validity, and strong internal consistency (<xref ref-type="bibr" rid="B12">12</xref>). The aim of this study was to develop conceptually equivalent and culturally relevant versions of the CBPI for use in Australia (English), Ireland (English), China (Chinese, simplified), Japan (Japanese), Hungary (Hungarian), Germany (German), Portugal (Portuguese), and the Netherlands (Dutch), as a first step in establishing the CBPI as an internationally validated owner-reported measure for evaluating pain in dogs.</p>
</sec>
<sec sec-type="materials and methods" id="s2">
<title>Materials and Methods</title>
<p>Using established methods from the World Health Organization (WHO) and the International Society of Pharmoeconomics and Outcomes Research (ISPOR) (<xref ref-type="bibr" rid="B9">9</xref>, <xref ref-type="bibr" rid="B10">10</xref>, <xref ref-type="bibr" rid="B14">14</xref>, <xref ref-type="bibr" rid="B15">15</xref>), the CBPI was translated into Australian-English (Australia), Simplified Chinese (China), Dutch (Netherlands), German (Germany), Hungarian (Hungary), Irish-English (Ireland), Japanese (Japan), and Portuguese (Portugal) and cognitively debriefed with a sample of dog owners from each country to evaluate their understanding of the measure and confirm that the translations of the CBPI adequately convey the concepts in the original US-English version. Permission to translate the CBPI was given by the developer.</p>
<p>Prior to translation, the CBPI was divided into key terms and phrases, with definitions for each concept, to ensure the intended meaning was captured in the translation. All translators (linguists) aimed for conceptual equivalence to the source and cultural appropriateness for the target country. The translation and validation process is outlined in <xref ref-type="fig" rid="F1">Figure 1</xref>.</p>
<fig id="F1" position="float">
<label>Figure 1</label>
<caption><p>Translation and linguistic validation process.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fvets-08-769112-g0001.tif"/>
</fig>
<p>Just as in the original CBPI, all translated versions consist of four items pertaining to the severity of pain evident in a dog (pain severity domain) and six items relating to pain interference with daily activities (pain interference domain). Items in both domains are measured using a 0&#x02013;10 numerical rating scale. For the pain severity domain items, 0 = no pain and 10 = extreme pain. For the interference domain items, 0 = does not interfere and 10 = completely interferes. Means values for each set of responses are calculated to determine the pain severity and pain interference scores, respectively. A single global quality of life (QoL) item is included to obtain the owner&#x00027;s overall assessment of the dog&#x00027;s QoL status. This item assesses QoL using a 5-point categoric response scale (1 = poor; 2 = fair; 3 = good; 4 = very good; and 5 = excellent) (<xref ref-type="bibr" rid="B2">2</xref>, <xref ref-type="bibr" rid="B8">8</xref>).</p>
<sec>
<title>Translation Process</title>
<p>Two native-speaking linguists of the target language independently performed forward translations on the CBPI. A third independent native-speaking linguist compared the two forward translations to identify any discrepancies or cultural differences in order to create a unified forward translation (reconciliation). An independent linguist with native-level English proficiency and fluent in the target language then translated the reconciled document back to the source language (US-English) using the forward translation as source material (back translation). Following this, an independent review was performed by a team of linguists (both English and target languages), a quality manager, and a project manager to examine and resolve any discrepancies between the forward translation, back translation, and source document (resolution). The reconciled forward and back translations were then reviewed to ensure clarity of wording and intended measurement of concepts were captured in the translation. Reviewer comments were then assessed by a linguist to resolve any issues with the translation.</p>
<p>For the Australian-English and Irish-English versions, the source content was first localized to local language conventions to produce a forward &#x0201C;translation&#x0201D; and then reviewed to ensure clarity of wording and intended measurement concepts were captured (<xref ref-type="bibr" rid="B10">10</xref>).</p>
</sec>
<sec>
<title>Cognitive Debriefing Interviews</title>
<p>Following translation, cognitive interviews were conducted with dog owners to determine if the CBPI instructions, response options, and items were clear, unambiguous, and relevant to participants. Participants included five dog owners from each target country (<italic>n</italic> = 40) (<xref ref-type="bibr" rid="B9">9</xref>). Participants were asked to read through the CBPI, discuss how they understood each item and the associated response options, and suggest potential alternative wording. Findings were used to make further adjustments to the translations.</p>
<p>For the German, Chinese, and Japanese translations, the back translation was reviewed a second time following updates from the cognitive interviews. This was done to ensure that any additional modifications made at this stage were conceptually equivalent to the source material. Conceptual equivalence was either confirmed by a linguist or further modifications were made to better align the translation with the source material.</p>
</sec>
<sec>
<title>Finalization</title>
<p>In the last step, a native-speaking linguist of the target language proof-read the document, leading to the final translation for the target country.</p>
</sec>
</sec>
<sec sec-type="results" id="s3">
<title>Results</title>
<p>The linguistic validation process led to Australian-English (Australia), Simplified Chinese (China), Dutch (Netherlands), German (Germany), Hungarian (Hungary), Irish-English (Ireland), Japanese (Japan), and Portuguese (Portugal) versions CBPI that are linguistically validated and conceptually equivalent to the original US English version. Example changes made throughout the linguistic validation process for the Portuguese translation can be found in <xref ref-type="table" rid="T1">Table 1</xref>.</p>
<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption><p>Examples of discrepancies and changes in the linguistic validation process for Portuguese.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th valign="top" align="left"><bold>Source (US-En)</bold></th>
<th valign="top" align="left"><bold>Forward translation and reconciliation</bold></th>
<th valign="top" align="left"><bold>Back translation</bold></th>
<th valign="top" align="left"><bold>Independent review (Resolution)</bold></th>
<th valign="top" align="left"><bold>Reviewer feedback</bold></th>
<th valign="top" align="left"><bold>Linguist feedback</bold></th>
<th valign="top" align="left"><bold>Cognitive debrief</bold></th>
<th valign="top" align="left"><bold>Linguist feedback</bold></th>
<th valign="top" align="left"><bold>Updated back translation</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Rate your dog&#x00027;s pain</td>
<td valign="top" align="left">Consensus reached on forward translation:<break/> <italic>Classifique a dor do seu c&#x000E3;o</italic></td>
<td valign="top" align="left">Please rate your dog&#x00027;s pain</td>
<td valign="top" align="left">It is confirmed that the FT and BT are accurate reflections of the English source</td>
<td valign="top" align="left">Does this need to have &#x02018;please&#x02019; for local reasons?</td>
<td valign="top" align="left">No, please is not needed and it is not included in the translation. Translation is correct as it is. BT updated to better reflect FT source:<break/> Rate your dog&#x00027;s pain</td>
<td valign="top" align="left">No difficulties reported</td>
<td valign="top" align="left">No revision needed</td>
<td valign="top" align="left">Rate your dog&#x00027;s pain</td>
</tr>
<tr>
<td valign="top" align="left">Fill in the oval next to the one number that best describes the pain at its worst in the last 7 days</td>
<td valign="top" align="left">Forward translations differed. Reconciled by third linguist:<break/> <italic>Preencha o espa&#x000E7;o oval a sequir ao n&#x000FA;mero que melhor descreve a pior dor nos &#x000FA;ltimos 7 dias</italic></td>
<td valign="top" align="left">Fill in the oval space after the number that best describes the worst pain in the last 7 days</td>
<td valign="top" align="left">FT updated to match reference as requested:<break/> Preencha o oval junto ao n&#x000FA;mero que melhor descreve o nivel de dor mais forte nos &#x000FA;ltimos 7 dias<break/> BT updated accordingly:<break/> Fill in the oval next to the one number that best describes the pain at its worst in the last 7 days</td>
<td valign="top" align="left">Agree</td>
<td valign="top" align="left">No revision needed</td>
<td valign="top" align="left">No difficulties reported</td>
<td valign="top" align="left">No revision needed. R4 suggested using the word &#x0201C;circulo&#x0201D; instead of &#x0201C;oval&#x0201D; but had no problem understanding</td>
<td valign="top" align="left">Fill in the oval next to the one number that best describes the pain at its worst in the last 7 days</td>
</tr>
<tr>
<td valign="top" align="left">No Pain</td>
<td valign="top" align="left">Forward translations differed. Reconciled by third linguist:<break/> <italic>Nenhuma dor</italic></td>
<td valign="top" align="left">No pain</td>
<td valign="top" align="left">FT updated to match reference as requested:<break/> <italic>Sem dor</italic><break/> BT updated accordingly:<break/> No pain</td>
<td valign="top" align="left">Agree</td>
<td valign="top" align="left">No revisions needed</td>
<td valign="top" align="left">No difficulties reported</td>
<td valign="top" align="left">No revisions needed</td>
<td valign="top" align="left">No pain</td>
</tr>
<tr>
<td valign="top" align="left">Does not interfere</td>
<td valign="top" align="left">Forward translations differed. Reconciled by third linguist:<break/> <italic>N&#x000E3;o interfere</italic></td>
<td valign="top" align="left">Does not interfere</td>
<td valign="top" align="left">FT updated to match reference as requested:<break/> <italic>N&#x000E3;o interferiu</italic><break/> No revision needed to BT</td>
<td valign="top" align="left">Agree</td>
<td valign="top" align="left">No revisions needed</td>
<td valign="top" align="left">No difficulties reported</td>
<td valign="top" align="left">No revisions needed</td>
<td valign="top" align="left">Does not interfere</td>
</tr>
<tr>
<td valign="top" align="left">Enjoyment of life</td>
<td valign="top" align="left">Forward translations differed. Reconciled by third linguist:<break/> <italic>Apreciar a vida</italic></td>
<td valign="top" align="left">Enjoying life</td>
<td valign="top" align="left">FT updated to match reference as requested:<break/> <italic>Aproveitamento da vida</italic><break/> BT updated accordingly:<break/> Enjoyment of life</td>
<td valign="top" align="left">Agree</td>
<td valign="top" align="left">No revisions needed</td>
<td valign="top" align="left">No difficulties reported</td>
<td valign="top" align="left">No revision needed. R4 had some difficulty understanding what enjoyment of life was, he wasn&#x00027;t sure if it was referring to general activities. He notes he had no trouble understanding the question. No changes needed</td>
<td valign="top" align="left">Enjoyment of life</td>
</tr>
<tr>
<td valign="top" align="left">Fair<break/> [&#x0201C;fair&#x0201D; = unsatisfactory]</td>
<td valign="top" align="left">Consensus reached on forward translation:<break/> <italic>Razo&#x000E1;vel</italic></td>
<td valign="top" align="left">Reasonable</td>
<td valign="top" align="left">FT and BT translation updated to better reflect source as per concept. Deviation from reference file justified:<break/> <italic>Insatisfat&#x000F3;rio</italic><break/> <italic>Unsatisfactory</italic></td>
<td valign="top" align="left">Please confirm that this term works in the context of the response option</td>
<td valign="top" align="left">Yes, both are correct. Insatisfat&#x000F3;rio was used based on feedback and the concept definition. No revision needed</td>
<td valign="top" align="left">No difficulties reported</td>
<td valign="top" align="left">No revisions needed</td>
<td valign="top" align="left">Unsatisfactory</td>
</tr>
</tbody>
</table>
</table-wrap>
<sec>
<title>Translation of the CBPI</title>
<p>In the dual forward translation, we found that the two independent linguists had similar views on the target language translations with the exception of the Portuguese, Chinese, and Japanese translations. Indeed, for the Japanese forward translations there were 18 items or instructions (out of a total 25) that differed between the two native-speaking linguists, while for the Chinese and Portuguese forward translations there were 16 and 13 items or instructions that differed, respectively. In the reconciliation process, the third independent native-speaking linguist reconciled these differences by either selecting the most appropriate translation (in consideration of the source statements) or proposing an alternative translation that better reflected the source materials.</p>
<p>In the resolution phase, the team of linguists, quality manager, and project manager identified 53 items or instructions that differed from the forward translation, back translation, and the source materials (Japanese: <italic>n</italic> = 16; Portuguese: <italic>n</italic> = 16; Chinese: <italic>n</italic> = 8; German: <italic>n</italic> = 7; Hungarian: <italic>n</italic> = 5; and Dutch: <italic>n</italic> = 1). For example, in the interference domain, the original item &#x0201C;enjoyment of life&#x0201D; was initially back translated from Portuguese to &#x0201C;enjoying life,&#x0201D; which was judged to have a different meaning and thus required re-translation. Another example was the use of the German word for &#x0201C;number&#x0201D; (&#x0201C;zahl&#x0201D;) rather than &#x0201C;response&#x0201D; (&#x0201C;antwort&#x0201D;) in the instructions for the overall QoL scale. This was revised to better reflect the original English version and intent.</p>
<p>In comparison of the back translation and the original US-English version, the reviewers identified the items or instructions that differed from the source material [Japanese: <italic>n</italic> = 7 instances; German: <italic>n</italic> = 4 instances; Dutch: <italic>n</italic> = 4 instances; Chinese (simplified): <italic>n</italic> = 2 instances; Portuguese: <italic>n</italic> = 2 instances; and Hungarian: <italic>n</italic> = 3 instances]. For three of items in the German translation and four items in the Dutch translation, the reviewer confirmed that while there was a slight deviation from English, the terms used reflected intention and therefore no revisions were needed. In the Hungarian back translation, the reviewer flagged use of the word &#x0201C;limited&#x0201D; in the anchors of the interference domain as inconsistent with the intended meaning of &#x0201C;interfere&#x0201D; in the original English version of the measure, which impacted three of the items/instructions. The anchors were re-translated to address this difference. For two items in the Portuguese translation, the reviewer asked for clarification on whether a specific term was required for local conventions; for example, whether &#x0201C;please&#x0201D; was needed for the item &#x0201C;[please] rate your dog&#x00027;s pain.&#x0201D; The linguist confirmed that this was not needed and back translation was updated to better reflect the source and forward translation. Similarly, in the Japanese translation, the reviewer asked for confirmation that a deviation in sentence structure for seven of the items was due to local language conventions or whether this could be updated to better reflect the source material. The linguist confirmed that Japanese grammar conventions differ from English and that sentence structure was correct for the target language and accurately reflected the source material.</p>
<p>In the Irish-English forward translation, the reviewer identified 12 revisions that appeared non-essential, of which one was deemed necessary by the linguist (i.e., changing the spelling of &#x0201C;kerb&#x0201D; to &#x0201C;curb&#x0201D;) and the forward translation was updated. The remaining 11 revisions focused on the use of Irish-English capitalization rules, which did not affect item understanding. Therefore, the original capitalization style was retained. No issues in translation were identified in the Australian-English version.</p>
</sec>
<sec>
<title>Cognitive Debriefing of the CBPI Translations</title>
<p>Cognitive interviews were conducted with five dog owners from each of the target countries (<italic>n</italic> = 40) to evaluate their understanding and cultural appropriateness of the CPBI (<xref ref-type="bibr" rid="B9">9</xref>). <xref ref-type="table" rid="T2">Table 2</xref> shows participant characteristics. In general, items were easily understood by the participants demonstrating the instructions, response options, and items were clear, unambiguous, and relevant to participants. In a few cases, participants suggested alternative words or phrases they felt either better reflected the sentiment of the item or sounded more natural in the context of the question. For example, in the Chinese translation, three participants reported difficulty understanding the term used for &#x0201C;average&#x0201D; in the instructions for rating average pain as this term is typically associated with calculations in Chinese language conventions. Suggestions were made to change the instruction wording to specify &#x0201C;in general&#x0201D; or &#x0201C;in most cases&#x0201D; and the instruction was subsequently updated to include the term &#x0201C;in general.&#x0201D; Additionally, in the Hungarian translation, two participants reported a dislike for the phrase &#x0201C;best describes&#x0201D; (&#x0201C;legjobban le&#x000ED;rja&#x0201D;) in the instruction to &#x0201C;Fill in the oval next to the one number that best describes the pain&#x02026;,&#x0201D; with one participant suggesting the alternative &#x0201C;best characterizes&#x0201D; (&#x0201C;legjobban jellemzi&#x0201D;) as a more natural phrase. With the exception of the Chinese translation, suggestions were deemed stylistic by the linguist and therefore the original translation was retained. No difficulties were reported in the Australian-English or Irish-English translations.</p>
<table-wrap position="float" id="T2">
<label>Table 2</label>
<caption><p>Participant characteristics; cognitive interviews.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th/>
<th valign="top" align="center"><bold>Australian (<italic>n</italic> &#x0003D; 5)</bold></th>
<th valign="top" align="center"><bold>Chinese (<italic>n</italic> &#x0003D; 5)</bold></th>
<th valign="top" align="center"><bold>Dutch (<italic>n</italic> &#x0003D; 5)</bold></th>
<th valign="top" align="center"><bold>German (<italic>n</italic> &#x0003D; 5)</bold></th>
<th valign="top" align="center"><bold>Hungarian (<italic>n</italic> &#x0003D; 5)</bold></th>
<th valign="top" align="center"><bold>Irish (<italic>n</italic> &#x0003D; 5)</bold></th>
<th valign="top" align="center"><bold>Japanese (<italic>n</italic> &#x0003D; 5)</bold></th>
<th valign="top" align="center"><bold>Portuguese (<italic>n</italic> &#x0003D; 5)</bold></th>
<th valign="top" align="center"><bold>Totals (<italic>n</italic> &#x0003D; 40)</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Female</td>
<td valign="top" align="center">3</td>
<td valign="top" align="center">3</td>
<td valign="top" align="center">3</td>
<td valign="top" align="center">3</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">3</td>
<td valign="top" align="center">3</td>
<td valign="top" align="center">22</td>
</tr>
<tr>
<td valign="top" align="left">Male</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">3</td>
<td valign="top" align="center">3</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">18</td>
</tr>
<tr>
<td valign="top" align="left">Age in years, mean (range)</td>
<td valign="top" align="center">45 (18&#x02013;70)</td>
<td valign="top" align="center">45 (27&#x02013;62)</td>
<td valign="top" align="center">42 (20&#x02013;68)</td>
<td valign="top" align="center">53 (35&#x02013;68)</td>
<td valign="top" align="center">56 (39&#x02013;71)</td>
<td valign="top" align="center">47 (22&#x02013;69)</td>
<td valign="top" align="center">52 (41&#x02013;70)</td>
<td valign="top" align="center">45 (27&#x02013;66)</td>
<td valign="top" align="center">48 (18&#x02013;71)</td>
</tr>
<tr>
<td valign="top" align="left">Education level in years, mean (range)</td>
<td valign="top" align="center">12.2 (4&#x02013;16)</td>
<td valign="top" align="center">12 (9&#x02013;16)</td>
<td valign="top" align="center">12.6 (10&#x02013;16)</td>
<td valign="top" align="center">10.2 (9&#x02013;12)</td>
<td valign="top" align="center">13.8 (10&#x02013;17)</td>
<td valign="top" align="center">13.2 (12&#x02013;15)</td>
<td valign="top" align="center">14.4 (12&#x02013;16)</td>
<td valign="top" align="center">13.8 (11&#x02013;17)</td>
<td valign="top" align="center">12.8 (4&#x02013;17)</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>A second review was performed by the reviewers following cognitive debriefing of the German, Chinese, and Japanese translations to ensure that any modifications made at this stage were conceptually equivalent with the source material. The reviewers identified three items in the German translation, one item in the Chinese translation, and six items in the Japanese translation where the meaning differed from the source material. For example, in the German translation, the item &#x0201C;rate your dog&#x00027;s pain&#x0201D; was back translated from &#x0201C;please evaluate your dog&#x00027;s pain,&#x0201D; which was deemed by the reviewer to deviate from the English source in such a way as to threaten the consistency between the languages and thus required re-translation. Additionally, the reviewer also questioned revisions made to the items &#x0201C;ability to run&#x0201D; and &#x0201C;ability to walk,&#x0201D; arguing that &#x0201C;gehen&#x0201D; implies a slower pace and therefore more adequately describes walking whereas &#x0201C;laufen&#x0201D; is more appropriate for describing running. In the Chinese translation, the reviewer requested that a more comparable term for &#x0201C;average&#x0201D; be used in place of &#x0201C;in general&#x0201D; for the instructions for the item assessing pain in the last 7 days as the latter does not imply the same meaning. This was subsequently re-translated to &#x0201C;average degree&#x0201D; to better match the source measure. While in the Japanese translation, the reviewer identified six items where word choices were inconsistent with the intended meaning in English and queried whether these were appropriate for the Japanese context (e.g., use of &#x0201C;applies&#x0201D; rather than &#x0201C;describes&#x0201D;). The appropriateness of the terms was confirmed by a linguist, and demonstrated in cognitive debriefing, and retained in the final version.</p>
<p>The final proofreading step led to minor changes in wording/grammar to provide clarity and comprehension.</p>
</sec>
</sec>
<sec sec-type="discussion" id="s4">
<title>Discussion</title>
<p>As owner-reported outcome assessments become increasingly used in global clinical veterinary practice and research (<xref ref-type="bibr" rid="B16">16</xref>), the rigorous translation and linguistic validation of these measures is essential to ensure that data collected is valid and reliable. Linguistic validation is the process by which translated measures are assessed for content validity, and conceptual equivalence of language translation and cultural appropriateness for use in the target country or region (<xref ref-type="bibr" rid="B14">14</xref>). This process ensures that data collected using a translated instrument is an accurate representation of the original instrument and is culturally appropriate for use in the intended context. Rigorous translation and validation of an instrument also means that the results can more easily be directly compared cross-culturally (<xref ref-type="bibr" rid="B9">9</xref>, <xref ref-type="bibr" rid="B10">10</xref>).</p>
<p>In this study, we describe the translation and linguistic validation of the CBPI to create versions in Australian and Irish-English, Simplified Chinese (China), Japanese (Japan), German (Germany), Dutch (Netherlands), Portuguese (Portugal), and Hungarian (Hungary). The CBPI has previously been translated and validated for use in Swedish (<xref ref-type="bibr" rid="B11">11</xref>), French (<xref ref-type="bibr" rid="B12">12</xref>), and Italian (<xref ref-type="bibr" rid="B13">13</xref>). Using established guidelines (<xref ref-type="bibr" rid="B9">9</xref>, <xref ref-type="bibr" rid="B10">10</xref>, <xref ref-type="bibr" rid="B14">14</xref>, <xref ref-type="bibr" rid="B15">15</xref>), the CBPI was translated to the target languages using a rigorous process of forward and back translation and then cognitively debriefed with a representative sample of dog owners whose first language was one of the target languages. Cognitive debriefing feedback for each language of interest confirmed that the translations of the CBPI adequately convey the concepts in the original version of the questionnaire and that items are relevant and easily understood by dog owners. Only minor changes in terminology were made following cognitive debriefing to improve clarity, comprehension, and to account for cultural differences (e.g., use of the term &#x0201C;average&#x0201D; in the Chinese translation). This has resulted in translated measures that are conceptually equivalent to the original CBPI and culturally appropriate for use in the target countries.</p>
<p>The translation and linguistic validation of the CBPI into eight additional versions is an essential step in adapting the measure for use globally (Translated versions of the instruments are available as <xref ref-type="supplementary-material" rid="SM1">Supplementary Materials</xref>. Copyright is held by Dr. Dorothy Cimino Brown. Terms of use can be found at <ext-link ext-link-type="uri" xlink:href="http://www.CanineBPI.com">www.CanineBPI.com</ext-link>). Validation of an instrument, however, is an on-going process. It is also good practice that the translated instruments demonstrate that they measure what they are intended to measure (i.e., pain severity and pain interference) within the target populations. This can be achieved by demonstrating quantitative evidence of validity (e.g., construct validity, convergent validity) and reliability (e.g., internal consistency, test-retest reliability) of the measures. Further, for the translated instruments to be used to evaluate the effectiveness of interventions of chronic pain in dogs, they should also be able to detect clinically importance change, known as responsiveness. Quantitative assessments of cross-cultural validity of the translated measures can also be assessed to determine the extent to which instrument scores behave as expected in different populations, such as ethnic or language groups (<xref ref-type="bibr" rid="B17">17</xref>, <xref ref-type="bibr" rid="B18">18</xref>). Initial psychometric validation has already been conducted for the French (<xref ref-type="bibr" rid="B12">12</xref>), Swedish (<xref ref-type="bibr" rid="B11">11</xref>), and Italian (<xref ref-type="bibr" rid="B13">13</xref>) versions of the CBPI, with the French version showing evidence of construct validity, convergent validity, and strong internal consistency of the measure. Next steps in this research could be for researchers to psychometrically test the newly translated versions to further demonstrate the validity of these instruments.</p>
</sec>
<sec sec-type="data-availability" id="s5">
<title>Data Availability Statement</title>
<p>The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.</p>
</sec>
<sec id="s6">
<title>Ethics Statement</title>
<p>Ethical review and approval was not required for the study on human participants in accordance with the local legislation and institutional requirements. Written informed consent for participation was not required for this study in accordance with the national legislation and the institutional requirements.</p>
</sec>
<sec id="s7">
<title>Author Contributions</title>
<p>AC oversaw the linguistic validation process. JW, AY, GM, HM, and AW contributed to study conception and interpretation of results. JW, AY, AC, HM, GM, and AW contributed to writing this manuscript. All authors contributed to the article and approved the submitted version.</p>
</sec>
<sec sec-type="funding-information" id="s8">
<title>Funding</title>
<p>This research was funded by Zoetis Inc.</p>
</sec>
<sec sec-type="COI-statement" id="conf1">
<title>Conflict of Interest</title>
<p>JW and AY were employed by company Adelphi Values Ltd. AC was employed by company TransPerfect. GM, HM, and AW were employed by company Zoetis Inc.</p>
</sec>
<sec sec-type="disclaimer" id="s9">
<title>Publisher&#x00027;s Note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec> 
</body>
<back>
<ack><p>The authors would like to acknowledge the participants who took part in this study.</p>
</ack>
<sec sec-type="supplementary-material" id="s10">
<title>Supplementary Material</title>
<p>The Supplementary Material for this article can be found online at: <ext-link ext-link-type="uri" xlink:href="https://www.frontiersin.org/articles/10.3389/fvets.2021.769112/full#supplementary-material">https://www.frontiersin.org/articles/10.3389/fvets.2021.769112/full#supplementary-material</ext-link></p>
<supplementary-material xlink:href="Data_Sheet_1.PDF" id="SM1" mimetype="application/pdf" xmlns:xlink="http://www.w3.org/1999/xlink"/>
</sec>
<ref-list>
<title>References</title>
<ref id="B1">
<label>1.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bendinger</surname> <given-names>T</given-names></name> <name><surname>Plunkett</surname> <given-names>N</given-names></name></person-group>. <article-title>Measurement in pain medicine</article-title>. <source>BJA Educ.</source> (<year>2016</year>) <volume>16</volume>:<fpage>310</fpage>&#x02013;<lpage>5</lpage>. <pub-id pub-id-type="doi">10.1093/bjaed/mkw014</pub-id></citation>
</ref>
<ref id="B2">
<label>2.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Brown</surname> <given-names>DC</given-names></name> <name><surname>Boston</surname> <given-names>RC</given-names></name> <name><surname>Coyne</surname> <given-names>JC</given-names></name> <name><surname>Farrar</surname> <given-names>JT</given-names></name></person-group>. <article-title>Development and psychometric testing of an instrument designed to measure chronic pain in dogs with osteoarthritis</article-title>. <source>Am J Vet Res.</source> (<year>2007</year>) <volume>68</volume>:<fpage>631</fpage>&#x02013;<lpage>7</lpage>. <pub-id pub-id-type="doi">10.2460/ajvr.68.6.631</pub-id><pub-id pub-id-type="pmid">17542696</pub-id></citation></ref>
<ref id="B3">
<label>3.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hielm-Bj&#x000F6;rkman</surname> <given-names>AK</given-names></name> <name><surname>Rita</surname> <given-names>H</given-names></name> <name><surname>Tulamo</surname> <given-names>RM</given-names></name></person-group>. <article-title>Psychometric testing of the Helsinki chronic pain index by completion of a questionnaire in Finnish by owners of dogs with chronic signs of pain caused by osteoarthritis</article-title>. <source>Am J Vet Res.</source> (<year>2009</year>) <volume>70</volume>:<fpage>727</fpage>&#x02013;<lpage>34</lpage>. <pub-id pub-id-type="doi">10.2460/ajvr.70.6.727</pub-id><pub-id pub-id-type="pmid">19496661</pub-id></citation></ref>
<ref id="B4">
<label>4.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cleeland</surname> <given-names>CS</given-names></name> <name><surname>Ryan</surname> <given-names>KM</given-names></name></person-group>. <article-title>Pain assessment: global use of the brief pain inventory</article-title>. <source>Ann Acad Med Singapore.</source> (<year>1994</year>) <volume>23</volume>:<fpage>129</fpage>&#x02013;<lpage>38</lpage>.<pub-id pub-id-type="pmid">8080219</pub-id></citation></ref>
<ref id="B5">
<label>5.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lapane</surname> <given-names>KL</given-names></name> <name><surname>Quilliam</surname> <given-names>BJ</given-names></name> <name><surname>Benson</surname> <given-names>C</given-names></name> <name><surname>Chow</surname> <given-names>W</given-names></name> <name><surname>Kim</surname> <given-names>M</given-names></name></person-group>. <article-title>One, two, or three? Constructs of the brief pain inventory among patients with non-cancer pain in the outpatient setting</article-title>. <source>J Pain Symptom Manag.</source> (<year>2014</year>) <volume>47</volume>:<fpage>325</fpage>&#x02013;<lpage>33</lpage>. <pub-id pub-id-type="doi">10.1016/j.jpainsymman.2013.03.023</pub-id><pub-id pub-id-type="pmid">23880588</pub-id></citation></ref>
<ref id="B6">
<label>6.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Atkinson</surname> <given-names>TM</given-names></name> <name><surname>Rosenfeld</surname> <given-names>BD</given-names></name> <name><surname>Sit</surname> <given-names>L</given-names></name> <name><surname>Mendoza</surname> <given-names>TR</given-names></name> <name><surname>Fruscione</surname> <given-names>M</given-names></name> <name><surname>Lavene</surname> <given-names>D</given-names></name> <etal/></person-group>. <article-title>Using confirmatory factor analysis to evaluate construct validity of the Brief Pain Inventory (BPI)</article-title>. <source>J Pain Symptom Manage.</source> (<year>2011</year>) <volume>41</volume>:<fpage>558</fpage>&#x02013;<lpage>65</lpage>. <pub-id pub-id-type="doi">10.1016/j.jpainsymman.2010.05.008</pub-id><pub-id pub-id-type="pmid">21131166</pub-id></citation></ref>
<ref id="B7">
<label>7.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Brown</surname> <given-names>DC</given-names></name> <name><surname>Boston</surname> <given-names>R</given-names></name> <name><surname>Coyne</surname> <given-names>JC</given-names></name> <name><surname>Farrar</surname> <given-names>JT</given-names></name></person-group>. <article-title>A novel approach to the use of animals in studies of pain: validation of the canine brief pain inventory in canine bone cancer</article-title>. <source>Pain Med.</source> (<year>2009</year>) <volume>10</volume>:<fpage>133</fpage>&#x02013;<lpage>42</lpage>. <pub-id pub-id-type="doi">10.1111/j.1526-4637.2008.00513.x</pub-id><pub-id pub-id-type="pmid">18823385</pub-id></citation></ref>
<ref id="B8">
<label>8.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Brown</surname> <given-names>DC</given-names></name> <name><surname>Boston</surname> <given-names>RC</given-names></name> <name><surname>Coyne</surname> <given-names>JC</given-names></name> <name><surname>Farrar</surname> <given-names>JT</given-names></name></person-group>. <article-title>Ability of the Canine brief pain inventory to detect response to treatment in dogs with osteoarthritis</article-title>. <source>J Am Vet Med Assoc.</source> (<year>2008</year>) <volume>233</volume>:<fpage>1278</fpage>&#x02013;<lpage>83</lpage>. <pub-id pub-id-type="doi">10.2460/javma.233.8.1278</pub-id><pub-id pub-id-type="pmid">19180716</pub-id></citation></ref>
<ref id="B9">
<label>9.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wild</surname> <given-names>D</given-names></name> <name><surname>Grove</surname> <given-names>A</given-names></name> <name><surname>Martin</surname> <given-names>M</given-names></name> <name><surname>Eremenco</surname> <given-names>S</given-names></name> <name><surname>McElroy</surname> <given-names>S</given-names></name> <name><surname>Verjee-Lorenz</surname> <given-names>A</given-names></name> <etal/></person-group>. <article-title>Principles of good practice for the translation and cultural adaptation process for Patient-Reported Outcomes (PRO) measures: report of the ISPOR task force for translation and cultural adaptation</article-title>. <source>Value Health.</source> (<year>2005</year>) <volume>8</volume>:<fpage>94</fpage>&#x02013;<lpage>104</lpage>. <pub-id pub-id-type="doi">10.1111/j.1524-4733.2005.04054.x</pub-id><pub-id pub-id-type="pmid">15804318</pub-id></citation></ref>
<ref id="B10">
<label>10.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wild</surname> <given-names>D</given-names></name> <name><surname>Eremenco</surname> <given-names>S</given-names></name> <name><surname>Mear</surname> <given-names>I</given-names></name> <name><surname>Martin</surname> <given-names>M</given-names></name> <name><surname>Houchin</surname> <given-names>C</given-names></name> <name><surname>Gawlicki</surname> <given-names>M</given-names></name> <etal/></person-group>. <article-title>Multinational trials-recommendations on the translations required, approaches to using the same language in different countries, and the approaches to support pooling the data: the ISPOR patient-reported outcomes translation and linguistic validation good research practices task force report</article-title>. <source>Value Health.</source> (<year>2009</year>) <volume>12</volume>:<fpage>430</fpage>&#x02013;<lpage>40</lpage>. <pub-id pub-id-type="doi">10.1111/j.1524-4733.2008.00471.x</pub-id><pub-id pub-id-type="pmid">19138309</pub-id></citation></ref>
<ref id="B11">
<label>11.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Essner</surname> <given-names>A</given-names></name> <name><surname>Zetterberg</surname> <given-names>L</given-names></name> <name><surname>Hellstr&#x000F6;m</surname> <given-names>K</given-names></name> <name><surname>Gust&#x000E5;s</surname> <given-names>P</given-names></name> <name><surname>H&#x000F6;gberg</surname> <given-names>H</given-names></name> <name><surname>Sj&#x000F6;str&#x000F6;m</surname> <given-names>R</given-names></name></person-group>. <article-title>Psychometric evaluation of the canine brief pain inventory in a Swedish sample of dogs with pain related to osteoarthritis</article-title>. <source>Acta Vet Scand.</source> (<year>2017</year>) <volume>59</volume>:<fpage>44</fpage>. <pub-id pub-id-type="doi">10.1186/s13028-017-0311-2</pub-id><pub-id pub-id-type="pmid">28743273</pub-id></citation></ref>
<ref id="B12">
<label>12.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ragetly</surname> <given-names>GR</given-names></name> <name><surname>Massey</surname> <given-names>L</given-names></name> <name><surname>Brown</surname> <given-names>DC</given-names></name></person-group>. <article-title>Initial psychometric testing and validation of the French version of the Canine Brief Pain Inventory</article-title>. <source>Vet Anaesth Analg.</source> (<year>2019</year>) <volume>46</volume>:<fpage>667</fpage>&#x02013;<lpage>72</lpage>. <pub-id pub-id-type="doi">10.1016/j.vaa.2019.04.001</pub-id><pub-id pub-id-type="pmid">31301964</pub-id></citation></ref>
<ref id="B13">
<label>13.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>della Rocca</surname> <given-names>G</given-names></name> <name><surname>Di Salvo</surname> <given-names>A</given-names></name> <name><surname>Medori</surname> <given-names>C</given-names></name> <name><surname>della Valle</surname> <given-names>MF</given-names></name> <name><surname>Cimino Brown</surname> <given-names>D</given-names></name></person-group>. <article-title>Initial psychometric testing and validation of the Italian version of the canine brief pain inventory in dogs with pain related to osteoarthritis</article-title>. <source>Front Vet Sci</source>. (<year>2021</year>) <volume>8</volume>:<fpage>736458</fpage>. <pub-id pub-id-type="doi">10.3389/fvets.2021.736458</pub-id><pub-id pub-id-type="pmid">34604372</pub-id></citation></ref>
<ref id="B14">
<label>14.</label>
<citation citation-type="web"><person-group person-group-type="author"><collab>World Health Organization</collab></person-group>. <source>Process of Translation and Adaptation of Instruments</source>. <publisher-loc>Geneva</publisher-loc>: <publisher-name>World Health Organization</publisher-name> (<year>2016</year>). Available online at: <ext-link ext-link-type="uri" xlink:href="http://www.who.int/substance_abuse/research_tools/translation/en/">http://www.who.int/substance_abuse/research_tools/translation/en/</ext-link> (accessed February 06, 2020).</citation>
</ref>
<ref id="B15">
<label>15.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Koller</surname> <given-names>M</given-names></name> <name><surname>West</surname> <given-names>K</given-names></name></person-group>. <article-title>Linguistic validation manual for Patient-Reported Outcomes (PRO) Instruments</article-title>. By C. Acquadro, K. Conway, C. Girourdet and I. Mear. MAPI ResearchTrust, Lyon, France, 2004,184 pp, ISBN: 2-9522021-0-9, price &#x020AC;70/&#x00024;90. <source>Qual Life Res.</source> (<year>2005</year>) <volume>14</volume>:<fpage>1791</fpage>&#x02013;<lpage>2</lpage>. <pub-id pub-id-type="doi">10.1007/s11136-005-5367-1</pub-id></citation>
</ref>
<ref id="B16">
<label>16.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mathews</surname> <given-names>K</given-names></name> <name><surname>Kronen</surname> <given-names>PW</given-names></name> <name><surname>Lascelles</surname> <given-names>D</given-names></name> <name><surname>Nolan</surname> <given-names>A</given-names></name> <name><surname>Robertson</surname> <given-names>S</given-names></name> <name><surname>Steagall</surname> <given-names>PV</given-names></name> <etal/></person-group>. <article-title>Guidelines for recognition, assessment and treatment of pain</article-title>. <source>Vet Nurse.</source> (<year>2014</year>) <volume>6</volume>:<fpage>164</fpage>&#x02013;<lpage>73</lpage>. <pub-id pub-id-type="doi">10.12968/vetn.2015.6.3.164</pub-id><pub-id pub-id-type="pmid">24841489</pub-id></citation></ref>
<ref id="B17">
<label>17.</label>
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Mokkink</surname> <given-names>LB</given-names></name> <name><surname>Prinsen</surname> <given-names>C</given-names></name> <name><surname>Patrick</surname> <given-names>DL</given-names></name> <name><surname>Alonso</surname> <given-names>J</given-names></name> <name><surname>Bouter</surname> <given-names>LM</given-names></name> <name><surname>De Vet</surname> <given-names>H</given-names></name> <etal/></person-group>. <article-title>COSMIN methodology for systematic reviews of patient-reported outcome measures (PROMs)</article-title>. <source>User Manual</source>. (<year>2018</year>) <volume>78</volume>:<fpage>51</fpage>&#x02013;<lpage>3</lpage>. Available online at: <ext-link ext-link-type="uri" xlink:href="https://cosmin.nl/wp-content/uploads/COSMIN-syst-review-for-PROMs-manual_version-1_feb-2018.pdf">https://cosmin.nl/wp-content/uploads/COSMIN-syst-review-for-PROMs-manual_version-1_feb-2018.pdf</ext-link></citation>
</ref>
<ref id="B18">
<label>18.</label>
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Mokkink</surname> <given-names>LB</given-names></name> <name><surname>Prinsen</surname> <given-names>CA</given-names></name> <name><surname>Patrick</surname> <given-names>DL</given-names></name> <name><surname>Alonso</surname> <given-names>J</given-names></name> <name><surname>Bouter</surname> <given-names>LM</given-names></name> <name><surname>de Vet</surname> <given-names>HC</given-names></name> <etal/></person-group>. <source>COSMIN Study Design Checklist for Patient-Reported Outcome Measurement Instruments</source>. <publisher-loc>Amsterdam</publisher-loc>: <publisher-name>COSMIN</publisher-name> (<year>2019</year>). Available online at: <ext-link ext-link-type="uri" xlink:href="https://www.cosmin.nl/wp-content/uploads/COSMIN-study-designing-checklist_final.pdf">https://www.cosmin.nl/wp-content/uploads/COSMIN-study-designing-checklist_final.pdf</ext-link>, <fpage>13</fpage>&#x02013;<lpage>14</lpage>.</citation>
</ref>
</ref-list> 
</back>
</article>