<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Genet.</journal-id>
<journal-title>Frontiers in Genetics</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Genet.</abbrev-journal-title>
<issn pub-type="epub">1664-8021</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fgene.2020.00571</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Genetics</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Enrollment of Diverse Populations in the INGENIOUS Pharmacogenetics Clinical Trial</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name><surname>Shah-Williams</surname> <given-names>Ebony</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/866269/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Levy</surname> <given-names>Kenneth D.</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
</contrib>
<contrib contrib-type="author">
<name><surname>Zang</surname> <given-names>Yong</given-names></name>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
</contrib>
<contrib contrib-type="author">
<name><surname>Holmes</surname> <given-names>Ann M.</given-names></name>
<xref ref-type="aff" rid="aff4"><sup>4</sup></xref>
</contrib>
<contrib contrib-type="author">
<name><surname>Stoughton</surname> <given-names>Christa</given-names></name>
<xref ref-type="aff" rid="aff5"><sup>5</sup></xref>
</contrib>
<contrib contrib-type="author">
<name><surname>Dexter</surname> <given-names>Paul</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<xref ref-type="aff" rid="aff6"><sup>6</sup></xref>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name><surname>Skaar</surname> <given-names>Todd C.</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/946260/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Department of Medical and Molecular Genetics, Indiana University</institution>, <addr-line>Indianapolis, IN</addr-line>, <country>United States</country></aff>
<aff id="aff2"><sup>2</sup><institution>Department of Medicine, Indiana University</institution>, <addr-line>Indianapolis, IN</addr-line>, <country>United States</country></aff>
<aff id="aff3"><sup>3</sup><institution>Department of Biostatistics, Indiana University</institution>, <addr-line>Indianapolis, IN</addr-line>, <country>United States</country></aff>
<aff id="aff4"><sup>4</sup><institution>Department of Health Policy and Management, Fairbanks School of Public Health, Indiana University&#x2013;Purdue University Indianapolis</institution>, <addr-line>Indianapolis, IN</addr-line>, <country>United States</country></aff>
<aff id="aff5"><sup>5</sup><institution>Department of Urology, Indiana University Hospital</institution>, <addr-line>Indianapolis, IN</addr-line>, <country>United States</country></aff>
<aff id="aff6"><sup>6</sup><institution>Regenstrief Institute for Health Care</institution>, <addr-line>Indianapolis, IN</addr-line>, <country>United States</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Henk-Jan Guchelaar, Leiden University Medical Center, Netherlands</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Benjamin D. Horne, Intermountain Healthcare, United States; Minoli A. Perera, Northwestern University, United States</p></fn>
<corresp id="c001">&#x002A;Correspondence: Todd C. Skaar, <email>tskaar@iu.edu</email></corresp>
<fn fn-type="other" id="fn004"><p>This article was submitted to Pharmacogenetics and Pharmacogenomics, a section of the journal Frontiers in Genetics</p></fn>
</author-notes>
<pub-date pub-type="epub">
<day>25</day>
<month>06</month>
<year>2020</year>
</pub-date>
<pub-date pub-type="collection">
<year>2020</year>
</pub-date>
<volume>11</volume>
<elocation-id>571</elocation-id>
<history>
<date date-type="received">
<day>20</day>
<month>12</month>
<year>2019</year>
</date>
<date date-type="accepted">
<day>11</day>
<month>05</month>
<year>2020</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x00A9; 2020 Shah-Williams, Levy, Zang, Holmes, Stoughton, Dexter and Skaar.</copyright-statement>
<copyright-year>2020</copyright-year>
<copyright-holder>Shah-Williams, Levy, Zang, Holmes, Stoughton, Dexter and Skaar</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract>
<p>Recruitment of diverse populations and subjects living in Medically Underserved Areas and Populations (MUA/P&#x2019;s) into clinical trials is a considerable challenge. Likewise, representation of African-Americans in pharmacogenetic trials is often inadequate, but critical for identifying genetic variation within and between populations. To identify enrollment patterns and variables that predict enrollment in a diverse underserved population, we analyzed data from the INGENIOUS (Indiana GENomics Implementation and Opportunity for the UnderServed), pharmacogenomics implementation clinical trial conducted at a community hospital for underserved subjects (Safety net hospital), and a statewide healthcare system (Academic hospital). We used a logistic regression model to identify patient variables that predicted successful enrollment after subjects were contacted and evaluated the reasons that clinical trial eligible subjects refused enrollment. In both healthcare systems, African-Americans were less likely to refuse the study than non-Hispanic Whites (Safety net, OR = 0.68, and <italic>p</italic> &#x003C; 0.002; Academic hospital, OR = 0.64, and <italic>p</italic> &#x003C; 0.001). At the Safety net hospital, other minorities were more likely to refuse the study than non-Hispanic Whites (OR = 1.58, <italic>p</italic> &#x003C; 0.04). The odds of refusing the study once contacted increased with patient age (Safety net hospital, OR = 1.02, <italic>p</italic> &#x003C; 0.001, Academic hospital, OR = 1.02, and <italic>p</italic> &#x003C; 0.001). At the Academic hospital, females were less likely to refuse the study than males (OR = 0.81, <italic>p</italic> = 0.01) and those not living in MUA/P&#x2019;s were less likely to refuse the study than those living in MUA/P&#x2019;s (OR = 0.81, <italic>p</italic> = 0.007). The most frequent barriers to enrollment included not being interested, being too busy, transportation, and illness. A lack of trust was reported less frequently. In conclusion, African-Americans can be readily recruited to pharmacogenetic clinical trials once contact has been successfully initiated. However, health care initiatives and increased recruitment efforts of subjects living in MUA/Ps are needed. Enrollment could be further enhanced by improving research awareness and knowledge of clinical trials, reducing time needed for participation, and compensating for travel.</p>
</abstract>
<kwd-group>
<kwd>diverse</kwd>
<kwd>clinical trial</kwd>
<kwd>African-American</kwd>
<kwd>INGENIOUS</kwd>
<kwd>enrollment</kwd>
<kwd>pharmacogenomics</kwd>
<kwd>MUA/P</kwd>
</kwd-group>
<contract-num rid="cn001">HG007762</contract-num>
<contract-sponsor id="cn001">National Institutes of Health<named-content content-type="fundref-id">10.13039/100000002</named-content></contract-sponsor>
<counts>
<fig-count count="3"/>
<table-count count="2"/>
<equation-count count="0"/>
<ref-count count="30"/>
<page-count count="9"/>
<word-count count="0"/>
</counts>
</article-meta>
</front>
<body>
<sec id="S1">
<title>Introduction</title>
<p>Randomized clinical trials are the gold standard for testing the safety and efficacy of therapeutic products, medical devices and clinical procedures (<xref ref-type="bibr" rid="B12">Minneci and Deans, 2018</xref>). In some cases, subjects may benefit from participating in clinical trials, which offer better alternatives in treatment compared to the standard of care for certain diseases and are provided with extra support and monitoring from health care providers. However, African-Americans, who are disproportionally diagnosed with higher rates of various diseases such as hypertension, diabetes, and stroke, compared to non-Hispanic Whites, are historically underrepresented in clinical trials (<xref ref-type="bibr" rid="B28">Thorpe et al., 2016</xref>; <xref ref-type="bibr" rid="B14">Musemwa and Gadegbeku, 2017</xref>; <xref ref-type="bibr" rid="B16">No author list, 2018</xref>). This creates racial disparities in receiving benefits from clinical trials. It also often limits the ability of researchers to extrapolate the findings and use pharmacogenomics to personalize drug therapies across races (<xref ref-type="bibr" rid="B18">Perera et al., 2014</xref>; <xref ref-type="bibr" rid="B21">Shendre et al., 2018</xref>). Additionally, racial disparities exist in the incidence of adverse drug events, making minority populations particularly important to include in pharmacogenetic clinical trials (<xref ref-type="bibr" rid="B13">Moffett et al., 2013</xref>; <xref ref-type="bibr" rid="B2">Chalasani et al., 2017</xref>).</p>
<p>A variety of strategies have been reported in an attempt to lessen health disparities in minority populations across many diseases (<xref ref-type="bibr" rid="B24">Smith et al., 2016</xref>). One of these strategies is to increase community involvement at the beginning and throughout the research process (<xref ref-type="bibr" rid="B27">The National Academies of Sciences Engineering, and Medicine, 2016</xref>). Thus, many studies have focused on barriers that impede African-Americans from enrolling into clinical trials. Several of them have focused on health inequities and medical practices that have historically prevented African-Americans from enrolling into clinical trials (<xref ref-type="bibr" rid="B10">Lincoln et al., 2018</xref>). However, barriers to enrollment in pharmacogenetic trials may be different. For example, diverse populations may be more willing to participate in pharmacogenetic trials because identifying genetic contributions to reduced efficacy could provide minority populations valuable explanations for the reduced efficacy that does not blame it on their lifestyles. On the other hand, <xref ref-type="bibr" rid="B9">Lee et al. (2018)</xref> have reported factors that impact pharmacogenetic testing in primarily minority populations, including concerns about the impact of the test results, reliability of test, and concerns about privacy. In an effort to understand the impact of pharmacogenetic testing in minority and underserved populations, we have recently concluded enrollment to our INdiana GENomics Implementation: an Opportunity for the UnderServed (INGENIOUS) clinical trial (<xref ref-type="bibr" rid="B5">Eadon et al., 2016</xref>).</p>
<p>Herein, we report the rates of enrollment of minority and underserved populations along with reasons for refusing to enroll. This study provides a unique opportunity to report enrollment patterns in a diverse population from a large safety net and a state-wide health care system, which include a large portion of subjects who live in Medically Underserved Areas and Populations (MUA/P&#x2019;s), and/or are an African-American patient population. The aim of this analysis is to (1) determine differences in enrollment patterns in diverse populations and (2) evaluate patient variables that may predict enrollment into a pharmacogenetic clinical trial and (3) evaluate reasons clinical trial eligible subjects did not enroll in the INGENIOUS trial.</p>
</sec>
<sec id="S2" sec-type="materials|methods">
<title>Materials and Methods</title>
<p>The INGENIOUS trial (<ext-link ext-link-type="uri" xlink:href="https://clinicaltrials.gov">ClinicalTrials.gov</ext-link> Identifier: NCT02297126) was a prospective, randomized controlled pharmacogenetics clinical trial. The study enrolled subjects to evaluate clinical responses and economic impact of implementing a pharmacogenetics program at a safety-net urban hospital, and an Academic hospital across the state of Indiana. The study design was previously described (<xref ref-type="bibr" rid="B5">Eadon et al., 2016</xref>). INGENIOUS data were analyzed from subjects who were contacted between January 2017 and April 2018, using data collected by the research assistants, who contacted the eligible subjects.</p>
<sec id="S2.SS1">
<title>Study Selection and Patient Demographics</title>
<sec id="S2.SS1.SSS1">
<title>Patient Inclusion/Exclusion Criteria</title>
<p>The inclusion criteria included: (1) ability to consent, (2) prescribed 1 of the 27 index medications, (3) must not have been prescribed the index medication in the past 13 months, and (4) be at least 18 years of age. Exclusion criteria included: (1) not English speaking, (2) subjects previously genotyped. Subjects were randomized into control and intervention arms. Subjects randomized to the control arm received standard of care, were not genotyped, were not contacted, and outcomes data for the trial endpoint analyses were obtained from the medical records. Subjects randomized to the intervention arm (pharmaco-genotyping) were actively recruited and consented via telephone or in clinics. Subjects in the intervention arm who were not successfully contacted for recruitment or were unable to complete the enrollment process within 5 days of receiving the targeted medication were excluded from this analysis (<xref ref-type="fig" rid="F1">Figure 1</xref>). Subjects who successfully enrolled and were consented received compensation of &#x0024;50. At both hospital systems, hypothesis testing, criteria for inclusion/exclusion, data collection, and analysis were identical, but varied in patient demographics.</p>
<fig id="F1" position="float">
<label>FIGURE 1</label>
<caption><p><bold>(A)</bold> INGENIOUS CONSORT Diagram for the inclusion of data analyzed at the Safety net hospital. The final analysis included 1341 subjects, 524 who agreed to the study and 817 subjects who refused the study. <bold>(B)</bold> INGENIOUS CONSORT Diagram for the inclusion of data analyzed at the Academic hospital. The final analysis included 1199 subjects who agreed to the study and 4661 subjects who refused the study.</p></caption>
<graphic xlink:href="fgene-11-00571-g001.tif"/>
</fig>
</sec>
<sec id="S2.SS1.SSS2">
<title>Medically Underserved Areas and Population</title>
<p>Medically Underserved Areas and Populations are designated geographic areas and populations with a paucity of key health care services as assessed by the Health Resource &#x0026; Service Administration (HRSA). Subjects identified living in MUA/Ps are based on the Index of Medical Underservice (IMU). The four criteria for assigning MUA/P designations are population-to provider ratio, percent of the population below the federal poverty level, percent population over the age of 65, and the percent infant mortality rate<sup><xref ref-type="fn" rid="footnote1">1</xref></sup>.</p>
</sec>
<sec id="S2.SS1.SSS3">
<title>Patient Selection at the Safety net Hospital</title>
<p>3,126 subjects with recruitment enrollment data were identified at the Safety net hospital and extracted from the REDCap database (<xref ref-type="bibr" rid="B6">Harris et al., 2009</xref>). A total of 1,785 subjects were excluded from the study for the following reasons: 1,176 subjects were ineligible based on enrollment criteria, 190 subjects were unable to be contacted, and 419 subjects did not complete the enrollment process within 5 days from receiving the prescription for the targeted medication. After exclusions, there were 1,341 eligible subjects successfully contacted and included in the final analysis (<xref ref-type="fig" rid="F1">Figures 1A</xref>, <xref ref-type="fig" rid="F2">2A</xref>). 524 subjects agreed to enroll, 817 subjects refused enrollment. When subjects refused the study, they were asked why. The refusal responses were recorded in free from text by research coordinators.</p>
<fig id="F2" position="float">
<label>FIGURE 2</label>
<caption><p><bold>(A)</bold> Refusal responses at the Safety net hospital. <bold>(B)</bold> Refusal responses at the Academic hospital.</p></caption>
<graphic xlink:href="fgene-11-00571-g002.tif"/>
</fig>
</sec>
<sec id="S2.SS1.SSS4">
<title>Patient Selection at the Academic Hospital</title>
<p>10,124 subjects with recruitment enrollment data at the Academic hospital were identified and extracted from the REDCap system. A total of 4,164 subjects were excluded from the study for the following reasons: 3,032 subjects were ineligible based on enrollment criteria, 719 subjects were unable to be contacted, and 513 subjects did not complete the enrollment process within 5 days from receiving the prescription for the targeted medication. After exclusions, there were 5,860 eligible subjects successfully contacted and included in the final analysis (<xref ref-type="fig" rid="F1">Figures 1B</xref>, <xref ref-type="fig" rid="F2">2B</xref>). 1199 subjects agreed to enroll, 4661 subjects refused enrollment. When subjects refused the study, they were asked why. The refusal responses were recorded in free form text by research coordinators.</p>
</sec>
<sec id="S2.SS1.SSS5">
<title>Recruitment Variations and Limitations</title>
<p>While recruitment to the trial began in June 2015, various changes in sample collection methods, compensation for participation and EHR platform introduced potential bias in comparisons of subjects recruited prior to January 2017 at the Safety net hospital. Thus, for the purposes of this analysis, only subjects recruited after January 2017 at the Safety net hospital are included. Recruitment at the Academic hospital was approved December 2016 and enrollment began January 2017.</p>
</sec>
</sec>
<sec id="S2.SS2">
<title>Statistical Analysis</title>
<p>Statistical analyses were performed in the Statistical Package for the Social Sciences (SPSS; IBM Corp. Released 2017. IBM SPSS Statistics for Windows, Version 25.0. Armonk, NY, United States: IBM Corp). Descriptive statistics, i.e., mean, quartiles, frequencies, and percentages, were analyzed to describe baseline characteristics of the study participants. To test for differences in enrollment outcomes between races, MUA/P&#x2019;s, and gender, a chi-squared test of independence was performed. A test of multi-collinearity was run to evaluate inter-correlations between the independent variables. Sensitivity analyses were performed between racial groups to identify the best strategy for grouping racial minority subjects with low enrollment. A forward conditional logistic regression method was used to select the best model in clinical trial eligible subjects. We built a logistic regression to estimate the effect of patient characteristics on successful enrollment into the INGENIOUS clinical trial.</p>
<p>Real data responses for the refusal category were transcribed, categorized, and analyzed. Frequencies and mean refusal responses were analyzed to determine reasons for not enrolling into the INGENIOUS Clinical Trial. Statistical analyses were performed independently at the Safety net and Academic hospital systems.</p>
</sec>
</sec>
<sec id="S3">
<title>Results</title>
<sec id="S3.SS1">
<title>Safety net Patient Demographics</title>
<p>A total of 1,341 subjects were included in the final analysis at the Safety net hospital. Female enrollment was 62.3%, male enrollment was 37.7%. Subjects living outside of MUA/P&#x2019;s were 53.7%, while subjects living inside MUA/P&#x2019;s were 45.3%. 36.8% self-identified as non-Hispanic White, 53.8% African-American, and 9.4% self-identified as Native Hawaiian or Pacific Islander, Indian or Alaska Native, Asian, more than one race, or refused to answer. The latter group was categorized into one racial category, termed, &#x201C;other minority&#x201D; (<xref ref-type="table" rid="T1">Table 1</xref>).</p>
<table-wrap position="float" id="T1">
<label>TABLE 1</label>
<caption><p>Demographics of study participants.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<td valign="top" align="left">Demographic characteristic<sup>a</sup></td>
<td valign="top" align="center" colspan="2">Safety net hospital<hr/></td>
<td valign="top" align="center" colspan="2">Academic hospital<hr/></td>
</tr>
<tr>
<td valign="top" align="justify"/>
<td valign="top" align="center">Number of subjects</td>
<td valign="top" align="center">Percent</td>
<td valign="top" align="center">Number of subjects</td>
<td valign="top" align="center">Percent</td>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left"><bold>Gender</bold></td>
<td valign="top" align="justify"/>
<td valign="top" align="center"/>
<td valign="top" align="justify"/>
<td valign="top" align="center"/>
</tr>
<tr>
<td valign="top" align="left">Female</td>
<td valign="top" align="center">835</td>
<td valign="top" align="center">62.3</td>
<td valign="top" align="center">3863</td>
<td valign="top" align="center">65.9</td>
</tr>
<tr>
<td valign="top" align="left">Male</td>
<td valign="top" align="center">506</td>
<td valign="top" align="center">37.7</td>
<td valign="top" align="center">1997</td>
<td valign="top" align="center">34.1</td>
</tr>
<tr>
<td valign="top" align="left"><bold>Age group (years)</bold></td>
<td valign="top" align="justify"/>
<td valign="top" align="center"/>
<td valign="top" align="justify"/>
<td valign="top" align="center"/>
</tr>
<tr>
<td valign="top" align="left">18&#x2013;38</td>
<td valign="top" align="center">299</td>
<td valign="top" align="center">22.3</td>
<td valign="top" align="center">1454</td>
<td valign="top" align="center">24.8</td>
</tr>
<tr>
<td valign="top" align="left">38&#x2013;52</td>
<td valign="top" align="center">388</td>
<td valign="top" align="center">28.9</td>
<td valign="top" align="center">1302</td>
<td valign="top" align="center">22.2</td>
</tr>
<tr>
<td valign="top" align="left">52&#x2013;63</td>
<td valign="top" align="center">426</td>
<td valign="top" align="center">31.8</td>
<td valign="top" align="center">1274</td>
<td valign="top" align="center">21.7</td>
</tr>
<tr>
<td valign="top" align="left">63&#x2013;92</td>
<td valign="top" align="center">228</td>
<td valign="top" align="center">17.0</td>
<td valign="top" align="center">1830</td>
<td valign="top" align="center">31.3</td>
</tr>
<tr>
<td valign="top" align="left"><bold>MUA/P</bold></td>
<td valign="top" align="justify"/>
<td valign="top" align="center"/>
<td valign="top" align="justify"/>
<td valign="top" align="center"/>
</tr>
<tr>
<td valign="top" align="left">Yes</td>
<td valign="top" align="center">608</td>
<td valign="top" align="center">45.3</td>
<td valign="top" align="center">1714</td>
<td valign="top" align="center">29.3</td>
</tr>
<tr>
<td valign="top" align="left">No</td>
<td valign="top" align="center">720</td>
<td valign="top" align="center">53.7</td>
<td valign="top" align="center">4141</td>
<td valign="top" align="center">70.7</td>
</tr>
<tr>
<td valign="top" align="left">Missing</td>
<td valign="top" align="center">13</td>
<td valign="top" align="center"/>
<td valign="top" align="center">5</td>
<td valign="top" align="center"/>
</tr>
<tr>
<td valign="top" align="left"><bold>Race</bold></td>
<td valign="top" align="justify"/>
<td valign="top" align="center"/>
<td valign="top" align="justify"/>
<td valign="top" align="center"/>
</tr>
<tr>
<td valign="top" align="left">Non-Hispanic White</td>
<td valign="top" align="center">494</td>
<td valign="top" align="center">36.8</td>
<td valign="top" align="center">4866</td>
<td valign="top" align="center">83.0</td>
</tr>
<tr>
<td valign="top" align="left">African-American/Black</td>
<td valign="top" align="center">721</td>
<td valign="top" align="center">53.8</td>
<td valign="top" align="center">795</td>
<td valign="top" align="center">13.6</td>
</tr>
<tr>
<td valign="top" align="left">Other minority</td>
<td valign="top" align="center">126</td>
<td valign="top" align="center">9.4</td>
<td valign="top" align="center">199</td>
<td valign="top" align="center">3.4</td>
</tr>
<tr>
<td valign="top" align="left">Total</td>
<td valign="top" align="center">1341</td>
<td valign="top" align="center">100.0</td>
<td valign="top" align="center">5860</td>
<td valign="top" align="center">100.0</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<attrib><italic><sup><italic>a</italic></sup>Characteristics of study participants at the Safety net and Academic hospital systems. Abbreviations: MUA/P, Medically Underserved Area/Population.</italic></attrib>
</table-wrap-foot>
</table-wrap>
</sec>
<sec id="S3.SS2">
<title>Enrollment Outcomes-Safety net Hospital</title>
<p>Data responses were recorded for subjects, which either agreed or refused the INGENIOUS trial. A chi-square test of independence revealed there were no significant differences in enrollment patterns stratified by MUA/P (<italic>p</italic> = 0.90) and gender (<italic>p</italic> = 0.11), but significant differences in enrollment patterns by race (<italic>p</italic> &#x003C; 0.001). Both race and age are significant covariates to predict enrollment at the Safety net hospital. African-Americans were less likely to refuse the study than non-Hispanic Whites (OR = 0.68, CI 0.53&#x2013;0.86, and <italic>p</italic> = 0.002), while other minorities were more likely to refuse the study than non-Hispanic Whites (OR = 1.58, CI 1.02&#x2013;2.45, and <italic>p</italic> = 0.04; <xref ref-type="table" rid="T2">Table 2</xref>). Additionally, the odds of refusing the study increased with age (OR = 1.02, CI, 1.02&#x2013;1.03, <italic>p</italic> &#x003C; 0.001; <xref ref-type="table" rid="T2">Table 2</xref>).</p>
<table-wrap position="float" id="T2">
<label>TABLE 2</label>
<caption><p>Estimated odds ratios (OR) and 95% confidence intervals (CI) for enrollment refusal based on logistic regression analysis.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<td valign="top" align="left">Predictor variables</td>
<td valign="top" align="center">Safety net (OR)</td>
<td valign="top" align="center">95% CI</td>
<td valign="top" align="center">Academic (OR)</td>
<td valign="top" align="center">95% CI</td>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left"><bold><italic>Race</italic></bold></td>
<td valign="top" align="justify"/>
<td/>
<td valign="top" align="justify"/>
<td/>
</tr>
<tr>
<td valign="top" align="left">African-American/Black</td>
<td valign="top" align="center">0.68</td>
<td valign="top" align="center">0.53&#x2013;0.86</td>
<td valign="top" align="center">0.64</td>
<td valign="top" align="center">0.53&#x2013;0.76</td>
</tr>
<tr>
<td valign="top" align="left">Other minorities</td>
<td valign="top" align="center">1.58</td>
<td valign="top" align="center">1.02&#x2013;2.45</td>
<td valign="top" align="center">1.28</td>
<td valign="top" align="center">0.88&#x2013;1.87</td>
</tr>
<tr>
<td valign="top" align="left"><bold><italic>Gender</italic></bold></td>
<td valign="top" align="justify"/>
<td/>
<td valign="top" align="justify"/>
<td/>
</tr>
<tr>
<td valign="top" align="left">Female0/Males<sup>1</sup></td>
<td valign="top" align="center">0.81</td>
<td valign="top" align="center">0.64&#x2013;1.03</td>
<td valign="top" align="center">0.83</td>
<td valign="top" align="center">0.72&#x2013;0.95</td>
</tr>
<tr>
<td valign="top" align="left"><italic>Age</italic></td>
<td valign="top" align="center">1.02</td>
<td valign="top" align="center">1.02&#x2013;1.03</td>
<td valign="top" align="center">1.02</td>
<td valign="top" align="center">1.02&#x2013;1.02</td>
</tr>
<tr>
<td valign="top" align="left"><bold><italic>MUAP</italic></bold></td>
<td valign="top" align="justify"/>
<td/>
<td valign="top" align="justify"/>
<td/>
</tr>
<tr>
<td valign="top" align="left">No<sup>0</sup> /Yes <italic>MUA/P<sup>1</sup></italic></td>
<td valign="top" align="center">1.05</td>
<td valign="top" align="center">0.81&#x2013;1.32</td>
<td valign="top" align="center">0.81</td>
<td valign="top" align="center">0.70&#x2013;0.94</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<attrib><italic>Abbreviations: CI, Confidence interval; MUA/P, Medically Underserved Areas/Populations. Reference groups: Living in MUA/P, males, and non-Hispanic Whites.</italic></attrib>
</table-wrap-foot>
</table-wrap>
</sec>
<sec id="S3.SS3">
<title>Patient Refusal Responses-Safety net Hospital</title>
<p>Refusal responses from open-ended questions were translated and categorized into similar barriers and the responses were stratified by race (<xref ref-type="fig" rid="F2">Figure 2A</xref>; <xref ref-type="supplementary-material" rid="SM1">Supplementary Appendix A</xref>). All 19 categories are listed in <xref ref-type="supplementary-material" rid="SM1">Supplementary Appendix A</xref>. The most common reason both African-American and non-Hispanic White subjects refused to enroll was because they were not interested in the study. Other barriers to enrollment from the most frequent to the least included time or being too busy, the clinic or hospital site was too far or had a lack of transportation, and sick or had other issues. Trust was reported less frequently in both ethnic groups. Additionally, 40% of refusal responses were missing at the Safety net hospital because some subjects abruptly hung up on research coordinators after they answered the phone or either received the subjects&#x2019; voicemail. When subjects did give reasons for refusing the study, examples of soft refusals were, &#x201C;Can&#x2019;t get to the Safety net hospital,&#x201D; &#x201C;Just had surgery, please keep in mind for the future,&#x201D; and &#x201C;Can&#x2019;t get to Safety net hospital that short of notice, keep in mind for future.&#x201D; When subjects gave hard refusals, some examples were, &#x201C;Take me off your list!,&#x201D; &#x201C;No, doesn&#x2019;t trust my DNA on files anywhere,&#x201D; &#x201C;Hates the Safety net hospital, will not do a study,&#x201D; or &#x201C;Doesn&#x2019;t have time for things like this; take my name off of your list.&#x201D; (<xref ref-type="fig" rid="F2">Figure 2A</xref>).</p>
</sec>
<sec id="S3.SS4">
<title>Academic Hospital Patient Demographics</title>
<p>5,860 subjects were included in the final analysis at the Academic hospital. Female enrollment was 65.9%, male enrollment was 37.7%. Subjects living outside of MUA/P&#x2019;s were 70.7% and within MUA/P&#x2019;s were 29.3%. 83% self-identified as non-Hispanic White, 13.6% African-American or Black, and 3.4% Native Hawaiian or Pacific Islander, Indian or Alaska Native, Asian, more than one race or refused to answer. The latter group was categorized into one racial category, termed, &#x201C;other minority&#x201D; (<xref ref-type="table" rid="T1">Table 1</xref>).</p>
</sec>
<sec id="S3.SS5">
<title>Enrollment Outcome-Academic Hospital</title>
<p>A chi-square test of independence revealed there were significant differences in enrollment patterns by race (<italic>p</italic> &#x003C; 0.001), MUA/P (<italic>p</italic> = 0.01), and gender (<italic>p</italic> &#x003C; 0.001). A forward logistic regression model selection process revealed race, age, MUA/P, and gender are significant covariates for enrollment into the INGENIOUS clinical trial at the Academic hospital. African-Americans were less likely to refuse the study than non-Hispanic-whites (OR = 0.64, CI 0.53&#x2013;0.76, and <italic>p</italic> &#x003C; 0.001; <xref ref-type="table" rid="T2">Table 2</xref>). Other minorities did not reach statistical significance in this analysis. Females were less likely to refuse the study than males (OR = 0.83, CI 0.72&#x2013;0.95, and <italic>p</italic> = 0.01) and the odds of refusing the study increased with age (OR = 1.02, CI 1.02&#x2013;1.03, and <italic>p</italic> &#x003C; 0.001). Subjects not living in MUA/P&#x2019;s were less likely to refuse the study than those living in MUA/P&#x2019;s (OR = 0.81, CI 0.70&#x2013;0.94, and <italic>p</italic> = 0.007; <xref ref-type="table" rid="T2">Table 2</xref>).</p>
</sec>
<sec id="S3.SS6">
<title>Patient Refusal Responses-Academic Hospital</title>
<p>Refusal responses from open-ended questions were translated and categorized into similar barriers and the responses were stratified by race (<xref ref-type="fig" rid="F2">Figure 2B</xref>; <xref ref-type="supplementary-material" rid="SM1">Supplementary Appendix A</xref>). All 19 categories are listed in <xref ref-type="supplementary-material" rid="SM1">Supplementary Appendix A</xref>. At the Academic hospital, the most common reason both African-American and non-Hispanic White subjects refused to enroll was due to a lack of interest in the study. Other barriers to enrollment include; time or being too busy, sick or had other issues, and being too far. Additionally, there were a number of non-Hispanic White respondents (<italic>n</italic> = 27) who reported they didn&#x2019;t want their medicine changed and trust was an infrequent response as a barrier to enrollment for both African-Americans and non-Hispanic White respondents (<xref ref-type="fig" rid="F2">Figure 2B</xref>). Additionally, 6% of refusal responses were missing at the Academic hospital because some subjects abruptly hung up on research coordinators after they answered the phone or either received the subjects&#x2019; voicemail. When subjects did give reasons for refusing the study, examples of soft refusals were, &#x201C;Have too many doctor appointments at this time,&#x201D; &#x201C;Has too many things going on,&#x201D; or &#x201C;I want to stick with what my doctor said.&#x201D; When subjects gave hard refusals, some examples were, &#x201C;Not interested in hearing about a research study,&#x201D; &#x201C;I&#x2019;m not taking the meds and not interested in the study,&#x201D; or &#x201C;I don&#x2019;t have time and don&#x2019;t think that this study would be beneficial to me.&#x201D;</p>
</sec>
</sec>
<sec id="S4">
<title>Discussion</title>
<p>An analysis of enrollment outcomes into the INGENIOUS pharmacogenetic trial at the Safety net hospital and the Academic hospital in a diverse population was conducted. Historically, African-Americans have been underrepresented in research and clinical trials, with many researchers reporting mistrust as a major barrier to enrollment (<xref ref-type="bibr" rid="B30">Washington, 2006</xref>; <xref ref-type="bibr" rid="B10">Lincoln et al., 2018</xref>). Similarly, a recent study recorded viewpoints from African-Americans on receiving healthcare and found that some subjects felt they were being discriminated against, based on race and their health insurance coverage (<xref ref-type="bibr" rid="B4">Cuevas et al., 2017</xref>).</p>
<p>Due to reports of mistrust with research from minority populations, we hypothesized that minority populations enrolled into INGENIOUS would be less likely to enroll than non-Hispanic Whites. In our analyses, African-Americans at the Safety net and Academic hospital were less likely to refuse enrollment into this pharmacogenetic implementation trial than non-Hispanic Whites and support recent findings that suggest African-Americans are interested in participating in clinical trials when trust and support from providers exist (<xref ref-type="bibr" rid="B20">Robinson et al., 2016</xref>).</p>
<p>The Safety net hospital is a county, urban hospital, located in Indianapolis, Indiana and has 10 primary care sites in the Indianapolis area. In collaboration with the Indiana University School of Medicine, they provide a variety of health programs to their communities. One possible explanation for the unanticipated result which showed African-Americans were less likely to refuse enrollment into the INGENIOUS trial may be due to the high awareness of research studies conducted at this hospital. The Indiana Clinical and Translational Sciences Institute Research Network (ResNet) Program Manager was interviewed. Notably, ResNet clinical coordinators were involved in recruitment efforts at the Safety net and Academic hospitals. The ResNet Program Manager was asked why she thought African-Americans would agree to participate more than non-Hispanic Whites at the Safety net hospital. She replied, &#x201C;At the Safety net hospital, African-American patients often expect to be asked to participate in research.&#x201D; &#x201C;In fact, subjects frequently participate in multiple independent research studies and know that research is a part of their healthcare.&#x201D; Moreover, these subjects have had the opportunity to participate in over 500 active research studies since 2001<sup><xref ref-type="fn" rid="footnote2">2</xref></sup>. Previous studies have also reported that awareness of research studies is important for improving clinical trial participation in African-Americans and medically underserved communities (<xref ref-type="bibr" rid="B20">Robinson et al., 2016</xref>) but may be undervalued in early research recruitment strategies. For prospective subjects to gain interest in pharmacogenetic trials, subjects need to know they exist. The Safety net hospital promotes research through online advertising, education, and collaborating with established research institutions, consequently exposing their subjects to various research opportunities.</p>
<p>Additionally, mostly African-American recruiters were involved in enrolling subjects in the INGENIOUS study at the Safety net hospital and may have influenced positive enrollment in our African-American population. A prior study suggests African-Americans and other minorities need health care professionals from their own cultural background to increase trust in the health care system (<xref ref-type="bibr" rid="B8">Kennedy et al., 2007</xref>). In addition, the clinical coordinators are a part of the Indiana CTSI ResNet and are highly skilled, with over 20 years of experience.</p>
<p>Cultural competency has also been reported to improve relationships with providers and minority subjects (<xref ref-type="bibr" rid="B4">Cuevas et al., 2017</xref>). A recent study conducted by <xref ref-type="bibr" rid="B15">Nielsen et al., 2019</xref> implemented a cultural teaching program, which included 30 health professionals. The study demonstrated that improving cultural competencies enhance motivation in providers and strengthen relationships with minority subjects. Recruiters for the Safety net hospital are proficient in cultural competency and are experienced with recruiting diverse populations. Alternatively, <xref ref-type="bibr" rid="B17">Otado et al., 2015</xref>, reported a field-based strategy was the most impactful method for recruiting African-Americans and targeting a specific clinic was less effective.</p>
<p>We also evaluated the outcome of African-Americans being less likely to refuse the study than non-Hispanic Whites at the Academic hospital. Most subjects who enrolled at the Academic hospital were non-Hispanic White and were given an option to consent to the INGENIOUS trial by traveling to a site that was most convenient for them. Many responses from prospective subjects at the Academic hospital still reported that traveling was a barrier for participation. Although we cannot pinpoint exactly why prospective subjects who were non-Hispanic White had low enrollment, a fraction of participants reported not interested, being too busy/lack of time, being sick and the clinic or hospital being too far as top barriers to enrollment. While other explanations included work/other obligations and subjects not wanting their medication changed, which were more frequent in non-Hispanic White than African-American subjects (<xref ref-type="fig" rid="F2">Figure 2B</xref>).</p>
<p>Individuals living in medically underserved areas also have many barriers to equal health care and research opportunities, compared to the general population (<xref ref-type="bibr" rid="B25">Tanner et al., 2015</xref>). <xref ref-type="bibr" rid="B25">Tanner et al., 2015</xref> found that clinical trial researchers rarely engaged individuals in medically underserved communities to participate in clinical trials and experienced difficulty finding rural residents to participate in clinical trials. Additionally, in 2014, 27% of low-income adults in rural areas of Mississippi between the ages of 19&#x2013;64, were reported to be uninsured and ranked the lowest in health, in the state of Mississippi (<xref ref-type="bibr" rid="B29">Wang et al., 2017</xref>). Thus, individuals living in medically underserved areas would greatly benefit from a targeted health care initiative and improved research efforts by sponsors. Our study revealed subjects not living in MUA/P&#x2019;s were less likely to refuse the INGENIOUS trial than those subjects living in MUA/P&#x2019;s at the Academic hospital (<xref ref-type="table" rid="T2">Table 2</xref>), which is what was expected. However, MUA/P status was not associated with enrollment outcomes at the Safety net hospital.</p>
<p>We observed similar results for age and enrollment into clinical trials as in previous studies (<xref ref-type="bibr" rid="B23">Sisk et al., 2008</xref>). The odds of refusing the study increased with age at the Safety net and Academic hospital. These findings support the notion that older subjects are less likely to enroll in clinical trials. Elderly subjects also experience health disparities, reducing biases associated with old age and raising cultural proficiency has been suggested to improve health care in this population (<xref ref-type="bibr" rid="B19">Periyakoil, 2019</xref>) and also may improve clinical trial enrollment.</p>
<p>Moreover, a recent report by the FDA, evaluated women&#x2019;s participation into clinical trials worldwide and found that the United States had the highest enrollment of women (49.1%) compared to other countries; nevertheless, the majority of women who enrolled identified as white across various cardiovascular disease clinical trials (<xref ref-type="bibr" rid="B1">Ayuso et al., 2019</xref>). At the Academic hospital, women were less likely to refuse the study than men. Notably, increased enrollment reported for women in the United States, could be in part, due to the conscious effort of researchers to comply with the NIH policies on the inclusion of women (<xref ref-type="bibr" rid="B26">Taylor, 2008</xref>).</p>
<p>In contrast, understanding why potential subjects do not enroll in clinical trials is of equal importance. The top 4 responses for refusing to enroll were similar between African-Americans and non-Hispanic Whites at both hospital systems. Less frequently reported was trust, for both African-American and non-Hispanic Whites. We also attempted to understand the reason for the respondents&#x2019; lack of interest. Those explanations were highly variable, and included, &#x201C;Don&#x2019;t want my body probed into,&#x201D; &#x201C;Don&#x2019;t pay enough,&#x201D; &#x201C;I don&#x2019;t think I will benefit from this study,&#x201D; &#x201C;My wife doesn&#x2019;t want me to,&#x201D; and &#x201C;Not in the mood for this research stuff.&#x201D; (<xref ref-type="fig" rid="F3">Figure 3</xref>). One drawback in the analysis was that the Safety net hospital data had 40% of the refusal responses missing and the Academic hospital had 6% of the refusal responses missing. In addition, with 19 different response categories, there were not enough data to make statistical comparisons between the responses for the different racial groups. However, a refusal response reported by African-American and non-Hispanic White subjects, &#x201C;open to the study, but not at this time,&#x201D; could be a unique opportunity to enhance research recruitment in future studies. These subjects clearly state they are interested in research, but perhaps had other commitments at the time of the INGENIOUS trial.</p>
<fig id="F3" position="float">
<label>FIGURE 3</label>
<caption><p>Prospective patients explanations for not being interested.</p></caption>
<graphic xlink:href="fgene-11-00571-g003.tif"/>
</fig>
<p>In summary, there were many barriers that prospective subjects reported for not enrolling into the INGENIOUS trial. Since lack of interest was the most frequent response in non-Hispanic White and African-American subjects, researchers should consider creative ways to promote interest in research to the general public before approaching perspective subjects by phone. Recent studies have demonstrated that implementing group seminars increase research participation (<xref ref-type="bibr" rid="B22">Shepp et al., 2018</xref>; <xref ref-type="bibr" rid="B11">Mayhew et al., 2020</xref>) and that telephone calls are less effective than in person recruitment (<xref ref-type="bibr" rid="B3">Chhatre et al., 2019</xref>).</p>
<p>Further, numerous studies have discussed strategies which may improve clinical trial participation for underserved populations. One of the common &#x201C;themes&#x201D; for improving enrollment for minority populations across genetic studies begin with building trust (<xref ref-type="bibr" rid="B7">Horowitz et al., 2019</xref>). Making trust a reality in underserved communities include; ensuring the research staff understands the challenges of the community, ensure a proportion of recruiters come from the community they are wanting to enroll, and establishing involvement from community stakeholders and subjects from minority populations in the beginning of the clinical trial design. Recruiters at the Safety net hospital reflected the population they were able to recruit, and likely influenced the positive enrollment at this hospital. Moving toward implementation of these strategies, which are likely to have a profound effect on successful enrollment are clearly the next steps.</p>
<p>Finally, personalized medicine approaches have improved drug exposure and response between racial/ethnic groups. Taking a personalized recruitment approach should increase clinical trial participation. Additionally, the implementation of the NIH inclusion policies by more trial sponsors should help to reduce healthcare disparities, by making the results relevant to more diverse racial/ethnic groups. This will undoubtedly make drugs safer and more efficacious in diverse populations.</p>
</sec>
<sec id="S5">
<title>Data Availability Statement</title>
<p>The datasets generated for this study are available on request to the corresponding author.</p>
</sec>
<sec id="S6">
<title>Ethics Statement</title>
<p>The studies involving human participants were reviewed and approved by Indiana University Institutional Review Board. The patients/participants provided their written informed consent to participate in this study.</p>
</sec>
<sec id="S7">
<title>Author Contributions</title>
<p>ES-W, KL, YZ, AH, and TS: article preparation. ES-W, KL, YZ, AH, PD, and TS: conceptualization. CS, KL, PD, and TS: recruitment implementation. ES-W, YZ, AH, KL, and TS: data analysis. All authors contributed to the article and approved the submitted version.</p>
</sec>
<sec id="conf1">
<title>Conflict of Interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
</body>
<back>
<fn-group>
<fn fn-type="financial-disclosure">
<p><bold>Funding.</bold> This study was supported by NIH grants HG007762 and TR002529.</p>
</fn>
</fn-group>
<ack>
<p>We would like to thank Jane French (CTSI Program Manager) for her support and contribution to this work.</p>
</ack>
<sec id="S10" sec-type="supplementary material"><title>Supplementary Material</title>
<p>The Supplementary Material for this article can be found online at: <ext-link ext-link-type="uri" xlink:href="https://www.frontiersin.org/articles/10.3389/fgene.2020.00571/full#supplementary-material">https://www.frontiersin.org/articles/10.3389/fgene.2020.00571/full#supplementary-material</ext-link></p>
<supplementary-material xlink:href="Image_1.tiff" id="SM1" mimetype="image/tiff" xmlns:xlink="http://www.w3.org/1999/xlink"/>
</sec>
<ref-list>
<title>References</title>
<ref id="B1"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ayuso</surname> <given-names>E.</given-names></name> <name><surname>Geller</surname> <given-names>R. J.</given-names></name> <name><surname>Wang</surname> <given-names>J.</given-names></name> <name><surname>Whyte</surname> <given-names>J.</given-names></name> <name><surname>Jenkins</surname> <given-names>M.</given-names></name></person-group> (<year>2019</year>). <article-title>Evaluation of worldwide clinical trials by gender: an FDA perspective.</article-title> <source><italic>Contemp. Clin. Trials</italic></source> <volume>80</volume> <fpage>16</fpage>&#x2013;<lpage>21</lpage>. <pub-id pub-id-type="doi">10.1016/j.cct.2019.03.007</pub-id> <pub-id pub-id-type="pmid">30890465</pub-id></citation></ref>
<ref id="B2"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chalasani</surname> <given-names>N.</given-names></name> <name><surname>Reddy</surname> <given-names>K. R. K.</given-names></name> <name><surname>Fontana</surname> <given-names>R. J.</given-names></name> <name><surname>Barnhart</surname> <given-names>H.</given-names></name> <name><surname>Gu</surname> <given-names>J.</given-names></name> <name><surname>Hayashi</surname> <given-names>P. H.</given-names></name><etal/></person-group> (<year>2017</year>). <article-title>Idiosyncratic drug induced liver injury in african-americans is associated with greater morbidity and mortality compared to caucasians.</article-title> <source><italic>Am. J. Gastroenterol.</italic></source> <volume>112</volume> <fpage>1382</fpage>&#x2013;<lpage>1388</lpage>. <pub-id pub-id-type="doi">10.1038/ajg.2017.215</pub-id> <pub-id pub-id-type="pmid">28762375</pub-id></citation></ref>
<ref id="B3"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chhatre</surname> <given-names>S.</given-names></name> <name><surname>Jefferson</surname> <given-names>A.</given-names></name> <name><surname>Cook</surname> <given-names>R.</given-names></name> <name><surname>Meeker</surname> <given-names>C. R.</given-names></name> <name><surname>Kim</surname> <given-names>J. H.</given-names></name> <name><surname>Hartz</surname> <given-names>K. M.</given-names></name><etal/></person-group> (<year>2019</year>). <article-title>Patient-centered recruitment and retention for a randomized controlled study.</article-title> <source><italic>Trials</italic></source> <volume>19</volume>:<issue>205</issue>.</citation></ref>
<ref id="B4"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cuevas</surname> <given-names>A. G.</given-names></name> <name><surname>OBrien</surname> <given-names>K.</given-names></name> <name><surname>Saha</surname> <given-names>S.</given-names></name></person-group> (<year>2017</year>). <article-title>What is the key to culturally competent care: reducing bias or cultural tailoring?.</article-title> <source><italic>Psychol. Health</italic></source> <volume>32</volume> <fpage>493</fpage>&#x2013;<lpage>507</lpage>. <pub-id pub-id-type="doi">10.1080/08870446.2017.1284221</pub-id> <pub-id pub-id-type="pmid">28165767</pub-id></citation></ref>
<ref id="B5"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Eadon</surname> <given-names>M. T.</given-names></name> <name><surname>Desta</surname> <given-names>Z.</given-names></name> <name><surname>Levy</surname> <given-names>K. D.</given-names></name> <name><surname>Decker</surname> <given-names>B. S.</given-names></name> <name><surname>Pierson</surname> <given-names>R. C.</given-names></name> <name><surname>Pratt</surname> <given-names>V. M.</given-names></name><etal/></person-group> (<year>2016</year>). <article-title>Implementation of a pharmacogenomics consult service to support the INGENIOUS trial.</article-title> <source><italic>Clin. Pharmacol. Ther.</italic></source> <volume>100</volume> <fpage>63</fpage>&#x2013;<lpage>66</lpage>. <pub-id pub-id-type="doi">10.1002/cpt.347</pub-id> <pub-id pub-id-type="pmid">26850569</pub-id></citation></ref>
<ref id="B6"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Harris</surname> <given-names>P. A.</given-names></name> <name><surname>Taylor</surname> <given-names>R.</given-names></name> <name><surname>Thielke</surname> <given-names>R.</given-names></name> <name><surname>Payne</surname> <given-names>J.</given-names></name> <name><surname>Gonzalez</surname> <given-names>N.</given-names></name> <name><surname>Conde</surname> <given-names>J. G.</given-names></name></person-group> (<year>2009</year>). <article-title>Research electronic data capture (REDCap)&#x2013;a metadata-driven methodology and workflow process for providing translational research informatics support.</article-title> <source><italic>J. Biomed. Inform.</italic></source> <volume>42</volume> <fpage>377</fpage>&#x2013;<lpage>381</lpage>. <pub-id pub-id-type="doi">10.1016/j.jbi.2008.08.010</pub-id> <pub-id pub-id-type="pmid">18929686</pub-id></citation></ref>
<ref id="B7"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Horowitz</surname> <given-names>C. R.</given-names></name> <name><surname>Sabin</surname> <given-names>T.</given-names></name> <name><surname>Ramos</surname> <given-names>M.</given-names></name> <name><surname>Richardson</surname> <given-names>L. D.</given-names></name> <name><surname>Hauser</surname> <given-names>D.</given-names></name> <name><surname>Robinson</surname> <given-names>M.</given-names></name><etal/></person-group> (<year>2019</year>). <article-title>Successful recruitment and retention of diverse participants in a genomics clinical trial: a good invitation to a great party.</article-title> <source><italic>Genet. Med</italic>.</source> <volume>21</volume> <fpage>2364</fpage>&#x2013;<lpage>2370</lpage>. <pub-id pub-id-type="doi">10.1038/s41436-019-0498-x</pub-id> <pub-id pub-id-type="pmid">30948857</pub-id></citation></ref>
<ref id="B8"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kennedy</surname> <given-names>B. R.</given-names></name> <name><surname>Mathis</surname> <given-names>C. C.</given-names></name> <name><surname>Woods</surname> <given-names>A. K.</given-names></name></person-group> (<year>2007</year>). <article-title>African-Americans and their distrust of the health care system: healthcare for diverse populations.</article-title> <source><italic>J. Cult. Divers.</italic></source> <volume>14</volume> <fpage>56</fpage>&#x2013;<lpage>60</lpage>.</citation></ref>
<ref id="B9"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lee</surname> <given-names>Y. M.</given-names></name> <name><surname>Manzoor</surname> <given-names>B. S.</given-names></name> <name><surname>Cavallari</surname> <given-names>L. H.</given-names></name> <name><surname>Nutescu</surname> <given-names>E. A.</given-names></name></person-group> (<year>2018</year>). <article-title>Facilitators and barriers to the adoption of pharmacogenetic testing in an inner-city population.</article-title> <source><italic>Pharmacotherapy</italic></source> <volume>38</volume> <fpage>205</fpage>&#x2013;<lpage>216</lpage>. <pub-id pub-id-type="doi">10.1002/phar.2077</pub-id> <pub-id pub-id-type="pmid">29286540</pub-id></citation></ref>
<ref id="B10"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lincoln</surname> <given-names>K. D.</given-names></name> <name><surname>Chow</surname> <given-names>T.</given-names></name> <name><surname>Gaines</surname> <given-names>B. F.</given-names></name> <name><surname>Fitzgerald</surname> <given-names>T.</given-names></name></person-group> (<year>2018</year>). <article-title>Fundamental causes of barriers to participation in Alzheimers clinical research among African-Americans.</article-title> <source><italic>Ethn. Health</italic></source> <volume>30</volume> <fpage>1</fpage>&#x2013;<lpage>15</lpage>. <pub-id pub-id-type="doi">10.1080/13557858.2018.1539222</pub-id> <pub-id pub-id-type="pmid">30375237</pub-id></citation></ref>
<ref id="B11"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mayhew</surname> <given-names>M.</given-names></name> <name><surname>Leo</surname> <given-names>M. C.</given-names></name> <name><surname>Vollmer</surname> <given-names>W. M.</given-names></name> <name><surname>DeBar</surname> <given-names>L. L.</given-names></name> <name><surname>Kiernan</surname> <given-names>M.</given-names></name></person-group> (<year>2020</year>). <article-title>Interactive group-based orientation sessions: a method to improve adherence and retention in pragmatic clinical trials.</article-title> <source><italic>Contemp. Clin. Trials Commun.</italic></source> <volume>17</volume>:<issue>100527</issue>. <pub-id pub-id-type="doi">10.1016/j.conctc.2020.100527</pub-id> <pub-id pub-id-type="pmid">32083219</pub-id></citation></ref>
<ref id="B12"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Minneci</surname> <given-names>P. C.</given-names></name> <name><surname>Deans</surname> <given-names>K. J.</given-names></name></person-group> (<year>2018</year>). <article-title>Clinical trials.</article-title> <source><italic>Semin. Pediatr. Surg.</italic></source> <volume>27</volume> <fpage>332</fpage>&#x2013;<lpage>337</lpage>.</citation></ref>
<ref id="B13"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Moffett</surname> <given-names>B. S.</given-names></name> <name><surname>Kim</surname> <given-names>S.</given-names></name> <name><surname>BomgAfrican-Americanrs</surname> <given-names>L. R.</given-names></name></person-group> (<year>2013</year>). <article-title>Readmissions for warfarin-related bleeding in pediatric subjects after hospital discharge.</article-title> <source><italic>Pediatr. Blood Cancer</italic></source> <volume>60</volume> <fpage>1503</fpage>&#x2013;<lpage>1506</lpage>. <pub-id pub-id-type="doi">10.1002/pbc.24546</pub-id> <pub-id pub-id-type="pmid">23606286</pub-id></citation></ref>
<ref id="B14"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Musemwa</surname> <given-names>N.</given-names></name> <name><surname>Gadegbeku</surname> <given-names>C. A.</given-names></name></person-group> (<year>2017</year>). <article-title>Hypertension in African-Americans.</article-title> <source><italic>Curr. Cardiol. Rep.</italic></source> <volume>19</volume>:<issue>129</issue>.</citation></ref>
<ref id="B15"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nielsen</surname> <given-names>D. S.</given-names></name> <name><surname>Korsholm</surname> <given-names>K. M.</given-names></name> <name><surname>Mottelson</surname> <given-names>I.</given-names></name> <name><surname>Sodemann</surname> <given-names>M.</given-names></name></person-group> (<year>2019</year>). <article-title>Cultural competences gained through an education program as ethnic patient coordinator: a qualitative study.</article-title> <source><italic>J. Transcult. Nurs.</italic></source> <volume>30</volume> <fpage>394</fpage>&#x2013;<lpage>402</lpage>. <pub-id pub-id-type="doi">10.1177/1043659618823923</pub-id> <pub-id pub-id-type="pmid">30688159</pub-id></citation></ref>
<ref id="B16"><citation citation-type="journal"><collab>No author list</collab> (<year>2018</year>). <article-title>Diversifying clinical trials.</article-title> <source><italic>Nat. Med.</italic></source> <volume>24</volume>:<issue>1779</issue>. <pub-id pub-id-type="doi">10.1038/s41591-018-0303-4</pub-id> <pub-id pub-id-type="pmid">30523324</pub-id></citation></ref>
<ref id="B17"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Otado</surname> <given-names>J.</given-names></name> <name><surname>Kwagyan</surname> <given-names>J.</given-names></name> <name><surname>Edwards</surname> <given-names>D.</given-names></name> <name><surname>Ukaegbu</surname> <given-names>A.</given-names></name> <name><surname>Rockcliffe</surname> <given-names>F.</given-names></name> <name><surname>Osafo</surname> <given-names>N.</given-names></name></person-group> (<year>2015</year>). <article-title>Culturally competent strategies for recruitment and retention of african-american populations into clinical trials.</article-title> <source><italic>Clin. Transl. Sci.</italic></source> <volume>8</volume> <fpage>460</fpage>&#x2013;<lpage>466</lpage>. <pub-id pub-id-type="doi">10.1111/cts.12285</pub-id> <pub-id pub-id-type="pmid">25974328</pub-id></citation></ref>
<ref id="B18"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Perera</surname> <given-names>M. A.</given-names></name> <name><surname>Cavallari</surname> <given-names>L. H.</given-names></name> <name><surname>Johnson</surname> <given-names>J. A.</given-names></name></person-group> (<year>2014</year>). <article-title>Warfarin pharmacogenetics: an illustration of the importance of studies in minority populations.</article-title> <source><italic>Clin. Pharmacol. Ther.</italic></source> <volume>95</volume> <fpage>242</fpage>&#x2013;<lpage>244</lpage>. <pub-id pub-id-type="doi">10.1038/clpt.2013.209</pub-id> <pub-id pub-id-type="pmid">24548987</pub-id></citation></ref>
<ref id="B19"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Periyakoil</surname> <given-names>V. S.</given-names></name></person-group> (<year>2019</year>). <article-title>Building a culturally competent workforce to care for diverse older adults: scope of the problem and potential solutions.</article-title> <source><italic>J. Am. Geriatr. Soc.</italic></source> <volume>67</volume> <fpage>S423</fpage>&#x2013;<lpage>S432</lpage>.</citation></ref>
<ref id="B20"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Robinson</surname> <given-names>B. N.</given-names></name> <name><surname>Newman</surname> <given-names>A. F.</given-names></name> <name><surname>Wallington</surname> <given-names>S. F.</given-names></name> <name><surname>Swain</surname> <given-names>S. M.</given-names></name></person-group> (<year>2016</year>). <article-title>Focus on You: cancer clinical trials perspectives.</article-title> <source><italic>Contemp. Clin. Trials Commun.</italic></source> <volume>4</volume> <fpage>170</fpage>&#x2013;<lpage>178</lpage>. <pub-id pub-id-type="doi">10.1016/j.conctc.2016.09.004</pub-id> <pub-id pub-id-type="pmid">28770256</pub-id></citation></ref>
<ref id="B21"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shendre</surname> <given-names>A.</given-names></name> <name><surname>Dillon</surname> <given-names>C.</given-names></name> <name><surname>Limdi</surname> <given-names>N. A.</given-names></name></person-group> (<year>2018</year>). <article-title>Pharmacogenetics of warfarin dosing in subjects of African and European ancestry.</article-title> <source><italic>Pharmacogenomics</italic></source> <volume>19</volume> <fpage>1357</fpage>&#x2013;<lpage>1371</lpage>. <pub-id pub-id-type="doi">10.2217/pgs-2018-0146</pub-id> <pub-id pub-id-type="pmid">30345882</pub-id></citation></ref>
<ref id="B22"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shepp</surname> <given-names>S. B.</given-names></name> <name><surname>Davis</surname> <given-names>A.</given-names></name> <name><surname>Dean</surname> <given-names>H.</given-names></name> <name><surname>Gibson</surname> <given-names>J.</given-names></name> <name><surname>Johnson</surname> <given-names>B.</given-names></name> <name><surname>Merner</surname> <given-names>N. D.</given-names></name></person-group> (<year>2018</year>). <article-title>Establishment of the Alabama Hereditary Cancer Cohort - strategies for the inclusion of underrepresented populations in cancer genetics research.</article-title> <source><italic>Mol. Genet. Genomic Med.</italic></source> <volume>6</volume> <fpage>766</fpage>&#x2013;<lpage>778</lpage>. <pub-id pub-id-type="doi">10.1002/mgg3.443</pub-id> <pub-id pub-id-type="pmid">29962060</pub-id></citation></ref>
<ref id="B23"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sisk</surname> <given-names>J. E.</given-names></name> <name><surname>Horowitz</surname> <given-names>C. R.</given-names></name> <name><surname>Wang</surname> <given-names>J. J.</given-names></name> <name><surname>McLaughlin</surname> <given-names>M. A.</given-names></name> <name><surname>Hebert</surname> <given-names>P. L.</given-names></name> <name><surname>Tuzzio</surname> <given-names>L.</given-names></name></person-group> (<year>2008</year>). <article-title>The success of recruiting minorities, women, and elderly into a randomized controlled effectiveness trial.</article-title> <source><italic>Mt Sinai J. Med.</italic></source> <volume>75</volume> <fpage>37</fpage>&#x2013;<lpage>43</lpage>. <pub-id pub-id-type="doi">10.1002/msj.20014</pub-id> <pub-id pub-id-type="pmid">18306248</pub-id></citation></ref>
<ref id="B24"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Smith</surname> <given-names>C. E.</given-names></name> <name><surname>Fullerton</surname> <given-names>S. M.</given-names></name> <name><surname>Dookeran</surname> <given-names>K. A.</given-names></name> <name><surname>Hampel</surname> <given-names>H.</given-names></name> <name><surname>Tin</surname> <given-names>A.</given-names></name> <name><surname>Maruthur</surname> <given-names>N. M.</given-names></name><etal/></person-group> (<year>2016</year>). <article-title>Using genetic technologies to reduce. rather than widen, health disparities.</article-title> <source><italic>Health Aff.</italic></source> <volume>35</volume> <fpage>367</fpage>&#x2013;<lpage>373</lpage>.</citation></ref>
<ref id="B25"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tanner</surname> <given-names>A.</given-names></name> <name><surname>Kim</surname> <given-names>S. H.</given-names></name> <name><surname>Friedman</surname> <given-names>D. B.</given-names></name> <name><surname>Foster</surname> <given-names>C.</given-names></name> <name><surname>Bergeron</surname> <given-names>C. D.</given-names></name></person-group> (<year>2015</year>). <article-title>Promoting clinical research to medically underserved communities: current practices and perceptions about clinical trial recruiting strategies.</article-title> <source><italic>Contemp. Clin. Trials</italic></source> <volume>41</volume> <fpage>39</fpage>&#x2013;<lpage>44</lpage>. <pub-id pub-id-type="doi">10.1016/j.cct.2014.12.010</pub-id> <pub-id pub-id-type="pmid">25542611</pub-id></citation></ref>
<ref id="B26"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Taylor</surname> <given-names>H. A.</given-names></name></person-group> (<year>2008</year>). <article-title>Implementation of NIH inclusion guidelines: survey of NIH study section members.</article-title> <source><italic>Clin Trials</italic></source> <volume>5</volume> <fpage>140</fpage>&#x2013;<lpage>146</lpage>. <pub-id pub-id-type="doi">10.1177/1740774508089457</pub-id> <pub-id pub-id-type="pmid">18375652</pub-id></citation></ref>
<ref id="B27"><citation citation-type="journal"><collab>The National Academies of Sciences Engineering, and Medicine</collab> (<year>2016</year>). &#x201C;<article-title>Roundtable on the promotion of health equity and the elimination of health disparities; board on population health and public health practice; health and medicine division; national academies of sciences, engineering, and medicine</article-title>,&#x201D; in <source><italic>The Private Sector as a Catalyst for Health Equity and a Vibrant Economy: Proceedings of a Workshop</italic></source>, <role>eds</role> <person-group person-group-type="editor"><name><surname>Olson</surname> <given-names>S.</given-names></name> <name><surname>Anderson</surname> <given-names>K. M.</given-names></name></person-group> (<publisher-loc>Washington, DC</publisher-loc>: <publisher-name>National Academies Press (US)</publisher-name>).</citation></ref>
<ref id="B28"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Thorpe</surname> <given-names>R. J.</given-names> <suffix>Jr.</suffix></name> <name><surname>Fesahazion</surname> <given-names>R. G.</given-names></name> <name><surname>Parker</surname> <given-names>L.</given-names></name> <name><surname>Wilder</surname> <given-names>T.</given-names></name> <name><surname>Rooks</surname> <given-names>R. N.</given-names></name> <name><surname>Bowie</surname> <given-names>J. V.</given-names></name><etal/></person-group> (<year>2016</year>). <article-title>Accelerated health declines among african-Americans in the USA.</article-title> <source><italic>J. Urban Health</italic></source> <volume>93</volume> <fpage>808</fpage>&#x2013;<lpage>819</lpage>. <pub-id pub-id-type="doi">10.1007/s11524-016-0075-4</pub-id> <pub-id pub-id-type="pmid">27653384</pub-id></citation></ref>
<ref id="B29"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wang</surname> <given-names>S. C.</given-names></name> <name><surname>Crook</surname> <given-names>L.</given-names></name> <name><surname>Connell</surname> <given-names>C.</given-names></name> <name><surname>Yadrick</surname> <given-names>K.</given-names></name></person-group> (<year>2017</year>). <article-title>We need help in the delta.</article-title> <source><italic>Am. J. Mens. Health</italic></source> <volume>11</volume> <fpage>414</fpage>&#x2013;<lpage>425</lpage>.</citation></ref>
<ref id="B30"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Washington</surname> <given-names>H.</given-names></name></person-group> (<year>2006</year>). <source><italic>Medical Apartheid: The Dark History of Medical Experimentation on Black Americans from Colonial Times to the Present.</italic></source> <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Doubleday Publishers</publisher-name>.</citation></ref>
</ref-list>
<fn-group>
<fn id="footnote1">
<label>1</label>
<p><ext-link ext-link-type="uri" xlink:href="https://bhw.hrsa.gov/shortage-designation/types">https://bhw.hrsa.gov/shortage-designation/types</ext-link></p></fn>
<fn id="footnote2">
<label>2</label>
<p><ext-link ext-link-type="uri" xlink:href="https://www.eskenazihealth.edu/about/research">https://www.eskenazihealth.edu/about/research</ext-link></p></fn>
</fn-group>
</back>
</article>