<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" article-type="research-article" dtd-version="2.3" xml:lang="EN">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Oncol.</journal-id>
<journal-title>Frontiers in Oncology</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Oncol.</abbrev-journal-title>
<issn pub-type="epub">2234-943X</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fonc.2022.859415</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Oncology</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Optimizing the Region for Evaluation of Global Gamma Analysis for Nasopharyngeal Cancer (NPC) Pretreatment IMRT QA by COMPASS: A Retrospective Study</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name>
<surname>Lu</surname><given-names>Wenli</given-names>
</name>
<uri xlink:href="https://loop.frontiersin.org/people/1301364"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Li</surname><given-names>Ying</given-names>
</name>
<uri xlink:href="https://loop.frontiersin.org/people/932834"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Huang</surname><given-names>Wei</given-names>
</name>
<uri xlink:href="https://loop.frontiersin.org/people/1178326"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Cui</surname><given-names>Haixia</given-names>
</name>
<uri xlink:href="https://loop.frontiersin.org/people/1445428"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Zhang</surname><given-names>Hanyin</given-names>
</name>
<uri xlink:href="https://loop.frontiersin.org/people/1655615"/>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name>
<surname>Yi</surname><given-names>Xin</given-names>
</name>
<xref ref-type="author-notes" rid="fn001"><sup>*</sup></xref>
<uri xlink:href="https://loop.frontiersin.org/people/1121190"/>
</contrib>
</contrib-group>
<aff id="aff1"><institution>Department of Oncology, The First Affiliated Hospital of Chongqing Medical University</institution>, <addr-line>Chongqing</addr-line>, <country>China</country></aff>
<author-notes>
<fn fn-type="edited-by">
<p>Edited by: Nesrin Dogan, University of Miami, United States</p>
</fn>
<fn fn-type="edited-by">
<p>Reviewed by: Gage Redler, Moffitt Cancer Center, United States; Perry Johnson, University of Florida, United States</p>
</fn>
<fn fn-type="corresp" id="fn001">
<p>*Correspondence: Xin Yi, <email xlink:href="mailto:noodles@hospital.cqmu.edu.cn">noodles@hospital.cqmu.edu.cn</email>
</p>
</fn>
<fn fn-type="other" id="fn002">
<p>This article was submitted to Radiation Oncology, a section of the journal Frontiers in Oncology</p>
</fn>
</author-notes>
<pub-date pub-type="epub">
<day>14</day>
<month>06</month>
<year>2022</year>
</pub-date>
<pub-date pub-type="collection">
<year>2022</year>
</pub-date>
<volume>12</volume>
<elocation-id>859415</elocation-id>
<history>
<date date-type="received">
<day>21</day>
<month>01</month>
<year>2022</year>
</date>
<date date-type="accepted">
<day>10</day>
<month>05</month>
<year>2022</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#xa9; 2022 Lu, Li, Huang, Cui, Zhang and Yi</copyright-statement>
<copyright-year>2022</copyright-year>
<copyright-holder>Lu, Li, Huang, Cui, Zhang and Yi</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p>
</license>
</permissions>
<abstract>
<sec>
<title>Background</title>
<p>The global gamma passing rate is the most commonly used metric for patient-specific pretreatment quality assurance in radiation therapy. However, the optimal region for evaluation and specific action limits (ALs) need to be explored. Therefore, this study was carried out to explore the optimal region for evaluation of the global gamma passing rate and define ALs by using the COMPASS software.</p>
</sec>
<sec>
<title>Methods</title>
<p>A total of 93 intensity-modulated radiation therapy (IMRT) plans for nasopharyngeal cancer (NPC) patients, including 61 original plans and 32 multileaf collimator (MLC) error-introduced test plans, were selected for retrospective analysis. Firstly, the dose distribution was divided into six isodose regions (&#x201c;&#x2265;10%&#x201d;, &#x201c;&#x2265;20%&#x201d;, &#x201c;&#x2265;30%&#x201d;, &#x201c;&#x2265;40%&#x201d;, &#x201c;&#x2265;50%&#x201d;, and &#x201c;&#x2265;60%&#x201d;) based on the prescribed dose and one clinically oriented region for evaluation (&#x201c;whole&#x201d;) to perform the three-dimensional (3D) global gamma reanalysis. Meanwhile, the percentage gamma passing rate (%GP), mean gamma index (&#x3bc;GI) based on 3%/2 mm criteria, and percentage dose error (%DE) of the dose&#x2013;volume histogram (DVH) metrics were recorded by COMPASS application. Secondly, the Pearson&#x2019;s correlation coefficient was used to analyze the correlation between %GP and %DE and between &#x3bc;GI and %DE in different regions. Additionally, receiver operating characteristic (ROC) methodology was applied to quantify the fraction of patient-specific plans evaluated as &#x201c;fail&#x201d; and &#x201c;pass&#x201d;. In order to improve the correlation between gamma analysis result and clinical criteria, ROC analysis was carried out in accordance with hybridization analysis criteria (%DE &#x2264;3%, %GP &#x2265;90% and %DE &#x2264;3%, &#x3bc;GI &#x2264;0.6). ROC was performed for two purposes: 1) to analyze the sensitivity and specificity of %GP and &#x3bc;GI in different regions for evaluation and 2) to define the ALs of %GP and &#x3bc;GI in the optimal region for evaluation. Finally, the plans introduced with MLC errors were prepared for validation. Moreover, we also compared the positive rate of ALs of both %GP and &#x3bc;GI in detecting MLC error-introduced plans in different regions.</p>
</sec>
<sec>
<title>Results</title>
<p>1) In our study, a number of DVH-based metrics were found to be correlated with the evaluation parameters. The corresponding number was 4, 2, 1, 1, 1, 1, and 3 in &#x3b3;<sub>whole</sub>, &#x3b3;<sub>10%</sub>, &#x3b3;<sub>20%</sub>, &#x3b3;<sub>30%</sub>, &#x3b3;<sub>40%</sub>, &#x3b3;<sub>50%</sub>, and &#x3b3;<sub>60%</sub>, respectively, and 5, 3, 0, 1, 1, 4, and 2 in &#x3bc;GI<sub>whole</sub>, &#x3bc;GI<sub>10%</sub>, &#x3bc;GI<sub>20%</sub>, &#x3bc;GI<sub>30%</sub>, &#x3bc;GI<sub>40%</sub>, &#x3bc;GI<sub>50%</sub>, and &#x3bc;GI<sub>60%</sub>, respectively. The results by COMPASS have revealed that the %DE of specific structures has a slightly higher correlation with both %GP and &#x3bc;GI of the &#x201c;whole&#x201d; region compared with that of any other region. However, it is a moderate correlation (0.5 &#x2264; |r| &lt; 0.8). 2) The areas under the curves (AUCs) of &#x3b3;<sub>whole</sub>, &#x3bc;GI<sub>whole</sub>, &#x3bc;GI<sub>40%</sub>, &#x3bc;GI<sub>50%</sub>, and &#x3bc;GI<sub>60%</sub> were &gt;0.7 based on 3%/2 mm criteria. According to the Youden coefficient, we defined the ALs of &#x3b3;<sub>whole</sub> &#x2265;92%, &#x3bc;GI<sub>whole &#x2264;</sub>0.36, &#x3bc;GI<sub>40%</sub> &#x2264;0.43, and &#x3bc;GI<sub>60%</sub> &#x2264;0.40 based on 3%/2 mm criteria. 3) In the validation, for original plans, the accuracy of AL<sub>&#x3b3;whole</sub>, AL<sub>&#x3b3;10%</sub>, AL<sub>&#x3bc;GIwhole</sub>, AL<sub>&#x3bc;GI40%</sub>, AL<sub>&#x3bc;GI50%</sub>, and AL<sub>&#x3bc;GI60%</sub> was 23%, 9.8%, 90%, 80.3%, 9.8%, and 88.5%, respectively. For test plans with systematic MLC errors smaller than 0.8 mm, the positive rates of AL<sub>&#x3b3;whole</sub>, AL<sub>&#x3b3;10%</sub>, AL<sub>&#x3bc;GIwhole</sub>, AL<sub>&#x3bc;GI40%</sub>, AL<sub>&#x3bc;GI50%</sub>, and AL<sub>&#x3bc;GI60%</sub> were 25%, 58%, 92%, 92%, 42%, and 100%, respectively. For the plans with systematic MLC errors higher than 0.8 mm, the positive rates of all AL<sub>%GP</sub> and AL<sub>&#x3bc;GI</sub> were 100%. From the COMPASS validation results, the accuracy of &#x3b3;<sub>whole</sub>, &#x3bc;GI<sub>whole</sub>, &#x3bc;GI<sub>40%</sub>, and &#x3bc;GI<sub>60%</sub> was higher than that of the conventional &#x3b3;<sub>10%</sub> and commonly used &#x3bc;GI<sub>50%</sub>.</p>
</sec>
<sec>
<title>Conclusions</title>
<p>Compared with the traditional evaluation region (i.e., the criteria with a threshold of 10% or a threshold of 50%, it was the same with the isodose regions of &#x201c;&#x2265;10%&#x201d;, &#x201c;&#x2265;50%&#x201d; based on the prescribed dose in our study), the &#x201c;whole&#x201d; region is more meaningful to the clinic by COMPASS. The accuracy of &#x3bc;GI<sub>whole</sub> is higher than that of the conventional &#x3b3;<sub>10%</sub> and the commonly used &#x3bc;GI<sub>50%</sub>.</p>
</sec>
</abstract>
<kwd-group>
<kwd>patient-specific quality assurance</kwd>
<kwd>region for evaluation</kwd>
<kwd>global gamma passing rate</kwd>
<kwd>percentage dose error</kwd>
<kwd>action limits</kwd>
</kwd-group>
<counts>
<fig-count count="8"/>
<table-count count="3"/>
<equation-count count="6"/>
<ref-count count="34"/>
<page-count count="12"/>
<word-count count="9979"/>
</counts>
</article-meta>
</front>
<body>
<sec id="s1" sec-type="intro">
<title>Introduction</title>
<p>As an advanced radiation therapy technique, intensity-modulated radiation therapy (IMRT) allows for a complex dose distribution, with sharp dose gradients often achieved at the edge of the planning target volume (PTV). As IMRT is able to create an intentionally inhomogeneous dose distribution, it has routinely been employed as a radiotherapy technique (<xref ref-type="bibr" rid="B1">1</xref>). Due to the complex features of the inverse planning and the complexity in the delivery process, safety and quality assurance (QA) are important (<xref ref-type="bibr" rid="B2">2</xref>). As an essential and important process, patient-specific QA analyzes and evaluates the deviation between the predicted dose and the delivered/measured dose. This process can be carried out by using film dosimetry, ionization chambers, electronic portal imaging device (EPID), two-dimensional (2D) array detector, three-dimensional (3D) dosimetric system, gel dosimetry, log file, etc. (<xref ref-type="bibr" rid="B3">3</xref>, <xref ref-type="bibr" rid="B4">4</xref>). Introduced in a seminal work by Low et&#xa0;al. (<xref ref-type="bibr" rid="B5">5</xref>), the global gamma index method is the most widely used technique for comparison of dose distribution for patient-specific pretreatment QA in radiation therapy (<xref ref-type="bibr" rid="B5">5</xref>&#x2013;<xref ref-type="bibr" rid="B7">7</xref>). The 2D or 3D gamma analysis could be chosen based on different equipment. As a 3D volume analysis, the 3D gamma analysis can be used by COMPASS, Delta<sup>4</sup>, ArcCheck, Dolphin, OCTAVIUS 4D, etc. As a plane analysis, the 2D gamma analysis is often used by array detector, just like EPID, log file, Mapcheck, etc. Compared with the 2D gamma analysis, the 3D gamma analysis is increasingly winning high favor among medical physicists because it can provide more comprehensive QA information. However, the 3D gamma analysis could make the Region of Interest (ROI) selection more complex.</p>
<p>In clinical practice, the results of the patient-specific QA should reveal the percentage dose errors (%DEs) of dose&#x2013;volume histogram (DVH) metrics (i.e., if the results of the patient-specific QA was acceptable, the %DE should be &#x2264;3%), which are the important parameters used by radiation oncologists (<xref ref-type="bibr" rid="B8">8</xref>). However, Nelms et&#xa0;al. (<xref ref-type="bibr" rid="B9">9</xref>), Stasi et&#xa0;al. (<xref ref-type="bibr" rid="B10">10</xref>), and Fredh et&#xa0;al. (<xref ref-type="bibr" rid="B11">11</xref>) have found that the conventional global gamma analysis has limited sensitivity to dose errors of DVH metrics. Recommended by the TG-218 (<xref ref-type="bibr" rid="B3">3</xref>), the conventional global gamma analysis for QA measurements and corresponding treatment plan was performed in absolute dose mode, adopting global normalization (often using the maximum planned dose point) and a dose threshold of 10%. In some studies, it has been argued recently that the percentage gamma passing rate (%GP) of individual structures is more sensitive to dose errors than that in the conventional gamma method (<xref ref-type="bibr" rid="B12">12</xref>, <xref ref-type="bibr" rid="B13">13</xref>). The %GP of individual structures provides a greater insight into the dose delivered to target volume and organs at risk (OARs). Stasi et&#xa0;al. (<xref ref-type="bibr" rid="B10">10</xref>), Heilemann et&#xa0;al. (<xref ref-type="bibr" rid="B12">12</xref>), and Yi et&#xa0;al. (<xref ref-type="bibr" rid="B13">13</xref>) have adopted the %GP of individual structures instead of conventional global gamma. Because the %GP of individual structures can not only improve the weak correlation between the %GP and %DE but also provide spatial information of dose errors that are unavailable in conventional gamma analysis. However, this method is only suitable for plans for one body site with a simple anatomy just like the IMRT plan for cervical cancer. It is difficult to be promoted in head and neck plan verification due to multiple targets and OARs that cause inefficiencies and increased clinical workload due to an abundance of DVH parameters that must now be reviewed.</p>
<p>In some reports (<xref ref-type="bibr" rid="B14">14</xref>), the current IMRT QA practice has been fundamentally questioned due to the poor sensitivity and specificity of the global gamma index implementation. Under such circumstances, Stojadinovic et&#xa0;al. (<xref ref-type="bibr" rid="B15">15</xref>) and Yu et&#xa0;al. (<xref ref-type="bibr" rid="B6">6</xref>, <xref ref-type="bibr" rid="B16">16</xref>) have proposed the divide and conquer (D&amp;C) gamma method. In this method, the dose distribution is divided into distinct regions: i) a high-dose (HD) region within the 90% isodose, ii) a high-gradient (HG) region with doses ranging from 50% to 90% isodose, iii) a medium-dose (MD) region with doses ranging from 20% to 50% isodose, and iv) a low-dose (LD) region with doses ranging from 10% to 20% isodose. It has been indicated that the conventional gamma method includes almost all dose regions (&#x2265;10% isodose level). However, from a clinical perspective, not all dose regions are equally essential. By using the D&amp;C gamma method, more information can be provided for validation without further increasing the time-intensive nature of IMRT QA. Hence, it has challenged the adequacy of the conventional approach to patient-specific QA analysis. However, these publications have neither illustrated the correlation between the QA results and clinical DVH metrics nor verified the sensitivity and specificity of the D&amp;C gamma method.</p>
<p>In addition, the %GP has been explored in most studies, but the mean gamma index (&#x3bc;GI) has been accounted for in only a few publications. In fact, Stock et&#xa0;al. (<xref ref-type="bibr" rid="B17">17</xref>) have proposed the initial concept of achieving the &#x3bc;GI action limits (ALs) for the hot area (receiving 50% or more of the prescribed dose) as early as in 2005. Recently, Visser et&#xa0;al. (<xref ref-type="bibr" rid="B18">18</xref>) have completed the 3D dose verification by combining &#x3bc;GI evaluation with %DE. Few publications have explored the relationship between &#x3bc;GI and %DE or the impact of different evaluation regions on &#x3bc;GI.</p>
<p>In this study, a measurement-guided dose calculation system was used to divide the measured dose distribution into six isodose regions and one global clinically concerned region (PTV plus all OARs). By doing so, we aimed to investigate the optimal region where the correlation between %GP and %DE and between &#x3bc;GI and %DE can be improved. Besides, this study was also implemented to prove a new method that does not further increase the time-intensive nature of IMRT QA.</p>
</sec>
<sec id="s2" sec-type="materials|methods">
<title>Materials and Methods</title>
<p>We selected 93 IMRT plans for nasopharyngeal cancer (NPC), including 61 original plans and 32 multileaf collimator (MLC) error-introduced test plans for retrospective analysis. These plans had been performed with measurement-based patient-specific QA. With ALs based on 3%/2 mm (global normalization) criteria recommended in American Association of  Physicists in Medicine (AAPM) TG-218 (<xref ref-type="bibr" rid="B3">3</xref>), these IMRT QA plans were reanalyzed by using the different regions for evaluation.</p>
<sec id="s2_1">
<title>Definition of Regions for Evaluation</title>
<p>For the treatment planning, the dose distribution was computed with the anisotropic analytical algorithm (AAA). The dose calculation was carried out on a 2.5 mm isotropic dose grid in Eclipse treatment planning system (TPS) (Eclipse 13.5, VARIAN, USA) for a 6-MV photon beam on a UNIQUE linac (VARIAN, USA) equipped with a 120-leaf multileaf collimator (MLC) (millennium120 MLC, VARIAN, USA). In the dose verification, the structures were categorized into target volume and OAR as shown in <xref ref-type="table" rid="T1"><bold>Table&#xa0;1</bold></xref>. <xref ref-type="fig" rid="f1"><bold>Figure&#xa0;1</bold></xref> shows the dose distribution that was divided into six isodose regions (&#x201c;10%&#x201d;, &#x201c;20%&#x201d;, &#x201c;30%&#x201d;, &#x201c;40%&#x201d;, &#x201c;50%&#x201d;, and &#x201c;60%&#x201d;) and clinically oriented region (&#x201c;whole&#x201d;):</p>
<list list-type="simple">
<list-item>
<p>(1) The region of &#x201c;10%&#x201d; label refers to all the voxels with a dose value of 10% or greater. Universal ALs adopted in AAPM TG-218 report: gamma passing rate &#x2265;90% based on 3%/2 mm and a 10% dose threshold. Therefore, the region of &#x201c;10%&#x201d; label corresponds to the most widely used region by the conventional global gamma method.</p>
</list-item>
<list-item>
<p>(2) The region of &#x201c;50%&#x201d; label refers to all the voxels with a dose value of 50% or greater. It is the same region with the commonly used &#x3bc;GI for the hot area (receiving 50% or more of the prescribed dose) in the patient CT based on Stock et&#xa0;al. (<xref ref-type="bibr" rid="B17">17</xref>).</p>
</list-item>
<list-item>
<p>(3) The regions of &#x201c;20%&#x201d;, &#x201c;30%&#x201d;, &#x201c;40%&#x201d;, and &#x201c;60%&#x201d; labels refer to all the voxels with a dose value of 20%, 30%, 40%, and 60% or greater, respectively.</p>
</list-item>
<list-item>
<p>(4) The region of &#x201c;whole&#x201d; label indicates all voxels of PTV plus all of the OARs (spinal cord, brain stem, parotid L/R).</p>
</list-item>
</list>
<table-wrap id="T1" position="float">
<label>Table&#xa0;1</label>
<caption>
<p>The correlation between the %DE and the %GP in different regions for NPC patients.</p>
</caption>
<table frame="hsides">
<thead>
<tr>
<th valign="top" rowspan="2" align="left"/>
<th valign="top" rowspan="2" align="center"/>
<th valign="top" align="center" colspan="3">PTV</th>
<th valign="top" align="center" colspan="3">GTV</th>
<th valign="top" align="center">Parotid L</th>
<th valign="top" align="center">Parotid R</th>
<th valign="top" align="center">Brainstem</th>
<th valign="top" align="center">Spinalcord</th>
</tr>
<tr>
<th valign="top" align="center">D<sub>95</sub>
</th>
<th valign="top" align="center">D<sub>mean</sub>
</th>
<th valign="top" align="center">D<sub>5</sub>
</th>
<th valign="top" align="center">D<sub>98</sub>
</th>
<th valign="top" align="center">D<sub>mean</sub>
</th>
<th valign="top" align="center">D<sub>2</sub>
</th>
<th valign="top" align="center">D<sub>mean</sub>
</th>
<th valign="top" align="center">D<sub>mean</sub>
</th>
<th valign="top" align="center">D<sub>1</sub>
</th>
<th valign="top" align="center">D<sub>1</sub>
</th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">&#x3b3;<sub>whole</sub>
</td>
<td valign="top" align="left">r</td>
<td valign="top" align="center">-0.063</td>
<td valign="top" align="center">-0.241</td>
<td valign="top" align="center">-0.251</td>
<td valign="top" align="center">-0.014</td>
<td valign="top" align="center">-0.516</td>
<td valign="top" align="center">-0.606</td>
<td valign="top" align="center">-0.412</td>
<td valign="top" align="center">-0.457</td>
<td valign="top" align="center">0.236</td>
<td valign="top" align="center">0.148</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="left"><italic>p</italic>
</td>
<td valign="top" align="center">0.632</td>
<td valign="top" align="center">0.062</td>
<td valign="top" align="center">0.051</td>
<td valign="top" align="center">0.917</td>
<td valign="top" align="center">&lt;0.001*</td>
<td valign="top" align="center">&lt;0.001*</td>
<td valign="top" align="center">0.001*</td>
<td valign="top" align="center">&lt;0.001*</td>
<td valign="top" align="center">0.067</td>
<td valign="top" align="center">0.254</td>
</tr>
<tr>
<td valign="top" align="left">&#x3b3;<sub>10%</sub>
</td>
<td valign="top" align="left">r</td>
<td valign="top" align="center">-0.064</td>
<td valign="top" align="center">0.055</td>
<td valign="top" align="center">0.067</td>
<td valign="top" align="center">-0.057</td>
<td valign="top" align="center">0.232</td>
<td valign="top" align="center">0.256</td>
<td valign="top" align="center">-0.085</td>
<td valign="top" align="center">0.185</td>
<td valign="top" align="center">-0.436</td>
<td valign="top" align="center">0.058</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="left"><italic>p</italic>
</td>
<td valign="top" align="center">0.625</td>
<td valign="top" align="center">0.674</td>
<td valign="top" align="center">0.609</td>
<td valign="top" align="center">0.665</td>
<td valign="top" align="center">0.072</td>
<td valign="top" align="center">0.046*</td>
<td valign="top" align="center">0.516</td>
<td valign="top" align="center">0.153</td>
<td valign="top" align="center">&lt;0.001*</td>
<td valign="top" align="center">0.657</td>
</tr>
<tr>
<td valign="top" align="left">&#x3b3;<sub>20%</sub>
</td>
<td valign="top" align="left">r</td>
<td valign="top" align="center">-0.086</td>
<td valign="top" align="center">0.091</td>
<td valign="top" align="center">0.048</td>
<td valign="top" align="center">-0.083</td>
<td valign="top" align="center">0.184</td>
<td valign="top" align="center">0.147</td>
<td valign="top" align="center">-0.165</td>
<td valign="top" align="center">0.081</td>
<td valign="top" align="center">-0.393</td>
<td valign="top" align="center">0.047</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="left"><italic>p</italic>
</td>
<td valign="top" align="center">0.509</td>
<td valign="top" align="center">0.487</td>
<td valign="top" align="center">0.714</td>
<td valign="top" align="center">0.523</td>
<td valign="top" align="center">0.157</td>
<td valign="top" align="center">0.257</td>
<td valign="top" align="center">0.205</td>
<td valign="top" align="center">0.536</td>
<td valign="top" align="center">0.002*</td>
<td valign="top" align="center">0.716</td>
</tr>
<tr>
<td valign="top" align="left">&#x3b3;<sub>30%</sub>
</td>
<td valign="top" align="left">r</td>
<td valign="top" align="center">-0.096</td>
<td valign="top" align="center">0.064</td>
<td valign="top" align="center">-0.003</td>
<td valign="top" align="center">-0.101</td>
<td valign="top" align="center">0.102</td>
<td valign="top" align="center">0.021</td>
<td valign="top" align="center">-0.231</td>
<td valign="top" align="center">-0.037</td>
<td valign="top" align="center">-0.32</td>
<td valign="top" align="center">0.045</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="left"><italic>p</italic>
</td>
<td valign="top" align="center">0.462</td>
<td valign="top" align="center">0.622</td>
<td valign="top" align="center">0.979</td>
<td valign="top" align="center">0.439</td>
<td valign="top" align="center">0.433</td>
<td valign="top" align="center">0.87</td>
<td valign="top" align="center">0.074</td>
<td valign="top" align="center">0.777</td>
<td valign="top" align="center">0.012*</td>
<td valign="top" align="center">0.732</td>
</tr>
<tr>
<td valign="top" align="left">&#x3b3;<sub>40%</sub>
</td>
<td valign="top" align="left">r</td>
<td valign="top" align="center">-0.128</td>
<td valign="top" align="center">0.034</td>
<td valign="top" align="center">-0.053</td>
<td valign="top" align="center">-0.124</td>
<td valign="top" align="center">0.015</td>
<td valign="top" align="center">-0.112</td>
<td valign="top" align="center">-0.271</td>
<td valign="top" align="center">-0.148</td>
<td valign="top" align="center">-0.232</td>
<td valign="top" align="center">0.032</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="left"><italic>p</italic>
</td>
<td valign="top" align="center">0.325</td>
<td valign="top" align="center">0.797</td>
<td valign="top" align="center">0.685</td>
<td valign="top" align="center">0.341</td>
<td valign="top" align="center">0.911</td>
<td valign="top" align="center">0.391</td>
<td valign="top" align="center">0.035*</td>
<td valign="top" align="center">0.256</td>
<td valign="top" align="center">0.072</td>
<td valign="top" align="center">0.809</td>
</tr>
<tr>
<td valign="top" align="left">&#x3b3;<sub>50%</sub>
</td>
<td valign="top" align="left">r</td>
<td valign="top" align="center">-0.12</td>
<td valign="top" align="center">-0.041</td>
<td valign="top" align="center">-0.114</td>
<td valign="top" align="center">-0.079</td>
<td valign="top" align="center">-0.067</td>
<td valign="top" align="center">-0.196</td>
<td valign="top" align="center">-0.286</td>
<td valign="top" align="center">-0.223</td>
<td valign="top" align="center">-0.155</td>
<td valign="top" align="center">0.08</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="left"><italic>p</italic>
</td>
<td valign="top" align="center">0.357</td>
<td valign="top" align="center">0.755</td>
<td valign="top" align="center">0.383</td>
<td valign="top" align="center">0.545</td>
<td valign="top" align="center">0.61</td>
<td valign="top" align="center">0.129</td>
<td valign="top" align="center">0.025*</td>
<td valign="top" align="center">0.084</td>
<td valign="top" align="center">0.233</td>
<td valign="top" align="center">0.538</td>
</tr>
<tr>
<td valign="top" align="left">&#x3b3;<sub>60%</sub>
</td>
<td valign="top" align="left">r</td>
<td valign="top" align="center">-0.127</td>
<td valign="top" align="center">-0.083</td>
<td valign="top" align="center">-0.175</td>
<td valign="top" align="center">-0.076</td>
<td valign="top" align="center">-0.168</td>
<td valign="top" align="center">-0.281</td>
<td valign="top" align="center">-0.297</td>
<td valign="top" align="center">-0.255</td>
<td valign="top" align="center">-0.087</td>
<td valign="top" align="center">0.152</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="left"><italic>p</italic>
</td>
<td valign="top" align="center">0.331</td>
<td valign="top" align="center">0.527</td>
<td valign="top" align="center">0.177</td>
<td valign="top" align="center">0.562</td>
<td valign="top" align="center">0.196</td>
<td valign="top" align="center">0.028*</td>
<td valign="top" align="center">0.020*</td>
<td valign="top" align="center">0.048*</td>
<td valign="top" align="center">0.504</td>
<td valign="top" align="center">0.242</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn>
<p>&#x201c;*&#x201d; indicates a significant difference, p &lt; 0.05. D98, D95, D5, and D1 refers to the dose received by 98%, 95%, 5% and 1% volume of the structures including PTV, GTV, Parotid gland, Brainstem, Spinalcord, respectively. Dmean refers to the mean dose of the structures.</p>
</fn>
</table-wrap-foot>
</table-wrap>
<fig id="f1" position="float">
<label>Figure&#xa0;1</label>
<caption>
<p>Dose distribution of the IMRT plan for nasopharyngeal cancer. The dose distribution was divided into seven parts depicted in different colors: the pink line refers to the region of &#x201c;10%&#x201d; label; the yellow line refers to the region of &#x201c;20%&#x201d; label; the orange line refers to the region of &#x201c;30%&#x201d; label; the green line refers to the region of &#x201c;40%&#x201d; label; the magenta line refers to the region of &#x201c;50%&#x201d; label; the cyan line refers to the region of &#x201c;60%&#x201d; label; the blue line refers to the region of &#x201c;whole&#x201d; label.</p>
</caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fonc-12-859415-g001.tif"/>
</fig>
</sec>
<sec id="s2_2">
<title>Introduction of Multileaf Collimator Errors in Test Plans</title>
<p>An in-house Python program based on Pydicom (version 2.1.2) was used to introduce systematic MLC errors into the test plans by manipulation of DICOM RT files. As described in <xref ref-type="fig" rid="f2"><bold>Figure&#xa0;2</bold></xref>, the introduced systematic MLC errors included an increase and a decrease of the distance between leaf pairs in the beam field. The magnitudes of systematic MLC errors were &#xb1;0.2, &#xb1; 0.4, &#xb1; 0.6, &#xb1; 0.8, &#xb1; 1.0, &#xb1; 2.0, &#xb1; 3.0, and &#xb1;4.0 mm, respectively. If any magnitude of MLC errors had led to a negative leaf gap in some of the leaf pairs, the gap of this leaf pair would have been set to 0.5 mm. After systematic MLC errors were introduced into the original plans, the modified RT files were reimported into TPS for dose calculation. A total of 32 plans were generated as a validation dataset.</p>
<fig id="f2" position="float">
<label>Figure&#xa0;2</label>
<caption>
<p>Creation of the MLC error-introduced IMRT plan. <bold>(A)</bold> Original plan. <bold>(B)</bold> Plan introduced with positive MLC errors. <bold>(C)</bold> Plan introduced with negative MLC errors.</p>
</caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fonc-12-859415-g002.tif"/>
</fig>
</sec>
<sec id="s2_3">
<title>Quality Assurance Procedure</title>
<p>COMPASS (version 1.2. IBA Dosimetry, Germany) is a software that is used in conjunction with MatriXX<sup>Evolution</sup>ionization chamber-based 2D_IC array detector to provide a measurement-guided dose calculation. The COMPASS system is based on a beam model that includes the characteristics of the accelerator, a collapsed-cone convolution (CCC) algorithm. This allows pretreatment dose verification on CT images, including DVH. A strict commissioning of the COMPASS system, including the validation of accuracy for 2D_IC array (MatriXX, IBA Dosimetry) measurement, beam modeling, gantry angle sensor, and absolute dose calibration, was performed in advance according to the same standards as the clinic- used TPS. <xref ref-type="fig" rid="f3"><bold>Figure&#xa0;3</bold></xref> shows the flowchart of QA procedure that had been carried out in the study: i) Initially, all plans were transferred from the TPS to the COMPASS software, including all of the DICOM files (RT plans, RT doses, RT structures, and CT images). ii) Afterward, all plans were performed by a linear accelerator to obtain the dose fluence by COMPASS so as to get the measurement-based QA. Meanwhile, the MatriXX was hung under the collimator to obtain the dose fluence. iii) Finally, the 2D_IC array measurement doses were reconstructed on patients&#x2019; CT images using the COMPASS application that models the characteristics of the linear accelerator head.</p>
<fig id="f3" position="float">
<label>Figure&#xa0;3</label>
<caption>
<p>Flowchart of the quality assurance process in the study.</p>
</caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fonc-12-859415-g003.tif"/>
</fig>
<p>Furthermore, the dose distribution was calculated by the CCC algorithm and on a 2.5 mm isotropic dose grid by using the COMPASS application. In comparing the treatment planning and measurement-based QA, we recorded %DE, %GP, and &#x3bc;GI in different regions for reanalysis.</p>
<p>i) The %DE between the TPS dose and DVH index of measurement-based QA for specific structures was calculated as follows:</p>
<disp-formula>
<label>(1)</label>
<mml:math display="block" id="M1">
<mml:mrow>
<mml:mo>%</mml:mo>
<mml:mi>D</mml:mi>
<mml:msub>
<mml:mi>E</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>=</mml:mo>
<mml:mrow>
<mml:mo>|</mml:mo> <mml:mrow>
<mml:mfrac>
<mml:mrow>
<mml:msub>
<mml:mi>D</mml:mi>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mi>i</mml:mi>
<mml:mo stretchy="false">)</mml:mo>
<mml:mi>e</mml:mi>
<mml:mi>v</mml:mi>
<mml:mi>a</mml:mi>
<mml:mi>l</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mi>D</mml:mi>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mi>i</mml:mi>
<mml:mo stretchy="false">)</mml:mo>
<mml:mi>r</mml:mi>
<mml:mi>e</mml:mi>
<mml:mi>f</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mrow>
<mml:msub>
<mml:mi>D</mml:mi>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mi>i</mml:mi>
<mml:mo stretchy="false">)</mml:mo>
<mml:mi>r</mml:mi>
<mml:mi>e</mml:mi>
<mml:mi>f</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mfrac>
</mml:mrow> <mml:mo>|</mml:mo>
</mml:mrow>
<mml:mo>&#xd7;</mml:mo>
<mml:mn>100</mml:mn>
<mml:mo>%</mml:mo>
</mml:mrow>
</mml:math>
</disp-formula>
<p>where D<sub>eval</sub> is the measurement-based QA dose acquired by COMPASS, D<sub>ref</sub> refers to the treatment planning dose, and <italic>i</italic> refers to the measured and calculated dose point pair.</p>
<p>ii) The global %GP is defined as follows:</p>
<disp-formula>
<label>(2)</label>
<mml:math display="block" id="M2">
<mml:mrow>
<mml:msub>
<mml:mi>&#x393;</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mrow>
<mml:msub>
<mml:mi>r</mml:mi>
<mml:mrow>
<mml:mi>r</mml:mi>
<mml:mi>e</mml:mi>
<mml:mi>f</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>,</mml:mo>
<mml:msub>
<mml:mi>r</mml:mi>
<mml:mrow>
<mml:mi>e</mml:mi>
<mml:mi>v</mml:mi>
<mml:mi>a</mml:mi>
<mml:mi>l</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>=</mml:mo>
<mml:msqrt>
<mml:mrow>
<mml:mfrac>
<mml:mrow>
<mml:mi>&#x394;</mml:mi>
<mml:msup>
<mml:mi>d</mml:mi>
<mml:mn>2</mml:mn>
</mml:msup>
</mml:mrow>
<mml:mrow>
<mml:mi>&#x3b4;</mml:mi>
<mml:msup>
<mml:mi>d</mml:mi>
<mml:mn>2</mml:mn>
</mml:msup>
</mml:mrow>
</mml:mfrac>
<mml:mo>+</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:mi>&#x394;</mml:mi>
<mml:msup>
<mml:mi>D</mml:mi>
<mml:mn>2</mml:mn>
</mml:msup>
</mml:mrow>
<mml:mrow>
<mml:mi>&#x3b4;</mml:mi>
<mml:msup>
<mml:mi>D</mml:mi>
<mml:mn>2</mml:mn>
</mml:msup>
</mml:mrow>
</mml:mfrac>
</mml:mrow>
</mml:msqrt>
</mml:mrow>
</mml:math>
</disp-formula>
<disp-formula>
<label>(3)</label>
<mml:math display="block" id="M3">
<mml:mrow>
<mml:mi>&#x3b3;</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:msub>
<mml:mi>r</mml:mi>
<mml:mrow>
<mml:mi>e</mml:mi>
<mml:mi>v</mml:mi>
<mml:mi>a</mml:mi>
<mml:mi>l</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo stretchy="false">)</mml:mo>
<mml:mo>=</mml:mo>
<mml:mtext>min</mml:mtext>
<mml:mrow>
<mml:mo>{</mml:mo> <mml:mrow>
<mml:mi>&#x393;</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:msub>
<mml:mi>r</mml:mi>
<mml:mrow>
<mml:mi>r</mml:mi>
<mml:mi>e</mml:mi>
<mml:mi>f</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>,</mml:mo>
<mml:msub>
<mml:mi>r</mml:mi>
<mml:mrow>
<mml:mi>e</mml:mi>
<mml:mi>v</mml:mi>
<mml:mi>a</mml:mi>
<mml:mi>l</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow> <mml:mo>}</mml:mo>
</mml:mrow>
<mml:mo>&#x2200;</mml:mo>
<mml:mrow>
<mml:mo>{</mml:mo> <mml:mrow>
<mml:msub>
<mml:mi>r</mml:mi>
<mml:mrow>
<mml:mi>e</mml:mi>
<mml:mi>v</mml:mi>
<mml:mi>a</mml:mi>
<mml:mi>l</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow> <mml:mo>}</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:math>
</disp-formula>
<p>The &#x3b3; function is the minimum value of generalized &#x393; function computed for arbitrary isodose point distance &#x394;d and dose difference &#x394;D. Values of &#x3b3; between 0 and 1 will indicate that the comparison is acceptable according to the dose and distance criteria. If &#x3b3;(r<sub>eval</sub>) &#x2264;1, it will indicate that the comparison result of r<sub>ref</sub> is acceptable. If &#x3b3;(r<sub>eval</sub>) &gt;1, it will mean a failure in the comparison result of r<sub>ref</sub>. The percentage of passing points in the gamma distribution is referred to as gamma pass rate (or %GP), &#x3b4;D/&#x3b4;d refers to the criteria of 3%/2&#xa0;mm, and <italic>i</italic> refers to the measured and calculated dose point pair.</p>
<disp-formula>
<label>(4)</label>
<mml:math display="block" id="M4">
<mml:mrow>
<mml:mi>&#x394;</mml:mi>
<mml:msub>
<mml:mi>D</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>=</mml:mo>
<mml:mrow>
<mml:mo>|</mml:mo> <mml:mrow>
<mml:mfrac>
<mml:mrow>
<mml:msub>
<mml:mi>D</mml:mi>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mi>i</mml:mi>
<mml:mo stretchy="false">)</mml:mo>
<mml:mi>e</mml:mi>
<mml:mi>v</mml:mi>
<mml:mi>a</mml:mi>
<mml:mi>l</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mi>D</mml:mi>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mi>i</mml:mi>
<mml:mo stretchy="false">)</mml:mo>
<mml:mi>r</mml:mi>
<mml:mi>e</mml:mi>
<mml:mi>f</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mrow>
<mml:msub>
<mml:mi>D</mml:mi>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mi>i</mml:mi>
<mml:mo stretchy="false">)</mml:mo>
<mml:mi>n</mml:mi>
<mml:mi>o</mml:mi>
<mml:mi>r</mml:mi>
<mml:mi>m</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mfrac>
</mml:mrow> <mml:mo>|</mml:mo>
</mml:mrow>
<mml:mo>&#xd7;</mml:mo>
<mml:mn>100</mml:mn>
<mml:mo>%</mml:mo>
</mml:mrow>
</mml:math>
</disp-formula>
<p>where D<sub>eval</sub> is the measurement-based QA dose acquired by COMPASS, D<sub>ref</sub> is the treatment planning dose, and D<sub>norm</sub> refers to the normalized max dose point. Normalization plays a critical role in the interpretation of dose comparison results. Specifically in global normalization, the dose difference between any measured and calculated dose point pair is normalized using the same value for all point pairs, often the maximum planned dose point. Here, <italic>i</italic> refers to the measured and calculated dose point pair.</p>
<disp-formula>
<label>(5)</label>
<mml:math display="block" id="M5">
<mml:mrow>
<mml:mi>&#x394;</mml:mi>
<mml:msub>
<mml:mi>d</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>=</mml:mo>
<mml:mrow>
<mml:mo>|</mml:mo> <mml:mrow>
<mml:msub>
<mml:mi>r</mml:mi>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mi>i</mml:mi>
<mml:mo stretchy="false">)</mml:mo>
<mml:mi>e</mml:mi>
<mml:mi>v</mml:mi>
<mml:mi>a</mml:mi>
<mml:mi>l</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mi>r</mml:mi>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mi>i</mml:mi>
<mml:mo stretchy="false">)</mml:mo>
<mml:mi>r</mml:mi>
<mml:mi>e</mml:mi>
<mml:mi>f</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow> <mml:mo>|</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:math>
</disp-formula>
<p>where <italic>&#x394;d</italic> refers to the distance difference of the same dose between the measurement-based QA dose acquired by COMPASS and the treatment planning dose; <italic>i</italic> refers to the measured and calculated dose point pair.</p>
<p>iii) The definition of &#x3bc;GI is as follows:</p>
<disp-formula>
<label>(6)</label>
<mml:math display="block" id="M6">
<mml:mrow>
<mml:mi>&#x3bc;</mml:mi>
<mml:mi>G</mml:mi>
<mml:msub>
<mml:mi>I</mml:mi>
<mml:mi>x</mml:mi>
</mml:msub>
<mml:mo>=</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:mstyle displaystyle="true">
<mml:msubsup>
<mml:mo>&#x2211;</mml:mo>
<mml:mn>1</mml:mn>
<mml:mi>n</mml:mi>
</mml:msubsup>
<mml:mrow>
<mml:mi>&#x3b3;</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:msub>
<mml:mi>r</mml:mi>
<mml:mrow>
<mml:mi>e</mml:mi>
<mml:mi>v</mml:mi>
<mml:mi>a</mml:mi>
<mml:mi>l</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mstyle>
</mml:mrow>
<mml:mi>n</mml:mi>
</mml:mfrac>
</mml:mrow>
</mml:math>
</disp-formula>
<p>&#x3bc;GI<sub>x</sub> refers to the mean &#x3b3; (r<sub>eval</sub>) for the measured and calculated dose point pair in <italic>x</italic> region, and <italic>n</italic> refers to the number of the measured and calculated dose point pairs in <italic>x</italic> region. A lower &#x3bc;GI is better.</p>
</sec>
<sec id="s2_4">
<title>Hybrid Analysis: Comprehensive Gamma-Based and Dose&#x2013;Volume Histogram-Based Analysis</title>
<p>In conventional gamma analysis (i.e., 3%/2-mm global normalization and 10% dose threshold, hereafter referred to as &#x3b3;<sub>10%</sub>), dimensionless gamma passing rate is adopted to combine the dose difference (DD) with the distance to agreement (DTA). The universal ALs of %GP &#x2265;90% in AAPM TG-218 report was proposed.</p>
<p>The &#x3bc;GI (the gamma index for receiving 50% or more of the prescribed dose, hereafter referred to as &#x3bc;GI<sub>50%</sub>) was the gamma passing rate for the composite dose. It was obtained and categorized by a global 3D gamma analysis (<xref ref-type="bibr" rid="B17">17</xref>, <xref ref-type="bibr" rid="B18">18</xref>). The &#x3bc;GI<sub>50%</sub> was categorized into &#x201c;PASS&#x201d; (acceptable for treatment), &#x201c;EVAL&#x201d; (to be evaluated by the medical physicist), or &#x201c;FAIL&#x201d; (rejected for treatment). Criteria for the &#x3bc;GI<sub>50%</sub> are classified into PASS (&#x3bc;GI<sub>50%</sub> &#x2264;0.4, acceptable for treatment), EVAL (0.4 &lt; &#x3bc;GI<sub>50%</sub> &lt; 0.6, to be evaluated by the medical physicist), and FAIL (&#x3bc;GI<sub>50%</sub> &#x2265;0.6, rejected for treatment).</p>
<p>DVH information was acquired for the Planning Target Volume (PTV), gross tumor volume (GTV), and four types of OARs (brain stem, spinal cord, parotid L, parotid R). The details of the DVH metrics are shown in <xref ref-type="fig" rid="f4"><bold>Figure&#xa0;4</bold></xref>. According to the study by Cozzolino et&#xa0;al. (<xref ref-type="bibr" rid="B19">19</xref>) and Visser et&#xa0;al. (<xref ref-type="bibr" rid="B18">18</xref>), the DVH ALs should be set to 2%&#x2013;5%. Therefore, we have chosen DVH ALs of 3%. It means that the %DE of all the structures must be &#x2264;3%.</p>
<fig id="f4" position="float">
<label>Figure&#xa0;4</label>
<caption>
<p>The %DE of DVH metrics based on 3%/2 mm criteria for NPC patients.  D98, D95, D5, and D1 refers to the dose received by 98%, 95%, 5% and 1% volume of the structures including PTV, GTV, Parotid gland, Brainstem, Spinalcord, respectively. Dmean refers to the mean dose of the structures.</p>
</caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fonc-12-859415-g004.tif"/>
</fig>
<p>Based on available literature (<xref ref-type="bibr" rid="B13">13</xref>, <xref ref-type="bibr" rid="B18">18</xref>), combinations of DVH information, %GP, and &#x3bc;GI were employed in this study. By doing so, we aimed to improve the correlation between gamma analysis result and clinical criteria. In particular, a measured plan can be considered to be clinically acceptable when the following two conditions are met (<xref ref-type="bibr" rid="B16">16</xref>, <xref ref-type="bibr" rid="B20">20</xref>): i) &#x3b3;<sub>10%</sub> &#x2265;90% and the absolute value of %DE &#x2264;3%; ii) &#x3bc;GI<sub>50%</sub> &lt;0.6 and the absolute value of %DE &#x2264;3%.</p>
</sec>
<sec id="s2_5">
<title>Data Analysis</title>
<p>
<xref ref-type="fig" rid="f5"><bold>Figure&#xa0;5</bold></xref> shows the patient-specific QA reports of the 61 original IMRT plans that were categorized into four types based on the DVH_&#x3b3;<sub>10%</sub> or DVH_ &#x3bc;GI<sub>50%</sub> ALs:</p>
<list list-type="simple">
<list-item>
<p>i) In DVH_&#x3b3;<sub>10%</sub> evaluation chart: &#x201c;true negatives&#x201d; (TNs) refer to &#x3b3;<sub>10%</sub> &#x2265;90% and the absolute value of %DE &#x2264;3%; &#x201c;false negatives&#x201d; (FNs) refer to &#x3b3;<sub>10%</sub> &#x2265;90% and the absolute value of %DE &gt;3%; &#x201c;true positives&#x201d; (TPs) refer to &#x3b3;<sub>10%</sub> &lt;90% and the absolute value of %DE &gt;3%; &#x201c;false positives&#x201d; (FPs) refer to &#x3b3;<sub>10%</sub> &lt;90% and the absolute value of %DE &#x2264;3%</p>
</list-item>
<list-item>
<p>ii) In DVH_ &#x3bc;GI<sub>50%</sub> evaluation chart: &#x201c;true negatives&#x201d; (TNs) refer to &#x3bc;GI<sub>50%</sub> &lt;0.6 and the absolute value of %DE &#x2264;3%; &#x201c;false negatives&#x201d; (FNs) refer to &#x3bc;GI<sub>50%</sub> &lt;0.6 and the absolute value of %DE &gt;3%; &#x201c;true positives&#x201d; (TPs) refer to &#x3bc;GI<sub>50%</sub> &#x2265;0.6 and the absolute value of %DE &gt;3%; &#x201c;false positives&#x201d; (FPs) refer to &#x3bc;GI<sub>50%</sub> &#x2265;0.6 and the absolute value of %DE &#x2264;3%</p>
</list-item>
</list>
<fig id="f5" position="float">
<label>Figure&#xa0;5</label>
<caption>
<p>The DVH_%GP and DVH_&#x3bc;GI evaluation charts.</p>
</caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fonc-12-859415-g005.tif"/>
</fig>
<p>When the correlation between %DE and %GP and between %DE and &#x3bc;GI in various regions was analyzed by the SPSS 19.0 (SPSS Inc., Chicago, IL, USA) software, we used Pearson&#x2019;s correlation coefficient (r). If the <italic>p</italic> value was &lt;0.05, it would have indicated that %DE has a correlation with both %GP and &#x3bc;GI. Different correlation coefficients (r) represent different degrees of correlation: If |r| &#x2265; 0.8, it will be considered to be highly correlated; if 0.5 &#x2264; |r| &lt; 0.8, it will be considered to be moderately correlated; if |r| &lt; 0.5, it will be considered to be weakly correlated.</p>
<p>In this study, the TP rate indicated the sensitivity and was defined as TP/(TP+FN), while the TN rate indicated the specificity and was given by TN/(TN+FP). The receiver operating characteristic (ROC) curves were generated based on the TN and TP rates to characterize %GP and &#x3bc;GI in different regions. The area under the curve (AUC) was used as the classification indicator as follows: If AUC = 1, it would have meant that the indicator can be used for classification precisely; If AUC = [0.8, 0.9], it would have indicated a very good effect; If AUC = [0.7, 0.8], it would have indicated an average effect; If AUC = [0.5, 0.7], it would have meant a low effect. Consequently, the ALs can also be defined according to the Youden coefficient (<xref ref-type="bibr" rid="B21">21</xref>). Youden coefficient is used to evaluate the authenticity of the screening test. Its value is equal to the sum of sensitivity and specificity of point in ROC minus 1. The higher the Youden coefficient, the better the authenticity. The value of the max Youden coefficient point in ROC is the cutoff.</p>
<p>Finally, in the validation, for the original plans and the MLC error-introduced test plans, the ALs were used to evaluate the accuracy of various regions.</p>
</sec>
</sec>
<sec id="s3" sec-type="results">
<title>Results</title>
<sec id="s3_1">
<title>Dose&#x2013;Volume Histogram Metrics Evaluation and 3D &#x3b3;_Analysis</title>
<p>As shown in <xref ref-type="fig" rid="f4"><bold>Figure&#xa0;4</bold></xref>, most of the %DE metrics were found to be within 3% criteria, except for D<sub>1</sub> of the brain stem. As shown in <xref ref-type="fig" rid="f6"><bold>Figure&#xa0;6</bold></xref>, the larger the volume of the region, the smaller the results of %GP. However, the results of &#x3bc;GI were consistent with volume changing of the different regions. The %GPs of the different regions (&#x3b3;<sub>10%</sub>, &#x3b3;<sub>20%</sub>, &#x3b3;<sub>30%</sub>, &#x3b3;<sub>40%</sub>, &#x3b3;<sub>50%</sub>, &#x3b3;<sub>60%</sub>, and &#x3b3;<sub>whole</sub>) were higher than 90%, and the &#x3bc;GIs of these regions (&#x3bc;GI<sub>10%</sub>, &#x3bc;GI<sub>20%</sub>, &#x3bc;GI<sub>30%</sub>, &#x3bc;GI<sub>40%</sub>, &#x3bc;GI<sub>50%</sub>, &#x3bc;GI<sub>60%</sub>, &#x3bc;GI<sub>whole</sub>) were lower than 0.6.</p>
<fig id="f6" position="float">
<label>Figure&#xa0;6</label>
<caption>
<p><bold>(A)</bold> The %GP in different regions based on 3%/2 mm criteria for NPC patients. <bold>(B)</bold> The &#x3bc;GI in different regions based on 3%/2 mm criteria for NPC patients.</p>
</caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fonc-12-859415-g006.tif"/>
</fig>
</sec>
<sec id="s3_2">
<title>Correlation Analysis Between %DE and %GP and Between %DE and &#x3bc;GI in Different Regions</title>
<p>Ten DVH-based parameters were chosen for evaluation. Correlation analysis between the different %DEs of DVH metrics and %GP, &#x3bc;GI of different regions was performed one by one as shown in <xref ref-type="table" rid="T1"><bold>Table&#xa0;1</bold></xref>. It shows that a number of DVH-based metrics were found to be correlated with the evaluation parameters (i.e., the corresponding number was 4, 2, 1, 1, 1, 1, and 3 in &#x3b3;<sub>whole</sub>, &#x3b3;<sub>10%</sub>, &#x3b3;<sub>20%</sub>, &#x3b3;<sub>30%</sub>, &#x3b3;<sub>40%</sub>, &#x3b3;<sub>50%</sub>, and &#x3b3;<sub>60%</sub>, respectively). i) Only &#x3b3;<sub>whole</sub> is considered to be moderately correlated with the %DE of GTV-D<sub>mean</sub> and GTV-D<sub>2</sub> (0.5 &#x2264; |r| &lt; 0.8, <italic>p</italic> &lt; 0.05); ii) The &#x3b3;<sub>whole</sub>, &#x3b3;<sub>10%</sub>, &#x3b3;<sub>20%</sub>, &#x3b3;<sub>30%</sub>, &#x3b3;<sub>40%</sub>, &#x3b3;<sub>50%</sub>, and &#x3b3;<sub>60%</sub> are considered to be weakly correlated with the other %DE (|r| &lt; 0.5, <italic>p</italic> &lt; 0.05).</p>
<p>
<xref ref-type="table" rid="T2"><bold>Table&#xa0;2</bold></xref> shows that a number of DVH-based metrics were found to be correlated with the evaluation parameters (i.e., the corresponding number was 5, 3, 0, 1, 1, 4, and 2 in &#x3bc;GI<sub>whole</sub>, &#x3bc;GI<sub>10%</sub>, &#x3bc;GI<sub>20%</sub>, &#x3bc;GI<sub>30%</sub>, &#x3bc;GI<sub>40%</sub>, &#x3bc;GI<sub>50%</sub>, and &#x3bc;GI<sub>60%</sub>, respectively). i) The &#x3bc;GI<sub>whole</sub> is considered to be moderately correlated with the %DE of GTV-D<sub>2</sub> (0.5 &#x2264; |r| &lt; 0.8, <italic>p</italic> &lt; 0.05); ii) The &#x3bc;GI<sub>whole</sub>, &#x3bc;GI<sub>10%</sub>, &#x3bc;GI<sub>20%</sub>, &#x3bc;GI<sub>30%</sub>, &#x3bc;GI<sub>40%</sub>, &#x3bc;GI<sub>50%</sub>, and &#x3bc;GI<sub>60%</sub> are considered to be weakly correlated with the other %DE (|r| &lt; 0.5, <italic>p</italic> &lt; 0.05).</p>
<table-wrap id="T2" position="float">
<label>Table&#xa0;2</label>
<caption>
<p>The correlation between the %DE and the &#x3bc;GI in different regions for NPC patients.</p>
</caption>
<table frame="hsides">
<thead>
<tr>
<th valign="top" rowspan="2" align="center" colspan="2"/>
<th valign="top" align="center" colspan="3">PTV</th>
<th valign="top" align="center" colspan="3">GTV</th>
<th valign="top" align="center">Parotid L</th>
<th valign="top" align="center">Parotid R</th>
<th valign="top" align="center">Brainstem</th>
<th valign="top" align="center">Spinalcord</th>
</tr>
<tr>
<th valign="top" align="center">D<sub>95</sub>
</th>
<th valign="top" align="center">D<sub>mean</sub>
</th>
<th valign="top" align="center">D<sub>5</sub>
</th>
<th valign="top" align="center">D<sub>98</sub>
</th>
<th valign="top" align="center">D<sub>mean</sub>
</th>
<th valign="top" align="center">D<sub>2</sub>
</th>
<th valign="top" align="center">D<sub>mean</sub>
</th>
<th valign="top" align="center">D<sub>mean</sub>
</th>
<th valign="top" align="center">D<sub>1</sub>
</th>
<th valign="top" align="center">D<sub>1</sub>
</th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">&#x3bc;GI<sub>whole</sub>
</td>
<td valign="top" align="left">r</td>
<td valign="top" align="center">0.187</td>
<td valign="top" align="center">0.303</td>
<td valign="top" align="center">0.2</td>
<td valign="top" align="center">0.063</td>
<td valign="top" align="center">0.44</td>
<td valign="top" align="center">0.551</td>
<td valign="top" align="center">0.39</td>
<td valign="top" align="center">0.493</td>
<td valign="top" align="center">-0.149</td>
<td valign="top" align="center">-0.066</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="left"><italic>p</italic>
</td>
<td valign="top" align="center">0.149</td>
<td valign="top" align="center">0.018*</td>
<td valign="top" align="center">0.122</td>
<td valign="top" align="center">0.628</td>
<td valign="top" align="center">&lt;0.001*</td>
<td valign="top" align="center">&lt;0.001*</td>
<td valign="top" align="center">0.002*</td>
<td valign="top" align="center">&lt;0.001*</td>
<td valign="top" align="center">0.253</td>
<td valign="top" align="center">0.613</td>
</tr>
<tr>
<td valign="top" align="left">&#x3bc;GI<sub>10%</sub>
</td>
<td valign="top" align="left">r</td>
<td valign="top" align="center">0.136</td>
<td valign="top" align="center">-0.085</td>
<td valign="top" align="center">-0.068</td>
<td valign="top" align="center">-0.008</td>
<td valign="top" align="center">-0.299</td>
<td valign="top" align="center">-0.351</td>
<td valign="top" align="center">0.054</td>
<td valign="top" align="center">-0.151</td>
<td valign="top" align="center">0.524</td>
<td valign="top" align="center">0.063</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="left"><italic>p</italic>
</td>
<td valign="top" align="center">0.296</td>
<td valign="top" align="center">0.513</td>
<td valign="top" align="center">0.6</td>
<td valign="top" align="center">0.952</td>
<td valign="top" align="center">0.019*</td>
<td valign="top" align="center">0.005*</td>
<td valign="top" align="center">0.679</td>
<td valign="top" align="center">0.246</td>
<td valign="top" align="center">&lt;0.001*</td>
<td valign="top" align="center">0.628</td>
</tr>
<tr>
<td valign="top" align="left">&#x3bc;GI<sub>20%</sub>
</td>
<td valign="top" align="left">r</td>
<td valign="top" align="center">0.101</td>
<td valign="top" align="center">-0.005</td>
<td valign="top" align="center">0.028</td>
<td valign="top" align="center">0.189</td>
<td valign="top" align="center">-0.151</td>
<td valign="top" align="center">-0.176</td>
<td valign="top" align="center">0.051</td>
<td valign="top" align="center">0.052</td>
<td valign="top" align="center">0.247</td>
<td valign="top" align="center">0.01</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="left"><italic>p</italic>
</td>
<td valign="top" align="center">0.439</td>
<td valign="top" align="center">0.967</td>
<td valign="top" align="center">0.833</td>
<td valign="top" align="center">0.145</td>
<td valign="top" align="center">0.246</td>
<td valign="top" align="center">0.174</td>
<td valign="top" align="center">0.697</td>
<td valign="top" align="center">0.693</td>
<td valign="top" align="center">0.055</td>
<td valign="top" align="center">0.94</td>
</tr>
<tr>
<td valign="top" align="left">&#x3bc;GI<sub>30%</sub>
</td>
<td valign="top" align="left">r</td>
<td valign="top" align="center">0.225</td>
<td valign="top" align="center">-0.053</td>
<td valign="top" align="center">-0.02</td>
<td valign="top" align="center">0.127</td>
<td valign="top" align="center">-0.218</td>
<td valign="top" align="center">-0.157</td>
<td valign="top" align="center">0.18</td>
<td valign="top" align="center">0.051</td>
<td valign="top" align="center">0.472</td>
<td valign="top" align="center">0.061</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="left"><italic>p</italic>
</td>
<td valign="top" align="center">0.082</td>
<td valign="top" align="center">0.685</td>
<td valign="top" align="center">0.88</td>
<td valign="top" align="center">0.33</td>
<td valign="top" align="center">0.092</td>
<td valign="top" align="center">0.226</td>
<td valign="top" align="center">0.164</td>
<td valign="top" align="center">0.699</td>
<td valign="top" align="center">&lt;0.001*</td>
<td valign="top" align="center">0.641</td>
</tr>
<tr>
<td valign="top" align="left">&#x3bc;GI<sub>40%</sub>
</td>
<td valign="top" align="left">r</td>
<td valign="top" align="center">0.245</td>
<td valign="top" align="center">0.019</td>
<td valign="top" align="center">0.002</td>
<td valign="top" align="center">0.149</td>
<td valign="top" align="center">-0.101</td>
<td valign="top" align="center">-0.012</td>
<td valign="top" align="center">0.248</td>
<td valign="top" align="center">0.169</td>
<td valign="top" align="center">0.343</td>
<td valign="top" align="center">0.076</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="left"><italic>p</italic>
</td>
<td valign="top" align="center">0.057</td>
<td valign="top" align="center">0.882</td>
<td valign="top" align="center">0.985</td>
<td valign="top" align="center">0.252</td>
<td valign="top" align="center">0.441</td>
<td valign="top" align="center">0.928</td>
<td valign="top" align="center">0.054</td>
<td valign="top" align="center">0.192</td>
<td valign="top" align="center">0.007*</td>
<td valign="top" align="center">0.561</td>
</tr>
<tr>
<td valign="top" align="left">&#x3bc;GI<sub>50%</sub>
</td>
<td valign="top" align="left">r</td>
<td valign="top" align="center">0.256</td>
<td valign="top" align="center">0.078</td>
<td valign="top" align="center">0.042</td>
<td valign="top" align="center">0.114</td>
<td valign="top" align="center">-0.049</td>
<td valign="top" align="center">0.039</td>
<td valign="top" align="center">0.259</td>
<td valign="top" align="center">0.23</td>
<td valign="top" align="center">0.272</td>
<td valign="top" align="center">0.038</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="left"><italic>p</italic>
</td>
<td valign="top" align="center">0.046*</td>
<td valign="top" align="center">0.552</td>
<td valign="top" align="center">0.749</td>
<td valign="top" align="center">0.381</td>
<td valign="top" align="center">0.708</td>
<td valign="top" align="center">0.768</td>
<td valign="top" align="center">0.044*</td>
<td valign="top" align="center">0.075*</td>
<td valign="top" align="center">0.034*</td>
<td valign="top" align="center">0.77</td>
</tr>
<tr>
<td valign="top" align="left">&#x3bc;GI<sub>60%</sub>
</td>
<td valign="top" align="left">r</td>
<td valign="top" align="center">0.276</td>
<td valign="top" align="center">0.134</td>
<td valign="top" align="center">0.103</td>
<td valign="top" align="center">0.076</td>
<td valign="top" align="center">0.066</td>
<td valign="top" align="center">0.124</td>
<td valign="top" align="center">0.257</td>
<td valign="top" align="center">0.247</td>
<td valign="top" align="center">0.232</td>
<td valign="top" align="center">-0.058</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="left"><italic>p</italic>
</td>
<td valign="top" align="center">0.031*</td>
<td valign="top" align="center">0.304</td>
<td valign="top" align="center">0.431</td>
<td valign="top" align="center">0.558</td>
<td valign="top" align="center">0.614</td>
<td valign="top" align="center">0.34</td>
<td valign="top" align="center">0.046*</td>
<td valign="top" align="center">0.055</td>
<td valign="top" align="center">0.072</td>
<td valign="top" align="center">0.658</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn>
<p>&#x201c;*&#x201d; means a significant difference, p &lt; 0.05. D98, D95, D5, and D1 refers to the dose received by 98%, 95%, 5% and 1% volume of the structures including PTV, GTV, Parotid gland, Brainstem, Spinalcord, respectively. Dmean refers to the mean dose of the structures.</p>
</fn>
</table-wrap-foot>
</table-wrap>
</sec>
<sec id="s3_3">
<title>Receiver Operating Characteristic Analysis</title>
<p>In accordance with the results, further analysis on sensitivity was performed by using the ROC of %GP (&#x3b3;<sub>whole</sub>, &#x3b3;<sub>10%</sub>, &#x3b3;<sub>20%</sub>, &#x3b3;<sub>30%</sub>, &#x3b3;<sub>40%</sub>, &#x3b3;<sub>50%</sub>, and &#x3b3;<sub>60%</sub>) and &#x3bc;GI (&#x3bc;GI<sub>whole</sub>, &#x3bc;GI<sub>10%</sub>, &#x3bc;GI<sub>20%</sub>, &#x3bc;GI<sub>30%</sub>, &#x3bc;GI<sub>40%</sub>, &#x3bc;GI<sub>50%</sub>, and &#x3bc;GI<sub>60%</sub>). <xref ref-type="fig" rid="f7"><bold>Figure&#xa0;7</bold></xref> shows the areas under the curves (AUCs) of %GP and &#x3bc;GI in different regions. The AUCs of both %GP and &#x3bc;GI acquired for the &#x201c;whole&#x201d; region were higher than 0.700. On the other hand, the AUCs of &#x3bc;GI<sub>40%</sub>, &#x3bc;GI<sub>50%</sub>, and &#x3bc;GI<sub>60%</sub> were 0.714, 0.714, and 0.738, respectively. It would have meant that the %GP and the &#x3bc;GI of other areas have a very low efficiency in classification. Therefore, these parameters were chosen for further analysis.</p>
<fig id="f7" position="float">
<label>Figure&#xa0;7</label>
<caption>
<p><bold>(A)</bold> Comparison of the AUCs of %GP in different regions (&#x3b3;<sub>whole</sub>, &#x3b3;<sub>10%</sub>, &#x3b3;<sub>20%</sub>, &#x3b3;<sub>30%</sub>, &#x3b3;<sub>40%</sub>, &#x3b3;<sub>50%</sub>, and &#x3b3;<sub>60%</sub>) and <bold>(B)</bold> &#x3bc;GI (&#x3bc;GI<sub>whole</sub>, &#x3bc;GI<sub>10%</sub>, &#x3bc;GI<sub>20%</sub>, &#x3bc;GI<sub>30%</sub>, &#x3bc;GI<sub>40%</sub>, &#x3bc;GI<sub>50%</sub>, and &#x3bc;GI<sub>60%</sub>).</p>
</caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fonc-12-859415-g007.tif"/>
</fig>
</sec>
<sec id="s3_4">
<title>The Accuracy Analysis</title>
<p>According to the Youden coefficient, the ALs of the &#x201c;whole&#x201d;, &#x201c;40%&#x201d;, and &#x201c;60%&#x201d; regions were adopted for AL&#x3b3;<sub>whole</sub> &#x2265;92%, AL<sub>&#x3bc;GIwhole &#x2264;</sub>0.36, AL<sub>&#x3bc;GI40%</sub> &#x2264;0.43, and AL<sub>&#x3bc;GI60%</sub> &#x2264;0.40, respectively, based on 3%/2 mm criteria.</p>
<p>In the validation, for the original plans and the MLC error-introduced test plans, the accuracy of the various regions was evaluated by ALs and compared with the hybrid analysis. As shown in <xref ref-type="table" rid="T3"><bold>Table&#xa0;3</bold></xref>, for original plans, the accuracy of AL<sub>&#x3b3;whole</sub>, AL<sub>&#x3b3;10%</sub>, AL<sub>&#x3bc;GIwhole</sub>, AL<sub>&#x3bc;GI40%</sub>, AL<sub>&#x3bc;GI50%</sub>, and AL<sub>&#x3bc;GI60%</sub> is 23%, 9.8%, 90%, 80.3%, 9.8%, and 88.5%, respectively. As shown in <xref ref-type="fig" rid="f8"><bold>Figure&#xa0;8</bold></xref>, for test plans with systematic MLC errors smaller than 0.8 mm, the positive rates of AL<sub>&#x3b3;whole</sub>, AL<sub>&#x3b3;10%</sub>, AL<sub>&#x3bc;GIwhole</sub>, AL<sub>&#x3bc;GI40%</sub>, AL<sub>&#x3bc;GI50%</sub>, and AL<sub>&#x3bc;GI60%</sub> were 25%, 58%, 92%, 92%, 42%, and 100%, respectively; for test plans with systematic MLC errors higher than 0.8 mm, the positive rates of all the AL<sub>%GP&amp;&#x3bc;GI</sub> in identifying MLC error-introduced plans were 100%.</p>
<table-wrap id="T3" position="float">
<label>Table&#xa0;3</label>
<caption>
<p>The comparison of the hybrid analysis among the evaluation parameters (i.e., AL<sub>&#x3b3;10%</sub>, AL<sub>&#x3b3;whole</sub>, AL<sub>&#x3bc;GI50%</sub>, AL<sub>&#x3bc;GIwhole</sub>, AL<sub>&#x3bc;GI40%</sub>, AL<sub>&#x3bc;GI60%</sub>).</p>
</caption>
<table frame="hsides">
<thead>
<tr>
<th valign="top" colspan="2" align="left"/>
<th valign="top" align="center">AL<sub>&#x3b3;10%</sub>
</th>
<th valign="top" align="center">AL<sub>&#x3b3;whole</sub>
</th>
<th valign="top" align="center">AL<sub>&#x3bc;GI50%</sub>
</th>
<th valign="top" align="center">AL<sub>&#x3bc;GIwhole</sub>
</th>
<th valign="top" align="center">AL<sub>&#x3bc;GI40%</sub>
</th>
<th valign="top" align="center">AL<sub>&#x3bc;GI60%</sub>
</th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" rowspan="2" align="left">Hybrid analysis</td>
<td valign="top" align="left">a</td>
<td valign="top" align="center">9.8%</td>
<td valign="top" align="center">23%</td>
<td valign="top" align="center">9.8%</td>
<td valign="top" align="center">90%</td>
<td valign="top" align="center">80.3%</td>
<td valign="top" align="center">88.5%</td>
</tr>
<tr>
<td valign="top" align="left">b</td>
<td valign="top" align="center">91.2%</td>
<td valign="top" align="center">77%</td>
<td valign="top" align="center">91.2%</td>
<td valign="top" align="center">10%</td>
<td valign="top" align="center">19.7%</td>
<td valign="top" align="center">11.5%</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn>
<p>a refers to the hybrid analysis results corresponding to the evaluation parameters; b refers to the hybrid analysis results that do not correspond to the evaluation parameters.</p>
</fn>
</table-wrap-foot>
</table-wrap>
<fig id="f8" position="float">
<label>Figure&#xa0;8</label>
<caption>
<p>The positive rates of test plans introduced with different magnitudes of systematic MLC errors.</p>
</caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fonc-12-859415-g008.tif"/>
</fig>
</sec>
</sec>
<sec id="s4" sec-type="discussion">
<title>Discussion</title>
<p>In global gamma analysis, all points are normalized to one reference dose point where the maximum dose or isocenter dose is the most common choice (<xref ref-type="bibr" rid="B9">9</xref>). In general, errors are masked in the lower dose regions in the conventional global gamma because the low dose points are normalized to a high dose point (<xref ref-type="bibr" rid="B22">22</xref>). Furthermore, the TG-218 report has also implied that a low dose region (such as 10% of the prescription dose) can significantly affect the analysis (<xref ref-type="bibr" rid="B3">3</xref>). As a result, the conventional global gamma passing rate is often questioned regarding its limitations or clinical relevance (<xref ref-type="bibr" rid="B23">23</xref>, <xref ref-type="bibr" rid="B24">24</xref>). Therefore, changing the evaluation region for the global gamma analysis (or changing the minimum threshold) is a preferred method because it can decrease the bias of the global gamma analysis.</p>
<p>In essence, the methodology proposed in our study computed the %GP and the &#x3bc;GI of reduced sample voxels of the dose distribution in different regions rather than that of all voxels. A conventional gamma analysis includes all voxels in the dose distribution (with dose values of 10% or greater). However, not all voxels have clinical significance in patient-specific QA. The targets and OARs are critical clinically relevant volume for making a final determination. The &#x201c;whole&#x201d; region for evaluation was explored with increasing dose level until it only contained the targets and OARs. The correlation between %GP, &#x3bc;GI, and %DE of various dosimetry metrics was used to assess the relevance of both %GP and &#x3bc;GI with clinically relevant observations.</p>
<p>From calculation equations 3&#x2013;6, it is &#x3bc;GI rather than %GP that was able to more or less reflect the gamma value change of each evaluated point. The ROC analysis also demonstrated that the &#x3bc;GI in different regions was more sensitive than %GP. Therefore, it has implied that &#x3bc;GI reveals more clinically relevant problems compared with %GP.</p>
<p>In this study, both %GP and &#x3bc;GI results of seven regions for evaluation were found to have moderate correlation with the DVH metrics. This can be compared with the studies made by Zhen et&#xa0;al. (<xref ref-type="bibr" rid="B25">25</xref>) and Chan et&#xa0;al. (<xref ref-type="bibr" rid="B26">26</xref>). The &#x3bc;GI<sub>whole</sub> was recommended to replace the conventional &#x3b3;<sub>10%</sub> and &#x3bc;GI<sub>50%</sub> in the study. There are two reasons why the &#x201c;whole&#x201d; region is superior. One, from equations 3&#x2013;6, both the spatial information and %DE were included in %GP and &#x3bc;GI. However, the dose difference information regarding specific structures was unavailable, which made %GP and &#x3bc;GI difficult to explore for assessing clinical implications (<xref ref-type="bibr" rid="B26">26</xref>). As the proposed &#x201c;whole&#x201d; region in our study only focused on the area of clinical concern, it can partially solve this problem. Moreover, Yu et&#xa0;al. (<xref ref-type="bibr" rid="B11">11</xref>) have demonstrated that different dose levels might include some other information such as the accuracy of TPS calculation in low-dose regions (10%&#x2013;20% dose region), the accuracy of MLC modeling (50% dose region), and the expected information regarding the validity of the source model including beam energy, focal spot size, and collimator feature (high-dose regions). The &#x201c;whole&#x201d; region not only was the clinically concerned region but also provided the information in different dose levels. Although the sensitivities of &#x3bc;GI<sub>60%</sub> and &#x3bc;GI<sub>whole</sub> were similar, the &#x201c;whole&#x201d; region included more dose levels. Hence, it provided greater insight into the dose delivered to specific structures. According to the study by Cozzolino et&#xa0;al. (<xref ref-type="bibr" rid="B19">19</xref>) and Visser et&#xa0;al. (<xref ref-type="bibr" rid="B18">18</xref>), the DVH ALs should be set to 2%&#x2013;5%. Therefore, we chose the DVH ALs of 3%. However, in areas with a sharp dose gradient and in metrics with small volumes, relatively high dose differences such as point dose (D<sub>1</sub>) were observed. For results whose %DE exceeded DVH ALs, it was acceptable from the clinical point of view if the measured dose of the target volume was higher than the calculated dose or if the measured dose of OAR was lower than the calculated dose (<xref ref-type="bibr" rid="B27">27</xref>). The reason was that the results would not affect clinical efficiency. This view was proven by the %DE of the brain stem in <xref ref-type="fig" rid="f5"><bold>Figure&#xa0;5</bold></xref>. The %DE of brain stem (D<sub>1</sub>) of 32 cases was &gt;3%, but most of the dose deviations were negative. Hence, this DVH ALs were too strict for OARs near the target volume such as the brainstem within or near the PTV in the NPC plan. The DVH ALs had an influence on defining the ALs of both %GP and &#x3bc;GI directly. So, if values determined for &#x3bc;GI<sub>whole</sub> exceed the ALs, we need to check whether they have a clinical impact.</p>
<p>MLC errors mainly include random MLC positional errors and systematic positional errors. Random MLC positional errors have little dosimetric effect on IMRT plans (<xref ref-type="bibr" rid="B28">28</xref>). Steers and Fraass (<xref ref-type="bibr" rid="B23">23</xref>) concluded that the shifts in different directions may be an indication of different types of systematic errors arising from TPS model issues, machine issues, or other device issues. In addition, in our study, for the systematic MLC errors smaller than 0.8 mm, the positive rate of &#x3bc;GI<sub>whole</sub> was higher compared with 0.75 mm systematic MLC errors in some publications (<xref ref-type="bibr" rid="B29">29</xref>), which were claimed to be undetected due to the poor resolution of array detectors. The author analyzed and concluded that the reason was that it was too strict to set the DVH ALs of 3% for the NPC plan. However, there is no consensus on the tolerance of the systematic MLC errors for patient QA. Numerous publications (<xref ref-type="bibr" rid="B30">30</xref>&#x2013;<xref ref-type="bibr" rid="B32">32</xref>) have found that the systematic MLC errors up to 1 mm can produce a clinically relevant influence on the dose distribution. However, Rangel et&#xa0;al. (<xref ref-type="bibr" rid="B33">33</xref>) have suggested that systematic MLC errors need to be limited to 0.3 mm. Oliver et&#xa0;al. (<xref ref-type="bibr" rid="B34">34</xref>) have suggested that the systematic MLC errors should be within 0.63 mm to keep the PTV95 within 2%. In brief, &#x3bc;GI<sub>whole</sub> can improve the detecting rate of small systematic MLC errors and the clinical effect of radiotherapy.</p>
<p>By gamma analysis, the verification results can be compressed into a single value (%GP or &#x3bc;GI). It can improve the efficiency of dose verification, which is usually important for clinics under a heavy workload. As proposed in this study, &#x3bc;GI<sub>whole</sub> would not increase the clinical workload. Instead, it has a better correlation with DVH metrics than other commonly used evaluation metrics. Of course, these results also highlighted major limitations of our study. It was not a multicenter study and can potentially bias the analysis. In addition, these results may also have been affected by the specific choice of dosimeter, QA equipment, delivery system, and tumor sites (<xref ref-type="bibr" rid="B23">23</xref>). However, this study could be extended by stratifying the &#x201c;whole&#x201d; region by isodose level and anatomical site to provide more clinical information without increasing clinical work.</p>
</sec>
<sec id="s5">
<title>Conclusion</title>
<p>The empirical-type metrics, such as those in the patient-specific QA, may vary from institution to institution, since those metrics are based on local equipment, processes, and treatment types. Therefore, the conventional regions including &#x201c;10%&#x201d; and &#x201c;50%&#x201d; may not be suitable for all institutions. Different regions of the global gamma analysis have different diagnostic efficiencies. The results of &#x3bc;GI<sub>whole</sub> can provide a new metric for the global gamma analysis.</p>
</sec>
<sec id="s6" sec-type="data-availability">
<title>Data Availability Statement</title>
<p>The original contributions presented in the study are included in the article/supplementary material. Further inquiries can be directed to the corresponding author.</p>
</sec>
<sec id="s7" sec-type="ethics-statement">
<title>Ethics Statement</title>
<p>This study was reviewed and approved by the Ethical and Scientific Committees of The First Affiliated Hospital of Chongqing Medical University (Chongqing, China). Written consent was obtained from the patient individual(s) for the publication of any potentially identifiable images or data included in this paper.</p>
</sec>
<sec id="s8" sec-type="author-contributions">
<title>Author Contributions</title>
<p>WL, YL, and XY conceived and designed the study and contributed to the analysis and interpretation of trials and literature and development and review of the article. HC and HZ collected the data, reviewed literature, and wrote the paper. WH prepared the figures and participated in the revision of literature. All authors contributed to the article and approved the submitted version.</p>
</sec>
<sec id="s9" sec-type="funding-information">
<title>Funding</title>
<p>This work was sponsored by Natural Science Foundation  of Chongqing, China (cstc2021jcyj-msxmX0138).</p>
</sec>
<sec id="s10" sec-type="COI-statement">
<title>Conflict of Interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec id="s11" sec-type="disclaimer">
<title>Publisher&#x2019;s Note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
</body>
<back>
<sec id="s12">
<title>Abbreviations</title>
<p>NPC, Nasopharyngeal cancer; IMRT, intensity-modulated radiation therapy; MLC, multileaf collimator; %GP, gamma passing rate; &#x3bc;GI, mean gamma index; %DE, percentage dose error; DVH, dose&#x2013;volume histogram; ROC, receiver operating characteristic; AUCs, areas under the curves; AL, action limit; PTV, planning target volume; QA, quality assurance; EPID, electronic portal imaging device; 2D, two-dimensional; 3D, three-dimensional; D&amp;C, divide and conquer; HD, high-dose; HG, high-gradient; MD, medium-dose; LD, low-dose; OARs, organs at risk; AAA, anisotropic analytical algorithm; TPS, treatment planning system; CCC, collapsed-cone convolution; DD, dose difference; DTA, distance to agreement; TN, true negative; FN, false negative; TP, true positive; FP, false positive.</p>
</sec>
<ref-list>
<title>References</title>
<ref id="B1">
<label>1</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Taylor</surname> <given-names>A</given-names>
</name>
</person-group>. <article-title>M E B Powell,Intensity-Modulated Radiotherapy&#x2013;What is it</article-title>? <source>Cancer Imaging</source> (<year>2004</year>) <volume>4</volume>(<issue>2</issue>):<fpage>68</fpage>&#x2013;<lpage>73</lpage>. doi: <pub-id pub-id-type="doi">10.1102/1470-7330.2004.0003</pub-id>
</citation>
</ref>
<ref id="B2">
<label>2</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Pan</surname> <given-names>Y</given-names>
</name>
<name>
<surname>Yang</surname> <given-names>R</given-names>
</name>
<name>
<surname>Zhang</surname> <given-names>S</given-names>
</name>
<name>
<surname>Li</surname> <given-names>J</given-names>
</name>
<name>
<surname>Dai</surname> <given-names>J</given-names>
</name>
<name>
<surname>Wang</surname> <given-names>J</given-names>
</name>
<etal/>
</person-group>. <article-title>National Survey of Patient Specific IMRT Quality Assurance in China</article-title>. <source>Radiat Oncol</source> (<year>2019</year>) <volume>14</volume>(<issue>1</issue>):<fpage>69</fpage>. doi: <pub-id pub-id-type="doi">10.1186/s13014-019-1273-5</pub-id>
</citation>
</ref>
<ref id="B3">
<label>3</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Miften</surname> <given-names>M</given-names>
</name>
<name>
<surname>Olch</surname> <given-names>A</given-names>
</name>
<name>
<surname>Mihailidis</surname> <given-names>D</given-names>
</name>
<name>
<surname>Moran</surname> <given-names>J</given-names>
</name>
<name>
<surname>Pawlicki</surname> <given-names>T</given-names>
</name>
<name>
<surname>Molineu</surname> <given-names>A</given-names>
</name>
<etal/>
</person-group>. <article-title>Tolerance Limits and Methodologies for IMRT Measurement-Based Verification QA: Recommendations of AAPM Task Group No. 218</article-title>. <source>Med Phys</source> (<year>2018</year>) <volume>45</volume>(<issue>4</issue>):<page-range>e53&#x2013;83</page-range>. doi: <pub-id pub-id-type="doi">10.1002/mp.12810</pub-id>
</citation>
</ref>
<ref id="B4">
<label>4</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Ahmed</surname> <given-names>S</given-names>
</name>
<name>
<surname>Nelms</surname> <given-names>B</given-names>
</name>
<name>
<surname>Kozelka</surname> <given-names>J</given-names>
</name>
<name>
<surname>Zhang</surname> <given-names>G</given-names>
</name>
<name>
<surname>Moros</surname> <given-names>E</given-names>
</name>
<name>
<surname>Feygelman</surname> <given-names>V</given-names>
</name>
</person-group>. <article-title>Validation of an Improved Helical Diode Array and Dose Reconstruction Software Using TG-244 Datasets and Stringent Dose Comparison Criteria</article-title>. <source>J Appl Clin Med Phys</source> (<year>2016</year>) <volume>17</volume>(<issue>6</issue>):<page-range>163&#x2013;78</page-range>. doi: <pub-id pub-id-type="doi">10.1120/jacmp.v17i6.6414</pub-id>
</citation>
</ref>
<ref id="B5">
<label>5</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Low</surname> <given-names>DA</given-names>
</name>
<name>
<surname>Harms</surname> <given-names>WB</given-names>
</name>
<name>
<surname>Mutic</surname> <given-names>S</given-names>
</name>
<name>
<surname>Purdy</surname> <given-names>JA</given-names>
</name>
</person-group>. <article-title>A Technique for the Quantitative Evaluation of Dose Distributions</article-title>. <source>Med Phys</source> (<year>1998</year>) <volume>25</volume>(<issue>5</issue>):<page-range>656&#x2013;61</page-range>. doi: <pub-id pub-id-type="doi">10.1118/1.598248</pub-id>
</citation>
</ref>
<ref id="B6">
<label>6</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Yu</surname> <given-names>L</given-names>
</name>
<name>
<surname>Tang</surname> <given-names>TLS</given-names>
</name>
<name>
<surname>Cassim</surname> <given-names>N</given-names>
</name>
<name>
<surname>Livingstone</surname> <given-names>A</given-names>
</name>
<name>
<surname>Cassidy</surname> <given-names>D</given-names>
</name>
<name>
<surname>Kairn</surname> <given-names>T</given-names>
</name>
<etal/>
</person-group>. <article-title>Analysis of Dose Comparison Techniques for Patient-Specific Quality Assurance in Radiation Therapy</article-title>. <source>J Appl Clin Med Phys</source> (<year>2019</year>) <volume>20</volume>(<issue>11</issue>):<page-range>189&#x2013;98</page-range>. doi: <pub-id pub-id-type="doi">10.1002/acm2.12726</pub-id>
</citation>
</ref>
<ref id="B7">
<label>7</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Low</surname> <given-names>DA</given-names>
</name>
<name>
<surname>Dempsey</surname> <given-names>JF</given-names>
</name>
</person-group>. <article-title>Evaluation of the Gamma Dose Distribution Comparison Method</article-title>. <source>Med Phys</source> (<year>2003</year>) <volume>30</volume>(<issue>9</issue>):<page-range>2455&#x2013;64</page-range>. doi: <pub-id pub-id-type="doi">10.1118/1.1598711</pub-id>
</citation>
</ref>
<ref id="B8">
<label>8</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Nelms</surname> <given-names>BE</given-names>
</name>
<name>
<surname>Simon</surname> <given-names>JA</given-names>
</name>
</person-group>. <article-title>A Survey on Planar IMRT QA Analysis</article-title>. <source>J Appl Clin Med Phys</source> (<year>2007</year>) <volume>8</volume>(<issue>3</issue>):<fpage>76</fpage>&#x2013;<lpage>90</lpage>. doi: <pub-id pub-id-type="doi">10.1120/jacmp.v8i3.2448</pub-id>
</citation>
</ref>
<ref id="B9">
<label>9</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Nelms</surname> <given-names>BE</given-names>
</name>
<name>
<surname>Zhen</surname> <given-names>H</given-names>
</name>
<name>
<surname>Per-beam</surname> <given-names>T</given-names>
</name>
</person-group>. <article-title>Planar IMRT QA Passing Rates Do Not Predict Clinically Relevant Patient Dose Errors</article-title>. <source>Med Phys</source> (<year>2011</year>) <volume>38</volume>:<page-range>1037&#x2013;44</page-range>. doi: <pub-id pub-id-type="doi">10.1118/1.3544657</pub-id>
</citation>
</ref>
<ref id="B10">
<label>10</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Stasi</surname> <given-names>M</given-names>
</name>
<name>
<surname>Bresciani</surname> <given-names>S</given-names>
</name>
<name>
<surname>Miranti</surname> <given-names>A</given-names>
</name>
<name>
<surname>Maggio</surname> <given-names>A</given-names>
</name>
<name>
<surname>Sapino</surname> <given-names>V</given-names>
</name>
<name>
<surname>Gabriele</surname> <given-names>P</given-names>
</name>
</person-group>. <article-title>Pretreatment Patient-Specific IMRT Quality Assurance: A Correlation Study Between Gamma Index and Patient Clinical Dose Volume Histogram</article-title>. <source>Med Phys</source> (<year>2012</year>) <volume>39</volume>:<page-range>7626&#x2013;34</page-range>. doi: <pub-id pub-id-type="doi">10.1118/1.4767763</pub-id>
</citation>
</ref>
<ref id="B11">
<label>11</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Fredh</surname> <given-names>A</given-names>
</name>
<name>
<surname>Scherman</surname> <given-names>JB</given-names>
</name>
<name>
<surname>Fog</surname> <given-names>LS</given-names>
</name>
<name>
<surname>Rosensch&#xf6;ld</surname> <given-names>PMA</given-names>
</name>
</person-group>. <article-title>Patient QA Systems for Rotational Radiation Therapy: A Comparative Experimental Study With Intentional Errors</article-title>. <source>Med Phys</source> (<year>2013</year>) <volume>40</volume>:<fpage>031716</fpage>. doi: <pub-id pub-id-type="doi">10.1118/1.4788645</pub-id>
</citation>
</ref>
<ref id="B12">
<label>12</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Heilemann</surname> <given-names>G</given-names>
</name>
<name>
<surname>Poppe</surname> <given-names>B</given-names>
</name>
<name>
<surname>Laub</surname> <given-names>W</given-names>
</name>
</person-group>. <article-title>On the Sensitivity of Common Gamma-Index Evaluation Methods to MLC Misalignments in Rapidarc Quality Assurance</article-title>. <source>Med Phys</source> (<year>2013</year>) <volume>40</volume>:<fpage>031702</fpage>. doi: <pub-id pub-id-type="doi">10.1118/1.4789580</pub-id>
</citation>
</ref>
<ref id="B13">
<label>13</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Yi</surname> <given-names>J</given-names>
</name>
<name>
<surname>Han</surname> <given-names>C</given-names>
</name>
<name>
<surname>Zheng</surname> <given-names>X</given-names>
</name>
<name>
<surname>Zhou</surname> <given-names>Y</given-names>
</name>
<name>
<surname>Deng</surname> <given-names>Z</given-names>
</name>
<name>
<surname>Xie</surname> <given-names>C</given-names>
</name>
<etal/>
</person-group>. <article-title>Individual Volume-Based 3D Gamma Indices for Pretreatment VMAT QA</article-title>. <source>J Appl Clin Med Phys</source> (<year>2017</year>) <volume>18</volume>:<fpage>28</fpage>&#x2013;<lpage>36</lpage>. doi: <pub-id pub-id-type="doi">10.1002/acm2.12062</pub-id>
</citation>
</ref>
<ref id="B14">
<label>14</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Gordon</surname> <given-names>J</given-names>
</name>
<name>
<surname>Siebers</surname> <given-names>J</given-names>
</name>
</person-group>. <article-title>Addressing a Gap in Current IMRT Quality Assurance</article-title>. <source>Int J Radiat Oncol Biol Phys</source> (<year>2013</year>) <volume>87</volume>(<issue>1</issue>):<page-range>20&#x2013;1</page-range>. doi: <pub-id pub-id-type="doi">10.1016/j.ijrobp.2013.03.030</pub-id>
</citation>
</ref>
<ref id="B15">
<label>15</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Stojadinovic</surname> <given-names>S</given-names>
</name>
<name>
<surname>Ouyang</surname> <given-names>L</given-names>
</name>
<name>
<surname>Gu</surname> <given-names>X</given-names>
</name>
<name>
<surname>Pompo&#x161;</surname> <given-names>A</given-names>
</name>
<name>
<surname>Bao</surname> <given-names>Q</given-names>
</name>
<name>
<surname>Solberg</surname> <given-names>TD</given-names>
</name>
</person-group>. <article-title>Breaking Bad IMRT QA Practice</article-title>. <source>J Appl Clin Med Phys</source> (<year>2015</year>) <volume>16</volume>(<issue>3</issue>):<fpage>5242</fpage>. doi: <pub-id pub-id-type="doi">10.1120/jacmp.v16i3.5242</pub-id>
</citation>
</ref>
<ref id="B16">
<label>16</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Yu</surname> <given-names>L</given-names>
</name>
<name>
<surname>Kairn</surname> <given-names>T</given-names>
</name>
<name>
<surname>Trapp</surname> <given-names>JV</given-names>
</name>
<name>
<surname>Crowe</surname> <given-names>SB</given-names>
</name>
</person-group>. <article-title>Comparison of Global and Local Gamma Evaluation Results Using Isodose Levels</article-title>. <source>Phys Eng Sci Med</source> (<year>2021</year>) <volume>44</volume>:<page-range>201&#x2013;6</page-range>. doi: <pub-id pub-id-type="doi">10.1007/s13246-020-00968-y</pub-id>
</citation>
</ref>
<ref id="B17">
<label>17</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Stock</surname> <given-names>M</given-names>
</name>
<name>
<surname>Kroupa</surname> <given-names>B</given-names>
</name>
<name>
<surname>Georg</surname> <given-names>D</given-names>
</name>
</person-group>. <article-title>Interpretation and Evaluation of the Gamma Index and the Gamma Index Angle for the Verification of IMRT Hybrid Plans</article-title>. <source>Phys Med Biol</source> (<year>2005</year>) <volume>50</volume>(<issue>3</issue>):<fpage>399</fpage>&#x2013;<lpage>411</lpage>. doi: <pub-id pub-id-type="doi">10.1088/0031-9155/50/3/001</pub-id>
</citation>
</ref>
<ref id="B18">
<label>18</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Visser</surname> <given-names>R</given-names>
</name>
<name>
<surname>Wauben</surname> <given-names>DJL</given-names>
</name>
<name>
<surname>De Groot</surname> <given-names>M</given-names>
</name>
<name>
<surname>Steenbakkers</surname> <given-names>RJHM</given-names>
</name>
<name>
<surname>Bijl</surname> <given-names>HP</given-names>
</name>
<name>
<surname>Godart</surname> <given-names>J</given-names>
</name>
<etal/>
</person-group>. <article-title>Evaluation of DVH-Based Treatment Plan Verification in Addition to Gamma Passing Rates for Head and Neck IMRT</article-title>. <source>Radiother Oncol</source> (<year>2014</year>) <volume>112</volume>:<page-range>389&#x2013;95</page-range>. doi: <pub-id pub-id-type="doi">10.1016/j.radonc.2014.08.002</pub-id>
</citation>
</ref>
<ref id="B19">
<label>19</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Cozzolino</surname> <given-names>M</given-names>
</name>
<name>
<surname>Oliviero</surname> <given-names>C</given-names>
</name>
<name>
<surname>Califano</surname> <given-names>G</given-names>
</name>
<name>
<surname>Clemente</surname> <given-names>S</given-names>
</name>
<name>
<surname>Pedicini</surname> <given-names>P</given-names>
</name>
<name>
<surname>Caivano</surname> <given-names>R</given-names>
</name>
<etal/>
</person-group>. <article-title>Clinically Relevant Quality Assurance (QA) for Prostate RapidArc Plans: Gamma Maps and DVH_based Evaluation</article-title>. <source>Phys Med</source> (<year>2014</year>) <volume>30</volume>:<page-range>462&#x2013;72</page-range>. doi: <pub-id pub-id-type="doi">10.1016/j.ejmp.2014.01.003</pub-id>
</citation>
</ref>
<ref id="B20">
<label>20</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Visser</surname> <given-names>R</given-names>
</name>
<name>
<surname>Wauben</surname> <given-names>DJL</given-names>
</name>
<name>
<surname>Groot</surname> <given-names>M</given-names>
</name>
<name>
<surname>Godart</surname> <given-names>J</given-names>
</name>
<name>
<surname>Langendijk</surname> <given-names>JA</given-names>
</name>
<name>
<surname>Veld</surname> <given-names>AA</given-names>
</name>
<etal/>
</person-group>. <article-title>Efficient and Reliable 3D Dose Quality Assurance for IMRT by Combining Independent Dose Calculations With Measurements</article-title>. <source>Med Phys</source> (<year>2013</year>) <volume>40</volume>(<issue>2</issue>):<fpage>021710</fpage>. doi: <pub-id pub-id-type="doi">10.1118/1.4774048</pub-id>
</citation>
</ref>
<ref id="B21">
<label>21</label>
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Chen</surname> <given-names>F</given-names>
</name>
<name>
<surname>Xia</surname> <given-names>J-l</given-names>
</name>
</person-group>. <source>Clinical Trial Statistics</source>. <publisher-loc>Beijing</publisher-loc>: <publisher-name>PEOPLE&#x2019;S MEDICAL PUBLISHING HOUSE</publisher-name> (<year>2018</year>). p. <fpage>368</fpage>.</citation>
</ref>
<ref id="B22">
<label>22</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Nelms</surname> <given-names>BE</given-names>
</name>
<name>
<surname>Chan</surname> <given-names>MF</given-names>
</name>
<name>
<surname>Jarry</surname> <given-names>G</given-names>
</name>
<name>
<surname>Lemire</surname> <given-names>M</given-names>
</name>
<name>
<surname>Lowden</surname> <given-names>J</given-names>
</name>
<name>
<surname>Hampton</surname> <given-names>C</given-names>
</name>
<etal/>
</person-group>. <article-title>Evaluating IMRT and VMAT Dose Accuracy: Practical Examples of Failure to Detect Systematic Errors When Applying a Commonly Used Metric and Action Levels</article-title>. <source>Med Phys</source> (<year>2013</year>) <volume>40</volume>(<issue>11</issue>):<fpage>111722</fpage>. doi: <pub-id pub-id-type="doi">10.1118/1.4826166</pub-id>
</citation>
</ref>
<ref id="B23">
<label>23</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Steers</surname> <given-names>JM</given-names>
</name>
<name>
<surname>Fraass BA. IMRT</surname> <given-names>QA</given-names>
</name>
</person-group> <article-title>Selecting Gamma Criteria Based on Error Detection Sensitivity</article-title>. <source>Med Phys</source> (<year>2016</year>) <volume>43</volume>(<issue>4</issue>):<page-range>1982&#x2013;94</page-range>. doi: <pub-id pub-id-type="doi">10.1118/1.4943953</pub-id>
</citation>
</ref>
<ref id="B24">
<label>24</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Bailey</surname> <given-names>DW</given-names>
</name>
<name>
<surname>Nelms</surname> <given-names>BE</given-names>
</name>
<name>
<surname>Attwood</surname> <given-names>K</given-names>
</name>
<name>
<surname>Kumaraswamy</surname> <given-names>L</given-names>
</name>
<name>
<surname>Podgorsak</surname> <given-names>MB</given-names>
</name>
</person-group>. <article-title>Statistical Variability and Confidence Intervals for Planar Dose QA Pass Rates</article-title>. <source>Med Phys</source> (<year>2011</year>) <volume>38</volume>(<issue>11</issue>):<page-range>6053&#x2013;64</page-range>. doi: <pub-id pub-id-type="doi">10.1118/1.3651695</pub-id>
</citation>
</ref>
<ref id="B25">
<label>25</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Zhen</surname> <given-names>H</given-names>
</name>
<name>
<surname>Nelms</surname> <given-names>BE</given-names>
</name>
<name>
<surname>Tome</surname> <given-names>WA</given-names>
</name>
</person-group>. <article-title>Moving From Gamma Passing Rates to Patient DVH-Based QA Metrics in Pretreatment Dose QA</article-title>. <source>Med Phys</source> (<year>2011</year>) <volume>38</volume>(<issue>10</issue>):<page-range>5477&#x2013;89</page-range>. doi: <pub-id pub-id-type="doi">10.1118/1.3633904</pub-id>
</citation>
</ref>
<ref id="B26">
<label>26</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Chan</surname> <given-names>MF</given-names>
</name>
<name>
<surname>Li</surname> <given-names>J</given-names>
</name>
<name>
<surname>Schupak</surname> <given-names>K</given-names>
</name>
<name>
<surname>Burman</surname> <given-names>C</given-names>
</name>
</person-group>. <article-title>Using a Novel Dose QA Tool to Quantify the Impact of Systematic Errors Otherwise Undetected by Conventional QA Methods: Clinical Head and Neck Case Studies</article-title>. <source>Technol Cancer Res Treat</source> (<year>2014</year>) <volume>13</volume>(<issue>1</issue>):<fpage>57</fpage>&#x2013;<lpage>67</lpage>. doi: <pub-id pub-id-type="doi">10.7785/tcrt.2012.500353</pub-id>
</citation>
</ref>
<ref id="B27">
<label>27</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Yi</surname> <given-names>X</given-names>
</name>
<name>
<surname>Lu</surname> <given-names>W-L</given-names>
</name>
<name>
<surname>Dang</surname> <given-names>J</given-names>
</name>
<name>
<surname>Huang</surname> <given-names>W</given-names>
</name>
<name>
<surname>Cui</surname> <given-names>H-X</given-names>
</name>
<name>
<surname>Wu</surname> <given-names>W-C</given-names>
</name>
<etal/>
</person-group>. <article-title>A Comprehensive and Clinical-Oriented Evaluation Criteria Based on DVH Information and Gamma Passing Rates Analysis for IMRT Plan 3D Verification</article-title>. <source>J Appl Clin Med Phys</source> (<year>2020</year>) <volume>21</volume>(<issue>8</issue>):<fpage>47</fpage>&#x2013;<lpage>55</lpage>. doi: <pub-id pub-id-type="doi">10.1002/acm2.12910</pub-id>
</citation>
</ref>
<ref id="B28">
<label>28</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wang</surname> <given-names>Y</given-names>
</name>
<name>
<surname>Pang</surname> <given-names>X</given-names>
</name>
<name>
<surname>Feng</surname> <given-names>L</given-names>
</name>
<name>
<surname>Wang</surname> <given-names>H</given-names>
</name>
<name>
<surname>Bai</surname> <given-names>Y</given-names>
</name>
</person-group>. <article-title>Correlation Between Gamma Passing Rate and Complexity of IMRT Plan Due to MLC Position Errors</article-title>. <source>Phys Med</source> (<year>2018</year>) <volume>47</volume>:<page-range>112&#x2013;20</page-range>. doi: <pub-id pub-id-type="doi">10.1016/j.ejmp.2018.03.003</pub-id>
</citation>
</ref>
<ref id="B29">
<label>29</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Woon</surname> <given-names>W</given-names>
</name>
<name>
<surname>Ravindran</surname> <given-names>PB</given-names>
</name>
<name>
<surname>Ekayanake</surname> <given-names>P</given-names>
</name>
<name>
<surname>Vikraman</surname> <given-names>S</given-names>
</name>
<name>
<surname>Lim</surname> <given-names>YY</given-names>
</name>
<name>
<surname>Khalid</surname> <given-names>J</given-names>
</name>
</person-group>. <article-title>A Study on the Effect of Detector Resolution on Gamma Index Passing Rate for VMAT and IMRT QA</article-title>. <source>J Appl Clin Med Phys</source> (<year>2018</year>) <volume>19</volume>(<issue>2</issue>):<page-range>230&#x2013;48</page-range>. doi: <pub-id pub-id-type="doi">10.1002/acm2.12285</pub-id>
</citation>
</ref>
<ref id="B30">
<label>30</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wootton</surname> <given-names>LS</given-names>
</name>
<name>
<surname>Nyflot</surname> <given-names>MJ</given-names>
</name>
<name>
<surname>Chaovalitwongse</surname> <given-names>WA</given-names>
</name>
<name>
<surname>Ford</surname> <given-names>E</given-names>
</name>
</person-group>. <article-title>Error Detection in Intensity-Modulated Radiation Therapy Quality Assurance Using Radiomic Analysis of Gamma Distributions</article-title>. <source>Int J Radiat Oncol Biol Phys</source> (<year>2018</year>) <volume>102</volume>(<issue>1</issue>):<page-range>219&#x2013;28</page-range>. doi: <pub-id pub-id-type="doi">10.1016/j.ijrobp.2018.05.033</pub-id>
</citation>
</ref>
<ref id="B31">
<label>31</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Nithiyanantham</surname> <given-names>K</given-names>
</name>
<name>
<surname>Mani</surname> <given-names>GK</given-names>
</name>
<name>
<surname>Subramani</surname> <given-names>V</given-names>
</name>
<name>
<surname>Mueller</surname> <given-names>L</given-names>
</name>
<name>
<surname>Palaniappan</surname> <given-names>KK</given-names>
</name>
<name>
<surname>Kataria</surname> <given-names>T</given-names>
</name>
</person-group>. <article-title>Analysis of Direct Clinical Consequences of MLC Positional Errors in Volumetric-Modulated Arc Therapy Using 3D Dosimetry System</article-title>. <source>J Appl Clin Med Phys</source> (<year>2015</year>) <volume>16</volume>(<issue>5</issue>):<fpage>296</fpage>&#x2013;<lpage>305</lpage>. doi: <pub-id pub-id-type="doi">10.1120/jacmp.v16i5.5515</pub-id>
</citation>
</ref>
<ref id="B32">
<label>32</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Klein</surname> <given-names>EE</given-names>
</name>
<name>
<surname>Hanley</surname> <given-names>J</given-names>
</name>
<name>
<surname>Bayouth</surname> <given-names>J</given-names>
</name>
<name>
<surname>Yin</surname> <given-names>F-F</given-names>
</name>
<name>
<surname>Simon</surname> <given-names>W</given-names>
</name>
<name>
<surname>Dresser</surname> <given-names>S</given-names>
</name>
<etal/>
</person-group>. <article-title>Task Group 142 Report: Quality Assurance of Medical Accelerators</article-title>. <source>Med Phys</source> (<year>2009</year>) <volume>36</volume>(<issue>9</issue>):<page-range>4197&#x2013;212</page-range>. doi: <pub-id pub-id-type="doi">10.1118/1.3190392</pub-id>
</citation>
</ref>
<ref id="B33">
<label>33</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Rangel</surname> <given-names>A</given-names>
</name>
<name>
<surname>Palte</surname> <given-names>G</given-names>
</name>
<name>
<surname>Dunscombe</surname> <given-names>P</given-names>
</name>
</person-group>. <article-title>The Sensitivity of Patient Specific IMRT QC to Systematic MLC Leaf Bank Offset Errors</article-title>. <source>Med Phys</source> (<year>2010</year>) <volume>37</volume>(<issue>7</issue>):<page-range>3862&#x2013;7</page-range>. doi: <pub-id pub-id-type="doi">10.1118/1.3453576</pub-id>
</citation>
</ref>
<ref id="B34">
<label>34</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Oliver</surname> <given-names>M</given-names>
</name>
<name>
<surname>Gagne</surname> <given-names>I</given-names>
</name>
<name>
<surname>Bush</surname> <given-names>K</given-names>
</name>
<name>
<surname>Zavgorodni</surname> <given-names>S</given-names>
</name>
<name>
<surname>Ansbacher</surname> <given-names>W</given-names>
</name>
<name>
<surname>Beckham</surname> <given-names>W</given-names>
</name>
</person-group>. <article-title>Clinical Significance of Multi-Leaf Collimator Positional Errors for Volumetric Modulated Arc Therapy</article-title>. <source>Radiother Oncol</source> (<year>2010</year>) <volume>97</volume>(<issue>3</issue>):<page-range>554&#x2013;60</page-range>. doi: <pub-id pub-id-type="doi">10.1016/j.radonc.2010.06.013</pub-id>
</citation>
</ref>
</ref-list>
</back>
</article>
