<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xml:lang="EN" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Neuroinform.</journal-id>
<journal-title>Frontiers in Neuroinformatics</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Neuroinform.</abbrev-journal-title>
<issn pub-type="epub">1662-5196</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fninf.2021.789295</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Neuroinformatics</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Comparing the Performance of Two Radiomic Models to Predict Progression and Progression Speed of White Matter Hyperintensities</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name><surname>Shao</surname> <given-names>Yuan</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/595879/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Ruan</surname> <given-names>Jingru</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/1497514/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Xu</surname> <given-names>Yuyun</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/651520/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Shu</surname> <given-names>Zhenyu</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/859941/overview"/>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name><surname>He</surname> <given-names>Xiaodong</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/961594/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Department of Radiology, Zhejiang Provincial People&#x2019;s Hospital, Affiliated People&#x2019;s Hospital of Hangzhou Medical College</institution>, <addr-line>Hangzhou</addr-line>, <country>China</country></aff>
<aff id="aff2"><sup>2</sup><institution>Bengbu Medical College</institution>, <addr-line>Bengbu</addr-line>, <country>China</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Hancan Zhu, Shaoxing University, China</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Liming Hsu, University of North Carolina at Chapel Hill, United States; Ruiting Zhang, Zhejiang University, China</p></fn>
<corresp id="c001">&#x002A;Correspondence: Xiaodong He, <email>15888815645@163.com</email></corresp>
</author-notes>
<pub-date pub-type="epub">
<day>01</day>
<month>12</month>
<year>2021</year>
</pub-date>
<pub-date pub-type="collection">
<year>2021</year>
</pub-date>
<volume>15</volume>
<elocation-id>789295</elocation-id>
<history>
<date date-type="received">
<day>04</day>
<month>10</month>
<year>2021</year>
</date>
<date date-type="accepted">
<day>04</day>
<month>11</month>
<year>2021</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x00A9; 2021 Shao, Ruan, Xu, Shu and He.</copyright-statement>
<copyright-year>2021</copyright-year>
<copyright-holder>Shao, Ruan, Xu, Shu and He</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract>
<p><bold>Purpose:</bold> The aim of this study was to compare two radiomic models in predicting the progression of white matter hyperintensity (WMH) and the speed of progression from conventional magnetic resonance images.</p>
<p><bold>Methods:</bold> In this study, 232 people were retrospectively analyzed at Medical Center A (training and testing groups) and Medical Center B (external validation group). A visual rating scale was used to divide all patients into WMH progression and non-progression groups. Two regions of interest (ROIs)&#x2014;ROI whole-brain white matter (WBWM) and ROI WMH penumbra (WMHp)&#x2014;were segmented from the baseline image. For predicting WMH progression, logistic regression was applied to create radiomic models in the two ROIs. Then, age, sex, clinical course, vascular risk factors, and imaging factors were incorporated into a stepwise regression analysis to construct the combined diagnosis model. Finally, the presence of a correlation between radiomic findings and the speed of progression was analyzed.</p>
<p><bold>Results:</bold> The area under the curve (AUC) was higher for the WMHp-based radiomic model than the WBWM-based radiomic model in training, testing, and validation groups (0.791, 0.768, and 0.767 vs. 0.725, 0.693, and 0.691, respectively). The WBWM-based combined model was established by combining age, hypertension, and rad-score of the ROI WBWM. Also, the WMHp-based combined model is built by combining the age and rad-score of the ROI WMHp. Compared with the WBWM-based model (AUC = 0.779, 0.716, 0.673 in training, testing, and validation groups, respectively), the WMHp-based combined model has higher diagnostic efficiency and better generalization ability (AUC = 0.793, 0.774, 0.777 in training, testing, and validation groups, respectively). The speed of WMH progression was related to the rad-score from ROI WMHp (<italic>r</italic> = 0.49) but not from ROI WBWM.</p>
<p><bold>Conclusion:</bold> The heterogeneity of the penumbra could help identify the individuals at high risk of WMH progression and the rad-score of it was correlated with the speed of progression.</p>
</abstract>
<kwd-group>
<kwd>white matter</kwd>
<kwd>penumbra</kwd>
<kwd>radiomics</kwd>
<kwd>magnetic resonance imaging</kwd>
<kwd>texture analysis</kwd>
</kwd-group>
<contract-num rid="cn001">No.82101983</contract-num>
<contract-num rid="cn002">No. 2021KY067</contract-num>
<contract-sponsor id="cn001">National Natural Science Foundation of China<named-content content-type="fundref-id">10.13039/501100001809</named-content></contract-sponsor>
<contract-sponsor id="cn002">Natural Science Foundation of Zhejiang Province<named-content content-type="fundref-id">10.13039/501100004731</named-content></contract-sponsor>
<counts>
<fig-count count="8"/>
<table-count count="4"/>
<equation-count count="0"/>
<ref-count count="20"/>
<page-count count="11"/>
<word-count count="6225"/>
</counts>
</article-meta>
</front>
<body>
<sec id="S1" sec-type="intro">
<title>Introduction</title>
<p>White matter hyperintensity (WMH) is a common feature found in the periventricular and deep white matter of the elderly (<xref ref-type="bibr" rid="B5">Longstreth et al., 2005</xref>). <xref ref-type="bibr" rid="B7">Maillard et al. (2014)</xref> reported that the abnormal regions are perceived as larger on diffusion tensor imaging (DTI) than on fluid-attenuated inversion recovery (FLAIR) images and proposed the concept of &#x201C;structural penumbra.&#x201D; A prospective study reported that 80% of WMH progression appears as direct extensions of preexisting lesions rather than new, scattered lesions (<xref ref-type="bibr" rid="B3">de Groot et al., 2013</xref>). Also, this study revealed the pattern of WMH progression, which was found to extend from the focus to the penumbra. Our study was aimed at comparing the performance of two radiomic models to predict the progression and progression speed of white matter hyperintensities.</p>
<p>Previous studies have suggested that the FLAIR intensity of a single voxel assists DTI in predicting WMH progression, indicating that the intensity of an individual voxel in conventional Magnetic resonance imaging (MRI) possibly contains influential information regarding the integrity of the white matter (<xref ref-type="bibr" rid="B6">Maillard et al., 2013</xref>). Radiomics is a relatively new field that could reveal changes in the microstructure and its regularity by extracting the intensity value of a single voxel and analyzing its relationship with the intensity value of neighboring voxels and its position within the brain (<xref ref-type="bibr" rid="B20">Yip and Aerts, 2016</xref>). Our previous research also found that radiomic findings could reflect the heterogeneity and complexity of the white matter, which may result from less uniform MRI signal intensities caused by reduced myelin content or increased water content (<xref ref-type="bibr" rid="B14">Shao et al., 2018</xref>; <xref ref-type="bibr" rid="B15">Shu Z. et al., 2020</xref>; <xref ref-type="bibr" rid="B16">Shu Z. Y. et al., 2020</xref>). <xref ref-type="bibr" rid="B17">Tozer et al. (2018)</xref> showed that the texture of the whole-brain white matter (WBWM) was moderately correlated with global cognition and executive dysfunction, and they may be less sensitive than DTI parameters in predicting cognitive decline (<xref ref-type="bibr" rid="B17">Tozer et al., 2018</xref>). We thought that considering the WBWM as the region of interest (ROI) may reduce the predictive power as it would contain more normal tissues. However, the heterogeneity and complexity of the penumbra may be more representative of the lesions. To our knowledge, there have been no studies comparing the predictive power of the WBWM and penumbra.</p>
<p>This study was aimed at investigating whether the heterogeneity of the penumbra was more obvious than that of WBWM in identifying high-risk patients. Furthermore, we want to explore whether a correlation exists between radiomic findings and the speed of progression.</p>
</sec>
<sec id="S2" sec-type="materials|methods">
<title>Materials and Methods</title>
<sec id="S2.SS1">
<title>Subjects</title>
<p>This research was approved by the ethics committee, and the need of obtaining informed consent of patients was waived owing to the retrospective design of the study.</p>
<p>Magnetic resonance imaging data of 152 patients from Medical Center A (ZPP hospital) and 80 patients from Medical Center B (LSP hospital) were collected in this study. The labeled names of all patients of the Medical Center A dataset were listed in alphabetical order and divided into two sets: the division formed a training set (<italic>n</italic> = 105) and a testing set (<italic>n</italic> = 47) in the ratio of 7:3. The database of Medical Center B patients was used as an external validation dataset. <xref ref-type="bibr" rid="B9">Prins et al. (2004)</xref> proposed a visual rating scale in 2004; based on this scale, all patients were divided into WMH progression group (<italic>n</italic> = 57 in A and <italic>n</italic> = 31 in B) and non-progression group (<italic>n</italic> = 95 in A and <italic>n</italic> = 49 in B). Periventricular WMH (PWMH) and deep WMH (DWMH) were compared independently. PWMH was defined as WMH within 10 mm from the ventricle surface. WMH away from the ventricle surface 10 mm is defined as DWMH. Scores of &#x2212;3 to +3 were given according to the progression or decrease in PWMH in the former horn, body, and posterior horn, as shown in <xref ref-type="fig" rid="F1">Figure 1</xref>. Scores of &#x2212;4 to +4 were given according to the progression or decrease in DWMH in different brain regions. WMH progression was defined when the total score was &#x2265;1. WMHs were graded, and their volume was quantified using FLAIR images. Clinical information on various aspects, such as vascular risk factors, clinical course, age, and sex, was obtained from the medical records of the picture archiving and communications system.</p>
<fig id="F1" position="float">
<label>FIGURE 1</label>
<caption><p>Take the periventricular score as an example. These images were obtained from a 73-year-old woman with a history of hypertension and diabetes. Panels <bold>(A,B)</bold> are baseline images, and <bold>(C,D)</bold> are follow-up images. These images show enlargement of white matter hyperintensity (WMH) in frontal caps, lateral bands, and occipital caps. So, the periventricular score for this patient is +3.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fninf-15-789295-g001.tif"/>
</fig>
<p>We included patients who (1) had a clinical diagnosis of minor strokes or transient ischemic attacks, (2) underwent more than two MRI examinations on the same machine within an interval of 2&#x2013;3 years, (3) were older than 60 years at the first examination, and (4) had visible WMH at baseline. We excluded patients who (1) had acute vascular lesions, such as ischemic stroke (except for lacunar infarction) or intracranial hemorrhage; (2) had non-vascular white matter lesions, such as immunologic demyelination, metabolic encephalopathy, poisoning, and infection; (3) had other intracranial lesions, including Alzheimer&#x2019;s disease, Parkinson&#x2019;s disease, craniocerebral trauma, or tumor; (4) had incomplete clinical data; (5) had incomplete imaging data; and (6) had imaging data with motion or machine artifacts. <xref ref-type="fig" rid="F2">Figures 2</xref>, <xref ref-type="fig" rid="F3">3</xref> show the flowchart summarizing participant recruitment and building radiomic models.</p>
<fig id="F2" position="float">
<label>FIGURE 2</label>
<caption><p>Flowchart of this study.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fninf-15-789295-g002.tif"/>
</fig>
<fig id="F3" position="float">
<label>FIGURE 3</label>
<caption><p>The overall outline of the radiomic procedure used in the current work, including image selection, region of interest (ROI) segmentation, model fitting, and clinical application.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fninf-15-789295-g003.tif"/>
</fig>
</sec>
<sec id="S2.SS2">
<title>Magnetic Resonance Imaging Acquisition</title>
<p>Brain MRI scans in medical centers A and B were performed using a 3.0 T MRI scanner with an eight-channel head coil (Discovery MR 750, GE Healthcare, Chicago, IL, United States). The routine sequences were as follows: axial T<sub>1</sub>WI, T<sub>2</sub>WI, FLAIR, and DWI. We used axial FLAIR to observe and segment the identified WMH based on the following parameters: TR = 9,000 ms, TE = 120 ms, field of view (FOV) = 220 mm &#x00D7; 220 mm, matrix = 256 &#x00D7; 256, and section thickness = 5 mm, and inter-slice gap = 1.5 mm. We used T<sub>1</sub>WI for segmenting the white matter with TR = 1,750 ms, TE = 24 ms, FOV = 220 mm &#x00D7; 220 mm, section thickness = 5 mm, and inter-slice gap = 1.5 mm. T<sub>2</sub>WI: TR = 9,823 ms, TE = 101 ms, FOV = 220 mm &#x00D7; 220 mm, section thickness = 5 mm, and inter-slice gap = 1.5 mm. DWI: TR = 3,071 ms, TE = minimum, <italic>b</italic> = 0, 1,000 s/mm<sup>2</sup>, FOV = 220 mm &#x00D7; 220 mm, inter-slice gap = 1.5 mm, and section thickness = 5 mm.</p>
</sec>
<sec id="S2.SS3">
<title>Image Preprocessing</title>
<p>All MRI scan sequences were converted to NIfTI files (.nii.gz) and preprocessed for normalization. Different imaging sequences were co-registered to the same anatomical template; then, they were interpolated to the same resolution (1 mm &#x00D7; 1 mm &#x00D7; 1 mm) and skull-stripped (<xref ref-type="bibr" rid="B11">Rohlfing et al., 2010</xref>; <xref ref-type="bibr" rid="B1">Bakas et al., 2017</xref>). The noise in the images was reduced using Gaussian filtering; then, for reducing external interference factors, magnetic field migration correction was performed. Then, by downsampling each image into 32 bins, the image grayscale intensity level was discretized and normalized for noise reduction. Given these fixed bins values and numbers, the grayscale range of the image is divided into equally spaced intervals. Thus, the grayscale values reflected the size and intensity resolution of the discretized bins (i.e., there are four sized bins per grayscale).</p>
</sec>
<sec id="S2.SS4">
<title>Segmentation of Region of Interests</title>
<sec id="S2.SS4.SSS1">
<title>Region of Interest Whole-Brain White Matter</title>
<p>After spatially normalizing the MRI images to a universal coordinate system, the gray matter, white matter, and cerebrospinal fluid (GM/WM/CSF) of the whole brain were automatically segmented in T<sub>1</sub>WI using the Statistical Parametric Maps 12 (SPM12) toolbox.<sup><xref ref-type="fn" rid="footnote1">1</xref></sup> The automatically segmented WM was treated as the ROI WBWM.</p>
</sec>
<sec id="S2.SS4.SSS2">
<title>Region of Interest White Matter Hyperintensity Penumbra</title>
<p>The WMH was segmented automatically using FLAIR and T<sub>1</sub>WI. <xref ref-type="bibr" rid="B7">Maillard et al. (2014)</xref> defined the WMH penumbra as the 5 mm area surrounding the WMH. We used the AGK software (Artificial-Intelligent Radio-Genomics Kits; GE Healthcare, Chicago, IL, United States) to automatically expand the WMH region by 5 mm. Then, the sulcus and gyrus were manually removed by two experienced neuroradiologists using the ITK-SNAP software.<sup><xref ref-type="fn" rid="footnote2">2</xref></sup> <xref ref-type="supplementary-material" rid="DS1">Supplementary Figure 1</xref> shows a diagram describing this ROI segmentation approach. All segmentations were visually checked for segmentation errors and artifacts.</p>
</sec>
</sec>
<sec id="S2.SS5">
<title>Extraction of Radiomic Features</title>
<p>All MRI images and ROIs were imported into the AGK software to extract radiomic features. The radiomic features were calculated, including histogram, texture, form factor, gray-level co-occurrence matrix (GLCM), run-length matrix (RLM), and gray-level size zone matrix (GLSZM). The extracted texture features were standardized, which removed the unit limits of the data of each feature and converted it into a dimensionless pure value. This allowed the indexes of different units or orders to be compared and weighted. For details, see <xref ref-type="supplementary-material" rid="DS1">Supplementary Materials</xref>.</p>
</sec>
<sec id="S2.SS6">
<title>Construction and Assessment of the Radiomic Models</title>
<p>Based on the training set, we performed analysis of variance (ANOVA) of the extracted features. For feature dimensionality reduction, the analysis of ANOVA + Mann&#x2013;Whitney <italic>U</italic>-test, correlation analysis, and gradient boosting decision tree were sequentially performed. See <xref ref-type="supplementary-material" rid="DS1">Supplementary Materials</xref> for details. The five machine learning methods, namely Bayes, the random forest, the logistic regression, the support vector machine classifiers (SVM), and the <italic>k</italic>-nearest neighbor (KNN), were used to build models, and the best modeling method was selected through comparison. The test set, the training set, and the external verification set were used to verify the predictive efficiency, including calibration efficiency, net value, and diagnostic accuracy, which were estimated using the calibration curve, the decision curve analysis (DCA), and receiver operating characteristic (ROC) curve.</p>
</sec>
<sec id="S2.SS7">
<title>Interobserver and Intra-Observer Reproducibility</title>
<p>For eliminating the sulcus and gyrus, the ROI WMHp was first manually adjusted by the physician XDH. One month later, the physicians XDH and YS manually eliminated these again on 30 randomly selected subjects. The intra-observer correlation coefficient was calculated based on the first measurement of the physicians XDH and YS. The interobserver correlation coefficient was calculated based on the two measurements acquired by the physician XDH.</p>
</sec>
<sec id="S2.SS8">
<title>Statistical Analysis</title>
<p>We performed our statistical analyses using SPSS 20.0 (IBM, Chicago, IL, United States). Comparisons of clinical and imaging characteristics were performed using a <italic>T</italic>-test, Mann&#x2013;Whitney <italic>U</italic>-test, or chi-square test. Moreover, we performed univariate logistic regression analyses on each potential predictor variable associated with WMH progression, including age, sex, imaging factors, and vascular risk factors. Thereafter, to construct combined prediction models, factors with marginal significance (<italic>P</italic> &#x003C; 0.1) in univariate logistic regression were included in multivariable logistic regression. The pairwise correlation among clinical features, the radiomic score (rad-score), and the speed of WMH progression were calculated using the Spearman&#x2019;s analysis. The values of <italic>P</italic> &#x2264; 0.05 were considered to indicate statistical significance.</p>
</sec>
</sec>
<sec id="S3" sec-type="results">
<title>Results</title>
<sec id="S3.SS1">
<title>Demographic and Clinical Characteristics</title>
<p><xref ref-type="table" rid="T1">Table 1</xref> shows the imaging features and demographic characteristics of the participants. In Medical Center A, the median age of patients with WMH progression was significantly higher than for those without WMH progression (74 years vs. 68 years, <italic>P</italic> = 0.004). In Medical Center B, the average age of patients was higher in the WMH progression group than in the non-progression group; however, the difference was not statistically significant (73.52 years vs. 71.65 years, <italic>P</italic> = 0.327). In both medical centers, the difference in the volume and speed of WMH progression was statistically significant between the two groups (all <italic>P</italic> &#x003C; 0.05). We found no significant difference in imaging features and demographic characteristics between medical centers A and B (all <italic>P</italic> &#x003E; 0.05).</p>
<table-wrap position="float" id="T1">
<label>TABLE 1</label>
<caption><p>The demographic characteristics and imaging features of the participants in medical centers A and B.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="center" colspan="3"><bold>Progression of WMH in A center <italic>n</italic> = 152</bold><hr/></td>
<td valign="top" align="center" colspan="3"><bold>Progression of WMH in B center <italic>n</italic> = 80</bold><hr/></td>
<td valign="top" align="center"><bold>A vs. B</bold></td>
</tr>
<tr>
<td/>
<td valign="top" align="center"><bold>No (<italic>n</italic> = 95)</bold></td>
<td valign="top" align="center"><bold>Yes (<italic>n</italic> = 57)</bold></td>
<td valign="top" align="center"><bold><italic>P</italic></bold></td>
<td valign="top" align="center"><bold>No (<italic>n</italic> = 49)</bold></td>
<td valign="top" align="center"><bold>Yes (<italic>n</italic> = 31)</bold></td>
<td valign="top" align="center"><bold><italic>P</italic></bold></td>
<td valign="top" align="center"><bold><italic>P</italic></bold></td>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Age (years)</td>
<td valign="top" align="center">68 (64&#x2013;75)</td>
<td valign="top" align="center">74 (68&#x2013;80)</td>
<td valign="top" align="center">0.004&#x002A;</td>
<td valign="top" align="center">71.65 &#x00B1; 8.92</td>
<td valign="top" align="center">73.52 &#x00B1; 7.00</td>
<td valign="top" align="center">0.327</td>
<td valign="top" align="center">0.367&#x002A;</td>
</tr>
<tr>
<td valign="top" align="left">Sex (male)</td>
<td valign="top" align="center">49 (51.58%)</td>
<td valign="top" align="center">26 (45.61%)</td>
<td valign="top" align="center">0.476</td>
<td valign="top" align="center">25 (51.02%)</td>
<td valign="top" align="center">15 (48.39%)</td>
<td valign="top" align="center">0.818</td>
<td valign="top" align="center">0.819</td>
</tr>
<tr>
<td valign="top" align="left">Hypertension</td>
<td valign="top" align="center">48 (50.53%)</td>
<td valign="top" align="center">37 (64.91%)</td>
<td valign="top" align="center">0.084</td>
<td valign="top" align="center">24 (48.98%)</td>
<td valign="top" align="center">13 (41.94%)</td>
<td valign="top" align="center">0.538</td>
<td valign="top" align="center">0.569</td>
</tr>
<tr>
<td valign="top" align="left">Diabetes</td>
<td valign="top" align="center">39 (41.05%)</td>
<td valign="top" align="center">20 (35.09%)</td>
<td valign="top" align="center">0.465</td>
<td valign="top" align="center">17 (34.69%)</td>
<td valign="top" align="center">13 (41.94%)</td>
<td valign="top" align="center">0.515</td>
<td valign="top" align="center">0.552</td>
</tr>
<tr>
<td valign="top" align="left">Hyperlipidemia</td>
<td valign="top" align="center">37 (38.95%)</td>
<td valign="top" align="center">25 (43.86%)</td>
<td valign="top" align="center">0.551</td>
<td valign="top" align="center">24 (48.98%)</td>
<td valign="top" align="center">15 (48.39%)</td>
<td valign="top" align="center">0.959</td>
<td valign="top" align="center">0.387</td>
</tr>
<tr>
<td valign="top" align="left">CHD</td>
<td valign="top" align="center">33 (34.74%)</td>
<td valign="top" align="center">23 (40.35%)</td>
<td valign="top" align="center">0.487</td>
<td valign="top" align="center">19 (38.78%)</td>
<td valign="top" align="center">9 (29.03%)</td>
<td valign="top" align="center">0.373</td>
<td valign="top" align="center">0.674</td>
</tr>
<tr>
<td valign="top" align="left">Smoking</td>
<td valign="top" align="center">38 (40.00%)</td>
<td valign="top" align="center">19 (33.33%)</td>
<td valign="top" align="center">0.411</td>
<td valign="top" align="center">22 (44.90%)</td>
<td valign="top" align="center">12 (38.71%)</td>
<td valign="top" align="center">0.585</td>
<td valign="top" align="center">0.360</td>
</tr>
<tr>
<td valign="top" align="left">Drinking</td>
<td valign="top" align="center">51 (53.68%)</td>
<td valign="top" align="center">28 (49.12%)</td>
<td valign="top" align="center">0.586</td>
<td valign="top" align="center">30 (61.22%)</td>
<td valign="top" align="center">17 (54.84%)</td>
<td valign="top" align="center">0.572</td>
<td valign="top" align="center">0.274</td>
</tr>
<tr>
<td valign="top" align="left" colspan="2">The Fazekas score of DWMH</td>
<td/>
<td valign="top" align="center">0.414</td>
<td/>
<td/>
<td valign="top" align="center">0.736</td>
<td valign="top" align="center">0.771</td>
</tr>
<tr>
<td valign="top" align="left">1</td>
<td valign="top" align="center">17 (17.89%)</td>
<td valign="top" align="center">19 (33.33%)</td>
<td/>
<td valign="top" align="center">15 (30.61%)</td>
<td valign="top" align="center">6 (19.35%)</td>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">2</td>
<td valign="top" align="center">59 (62.11%)</td>
<td valign="top" align="center">23 (40.35%)</td>
<td/>
<td valign="top" align="center">22 (44.90%)</td>
<td valign="top" align="center">23 (74.19%)</td>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">3</td>
<td valign="top" align="center">19 (20.00%)</td>
<td valign="top" align="center">15 (26.32%)</td>
<td/>
<td valign="top" align="center">12 (24.49%)</td>
<td valign="top" align="center">2 (6.45%)</td>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left" colspan="2">The Fazekas score of PWMH</td>
<td/>
<td valign="top" align="center">0.629</td>
<td/>
<td/>
<td valign="top" align="center">0.952</td>
<td valign="top" align="center">0.779</td>
</tr>
<tr>
<td valign="top" align="left">1</td>
<td valign="top" align="center">18 (18.95%)</td>
<td valign="top" align="center">18 (31.58%)</td>
<td/>
<td valign="top" align="center">13 (26.53%)</td>
<td valign="top" align="center">6 (19.35%)</td>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">2</td>
<td valign="top" align="center">55 (57.89%)</td>
<td valign="top" align="center">22 (38.60%)</td>
<td/>
<td valign="top" align="center">24 (48.98%)</td>
<td valign="top" align="center">20 (64.52%)</td>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">3</td>
<td valign="top" align="center">22 (23.16%)</td>
<td valign="top" align="center">17 (29.82%)</td>
<td/>
<td valign="top" align="center">12 (24.49%)</td>
<td valign="top" align="center">5 (16.13%)</td>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">Volume of WMH at baseline (cm<sup>3</sup>)</td>
<td valign="top" align="center">16.40 &#x00B1; 13.68</td>
<td valign="top" align="center">20.79 &#x00B1; 17.87</td>
<td valign="top" align="center">0.114</td>
<td valign="top" align="center">16.59 &#x00B1; 11.85</td>
<td valign="top" align="center">21.19 &#x00B1; 11.54</td>
<td valign="top" align="center">0.091</td>
<td valign="top" align="center">0.389</td>
</tr>
<tr>
<td valign="top" align="left">Volume of WMH progress (cm<sup>3</sup>)</td>
<td valign="top" align="center">1.52 &#x00B1; 4.70</td>
<td valign="top" align="center">3.51 &#x00B1; 5.80</td>
<td valign="top" align="center">0.023</td>
<td valign="top" align="center">1.18 &#x00B1; 2.68</td>
<td valign="top" align="center">2.90 &#x00B1; 3.70</td>
<td valign="top" align="center">0.018</td>
<td valign="top" align="center">0.107</td>
</tr>
<tr>
<td valign="top" align="left">Interval time (d)</td>
<td valign="top" align="center">862.57 &#x00B1; 106.80</td>
<td valign="top" align="center">881.98 &#x00B1; 100.48</td>
<td valign="top" align="center">0.269</td>
<td valign="top" align="center">863.37 &#x00B1; 89.99</td>
<td valign="top" align="center">860.48 &#x00B1; 109.09</td>
<td valign="top" align="center">0.898</td>
<td valign="top" align="center">0.766</td>
</tr>
<tr>
<td valign="top" align="left">Speed of progress (mm<sup>3</sup>/d)</td>
<td valign="top" align="center">1.74 &#x00B1; 5.43</td>
<td valign="top" align="center">4.00 &#x00B1; 6.68</td>
<td valign="top" align="center">0.024</td>
<td valign="top" align="center">1.39 &#x00B1; 3.23</td>
<td valign="top" align="center">3.56 &#x00B1; 4.73</td>
<td valign="top" align="center">0.017</td>
<td valign="top" align="center">0.118</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn><p><italic>CHD, coronary heart disease; DWMH, deep white matter hyperintensity; PWMH, periventricular white matter hyperintensity. &#x002A;Mann&#x2013;Whitney <italic>U</italic>-test, Median, 25&#x2013;75%.</italic></p></fn>
</table-wrap-foot>
</table-wrap>
</sec>
<sec id="S3.SS2">
<title>Building Radiomic Models to Predict White Matter Hyperintensity Progression</title>
<p>For constructing radiomic models after feature dimensionality reduction, the optimal features were selected, including 12 features in the ROI WMHp and 7 features in the ROI WBWM. The area under the curve (AUC) value was higher for the logistic regression model than for other machine learning methods. In line with this finding, the models were built using the logistic regression classifier (<xref ref-type="fig" rid="F4">Figure 4</xref>). The rad-score was calculated using the formula for the features. The rad-score was found to be significantly different between the progression and non-progression groups in two ROIs (all <italic>P</italic> &#x003C; 0.05; <xref ref-type="table" rid="T2">Table 2</xref>). Additional information about the formulas is shown in the <xref ref-type="supplementary-material" rid="DS1">Supplementary Material</xref>. The predictive efficacies (represented as the AUC) of the ROI WBWM were 0.725, 0.693, and 0.691 for the training group, testing group, and external validation group, respectively. Similarly, the predictive efficacies of the ROI WMHp were 0.791, 0.768, and 0.767 for the training group, testing group, and external validation group, respectively. <xref ref-type="fig" rid="F5">Figures 5</xref>&#x2013;<xref ref-type="fig" rid="F7">7</xref> show the diagnostic accuracy, the calibration efficiency, and the net value of models, which were evaluated using the ROC, the Hosmer&#x2013;Lemeshow test, and DCA, respectively.</p>
<fig id="F4" position="float">
<label>FIGURE 4</label>
<caption><p>Comparison of diagnostic performance of five machine learning approaches and selection of the best machine learning approach to build models. <bold>(A)</bold> The region of interest (ROC) curves of the five machine learning methods in the training group of the ROI whole-brain white matter (WBWM). <bold>(B)</bold> A heatmap of <italic>P</italic>-values comparing diagnostic performance for five machine learning approaches in the ROI WBWM. <bold>(C)</bold> The ROC curves of the five machine learning methods in the training group of the ROI WMH penumbra (WMHp). <bold>(D)</bold> A heatmap of <italic>P</italic>-values comparing diagnostic performance for five machine learning approaches in ROI WMHp.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fninf-15-789295-g004.tif"/>
</fig>
<table-wrap position="float" id="T2">
<label>TABLE 2</label>
<caption><p>Diagnostic accuracy of the rad-score in the training group, testing group, and external validation group.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="center" colspan="3"><bold>WBWM</bold><hr/></td>
<td valign="top" align="center" colspan="3"><bold>WMHp</bold><hr/></td>
</tr>
<tr>
<td/>
<td valign="top" align="center"><bold>Training group</bold></td>
<td valign="top" align="center"><bold>Testing group</bold></td>
<td valign="top" align="center"><bold>External validation</bold></td>
<td valign="top" align="center"><bold>Training group</bold></td>
<td valign="top" align="center"><bold>Testing group</bold></td>
<td valign="top" align="center"><bold>External validation</bold></td>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Rad-score of progression group</td>
<td valign="top" align="center">&#x2212;0.91 &#x00B1; 0.82</td>
<td valign="top" align="center">&#x2212;0.94 &#x00B1; 0.75</td>
<td valign="top" align="center">&#x2212;0.80 &#x00B1; 0.83</td>
<td valign="top" align="center">&#x2212;1.08 &#x00B1; 1.22</td>
<td valign="top" align="center">&#x2212;1.13 &#x00B1; 1.34</td>
<td valign="top" align="center">&#x2212;1.41 &#x00B1; 1.60</td>
</tr>
<tr>
<td valign="top" align="left">Rad-score of no-progression group</td>
<td valign="top" align="center">&#x2212;0.07 &#x00B1; 1.03</td>
<td valign="top" align="center">&#x2212;1.25 &#x00B1; 1.12</td>
<td valign="top" align="center">&#x2212;0.27 &#x00B1; 0.83</td>
<td valign="top" align="center">&#x2212;0.01 &#x00B1; 0.88</td>
<td valign="top" align="center">0.07 &#x00B1; 1.33</td>
<td valign="top" align="center">0.04 &#x00B1; 1.15</td>
</tr>
<tr>
<td valign="top" align="left"><italic>P</italic></td>
<td valign="top" align="center">&#x003C;0.001</td>
<td valign="top" align="center">0.046</td>
<td valign="top" align="center">0.006</td>
<td valign="top" align="center">&#x003C;0.001</td>
<td valign="top" align="center">0.004</td>
<td valign="top" align="center">&#x003C;0.001</td>
</tr>
<tr>
<td valign="top" align="left">AUC</td>
<td valign="top" align="center">0.725</td>
<td valign="top" align="center">0.693</td>
<td valign="top" align="center">0.691</td>
<td valign="top" align="center">0.791</td>
<td valign="top" align="center">0.768</td>
<td valign="top" align="center">0.767</td>
</tr>
<tr>
<td valign="top" align="left">Sensitivity</td>
<td valign="top" align="center">48.7%</td>
<td valign="top" align="center">72.2%</td>
<td valign="top" align="center">71.0%</td>
<td valign="top" align="center">64.1%</td>
<td valign="top" align="center">72.2%</td>
<td valign="top" align="center">80.6%</td>
</tr>
<tr>
<td valign="top" align="left">Specificity</td>
<td valign="top" align="center">89.5%</td>
<td valign="top" align="center">63.1%</td>
<td valign="top" align="center">67.3%</td>
<td valign="top" align="center">84.8%</td>
<td valign="top" align="center">86.2%</td>
<td valign="top" align="center">63.3%</td>
</tr>
</tbody>
</table>
</table-wrap>
<fig id="F5" position="float">
<label>FIGURE 5</label>
<caption><p>The diagnostic accuracy of radiomic models in different groups of two regions of interests (ROIs). <bold>(A&#x2013;C)</bold> The ROC curves of the radiomic models of the ROI whole-brain white matter (WBWM) in the training group, testing group, and external validation group, respectively. <bold>(D&#x2013;F)</bold> The ROC curves of the radiomic models of the ROI WMH penumbra (WMHp) in the training group, testing group, and external validation group, respectively.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fninf-15-789295-g005.tif"/>
</fig>
<fig id="F6" position="float">
<label>FIGURE 6</label>
<caption><p>The calibration curve was used to describe the goodness-of-fit of radiomic models in different groups of two regions of interests (ROIs). <bold>(A&#x2013;C)</bold> The radiomic models of the ROI whole-brain white matter (WBWM) in the training group, testing group, and external validation group, respectively. <bold>(D&#x2013;F)</bold> The radiomic models of the ROI WMH penumbra (WMHp) in the training group, testing group, and external validation group, respectively. The Hosmer&#x2013;Lemeshow test revealed good goodness-of-fit of all models (all <italic>P</italic> &#x003E; 0.05).</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fninf-15-789295-g006.tif"/>
</fig>
<fig id="F7" position="float">
<label>FIGURE 7</label>
<caption><p>The decision curve analysis (DCA) curve was used to describe the net value of radiomic models in different groups of two regions of interests (ROIs). The <italic>Y</italic>-axis represents the net benefit. The pink line represents the radiomic model. The solid black line represents the hypothesis that all patients have white matter hyperintensity (WMH) progression. The black dotted line represents the hypothesis that no patients have WMH progression. The <italic>X</italic>-axis represents the threshold probability. The threshold probability is where the expected benefit of a treatment is equal to the expected benefit of avoiding the treatment. <bold>(A&#x2013;C)</bold> The DCA of the radiomic models of the ROI whole-brain white matter (WBWM) in the training group, testing group, and external validation group, respectively. <bold>(D&#x2013;F)</bold> The DCA of the radiomic models of the ROI WMH penumbra (WMHp) in the training group, testing group, and external validation group, respectively.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fninf-15-789295-g007.tif"/>
</fig>
</sec>
<sec id="S3.SS3">
<title>Building Combined Models to Predict White Matter Hyperintensity Progression</title>
<p>After stepwise logistic regression analysis, age, hypertension, and the rad-score of the ROI WBWM were the independent factors of WMH progression (<xref ref-type="table" rid="T3">Table 3</xref>). We used these factors to construct the combined model in WBWM. The AUCs were 0.779, 0.716, and 0.673 in the training group, testing group, and external validation group, respectively (<xref ref-type="table" rid="T4">Table 4</xref>). In addition, the combined model in WBWM was constructed using the age and the rad-score of the ROI WMHp (<xref ref-type="table" rid="T3">Table 3</xref>). The AUCs were 0.793, 0.774, and 0.777 in the training group, testing group, and external validation group, respectively (<xref ref-type="table" rid="T4">Table 4</xref>).</p>
<table-wrap position="float" id="T3">
<label>TABLE 3</label>
<caption><p>Stepwise logistic regression analysis was performed to construct combined clinical and imaging models for predicting WMH progression.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="center" colspan="2"><bold>Univariate logistic regression</bold><hr/></td>
<td valign="top" align="center" colspan="4"><bold>Multivariate logistic regression</bold><hr/></td>
</tr>
<tr>
<td/>
<td valign="top" colspan="2"/>
<td valign="top" align="center" colspan="2"><bold>WMHp-based combined model</bold><hr/></td>
<td valign="top" align="center" colspan="2"><bold>WBWM-based combined model</bold><hr/></td>
</tr>
<tr>
<td/>
<td valign="top" align="center"><bold>OR (95% CI)</bold></td>
<td valign="top" align="center"><bold><italic>P</italic></bold></td>
<td valign="top" align="center"><bold>OR (95% CI)</bold></td>
<td valign="top" align="center"><bold><italic>P</italic></bold></td>
<td valign="top" align="center"><bold>OR (95% CI)</bold></td>
<td valign="top" align="center"><bold><italic>P</italic></bold></td>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Age (years)</td>
<td valign="top" align="center">1.063 (1.016, 1.112)</td>
<td valign="top" align="center">0.008</td>
<td valign="top" align="center">1.077 (1.023, 1.133)</td>
<td valign="top" align="center">0.004</td>
<td valign="top" align="center">1.069 (1.015, 1.125)</td>
<td valign="top" align="center">0.011</td>
</tr>
<tr>
<td valign="top" align="left">Sex (male)</td>
<td valign="top" align="center">0.787 (0.408, 1.521)</td>
<td valign="top" align="center">0.477</td>
<td valign="top" align="center">/</td>
<td valign="top" align="center">/</td>
<td valign="top" align="center">/</td>
<td valign="top" align="center">/</td>
</tr>
<tr>
<td valign="top" align="left">Hypertension</td>
<td valign="top" align="center">1.811 (0.921, 3.563)</td>
<td valign="top" align="center">0.085</td>
<td valign="top" align="center">2.248 (1.029, 4.910)</td>
<td valign="top" align="center">0.042</td>
<td valign="top" align="center">1.647 (0.758, 3.581)</td>
<td valign="top" align="center">0.208</td>
</tr>
<tr>
<td valign="top" align="left">Diabetes</td>
<td valign="top" align="center">0.776 (0.393, 1.533)</td>
<td valign="top" align="center">0.465</td>
<td valign="top" align="center">/</td>
<td valign="top" align="center">/</td>
<td valign="top" align="center">/</td>
<td valign="top" align="center">/</td>
</tr>
<tr>
<td valign="top" align="left">Hyperlipidemia</td>
<td valign="top" align="center">1.225 (0.629, 2.384)</td>
<td valign="top" align="center">0.551</td>
<td valign="top" align="center">/</td>
<td valign="top" align="center">/</td>
<td valign="top" align="center">/</td>
<td valign="top" align="center">/</td>
</tr>
<tr>
<td valign="top" align="left">CHD</td>
<td valign="top" align="center">1.271 (0.646, 2.501)</td>
<td valign="top" align="center">0.488</td>
<td valign="top" align="center">/</td>
<td valign="top" align="center">/</td>
<td valign="top" align="center">/</td>
<td valign="top" align="center">/</td>
</tr>
<tr>
<td valign="top" align="left">Smoking</td>
<td valign="top" align="center">0.750 (0.377, 1.491)</td>
<td valign="top" align="center">0.412</td>
<td valign="top" align="center">/</td>
<td valign="top" align="center">/</td>
<td valign="top" align="center">/</td>
<td valign="top" align="center">/</td>
</tr>
<tr>
<td valign="top" align="left">Drinking</td>
<td valign="top" align="center">0.833 (0.432, 1.608)</td>
<td valign="top" align="center">0.586</td>
<td valign="top" align="center">/</td>
<td valign="top" align="center">/</td>
<td valign="top" align="center">/</td>
<td valign="top" align="center">/</td>
</tr>
<tr>
<td valign="top" align="left">Interval time</td>
<td valign="top" align="center">1.001 (0.998, 1.004)</td>
<td valign="top" align="center">0.655</td>
<td valign="top" align="center">/</td>
<td valign="top" align="center">/</td>
<td valign="top" align="center">/</td>
<td valign="top" align="center">/</td>
</tr>
<tr>
<td valign="top" align="left">Volume of WMH at baseline</td>
<td valign="top" align="center">1.018 (0.997, 1.04)</td>
<td valign="top" align="center">0.094</td>
<td valign="top" align="center">1.020 (0.999, 1.045)</td>
<td valign="top" align="center">0.103</td>
<td valign="top" align="center">1.013 (0.989, 1.038)</td>
<td valign="top" align="center">0.301</td>
</tr>
<tr>
<td valign="top" align="left">DWMH</td>
<td valign="top" align="center">0.82 (0.504, 1.333)</td>
<td valign="top" align="center">0.423</td>
<td valign="top" align="center">/</td>
<td valign="top" align="center">/</td>
<td valign="top" align="center">/</td>
<td valign="top" align="center">/</td>
</tr>
<tr>
<td valign="top" align="left">PWMH</td>
<td valign="top" align="center">0.886 (0.555, 1.415)</td>
<td valign="top" align="center">0.612</td>
<td valign="top" align="center">/</td>
<td valign="top" align="center">/</td>
<td valign="top" align="center">/</td>
<td valign="top" align="center">/</td>
</tr>
<tr>
<td valign="top" align="left">Rads-WBWM</td>
<td valign="top" align="center">2.251 (1.493, 3.395)</td>
<td valign="top" align="center">&#x003C;0.001</td>
<td valign="top" align="center">2.779 (1.765, 4.376)</td>
<td valign="top" align="center">&#x003C;0.001</td>
<td valign="top" align="center">/</td>
<td valign="top" align="center">/</td>
</tr>
<tr>
<td valign="top" align="left">Rads-WMHp</td>
<td valign="top" align="center">1.987 (1.51, 2.614)</td>
<td valign="top" align="center">&#x003C;0.001</td>
<td valign="top" align="center">/</td>
<td valign="top" align="center">/</td>
<td valign="top" align="center">2.473 (1.639, 3.732)</td>
<td valign="top" align="center">&#x003C;0.001</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn><p><italic>Univariate logistic regression analysis was performed on each potential predictor of WMH progression, including age, sex, vascular risk factors, and imaging factors. Factors with marginal significance (<italic>P</italic> &#x003C; 0.1) in the univariate logistic regression were included in the multivariate logistic regression to construct combined prediction models. Rads, rad-score.</italic></p></fn>
</table-wrap-foot>
</table-wrap>
<table-wrap position="float" id="T4">
<label>TABLE 4</label>
<caption><p>The predictive efficacy of two joint models in training group, testing group, and validation group.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="center"><bold>AUC</bold></td>
<td valign="top" align="center"><bold>Sensitivity</bold></td>
<td valign="top" align="center"><bold>Specificity</bold></td>
<td valign="top" align="center"><bold>Positive prediction</bold></td>
<td valign="top" align="center"><bold>Negative prediction</bold></td>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left" colspan="6"><bold>WBWM-based combined model</bold></td>
</tr>
<tr>
<td valign="top" align="left">Training group</td>
<td valign="top" align="center">0.779</td>
<td valign="top" align="center">74.4%</td>
<td valign="top" align="center">77.3%</td>
<td valign="top" align="center">65.9%</td>
<td valign="top" align="center">83.6%</td>
</tr>
<tr>
<td valign="top" align="left">Testing group</td>
<td valign="top" align="center">0.716</td>
<td valign="top" align="center">72.2%</td>
<td valign="top" align="center">75.9%</td>
<td valign="top" align="center">65.0%</td>
<td valign="top" align="center">81.5%</td>
</tr>
<tr>
<td valign="top" align="left">Validation group</td>
<td valign="top" align="center">0.673</td>
<td valign="top" align="center">83.9%</td>
<td valign="top" align="center">55.1%</td>
<td valign="top" align="center">54.2%</td>
<td valign="top" align="center">84.4%</td>
</tr>
<tr>
<td valign="top" align="left" colspan="6"><bold>WMHp-based combined model</bold></td>
</tr>
<tr>
<td valign="top" align="left">Training group</td>
<td valign="top" align="center">0.793</td>
<td valign="top" align="center">56.4%</td>
<td valign="top" align="center">90.9%</td>
<td valign="top" align="center">78.6%</td>
<td valign="top" align="center">77.9%</td>
</tr>
<tr>
<td valign="top" align="left">Testing group</td>
<td valign="top" align="center">0.774</td>
<td valign="top" align="center">72.2%</td>
<td valign="top" align="center">75.9%</td>
<td valign="top" align="center">65.0%</td>
<td valign="top" align="center">81.5%</td>
</tr>
<tr>
<td valign="top" align="left">Validation group</td>
<td valign="top" align="center">0.777</td>
<td valign="top" align="center">90.3%</td>
<td valign="top" align="center">59.2%</td>
<td valign="top" align="center">58.3%</td>
<td valign="top" align="center">90.6%</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="S3.SS4">
<title>The Pairwise Correlation Among Clinical Risk Factors, Rad-Score, and Speed of Progression</title>
<p>The speed of WMH progression was positively correlated with the rad-score from the ROI WMHp and age (<italic>r</italic> = 0.49 and <italic>r</italic> = 0.15, respectively). In addition, in our sample, we found a weak correlation between hypertension and coronary heart disease, hypertension and diabetes, and hyperlipidemia and smoking (<italic>r</italic> = 0.14, <italic>r</italic> = 0.16, and <italic>r</italic> = 0.18, respectively). Women were more likely to develop diabetes than men (<italic>r</italic> = &#x2212;0.16), as shown in <xref ref-type="fig" rid="F8">Figure 8</xref>.</p>
<fig id="F8" position="float">
<label>FIGURE 8</label>
<caption><p><bold>(A)</bold> The pairwise correlation heatmap among clinical risk factors, the rad-score, and the speed of white matter hyperintensity (WMH) progression. The color bar on the right represents the size of the correlation coefficient. The larger the circle in the figure, the higher the correlation. Asterisk indicates <italic>P</italic> &#x003C; 0.05. CHD, coronary heart disease. <bold>(B)</bold> Scatter diagrams show the correlation between the speed of progress and the rad-score of WMH penumbra (WMHp) and age.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fninf-15-789295-g008.tif"/>
</fig>
</sec>
<sec id="S3.SS5">
<title>Interobserver and Intra-Observer Reproducibility</title>
<p>The intra- and interobserver correlation coefficients of segmenting the ROI WMHp were 0.846 and 0.885, respectively.</p>
</sec>
</sec>
<sec id="S4" sec-type="discussion">
<title>Discussion</title>
<p>Our results revealed that the predictive efficiency was higher for the ROI WMHp-based radiomic model than the ROI WBWM-based radiomic model. Compared with the WBWM-based combined model, the WMHp-based combined model has higher diagnostic efficiency and better generalization ability. Another noteworthy result was that the speed of progression was related to the rad-score of the ROI WMHp but not to that of the ROI WBWM.</p>
<p>The efficiency of the WMHp-based radiomic model was higher than that of the WBWM-based radiomic model in predicting the WMH progression. This finding may be attributed to the fact that the evolutionary mechanism of WMH predominantly affects the foci and moves toward the periphery gradually (<xref ref-type="bibr" rid="B8">Maniega et al., 2015</xref>; <xref ref-type="bibr" rid="B10">Reginold et al., 2018</xref>; <xref ref-type="bibr" rid="B18">van Leijsen et al., 2018</xref>; <xref ref-type="bibr" rid="B19">Vangberg et al., 2019</xref>). The microstructure of the WMHp region has been suggested to be more heterogeneous and complex and more predictive of WMH progression. However, the predictive power of WBWM was reduced by the inclusion of more extensive normal tissues (<xref ref-type="bibr" rid="B15">Shu Z. et al., 2020</xref>). This result also suggests that in particular for clinical studies, the selection of ROIs by medical principles may be more important than the size of ROIs for diagnostic accuracy.</p>
<p>Moreover, we also found that the ROI WMHp-based combined model has higher better generalization ability in predicting the WMH progression. This model has been validated in an external cohort with good diagnostic efficiency, and age was the independent clinical factor that survived in the predictive model. The WMH is the main radiological feature of small vessel disease, with age as a confirmed risk factor (<xref ref-type="bibr" rid="B4">Grueter and Schulz, 2012</xref>; <xref ref-type="bibr" rid="B12">Sabisz et al., 2019</xref>). Besides, our findings suggested that hypertension could also be an established risk factor for the WMH progression in the ROI WBWM-based combined model. Hypertension would damage small blood vessel walls and increase blood&#x2013;brain barrier permeability, thus aggravating white matter progression (<xref ref-type="bibr" rid="B2">Chen et al., 2019</xref>; <xref ref-type="bibr" rid="B12">Sabisz et al., 2019</xref>).</p>
<p>Previous studies using radiomics on the WMH progression ignored the effect of the interval time between examinations (<xref ref-type="bibr" rid="B15">Shu Z. et al., 2020</xref>; <xref ref-type="bibr" rid="B16">Shu Z. Y. et al., 2020</xref>). To avoid this lapse, we further studied the correlation between the speed of progression and the rad-score. Consequently, we found that the speed of the WMH progression to be related to the rad-score of only ROI WMHp and not of the ROI WBWM. The WMH progression follows the pattern of extending from the lesion to the adjacent regions, the heterogeneity, and the complexity of the penumbra was more representative of and correlated more strongly to the progression of the lesion (<xref ref-type="bibr" rid="B7">Maillard et al., 2014</xref>). However, the heterogeneity of WBWM was diluted by relatively more normal tissues, and it was not correlated with the speed of progression. We also found a mild correlation between age and the speed of progress, which corroborated previous reports (<xref ref-type="bibr" rid="B13">Schmidt et al., 2003</xref>; <xref ref-type="bibr" rid="B4">Grueter and Schulz, 2012</xref>).</p>
<p>This study has some limitations. First, the sample size was not large enough, so more cases need to be collected to verify the model. Second, semiautomatic segmentation of ROI WMHp was time-consuming than automatic delineation, which would reduce its clinical usefulness in future.</p>
</sec>
<sec id="S5" sec-type="conclusion">
<title>Conclusion</title>
<p>Radiomic findings revealed that the damage of WMH extended further from the high-intensity area observed on conventional MRI sequences. The heterogeneity of the penumbra could identify the individuals at high risk of WMH progression and the rad-score of it was correlated with the speed of progression.</p>
</sec>
<sec id="S6" sec-type="data-availability">
<title>Data Availability Statement</title>
<p>The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.</p>
</sec>
<sec id="S7">
<title>Ethics Statement</title>
<p>The studies involving human participants were reviewed and approved by the Medical Ethics Committee of Zhejiang Provincial People&#x2019;s Hospital. Written informed consent for participation was not required for this study in accordance with the national legislation and the institutional requirements.</p>
</sec>
<sec id="S8">
<title>Author Contributions</title>
<p>XH designed this study and guided the experiment. YS and YX wrote this manuscript and participated in the whole experiment process. YS and ZS analyzed the data. All authors read and approved the final manuscript.</p>
</sec>
<sec sec-type="COI-statement" id="conf1">
<title>Conflict of Interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="pudiscl1">
<title>Publisher&#x2019;s Note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
</body>
<back>
<sec id="S9" sec-type="funding-information">
<title>Funding</title>
<p>The work was supported by the National Natural Science Foundation of China (Grant No. 82101983) and the Natural Science Foundation of Zhejiang Province Health Department (Grant No. 2021KY067).</p>
</sec>
<sec id="S10" sec-type="supplementary-material">
<title>Supplementary Material</title>
<p>The Supplementary Material for this article can be found online at: <ext-link ext-link-type="uri" xlink:href="https://www.frontiersin.org/articles/10.3389/fninf.2021.789295/full#supplementary-material">https://www.frontiersin.org/articles/10.3389/fninf.2021.789295/full#supplementary-material</ext-link></p>
<supplementary-material xlink:href="Data_Sheet_1.docx" id="DS1" mimetype="application/vnd.openxmlformats-officedocument.wordprocessingml.document" xmlns:xlink="http://www.w3.org/1999/xlink"/>
</sec>
<ref-list>
<title>References</title>
<ref id="B1"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bakas</surname> <given-names>S.</given-names></name> <name><surname>Akbari</surname> <given-names>H.</given-names></name> <name><surname>Sotiras</surname> <given-names>A.</given-names></name> <name><surname>Bilello</surname> <given-names>M.</given-names></name> <name><surname>Rozycki</surname> <given-names>M.</given-names></name> <name><surname>Kirby</surname> <given-names>J. S.</given-names></name><etal/></person-group> (<year>2017</year>). <article-title>Advancing the cancer genome atlas glioma MRI collections with expert segmentation labels and radiomic features.</article-title> <source><italic>Sci. Data</italic></source> <volume>4</volume>:<fpage>170117</fpage>. <pub-id pub-id-type="doi">10.1038/sdata.2017.117</pub-id> <pub-id pub-id-type="pmid">28872634</pub-id></citation></ref>
<ref id="B2"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chen</surname> <given-names>X.</given-names></name> <name><surname>Zhu</surname> <given-names>Y.</given-names></name> <name><surname>Geng</surname> <given-names>S.</given-names></name> <name><surname>Li</surname> <given-names>Q.</given-names></name> <name><surname>Jiang</surname> <given-names>H.</given-names></name></person-group> (<year>2019</year>). <article-title>Association of blood pressure variability and intima-media thickness with white matter hyperintensities in hypertensive patients.</article-title> <source><italic>Front. Aging Neurosci.</italic></source> <volume>11</volume>:<fpage>192</fpage>. <pub-id pub-id-type="doi">10.3389/fnagi.2019.00192</pub-id> <pub-id pub-id-type="pmid">31447663</pub-id></citation></ref>
<ref id="B3"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>de Groot</surname> <given-names>M.</given-names></name> <name><surname>Verhaaren</surname> <given-names>B. F.</given-names></name> <name><surname>de Boer</surname> <given-names>R.</given-names></name> <name><surname>Klein</surname> <given-names>S.</given-names></name> <name><surname>Hofman</surname> <given-names>A.</given-names></name> <name><surname>van der Lugt</surname> <given-names>A.</given-names></name><etal/></person-group> (<year>2013</year>). <article-title>Changes in normal-appearing white matter precede development of white matter lesions.</article-title> <source><italic>Stroke</italic></source> <volume>44</volume> <fpage>1037</fpage>&#x2013;<lpage>1042</lpage>. <pub-id pub-id-type="doi">10.1161/strokeaha.112.680223</pub-id> <pub-id pub-id-type="pmid">23429507</pub-id></citation></ref>
<ref id="B4"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Grueter</surname> <given-names>B. E.</given-names></name> <name><surname>Schulz</surname> <given-names>U. G.</given-names></name></person-group> (<year>2012</year>). <article-title>Age-related cerebral white matter disease (leukoaraiosis): a review.</article-title> <source><italic>Postgrad. Med. J.</italic></source> <volume>88</volume> <fpage>79</fpage>&#x2013;<lpage>87</lpage>. <pub-id pub-id-type="doi">10.1136/postgradmedj-2011-130307</pub-id> <pub-id pub-id-type="pmid">22184252</pub-id></citation></ref>
<ref id="B5"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Longstreth</surname> <given-names>W. T.</given-names> <suffix>Jr.</suffix></name> <name><surname>Arnold</surname> <given-names>A. M.</given-names></name> <name><surname>Beauchamp</surname> <given-names>N. J.</given-names> <suffix>Jr.</suffix></name> <name><surname>Manolio</surname> <given-names>T. A.</given-names></name> <name><surname>Lefkowitz</surname> <given-names>D.</given-names></name> <name><surname>Jungreis</surname> <given-names>C.</given-names></name><etal/></person-group> (<year>2005</year>). <article-title>Incidence, manifestations, and predictors of worsening white matter on serial cranial magnetic resonance imaging in the elderly: the Cardiovascular Health Study.</article-title> <source><italic>Stroke</italic></source> <volume>36</volume> <fpage>56</fpage>&#x2013;<lpage>61</lpage>. <pub-id pub-id-type="doi">10.1161/01.Str.0000149625.99732.69</pub-id></citation></ref>
<ref id="B6"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Maillard</surname> <given-names>P.</given-names></name> <name><surname>Carmichael</surname> <given-names>O.</given-names></name> <name><surname>Harvey</surname> <given-names>D.</given-names></name> <name><surname>Fletcher</surname> <given-names>E.</given-names></name> <name><surname>Reed</surname> <given-names>B.</given-names></name> <name><surname>Mungas</surname> <given-names>D.</given-names></name><etal/></person-group> (<year>2013</year>). <article-title>FLAIR and diffusion MRI signals are independent predictors of white matter hyperintensities.</article-title> <source><italic>AJNR Am. J. Neuroradiol.</italic></source> <volume>34</volume> <fpage>54</fpage>&#x2013;<lpage>61</lpage>. <pub-id pub-id-type="doi">10.3174/ajnr.A3146</pub-id> <pub-id pub-id-type="pmid">22700749</pub-id></citation></ref>
<ref id="B7"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Maillard</surname> <given-names>P.</given-names></name> <name><surname>Fletcher</surname> <given-names>E.</given-names></name> <name><surname>Lockhart</surname> <given-names>S. N.</given-names></name> <name><surname>Roach</surname> <given-names>A. E.</given-names></name> <name><surname>Reed</surname> <given-names>B.</given-names></name> <name><surname>Mungas</surname> <given-names>D.</given-names></name><etal/></person-group> (<year>2014</year>). <article-title>White matter hyperintensities and their penumbra lie along a continuum of injury in the aging brain.</article-title> <source><italic>Stroke</italic></source> <volume>45</volume> <fpage>1721</fpage>&#x2013;<lpage>1726</lpage>. <pub-id pub-id-type="doi">10.1161/strokeaha.113.004084</pub-id> <pub-id pub-id-type="pmid">24781079</pub-id></citation></ref>
<ref id="B8"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Maniega</surname> <given-names>S. M.</given-names></name> <name><surname>Vald&#x00E9;s Hern&#x00E1;ndez</surname> <given-names>M. C.</given-names></name> <name><surname>Clayden</surname> <given-names>J. D.</given-names></name> <name><surname>Royle</surname> <given-names>N. A.</given-names></name> <name><surname>Murray</surname> <given-names>C.</given-names></name> <name><surname>Morris</surname> <given-names>Z.</given-names></name><etal/></person-group> (<year>2015</year>). <article-title>White matter hyperintensities and normal-appearing white matter integrity in the aging brain.</article-title> <source><italic>Neurobiol. Aging</italic></source> <volume>36</volume> <fpage>909</fpage>&#x2013;<lpage>918</lpage>. <pub-id pub-id-type="doi">10.1016/j.neurobiolaging.2014.07.048</pub-id> <pub-id pub-id-type="pmid">25457555</pub-id></citation></ref>
<ref id="B9"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Prins</surname> <given-names>N. D.</given-names></name> <name><surname>van Straaten</surname> <given-names>E. C.</given-names></name> <name><surname>van Dijk</surname> <given-names>E. J.</given-names></name> <name><surname>Simoni</surname> <given-names>M.</given-names></name> <name><surname>van Schijndel</surname> <given-names>R. A.</given-names></name> <name><surname>Vrooman</surname> <given-names>H. A.</given-names></name><etal/></person-group> (<year>2004</year>). <article-title>Measuring progression of cerebral white matter lesions on MRI: visual rating and volumetrics.</article-title> <source><italic>Neurology</italic></source> <volume>62</volume> <fpage>1533</fpage>&#x2013;<lpage>1539</lpage>. <pub-id pub-id-type="doi">10.1212/01.wnl.0000123264.40498.b6</pub-id> <pub-id pub-id-type="pmid">29363050</pub-id></citation></ref>
<ref id="B10"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Reginold</surname> <given-names>W.</given-names></name> <name><surname>Sam</surname> <given-names>K.</given-names></name> <name><surname>Poublanc</surname> <given-names>J.</given-names></name> <name><surname>Fisher</surname> <given-names>J.</given-names></name> <name><surname>Crawley</surname> <given-names>A.</given-names></name> <name><surname>Mikulis</surname> <given-names>D. J.</given-names></name></person-group> (<year>2018</year>). <article-title>Impact of white matter hyperintensities on surrounding white matter tracts.</article-title> <source><italic>Neuroradiology</italic></source> <volume>60</volume> <fpage>933</fpage>&#x2013;<lpage>944</lpage>. <pub-id pub-id-type="doi">10.1007/s00234-018-2053-x</pub-id> <pub-id pub-id-type="pmid">30030550</pub-id></citation></ref>
<ref id="B11"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rohlfing</surname> <given-names>T.</given-names></name> <name><surname>Zahr</surname> <given-names>N. M.</given-names></name> <name><surname>Sullivan</surname> <given-names>E. V.</given-names></name> <name><surname>Pfefferbaum</surname> <given-names>A.</given-names></name></person-group> (<year>2010</year>). <article-title>The SRI24 multichannel atlas of normal adult human brain structure.</article-title> <source><italic>Hum. Brain Mapp.</italic></source> <volume>31</volume> <fpage>798</fpage>&#x2013;<lpage>819</lpage>. <pub-id pub-id-type="doi">10.1002/hbm.20906</pub-id> <pub-id pub-id-type="pmid">20017133</pub-id></citation></ref>
<ref id="B12"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sabisz</surname> <given-names>A.</given-names></name> <name><surname>Naumczyk</surname> <given-names>P.</given-names></name> <name><surname>Marcinkowska</surname> <given-names>A.</given-names></name> <name><surname>Graff</surname> <given-names>B.</given-names></name> <name><surname>G&#x0105;secki</surname> <given-names>D.</given-names></name> <name><surname>Gli&#x0144;ska</surname> <given-names>A.</given-names></name><etal/></person-group> (<year>2019</year>). <article-title>Aging and hypertension - independent or intertwined white matter impairing factors? insights from the quantitative diffusion tensor imaging.</article-title> <source><italic>Front. Aging Neurosci.</italic></source> <volume>11</volume>:<fpage>35</fpage>. <pub-id pub-id-type="doi">10.3389/fnagi.2019.00035</pub-id> <pub-id pub-id-type="pmid">30837864</pub-id></citation></ref>
<ref id="B13"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schmidt</surname> <given-names>R.</given-names></name> <name><surname>Enzinger</surname> <given-names>C.</given-names></name> <name><surname>Ropele</surname> <given-names>S.</given-names></name> <name><surname>Schmidt</surname> <given-names>H.</given-names></name> <name><surname>Fazekas</surname> <given-names>F.</given-names></name></person-group> (<year>2003</year>). <article-title>Progression of cerebral white matter lesions: 6-year results of the Austrian stroke prevention study.</article-title> <source><italic>Lancet</italic></source> <volume>361</volume> <fpage>2046</fpage>&#x2013;<lpage>2048</lpage>. <pub-id pub-id-type="doi">10.1016/s0140-6736(03)13616-1</pub-id></citation></ref>
<ref id="B14"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shao</surname> <given-names>Y.</given-names></name> <name><surname>Chen</surname> <given-names>Z.</given-names></name> <name><surname>Ming</surname> <given-names>S.</given-names></name> <name><surname>Ye</surname> <given-names>Q.</given-names></name> <name><surname>Shu</surname> <given-names>Z.</given-names></name> <name><surname>Gong</surname> <given-names>C.</given-names></name><etal/></person-group> (<year>2018</year>). <article-title>Predicting the development of normal-appearing white matter with radiomics in the aging brain: a longitudinal clinical study.</article-title> <source><italic>Front. Aging Neurosci.</italic></source> <volume>10</volume>:<fpage>393</fpage>. <pub-id pub-id-type="doi">10.3389/fnagi.2018.00393</pub-id> <pub-id pub-id-type="pmid">30546304</pub-id></citation></ref>
<ref id="B15"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shu</surname> <given-names>Z.</given-names></name> <name><surname>Xu</surname> <given-names>Y.</given-names></name> <name><surname>Shao</surname> <given-names>Y.</given-names></name> <name><surname>Pang</surname> <given-names>P.</given-names></name> <name><surname>Gong</surname> <given-names>X.</given-names></name></person-group> (<year>2020</year>). <article-title>Radiomics from magnetic resonance imaging may be used to predict the progression of white matter hyperintensities and identify associated risk factors.</article-title> <source><italic>Eur. Radiol.</italic></source> <volume>30</volume> <fpage>3046</fpage>&#x2013;<lpage>3058</lpage>. <pub-id pub-id-type="doi">10.1007/s00330-020-06676-1</pub-id> <pub-id pub-id-type="pmid">32086580</pub-id></citation></ref>
<ref id="B16"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shu</surname> <given-names>Z. Y.</given-names></name> <name><surname>Shao</surname> <given-names>Y.</given-names></name> <name><surname>Xu</surname> <given-names>Y. Y.</given-names></name> <name><surname>Ye</surname> <given-names>Q.</given-names></name> <name><surname>Cui</surname> <given-names>S. J.</given-names></name> <name><surname>Mao</surname> <given-names>D. W.</given-names></name><etal/></person-group> (<year>2020</year>). <article-title>Radiomics nomogram based on MRI for predicting white matter hyperintensity progression in elderly adults.</article-title> <source><italic>J. Magn. Reson. Imaging</italic></source> <volume>51</volume> <fpage>535</fpage>&#x2013;<lpage>546</lpage>. <pub-id pub-id-type="doi">10.1002/jmri.26813</pub-id> <pub-id pub-id-type="pmid">31187560</pub-id></citation></ref>
<ref id="B17"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tozer</surname> <given-names>D. J.</given-names></name> <name><surname>Zeestraten</surname> <given-names>E.</given-names></name> <name><surname>Lawrence</surname> <given-names>A. J.</given-names></name> <name><surname>Barrick</surname> <given-names>T. R.</given-names></name> <name><surname>Markus</surname> <given-names>H. S.</given-names></name></person-group> (<year>2018</year>). <article-title>Texture analysis of T1-weighted and fluid-attenuated inversion recovery images detects abnormalities that correlate with cognitive decline in small vessel disease.</article-title> <source><italic>Stroke</italic></source> <volume>49</volume> <fpage>1656</fpage>&#x2013;<lpage>1661</lpage>. <pub-id pub-id-type="doi">10.1161/strokeaha.117.019970</pub-id> <pub-id pub-id-type="pmid">29866751</pub-id></citation></ref>
<ref id="B18"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>van Leijsen</surname> <given-names>E. M. C.</given-names></name> <name><surname>Bergkamp</surname> <given-names>M. I.</given-names></name> <name><surname>van Uden</surname> <given-names>I. W. M.</given-names></name> <name><surname>Ghafoorian</surname> <given-names>M.</given-names></name> <name><surname>van der Holst</surname> <given-names>H. M.</given-names></name> <name><surname>Norris</surname> <given-names>D. G.</given-names></name><etal/></person-group> (<year>2018</year>). <article-title>Progression of white matter hyperintensities preceded by heterogeneous decline of microstructural integrity.</article-title> <source><italic>Stroke</italic></source> <volume>49</volume> <fpage>1386</fpage>&#x2013;<lpage>1393</lpage>. <pub-id pub-id-type="doi">10.1161/strokeaha.118.020980</pub-id> <pub-id pub-id-type="pmid">29724890</pub-id></citation></ref>
<ref id="B19"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Vangberg</surname> <given-names>T. R.</given-names></name> <name><surname>Eikenes</surname> <given-names>L.</given-names></name> <name><surname>H&#x00E5;berg</surname> <given-names>A. K.</given-names></name></person-group> (<year>2019</year>). <article-title>The effect of white matter hyperintensities on regional brain volumes and white matter microstructure, a population-based study in HUNT.</article-title> <source><italic>Neuroimage</italic></source> <volume>203</volume>:<fpage>116158</fpage>. <pub-id pub-id-type="doi">10.1016/j.neuroimage.2019.116158</pub-id> <pub-id pub-id-type="pmid">31493533</pub-id></citation></ref>
<ref id="B20"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yip</surname> <given-names>S. S.</given-names></name> <name><surname>Aerts</surname> <given-names>H. J.</given-names></name></person-group> (<year>2016</year>). <article-title>Applications and limitations of radiomics.</article-title> <source><italic>Phys. Med. Biol.</italic></source> <volume>61</volume> <fpage>R150</fpage>&#x2013;<lpage>R166</lpage>. <pub-id pub-id-type="doi">10.1088/0031-9155/61/13/r150</pub-id></citation></ref>
</ref-list>
<glossary>
<title>Abbreviations</title>
<def-list id="DL1">
<def-item><term>WMH</term><def><p>white matter hyperintensity</p></def></def-item>
<def-item><term>WBWM</term><def><p>whole-brain white matter</p></def></def-item>
<def-item><term>WMHp</term><def><p>white matter hyperintensity penumbra</p></def></def-item>
<def-item><term>ANOVA</term><def><p>analysis of variance</p></def></def-item>
<def-item><term>AUC</term><def><p>area under the curve</p></def></def-item>
<def-item><term>DTI</term><def><p>diffusion tensor imaging</p></def></def-item>
<def-item><term>FLAIR</term><def><p>fluid-attenuated inversion recovery</p></def></def-item>
<def-item><term>GLCM</term><def><p>gray-level co-occurrence matrix</p></def></def-item>
<def-item><term>GLSZM</term><def><p>Gray Level Size Zone Matrix</p></def></def-item>
<def-item><term>RLM</term><def><p>run-length matrix</p></def></def-item>
<def-item><term>ROC</term><def><p>receiver operating characteristic</p></def></def-item>
<def-item><term>ROI</term><def><p>regions of interest</p></def></def-item>
<def-item><term>FOV</term><def><p>field of view.</p></def></def-item>
</def-list>
</glossary>
<fn-group>
<fn id="footnote1">
<label>1</label>
<p><ext-link ext-link-type="uri" xlink:href="https://www.fil.ion.ucl.ac.uk/spm/software/spm12">https://www.fil.ion.ucl.ac.uk/spm/software/spm12</ext-link></p></fn>
<fn id="footnote2">
<label>2</label>
<p><ext-link ext-link-type="uri" xlink:href="http://www.itksnap.org/pmwiki/pmwiki.php">http://www.itksnap.org/pmwiki/pmwiki.php</ext-link></p></fn>
</fn-group>
</back>
</article>
