<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" article-type="research-article" dtd-version="2.3" xml:lang="EN">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Oncol.</journal-id>
<journal-title>Frontiers in Oncology</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Oncol.</abbrev-journal-title>
<issn pub-type="epub">2234-943X</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fonc.2022.758622</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Oncology</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>A Multiparametric MRI-Based Radiomics Nomogram for Preoperative Prediction of Survival Stratification in Glioblastoma Patients With Standard Treatment</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name>
<surname>Jia</surname><given-names>Xin</given-names>
</name>
<uri xlink:href="https://loop.frontiersin.org/people/1324874"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Zhai</surname><given-names>Yixuan</given-names>
</name>
<uri xlink:href="https://loop.frontiersin.org/people/1339507"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Song</surname><given-names>Dixiang</given-names>
</name>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Wang</surname><given-names>Yiming</given-names>
</name>
<uri xlink:href="https://loop.frontiersin.org/people/1435911"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Wei</surname><given-names>Shuxin</given-names>
</name>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Yang</surname><given-names>Fengdong</given-names>
</name>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name>
<surname>Wei</surname><given-names>Xinting</given-names>
</name>
<xref ref-type="author-notes" rid="fn001"><sup>*</sup></xref>
<uri xlink:href="https://loop.frontiersin.org/people/829871"/>
</contrib>
</contrib-group>
<aff id="aff1"><institution>Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University</institution>, <addr-line>Zhengzhou</addr-line>, <country>China</country></aff>
<author-notes>
<fn fn-type="edited-by">
<p>Edited by: Jose Javier Otero, The Ohio State University, United States</p>
</fn>
<fn fn-type="edited-by">
<p>Reviewed by: Mingxuan Li, Beijing Neurosurgical Institute, China; Tao Yu, China Medical University, China; Hui Wang, The Sixth Affiliated Hospital of Sun Yat-sen University, China</p>
</fn>
<fn fn-type="corresp" id="fn001">
<p>*Correspondence: Xinting Wei, <email xlink:href="mailto:weixinting777@126.com">weixinting777@126.com</email>
</p>
</fn>
<fn fn-type="other" id="fn002">
<p>This article was submitted to Neuro-Oncology and Neurosurgical Oncology, a section of the journal Frontiers in Oncology</p>
</fn>
</author-notes>
<pub-date pub-type="epub">
<day>16</day>
<month>02</month>
<year>2022</year>
</pub-date>
<pub-date pub-type="collection">
<year>2022</year>
</pub-date>
<volume>12</volume>
<elocation-id>758622</elocation-id>
<history>
<date date-type="received">
<day>14</day>
<month>08</month>
<year>2021</year>
</date>
<date date-type="accepted">
<day>21</day>
<month>01</month>
<year>2022</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#xa9; 2022 Jia, Zhai, Song, Wang, Wei, Yang and Wei</copyright-statement>
<copyright-year>2022</copyright-year>
<copyright-holder>Jia, Zhai, Song, Wang, Wei, Yang and Wei</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p>
</license>
</permissions>
<abstract>
<sec>
<title>Objective</title>
<p>To construct and validate a radiomics nomogram for preoperative prediction of survival stratification in glioblastoma (GBM) patients with standard treatment according to radiomics features extracted from multiparameter magnetic resonance imaging (MRI), which could facilitate clinical decision-making.</p>
</sec>
<sec>
<title>Methods</title>
<p>A total of 125 eligible GBM patients (53 in the short and 72 in the long survival group, separated by an overall survival of 12 months) were randomly divided into a training cohort (n = 87) and a validation cohort (n = 38). Radiomics features were extracted from the MRI of each patient. The T-test and the least absolute shrinkage and selection operator algorithm (LASSO) were used for feature selection. Next, three feature classifier models were established based on the selected features and evaluated by the area under curve (AUC). A radiomics score (Radscore) was then constructed by these features for each patient. Combined with clinical features, a radiomics nomogram was constructed with independent risk factors selected by the logistic regression model. The performance of the nomogram was assessed by AUC, calibration, discrimination, and clinical usefulness.</p>
</sec>
<sec>
<title>Results</title>
<p>There were 5,216 radiomics features extracted from each patient, and 5,060 of them were stable features judged by the intraclass correlation coefficients (ICCs). 21 features were included in the construction of the radiomics score. Of three feature classifier models, support vector machines (SVM) had the best classification effect. The radiomics nomogram was constructed in the training cohort and exhibited promising calibration and discrimination with AUCs of 0.877 and 0.919 in the training and validation cohorts, respectively. The favorable decision curve analysis (DCA) indicated the clinical usefulness of the radiomics nomogram.</p>
</sec>
<sec>
<title>Conclusions</title>
<p>The presented radiomics nomogram, as a non-invasive tool, achieved satisfactory preoperative prediction of the individualized survival stratification of GBM patients.</p>
</sec>
</abstract>
<kwd-group>
<kwd>glioblastoma</kwd>
<kwd>preoperative survival stratification</kwd>
<kwd>machine learning</kwd>
<kwd>radiomics</kwd>
<kwd>nomogram</kwd>
</kwd-group>
<counts>
<fig-count count="7"/>
<table-count count="4"/>
<equation-count count="0"/>
<ref-count count="22"/>
<page-count count="10"/>
<word-count count="4181"/>
</counts>
</article-meta>
</front>
<body>
<sec id="s1" sec-type="intro">
<title>Introduction</title>
<p>Glioblastoma (GBM) is the most frequent primary malignant tumor of the central nervous system with the characteristics of highly aggressive growth, high recurrence rate, and poor prognosis, defined as Grade IV glioma or glioblastoma multiforme according to the 2016 World Health Organization classification of brain tumors (<xref ref-type="bibr" rid="B1">1</xref>). The current standard treatment includes maximal safe surgical resection followed by concomitant radiotherapy and adjuvant chemotherapy with temozolomide, then maintenance with 6&#x2013;12 months of temozolomide as single-agent therapy (<xref ref-type="bibr" rid="B2">2</xref>, <xref ref-type="bibr" rid="B3">3</xref>). Despite receiving standard treatment, the median overall survival (OS) of GBM patients remains 10&#x2013;14 months (<xref ref-type="bibr" rid="B4">4</xref>, <xref ref-type="bibr" rid="B5">5</xref>). Therefore, it is necessary to establish a more reasonable and personalized preoperative prediction approach for survival stratification so that neurosurgeons can make the evaluation, targeted treatment, follow-up management, and better education for GBM patients.</p>
<p>Recent investigative studies have identified several prognostic factors commonly used to predict the prognoses of GBM patients, such as the age of diagnosis, laterality, radiotherapy, chemotherapy (<xref ref-type="bibr" rid="B6">6</xref>), Karnofsky performance status (KPS), the extent of resection (total/gross, subtotal, or other), O6-methylguanine-DNA methyltransferase (MGMT) gene status (<xref ref-type="bibr" rid="B7">7</xref>), and isocitrate dehydrogenase (IDH) mutation status (<xref ref-type="bibr" rid="B8">8</xref>). Additionally, magnetic resonance imaging (MRI), as a non-invasive and non-radioactive inspection method, has indicated great potential in predicting the prognosis of GBM patients based on providing a comprehensive macro-image of the whole tumor (<xref ref-type="bibr" rid="B9">9</xref>, <xref ref-type="bibr" rid="B10">10</xref>). Recently, as a potentially non-invasive high-throughput method of acquiring tumor characteristics, radiomics has been used in many tumors, including the pancreatic ductal adenocarcinomas, colorectal cancer, and pituitary adenomas (<xref ref-type="bibr" rid="B11">11</xref>&#x2013;<xref ref-type="bibr" rid="B13">13</xref>).</p>
<p>In this research, the main purpose was to develop and then independently validate a nomogram based on radiomics score (Radscore) for preoperative prediction of individual OS stratification probabilities for GBM patients who would receive&#xa0;standard treatment. Moreover, three feature classifiers were&#xa0;established to evaluate the value of the selected radiomics&#xa0;features for differentiating survival stratification of GBM patients.</p>
</sec>
<sec id="s2">
<title>Methods</title>
<sec id="s2_1">
<title>Patients</title>
<p>This retrospective study included 125 patients with newly diagnosed GBM undergoing open craniotomy at the First Affiliated Hospital of Zhengzhou University from January 2018 to January 2020 according to the following criteria. The inclusion criteria were as follows: 1) patients with GBM confirmed by pathological report; 2) patients with complete data of medical and imaging records before surgery; and 3) patients with standard treatment, i.e., maximal safe surgical resection followed by radiotherapy plus adjuvant chemotherapy with temozolomide, then maintenance with 6&#x2013;12 months of temozolomide as single-agent therapy. The exclusion criteria were as follows: 1) patients with biopsy only; 2) patients without complete medical records; 3) patients with incomplete image data and image artifacts; and 4) patients with radiotherapy or chemotherapy alone after surgery. The medical ethics committee of the First Affiliated Hospital of Zhengzhou University approved this retrospective study.</p>
<p>There were 4 clinical features and 2 conventional imaging features collected for each patient, including age at diagnosis, gender, preoperative Karnofsky performance status (pKPS), preoperative epilepsy status (pEPI), located lobe (frontal, temporal, parietal, occipital, insular, corpus callosum), and hemisphere (left, right, bilateral). Regular follow-up was applied to every patient until death or June 2021 through the clinic or phone, once every month for the first 6 months after surgery, and every 3&#x2013;6 months thereafter. Each patient was separated into short or long survival group according to the OS of 12 months. Then, the patients were divided randomly into training cohort (n = 87, 70%) used for model construction and validation cohort (n = 38, 30%) used for model evaluation.</p>
</sec>
<sec id="s2_2">
<title>MRI Acquisition and Preprocessing</title>
<p>Four imaging sequences were selected from the head MRI undergone before surgery of each patient, i.e., T1-weighted contrast-enhanced imaging (T1C), T1-weighted imaging (T1), T2-weighted imaging (T2), and T2-weighted fluid-attenuated inversion recovery imaging (T2F). The imaging was performed on five models of MRI scanners from two manufacturers, i.e., Verio, Prisma, TrioTim, and Skyra of Siemens and Discovery MR750 of GE Medical Systems. The T1 sequence was acquired with the following range of parameters: repetition time (TR)/echo time (TE), 163&#x2013;1,750.03 ms/2.46&#x2013;25.176 ms; slice thickness, 5 mm; spacing between slices, 6.5&#x2013;6.75 mm. The T1C sequence was acquired with the following range of parameters: TR/TE, 21&#x2013;3,900 ms/2.32&#x2013;92 ms; slice thickness, 0.9&#x2013;5 mm; spacing between slices, 6.50&#x2013;6.75 mm. The T2 sequence was acquired with the following range of parameters: TR/TE, 3,800&#x2013;5,673.8213 ms/92&#x2013;117 ms; slice thickness, 5 mm; spacing between slices, 6.5&#x2013;6.75 mm. The T2F sequence was acquired with the following range of parameters: TR/TE, 5,000&#x2013;8,400 ms/81&#x2013;157.732 ms; slice thickness, 5 mm; spacing between slices, 6.5&#x2013;6.75 mm.</p>
<p>Image preprocessing was performed by 3D Slicer software (v4.11.0). First, skull-stripping was executed by the Swiss Skull Stripper module, and T1, T2, and T2F sequence images were registered to T1C sequence images. Next, N4 bias field correction was applied to correct the intensity unevenness of each sequence. Ultimately, image normalization (normalizeScale = 100) and image resampling (ResamplePixelSpacing = [3, 3, 3]) were performed in Python environment by the PyRadiomics package.</p>
</sec>
<sec id="s2_3">
<title>Tumor Delineation and Radiomics Feature Extraction</title>
<p>The region of interest (ROI) was delineated on T1C using 3D Slicer software separately by two neurosurgeons, who were blinded to the clinical data and had over 5 years of clinical experience.</p>
<p>The radiomics feature extraction was executed in the Python environment with the PyRadiomics package, which was an open-source python package for the extraction of Radiomics features from medical imaging. The <xref ref-type="supplementary-material" rid="SM1"><bold>Supplementary Material Data S1</bold></xref> supplied the detail parameter settings of feature extraction. There were seven image types (Original, Wavelet, Laplacian of Gaussian (LoG sigma [3.0, 5.0]), Square, SquareRoot, Logarithm, Exponential) and six feature classes (shape, first-order statistics, gray-level co-occurrence matrix (glcm), gray-level run length matrix (glrlm), gray-level size zone matrix (glszm), gray-level dependence matrix (gldm)) adopted for each sequence.</p>
</sec>
<sec id="s2_4">
<title>OS Status-Related Radiomics Feature Selection</title>
<p>Three feature selection steps were performed to avoid overfitting before establishing the model. First, the stable features, which were defined by intraclass correlation coefficients (ICCs) &gt;0.8, were selected between the two groups of ROIs drawn by the two neurosurgeons (<xref ref-type="bibr" rid="B14">14</xref>). Next, the t-test was applied to each stable feature between short and long survival cases. Then, the least absolute shrinkage and selection operator (LASSO) regression algorithm was applied to analyze these features whose p-values were less than 0.05 in the t-test. The optimal &#x3bb; value in LASSO was automatically selected by 10-fold cross-validation with a maximum area under the curve (AUC) criterion, where the final value of &#x3bb; yielded the maximum AUC.</p>
</sec>
<sec id="s2_5">
<title>Construction and Assessment of the Radiomics Nomogram</title>
<p>To understand the ability of these OS status-related radiomics features to discriminate the OS state, three supervised machine learning algorithms were applied in the training cohort, including random forest (RF) algorithm, support vector machine (SVM) algorithm, and logistic regression (LR) algorithm, and tested in the validation cohort. The performance of training and validation cohorts was evaluated by AUC. Then, these features with non-zero coefficients were used to construct the Radscore for each patient. Finally, the radiomics nomogram based on Radscore from the training cohort was established by logistic regression and assessed by the validation cohort. For the two cohorts, the discriminative ability of the radiomics nomogram was quantitatively measured using AUC, and the calibration curves were plotted based on observed probabilities and the nomogram-estimated probabilities (<xref ref-type="bibr" rid="B15">15</xref>). To evaluate the clinical utility of the radiomics nomogram, the decision curve analysis (DCA) was executed by calculating the net benefits at different threshold probabilities in the combined training and validation cohorts (<xref ref-type="bibr" rid="B16">16</xref>). The flowchart of this research is shown in <xref ref-type="fig" rid="f1"><bold>Figure&#xa0;1</bold></xref>.</p>
<fig id="f1" position="float">
<label>Figure&#xa0;1</label>
<caption>
<p>The flowchart of the study.</p>
</caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fonc-12-758622-g001.tif"/>
</fig>
</sec>
<sec id="s2_6">
<title>Statistical Analysis</title>
<p>The continuous variables were analyzed by Student&#x2019;s t-test or Mann&#x2013;Whitney U-test, and chi-square test, Yates&#x2019; correction, or Fisher&#x2019;s exact probabilities were performed in the categorical characteristics. Generally, a two-sided p-value &lt; 0.05 was considered statistically significant. All data analyses were performed in Python (v3.7.6) and R software (v4.0.5).</p>
</sec>
</sec>
<sec id="s3" sec-type="results">
<title>Results</title>
<sec id="s3_1">
<title>Patient Summary</title>
<p>A total of 320 newly diagnosed GBM patients were collected. According to the inclusion and exclusion criteria, we included 177 patients whose image quality met the criteria and 52 patients without standard treatment were excluded. 125 patients were finally included in our study (87 cases in the training cohort and 38 cases in the validation cohort). The clinical features, conventional imaging features, and Radscores of patients in the training cohort, validation cohort and total cohort, are summarized in <xref ref-type="table" rid="T1"><bold>Table&#xa0;1</bold></xref>. There were no significant differences between the short OS and long OS groups in age, gender, pEPI, pKPS, located lobe (frontal, temporal, parietal, occipital, insular, corpus callosum), and hemisphere (left, right, bilateral). However, it was worth noting that Radscore had significant differences in the short OS and long OS groups (p &lt; 0.001).</p>
<table-wrap id="T1" position="float">
<label>Table&#xa0;1</label>
<caption>
<p>Characteristics of GBM patients in the training cohort and validation cohort.</p>
</caption>
<table frame="hsides">
<thead>
<tr>
<th valign="top" rowspan="2" align="left">Variable</th>
<th valign="top" colspan="3" align="center">Training cohort (n = 87)</th>
<th valign="top" colspan="4" align="center">Validation cohort (n = 38)</th>
<th valign="top" colspan="3" align="center">Total cohort (n = 125)</th>
</tr>
<tr>
<th valign="top" align="center">Short OS</th>
<th valign="top" align="center">Long OS</th>
<th valign="top" align="center">p-value</th>
<th valign="top" colspan="2" align="center">Short OS</th>
<th valign="top" align="center">Long OS</th>
<th valign="top" align="center">p-value</th>
<th valign="top" align="center">Short OS</th>
<th valign="top" align="center">Long OS</th>
<th valign="top" align="center">p-value</th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Age/year (mean &#xb1; SD)</td>
<td valign="top" align="center">56.70 &#xb1; 14.70</td>
<td valign="top" align="center">52.82 &#xb1; 10.58</td>
<td valign="top" colspan="2" align="center">0.207</td>
<td valign="top" align="center">50.17 &#xb1; 17.36</td>
<td valign="top" align="center">50.53 &#xb1; 12.96</td>
<td valign="top" align="center">0.946</td>
<td valign="top" align="center">53.87 &#xb1; 16.08</td>
<td valign="top" align="center">52.35 &#xb1; 11.06</td>
<td valign="top" align="center">0.555</td>
</tr>
<tr>
<td valign="top" align="left">Gender</td>
<td valign="top" align="center"/>
<td valign="top" align="center"/>
<td valign="top" colspan="2" align="center">0.571</td>
<td valign="top" align="center"/>
<td valign="top" align="center"/>
<td valign="top" align="center">0.945</td>
<td valign="top" align="center"/>
<td valign="top" align="center"/>
<td valign="top" align="center">0.540</td>
</tr>
<tr>
<td valign="top" align="left">&#x2003;Male</td>
<td valign="top" align="center">16</td>
<td valign="top" align="center">34</td>
<td valign="top" colspan="2" align="center"/>
<td valign="top" align="center">12</td>
<td valign="top" align="center">8</td>
<td valign="top" align="center"/>
<td valign="top" align="center">28</td>
<td valign="top" align="center">42</td>
<td valign="top" align="center"/>
</tr>
<tr>
<td valign="top" align="left">&#x2003;Female</td>
<td valign="top" align="center">14</td>
<td valign="top" align="center">23</td>
<td valign="top" colspan="2" align="center"/>
<td valign="top" align="center">11</td>
<td valign="top" align="center">7</td>
<td valign="top" align="center"/>
<td valign="top" align="center">25</td>
<td valign="top" align="center">30</td>
<td valign="top" align="center"/>
</tr>
<tr>
<td valign="top" align="left">pEPI</td>
<td valign="top" align="center"/>
<td valign="top" align="center"/>
<td valign="top" colspan="2" align="center">0.624</td>
<td valign="top" align="center"/>
<td valign="top" align="center"/>
<td valign="top" align="center">0.143</td>
<td valign="top" align="center"/>
<td valign="top" align="center"/>
<td valign="top" align="center">0.199</td>
</tr>
<tr>
<td valign="top" align="left">&#x2003;Yes</td>
<td valign="top" align="center">5</td>
<td valign="top" align="center">12</td>
<td valign="top" colspan="2" align="center"/>
<td valign="top" align="center">2</td>
<td valign="top" align="center">4</td>
<td valign="top" align="center"/>
<td valign="top" align="center">7</td>
<td valign="top" align="center">16</td>
<td valign="top" align="center"/>
</tr>
<tr>
<td valign="top" align="left">&#x2003;No</td>
<td valign="top" align="center">25</td>
<td valign="top" align="center">45</td>
<td valign="top" colspan="2" align="center"/>
<td valign="top" align="center">21</td>
<td valign="top" align="center">11</td>
<td valign="top" align="center"/>
<td valign="top" align="center">46</td>
<td valign="top" align="center">56</td>
<td valign="top" align="center"/>
</tr>
<tr>
<td valign="top" align="left">pKPS</td>
<td valign="top" align="center">74.33 &#xb1; 14.31</td>
<td valign="top" align="center">72.28 &#xb1; 15.59</td>
<td valign="top" colspan="2" align="center">0.550</td>
<td valign="top" align="center">74.35 &#xb1; 12.73</td>
<td valign="top" align="center">74.00 &#xb1; 12.42</td>
<td valign="top" align="center">0.934</td>
<td valign="top" align="center">74.34 &#xb1; 13.52</td>
<td valign="top" align="center">72.64 &#xb1; 14.92</td>
<td valign="top" align="center">0.514</td>
</tr>
<tr>
<td valign="top" align="left">Located lobe</td>
<td valign="top" align="center"/>
<td valign="top" align="center"/>
<td valign="top" colspan="2" align="center"/>
<td valign="top" align="center"/>
<td valign="top" align="center"/>
<td valign="top" align="center"/>
<td valign="top" align="center"/>
<td valign="top" align="center"/>
<td valign="top" align="center"/>
</tr>
<tr>
<td valign="top" align="left">&#x2003;Frontal</td>
<td valign="top" align="center">14</td>
<td valign="top" align="center">17</td>
<td valign="top" colspan="2" align="center">0.158</td>
<td valign="top" align="center">7</td>
<td valign="top" align="center">5</td>
<td valign="top" align="center">1.000</td>
<td valign="top" align="center">21</td>
<td valign="top" align="center">22</td>
<td valign="top" align="center">0.292</td>
</tr>
<tr>
<td valign="top" align="left">&#x2003;Temporal</td>
<td valign="top" align="center">7</td>
<td valign="top" align="center">17</td>
<td valign="top" colspan="2" align="center">0.618</td>
<td valign="top" align="center">4</td>
<td valign="top" align="center">7</td>
<td valign="top" align="center">0.073</td>
<td valign="top" align="center">11</td>
<td valign="top" align="center">24</td>
<td valign="top" align="center">0.122</td>
</tr>
<tr>
<td valign="top" align="left">&#x2003;Parietal</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">11</td>
<td valign="top" colspan="2" align="center">0.084</td>
<td valign="top" align="center">5</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">0.681</td>
<td valign="top" align="center">6</td>
<td valign="top" align="center">13</td>
<td valign="top" align="center">0.300</td>
</tr>
<tr>
<td valign="top" align="left">&#x2003;Occipital</td>
<td valign="top" align="center">3</td>
<td valign="top" align="center">2</td>
<td valign="top" colspan="2" align="center">0.452</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">1.000</td>
<td valign="top" align="center">4</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">0.418</td>
</tr>
<tr>
<td valign="top" align="left">&#x2003;Insular</td>
<td valign="top" align="center">5</td>
<td valign="top" align="center">6</td>
<td valign="top" colspan="2" align="center">0.502</td>
<td valign="top" align="center">4</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">0.630</td>
<td valign="top" align="center">9</td>
<td valign="top" align="center">7</td>
<td valign="top" align="center">0.230</td>
</tr>
<tr>
<td valign="top" align="left">&#x2003;Corpus callosum</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">4</td>
<td valign="top" colspan="2" align="center">0.344</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0.510</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">4</td>
<td valign="top" align="center">0.970</td>
</tr>
<tr>
<td valign="top" align="left">Hemisphere</td>
<td valign="top" align="center"/>
<td valign="top" align="center"/>
<td valign="top" colspan="2" align="center"/>
<td valign="top" align="center"/>
<td valign="top" align="center"/>
<td valign="top" align="center"/>
<td valign="top" align="center"/>
<td valign="top" align="center"/>
<td valign="top" align="center"/>
</tr>
<tr>
<td valign="top" align="left">&#x2003;Left</td>
<td valign="top" align="center">16</td>
<td valign="top" align="center">32</td>
<td valign="top" colspan="2" align="center">0.802</td>
<td valign="top" align="center">11</td>
<td valign="top" align="center">7</td>
<td valign="top" align="center">0.793</td>
<td valign="top" align="center">27</td>
<td valign="top" align="center">39</td>
<td valign="top" align="center">0.721</td>
</tr>
<tr>
<td valign="top" align="left">&#x2003;Right</td>
<td valign="top" align="center">13</td>
<td valign="top" align="center">21</td>
<td valign="top" colspan="2" align="center">0.555</td>
<td valign="top" align="center">10</td>
<td valign="top" align="center">8</td>
<td valign="top" align="center">0.793</td>
<td valign="top" align="center">23</td>
<td valign="top" align="center">29</td>
<td valign="top" align="center">0.727</td>
</tr>
<tr>
<td valign="top" align="left">&#x2003;Bilateral</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">4</td>
<td valign="top" colspan="2" align="center">0.828</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0.667</td>
<td valign="top" align="center">3</td>
<td valign="top" align="center">4</td>
<td valign="top" align="center">0.713</td>
</tr>
<tr>
<td valign="top" align="left">Radscore</td>
<td valign="top" align="center"/>
<td valign="top" align="center"/>
<td valign="top" colspan="2" align="center"/>
<td valign="top" align="center"/>
<td valign="top" align="center"/>
<td valign="top" align="center"/>
<td valign="top" align="center"/>
<td valign="top" align="center"/>
<td valign="top" align="center"/>
</tr>
<tr>
<td valign="top" align="left">&#x2003;Mean</td>
<td valign="top" align="center">-0.167</td>
<td valign="top" align="center">0.128</td>
<td valign="top" colspan="2" align="center">&lt;0.001</td>
<td valign="top" align="center">-0.207</td>
<td valign="top" align="center">0.165</td>
<td valign="top" align="center">&lt;0.001</td>
<td valign="top" align="center">-0.185</td>
<td valign="top" align="center">-0.136</td>
<td valign="top" align="center">&lt;0.001</td>
</tr>
<tr>
<td valign="top" align="left">&#x2003;Range</td>
<td valign="top" align="center">(-0.411,0.182)</td>
<td valign="top" align="center">(-0.405,0.609)</td>
<td valign="top" colspan="2" align="center"/>
<td valign="top" align="center">(-0.528,0.150)</td>
<td valign="top" align="center">(-0.057,0.613)</td>
<td valign="top" align="center"/>
<td valign="top" align="center">(-0.528,0.182)</td>
<td valign="top" align="center">(-0.405,0.613)</td>
<td valign="top" align="center"/>
</tr>
<tr>
<td valign="top" align="left"> Median OS/month</td>
<td valign="top" colspan="2" align="center">16</td>
<td valign="top" align="center">NA</td>
<td valign="top" colspan="3" align="center">11.5</td>
<td valign="top" align="center">NA</td>
<td valign="top" colspan="2" align="center">15</td>
<td valign="top" align="center">NA</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn>
<p>SD, standard deviation; NA, not applicable.</p>
</fn>
</table-wrap-foot>
</table-wrap>
</sec>
<sec id="s3_2">
<title>Radiomics Feature Analysis and Radscore Calculation</title>
<p>In this study, a total of 1,304 radiomics features for each sequence were extracted, including 14 shape features, 18 first-order statistics features, 68 texture features, 172 LoG features, 688 wavelet features, 86 square features, 86 square-root features, 86 logarithm features, and 86 exponential features. A total of 5,216 radiomics features were calculated from four imaging sequences for each patient. Among them, 5,080 radiomics features were stable after being screened by ICCs. After that, 777 radiomics features were selected by t-test. Ultimately, the optimal regulation weight &#x3bb; (&#x3bb; = 0.029470517025518096) was determined for the LASSO algorithm, and 21 features with non-zero coefficients were selected for OS stratification of GBM patients. The detailed names and weights of the 25 radiomics features are shown in <xref ref-type="table" rid="T2"><bold>Table&#xa0;2</bold></xref> and <xref ref-type="fig" rid="f2"><bold>Figure&#xa0;2</bold></xref>. It could be seen that the T1C sequence had a greater impact on OS stratification.</p>
<table-wrap id="T2" position="float">
<label>Table&#xa0;2</label>
<caption>
<p>Description of the radiomics features selected.</p>
</caption>
<table frame="hsides">
<thead>
<tr>
<th valign="top" align="left">Sequence</th>
<th valign="top" align="left">Image type</th>
<th valign="top" align="center">Feature class</th>
<th valign="top" align="center">Feature name</th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">T2</td>
<td valign="top" align="left">HLH wavelet</td>
<td valign="top" align="left">glszm</td>
<td valign="top" align="left">LargeAreaLowGrayLevelEmphasis</td>
</tr>
<tr>
<td valign="top" align="left">T2</td>
<td valign="top" align="left">SquareRoot</td>
<td valign="top" align="left">firstorder</td>
<td valign="top" align="left">RootMeanSquared</td>
</tr>
<tr>
<td valign="top" align="left">T2</td>
<td valign="top" align="left">Logarithm</td>
<td valign="top" align="left">firstorder</td>
<td valign="top" align="left">10Percentile</td>
</tr>
<tr>
<td valign="top" align="left">T1C</td>
<td valign="top" align="left">log(sigma=5.0mm)</td>
<td valign="top" align="left">firstorder</td>
<td valign="top" align="left">Maximum</td>
</tr>
<tr>
<td valign="top" align="left">T1C</td>
<td valign="top" align="left">LHL wavelet</td>
<td valign="top" align="left">glcm</td>
<td valign="top" align="left">Correlation</td>
</tr>
<tr>
<td valign="top" align="left">T1C</td>
<td valign="top" align="left">LHH wavelet</td>
<td valign="top" align="left">firstorder</td>
<td valign="top" align="left">Median</td>
</tr>
<tr>
<td valign="top" align="left">T1C</td>
<td valign="top" align="left">LHH wavelet</td>
<td valign="top" align="left">glcm</td>
<td valign="top" align="left">Correlation</td>
</tr>
<tr>
<td valign="top" align="left">T1C</td>
<td valign="top" align="left">HLL wavelet</td>
<td valign="top" align="left">glcm</td>
<td valign="top" align="left">lmc2</td>
</tr>
<tr>
<td valign="top" align="left">T1C</td>
<td valign="top" align="left">HLL wavelet</td>
<td valign="top" align="left">glrlm</td>
<td valign="top" align="left">LongRunHighGrayLevelEmphasis</td>
</tr>
<tr>
<td valign="top" align="left">T1C</td>
<td valign="top" align="left">HLL wavelet</td>
<td valign="top" align="left">gldm</td>
<td valign="top" align="left">LargeDependenceHighGrayLevelEmphasis</td>
</tr>
<tr>
<td valign="top" align="left">T1C</td>
<td valign="top" align="left">Logarithm</td>
<td valign="top" align="left">firstorder</td>
<td valign="top" align="left">RootMeanSquared</td>
</tr>
<tr>
<td valign="top" align="left">T1C</td>
<td valign="top" align="left">Logarithm</td>
<td valign="top" align="left">glcm</td>
<td valign="top" align="left">Autocorrelation</td>
</tr>
<tr>
<td valign="top" align="left">T1C</td>
<td valign="top" align="left">Logarithm</td>
<td valign="top" align="left">glcm</td>
<td valign="top" align="left">lmc2</td>
</tr>
<tr>
<td valign="top" align="left">T1C</td>
<td valign="top" align="left">Exponential</td>
<td valign="top" align="left">glszm</td>
<td valign="top" align="left">SizeZoneNonUniformityNormalized</td>
</tr>
<tr>
<td valign="top" align="left">T1C</td>
<td valign="top" align="left">Exponential</td>
<td valign="top" align="left">glszm</td>
<td valign="top" align="left">SmallAreaLowGrayLevelEmphasis</td>
</tr>
<tr>
<td valign="top" align="left">T2F</td>
<td valign="top" align="left">Original</td>
<td valign="top" align="left">glcm</td>
<td valign="top" align="left">Idmn</td>
</tr>
<tr>
<td valign="top" align="left">T2F</td>
<td valign="top" align="left">LLH wavelet</td>
<td valign="top" align="left">firstorder</td>
<td valign="top" align="left">90Percentile</td>
</tr>
<tr>
<td valign="top" align="left">T2F</td>
<td valign="top" align="left">LLH wavelet</td>
<td valign="top" align="left">glcm</td>
<td valign="top" align="left">ClusterTendency</td>
</tr>
<tr>
<td valign="top" align="left">T2F</td>
<td valign="top" align="left">LHH wavelet</td>
<td valign="top" align="left">glszm</td>
<td valign="top" align="left">SmallAreaEmphasis</td>
</tr>
<tr>
<td valign="top" align="left">T2F</td>
<td valign="top" align="left">HHH wavelet</td>
<td valign="top" align="left">glcm</td>
<td valign="top" align="left">DifferenceVariance</td>
</tr>
<tr>
<td valign="top" align="left">T2F</td>
<td valign="top" align="left">Exponential</td>
<td valign="top" align="left">gldm</td>
<td valign="top" align="left">DependenceVariance</td>
</tr>
</tbody>
</table>
</table-wrap>
<fig id="f2" position="float">
<label>Figure&#xa0;2</label>
<caption>
<p>The weights of radiomics features selected. It could be seen that the T1C sequence had a greater impact on OS stratification.</p>
</caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fonc-12-758622-g002.tif"/>
</fig>
<p>There were three supervised machine learning algorithms models constructed to determine the ability of these OS status-related radiomics features to discriminate the OS stratification. The detail performances of the three models are shown in <xref ref-type="table" rid="T3"><bold>Table&#xa0;3</bold></xref>. The SVM model performed best among the three models. The AUC, sensitivity, accuracy, and F1 score were 0.75, 0.93, 0.71, and 0.72 in the validation cohort, respectively.</p>
<table-wrap id="T3" position="float">
<label>Table&#xa0;3</label>
<caption>
<p>Comparison of the three radiomics feature classifiers.</p>
</caption>
<table frame="hsides">
<thead>
<tr>
<th valign="top" rowspan="2" align="left">Variable</th>
<th valign="top" colspan="2" align="center">RF</th>
<th valign="top" colspan="2" align="center">SVM</th>
<th valign="top" colspan="2" align="center">LR</th>
</tr>
<tr>
<th valign="top" align="center">Training</th>
<th valign="top" align="center">Validation</th>
<th valign="top" align="center">Training</th>
<th valign="top" align="center">Validation</th>
<th valign="top" align="center">Training</th>
<th valign="top" align="center">Validation</th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">AUC</td>
<td valign="top" align="center">0.98</td>
<td valign="top" align="center">0.72</td>
<td valign="top" align="center">0.97</td>
<td valign="top" align="center">0.75</td>
<td valign="top" align="center">0.85</td>
<td valign="top" align="center">0.73</td>
</tr>
<tr>
<td valign="top" align="left">Sensitivity</td>
<td valign="top" align="center">0.98</td>
<td valign="top" align="center">0.87</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">0.93</td>
<td valign="top" align="center">0.84</td>
<td valign="top" align="center">0.8</td>
</tr>
<tr>
<td valign="top" align="left">Specificity</td>
<td valign="top" align="center">0.98</td>
<td valign="top" align="center">0.57</td>
<td valign="top" align="center">0.95</td>
<td valign="top" align="center">0.57</td>
<td valign="top" align="center">0.86</td>
<td valign="top" align="center">0.65</td>
</tr>
<tr>
<td valign="top" align="left">Accuracy</td>
<td valign="top" align="center">0.98</td>
<td valign="top" align="center">0.68</td>
<td valign="top" align="center">0.97</td>
<td valign="top" align="center">0.71</td>
<td valign="top" align="center">0.85</td>
<td valign="top" align="center">0.71</td>
</tr>
<tr>
<td valign="top" align="left">F1-score</td>
<td valign="top" align="center">0.98</td>
<td valign="top" align="center">0.68</td>
<td valign="top" align="center">0.97</td>
<td valign="top" align="center">0.72</td>
<td valign="top" align="center">0.85</td>
<td valign="top" align="center">0.69</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn>
<p>RF, random forest; SVM, support vector machine; LR, logistic regression.</p>
</fn>
</table-wrap-foot>
</table-wrap>
<p>Then, the Radscore for each patient in training and validation cohorts was constructed for further analysis, which was calculated by multiplying each feature coefficient by the corresponding feature value and summing. The corresponding fitting formula is listed in <xref ref-type="supplementary-material" rid="SM1"><bold>Supplementary Material Data S2</bold></xref>. Patients with long OS showed higher Radscores than patients with short OS in both the training and validation cohorts <bold>(</bold>
<xref ref-type="fig" rid="f3"><bold>Figure&#xa0;3</bold></xref><bold>)</bold>. In the training cohort, the average values of Radscore were significant differences in the short OS and long OS groups (-0.167 vs. 0.128, p &lt; 0.001). Similarly, the mean Radscore of long OS was 0.165, which was significantly higher than that of short OS (-0.207, p &lt; 0.001) in the validation cohort.</p>
<fig id="f3" position="float">
<label>Figure&#xa0;3</label>
<caption>
<p>The histogram of Radscore for each patient in the training cohort <bold>(A)</bold> and validation cohort <bold>(B)</bold>. The red bars showed the Radscore values for the short OS patients, and the blue bars showed the values for the long OS patients. Patients with long OS showed higher Radscores than patients with short OS in both the training and validation cohorts.</p>
</caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fonc-12-758622-g003.tif"/>
</fig>
</sec>
<sec id="s3_3">
<title>Radiomics Nomogram Establishment and Evaluation</title>
<p>To establish the radiomics nomogram, the logistic regression based on Radscore, clinical features, and conventional imaging features was applied to find independent predictors of OS stratification by univariate and multivariable logistic regression. The results of logistic regression are presented in <xref ref-type="table" rid="T4"><bold>Table&#xa0;4</bold></xref>, which demonstrated that only Radscore was the significant independent predictor for OS stratification.</p>
<table-wrap id="T4" position="float">
<label>Table&#xa0;4</label>
<caption>
<p>The results of logistic regression.</p>
</caption>
<table frame="hsides">
<thead>
<tr>
<th valign="top" rowspan="2" align="left">Variable</th>
<th valign="top" colspan="2" align="center">Univariate logistic regression</th>
<th valign="top" colspan="2" align="center">Multivariable logistic regression</th>
</tr>
<tr>
<th valign="top" align="center">OR (95% CI)</th>
<th valign="top" align="center">p-value</th>
<th valign="top" align="center">OR (95% CI)</th>
<th valign="top" align="center">p-value</th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Age</td>
<td valign="top" align="center">0.972 (0.930&#x2013;1.010)</td>
<td valign="top" align="center">0.164</td>
<td valign="top" align="center">NA</td>
<td valign="top" align="center">NA</td>
</tr>
<tr>
<td valign="top" align="left">Gender</td>
<td valign="top" align="center">1.293 (0.528&#x2013;3.167)</td>
<td valign="top" align="center">0.571</td>
<td valign="top" align="center">NA</td>
<td valign="top" align="center">NA</td>
</tr>
<tr>
<td valign="top" align="left">pEPI</td>
<td valign="top" align="center">1.333 (0.439&#x2013;4.585)</td>
<td valign="top" align="center">0.625</td>
<td valign="top" align="center">NA</td>
<td valign="top" align="center">NA</td>
</tr>
<tr>
<td valign="top" align="left">pKPS</td>
<td valign="top" align="center">0.991 (0.960&#x2013;1.020)</td>
<td valign="top" align="center">0.545</td>
<td valign="top" align="center">NA</td>
<td valign="top" align="center">NA</td>
</tr>
<tr>
<td valign="top" align="left">Frontal</td>
<td valign="top" align="center">0.486 (0.193&#x2013;1.213)</td>
<td valign="top" align="center">0.122</td>
<td valign="top" align="center">NA</td>
<td valign="top" align="center">NA</td>
</tr>
<tr>
<td valign="top" align="left">Temporal</td>
<td valign="top" align="center">1.396 (0.518&#x2013;4.067)</td>
<td valign="top" align="center">0.521</td>
<td valign="top" align="center">NA</td>
<td valign="top" align="center">NA</td>
</tr>
<tr>
<td valign="top" align="left">Parietal</td>
<td valign="top" align="center">6.935 (1.249&#x2013;130.091)</td>
<td valign="top" align="center">0.070</td>
<td valign="top" align="center">NA</td>
<td valign="top" align="center">NA</td>
</tr>
<tr>
<td valign="top" align="left">Occipital</td>
<td valign="top" align="center">0.327 (0.041&#x2013;2.085)</td>
<td valign="top" align="center">0.236</td>
<td valign="top" align="center">NA</td>
<td valign="top" align="center">NA</td>
</tr>
<tr>
<td valign="top" align="left">Insular</td>
<td valign="top" align="center">0.588 (0.162&#x2013;2.216)</td>
<td valign="top" align="center">0.416</td>
<td valign="top" align="center">NA</td>
<td valign="top" align="center">NA</td>
</tr>
<tr>
<td valign="top" align="left">Corpus callosum</td>
<td valign="top" align="center">0.452 (0.012&#x2013;3.245)</td>
<td valign="top" align="center">0.980</td>
<td valign="top" align="center">NA</td>
<td valign="top" align="center">NA</td>
</tr>
<tr>
<td valign="top" align="left">Left</td>
<td valign="top" align="center">1.120 (0.458&#x2013;2.729)</td>
<td valign="top" align="center">0.802</td>
<td valign="top" align="center">NA</td>
<td valign="top" align="center">NA</td>
</tr>
<tr>
<td valign="top" align="left">Right</td>
<td valign="top" align="center">0.763 (0.309&#x2013;1.893)</td>
<td valign="top" align="center">0.556</td>
<td valign="top" align="center">NA</td>
<td valign="top" align="center">NA</td>
</tr>
<tr>
<td valign="top" align="left">Bilateral</td>
<td valign="top" align="center">2.189 (0.306&#x2013;43.891)</td>
<td valign="top" align="center">0.493</td>
<td valign="top" align="center">NA</td>
<td valign="top" align="center">NA</td>
</tr>
<tr>
<td valign="top" align="left">Radscore</td>
<td valign="top" align="center">5941.499 (239.983&#x2013;336406.47)</td>
<td valign="top" align="center">&lt;0.001</td>
<td valign="top" align="center">5941.499 (239.983&#x2013;336406.47)</td>
<td valign="top" align="center">&lt;0.001</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn>
<p>OR, odd ratio; CI, confidence interval; NA, not applicable.</p>
</fn>
</table-wrap-foot>
</table-wrap>
<p>Then, the radiomics nomogram was constructed according to the multivariable logistic regression <bold>(</bold>
<xref ref-type="fig" rid="f4"><bold>Figure&#xa0;4</bold></xref><bold>)</bold>. The ROC curve, which was based on the probability of long OS according to the Radscore, was used to evaluate the sensitivity and specificity of the nomogram. The AUCs of the nomogram were 0.877 and 0.919 in the training and validation cohorts, respectively, which indicated favorable sensitivity and specificity <bold>(</bold>
<xref ref-type="fig" rid="f5"><bold>Figure&#xa0;5</bold></xref><bold>)</bold>. The calibration curve of the proposed nomogram based on the training cohort was constructed, and a favorable calibration was confirmed in the validation cohort <bold>(</bold>
<xref ref-type="fig" rid="f6"><bold>Figure&#xa0;6</bold></xref><bold>)</bold>. Moreover, the result of DCA showed that the nomogram to stratify the OS of GBM patients could yield clinical net benefits <bold>(</bold>
<xref ref-type="fig" rid="f7"><bold>Figure&#xa0;7</bold></xref><bold>)</bold>.</p>
<fig id="f4" position="float">
<label>Figure&#xa0;4</label>
<caption>
<p>The radiomics nomogram for OS stratification of GBM patients.</p>
</caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fonc-12-758622-g004.tif"/>
</fig>
<fig id="f5" position="float">
<label>Figure&#xa0;5</label>
<caption>
<p>The AUCs of the radiomics nomogram for the training cohort <bold>(A)</bold> and validation cohort <bold>(B)</bold>. The results demonstrated that the radiomics nomogram performed well in both groups with favorable sensitivity and specificity.</p>
</caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fonc-12-758622-g005.tif"/>
</fig>
<fig id="f6" position="float">
<label>Figure&#xa0;6</label>
<caption>
<p>The calibration curves of the radiomics nomogram for the training cohort <bold>(A)</bold> and validation cohort <bold>(B)</bold>. It showed the agreement between observed probabilities and the nomogram-estimated probabilities.</p>
</caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fonc-12-758622-g006.tif"/>
</fig>
<fig id="f7" position="float">
<label>Figure&#xa0;7</label>
<caption>
<p>The DCA for the developed radiomics nomogram. The y-axis represents the net benefit. The x-axis represents the threshold probability. The black line at the bottom named &#x201c;None&#x201d; represented the hypothesis that no patients had long OS, which meant the net benefit would be zero if all patients did not have the long OS. The gray line named &#x201c;All&#x201d; represents the hypothesis that all patients had long OS. The red line represents the net benefit of the radiomics nomogram at different threshold probabilities. The result indicated the radiomics nomogram to stratify the OS of GBM patients could yield clinical net benefits.</p>
</caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fonc-12-758622-g007.tif"/>
</fig>
</sec>
</sec>
<sec id="s4" sec-type="discussion">
<title>Discussion</title>
<p>A total of 125 newly diagnosed GBM patients with standard treatment were included in this study, and the objective was to develop and validate a preoperative prediction model for OS stratification. Only one independent predictive factor was found to be associated with OS stratification. The Radscore factor was adopted in a clinically relevant nomogram model that can predict the probabilities of OS stratification for the GBM patients. The radiomics nomogram demonstrated that a patient was more likely to have long OS if he had a higher Radscore before operation and would receive standard treatment. This may help neurosurgeons with preoperative planning and allow for better education for these patients or those family members who were extremely concerned about the postoperative survival or hesitated to continue the treatment for various reasons before the operation.</p>
<p>The nomogram, as a tool of prediction, integrates a variety of independent predictive factors and visualizes the overall impact of these factors on survival in each patient to help clinicians develop intervention plans (<xref ref-type="bibr" rid="B17">17</xref>). Owing to its convenience and accuracy, the nomogram has been used in many tumors, such as pancreatic ductal adenocarcinomas, colorectal cancer, pituitary adenomas, and gastric cancer (<xref ref-type="bibr" rid="B11">11</xref>&#x2013;<xref ref-type="bibr" rid="B13">13</xref>, <xref ref-type="bibr" rid="B18">18</xref>). Moreover, radiomics, as a new study method, extracts, processes, and analyzes the quantitative and high-throughput data from medical imaging to explore their relationships with valuable information. When combined with radiomics features and traditional clinical features to construct a nomogram, the radiomics features showed stronger robustness, which had been confirmed by some studies (<xref ref-type="bibr" rid="B9">9</xref>, <xref ref-type="bibr" rid="B19">19</xref>).</p>
<p>At present, there have been some studies that make efforts to predict the OS of GBM. These studies have selected some independent clinical risk factors related to OS, such as age at diagnosis, gender, KPS, MGMT, IDH, radiotherapy, chemotherapy, and radiotherapy combined with chemotherapy (<xref ref-type="bibr" rid="B8">8</xref>, <xref ref-type="bibr" rid="B20">20</xref>, <xref ref-type="bibr" rid="B21">21</xref>). In our research, the study population was newly diagnosed GBM patients who had undergone standard treatment, so no treatment factors were included. The factors included in our study were clinical features and conventional imaging features, and the postoperation-related factors were excluded including completeness of resection, pathological features, and treatment, for the study stage was defined as preoperation. Ultimately, according to the logistic regression, none of these clinical factors and conventional imaging features was selected as an independent risk factor. This result was different from the results of these studies (<xref ref-type="bibr" rid="B8">8</xref>, <xref ref-type="bibr" rid="B20">20</xref>, <xref ref-type="bibr" rid="B21">21</xref>). For this difference, we think it was because of strict treatment and imaging standards. On the other hand, it also indicated that patients who chose standard treatment after surgery were relatively concentrated in this study.</p>
<p>Recently, several studies about the nomogram for predicting survival of GBM based on radiomics were published. Zhang et&#xa0;al. (<xref ref-type="bibr" rid="B9">9</xref>) developed a radiomics nomogram, which showed excellent performance with 0.974 of the concordance index (C-index) in survival stratification. The C-index represents the AUC of ROC that plots sensitivity against 1-specificity of the radiomics nomogram (<xref ref-type="bibr" rid="B15">15</xref>). A total of 4,000 radiomics features were extracted from multiple regions of the GBM using multiparametric MRI, and 25 selected features were used for constructing the Radscore. Among these features, the T1C and T2F sequence of GBM contributed more than other MRI sequences. Xu et&#xa0;al. (<xref ref-type="bibr" rid="B22">22</xref>) reported a radiomics nomogram integrated with Radscore, ependymal, and pia mater involvement and age at diagnosis to stratify the survival of GBM patients, and the ROC reached up to 0.858. In this study, the data from Brain Tumor Segmentation Challenge 2018 were divided into training and test sets to build the model, and the data from the local medical center were used to validate the model. In our study, we first analyzed the extracted radiomics features with three machine learning algorithms to determine the ability of these OS status-related radiomics features to discriminate the OS stratification. The results showed that the three classifiers were all excellent, and the SVM performance was best among them (the AUCs of 0.97 and 0.75 in the training and validation cohorts), which illustrated the favorable ability for these features to stratify the OS of GBM patients. Similarly to the published researches, the nomogram only including Radscore represented the favorable ability to predict the long OS patients with 0.919 of the AUC in the validation set and these features from the T1C sequence had a greater impact on OS stratification, although we merely cared about preoperative features to stratify the OS of GBM patients.</p>
<p>However, our study still has some limitations. Firstly, this was not a multicenter study, although we had independently validated the model. More datasets from multimedical centers are needed to independently validate the robustness and repeatability of the radiomics nomogram. Second, although with high efficiency and sparsity, the combination method of the t-test and LASSO regression may be less stable when a large number of features were involved in the model. Other feature selection methods should be investigated in future work. Finally, these MRI images come from different imaging scanners and models, which may cause heterogeneity bias. In order to avoid this situation, all MRI images involved in the study were normalized and resampled before feature extraction. The same scanner and model are expected for MRI images in future researches for the convenience of image processing.</p>
<p>In conclusion, to help neurosurgeons make better preoperative planning and patient education, our research developed and validated a radiomics nomogram based on multiparameter MRI imaging. The presented radiomics nomogram, as a noninvasive tool, achieved satisfactory preoperative prediction of the individualized survival stratification of GBM patients.</p>
</sec>
<sec id="s5" sec-type="data-availability">
<title>Data Availability Statement</title>
<p>The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.</p>
</sec>
<sec id="s6" sec-type="ethics-statement">
<title>Ethics Statement</title>
<p>The studies involving human participants were reviewed and approved by the Ethics Committee of the First Affiliated Hospital of Zhengzhou University. Written informed consent for participation was not required for this study in accordance with the national legislation and the institutional requirements.</p>
</sec>
<sec id="s7" sec-type="author-contributions">
<title>Author Contributions</title>
<p>XJ and XW designed the study. XJ, DS, YW, and SW collected the clinical and radiomics data. XJ and FY preprocessed patients&#x2019; MR imaging and drew the ROI. XJ, DS, and YZ analyzed the data and developed the prediction model. XJ wrote the manuscript. All authors contributed to the article and approved the submitted version.</p>
</sec>
<sec id="s8" sec-type="COI-statement">
<title>Conflict of Interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec id="s9" sec-type="disclaimer">
<title>Publisher&#x2019;s Note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
</body>
<back>
<sec id="s10" sec-type="supplementary-material">
<title>Supplementary Material</title>
<p>The Supplementary Material for this article can be found online at: <ext-link ext-link-type="uri" xlink:href="https://www.frontiersin.org/articles/10.3389/fonc.2022.758622/full#supplementary-material">https://www.frontiersin.org/articles/10.3389/fonc.2022.758622/full#supplementary-material</ext-link>
</p>
<supplementary-material xlink:href="DataSheet_1.docx" id="SM1" mimetype="application/vnd.openxmlformats-officedocument.wordprocessingml.document"/>
</sec>
<ref-list>
<title>References</title>
<ref id="B1">
<label>1</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Ostrom</surname> <given-names>QT</given-names>
</name>
<name>
<surname>Gittleman</surname> <given-names>H</given-names>
</name>
<name>
<surname>Truitt</surname> <given-names>G</given-names>
</name>
<name>
<surname>Boscia</surname> <given-names>A</given-names>
</name>
<name>
<surname>Kruchko</surname> <given-names>C</given-names>
</name>
<name>
<surname>Barnholtz-Sloan</surname> <given-names>JS</given-names>
</name>
</person-group>. <article-title>CBTRUS Statistical Report: Primary Brain and Other Central Nervous System Tumors Diagnosed in the United States in 2011-2015</article-title>. <source>Neuro Oncol</source> (<year>2018</year>) <volume>20</volume>:<fpage>iv1</fpage>&#x2013;<lpage>iv86</lpage>. doi:&#xa0;<pub-id pub-id-type="doi">10.1093/neuonc/noy131</pub-id>
</citation>
</ref>
<ref id="B2">
<label>2</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Stupp</surname> <given-names>R</given-names>
</name>
<name>
<surname>Mason</surname> <given-names>WP</given-names>
</name>
<name>
<surname>van den Bent</surname> <given-names>MJ</given-names>
</name>
<name>
<surname>Weller</surname> <given-names>M</given-names>
</name>
<name>
<surname>Fisher</surname> <given-names>B</given-names>
</name>
<name>
<surname>Taphoorn</surname> <given-names>MJ</given-names>
</name>
<etal/>
</person-group>. <article-title>Radiotherapy Plus Concomitant and Adjuvant Temozolomide for Glioblastoma</article-title>. <source>N Engl J Med</source> (<year>2005</year>) <volume>352</volume>:<page-range>987&#x2013;96</page-range>. doi:&#xa0;<pub-id pub-id-type="doi">10.1056/NEJMoa043330</pub-id>
</citation>
</ref>
<ref id="B3">
<label>3</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Stupp</surname> <given-names>R</given-names>
</name>
<name>
<surname>Hegi</surname> <given-names>ME</given-names>
</name>
<name>
<surname>Mason</surname> <given-names>WP</given-names>
</name>
<name>
<surname>van den Bent</surname> <given-names>MJ</given-names>
</name>
<name>
<surname>Taphoorn</surname> <given-names>MJ</given-names>
</name>
<name>
<surname>Janzer</surname> <given-names>RC</given-names>
</name>
<etal/>
</person-group>. <article-title>Effects of Radiotherapy With Concomitant and Adjuvant Temozolomide Versus Radiotherapy Alone on Survival in Glioblastoma in a Randomised Phase III Study: 5-Year Analysis of the EORTC-NCIC Trial</article-title>. <source>Lancet Oncol</source> (<year>2009</year>) <volume>10</volume>:<page-range>459&#x2013;66</page-range>. doi:&#xa0;<pub-id pub-id-type="doi">10.1016/s1470-2045(09)70025-7</pub-id>
</citation>
</ref>
<ref id="B4">
<label>4</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Van Meir</surname> <given-names>EG</given-names>
</name>
<name>
<surname>Hadjipanayis</surname> <given-names>CG</given-names>
</name>
<name>
<surname>Norden</surname> <given-names>AD</given-names>
</name>
<name>
<surname>Shu</surname> <given-names>HK</given-names>
</name>
<name>
<surname>Wen</surname> <given-names>PY</given-names>
</name>
<name>
<surname>Olson</surname> <given-names>JJ</given-names>
</name>
</person-group>. <article-title>Exciting New Advances in Neuro-Oncology: The Avenue to a Cure for Malignant Glioma</article-title>. <source>CA: Cancer J Clin</source> (<year>2010</year>) <volume>60</volume>:<page-range>166&#x2013;93</page-range>. doi:&#xa0;<pub-id pub-id-type="doi">10.3322/caac.20069</pub-id>
</citation>
</ref>
<ref id="B5">
<label>5</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Hanif</surname> <given-names>F</given-names>
</name>
<name>
<surname>Muzaffar</surname> <given-names>K</given-names>
</name>
<name>
<surname>Perveen</surname> <given-names>K</given-names>
</name>
<name>
<surname>Malhi</surname> <given-names>SM</given-names>
</name>
<name>
<surname>Simjee Sh</surname> <given-names>U</given-names>
</name>
</person-group>. <article-title>Glioblastoma Multiforme: A Review of Its Epidemiology and Pathogenesis Through Clinical Presentation and Treatment</article-title>. <source>Asian Pac J Cancer Prevention: APJCP</source> (<year>2017</year>) <volume>18</volume>:<fpage>3</fpage>&#x2013;<lpage>9</lpage>. doi:&#xa0;<pub-id pub-id-type="doi">10.22034/apjcp.2017.18.1.3</pub-id>
</citation>
</ref>
<ref id="B6">
<label>6</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Li</surname> <given-names>H</given-names>
</name>
<name>
<surname>He</surname> <given-names>Y</given-names>
</name>
<name>
<surname>Huang</surname> <given-names>L</given-names>
</name>
<name>
<surname>Luo</surname> <given-names>H</given-names>
</name>
<name>
<surname>Zhu</surname> <given-names>X</given-names>
</name>
</person-group>. <article-title>The Nomogram Model Predicting Overall Survival and Guiding Clinical Decision in Patients With Glioblastoma Based on the SEER Database</article-title>. <source>Front Oncol</source> (<year>2020</year>) <volume>10</volume>:<elocation-id>1051</elocation-id>. doi:&#xa0;<pub-id pub-id-type="doi">10.3389/fonc.2020.01051</pub-id>
</citation>
</ref>
<ref id="B7">
<label>7</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Gittleman</surname> <given-names>H</given-names>
</name>
<name>
<surname>Lim</surname> <given-names>D</given-names>
</name>
<name>
<surname>Kattan</surname> <given-names>MW</given-names>
</name>
<name>
<surname>Chakravarti</surname> <given-names>A</given-names>
</name>
<name>
<surname>Gilbert</surname> <given-names>MR</given-names>
</name>
<name>
<surname>Lassman</surname> <given-names>AB</given-names>
</name>
<etal/>
</person-group>. <article-title>An Independently Validated Nomogram for Individualized Estimation of Survival Among Patients With Newly Diagnosed Glioblastoma: NRG Oncology RTOG 0525 and 0825</article-title>. <source>Neuro Oncol</source> (<year>2017</year>) <volume>19</volume>:<page-range>669&#x2013;77</page-range>. doi:&#xa0;<pub-id pub-id-type="doi">10.1093/neuonc/now208</pub-id>
</citation>
</ref>
<ref id="B8">
<label>8</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Cheng</surname> <given-names>W</given-names>
</name>
<name>
<surname>Zhang</surname> <given-names>C</given-names>
</name>
<name>
<surname>Ren</surname> <given-names>X</given-names>
</name>
<name>
<surname>Wang</surname> <given-names>Z</given-names>
</name>
<name>
<surname>Liu</surname> <given-names>X</given-names>
</name>
<name>
<surname>Han</surname> <given-names>S</given-names>
</name>
<etal/>
</person-group>. <article-title>Treatment Strategy and IDH Status Improve Nomogram Validity in Newly Diagnosed GBM Patients</article-title>. <source>Neuro Oncol</source> (<year>2017</year>) <volume>19</volume>:<page-range>736&#x2013;38</page-range>. doi:&#xa0;<pub-id pub-id-type="doi">10.1093/neuonc/nox012</pub-id>
</citation>
</ref>
<ref id="B9">
<label>9</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Zhang</surname> <given-names>X</given-names>
</name>
<name>
<surname>Lu</surname> <given-names>H</given-names>
</name>
<name>
<surname>Tian</surname> <given-names>Q</given-names>
</name>
<name>
<surname>Feng</surname> <given-names>N</given-names>
</name>
<name>
<surname>Yin</surname> <given-names>L</given-names>
</name>
<name>
<surname>Xu</surname> <given-names>X</given-names>
</name>
<etal/>
</person-group>. <article-title>A Radiomics Nomogram Based on Multiparametric MRI Might Stratify Glioblastoma Patients According to Survival</article-title>. <source>Eur Radiol</source> (<year>2019</year>) <volume>29</volume>:<page-range>5528&#x2013;38</page-range>. doi:&#xa0;<pub-id pub-id-type="doi">10.1007/s00330-019-06069-z</pub-id>
</citation>
</ref>
<ref id="B10">
<label>10</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Yang</surname> <given-names>Y</given-names>
</name>
<name>
<surname>Han</surname> <given-names>Y</given-names>
</name>
<name>
<surname>Hu</surname> <given-names>X</given-names>
</name>
<name>
<surname>Wang</surname> <given-names>W</given-names>
</name>
<name>
<surname>Cui</surname> <given-names>G</given-names>
</name>
<name>
<surname>Guo</surname> <given-names>L</given-names>
</name>
<etal/>
</person-group>. <article-title>An Improvement of Survival Stratification in Glioblastoma Patients <italic>via</italic> Combining Subregional Radiomics Signatures</article-title>. <source>Front Neurosci</source> (<year>2021</year>) <volume>15</volume>:<elocation-id>683452</elocation-id>. doi:&#xa0;<pub-id pub-id-type="doi">10.3389/fnins.2021.683452</pub-id>
</citation>
</ref>
<ref id="B11">
<label>11</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Yang</surname> <given-names>L</given-names>
</name>
<name>
<surname>Dong</surname> <given-names>D</given-names>
</name>
<name>
<surname>Fang</surname> <given-names>M</given-names>
</name>
<name>
<surname>Zhu</surname> <given-names>Y</given-names>
</name>
<name>
<surname>Zang</surname> <given-names>Y</given-names>
</name>
<name>
<surname>Liu</surname> <given-names>Z</given-names>
</name>
<etal/>
</person-group>. <article-title>Can CT-Based Radiomics Signature Predict KRAS/NRAS/BRAF Mutations in Colorectal Cancer</article-title>? <source>Eur Radiol</source> (<year>2018</year>) <volume>28</volume>:<page-range>2058&#x2013;67</page-range>. doi:&#xa0;<pub-id pub-id-type="doi">10.1007/s00330-017-5146-8</pub-id>
</citation>
</ref>
<ref id="B12">
<label>12</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Xie</surname> <given-names>T</given-names>
</name>
<name>
<surname>Wang</surname> <given-names>X</given-names>
</name>
<name>
<surname>Li</surname> <given-names>M</given-names>
</name>
<name>
<surname>Tong</surname> <given-names>T</given-names>
</name>
<name>
<surname>Yu</surname> <given-names>X</given-names>
</name>
<name>
<surname>Zhou</surname> <given-names>Z</given-names>
</name>
</person-group>. <article-title>Pancreatic Ductal Adenocarcinoma: A Radiomics Nomogram Outperforms Clinical Model and TNM Staging for Survival Estimation After Curative Resection</article-title>. <source>Eur Radiol</source> (<year>2020</year>) <volume>30</volume>:<page-range>2513&#x2013;24</page-range>. doi:&#xa0;<pub-id pub-id-type="doi">10.1007/s00330-019-06600-2</pub-id>
</citation>
</ref>
<ref id="B13">
<label>13</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Zhang</surname> <given-names>Y</given-names>
</name>
<name>
<surname>Shang</surname> <given-names>L</given-names>
</name>
<name>
<surname>Chen</surname> <given-names>C</given-names>
</name>
<name>
<surname>Ma</surname> <given-names>X</given-names>
</name>
<name>
<surname>Ou</surname> <given-names>X</given-names>
</name>
<name>
<surname>Wang</surname> <given-names>J</given-names>
</name>
<etal/>
</person-group>. <article-title>Machine-Learning Classifiers in Discrimination of Lesions Located in the Anterior Skull Base</article-title>. <source>Front Oncol</source> (<year>2020</year>) <volume>10</volume>:<elocation-id>752</elocation-id>. doi:&#xa0;<pub-id pub-id-type="doi">10.3389/fonc.2020.00752</pub-id>
</citation>
</ref>
<ref id="B14">
<label>14</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Koo</surname> <given-names>TK</given-names>
</name>
<name>
<surname>Li</surname> <given-names>MY</given-names>
</name>
</person-group>. <article-title>A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research</article-title>. <source>J Chiropractic Med</source> (<year>2016</year>) <volume>15</volume>:<page-range>155&#x2013;63</page-range>. doi:&#xa0;<pub-id pub-id-type="doi">10.1016/j.jcm.2016.02.012</pub-id>
</citation>
</ref>
<ref id="B15">
<label>15</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Balachandran</surname> <given-names>VP</given-names>
</name>
<name>
<surname>Gonen</surname> <given-names>M</given-names>
</name>
<name>
<surname>Smith</surname> <given-names>JJ</given-names>
</name>
<name>
<surname>DeMatteo</surname> <given-names>RP</given-names>
</name>
</person-group>. <article-title>Nomograms in Oncology: More Than Meets the Eye</article-title>. <source>Lancet Oncol</source> (<year>2015</year>) <volume>16</volume>:<page-range>e173&#x2013;80</page-range>. doi:&#xa0;<pub-id pub-id-type="doi">10.1016/s1470-2045(14)71116-7</pub-id>
</citation>
</ref>
<ref id="B16">
<label>16</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Nguy&#x1ec5;n</surname> <given-names>MV</given-names>
</name>
<name>
<surname>Carlier</surname> <given-names>C</given-names>
</name>
<name>
<surname>Nich</surname> <given-names>C</given-names>
</name>
<name>
<surname>Gouin</surname> <given-names>F</given-names>
</name>
<name>
<surname>Crenn</surname> <given-names>V</given-names>
</name>
</person-group>. <article-title>Fracture Risk of Long Bone Metastases: A Review of Current and New Decision-Making Tools for Prophylactic Surgery</article-title>. <source>Cancers</source> (<year>2021</year>) <volume>13</volume>:<fpage>3662</fpage>. doi:&#xa0;<pub-id pub-id-type="doi">10.3390/cancers13153662</pub-id>
</citation>
</ref>
<ref id="B17">
<label>17</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kattan</surname> <given-names>MW</given-names>
</name>
</person-group>. <article-title>Nomograms. Introduction</article-title>. <source>Semin Urol Oncol</source> (<year>2002</year>) <volume>20</volume>:<fpage>79</fpage>&#x2013;<lpage>81</lpage>.</citation>
</ref>
<ref id="B18">
<label>18</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Zhang</surname> <given-names>W</given-names>
</name>
<name>
<surname>Fang</surname> <given-names>M</given-names>
</name>
<name>
<surname>Dong</surname> <given-names>D</given-names>
</name>
<name>
<surname>Wang</surname> <given-names>X</given-names>
</name>
<name>
<surname>Ke</surname> <given-names>X</given-names>
</name>
<name>
<surname>Zhang</surname> <given-names>L</given-names>
</name>
<etal/>
</person-group>. <article-title>Development and Validation of a CT-Based Radiomic Nomogram for Preoperative Prediction of Early Recurrence in Advanced Gastric Cancer</article-title>. <source>Radiother Oncol: J Eur Soc Ther Radiol Oncol</source> (<year>2020</year>) <volume>145</volume>:<fpage>13</fpage>&#x2013;<lpage>20</lpage>. doi:&#xa0;<pub-id pub-id-type="doi">10.1016/j.radonc.2019.11.023</pub-id>
</citation>
</ref>
<ref id="B19">
<label>19</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Huang</surname> <given-names>YQ</given-names>
</name>
<name>
<surname>Liang</surname> <given-names>CH</given-names>
</name>
<name>
<surname>He</surname> <given-names>L</given-names>
</name>
<name>
<surname>Tian</surname> <given-names>J</given-names>
</name>
<name>
<surname>Liang</surname> <given-names>CS</given-names>
</name>
<name>
<surname>Chen</surname> <given-names>X</given-names>
</name>
<etal/>
</person-group>. <article-title>Development and Validation of a Radiomics Nomogram for Preoperative Prediction of Lymph Node Metastasis in Colorectal Cancer</article-title>. <source>J Clin Oncol: Off J Am Soc Clin Oncol</source> (<year>2016</year>) <volume>34</volume>:<page-range>2157&#x2013;64</page-range>. doi:&#xa0;<pub-id pub-id-type="doi">10.1200/jco.2015.65.9128</pub-id>
</citation>
</ref>
<ref id="B20">
<label>20</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Gately</surname> <given-names>L</given-names>
</name>
<name>
<surname>McLachlan</surname> <given-names>SA</given-names>
</name>
<name>
<surname>Philip</surname> <given-names>J</given-names>
</name>
<name>
<surname>Ruben</surname> <given-names>J</given-names>
</name>
<name>
<surname>Dowling</surname> <given-names>A</given-names>
</name>
</person-group>. <article-title>Long-Term Survivors of Glioblastoma: A Closer Look</article-title>. <source>J Neurooncol</source> (<year>2018</year>) <volume>136</volume>:<page-range>155&#x2013;62</page-range>. doi:&#xa0;<pub-id pub-id-type="doi">10.1007/s11060-017-2635-1</pub-id>
</citation>
</ref>
<ref id="B21">
<label>21</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Bartek</surname> <given-names>J</given-names> <suffix>Jr</suffix>
</name>
<name>
<surname>Alattar</surname> <given-names>AA</given-names>
</name>
<name>
<surname>Dhawan</surname> <given-names>S</given-names>
</name>
<name>
<surname>Ma</surname> <given-names>J</given-names>
</name>
<name>
<surname>Koga</surname> <given-names>T</given-names>
</name>
<name>
<surname>Nakaji</surname> <given-names>P</given-names>
</name>
<etal/>
</person-group>. <article-title>Receipt of Brachytherapy Is an Independent Predictor of Survival in Glioblastoma in the Surveillance, Epidemiology, and End Results Database</article-title>. <source>J Neurooncol</source> (<year>2019</year>) <volume>145</volume>:<fpage>75</fpage>&#x2013;<lpage>83</lpage>. doi:&#xa0;<pub-id pub-id-type="doi">10.1007/s11060-019-03268-y</pub-id>
</citation>
</ref>
<ref id="B22">
<label>22</label>
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Xu</surname> <given-names>Y</given-names>
</name>
<name>
<surname>He</surname> <given-names>X</given-names>
</name>
<name>
<surname>Li</surname> <given-names>Y</given-names>
</name>
<name>
<surname>Pang</surname> <given-names>P</given-names>
</name>
<name>
<surname>Shu</surname> <given-names>Z</given-names>
</name>
<name>
<surname>Gong</surname> <given-names>X</given-names>
</name>
</person-group>. <article-title>The Nomogram of MRI-Based Radiomics With Complementary Visual Features by Machine Learning Improves Stratification of Glioblastoma Patients: A Multicenter Study</article-title>. <source>J&#xa0;Magn Reson Imaging: JMRI</source> (<year>2021</year>) <volume>54</volume>:<page-range>571&#x2013;83</page-range>. doi:&#xa0;<pub-id pub-id-type="doi">10.1002/jmri.27536</pub-id>
</citation>
</ref>
</ref-list>
</back>
</article>