<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article article-type="research-article" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xml:lang="EN">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Surg.</journal-id>
<journal-title>Frontiers in Surgery</journal-title><abbrev-journal-title abbrev-type="pubmed">Front. Surg.</abbrev-journal-title>
<issn pub-type="epub">2296-875X</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fsurg.2022.1068321</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Surgery</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Identifying an optimal machine learning model generated circulating biomarker to predict chronic postoperative pain in patients undergoing hepatectomy</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author"><name><surname>Hong</surname><given-names>Ying</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<xref ref-type="author-notes" rid="an1"><sup>&#x2020;</sup></xref><uri xlink:href="https://loop.frontiersin.org/people/1992069/overview"/></contrib>
<contrib contrib-type="author"><name><surname>Li</surname><given-names>Yue</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<xref ref-type="author-notes" rid="an1"><sup>&#x2020;</sup></xref></contrib>
<contrib contrib-type="author"><name><surname>Ye</surname><given-names>Mao</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib>
<contrib contrib-type="author"><name><surname>Yan</surname><given-names>Siyu</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib>
<contrib contrib-type="author"><name><surname>Yang</surname><given-names>Wei</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib>
<contrib contrib-type="author" corresp="yes"><name><surname>Jiang</surname><given-names>Chunling</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<xref ref-type="corresp" rid="cor1">&#x002A;</xref></contrib>
</contrib-group>
<aff id="aff1"><label><sup>1</sup></label><addr-line>Department of Anesthesiology</addr-line>, <institution>West China Hospital, Sichuan University and The Research Units of West China (2018RU012), Chinese Academy of Medical Sciences</institution>, <addr-line>Chengdu</addr-line>, <country>China</country></aff>
<aff id="aff2"><label><sup>2</sup></label><addr-line>Laboratory of Anesthesia and Critical Care Medicine, Department of Anesthesiology, Translational Neuroscience Center</addr-line>, <institution>West China Hospital, Sichuan University</institution>, <addr-line>Chengdu</addr-line>, <country>China</country></aff>
<author-notes>
<fn fn-type="edited-by"><p><bold>Edited by:</bold> Andrew Gumbs, Centre Hospitalier Intercommunal de Poissy, France</p></fn>
<fn fn-type="edited-by"><p><bold>Reviewed by:</bold> Heba Taher, Cairo University, Egypt Luca Milone, Brooklyn Hospital Center, United States</p></fn>
<corresp id="cor1"><label>&#x002A;</label><bold>Correspondence:</bold> Chunling Jiang <email>jiangchunling@scu.edu.cn</email></corresp>
<fn id="an1"><label><sup>&#x2020;</sup></label><p>These authors have contributed equally to this work</p></fn>
<fn fn-type="other" id="fn001"><p><bold>Specialty Section:</bold> This article was submitted to Visceral Surgery, a section of the journal Frontiers in Surgery</p></fn>
</author-notes>
<pub-date pub-type="epub"><day>06</day><month>01</month><year>2023</year></pub-date>
<pub-date pub-type="collection"><year>2022</year></pub-date>
<volume>9</volume><elocation-id>1068321</elocation-id>
<history>
<date date-type="received"><day>12</day><month>10</month><year>2022</year></date>
<date date-type="accepted"><day>09</day><month>11</month><year>2022</year></date>
</history>
<permissions>
<copyright-statement>&#x00A9; 2023 Hong, Li, Ye, Yan, Yang and Jiang.</copyright-statement>
<copyright-year>2023</copyright-year><copyright-holder>Hong, Li, Ye, Yan, Yang and Jiang</copyright-holder><license license-type="open-access" xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the <ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/licenses/by/4.0/">Creative Commons Attribution License (CC BY)</ext-link>. The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract>
<p>Chronic postsurgical pain (CPSP) after hepatectomy is highly prevalent and challenging to treat. Several risk factors have been unmasked for CPSP after hepatectomy, such as acute postoperative pain. The current secondary analysis of a clinical study sought to extend previous research by investigating more clinical variables and inflammatory biomarkers as risk factors for CPSP after hepatectomy and sifting those strongly related to CPSP to build a reliable machine learning model to predict CPSP occurring. Participants included 91 adults undergoing hepatectomy who was followed 3 months postoperatively. Twenty-four hours after surgery, participants completed numerical rating scale (NRS) grading and blood sample collecting. Three months after surgery, participants also reported whether CPSP occurred through follow-up. The Random Forest and Support Vector Machine models were conducted to predict pain outcomes 3 months after surgery. The results showed that the SVM model had better performance in predicting CPSP which consists of acute postoperative pain (evaluated by NRS) and matrix metalloprotease 3 (MMP3) level. What&#x0027;s more, besides traditional cytokines, several novel inflammatory biomarkers like C-X-C motif chemokine ligand 10 (CXCL10) and MMP2 levels were found to be closely related to CPSP and a novel spectrum of inflammatory biomarkers was created. These findings demonstrate that the SVM model consisting of acute postoperative pain and MMP3 level predicts greater chronic pain intensity 3 months after hepatectomy and with this model, intervention administration before CPSP occurs may prevent or minimize CPSP intensity successfully.</p>
</abstract>
<kwd-group>
<kwd>chronic pain</kwd>
<kwd>post-hepatectomy</kwd>
<kwd>machine learning (ML)</kwd>
<kwd>SVM</kwd>
<kwd>prediction model</kwd>
</kwd-group>
<contract-num rid="cn001">320.6750.2022-05-3, 2018</contract-num>
<contract-num rid="cn002">2019HXFH043 2022HXFH036</contract-num>
<contract-sponsor id="cn001">Wu Jieping Medical Foundation<named-content content-type="fundref-id">10.13039/100007452</named-content></contract-sponsor>
<contract-sponsor id="cn002">1.3.5 project for the discipline of excellence</contract-sponsor>
<counts>
<fig-count count="7"/>
<table-count count="0"/><equation-count count="0"/><ref-count count="32"/><page-count count="0"/><word-count count="0"/></counts>
</article-meta>
</front>
<body>
<sec id="s1" sec-type="intro"><title>Introduction</title>
<p>Chronic post-surgery pain after hepatectomy remains a daunting challenge, casting a shadow over the patient&#x0027;s heart. Approximately 40&#x0025; of post-hepatectomy patients suffered from unbearable CPSP (<xref ref-type="bibr" rid="B1">1</xref>), for those after liver transplantation, the incidence of CPSP was surprisingly up to 70.5&#x0025; (<xref ref-type="bibr" rid="B2">2</xref>). Pain itself may not immediately bring threats toward life; people continue to live with their pain. But it strongly disturbs post-operative rehabilitation and post-discharge life. Clinically significant chronic pain often raises diverse mental symptoms, including mood disturbances (28&#x0025;), sleep disturbances (30&#x0025;), and reduced enjoyment of life (30&#x0025;) (<xref ref-type="bibr" rid="B3">3</xref>). It is, therefore, crucial to identify risk factors and models that can predict CPSP and intervene before it occurs.</p>
<p>CPSP is de&#xFB01;ned as pain that persists past normal healing time (<xref ref-type="bibr" rid="B4">4</xref>), usually lasting or recurring longer than 3 months (<xref ref-type="bibr" rid="B5">5</xref>). The mechanisms lying under CPSP might relate to the whole pain progress. It is now well established that locally inflammatory mediators following tissue injury can not only cause pain by binding to their receptors on nociceptive primary sensory neurons (nociceptors) but also directly stimulate and cause sensitization of their nociceptors (<xref ref-type="bibr" rid="B6">6</xref>). Then, enhanced responses of pain circuits in the spinal cord and brain (central sensitization) occurred in the CNS, which takes responsibility for the amplifying signal transmission to the brain and followed alternative in descending pathways (<xref ref-type="bibr" rid="B7">7</xref>). Since the periphery and the CNS sensitization is hardly assessable, the level of mediators in the pathway, that is biomarker&#x0027;s levels, have become a standard indicator for evaluating CPSP occurring due to its easy availability. With reference to other clinical studies, we aim to identify specific biomarkers <italic>via</italic> blood sample to predict the occurrence of CPSP (<xref ref-type="bibr" rid="B8">8</xref>).</p>
<p>Cytokines involve vitally in the interactions and communications between cells; especially, some are essential in the pathologic process of pain development, thus potentiating chronic pain postoperatively. Multiple studies have identified several traditional cytokines as the risk factors for CPSP such as IL-1&#x03B2; (<xref ref-type="bibr" rid="B9">9</xref>) and TNF-&#x03B1; (<xref ref-type="bibr" rid="B10">10</xref>). But with the emergence of new neural-inflammatory pathways, the inflammatory mediators&#x2019; profiles need to be updated. Recently, C-X-C motif chemokine ligand 10 (CXCL10) (<xref ref-type="bibr" rid="B11">11</xref>) levels is found to exacerbates pain in mice. Matrix metalloproteases (MMPs) (<xref ref-type="bibr" rid="B12">12</xref>), dedicating to generate neuroinflammation, are implicated in the development of pain. The above cytokines and enzymes hold promise for forming an <italic>in vivo</italic> biomarkers profile to foreshadow the onset of pain. Some clinical variables, such as acute postoperative pain and body mass index (BMI) are also identified as key factors in CPSP predictive model (<xref ref-type="bibr" rid="B13">13</xref>). However, previous studies have focused only on the cytokines or the clinical variables separately. A model to predict CPSP occurrence by integration of postoperative inflammatory biomarkers and clinical variables had not been developed.</p>
<p>This is a secondary analysis on follow-up data from a prospective clinical trial, which aim to explore additional options to alleviate MEP after hepatectomy (<xref ref-type="bibr" rid="B14">14</xref>). In this study, we hypothesize that novel inflammatory biomarkers play a key role in CPSP development and when combined with clinical variables can predict the onset of CPSP. Specifically, this study aims to explore such a predictive model for CPSP and the clinical utility of machine learning algorithm for modeling. We choose Support Vector Machine (SVM) and random forest due to their different properties.</p>
</sec>
<sec id="s2" sec-type="methods"><title>Methods</title>
<sec id="s2a"><title>Participants</title>
<p>In this study (NCT04295330), we performed a secondary analysis on the prospective clinical trials (NCT05492669) in Medical Center: West China Hospital (Sichuan, China) (<xref ref-type="bibr" rid="B14">14</xref>) and screened 130 patients suffering from primary liver cancer who underwent elective hepatectomy from 2019 to 2021. Study eligibility included those undergoing elective hepatectomy for primary liver cancer, aged 18&#x2013;80 years, American Society of Anesthesiologists (ASA) physical status I&#x2013;III; with follow-up assessment for NRS. All clinical data, including grading of NRS and clinical and physiological parameters were prospectively collected. We excluded patients without follow-up and those body weight &#x003C;40 or &#x003E;100&#x2005;kg; metastases occurring in other distant organs; severe hepatic insufficiency (aspartate aminotransferase or alanine transaminase or bilirubin &#x003E;2.5 times the upper limit of normal), renal impairment (creatinine clearance &#x003C;60&#x2005;ml/min); cardiac rhythm disorders or systolic heart failure (second-and third-degree heart block, ejection fraction &#x003C;50&#x0025;); with allergies to any of the trial drugs; chronic opioid use; inability to comprehend numeric rating scale.</p>
</sec>
<sec id="s2b"><title>General anesthesia and perioperative procedure</title>
<p>Anesthesia procedures were performed in accordance with standardized criteria. For premedication, patients received 50&#x2005;mg flurbiprofen axetil by intravenous infusion 30&#x2005;min before the surgery initiation. Intravenous access to the upper limb was performed and standard monitoring was performed, including electrocardiography, pulse oximetry, blood pressure, and the bispectral index (BIS). Then anesthesia was induced by propofol 1.5&#x2013;2&#x2005;mg/kg, midazolam 2&#x2005;mg and sufentanil 0.2&#x2013;0.3&#x2005;&#x03BC;g/kg. Tracheal intubation was facilitated with cis-atracurium 0.2&#x2005;mg/kg. Whole anesthesia progress was maintained with remifentanil 0.1&#x2013;0.2&#x2005;&#x03BC;g/kg/min and desflurane or sevoflurane in a mixture of air 40&#x0025; and O<sub>2</sub> 60&#x0025; to maintain BIS within 40&#x2013;60. Systolic arterial blood pressure was maintained within 20&#x0025; of baseline values; when hypotension (MAP &#x003C;55&#x2005;mmHg) occurred, patients were treated with intravenous phenylephrine. The incision was infiltrated with 0.25&#x0025; ropivacaine 20&#x2005;ml at the end of the procedure. Following the completion of the surgical procedure, the patients were extubated in the operating room and admitted to the post-anesthesia care unit (PACU).</p>
<p>Observations of pain were conducted every 10&#x2005;min using the numerical rating scale (NRS), and those who scored higher were treated with sufentanil 0.1&#x2005;&#x00B5;g/kg every 10&#x2005;min. Aldrete scores were recorded prior to leaving the PACU. It was only possible to discharge patients from the PACU if the Aldrete score was at least 9 and there was no evidence of pain or PONV (<xref ref-type="bibr" rid="B15">15</xref>).</p>
<p>Patients received intravenous analgesia with PCIA for the first 72&#x2005;h post-operatively. In case pain occurs, patient may press the PCIA button repeatedly until feeling relief. Mephedrone 5&#x2005;mg would be administered if the NRS score of the participant was &#x003E;3 after taking the maximum dose (10&#x2005;ml/h).</p>
</sec>
<sec id="s2c"><title>NRS and ID pain grading</title>
<p>The day before the operation, all patients received an explanation of how to rate pain intensity on NRS, identifying 0 as &#x201C;no pain&#x201D; and 10 as &#x201C;worst imaginable pain&#x201D;. In the final assessment of NRS grade, face-to-face follow-ups were conducted 1 day after surgery and telephone follow-ups were conducted 3 months after surgery. Acute postoperative pain is defined as the pain that occurs during movement (e.g., deep breathing) at postoperative 24&#x2005;h, and CPSP as the pain that occurs at 3 months after surgery.</p>
<p>In the above 3-months follow-ups, the patients suffering from CPSP also received an explanation of ID pain (<xref ref-type="bibr" rid="B16">16</xref>). The items included the following: (1) &#x201C;Did the pain feel like pins and needles?&#x201D; (2) &#x201C;Did the pain feel hot/burning?&#x201D; (3) &#x201C;Did the pain feel numb?&#x201D; (4) &#x201C;Did the pain feel like electrical shocks?&#x201D; (5) &#x201C;Is the pain made worse with the touch of clothing or bed sheets?&#x201D; and (6) &#x201C;Is the pain limited to your joints?&#x201D; &#x201C;Yes&#x201D; answers to Questions 1&#x2013;5 were scored as 1, whereas a &#x201C;yes&#x201D; answer to Question 6 was scored as &#x2212;1. Higher scores suggested a neuropathic component to the pain.</p>
</sec>
<sec id="s2d"><title>Plasma biomarkers</title>
<p>Blood samples are collected at 24&#x2005;h after surgery for subsequent measurement, which are labelled, centrifuged, frozen, and stored locally at &#x2212;80&#x00B0; in line with experimental standards. Levels of 8 plasma biomarkers including VEGF, IL-1&#x03B2;, IL-6, CXCL10, TNF-&#x03B1;, MMP2, MMP3 and MMP9 are measured using Human Premixed Multi-Analyte Kit (R&#x0026;D, Cat: LXSAHM-15, Lot: L141228).</p>
</sec>
<sec id="s2e"><title>Variable selection using random forest</title>
<p>Permuted importance approach in random forest was applied for elimination of some variables that were not predictive for CPSP to improve model accuracy. Permuted importance for a particular variable was calculated by comparing the difference in the prediction accuracy of the out-of-bag data to the prediction accuracy when the variable was noised up by randomly permuting its values. The higher the predictive power variable obtained, the larger importance value it earned. Variables were ranked from high to low according to their permuted importance score and those with the highest scores were selected. Variable selection of this study was performed using R, version 3.6.1.</p>
</sec>
<sec id="s2f"><title>CPSP predicting methods</title>
<p>Through the building and cross-validating of predictive models to classify CPSP risk, multiple machine learning algorithms to identify important biomarkers and clinical variables can be employed. After comparison, Support Vector Machines (SVM) and Random Forest were selected. Model building were performed using R, version 3.6.1.</p>
<sec id="s2f1"><title>SVM</title>
<p>The SVM algorithm was selected considering the limitations of small sample sizes and imbalanced dataset. For SVM model building, limited by the sample size, only 2 features were allowed to avoid over-fitting. The tuning hyperparameters of the SVM included the following: radial, cost, gamma. The SVM classifiers with final features and hyperparameters were trained and tested in Set 1 by 10-times cross-validation (CV) algorithm. SVM models with different sets of features and sets of hyperparameters were compared by AUC; finally, the one with the highest value was selected as the final SVM classifier. In the process of constructing the SVM model, we set radical as kernel, cost as 20 and gamma as 0.01 by the result of automatic parameter tuning. The generalized performances of this final predicting classifier were validated in Set 2, including accuracy, sensitivity, specificity receiver operative curves (ROCs), and its corresponding AUC.</p>
</sec>
<sec id="s2f2"><title>Random forest</title>
<p>Random forest was selected for its excellent performance on handling an imbalanced dataset containing multiple types of data. Multiple decision trees were built based on bootstrap sampling of the Set 1 by 10-times cross-validation (CV) algorithm. It could give a prediction whether a patient would develop CPSP by providing a probability, and the probability was determined by the ratio of the decision trees that gave positive results to the total number of decision trees. In the process of constructing the RF model, we set ntrees as 280 and mtry as 3 by the result of manual parameter tuning, considering the predictive performance of the RF model and AUC. The generalized performances of this final predicting classifier were also validated in Set 2 as previously mentioned.</p>
</sec>
</sec>
</sec>
<sec id="s3" sec-type="results"><title>Results</title>
<sec id="s3a"><title>Recruitment</title>
<p>Participants were selected from a clinical trial recruiting between June 2019 and June 2021. Participant flow through the study was shown in <xref ref-type="fig" rid="F1">Figure&#x00A0;1</xref>. After the initial screening, 130 patients were deemed eligible to participate in the study. Participants with missing data were removed. Of these, 91 (70.0&#x0025;) patients completed the blood sample collected and follow-up at 3 months, while radiological examinations were performed to exclude recurrence of the primary tumor, distant metastases from the primary tumor, and new tumors. Thus, this report presents results of 91 participants who were included in the final analysis.</p>
<fig id="F1" position="float"><label>Figure 1</label>
<caption><p>Study flow chart.</p></caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="fsurg-09-1068321-g001.tif"/>
</fig>
</sec>
<sec id="s3b"><title>Participant characteristics</title>
<p>91 individuals undergoing hepatectomy were included in the analyses. 70 (77.0&#x0025;) were male; 21 (23.0&#x0025;) were female. The mean&#x2009;&#x00B1;&#x2009;SD. age of all participants was 54.1&#x2009;&#x00B1;&#x2009;11.0 years (range 27&#x2013;78 years). The average duration of surgery was 3.2&#x2009;&#x00B1;&#x2009;1.2&#x2005;h, and the average duration of anesthesia was 4.4&#x2009;&#x00B1;&#x2009;1.2&#x2005;h. The average volume of bleeding was 289.8&#x2005;ml, which varying from 10 to 1,200&#x2005;ml. Open hepatectomy was performed in 76 patients (83.51&#x0025;), while laparoscopic hepatectomy was performed in 15 patients (16.49&#x0025;). Of these, the incision length varied from 23 to 30&#x2005;cm for open procedures, with an average of 26.82&#x2005;cm.</p>
<p>All participants reported having acute postoperative pain. Of these, 33 (36.2&#x0025;) reported mild pain (NRS 1&#x2013;3), 46 (50.6&#x0025;) reported moderate pain (NRS 4&#x2013;6), and 12 (13.2&#x0025;) reported severe pain (NRS&#x2009;&#x003E;&#x2009;6).</p>
<p>There were 49 (53.8&#x0025;) participants who reported no pain 3 months after surgery, 40 (44.0&#x0025;) participants who reported mild pain, and 2 (2.2&#x0025;) participants who reported moderate pain. Pain distribution and characteristics were shown in <xref ref-type="fig" rid="F2">Figures&#x00A0;2A,B</xref>.</p>
<fig id="F2" position="float"><label>Figure 2</label>
<caption><p>NRS (<bold>A</bold>), pain characteristics (<bold>B</bold>) and ID pain (<bold>C</bold>) at 3 months postoperatively.</p></caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="fsurg-09-1068321-g002.tif"/>
</fig>
<p>More recently, the six-item ID Pain was developed as a brief, self-administered screening tool for detecting neuropathic pain in primary care settings (<xref ref-type="bibr" rid="B16">16</xref>). Among those who reported CPSP, 12 scored 0 (28.6&#x0025;), indicating they were less likely to be neuropathic; while 22 scored 1 (52.3&#x0025;) and 8 scored 2 (19.1&#x0025;), indicating that most patients suffer from CPSP associated with neuropathic pain. The results of the ID pain distribution were shown in <xref ref-type="fig" rid="F2">Figure&#x00A0;2C</xref>.</p>
</sec>
<sec id="s3c"><title>Univariate analysis of biomarkers and clinical variables</title>
<p>To explore the effect of each biomarker and clinical variables, random forest was performed for them shown in <xref ref-type="fig" rid="F3">Figure&#x00A0;3</xref>. NRS (13.14) was signi&#xFB01;cantly associated with the risk of CPSP. Also, CXCL10 (4.24), MMP3 (2.53), TNF-&#x03B1; (2.10), IL-1&#x03B2; (2.27), MMP2 (2.14), Anesthesia Duration (2.20), Operation Duration (2.22) and VEGF (4.96) were also signi&#xFB01;cantly related to the risk of CPSP (threshold&#x2009;&#x003D;&#x2009;2).</p>
<fig id="F3" position="float"><label>Figure 3</label>
<caption><p>Random forest analysis of clinical variables and biomarkers.</p></caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="fsurg-09-1068321-g003.tif"/>
</fig>
</sec>
<sec id="s3d"><title>Models building</title>
<p>91 patients were randomized into two independent sets: 64 patients for model building and cross validation in train set (Set 1), and 27 patients in test set (Set 2). Two groups share similar physical and clinical characteristics.</p>
<p>SVM model for CPSP risk were &#xFB01;rst trained and tested in Set1 by cross validation. The model with best performance was selected, and this model included 2 features from biomarkers and clinical variables of our interest. NRS at the first postoperative day seemed to be the most signi&#xFB01;cant one as identi&#xFB01;ed by random forest shown in <xref ref-type="fig" rid="F3">Figure&#x00A0;3</xref>. In line with this, previous studies attached great importance to postoperative acute pain towards the onset and progress of CPSP (<xref ref-type="bibr" rid="B17">17</xref>, <xref ref-type="bibr" rid="B18">18</xref>). As mentioned above, we finally picked it as a representative clinical variable. CXCL10, MMP3, TNF-&#x03B1;, IL-1&#x03B2;, MMP2 and VEGF were also taken into account in this model not only for its remarkable importance, but for indispensable role in neuro-inflammatory pathways. For better visual comparison, models including CXCL10, MMP3, VEGF, TNF-&#x03B1;, IL-1&#x03B2;, MMP2 and NRS were shown in <xref ref-type="fig" rid="F4">Figure&#x00A0;4</xref> to compare their performances. The &#xFB01;nal SVM model with radial kernel included NRS and MMP3 as model features, while cost&#x2009;&#x003D;&#x2009;2, gamma&#x2009;&#x003D;&#x2009;0.01 as model parameters. The classifying performance measures in Set 1 included: accuracy&#x2009;&#x003D;&#x2009;0.890, sensitivity&#x2009;&#x003D;&#x2009;0.963, speci&#xFB01;city&#x2009;&#x003D;&#x2009;0.889, AUC&#x2009;&#x003D;&#x2009;0.953. <xref ref-type="fig" rid="F5">Figure&#x00A0;5</xref> showed the predicted results of this &#xFB01;nal SVM model for Set 1 patients, 32/36 patients actually had CPSP when they were predicted to have CPSP, while 25/27 patients without CPSP were predicted to not develop CPSP. Matrix metalloproteinases (MMPs) have been implicated in the modulation of synaptic plasticity, glial activation, and long-term potentiation in the CNS and MMP3 was proved to regulate of nociceptive processing in thermal hyperalgesia and tactile hypersensitivity (<xref ref-type="bibr" rid="B19">19</xref>), which was consistent with the ID pain result above that most CPSP associated with neuropathic pain.</p>
<fig id="F4" position="float"><label>Figure 4</label>
<caption><p>Performances of the &#xFB01;nal SVM model (NRS&#x2009;&#x002B;&#x2009;MMP3) in Set 1 comparing with the other model. The panel showed their ROC performances. The models&#x2019; features were shown in subplots&#x2019; head. The panel demonstrated that the &#xFB01;nal model of using NRS and MMP3 with the best performance. ROC, receiver operating characteristic; AUC, the area under the ROC curve.</p></caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="fsurg-09-1068321-g004.tif"/>
</fig>
<fig id="F5" position="float"><label>Figure 5</label>
<caption><p>Predicted result of the &#xFB01;nal SVM model for CPSP risk in Set 1.</p></caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="fsurg-09-1068321-g005.tif"/>
</fig>
<p>The &#xFB01;nal SVM model was validated in Set 2. It predicted CPSP risk with accuracy&#x2009;&#x003D;&#x2009;0.857, sensitivity&#x2009;&#x003D;&#x2009;0.800, speci&#xFB01;city&#x2009;&#x003D;&#x2009;0.923, AUC&#x2009;&#x003D;&#x2009;0.892. The validated results are shown in <xref ref-type="fig" rid="F6">Figure&#x00A0;6</xref>: 12/15 patients actually had CPSP when they were predicted to have CPSP, while 12/13 patients without CPSP were predicted to not develop CPSP.</p>
<fig id="F6" position="float"><label>Figure 6</label>
<caption><p>Roc curve and predicted result of the &#xFB01;nal SVM model for CPSP risk in Set 2.</p></caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="fsurg-09-1068321-g006.tif"/>
</fig>
<p>The performances of the &#xFB01;nal SVM classi&#xFB01;er were compared with that of random forest model (also built in Set 1 and tested in Set 2). As shown in <xref ref-type="fig" rid="F7">Figure&#x00A0;7</xref>, the ROC curve (AUC&#x2009;&#x003D;&#x2009;0.917) of the &#xFB01;nal SVM classi&#xFB01;er was not only higher than that of the SVM classi&#xFB01;ers with other features of our interest as described above Set 1, but also higher than random forest model (AUC&#x2009;&#x003D;&#x2009;0.783).</p>
<fig id="F7" position="float"><label>Figure 7</label>
<caption><p>Roc curve, MDS plot and predicted result of the &#xFB01;nal random forest model for CPSP risk in Set 2. MDS, multidimensional scaling.</p></caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="fsurg-09-1068321-g007.tif"/>
</fig>
</sec>
</sec>
<sec id="s4" sec-type="discussion"><title>Discussion</title>
<p>In the current study, the overall prevalence of CPSP at 3 months after hepatectomy was 53.85&#x0025; (49 in 91). Findings from this study proved that the inflammatory biomarkers MMP3 and NRS at 24&#x2005;h postoperatively correlated significantly with the risk of CPSP. Machine Learning model combining MMP3 and NRS for CPSP risk forecasting showed reasonable predictive values. Within the limitations of a medium-sized study, the AUC of the final SVM model showed sound performance for predicting CPSP risk.</p>
<p>Previous studies had underscored that learning machine methods could better predict the occurrence of multiple diseases (<xref ref-type="bibr" rid="B20">20</xref>, <xref ref-type="bibr" rid="B21">21</xref>) due to high model accuracy and reduced overfitting. SVMs were highly resistant to overfitting as they map to a finite dimensional space (<xref ref-type="bibr" rid="B22">22</xref>). In line with this, our data (<xref ref-type="fig" rid="F5">Figures&#x00A0;5</xref>&#x2013;<xref ref-type="fig" rid="F7">7</xref>) showed that models generated by support vector machines have better performance than random forest models. Furthermore, as shown in <xref ref-type="fig" rid="F5">Figures&#x00A0;5</xref>, <xref ref-type="fig" rid="F6">6</xref>, the support vector machine model could be used as an intuitive and convenient tool to facilitate clinical decision-making. For example, the anesthetist could estimate the risk of CPSP by assessing the baseline level of MMP3 and the 24&#x2005;h postoperative NRS. If a patient with an estimated high risk of CPSP, the anesthetist was able to modify the perioperative pain administration to reduce the CPSP risk.</p>
<p>SVM was considered a &#x201C;black box&#x201D; algorithm, which might create a challenging dilemma for those responsible for a potential decision-making medical error. Interpreting how the model reached its predictions was therefore necessary to enable researchers to assess whether their predictions were trustworthy (<xref ref-type="bibr" rid="B23">23</xref>). Accumulating evidence have identified several risk factors for CPSP, including presence and intensity of acute postoperative pain, type of surgery, age, body mass index (BMI) and psychosocial factors (<xref ref-type="bibr" rid="B24">24</xref>, <xref ref-type="bibr" rid="B25">25</xref>). Here, we proved NRS at postoperative 24&#x2005;h to be an essential part to predict CPSP (<xref ref-type="fig" rid="F3">Figure&#x00A0;3</xref>), that is to say, postoperative acute pain might lead to the development of chronic pain. Multiple studies have backed this perspective (<xref ref-type="bibr" rid="B26">26</xref>, <xref ref-type="bibr" rid="B27">27</xref>) and the involving mechanism might include neuroplasticity, pain modulation and central sensitization (<xref ref-type="bibr" rid="B28">28</xref>). Therefore, this factor was first included in model building. Notably, in this study, blood samples were only collected from patients 24&#x2005;h after surgery, and it was found to be strongly correlated with the development of CPSP. However, a few studies did not support the direct transition from acute nociceptive postoperative pain to a different chronic pain condition as a mechanism for CPSP, but rather the parallel development of different types of persistent pain, including some perioperative or postoperative events, with the remission of acute pain (<xref ref-type="bibr" rid="B29">29</xref>). Due to the limitations of the data, we considered acute postoperative pain to be a highly potent risk factor, but the role of perioperative or postoperative events 3 months after surgery could not be dismissed. Few studies have explored the predictive models of inflammatory cytokines for CPSP, but most focused on local inflammation, with very few focusing on neuro-inflammatory conditions. We took a stab at building predictive models with novel biomarker profile at 24&#x2005;h postoperative levels covering both above and were surprised to find that the model including MMP3 performed remarkably well (<xref ref-type="fig" rid="F4">Figures&#x00A0;4</xref>&#x2013;<xref ref-type="fig" rid="F6">6</xref>). Present studies showed MMP3 to be a key component concurrent with increased tumor necrosis factor (TNF) in a spinal cascade initiated by peripheral inflammation and resulting in thermal hyperalgesia and tactile allodynia, likely from non-neuronal cells to evoke a facilitated state of dorsal horn processing (<xref ref-type="bibr" rid="B19">19</xref>). For clinic, elevated MMP3 has been reported in patients with ankylosing spondylitis, a chronic inflammatory disease, compared with healthy controls (<xref ref-type="bibr" rid="B30">30</xref>). Also, a correlation between MMP-3 and IL-6 was proposed in fibromyalgia, a common chronic pain, which represents either inflammatory cytokine-induced MMP-3 release or MMP-3 stimulation of local inflammatory cytokine production (<xref ref-type="bibr" rid="B31">31</xref>).</p>
<p>Meanwhile, this study also demonstrates the importance of other biomarkers (e.g., CXCL10) and clinical variables (e.g., operation duration, anesthesia duration and BMI) in patients after hepatectomy, although they were not entered into the SVM model implemented by the machine learning algorithm. In mice with spinal nerve ligation (SNL), CXCL10-activated CXCR3 was found to mediate p38 and ERK activation in DRG neurons and enhance neuronal excitability, which contributed to the maintenance of neuropathic pain (<xref ref-type="bibr" rid="B11">11</xref>). BMI was also reported to be a crucial risk factor for CPSP in cardiac surgery because overweighting or obesity increased the technical difficulty and might expose patients to prolonged retraction giving rise to CPSP (<xref ref-type="bibr" rid="B32">32</xref>). However, on account of the small database, the model did not incorporate the above variables to avoid overfitting. Future studies are warranted to determine the additional contribution of CXCL10 and BMI to CPSP as well as to externally validate our results.</p>
<p>There were some limitations of this study. First, the sample size was small limiting statistical evaluation and constraining our choice in machine learning model; secondly, only 2 factors were applied to construct the SVM model to avoid overfitting but was susceptible to type I error and unfitting; additionally, limited by the numbers of the events, this model simplified CPSP as a binary outcome, while the NRS was a 10-level graded event and pain also varied in character, which were topics of our ongoing study; what&#x0027;s more, only biomarkers that have been widely studied recently were included in this study, and other biomarkers were also worthy of further exploration. These limitations could be overcome in future with larger sample sizes.</p>
<p>In summary, using a machine learning framework, a SVM model of CPSP risk was established which integrated MMP3 and NRS as representative of cytokines and clinical variables. The SVM classi&#xFB01;er was validated in Set 2 and con&#xFB01;rmed to have reliable predictive performance. Additionally, our study provided important insights into biomarkers of CPSP risk and had identi&#xFB01;ed 24&#x2005;h postoperative biomarker levels such as VEGF, MMP3 and CXCL10 and clinical variables to be closely related to CPSP. Further study will need to validate this &#xFB01;nding and will need to consider the incorporation of more biomarkers and clinical variables to improve predictive accuracy.</p>
</sec>
</body>
<back>
<sec id="s5" sec-type="data-availability"><title>Data availability statement</title>
<p>The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.</p>
</sec>
<sec id="s6"><title>Ethics statement</title>
<p>The studies involving human participants were reviewed and approved by Ethics Committee on Biomedical Research, West China Hospital of Sichuan University. The patients/participants provided their written informed consent to participate in this study.</p>
</sec>
<sec id="s7"><title>Author contributions</title>
<p>Protocol: YH, MY. Ethics and governance: YL. Data collection: YL, MY, SY, WY. Data collection oversight: YH, CJ. Statistical analysis plan/analyses: YH. Drafting manuscript: YH. Reviewing manuscript: CJ. All authors contributed to the article and approved the submitted version.</p>
</sec>
<sec id="s8" sec-type="funding-information"><title>Funding</title>
<p>This work was supported by the Wu Jieping Medical Foundation (320.6750.2022-05-3), and Research Grant from the 1.3.5 project for the discipline of excellence (2019HXFH043 2022HXFH036).</p>
</sec>
<ack><title>Acknowledgments</title>
<p>The authors thank CJ for sincerely help with the literature search.</p>
</ack>
<sec id="s9" sec-type="COI-statement"><title>Conflict of interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec id="s10" sec-type="disclaimer"><title>Publisher&#x0027;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<ref-list><title>References</title>
<ref id="B1"><label>1.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ge</surname><given-names>X</given-names></name><name><surname>Pan</surname><given-names>Y</given-names></name><name><surname>Jin</surname><given-names>D</given-names></name><name><surname>Wang</surname><given-names>Y</given-names></name><name><surname>Ge</surname><given-names>S</given-names></name></person-group>. <article-title>Effect of perioperative use of parecoxib on chronic post-surgical pain in elderly patients after hepatectomy: a prospective randomized controlled study</article-title>. <source>BMC Pharmacol Toxicol</source>. (<year>2021</year>) <volume>22</volume>(<issue>1</issue>):<fpage>1</fpage>&#x2013;<lpage>12</lpage>. <pub-id pub-id-type="doi">10.1186/s40360-020-00461-y</pub-id><pub-id pub-id-type="pmid">33407916</pub-id></citation></ref>
<ref id="B2"><label>2.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fukazawa</surname><given-names>K</given-names></name><name><surname>Rodriguez</surname><given-names>PJ</given-names></name><name><surname>Fong</surname><given-names>CT</given-names></name><name><surname>Gologorsky</surname><given-names>E</given-names></name></person-group>. <article-title>Perioperative opioid use and chronic post-surgical pain after liver transplantation: a single center observational study</article-title>. <source>J Cardiothorac Vasc Anesth</source>. (<year>2020</year>) <volume>34</volume>(<issue>7</issue>):<fpage>1815</fpage>&#x2013;<lpage>21</lpage>. <pub-id pub-id-type="doi">10.1053/j.jvca.2019.12.024</pub-id><pub-id pub-id-type="pmid">31952905</pub-id></citation></ref>
<ref id="B3"><label>3.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Glare</surname><given-names>P</given-names></name><name><surname>Aubrey</surname><given-names>KR</given-names></name><name><surname>Myles</surname><given-names>PS</given-names></name></person-group>. <article-title>Transition from acute to chronic pain after surgery</article-title>. <source>Lancet</source>. (<year>2019</year>) <volume>393</volume>(<issue>10180</issue>):<fpage>1537</fpage>&#x2013;<lpage>46</lpage>. <pub-id pub-id-type="doi">10.1016/S0140-6736(19)30352-6</pub-id><pub-id pub-id-type="pmid">30983589</pub-id></citation></ref>
<ref id="B4"><label>4.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Treede</surname><given-names>R-D</given-names></name><name><surname>Rief</surname><given-names>W</given-names></name><name><surname>Barke</surname><given-names>A</given-names></name><name><surname>Aziz</surname><given-names>Q</given-names></name><name><surname>Bennett</surname><given-names>MI</given-names></name><name><surname>Benoliel</surname><given-names>R</given-names></name><etal/></person-group> <article-title>Chronic pain as a symptom or a disease: the IASP classification of chronic pain for the international classification of diseases (ICD-11)</article-title>. <source>Pain</source>. (<year>2019</year>) <volume>160</volume>(<issue>1</issue>):<fpage>19</fpage>&#x2013;<lpage>27</lpage>. <pub-id pub-id-type="doi">10.1097/j.pain.0000000000001384</pub-id><pub-id pub-id-type="pmid">30586067</pub-id></citation></ref>
<ref id="B5"><label>5.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Treede</surname><given-names>R-D</given-names></name><name><surname>Rief</surname><given-names>W</given-names></name><name><surname>Barke</surname><given-names>A</given-names></name><name><surname>Aziz</surname><given-names>Q</given-names></name><name><surname>Bennett</surname><given-names>MI</given-names></name><name><surname>Benoliel</surname><given-names>R</given-names></name><etal/></person-group> <article-title>A classification of chronic pain for ICD-11</article-title>. <source>Pain</source>. (<year>2015</year>) <volume>156</volume>(<issue>6</issue>):<fpage>1003</fpage>. <pub-id pub-id-type="doi">10.1097/j.pain.0000000000000160</pub-id><pub-id pub-id-type="pmid">25844555</pub-id></citation></ref>
<ref id="B6"><label>6.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ji</surname><given-names>R-R</given-names></name><name><surname>Xu</surname><given-names>Z-Z</given-names></name><name><surname>Gao</surname><given-names>Y-J</given-names></name></person-group>. <article-title>Emerging targets in neuroinflammation-driven chronic pain</article-title>. <source>Nat Rev Drug Discov</source>. (<year>2014</year>) <volume>13</volume>(<issue>7</issue>):<fpage>533</fpage>&#x2013;<lpage>48</lpage>. <pub-id pub-id-type="doi">10.1038/nrd4334</pub-id><pub-id pub-id-type="pmid">24948120</pub-id></citation></ref>
<ref id="B7"><label>7.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mendell</surname><given-names>LM</given-names></name><name><surname>Wall</surname><given-names>PD</given-names></name></person-group>. <article-title>Responses of single dorsal cord cells to peripheral cutaneous unmyelinated fibres</article-title>. <source>Nature</source>. (<year>1965</year>) <volume>206</volume>(<issue>4979</issue>):<fpage>97</fpage>&#x2013;<lpage>9</lpage>. <pub-id pub-id-type="doi">10.1038/206097a0</pub-id><pub-id pub-id-type="pmid">14334366</pub-id></citation></ref>
<ref id="B8"><label>8.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Islam</surname><given-names>B</given-names></name><name><surname>Stephenson</surname><given-names>J</given-names></name><name><surname>Young</surname><given-names>B</given-names></name><name><surname>Manca</surname><given-names>M</given-names></name><name><surname>Buckley</surname><given-names>DA</given-names></name><name><surname>Radford</surname><given-names>H</given-names></name><etal/></person-group> <article-title>The identification of blood biomarkers of chronic neuropathic pain by comparative transcriptomics</article-title>. <source>NeuroMol Med</source>. (<year>2021</year>) <volume>24</volume>:<fpage>1</fpage>&#x2013;<lpage>19</lpage>. <pub-id pub-id-type="doi">10.1007/s12017-021-08694-8</pub-id></citation></ref>
<ref id="B9"><label>9.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ren</surname><given-names>K</given-names></name><name><surname>Torres</surname><given-names>R</given-names></name></person-group>. <article-title>Role of interleukin-1beta during pain and inflammation</article-title>. <source>Brain Res Rev</source>. (<year>2009</year>) <volume>60</volume>(<issue>1</issue>):<fpage>57</fpage>. <pub-id pub-id-type="doi">10.1016/j.brainresrev.2008.12.020</pub-id><pub-id pub-id-type="pmid">19166877</pub-id></citation></ref>
<ref id="B10"><label>10.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Koch</surname><given-names>A</given-names></name><name><surname>Zacharowski</surname><given-names>K</given-names></name><name><surname>Boehm</surname><given-names>O</given-names></name><name><surname>Stevens</surname><given-names>M</given-names></name><name><surname>Lipfert</surname><given-names>P</given-names></name><name><surname>Giesen</surname><given-names>H</given-names></name><etal/></person-group> <article-title>Nitric oxide and pro-inflammatory cytokines correlate with pain intensity in chronic pain patients</article-title>. <source>Inflamm Res</source>. (<year>2007</year>) <volume>56</volume>(<issue>1</issue>):<fpage>32</fpage>&#x2013;<lpage>7</lpage>. <pub-id pub-id-type="doi">10.1007/s00011-007-6088-4</pub-id><pub-id pub-id-type="pmid">17334668</pub-id></citation></ref>
<ref id="B11"><label>11.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kong</surname><given-names>YF</given-names></name><name><surname>Sha</surname><given-names>WL</given-names></name><name><surname>Wu</surname><given-names>XB</given-names></name><name><surname>Zhao</surname><given-names>LX</given-names></name><name><surname>Gao</surname><given-names>YJ</given-names></name></person-group>. <article-title>CXCL10/CXCR3 signaling in the DRG exacerbates neuropathic pain in mice</article-title>. <source>Neurosci Bull</source>. (<year>2020</year>) <volume>37</volume>(<issue>3</issue>):339&#x2013;52. <pub-id pub-id-type="doi">10.1007/s12264-020-00608-1</pub-id><pub-id pub-id-type="pmid">33196963</pub-id></citation></ref>
<ref id="B12"><label>12.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ji</surname><given-names>RR</given-names></name><name><surname>Xu</surname><given-names>ZZ</given-names></name><name><surname>Wang</surname><given-names>X</given-names></name><name><surname>Lo</surname><given-names>EH</given-names></name></person-group>. <article-title>Matrix metalloprotease regulation of neuropathic pain</article-title>. <source>Trends Pharmacol Sci</source>. (<year>2009</year>) <volume>30</volume>(<issue>7</issue>):<fpage>336</fpage>&#x2013;<lpage>40</lpage>. <pub-id pub-id-type="doi">10.1016/j.tips.2009.04.002</pub-id><pub-id pub-id-type="pmid">19523695</pub-id></citation></ref>
<ref id="B13"><label>13.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kalso</surname><given-names>E</given-names></name><name><surname>Meretoja</surname><given-names>T</given-names></name><name><surname>Sipila</surname><given-names>J</given-names></name><name><surname>Reetta</surname><given-names>H</given-names></name><name><surname>Lassi</surname><given-names>S</given-names></name></person-group>. <article-title>Clinical prediction model and tool for assessing risk of persistent pain after breast cancer surgery</article-title>. <source>J Clin Oncol</source>. (<year>2017</year>) 35:1660&#x2013;7. <pub-id pub-id-type="doi">10.1200/JCO.2016.70.3413</pub-id><pub-id pub-id-type="pmid">28524782</pub-id></citation></ref>
<ref id="B14"><label>14.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Xu</surname><given-names>Y</given-names></name><name><surname>Ye</surname><given-names>M</given-names></name><name><surname>Hong</surname><given-names>Y</given-names></name><name><surname>Kang</surname><given-names>Y</given-names></name><name><surname>Li</surname><given-names>Y</given-names></name><name><surname>Xiao</surname><given-names>X</given-names></name><etal/></person-group> <article-title>Efficacy of perioperative continuous intravenous lidocaine infusion for 72 hours on postoperative pain and recovery in patients undergoing hepatectomy: study protocol for a prospective randomized controlled trial</article-title>. <source>J Pain Res</source>. (<year>2021</year>) <volume>14</volume>:<fpage>3665</fpage>&#x2013;<lpage>74</lpage>. <pub-id pub-id-type="doi">10.2147/jpr.S341550</pub-id><pub-id pub-id-type="pmid">34880671</pub-id></citation></ref>
<ref id="B15"><label>15.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Aldrete</surname><given-names>JA</given-names></name><name><surname>Kroulik</surname><given-names>D</given-names></name></person-group>. <article-title>A postanesthetic recovery score</article-title>. <source>Anesth Analg</source>. (<year>1970</year>) <volume>49</volume>(<issue>6</issue>):<fpage>924</fpage>&#x2013;<lpage>34</lpage>. <pub-id pub-id-type="doi">10.1213/00000539-197011000-00020</pub-id><pub-id pub-id-type="pmid">5534693</pub-id></citation></ref>
<ref id="B16"><label>16.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Portenoy</surname><given-names>R</given-names></name><name><surname>Committee</surname><given-names>IPS</given-names></name></person-group>. <article-title>Development and testing of a neuropathic pain screening questionnaire: ID pain</article-title>. <source>Curr Med Res Opin</source>. (<year>2006</year>) <volume>22</volume>(<issue>8</issue>):<fpage>1555</fpage>&#x2013;<lpage>65</lpage>. <pub-id pub-id-type="doi">10.1185/030079906X115702</pub-id><pub-id pub-id-type="pmid">16870080</pub-id></citation></ref>
<ref id="B17"><label>17.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tasmuth</surname><given-names>T</given-names></name><name><surname>Kataja</surname><given-names>M</given-names></name><name><surname>Blomqvist</surname><given-names>C</given-names></name><name><surname>Smitten</surname><given-names>KV</given-names></name><name><surname>Kalso</surname><given-names>E</given-names></name></person-group>. <article-title>Treatment-related factors predisposing to chronic pain in patients with breast cancer&#x2013;a multivariate approach</article-title>. <source>Acta Oncol</source>. (<year>1997</year>) <volume>36</volume>(<issue>6</issue>):<fpage>625</fpage>&#x2013;<lpage>30</lpage>. <pub-id pub-id-type="doi">10.3109/02841869709001326</pub-id><pub-id pub-id-type="pmid">9408154</pub-id></citation></ref>
<ref id="B18"><label>18.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Thue</surname><given-names>B</given-names></name><name><surname>Jacob</surname><given-names>R</given-names></name><name><surname>Henrik</surname><given-names>K</given-names></name></person-group>. <article-title>From acute to chronic pain after laparoscopic cholecystectomy: a prospective follow-up analysis</article-title>. <source>Scand J Gastroenterol</source>. (<year>2009</year>) <volume>40</volume>(<issue>11</issue>):<fpage>1358</fpage>&#x2013;<lpage>64</lpage>. <pub-id pub-id-type="doi">10.1080/00365520510023675</pub-id></citation></ref>
<ref id="B19"><label>19.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Christianson</surname><given-names>CA</given-names></name><name><surname>Fitzsimmons</surname><given-names>BL</given-names></name><name><surname>Shim</surname><given-names>J-H</given-names></name><name><surname>Agrawal</surname><given-names>A</given-names></name><name><surname>Cohen</surname><given-names>SM</given-names></name><name><surname>Hua</surname><given-names>X-Y</given-names></name><etal/></person-group> <article-title>Spinal matrix metalloproteinase 3 mediates inflammatory hyperalgesia via a tumor necrosis factor-dependent mechanism</article-title>. <source>Neuroscience</source>. (<year>2012</year>) <volume>200</volume>:<fpage>199</fpage>&#x2013;<lpage>210</lpage>. <pub-id pub-id-type="doi">10.1016/j.neuroscience.2011.10.019</pub-id><pub-id pub-id-type="pmid">22056600</pub-id></citation></ref>
<ref id="B20"><label>20.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yu</surname><given-names>H</given-names></name><name><surname>Wu</surname><given-names>H</given-names></name><name><surname>Wang</surname><given-names>W</given-names></name><name><surname>Jolly</surname><given-names>S</given-names></name><name><surname>Jin</surname><given-names>J-Y</given-names></name><name><surname>Hu</surname><given-names>C</given-names></name><etal/></person-group> <article-title>Machine learning to build and validate a model for radiation pneumonitis prediction in patients with non&#x2013;small cell lung cancer</article-title>. <source>Clin Cancer Res</source>. (<year>2019</year>) <volume>25</volume>(<issue>14</issue>):<fpage>4343</fpage>&#x2013;<lpage>50</lpage>. <pub-id pub-id-type="doi">10.1158/1078-0432.CCR-18-1084</pub-id><pub-id pub-id-type="pmid">30992302</pub-id></citation></ref>
<ref id="B21"><label>21.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Luna</surname><given-names>JM</given-names></name><name><surname>Chao</surname><given-names>H-H</given-names></name><name><surname>Diffenderfer</surname><given-names>ES</given-names></name><name><surname>Valdes</surname><given-names>G</given-names></name><name><surname>Chinniah</surname><given-names>C</given-names></name><name><surname>Ma</surname><given-names>G</given-names></name><etal/></person-group> <article-title>Predicting radiation pneumonitis in locally advanced stage II&#x2013;III non-small cell lung cancer using machine learning</article-title>. <source>Radiother Oncol</source>. (<year>2019</year>) <volume>133</volume>:<fpage>106</fpage>&#x2013;<lpage>12</lpage>. <pub-id pub-id-type="doi">10.1016/j.radonc.2019.01.003</pub-id><pub-id pub-id-type="pmid">30935565</pub-id></citation></ref>
<ref id="B22"><label>22.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Vapnik</surname><given-names>VN</given-names></name></person-group>. <source>The nature of statistical learning theory</source>. <publisher-name>New York: Springer</publisher-name> (<year>1995</year>).</citation></ref>
<ref id="B23"><label>23.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Taher</surname><given-names>H</given-names></name><name><surname>Grasso</surname><given-names>V</given-names></name><name><surname>Tawfik</surname><given-names>S</given-names></name><name><surname>Gumbs</surname><given-names>A</given-names></name></person-group>. <article-title>The challenges of deep learning in artificial intelligence and autonomous actions in surgery: a literature review</article-title>. <source>Artif Intell Surg</source>. (<year>2022</year>) <volume>2</volume>(<issue>3</issue>):<fpage>144</fpage>&#x2013;<lpage>58</lpage>. <pub-id pub-id-type="doi">10.20517/ais.2022.11</pub-id></citation></ref>
<ref id="B24"><label>24.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bruce</surname><given-names>J</given-names></name><name><surname>Thornton</surname><given-names>AJ</given-names></name><name><surname>Powell</surname><given-names>R</given-names></name><name><surname>Johnston</surname><given-names>M</given-names></name><name><surname>Wells</surname><given-names>M</given-names></name><name><surname>Heys</surname><given-names>SD</given-names></name><etal/></person-group> <article-title>Psychological, surgical, and sociodemographic predictors of pain outcomes after breast cancer surgery: a population-based cohort study</article-title>. <source>Pain</source>. (<year>2014</year>) <volume>155</volume>(<issue>2</issue>):232&#x2013;43. <pub-id pub-id-type="doi">10.1016/j.pain.2013.09.028</pub-id><pub-id pub-id-type="pmid">24099954</pub-id></citation></ref>
<ref id="B25"><label>25.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Andersen</surname><given-names>KG</given-names></name><name><surname>Duriaud</surname><given-names>HM</given-names></name><name><surname>Jensen</surname><given-names>HE</given-names></name><name><surname>Kroman</surname><given-names>N</given-names></name><name><surname>Kehlet</surname><given-names>H</given-names></name></person-group>. <article-title>Predictive factors for the development of persistent pain after breast cancer surgery</article-title>. <source>Pain</source>. (<year>2015</year>) <volume>156</volume>(<issue>12</issue>):<fpage>2413</fpage>&#x2013;<lpage>22</lpage>. <pub-id pub-id-type="doi">10.1097/j.pain.0000000000000298</pub-id><pub-id pub-id-type="pmid">26176893</pub-id></citation></ref>
<ref id="B26"><label>26.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dominique</surname><given-names>F</given-names></name><name><surname>Ulrike</surname><given-names>S</given-names></name><name><surname>Esther</surname><given-names>P-Z</given-names></name><name><surname>Ruth</surname><given-names>Z</given-names></name><name><surname>Narcis</surname><given-names>VT</given-names></name></person-group>. <article-title>Chronic postsurgical pain in Europe: an observational study</article-title>. <source>Eur J Anaesthesiol</source>. (<year>2015</year>) 32:725&#x2013;34. <pub-id pub-id-type="doi">10.1097/EJA.0000000000000319</pub-id></citation></ref>
<ref id="B27"><label>27.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kehlet</surname><given-names>H</given-names></name><name><surname>Jensen</surname><given-names>TS</given-names></name><name><surname>Woolf</surname><given-names>CJ</given-names></name></person-group>. <article-title>Persistent postsurgical pain: risk factors and prevention</article-title>. <source>Lancet</source>. (<year>2006</year>) <volume>367</volume>(<issue>9522</issue>):<fpage>1618</fpage>&#x2013;<lpage>25</lpage>. <pub-id pub-id-type="doi">10.1016/S0140-6736(06)68700-X</pub-id><pub-id pub-id-type="pmid">16698416</pub-id></citation></ref>
<ref id="B28"><label>28.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Meissner</surname><given-names>W</given-names></name><name><surname>Coluzzi</surname><given-names>F</given-names></name><name><surname>Fletcher</surname><given-names>D</given-names></name><name><surname>Huygen</surname><given-names>F</given-names></name><name><surname>Pergolizzi</surname><given-names>J</given-names></name></person-group>. <article-title>Improving the management of post-operative acute pain: priorities for change</article-title>. <source>Curr Med Res Opin</source>. (<year>2015</year>) <volume>31</volume>(<issue>11</issue>):<fpage>2131</fpage>. <pub-id pub-id-type="doi">10.1185/03007995.2015.1092122</pub-id><pub-id pub-id-type="pmid">26359332</pub-id></citation></ref>
<ref id="B29"><label>29.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Finnerup</surname><given-names>NB</given-names></name><name><surname>Nikolajsen</surname><given-names>L</given-names></name><name><surname>Rice</surname><given-names>AS</given-names></name></person-group>. <article-title>Transition from acute to chronic pain: a misleading concept?</article-title> <source>Pain</source>. (<year>2022</year>) 163:e985&#x2013;e8. <pub-id pub-id-type="doi">10.1097/j.pain.0000000000002631</pub-id></citation></ref>
<ref id="B30"><label>30.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>He</surname><given-names>D</given-names></name><name><surname>Zhu</surname><given-names>Q</given-names></name><name><surname>Zhou</surname><given-names>Q</given-names></name><name><surname>Qi</surname><given-names>Q</given-names></name><name><surname>Sun</surname><given-names>H</given-names></name><name><surname>Zachariah</surname><given-names>LM</given-names></name><etal/></person-group> <article-title>Correlation of serum MMP3 and other biomarkers with clinical outcomes in patients with ankylosing spondylitis: a pilot study</article-title>. <source>Clin Rheumatol</source>. (<year>2017</year>) 36:1819&#x2013;26. <pub-id pub-id-type="doi">10.1007/s10067-017-3624-7</pub-id></citation></ref>
<ref id="B31"><label>31.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bjersing</surname><given-names>JL</given-names></name><name><surname>Dehlin</surname><given-names>M</given-names></name><name><surname>Erlandsson</surname><given-names>M</given-names></name></person-group>. <article-title>Changes in pain and insulin-like growth factor 1 in fibromyalgia during exercise: the involvement of cerebrospinal inflammatory factors and neuropeptides</article-title>. <source>Arthritis Res Ther</source>. (<year>2012</year>) <volume>14</volume>(<issue>4</issue>):<fpage>1</fpage>&#x2013;<lpage>9</lpage>. <pub-id pub-id-type="doi">10.1186/ar3902</pub-id><pub-id pub-id-type="pmid">22393579</pub-id></citation></ref>
<ref id="B32"><label>32.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Clarke</surname><given-names>H</given-names></name><name><surname>Rai</surname><given-names>A</given-names></name><name><surname>Bao</surname><given-names>J</given-names></name><name><surname>Poon</surname><given-names>M</given-names></name><name><surname>Katz</surname><given-names>J</given-names></name></person-group>. <article-title>Toward a phenomic analysis of chronic postsurgical pain following cardiac surgery</article-title>. <source>Can J Pain</source>. (<year>2019</year>) <volume>3</volume>(<issue>1</issue>):<fpage>58</fpage>&#x2013;<lpage>69</lpage>. <pub-id pub-id-type="doi">10.1080/24740527.2019.1580142</pub-id><pub-id pub-id-type="pmid">35005394</pub-id></citation></ref></ref-list>
</back>
</article>