<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Med.</journal-id>
<journal-title>Frontiers in Medicine</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Med.</abbrev-journal-title>
<issn pub-type="epub">2296-858X</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fmed.2023.1271407</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Medicine</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Candidate composite biomarker to inform drug treatments for diabetic kidney disease</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Jones</surname> <given-names>Roger D.</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/2040862/overview"/>
<role content-type="https://credit.niso.org/contributor-roles/conceptualization/"/>
<role content-type="https://credit.niso.org/contributor-roles/formal-analysis/"/>
<role content-type="https://credit.niso.org/contributor-roles/investigation/"/>
<role content-type="https://credit.niso.org/contributor-roles/methodology/"/>
<role content-type="https://credit.niso.org/contributor-roles/software/"/>
<role content-type="https://credit.niso.org/contributor-roles/validation/"/>
<role content-type="https://credit.niso.org/contributor-roles/visualization/"/>
<role content-type="https://credit.niso.org/contributor-roles/writing-original-draft/"/>
<role content-type="https://credit.niso.org/contributor-roles/writing-review-editing/"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Abebe</surname> <given-names>Seyum</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/2523676/overview"/>
<role content-type="https://credit.niso.org/contributor-roles/writing-review-editing/"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Distefano</surname> <given-names>Veronica</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff4"><sup>4</sup></xref>
<role content-type="https://credit.niso.org/contributor-roles/writing-review-editing/"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Mayer</surname> <given-names>Gert</given-names></name>
<xref ref-type="aff" rid="aff5"><sup>5</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/177702/overview"/>
<role content-type="https://credit.niso.org/contributor-roles/conceptualization/"/>
<role content-type="https://credit.niso.org/contributor-roles/funding-acquisition/"/>
<role content-type="https://credit.niso.org/contributor-roles/project-administration/"/>
<role content-type="https://credit.niso.org/contributor-roles/supervision/"/>
<role content-type="https://credit.niso.org/contributor-roles/writing-original-draft/"/>
<role content-type="https://credit.niso.org/contributor-roles/writing-review-editing/"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Poli</surname> <given-names>Irene</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<role content-type="https://credit.niso.org/contributor-roles/conceptualization/"/>
<role content-type="https://credit.niso.org/contributor-roles/formal-analysis/"/>
<role content-type="https://credit.niso.org/contributor-roles/funding-acquisition/"/>
<role content-type="https://credit.niso.org/contributor-roles/investigation/"/>
<role content-type="https://credit.niso.org/contributor-roles/project-administration/"/>
<role content-type="https://credit.niso.org/contributor-roles/supervision/"/>
<role content-type="https://credit.niso.org/contributor-roles/validation/"/>
<role content-type="https://credit.niso.org/contributor-roles/writing-review-editing/"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Silvestri</surname> <given-names>Claudio</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff6"><sup>6</sup></xref>
<role content-type="https://credit.niso.org/contributor-roles/data-curation/"/>
<role content-type="https://credit.niso.org/contributor-roles/writing-review-editing/"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Slanzi</surname> <given-names>Debora</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff7"><sup>7</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/2504863/overview"/>
<role content-type="https://credit.niso.org/contributor-roles/writing-review-editing/"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>European Centre for Living Technology, Ca&#x00027; Foscari University of Venice</institution>, <addr-line>Venice</addr-line>, <country>Italy</country></aff>
<aff id="aff2"><sup>2</sup><institution>Department of Biology, University of North Carolina at Chapel Hill</institution>, <addr-line>Chapel Hill, NC</addr-line>, <country>United States</country></aff>
<aff id="aff3"><sup>3</sup><institution>Systems Engineering and Research Center, Stevens Institute of Technology</institution>, <addr-line>Hoboken, NJ</addr-line>, <country>United States</country></aff>
<aff id="aff4"><sup>4</sup><institution>Department of Economic Sciences, Universit&#x000E0; del Salento</institution>, <addr-line>Salento</addr-line>, <country>Italy</country></aff>
<aff id="aff5"><sup>5</sup><institution>Internal Medicine IV, Medical University Innsbruck</institution>, <addr-line>Innsbruck</addr-line>, <country>Austria</country></aff>
<aff id="aff6"><sup>6</sup><institution>Department of Environmental Sciences, Informatics and Statistics, Ca&#x00027; Foscari University of Venice</institution>, <addr-line>Venice</addr-line>, <country>Italy</country></aff>
<aff id="aff7"><sup>7</sup><institution>Department of Management, Ca&#x00027; Foscari University of Venice</institution>, <addr-line>Venice</addr-line>, <country>Italy</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Allah Nawaz, Joslin Diabetes Center and Harvard Medical School, United States</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Giovanni Maria Rossi, University Hospital of Parma, Italy; Tomonobu Kado, University of Toyama, Japan; Hafizur Rahman, University of Karachi, Pakistan; Raj Mongre, Boston Children&#x00027;s Hospital and Harvard Medical School, United States</p></fn>
<corresp id="c001">&#x0002A;Correspondence: Roger D. Jones <email>RogerDJonesPhD&#x00040;gmail.com</email></corresp>
</author-notes>
<pub-date pub-type="epub">
<day>01</day>
<month>11</month>
<year>2023</year>
</pub-date>
<pub-date pub-type="collection">
<year>2023</year>
</pub-date>
<volume>10</volume>
<elocation-id>1271407</elocation-id>
<history>
<date date-type="received">
<day>02</day>
<month>08</month>
<year>2023</year>
</date>
<date date-type="accepted">
<day>29</day>
<month>09</month>
<year>2023</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2023 Jones, Abebe, Distefano, Mayer, Poli, Silvestri and Slanzi.</copyright-statement>
<copyright-year>2023</copyright-year>
<copyright-holder>Jones, Abebe, Distefano, Mayer, Poli, Silvestri and Slanzi</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract>
<sec>
<title>Introduction</title>
<p>Current guidelines recommend renin angiotensin system inhibitors (RASi) as key components of treatment of diabetic kidney disease (DKD). Additional options include sodium-glucose cotransporter-2 inhibitors (SGLT2i), glucagon-like peptide 1 receptor agonists (GLP1a), and mineralocorticoid receptor antagonists (MCRa). The identification of the optimum drug combination for an individual is difficult because of the inter-, and longitudinal intra-individual heterogeneity of response to therapy.</p></sec>
<sec>
<title>Results</title>
<p>Using data from a large observational study (PROVALID), we identified a set of parameters that can be combined into a meaningful composite biomarker that appears to be able to identify which of the various treatment options is clinically beneficial for an individual. It uses machine-earning techniques to estimate under what conditions a treatment of RASi plus an additional treatment is different from the treatment with RASi alone. The measure of difference is the annual percent change (&#x00394;eGFR) in the estimated glomerular filtration rate (&#x00394;eGFR). The 1eGFR is estimated for both the RASi-alone treatment and the add-on treatment.</p></sec>
<sec>
<title>Discussion</title>
<p>Higher estimated increase of eGFR for add-on patients compared with RASi-alone patients indicates that prognosis may be improved with the add-on treatment. The personalized biomarker value thus identifies which patients may benefit from the additional treatment.</p></sec></abstract>
<kwd-group>
<kwd>precision medicine</kwd>
<kwd>diabetic kidney disease</kwd>
<kwd>biomarkers</kwd>
<kwd>RASi</kwd>
<kwd>SGLT2i</kwd>
<kwd>MCRa</kwd>
<kwd>clinical data</kwd>
</kwd-group>
<contract-sponsor id="cn001">Horizon 2020<named-content content-type="fundref-id">10.13039/501100007601</named-content></contract-sponsor>
<counts>
<fig-count count="3"/>
<table-count count="4"/>
<equation-count count="15"/>
<ref-count count="38"/>
<page-count count="11"/>
<word-count count="7690"/>
</counts>
<custom-meta-wrap>
<custom-meta>
<meta-name>section-at-acceptance</meta-name>
<meta-value>Precision Medicine</meta-value>
</custom-meta>
</custom-meta-wrap>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="s1">
<title>1. Introduction</title>
<p>Cross sectional inter- and longitudinal intra-individual heterogeneity in progression and response to therapy is a common feature of many chronic and age-related diseases. The current state-of-the-art guideline-backed clinical practice relies on studies in large cohorts and does not take individual variability into account. Precision/personalized/stratified medicine attempts to identify the individual prognosis and targeted treatment at the right time for the right patient, or at least for smaller and more homogeneous groups (<xref ref-type="bibr" rid="B1">1</xref>&#x02013;<xref ref-type="bibr" rid="B3">3</xref>). Implementation requires adaptations in research as well as in clinical approaches. As an example, patients with diabetes mellitus type 2 and kidney disease (diabetic kidney disease; DKD) are currently categorized by two biomarkers, the estimated glomerular filtration rate (eGFR), a measure of the kidneys ability to excrete waste products and the amount of pathologically increased excretion of albumin in the urine (<xref ref-type="bibr" rid="B4">4</xref>). Even though each of these alterations reflects a distinct pathology with impact on prognosis (<xref ref-type="bibr" rid="B5">5</xref>&#x02013;<xref ref-type="bibr" rid="B7">7</xref>) and therapy is adjusted accordingly, heterogeneity in response persists. If we increase the data space for deeper phenotyping (including e.g., genetics, family and personal history, lifestyle, environment, demographics, routine laboratory parameters or even Omics profiling studies), we must use higher-resolution statistics to extract usable information. Systems biology (<xref ref-type="bibr" rid="B8">8</xref>) and advanced data-mining techniques are required to (1) improve phenotyping, (2) predict the future state (prognosis) of the individual, and (3) identify the most effective spectrum of drugs to intervene. The design of clinical validation trials also needs adjustment to the individual or small cluster level (<xref ref-type="bibr" rid="B9">9</xref>). Increased molecular resolution of pathophysiology as well as drug mode of action will also improve our understanding of diseases and support the process of drug discovery (<xref ref-type="bibr" rid="B10">10</xref>). As an example, the hormone angiotensin II increases blood pressure and prolonged hypertension drives DKD. Renin angiotensin system inhibitors (RASi), such as angiotensin converting enzyme inhibitors (ACEis) and angiotensin II receptor blockers (ARBs), block the formation and action of angiotensin II and lower systemic blood pressure. Interestingly, when compared with other antihypertensive agents, ACEis and ARBs stabilize kidney function at the same level of achieved blood pressure better than conventional antihypertensive therapy (<xref ref-type="bibr" rid="B11">11</xref>). This suggests that angiotensin II also operates in other processes (<xref ref-type="bibr" rid="B10">10</xref>, <xref ref-type="bibr" rid="B12">12</xref>). Indeed, the angiotensin receptor and other G-protein coupled receptors can trigger distinct multiple downstream responses that depend on the cellular environment (<xref ref-type="bibr" rid="B13">13</xref>&#x02013;<xref ref-type="bibr" rid="B15">15</xref>) and thereby may lead to heterogeneous disease progression and effect of therapy.</p>
<p>In this study, we focused on the identification of a biomarker panel to support precision drug treatment in DKD. We used data from a subgroup of patients included in the PROVALID study (<xref ref-type="bibr" rid="B16">16</xref>&#x02013;<xref ref-type="bibr" rid="B19">19</xref>), a longitudinal prospective observational study in patients with type 2 diabetes. Information on eGFR and therapy as well as many other biomarkers was available on an annual basis. Patients with controlled kidney disease (CD) were characterized by an annual decrease of eGFR not exceeding 5%, while eGFR dropped more than 10% in uncontrolled DKD (UCD). A 1-year follow-up period is consistent with international guideline recommendations. The 1-year follow-up minimizes the effect of longitudinal intra-individual heterogeneity in treatment response and our threshold of 10% decrease for identification of uncontrolled disease still represents a change in eGFR not expected to occur spontaneously (<xref ref-type="bibr" rid="B18">18</xref>). All patients were continuously treated with a RASi. In some individuals, one other agent supposed to beneficially affect DKD [glucagon-like peptide 1 agonist (GLP1a), mineralocorticoid receptor antagonist (MCRa) or a sodium-glucose cotransporter 2 inhibitor (SGLT2i)], was added on top of RASi therapy in the 1-year follow up period. We set out to define a biomarker panel that supports clinicians to decide if a patient, who is currently treated with an ACEi or ARB-only should remain on this regimen as CD is expected or be changed to a drug combination to improve outcome in case of UCD prognosis. To answer this question at the most basic level, we use data to construct a model &#x00394;<sub><italic>R</italic></sub> that predicts the future value of the change (&#x00394;eGFR) in eGFR between baseline and the next follow-up visit in RASi-only treated patients. Next, we apply the model to patients taking one of the other three combination drug therapies. If the added treatment has no effect, we expect the RASi-only model to predict the outcome accurately. If, however, the other treatment has an effect beyond that of the effect of RASi only, the model will not be a good predictor. Next, we developed models, &#x00394;<sub><italic>G</italic></sub>, &#x00394;<sub><italic>M</italic></sub>, and &#x00394;<sub><italic>S</italic></sub>, to predict &#x00394;eGFR for each individual drug of interest, GLP1a, MCRa, and SGLT2i, respectively, when added on top of RASi. If a new patient thus presents on RASi only therapy and that patient&#x00027;s value for &#x00394;<sub><italic>R</italic></sub> is measured and calculated, the physician can decide if the individual should stay on RASi only or not. In those with a negative prognosis on RASi alone, the change in &#x00394;eGFR expected under different combination therapies can be estimated, and the best therapy is selected. The process described will become part of a toolbox that supports clinicians treating patients with DKD. We therefore recognized a number of practical constraints on biomarker selection and on the prediction model. Clinical tests can be time-consuming and expensive, and therefore, the selection of variables should ideally be restricted to a small number of readily available and inexpensive parameters, if possible. In addition, they should be familiar and explainable to clinicians and ideally be linked to relevant biological processes. Moreover, as many patient tests will pass through the toolbox, the models should be computationally efficient.</p></sec>
<sec id="s2">
<title>2. Approach</title>
<p>Data on patients with DKD used in this study were obtained in an extensive data-collection effort, the PROVALID (PROspective cohort study in patients with type 2 diabetes mellitus for VALIDation of biomarkers) study (<xref ref-type="bibr" rid="B16">16</xref>&#x02013;<xref ref-type="bibr" rid="B19">19</xref>). Here, 4,000 patients were recruited at the primary level of healthcare in Austria, Hungary, Netherlands, Poland, and Scotland. The patients visited their physicians annually as part of standard clinical practice and were followed for at least 4 years. Information on patient history, physical status, laboratory measurements, medication, and renal and cardiovascular events were collected as well as urine and plasma for measurement of biomarkers. We used the Modification of Diet in Renal Disease Study equation (MDRD) formula for the calculation of &#x00394;eGFR (<xref ref-type="bibr" rid="B20">20</xref>). Only individuals with eGFR values between 30 and 90 ml/min/1.73 m<sup>2</sup> were included. The prevention of progression of DKD (defined as a loss of eGFR) is most efficient in early disease. Therefore, we excluded individuals with advanced stages (i.e., an eGFR &#x0003C;30 ml/min/1.73 m<sup>2</sup>). On the contrary, hyperfiltration with elevated eGFR is atypical early feature of DKD. The pathophysiology of induction and resolution of hyperfiltration is not completely clear but may be different from progression thereafter. Hence, we decided to set the upper boundary of eGFR for inclusion to 90 ml/min/1.73 m<sup>2</sup>. Baseline characteristics and medication for all participants per group are presented in the <xref ref-type="supplementary-material" rid="SM1">Supplementary material</xref>. For this analysis, patients with the following treatment regimen were selected:</p>
<list list-type="order">
<list-item><p>RASi as the only drug treatment during a 1-year follow-up period (RASi only). For this group, the same patient could contribute multiple annual sequences, and we aimed for a equal distribution of CD and UCD.</p></list-item>
<list-item><p>RASi during a 1-year follow-up period with addition of a glucagon-like peptide 1 agonist added after baseline (RASi&#x0002B;GLP1a).</p></list-item>
<list-item><p>RASi during a 1-year follow-up period with addition of a mineralocorticoid receptor antagonist added after baseline (RASi&#x0002B;MCRa).</p></list-item>
<list-item><p>RASi during a 1-year follow-up period with addition of a sodium-glucose cotransporter 2 inhibitor added after baseline (RASi&#x0002B;SGLT2i).</p></list-item>
</list>
<p>The data presented several challenges to modeling:</p>
<list list-type="order">
<list-item><p>The number of visits per group was small (approximately 100) with the exception of the RASi only group. As a consequence, data-hungry multi-layer perceptrons, for instance, are not adequate for non-linear modeling of this particular sparse data. Machine-learning techniques that can efficiently extract information from small amounts of data were required.</p></list-item>
<list-item><p>The evolution of &#x00394;eGFR, as seen in PROVALID data, can change significantly within a period of 1 year, which is the measurement interval (<xref ref-type="bibr" rid="B21">21</xref>). This requires modeling techniques that can change predictions discontinuously over a period of 1 year. For this, we used recurrent neural networks that handle discontinuities in data.</p></list-item>
<list-item><p>Physician visits by the same patient are correlated with each other leading to co-linearity issues in the building all the models in this study. As a consequence, we removed collinearity by preprocessing the data with the partial least squares (PLS) algorithm, which is designed to minimize the effects of collinearity.</p></list-item>
<list-item><p>The results should be biologically interpretable, which is a ubiquitous concern of statistical modeling and will be a constraint on variable panel selection. As a consequence, we relied on data, that are available in daily clinical routine (e.g., blood pressure urinary albumin excretion). These variables were complemented urinary or plasma proteins that were identified to be part of DKD pathophysiology and molecular drug mode of action by bioinformatical analysis. The complete list of parameters available is given in <xref ref-type="supplementary-material" rid="SM1">Supplementary Table 1</xref>.</p></list-item>
</list>
<p>Variables were selected from the complete PROVALID data set and a subset of PROVALID as suggested by experts in (<xref ref-type="bibr" rid="B22">22</xref>) (<bold>Table2</bold>). Only continuous but not discrete and binary variables were included. We used the partial least squares algorithm to determine the baseline variables that were most accurately correlated with &#x00394;eGFR in the complete PROVALID set. We did the same for the subset of variables in the expert selection, and we combined the most important variables from each calculation into a single data set and performed the PLS calculation on this combined set, selecting the most important variables (see the nine variables selected in <bold>Table 2</bold>). We then used a hybrid machine-learning technique (see <xref ref-type="app" rid="A1">Appendix</xref>) to predict &#x00394;eGFR for the group of patients treated with RASi only. The model (PLSNN) is a combination of partial least squares (PLS) and normalized radial basis function neural network (NN). The prediction of &#x00394;eGFR for the RASi-only set of patients is the composite biomarker &#x00394;<sub><italic>R</italic></sub>, which will allow the physician to estimate &#x00394;eGFR within the next year (and thus the state of CD or UCD) in case the patient remains on RASi only. In case UCD is predicted, similar models for the other treatment option groups will enable the clinician to select the best option to maintain kidney function.</p>
</sec>
<sec sec-type="results" id="s3">
<title>3. Results</title>
<p>The nine continuous input variables as given by experts in (<xref ref-type="bibr" rid="B22">22</xref>, <xref ref-type="bibr" rid="B23">23</xref>) are displayed in <xref ref-type="table" rid="T1">Table 1</xref>. Discrete variables were not included in this study because the modeling process used here is restricted to continuous inputs. The highest PLS-ranked continuous variables from the PROVALID set and the expert data set were combined, re-ranked by PLS, and the consensus file is displayed in <xref ref-type="table" rid="T2">Table 2</xref>. The <xref ref-type="fig" rid="F1">Figure 1</xref> upper left panel shows the relation between &#x00394;<sub><italic>R</italic></sub> and &#x00394;eGFR in the RASi-only treatment group (black dots). A decrease of 10% or more of &#x00394;<sub><italic>R</italic></sub> characterizes patients with UCD (drop in eGFR more than 10%, dotted green lines) and higher values of &#x00394;<sub><italic>R</italic></sub> those with CD (dashed green lines). The upper right and the lower panels show the observations for the add-on treatments (colored dots) vs. the RASi-only model prediction. The RASi-only model predicted well for individuals with CD regardless of the type of add-on therapy. On the other hand, patients in whom the RASi-only model predicted UCD clearly showed a different outcome when drugs were added, with most moving to the CD population. Of note, the lower the &#x00394;<sub><italic>R</italic></sub> is, the larger is the effect of the add-on drug. This supports the hypothesis that addressing a different pathophysiology via a specific drug mode of action is beneficial in patients with a disease trajectory unresponsive to RASi therapy alone. As &#x00394;<sub><italic>R</italic></sub> developed for RASi to predict &#x00394;eGFR obviously was not accurate in the add-on therapy groups, we developed models for the individual groups using the same variables. Prediction models were developed in each of the four treatment populations, and the variable ranking regarding informational contribution within each group (providing insight into pathophysiology) is displayed in <xref ref-type="table" rid="T3">Table 3</xref>. The models were tested on each of the four treatment populations. The predictions of &#x00394;eGFR and sensitivity as well as specificity and accuracy for allocation of patients to CD and UCD for RASi only, RASi &#x0002B; GLP1a, RASi &#x0002B; MCRa, and RASi &#x0002B; SGLT2i provided by &#x00394;<sub><italic>R</italic></sub>, &#x00394;<sub><italic>G</italic></sub>, &#x00394;<sub><italic>M</italic></sub>, and &#x00394;<sub><italic>S</italic></sub>, respectively are given in <xref ref-type="table" rid="T4">Table 4</xref>. These models are used to calculate the expected increase/decrease in &#x00394;eGFR, which can be used to inform the clinician on whether or not to prescribe the add-on drug (<xref ref-type="fig" rid="F2">Figure 2</xref>).</p>
<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption><p>Expert selection of key continuous predictors.</p></caption>
<table frame="box" rules="all">
<thead>
<tr style="background-color:&#x00023;919498;color:&#x00023;ffffff">
<th valign="top" align="left"><bold>Marker</bold></th>
<th valign="top" align="left"><bold>Symbol</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Estimated glomerular flow rate</td>
<td valign="top" align="left">eGFR</td>
</tr>
<tr>
<td valign="top" align="left">Urine albumin-creatinine ratio</td>
<td valign="top" align="left">UACR</td>
</tr>
<tr>
<td valign="top" align="left">Systolic blood pressure</td>
<td valign="top" align="left">SBP</td>
</tr>
<tr>
<td valign="top" align="left">Diastolic blood pressure</td>
<td valign="top" align="left">DBP</td>
</tr>
<tr>
<td valign="top" align="left">Hemoglobin</td>
<td valign="top" align="left">HB</td>
</tr>
<tr>
<td valign="top" align="left">Serum cholesterol</td>
<td valign="top" align="left">TOTCHOL</td>
</tr>
<tr>
<td valign="top" align="left">Body mass index</td>
<td valign="top" align="left">BMI</td>
</tr>
<tr>
<td valign="top" align="left">HbA<sub>1<italic>c</italic></sub></td>
<td valign="top" align="left">HBA1C</td>
</tr>
<tr>
<td valign="top" align="left">Age</td>
<td valign="top" align="left">Age</td>
</tr></tbody>
</table>
</table-wrap>
<table-wrap position="float" id="T2">
<label>Table 2</label>
<caption><p>Reduced data set.</p></caption>
<table frame="box" rules="all">
<thead>
<tr style="background-color:&#x00023;919498;color:&#x00023;ffffff">
<th valign="top" align="left"><bold>Marker</bold></th>
<th valign="top" align="left"><bold>Name</bold></th>
<th valign="top" align="left"><bold>Data set</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">eGFR</td>
<td valign="top" align="left">Estimated glomerular filtration rate</td>
<td valign="top" align="left">Expert</td>
</tr>
<tr>
<td valign="top" align="left">DPP4</td>
<td valign="top" align="left">Dipeptidyl peptidase-4</td>
<td valign="top" align="left">Extended</td>
</tr>
<tr>
<td valign="top" align="left">ICAM1</td>
<td valign="top" align="left">Intercellular Adhesion Molecule 1</td>
<td valign="top" align="left">Extended</td>
</tr>
<tr>
<td valign="top" align="left">LEP</td>
<td valign="top" align="left">Leptin</td>
<td valign="top" align="left">Extended</td>
</tr>
<tr>
<td valign="top" align="left">AGE</td>
<td valign="top" align="left">Age</td>
<td valign="top" align="left">Expert</td>
</tr>
<tr>
<td valign="top" align="left">ADIPOQ</td>
<td valign="top" align="left">Adiponectin</td>
<td valign="top" align="left">Extended</td>
</tr>
<tr>
<td valign="top" align="left">TOTCHOL</td>
<td valign="top" align="left">Total serum cholesterol</td>
<td valign="top" align="left">Expert</td>
</tr>
<tr>
<td valign="top" align="left">SBP</td>
<td valign="top" align="left">Systolic blood pressure</td>
<td valign="top" align="left">Expert</td>
</tr>
<tr>
<td valign="top" align="left">SERPINE1</td>
<td valign="top" align="left">Plasminogen activator inhibitor-1</td>
<td valign="top" align="left">Extended</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p>The PROVALID identifiers are displayed in the left column. The data sources are given in the far right column. The labels &#x0201C;Expert&#x0201D; are from the expert data set. Those labeled &#x0201C;Extended&#x0201D; are from the PROVALID dataset that are not also in the expert set.</p>
</table-wrap-foot>
</table-wrap>
<fig id="F1" position="float">
<label>Figure 1</label>
<caption><p>PROVALID data output &#x00394;eGFR as a function of the composite biomarker &#x00394;<sub><italic>R</italic></sub>. Here, &#x00394;<sub><italic>R</italic></sub> is the predicted output for the RASi Alone model. The black markers represent data for RASi only, and the colored markers represent data for the add-on drugs. If the colored markers have greater values for &#x00394;<italic>e</italic>GFR than the black markers, then possible benefit from the add-on drug may be indicated. The green dashed line indicates values for &#x00394;<italic>e</italic>GFR and &#x00394;<sub><italic>R</italic></sub> that are equal to &#x02212;5%. The dotted green lines are for values of &#x02212;10%. These values are often used as markers for controlled and uncontrolled DKD.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fmed-10-1271407-g0001.tif"/>
</fig>
<table-wrap position="float" id="T3">
<label>Table 3</label>
<caption><p>Top five biomarkers for each treatment population.</p></caption>
<table frame="box" rules="all">
<thead>
<tr style="background-color:&#x00023;919498;color:&#x00023;ffffff">
<th valign="top" align="left"><bold>RASi alone</bold></th>
<th valign="top" align="left"><bold>RASi &#x0002B; GLP1a</bold></th>
<th valign="top" align="left"><bold>RASi &#x0002B; MCRa</bold></th>
<th valign="top" align="left"><bold>RASi &#x0002B; SGLT2i</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">eGFR</td>
<td valign="top" align="left">LEP</td>
<td valign="top" align="left">DPP4</td>
<td valign="top" align="left">LEP</td>
</tr>
<tr>
<td valign="top" align="left">DPP4</td>
<td valign="top" align="left">DPP4</td>
<td valign="top" align="left">LEP</td>
<td valign="top" align="left">SERPINE1</td>
</tr>
<tr>
<td valign="top" align="left">ICAM1</td>
<td valign="top" align="left">eGFR</td>
<td valign="top" align="left">eGFR</td>
<td valign="top" align="left">DPP4</td>
</tr>
<tr>
<td valign="top" align="left">LEP</td>
<td valign="top" align="left">ICAM1</td>
<td valign="top" align="left">TOTCHOL</td>
<td valign="top" align="left">eGFR</td>
</tr>
<tr>
<td valign="top" align="left">AGE</td>
<td valign="top" align="left">ADIPOQ</td>
<td valign="top" align="left">ICAM1</td>
<td valign="top" align="left">TOTCHOL</td>
</tr></tbody>
</table>
<table-wrap-foot>
<p>The columns represent the variables, in descending rank order, that are important for each treatment model. For instance, in the model for the population that took GLP1a as an add-on treatment, LEP had the greatest effect on the prediction.</p>
</table-wrap-foot>
</table-wrap>
<table-wrap position="float" id="T4">
<label>Table 4</label>
<caption><p>Diagnostics of model quality for four treatment models.</p></caption>
<table frame="box" rules="all">
<thead>
<tr style="background-color:&#x00023;919498;color:&#x00023;ffffff">
<th valign="top" align="left"><bold>Model</bold></th>
<th valign="top" align="left"><bold>Output</bold></th>
<th valign="top" align="left"><bold>ACC</bold></th>
<th valign="top" align="left"><bold>SE</bold></th>
<th valign="top" align="left"><bold>SP</bold></th>
<th valign="top" align="left"><bold>&#x00023; patients</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">RASi alone</td>
<td valign="top" align="left">&#x00394;<sub><italic>R</italic></sub></td>
<td valign="top" align="left">0.78</td>
<td valign="top" align="left">0.50</td>
<td valign="top" align="left">0.93</td>
<td valign="top" align="left">277</td>
</tr>
<tr>
<td valign="top" align="left">RASi &#x0002B; GLP1a</td>
<td valign="top" align="left">&#x00394;<sub><italic>G</italic></sub></td>
<td valign="top" align="left">0.92</td>
<td valign="top" align="left">0.93</td>
<td valign="top" align="left">0.92</td>
<td valign="top" align="left">52</td>
</tr>
<tr>
<td valign="top" align="left">RASi &#x0002B; MCRa</td>
<td valign="top" align="left">&#x00394;<sub><italic>M</italic></sub></td>
<td valign="top" align="left">0.87</td>
<td valign="top" align="left">0.77</td>
<td valign="top" align="left">0.92</td>
<td valign="top" align="left">64</td>
</tr>
<tr>
<td valign="top" align="left">RASi &#x0002B; SGLT2i</td>
<td valign="top" align="left">&#x00394;<sub><italic>S</italic></sub></td>
<td valign="top" align="left">0.93</td>
<td valign="top" align="left">0.81</td>
<td valign="top" align="left">0.97</td>
<td valign="top" align="left">104</td>
</tr></tbody>
</table>
<table-wrap-foot>
<p>The predictions of &#x00394;<italic>e</italic>GFR for RASi alone, RASi &#x0002B; GLP1a, RASi &#x0002B; MCRa, and RASi &#x0002B; SGLT2i are given by &#x00394;<sub><italic>R</italic></sub>, &#x00394;<sub><italic>G</italic></sub>, &#x00394;<sub><italic>M</italic></sub>, and &#x00394;<sub><italic>S</italic></sub>, respectively. The quantity &#x00394;<sub><italic>R</italic></sub> is the composite biomarker. The quantities &#x00394;<sub><italic>G</italic></sub>, &#x00394;<sub><italic>M</italic></sub>, and &#x00394;<sub><italic>S</italic></sub> are the model outputs for RASi plus GLP1a, RASi plus MCRa, and RASi plus SGLT2i, respectively. The data are divided into UCD and CD. Model output predictions were performed using leave-one-out validation performed on the entire population for each treatment. Sensitivity (SE) is the fraction of observed UCD patients that were predicted correctly. Specificity (SP) is the fraction of observed CD patients that were predicted correctly. Accuracy (ACC) is the total number of patients that were predicted correctly. The number &#x00023; of patients in each population is displayed in the last column. As explained in the <xref ref-type="app" rid="A1">Appendix</xref>, the models contain random number generators, which causes slight run-to-run variation in outputs for the same data set.</p>
</table-wrap-foot>
</table-wrap>
<fig id="F2" position="float">
<label>Figure 2</label>
<caption><p>Model outputs for RASi only (black) and RASi plus add-on drugs (colored) vs. the composite biomarker &#x00394;<sub><italic>R</italic></sub>. The add-on outputs are the expectation of &#x00394;eGFR, just as the case for RASi-only. These outputs are designated &#x00394;<sub><italic>G</italic></sub>, &#x00394;<sub><italic>M</italic></sub>, and &#x00394;<sub><italic>S</italic></sub> for GLP1a, MCRa, and SGLT2i, respectively. The vertical distance between the add-on model and the RASi-only model is the expected increase/decrease in &#x00394;eGFR for a patient with composite biomarker &#x00394;<sub><italic>R</italic></sub> and administration of the add-on drug. The use of models allows direct comparison of the add-on drug outcome to the RASi-only outcome. The models can be calculated for any values of input biomarkers, while the actual data of <xref ref-type="fig" rid="F1">Figure 1</xref> only contains output data for a discrete set of sample inputs and, thus, cannot give comparisons for all values of input biomarkers.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fmed-10-1271407-g0002.tif"/>
</fig></sec>
<sec sec-type="discussion" id="s4">
<title>4. Discussion</title>
<p>In this study, we identified a composite biomarker panel that predicts the annual change in &#x00394;eGFR for four different drug treatments. The baseline treatment was the blockage of the renin angiotensin system by ACEi or ARB therapy. Next, three additional drugs on top of RASi, SGLT2i, MCRa, or GLP1a, were tested. Only one add-on drug at a time was allowed on top of RASi treatment in our dataset. We do not have data on multi-drug combination therapies. Higher estimated increase of eGFR for add-on patients compared with RASi-alone patients indicates that prognosis is improved with the add-on treatment. The personalized biomarker value thus identifies which patients may benefit from the additional treatment.</p>
<p>Several studies have addressed mid- to long-term prognostic and predictive biomarkers in DKD and found reasonable discrimination on a cohort level. However, for individuals with their sensitivity and specificity is modest at its best (<xref ref-type="bibr" rid="B24">24</xref>) at least partially due to longitudinal intra-individual variability in progression. Consequently, our approach relies on short-term prediction and a direct comparison of published mid- to long-term markers with our composite short-term biomarker is not adequate.</p>
<p>An added value of the composite biomarker is that it increases the resolution of biomarkers to identify patients that respond differently to treatments. This can be seen in <xref ref-type="fig" rid="F1">Figures 1</xref>, <xref ref-type="fig" rid="F2">2</xref>, where the composite biomarker identifies a specific cluster of low-&#x00394;<sub><italic>R</italic></sub> patients that respond positively to add-on treatments.</p>
<p>The study was motivated by the need for precision treatment for DKD. Precision drug therapy is becoming increasingly important in this area as more and more options to intervene become available. Several efforts to predict inter-individual differences in kidney disease progression to &#x0201C;hard&#x0201D; long-term outcome endpoints (incidence of e.g., end-stage kidney disease) under specific therapies have already been undertaken. While the identified markers/ or marker panels show some promise in cohorts, their accuracy at the level of an individual is modest, limiting their value in bedside medicine. One reason for this shortcoming is the fact that progression of chronic kidney disease (e.g., as assessed by a decrease in eGFR) also shows considerable variability within an individual over time. Even under stable drug therapy, periods of falling eGFR can be followed by recovery under stable treatment (<xref ref-type="bibr" rid="B21">21</xref>). Our study design respects this aspect by restricting predictions to relatively short (annual) intervals of follow-up. Of note, this approach closely follows current guidelines that recommend repetitive annual assessment of eGFR to adjust the treatment strategy (<xref ref-type="bibr" rid="B25">25</xref>). Clearly, the magnitude of change in eGFR to detect is smaller with shorter follow-up and a &#x0201C;misclassification&#x0201D; based on spontaneous eGFR variability must be taken into account. Our discriminatory threshold for the definition of CD and UCD takes these caveats also into consideration.</p>
<p>The modeling process was constrained by the large number of possible inputs and a small amount of available data in relation to the number of possible inputs. To address these constraints, we reduced the number of variables by identifying those variables that had the biggest effect on the output &#x00394;eGFR. We also removed collinear variables that contained redundant information. We used PLS, which is a linear process, to achieve both these goals (<xref ref-type="sec" rid="A1">Appendix</xref>). We also addressed the constraint that the chosen reduced set of variables must include inputs that are measurable in a clinical setting and that are reasonably familiar to clinicians. To do this, we heuristically ran both data sets generated by experts and the complete PROVALID data set through PLS pre-selection. We then combined the highest ranking inputs from both data sets into a single reduced data set (<xref ref-type="table" rid="T2">Table 2</xref>). We then used the reduced data set including the PLS regression output as inputs to a non-linear neural network model that is designed to extract information from small amounts of data as can be found in control problems (<xref ref-type="bibr" rid="B26">26</xref>). Managing disease treatments is a biological control problem. The output from the neural network is the composite biomarker &#x00394;<sub><italic>R</italic></sub> used to identify optimal treatment regimes. This is done by comparing observed and predicted outcomes from various treatments with each other.</p>
<p>The most immediate use of the composite biomarker is to inform the clinician on the predicted change of &#x00394;eGFR if a treatment with an add-on drugs is applied. The model possibly may be used to access the particular disease pathway in each patient. For instance, the data and model predictions of <xref ref-type="fig" rid="F1">Figures 1</xref>, <xref ref-type="fig" rid="F2">2</xref> indicate that add-on treatments may be preventing outcome degradation for sicker patients with lower values of the composite biomarker &#x00394;<sub><italic>R</italic></sub>. An examination of the fundamental biomarkers for these low-&#x00394;<sub><italic>R</italic></sub> patients may indicate the mechanism that prevents this degradation in outcome. This is currently under investigation. This information may identify additional drug targets.</p>
<p>The biomarkers were identified by an heuristic approach on a set of continuous variables and without consideration of proteomics. A more exhaustive inclusion practice (e.g., by mining urinary proteomics data) may very well identify other characteristics that add to or substitute for components. On the other hand, the markers finally entering the algorithm ideally are reasonably accessible and allow pathophysiological interpretation as this increases acceptance of healthcare providers, payers, and physicians. Another weakness of our current model is that we were restricted to continuous markers as inputs, leaving out discrete and binary variables. We are currently exploring the possibilities of including them as well. Finally, the model was built and validated on the PROVALID data set. Other data sets are in preparation for external validation. The basic principle of our approach is that longitudinal intra-individual variability in progression decreases the accuracy of any prediction marker with extended follow-up periods. This will be the topic of a follow-on study. However, one specific property of the model is that it predicts the change in eGFR 1 year in advance. It is possible to extend the model to predict multiple years in advance; thus, it is possible to extend the model to predict multiple repetitive years. This will require that the model also predicts all fundamental biomarkers 1 year in advance, rather than just the output &#x00394;eGFR. This will require that the model predict all fundamental biomarkers 1 year in advance, rather than just the output &#x00394;eGFR. The prediction can then be iterated to provide predictions multiple years in advance. This process is under study.</p>
<p>In summary, this study identifies a composite biomarker for DKD that is an aggregate of fundamental biomarkers easily accessible to clinicians. The composite biomarker can be used to inform the decision to maintain a patient on a RASi-only treatment or to add GLP1a, MCRa, or SGLT2i to the RASi treatment. Clinical access to this model and related models is currently being developed, tested, and prepared for the approval process.</p></sec>
<sec sec-type="data-availability" id="s5">
<title>Data availability statement</title>
<p>The data analyzed in this study is subject to the following licenses/restrictions: data owned by the European Union DC-ren project. Requests to access these datasets should be directed to GM, <email>gert.mayer&#x00040;i-med.ac.at</email>.</p></sec>
<sec sec-type="ethics-statement" id="s6">
<title>Ethics statement</title>
<p>The studies involving human participants were reviewed and approved by the Ethics Committee of the Medical University Innsbruck; DC-ren approval number: EK Nr:1188/2020, date 19.06.2020. The DC-ren cohort consists of patients from PROVALID and written informed consent to participate in this study was obtained from all patients.</p>
<p>The PROVALID dataset used in this study was approved by the local Institutional Review Board (IRB) in each participating country, and are listed below. Signing an informed consent was a prerequisite for study participation in all countries.</p>
<p>Austria: Ethical approval from the Ethics Committee of the Medical University Innsbruck AN4959 322/4.5370/5.9 (4012a); 29.01.2013 and approval of the Ethics Committee of Upper Austria, Study Nr. I-1-11; 30.12.2010. Hungary: Approval from Semmelweis University, Regional and Institutional Committee Of Science And Research Ethics; No.12656-0/2011-EKU (421/PV11.);17.06.2011. United Kingdom: Approval from WoSRES, NHS; Rec. Reference:12/WS/0005 (13.01.2012). Netherlands: Approval of the Medical Ethical Committee of the University Medical Center Groningen, ABRnr. NL35350.042.11. Poland: Approval from Ethics Committee of the Medical University of Silesia, KNW/022/KB1/78/11/, date 07.06.2011.</p></sec>
<sec sec-type="author-contributions" id="s7">
<title>Author contributions</title>
<p>RJ: Conceptualization, Formal analysis, Investigation, Methodology, Software, Validation, Visualization, Writing&#x02014;original draft, review, and editing. SA: Writing&#x02014;review and editing. VD: Writing&#x02014;review and editing. GM: Conceptualization, Funding acquisition, Project administration, Supervision, Writing&#x02014;original draft, review, and editing. IP: Conceptualization, Formal analysis, Funding acquisition, Investigation, Project administration, Supervision, Validation, Writing&#x02014;review and editing. CS: Data curation, Writing&#x02014;review and editing. DS: Writing&#x02014;review and editing.</p></sec>
</body>
<back>
<sec sec-type="funding-information" id="s8">
<title>Funding</title>
<p>The author(s) declare financial support was received for the research, authorship, and/or publication of this article. Funded by the European Union&#x00027;s Horizon 2020 research and innovation programme under grant agreement No 848011. Views and opinions expressed are however those of the author(s) only and do not necessarily reflect those of the European Union or Innovative Medicines Initiative 2 Joint Undertaking (Grant No. 115974, 2015). Neither the European Union nor the granting authority can be held responsible for them.</p>
</sec>
<ack><p>The authors would like to acknowledge many useful reviews and conversations with all the members of the DC-ren consortium (<ext-link ext-link-type="uri" xlink:href="https://dc-ren.eu/">https://dc-ren.eu/</ext-link>).</p>
</ack>
<sec sec-type="COI-statement" id="conf1">
<title>Conflict of interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest. The author(s) declared that they were an editorial board member of Frontiers, at the time of submission. This had no impact on the peer review process and the final decision.</p>
</sec>
<sec sec-type="disclaimer" id="s9">
<title>Publisher&#x00027;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<sec sec-type="supplementary-material" id="s10">
<title>Supplementary material</title>
<p>The Supplementary Material for this article can be found online at: <ext-link ext-link-type="uri" xlink:href="https://www.frontiersin.org/articles/10.3389/fmed.2023.1271407/full#supplementary-material">https://www.frontiersin.org/articles/10.3389/fmed.2023.1271407/full#supplementary-material</ext-link></p>
<supplementary-material xlink:href="Data_Sheet_1.pdf" id="SM1" mimetype="application/pdf" xmlns:xlink="http://www.w3.org/1999/xlink"/></sec>
<ref-list>
<title>References</title>
<ref id="B1">
<label>1.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Koenig</surname> <given-names>IR</given-names></name> <name><surname>Fuchs</surname> <given-names>O</given-names></name> <name><surname>Hansen</surname> <given-names>G</given-names></name> <name><surname>von Mutius</surname> <given-names>E</given-names></name> <name><surname>Kopp</surname> <given-names>MV</given-names></name></person-group>. <article-title>What is precision medicine?</article-title> <source>Eur Respirat J.</source> (<year>2017</year>) <fpage>50</fpage>. <pub-id pub-id-type="doi">10.1183/13993003.00391-2017</pub-id></citation>
</ref>
<ref id="B2">
<label>2.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kosorok</surname> <given-names>MR</given-names></name> <name><surname>Laber</surname> <given-names>EB</given-names></name></person-group>. <article-title>Precision medicine</article-title>. <source>Annu Rev Stat Appl.</source> (<year>2019</year>) <volume>6</volume>:<fpage>263</fpage>&#x02013;<lpage>86</lpage>. <pub-id pub-id-type="doi">10.1146/annurev-statistics-030718-105251</pub-id></citation>
</ref>
<ref id="B3">
<label>3.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ginsburg</surname> <given-names>GS</given-names></name> <name><surname>Phillips</surname> <given-names>KA</given-names></name></person-group>. <article-title>Precision medicine: from science to value</article-title>. <source>Health Aff.</source> (<year>2018</year>) <volume>37</volume>:<fpage>694</fpage>&#x02013;<lpage>701</lpage>. <pub-id pub-id-type="doi">10.1377/hlthaff.2017.1624</pub-id></citation>
</ref>
<ref id="B4">
<label>4.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pugliese</surname> <given-names>G</given-names></name> <name><surname>Penno</surname> <given-names>G</given-names></name> <name><surname>Natali</surname> <given-names>A</given-names></name> <name><surname>Barutta</surname> <given-names>F</given-names></name> <name><surname>Di Paolo</surname> <given-names>S</given-names></name> <name><surname>Reboldi</surname> <given-names>G</given-names></name> <etal/></person-group>. <article-title>Diabetic kidney disease: new clinical and therapeutic issues. Joint position statement of the Italian Diabetes Society and the Italian Society of Nephrology on &#x0201C;The natural history of diabetic kidney disease and treatment of hyperglycemia in patients with type 2 diabetes and impaired renal function&#x0201D;</article-title>. <source>Nutr Metab Cardiovasc Dis</source>. (<year>2019</year>) <volume>29</volume>:<fpage>1127</fpage>&#x02013;<lpage>50</lpage>. <pub-id pub-id-type="doi">10.1007/s40620-019-00650-x</pub-id></citation>
</ref>
<ref id="B5">
<label>5.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fu</surname> <given-names>J</given-names></name> <name><surname>Lee</surname> <given-names>K</given-names></name> <name><surname>Chuang</surname> <given-names>PY</given-names></name> <name><surname>Liu</surname> <given-names>Z</given-names></name> <name><surname>He</surname> <given-names>JC</given-names></name></person-group>. <article-title>Glomerular endothelial cell injury and cross talk in diabetic kidney disease</article-title>. <source>Am J Physiol Renal Physiol.</source> (<year>2015</year>) <volume>308</volume>:<fpage>F287</fpage>&#x02013;<lpage>97</lpage>. <pub-id pub-id-type="doi">10.1152/ajprenal.00533.2014</pub-id><pub-id pub-id-type="pmid">25411387</pub-id></citation></ref>
<ref id="B6">
<label>6.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nangaku</surname> <given-names>M</given-names></name></person-group>. <article-title>Chronic hypoxia and tubulointerstitial injury: a final common pathway to end-stage renal failure</article-title>. <source>J Am Soc Nephrol</source>. (<year>2006</year>) <volume>17</volume>:<fpage>17</fpage>&#x02013;<lpage>25</lpage>. <pub-id pub-id-type="doi">10.1681/ASN.2005070757</pub-id><pub-id pub-id-type="pmid">15361693</pub-id></citation></ref>
<ref id="B7">
<label>7.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chang</surname> <given-names>J</given-names></name> <name><surname>Yan</surname> <given-names>J</given-names></name> <name><surname>Li</surname> <given-names>X</given-names></name> <name><surname>Liu</surname> <given-names>N</given-names></name> <name><surname>Zheng</surname> <given-names>R</given-names></name> <name><surname>Zhong</surname> <given-names>Y</given-names></name></person-group>. <article-title>Update on the mechanisms of tubular cell injury in diabetic kidney disease</article-title>. <source>Front Med.</source> (<year>2021</year>) <volume>8</volume>:<fpage>661076</fpage>. <pub-id pub-id-type="doi">10.3389/fmed.2021.661076</pub-id><pub-id pub-id-type="pmid">33859992</pub-id></citation></ref>
<ref id="B8">
<label>8.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kussmann</surname> <given-names>M</given-names></name> <name><surname>Morine</surname> <given-names>M</given-names></name> <name><surname>Hager</surname> <given-names>J</given-names></name> <name><surname>Sonderegger</surname> <given-names>B</given-names></name> <name><surname>Kaput</surname> <given-names>J</given-names></name></person-group>. <article-title>Perspective: a systems approach to diabetes research</article-title>. <source>Front Genet.</source> (<year>2013</year>) 4, 205. <pub-id pub-id-type="doi">10.3389/fgene.2013.00205</pub-id><pub-id pub-id-type="pmid">24187547</pub-id></citation></ref>
<ref id="B9">
<label>9.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Garralda</surname> <given-names>E</given-names></name> <name><surname>Dienstmann</surname> <given-names>R</given-names></name> <name><surname>Piris-Gim&#x000E9;nez</surname> <given-names>A</given-names></name> <name><surname>Bra&#x000F1;a</surname> <given-names>I</given-names></name> <name><surname>Rodon</surname> <given-names>J</given-names></name> <name><surname>Tabernero</surname> <given-names>J</given-names></name></person-group>. <article-title>New clinical trial designs in the era of precision medicine</article-title>. <source>Mol Oncol.</source> (<year>2019</year>) <volume>13</volume>:<fpage>549</fpage>&#x02013;<lpage>57</lpage>. <pub-id pub-id-type="doi">10.1002/1878-0261.12465</pub-id><pub-id pub-id-type="pmid">30698321</pub-id></citation></ref>
<ref id="B10">
<label>10.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cardon</surname> <given-names>LR</given-names></name> <name><surname>Harris</surname> <given-names>T</given-names></name></person-group>. <article-title>Precision medicine, genomics and drug discovery</article-title>. <source>Hum Mol Genet.</source> (<year>2016</year>) <volume>25</volume>:<fpage>R166</fpage>&#x02013;<lpage>72</lpage>. <pub-id pub-id-type="doi">10.1093/hmg/ddw246</pub-id><pub-id pub-id-type="pmid">27538422</pub-id></citation></ref>
<ref id="B11">
<label>11.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Thomas</surname> <given-names>MC</given-names></name> <name><surname>Atkins</surname> <given-names>RC</given-names></name></person-group>. <article-title>Blood pressure lowering for the prevention and treatment of diabetic kidney disease</article-title>. <source>Drugs.</source> (<year>2006</year>) <volume>66</volume>:<fpage>2213</fpage>&#x02013;<lpage>34</lpage>. <pub-id pub-id-type="doi">10.2165/00003495-200666170-00005</pub-id><pub-id pub-id-type="pmid">17137404</pub-id></citation></ref>
<ref id="B12">
<label>12.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Leehey</surname> <given-names>DJ</given-names></name> <name><surname>Singh</surname> <given-names>AK</given-names></name> <name><surname>Alavi</surname> <given-names>N</given-names></name> <name><surname>Singh</surname> <given-names>R</given-names></name></person-group>. <article-title>Role of angiotensin II in diabetic nephropathy</article-title>. <source>Kidney Int.</source> (<year>2000</year>) <volume>58</volume>:<fpage>S93</fpage>&#x02013;<lpage>8</lpage>. <pub-id pub-id-type="doi">10.1046/j.1523-1755.2000.07715.x</pub-id></citation>
</ref>
<ref id="B13">
<label>13.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jones</surname> <given-names>RD</given-names></name> <name><surname>Jones</surname> <given-names>AM</given-names></name></person-group>. <article-title>Model of ligand-triggered information transmission in G-protein coupled receptor complexes</article-title>. <source>Front Endocrinol</source>. (<year>2023</year>) <volume>14</volume>:<fpage>879</fpage>. <pub-id pub-id-type="doi">10.3389/fendo.2023.1111594</pub-id><pub-id pub-id-type="pmid">37361529</pub-id></citation></ref>
<ref id="B14">
<label>14.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rajagopal</surname> <given-names>S</given-names></name> <name><surname>Ahn</surname> <given-names>S</given-names></name> <name><surname>Rominger</surname> <given-names>DH</given-names></name> <name><surname>Gowen-MacDonald</surname> <given-names>W</given-names></name> <name><surname>Lam</surname> <given-names>CM</given-names></name> <name><surname>DeWire</surname> <given-names>SM</given-names></name> <etal/></person-group>. <article-title>Quantifying ligand bias at seven-transmembrane receptors</article-title>. <source>Mol Pharmacol.</source> (<year>2011</year>) <volume>80</volume>:<fpage>367</fpage>&#x02013;<lpage>77</lpage>. <pub-id pub-id-type="doi">10.1124/mol.111.072801</pub-id><pub-id pub-id-type="pmid">21610196</pub-id></citation></ref>
<ref id="B15">
<label>15.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Latorraca</surname> <given-names>NR</given-names></name> <name><surname>Masureel</surname> <given-names>M</given-names></name> <name><surname>Hollingsworth</surname> <given-names>SA</given-names></name> <name><surname>Heydenreich</surname> <given-names>FM</given-names></name> <name><surname>Suomivuori</surname> <given-names>CM</given-names></name> <name><surname>Brinton</surname> <given-names>C</given-names></name> <etal/></person-group>. <article-title>How GPCR phosphorylation patterns orchestrate arrestin-mediated signaling</article-title>. <source>Cell.</source> (<year>2020</year>) <volume>183</volume>:<fpage>1813</fpage>&#x02013;<lpage>25</lpage>. <pub-id pub-id-type="doi">10.1016/j.cell.2020.11.014</pub-id><pub-id pub-id-type="pmid">33296703</pub-id></citation></ref>
<ref id="B16">
<label>16.</label>
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Mayer</surname> <given-names>G</given-names></name> <name><surname>Eder</surname> <given-names>S</given-names></name> <name><surname>Rosivall</surname> <given-names>L</given-names></name> <name><surname>Voros</surname> <given-names>P</given-names></name> <name><surname>Lambers Heerspink</surname> <given-names>H</given-names></name> <name><surname>de Zeeuw</surname> <given-names>D</given-names></name> <etal/></person-group>. <article-title>MP427 Baseline Data from the Multinational Prospective Cohort Study for Validation of Biomarkers (Provalid)</article-title>. <publisher-loc>Kettering</publisher-loc>: <publisher-name>Oxford University Press</publisher-name> (<year>2016</year>). <pub-id pub-id-type="doi">10.1093/ndt/gfw193.01</pub-id></citation>
</ref>
<ref id="B17">
<label>17.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Eder</surname> <given-names>S</given-names></name> <name><surname>Leierer</surname> <given-names>J</given-names></name> <name><surname>Kerschbaum</surname> <given-names>J</given-names></name> <name><surname>Rosivall</surname> <given-names>L</given-names></name> <name><surname>Wiecek</surname> <given-names>A</given-names></name> <name><surname>de Zeeuw</surname> <given-names>D</given-names></name> <etal/></person-group>. <article-title>A prospective cohort study in patients with type 2 diabetes mellitus for validation of biomarkers (PROVALID)&#x02013;study design and baseline characteristics</article-title>. <source>Kidney Blood Pressure Res.</source> (<year>2018</year>) <volume>43</volume>:<fpage>181</fpage>&#x02013;<lpage>90</lpage>. <pub-id pub-id-type="doi">10.1159/000487500</pub-id><pub-id pub-id-type="pmid">29466797</pub-id></citation></ref>
<ref id="B18">
<label>18.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Th&#x000F6;ni</surname> <given-names>S</given-names></name> <name><surname>Keller</surname> <given-names>F</given-names></name> <name><surname>Denicolo</surname> <given-names>S</given-names></name> <name><surname>Eder</surname> <given-names>S</given-names></name> <name><surname>Rosivall</surname> <given-names>L</given-names></name> <name><surname>Wiecek</surname> <given-names>AJ</given-names></name> <etal/></person-group>. <article-title>MO514 cardiorenal outcomes and mortality in patients with type 2 diabetes mellitus: a multinational prospective cohort study (provalid)</article-title>. <source>Nephrol Dial Transplant.</source> (<year>2021</year>) <volume>36</volume>(<supplement>Suppl_1</supplement>):<fpage>gfab087</fpage>. <pub-id pub-id-type="doi">10.1159/000528438</pub-id></citation>
</ref>
<ref id="B19">
<label>19.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Eder</surname> <given-names>S</given-names></name> <name><surname>Leierer</surname> <given-names>J</given-names></name> <name><surname>Kerschbaum</surname> <given-names>J</given-names></name> <name><surname>Rosivall</surname> <given-names>L</given-names></name> <name><surname>Wiecek</surname> <given-names>A</given-names></name> <name><surname>de Zeeuw</surname> <given-names>D</given-names></name> <etal/></person-group>. <article-title>Guidelines and clinical practice at the primary level of healthcare in patients with type 2 diabetes mellitus with and without kidney disease in five European countries</article-title>. <source>Diab Vasc Dis Res.</source> (<year>2019</year>) <volume>16</volume>:<fpage>47</fpage>&#x02013;<lpage>56</lpage>. <pub-id pub-id-type="doi">10.1177/1479164118795559</pub-id><pub-id pub-id-type="pmid">30238781</pub-id></citation></ref>
<ref id="B20">
<label>20.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dias</surname> <given-names>AH</given-names></name> <name><surname>Pint&#x000E3;o</surname> <given-names>S</given-names></name> <name><surname>Almeida</surname> <given-names>P</given-names></name> <name><surname>Martins</surname> <given-names>T</given-names></name></person-group>. <article-title>Comparison of GFR calculation methods: MDRD and CKD-EPI vs. 99mTc-DTPA tracer clearance rates</article-title>. <source>Scand J Clin Lab Investig.</source> (<year>2013</year>) <volume>73</volume>:<fpage>334</fpage>&#x02013;<lpage>8</lpage>. <pub-id pub-id-type="doi">10.3109/00365513.2013.780663</pub-id><pub-id pub-id-type="pmid">23586782</pub-id></citation></ref>
<ref id="B21">
<label>21.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kerschbaum</surname> <given-names>J</given-names></name> <name><surname>Rudnicki</surname> <given-names>M</given-names></name> <name><surname>Dzien</surname> <given-names>A</given-names></name> <name><surname>Dzien-Bischinger</surname> <given-names>C</given-names></name> <name><surname>Winner</surname> <given-names>H</given-names></name> <name><surname>Heerspink</surname> <given-names>HL</given-names></name> <etal/></person-group>. <article-title>Intra-individual variability of eGFR trajectories in early diabetic kidney disease and lack of performance of prognostic biomarkers</article-title>. <source>Sci Rep</source>. (<year>2020</year>) <volume>10</volume>:<fpage>1</fpage>&#x02013;<lpage>7</lpage>. <pub-id pub-id-type="doi">10.1038/s41598-020-76773-0</pub-id><pub-id pub-id-type="pmid">33184434</pub-id></citation></ref>
<ref id="B22">
<label>22.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gregorich</surname> <given-names>M</given-names></name> <name><surname>Heinzel</surname> <given-names>A</given-names></name> <name><surname>Kammer</surname> <given-names>M</given-names></name> <name><surname>Meiselbach</surname> <given-names>H</given-names></name> <name><surname>B&#x000F6;ger</surname> <given-names>C</given-names></name> <name><surname>Eckardt</surname> <given-names>KU</given-names></name> <etal/></person-group>. <article-title>A prediction model for the decline in renal function in people with type 2 diabetes mellitus: study protocol</article-title>. <source>Diagn Prognost Res</source>. (<year>2021</year>) <volume>5</volume>:<fpage>1</fpage>&#x02013;<lpage>9</lpage>. <pub-id pub-id-type="doi">10.1186/s41512-021-00107-5</pub-id><pub-id pub-id-type="pmid">34789343</pub-id></citation></ref>
<ref id="B23">
<label>23.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gregorich</surname> <given-names>M</given-names></name> <name><surname>Kammer</surname> <given-names>M</given-names></name> <name><surname>Heinzel</surname> <given-names>A</given-names></name> <name><surname>B&#x000F6;ger</surname> <given-names>C</given-names></name> <name><surname>Eckardt</surname> <given-names>KU</given-names></name> <name><surname>Heerspink</surname> <given-names>HL</given-names></name> <etal/></person-group>. <article-title>Development and validation of a prediction model for future estimated glomerular filtration rate in people with type 2 diabetes and chronic kidney disease</article-title>. <source>JAMA Netw Open.</source> (<year>2023</year>) <volume>6</volume>:<fpage>e231870</fpage>. <pub-id pub-id-type="doi">10.1001/jamanetworkopen.2023.1870</pub-id><pub-id pub-id-type="pmid">37017968</pub-id></citation></ref>
<ref id="B24">
<label>24.</label>
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Denicol&#x000F2;</surname> <given-names>S</given-names></name> <name><surname>Mayer</surname> <given-names>G</given-names></name></person-group>. <article-title>Pr&#x000E4;zision der prognose von nierenerkrankungen bei diabetes mellitus typ 2</article-title>. <source>Die Nephrologie.</source> (<year>2023</year>) <volume>18</volume>:<fpage>147</fpage>&#x02013;<lpage>52</lpage>. Available online at: <ext-link ext-link-type="uri" xlink:href="https://api.semanticscholar.org/CorpusID:257516774">https://api.semanticscholar.org/CorpusID:257516774</ext-link></citation>
</ref>
<ref id="B25">
<label>25.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Eknoyan</surname> <given-names>G</given-names></name> <name><surname>Lameire</surname> <given-names>N</given-names></name> <name><surname>Eckardt</surname> <given-names>K</given-names></name> <name><surname>Kasiske</surname> <given-names>B</given-names></name> <name><surname>Wheeler</surname> <given-names>D</given-names></name> <name><surname>Levin</surname> <given-names>A</given-names></name> <etal/></person-group>. <article-title>KDIGO 2012 clinical practice guideline for the evaluation and management of chronic kidney disease</article-title>. <source>Kidney Int.</source> (<year>2013</year>) <volume>3</volume>(<issue>1</issue>):<fpage>5</fpage>&#x02013;<lpage>14</lpage>. <pub-id pub-id-type="doi">10.7326/0003-4819-158-11-201306040-00007</pub-id><pub-id pub-id-type="pmid">23989362</pub-id></citation></ref>
<ref id="B26">
<label>26.</label>
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Jones</surname> <given-names>R</given-names></name> <name><surname>Qian</surname> <given-names>S</given-names></name> <name><surname>Barnes</surname> <given-names>C</given-names></name> <name><surname>Bisset</surname> <given-names>K</given-names></name> <name><surname>Bruce</surname> <given-names>G</given-names></name> <name><surname>Lee</surname> <given-names>K</given-names></name></person-group>. <source>Nonlinear Adaptive Networks: A Little Theory, A Few Applications. Los Alamos National Lab.(LANL), Los Alamos, NM</source> (<year>1990</year>). Available online at: <ext-link ext-link-type="uri" xlink:href="https://chrome-extension://efaidnbmnnnibpcajpcglclefindmkaj/permalink.lanl.gov/object/tr?what=info:lanl-repo/lareport/LA-UR-91-0273">https://chrome-extension://efaidnbmnnnibpcajpcglclefindmkaj/permalink.lanl.gov/object/tr?what=info:lanl-repo/lareport/LA-UR-91-0273</ext-link></citation>
</ref>
<ref id="B27">
<label>27.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Feigenbaum</surname> <given-names>MJ</given-names></name></person-group>. <article-title>Quantitative universality for a class of nonlinear transformations</article-title>. <source>J Stat Phys.</source> (<year>1978</year>) <volume>19</volume>:<fpage>25</fpage>&#x02013;<lpage>52</lpage>.</citation>
</ref>
<ref id="B28">
<label>28.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bashar</surname> <given-names>DA</given-names></name></person-group>. <article-title>Survey on evolving deep learning neural network architectures</article-title>. <source>J Artif Intell Capsule Netw.</source> (<year>2019</year>) <volume>1</volume>:<fpage>73</fpage>&#x02013;<lpage>82</lpage>.</citation>
</ref>
<ref id="B29">
<label>29.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Moody</surname> <given-names>J</given-names></name> <name><surname>Darken</surname> <given-names>CJ</given-names></name></person-group>. <article-title>Fast learning in networks of locally-tuned processing units</article-title>. <source>Neural Comput.</source> (<year>1989</year>) <volume>1</volume>:<fpage>281</fpage>&#x02013;<lpage>94</lpage>.</citation>
</ref>
<ref id="B30">
<label>30.</label>
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Jones</surname> <given-names>RD</given-names></name> <name><surname>Lee</surname> <given-names>YC</given-names></name> <name><surname>Barnes</surname> <given-names>C</given-names></name> <name><surname>Flake</surname> <given-names>GW</given-names></name> <name><surname>Lee</surname> <given-names>K</given-names></name> <name><surname>Lewis</surname> <given-names>P</given-names></name> <etal/></person-group>. <article-title>Function approximation and time series prediction with neural networks</article-title>. In: <source>1990 IJCNN International Joint Conference on Neural Networks</source>. (<publisher-name>IEEE</publisher-name>) 1990. p. <fpage>649</fpage>&#x02013;<lpage>65</lpage>.</citation>
</ref>
<ref id="B31">
<label>31.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Poli</surname> <given-names>I</given-names></name> <name><surname>Jones</surname> <given-names>R</given-names></name></person-group>. <article-title>A neural net model for prediction</article-title>. <source>J Am Stat Assoc.</source> (<year>1994</year>) <volume>89</volume>:<fpage>117</fpage>&#x02013;<lpage>21</lpage>.</citation>
</ref>
<ref id="B32">
<label>32.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ghosh</surname> <given-names>J</given-names></name> <name><surname>Nag</surname> <given-names>A</given-names></name></person-group>. <article-title>An overview of radial basis function networks</article-title>. In: <source>Radial Basis Function Networks 2</source>. (<year>2001</year>). p. <fpage>1</fpage>&#x02013;<lpage>36</lpage>.</citation>
</ref>
<ref id="B33">
<label>33.</label>
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Dagnew</surname> <given-names>TM</given-names></name> <name><surname>Silvestri</surname> <given-names>C</given-names></name> <name><surname>Slanzi</surname> <given-names>D</given-names></name> <name><surname>Poli</surname> <given-names>I</given-names></name></person-group>. <article-title>A neural network model for lead optimization of MMP12 inhibitors</article-title>. In: <source>Pattern Recognition. ICPR International Workshops and Challenges: Virtual Event</source>. <publisher-loc>Springer</publisher-loc> (<year>2021</year>). p. <fpage>323</fpage>&#x02013;<lpage>35</lpage>.</citation>
</ref>
<ref id="B34">
<label>34.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Borrotti</surname> <given-names>M</given-names></name> <name><surname>De March</surname> <given-names>D</given-names></name> <name><surname>Slanzi</surname> <given-names>D</given-names></name> <name><surname>Poli</surname> <given-names>I</given-names></name> <etal/></person-group>. <article-title>Designing lead optimisation of MMP-12 inhibitors</article-title>. <source>Comput Math Methods Med</source>. (<year>2014</year>) <volume>2014</volume>:<fpage>258627</fpage>. <pub-id pub-id-type="doi">10.1155/2014/258627</pub-id><pub-id pub-id-type="pmid">24527058</pub-id></citation></ref>
<ref id="B35">
<label>35.</label>
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Fountain</surname> <given-names>J</given-names></name> <name><surname>Lappin</surname> <given-names>S</given-names></name></person-group>. <source>Physiology, Renin Angiotensin System</source>. <publisher-loc>Treasure Island, FL</publisher-loc>: <publisher-name>StatPearls Publishing</publisher-name> (<year>2020</year>).</citation>
</ref>
<ref id="B36">
<label>36.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shubrook</surname> <given-names>JH</given-names></name> <name><surname>Bokaie</surname> <given-names>BB</given-names></name> <name><surname>Adkins</surname> <given-names>SE</given-names></name></person-group>. <article-title>Empagliflozin in the treatment of type 2 diabetes: evidence to date</article-title>. <source>Drug Design Dev Ther.</source> (<year>2015</year>) <volume>9</volume>:<fpage>5793</fpage>. <pub-id pub-id-type="doi">10.2147/DDDT.S69926</pub-id></citation>
</ref>
<ref id="B37">
<label>37.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Marathe</surname> <given-names>CS</given-names></name> <name><surname>Rayner</surname> <given-names>CK</given-names></name> <name><surname>Jones</surname> <given-names>KL</given-names></name> <name><surname>Horowitz</surname> <given-names>M</given-names></name></person-group>. <article-title>Glucagon-like peptides 1 and 2 in health and disease: a review</article-title>. <source>Peptides.</source> (<year>2013</year>) <volume>44</volume>:<fpage>75</fpage>&#x02013;<lpage>86</lpage>. <pub-id pub-id-type="doi">10.1016/j.peptides.2013.01.014</pub-id></citation>
</ref>
<ref id="B38">
<label>38.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Guichard</surname> <given-names>JL</given-names></name> <name><surname>Clark III</surname> <given-names>D</given-names></name> <name><surname>Calhoun</surname> <given-names>DA</given-names></name> <name><surname>Ahmed</surname> <given-names>MI</given-names></name></person-group>. <article-title>Aldosterone receptor antagonists: current perspectives and therapies</article-title>. <source>Vasc Health Risk Manage.</source> (<year>2013</year>) <fpage>321</fpage>&#x02013;<lpage>31</lpage>. <pub-id pub-id-type="doi">10.2147/VHRM.S33759</pub-id><pub-id pub-id-type="pmid">23836977</pub-id></citation></ref>
</ref-list>
<app-group>
<app id="A1">
<title>Appendix: The hybrid machine-learning approach</title>
<sec>
<title>PLS</title>
<p>The simplest model we consider to predict and maximize &#x00394;<italic>e</italic>GFR is a linear model.</p>
<disp-formula id="E1"><label>(A1)</label><mml:math id="M1"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:mi>&#x00177;</mml:mi><mml:mo>=</mml:mo><mml:msup><mml:mrow><mml:mi>B</mml:mi></mml:mrow><mml:mrow><mml:mi>T</mml:mi></mml:mrow></mml:msup><mml:msub><mml:mrow><mml:mi>x</mml:mi></mml:mrow><mml:mrow><mml:mi>b</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>where <italic>x</italic><sub><italic>b</italic></sub> is a vector of length p of biomarker values, &#x00177; is a the estimate of the value of &#x00394;<italic>e</italic>GFR, and B is a vector of length p of coefficients. The coefficients <italic>B</italic> can be determined by LR as suggested in (<xref ref-type="bibr" rid="B22">22</xref>). Here, we calculate <italic>B</italic> with PLS. PLS has an advantage over LR by reducing the issue of colinearity. PLS also can be used to rank the importance of the input biomarkers in determining the output &#x00177;. Therefore, not only can PLS be used in estimating the output but it can also be used in input dimensionality reduction, reducing the value of <italic>p</italic>. We use both of these features of PLS in this study. PLS is available as a package in python and MATLAB. Here, we use plsregres from the MATLAB library. Note that PLS uses a random-number generator and, therefore, has slight variation in the output from run to run even for the same data set.</p>
<p>Models can be divided into two classes, feedforward and recurrent. Feedforward models map an input smoothly into an output, while recurrent networks map inputs and outputs into outputs. Recurrent models usually require iteration for evaluation. A guess for the output is supplied and an updated value for the guess is calculated by mapping the initial guess and the inputs into the second guess. This process is repeated until the process converges. A simple feedforward model such as Eq. 1 can describe a smooth dependence of &#x00177; on the biomarkers, but the evolution of DKD can behave discontinuously as a result of vicious cycles in the disease progression. In other words, the disease progress can increase suddenly over a period of months, which is shorter than the time between annual visits. This appears as a discontinuity in the data.</p>
<p>Recurrent models are able to model discontinuities [Sec. 1.3](<xref ref-type="bibr" rid="B26">26</xref>). Specifically, we model discontinuous jumps with a polynomial in the output &#x00177;. For the case of a cubic polynomial, Eq. 1 becomes</p>
<disp-formula id="E2"><label>(A2)</label><mml:math id="M2"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:msub><mml:mrow><mml:mi>a</mml:mi></mml:mrow><mml:mrow><mml:mn>3</mml:mn></mml:mrow></mml:msub><mml:msup><mml:mrow><mml:mi>&#x00177;</mml:mi></mml:mrow><mml:mrow><mml:mn>3</mml:mn></mml:mrow></mml:msup><mml:mo>&#x0002B;</mml:mo><mml:msub><mml:mrow><mml:mi>a</mml:mi></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msub><mml:msup><mml:mrow><mml:mi>&#x00177;</mml:mi></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msup><mml:mo>&#x0002B;</mml:mo><mml:mi>&#x00177;</mml:mi><mml:mo>=</mml:mo><mml:msup><mml:mrow><mml:mi>B</mml:mi></mml:mrow><mml:mrow><mml:mi>T</mml:mi></mml:mrow></mml:msup><mml:msub><mml:mrow><mml:mi>x</mml:mi></mml:mrow><mml:mrow><mml:mi>b</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>where <italic>a</italic><sub>2</sub> and <italic>a</italic><sub>3</sub> are coefficients to be determined. The output &#x00177; can be evaluated iteratively. Equation 2 can be written</p>
<disp-formula id="E3"><label>(A3)</label><mml:math id="M3"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:mi>&#x00177;</mml:mi><mml:mo>=</mml:mo><mml:mi>f</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msub><mml:mrow><mml:mi>x</mml:mi></mml:mrow><mml:mrow><mml:mi>b</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:mi>&#x00177;</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mo>,</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>where</p>
<disp-formula id="E4"><label>(A4)</label><mml:math id="M4"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:mi>f</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msub><mml:mrow><mml:mi>x</mml:mi></mml:mrow><mml:mrow><mml:mi>b</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:mi>&#x00177;</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:msup><mml:mrow><mml:mi>B</mml:mi></mml:mrow><mml:mrow><mml:mi>T</mml:mi></mml:mrow></mml:msup><mml:msub><mml:mrow><mml:mi>x</mml:mi></mml:mrow><mml:mrow><mml:mi>b</mml:mi></mml:mrow></mml:msub><mml:mo>-</mml:mo><mml:msub><mml:mrow><mml:mi>a</mml:mi></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msub><mml:msup><mml:mrow><mml:mi>&#x00177;</mml:mi></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msup><mml:mo>-</mml:mo><mml:msub><mml:mrow><mml:mi>a</mml:mi></mml:mrow><mml:mrow><mml:mn>3</mml:mn></mml:mrow></mml:msub><mml:msup><mml:mrow><mml:mi>&#x00177;</mml:mi></mml:mrow><mml:mrow><mml:mn>3</mml:mn></mml:mrow></mml:msup><mml:mo>,</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>which is non-linear in &#x00177; but linear in coefficients <italic>B</italic><sup><italic>T</italic></sup>, <italic>a</italic><sub>2</sub>, and <italic>a</italic><sub>3</sub>. Equations 3, 4 describe a recurrent model that models a cubic equation. The particular case of a cubic model is described in [Sec. 1.3](<xref ref-type="bibr" rid="B26">26</xref>). The output is evaluated by making an initial guess &#x00177;<sub>0</sub> for &#x00177; on the RHS of Eq. 3 and using <italic>f</italic> to update the guess. The process is a one-dimensional map of &#x00177; onto itself. The process is repeated until the difference between successive guesses becomes smaller than a threshold value. Here, we find that the differences become smaller than 1% after 10 iterations. The guesses converge to one of as many as three possible real fixed points.</p>
<p>The final fixed point is determined by two factors, the initial guess and the slope:</p>
<disp-formula id="E5"><label>(A5)</label><mml:math id="M5"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:msup><mml:mrow><mml:mi>f</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x02032;</mml:mi></mml:mrow></mml:msup><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:mi>&#x02202;</mml:mi><mml:mi>f</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x02202;</mml:mi><mml:mi>&#x00177;</mml:mi></mml:mrow></mml:mfrac></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>at each of the fixed points. It is easy to show that a stable fixed point obeys the condition</p>
<disp-formula id="E6"><label>(A6)</label><mml:math id="M6"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:mo>|</mml:mo><mml:msup><mml:mrow><mml:mi>f</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x02032;</mml:mi></mml:mrow></mml:msup><mml:mo>|</mml:mo><mml:mo>&#x0003C;</mml:mo><mml:mn>1</mml:mn></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>In other words, if a fixed point violates Eq. 6 at the fixed point, then that point is not stable. The system will avoid that fixed point and converge to one in which Eq. 6 is satisfied. If the slope approaches zero, the system converges or diverges from the fixed point very slowly. We have not seen this situation in practice. The final fixed point is not only a fixed point that is stable but also one for which the initial guess lies within the fixed point&#x00027;s basin of attraction. The details of the boundaries for the basins of attraction are determined by <inline-formula><mml:math id="M7"><mml:msup><mml:mrow><mml:mi>B</mml:mi></mml:mrow><mml:mrow><mml:mi>T</mml:mi></mml:mrow></mml:msup><mml:msub><mml:mrow><mml:mi>x</mml:mi></mml:mrow><mml:mrow><mml:mi>b</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula>. The classic reference on the topic of fixed points and basins of attraction for one-dimensional non-linear dynamics is Feigenbaum (<xref ref-type="bibr" rid="B27">27</xref>).</p>
<p>The polynomial model, Eqs. 2, 4, can fit into the PLS framework. In order to train the coefficients, the actual output <italic>y</italic><sup>&#x0002A;</sup> is substituted for the estimated output &#x00177; in Eq. 4. The inputs <italic>x</italic> to PLS are a vector of length <italic>p</italic>&#x0002B;2.</p>
<disp-formula id="E7"><label>(A7)</label><mml:math id="M8"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:mi>x</mml:mi><mml:mo>=</mml:mo><mml:mrow><mml:mo>[</mml:mo><mml:mrow><mml:msub><mml:mrow><mml:mi>x</mml:mi></mml:mrow><mml:mrow><mml:mi>b</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:mo>-</mml:mo><mml:msup><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msup><mml:mrow><mml:mi>y</mml:mi></mml:mrow><mml:mrow><mml:mo>*</mml:mo></mml:mrow></mml:msup></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msup><mml:mo>,</mml:mo><mml:mo>-</mml:mo><mml:msup><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msup><mml:mrow><mml:mi>y</mml:mi></mml:mrow><mml:mrow><mml:mo>*</mml:mo></mml:mrow></mml:msup></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow><mml:mrow><mml:mn>3</mml:mn></mml:mrow></mml:msup></mml:mrow><mml:mo>]</mml:mo></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>The fixed points, therefore, are trained on actual outputs <italic>y</italic><sup>&#x0002A;</sup>, and we expect the iterative evaluation process to converge to an estimate for the actual output value <italic>y</italic><sup>&#x0002A;</sup>. The coefficients <italic>B</italic>, <italic>a</italic><sub>2</sub>, and <italic>a</italic><sub>3</sub> are given by the PLS process. Here, we choose the initial guess for &#x00177; to be &#x00177;<sub>0</sub> &#x0003D; 0. The consequences of this choice are tested numerically.</p></sec>
<sec>
<title> Biomarker selection</title>
<p>Biomarkers were selected from two data sets, the expert data set (<xref ref-type="table" rid="T2">Table 2</xref>) (<xref ref-type="bibr" rid="B22">22</xref>) and the complete PROVALID data set, which also contains the expert data set as a subset. Only continuous variables were considered. The number of PLS components was chosen to be five. The most important variables in both the expert and the PROVALID data sets were selected and combined into a single data set (<xref ref-type="table" rid="T2">Table 2</xref>). This combined data set was used for all subsequent modeling.</p></sec>
<sec>
<title> PLSNN</title>
<p>Neural networks are commonly used for modeling data. The most common networks used for deep learning, however, require massive amounts of data to train (<xref ref-type="bibr" rid="B28">28</xref>). In this study, we use a class of localized networks (<xref ref-type="bibr" rid="B29">29</xref>) that can provide quick and accurate results on small problems such as those we have in this study (see <xref ref-type="fig" rid="F3">Figure A1</xref>). Normalized radial basis function networks (NRBNs) have demonstrated good utility in control problems that require a small number of inputs and that live in a changeable environment (<xref ref-type="bibr" rid="B26">26</xref>, <xref ref-type="bibr" rid="B30">30</xref>&#x02013;<xref ref-type="bibr" rid="B34">34</xref>).</p>
<fig id="F3" position="float">
<label>Figure A1</label>
<caption><p>Raw data can come from experts, the PROVALID data set, or other preproccessed sources. Preprocessing might include dimensionality reduction with Bayesian networks, genetic algorithms, or other dimensionality reduction schemes as indicated in the figure. The data are run through PLS to create a reduced vector of inputs ranked by how they affect the output and to create a linear estimate of the output. These are fed back into the PLS process and iterated to convergence. The converged outputs are inputs to the normalized radial basis network. The output is both a non-linear estimate of the output and a non-linear reduction of the input variables. The network is iterated to convergence yielding the final output &#x00394;<sub><italic>R</italic></sub>.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fmed-10-1271407-g0003.tif"/>
</fig>
<p>In order to increase the model accuracy beyond that achievable by PLS, we input the variables, coefficients, and output from PLS into NRBN to obtain an improved estimate for <italic>y</italic><sup>&#x0002A;</sup>. A training set of sample observables is used to fit trainable parameters. The combined model is designated PLSNN.</p>
<p>The architecture of PLSNN is (<xref ref-type="bibr" rid="B26">26</xref>, <xref ref-type="bibr" rid="B30">30</xref>)</p>
<disp-formula id="E8"><label>(A8)</label><mml:math id="M9"><mml:mrow><mml:mover accent='true'><mml:mrow><mml:mover accent='true'><mml:mi>y</mml:mi><mml:mo stretchy='true'>&#x0005E;</mml:mo></mml:mover></mml:mrow><mml:mo stretchy='true'>&#x0005E;</mml:mo></mml:mover><mml:mo>=</mml:mo><mml:mstyle displaystyle='true'><mml:munderover><mml:mo>&#x02211;</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mi>q</mml:mi></mml:munderover><mml:mrow><mml:mstyle displaystyle='true'><mml:munderover><mml:mo>&#x02211;</mml:mo><mml:mrow><mml:mi>j</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mi>p</mml:mi></mml:munderover><mml:mrow><mml:msub><mml:mi>a</mml:mi><mml:mrow><mml:mi>i</mml:mi><mml:mi>j</mml:mi></mml:mrow></mml:msub><mml:msub><mml:mi>B</mml:mi><mml:mi>j</mml:mi></mml:msub><mml:msub><mml:mi>x</mml:mi><mml:mi>j</mml:mi></mml:msub><mml:mtext>&#x02009;</mml:mtext><mml:mi>u</mml:mi><mml:mo stretchy='false'>[</mml:mo><mml:mi>d</mml:mi><mml:mo stretchy='false'>(</mml:mo><mml:msup><mml:mi>x</mml:mi><mml:mo>&#x02032;</mml:mo></mml:msup><mml:mo>,</mml:mo><mml:msubsup><mml:mi>x</mml:mi><mml:mi>i</mml:mi><mml:mo>&#x02032;</mml:mo></mml:msubsup><mml:mo stretchy='false'>]</mml:mo><mml:mo>,</mml:mo></mml:mrow></mml:mstyle></mml:mrow></mml:mstyle></mml:mrow></mml:math></disp-formula>
<p>where <inline-formula><mml:math id="M10"><mml:mover accent="true"><mml:mrow><mml:mi>&#x00177;</mml:mi></mml:mrow><mml:mo>^</mml:mo></mml:mover></mml:math></inline-formula> is the PLSNN estimate, <italic>x</italic> is the expanded input vector given by Eq. 7, <italic>B</italic> are the corresponding PLS coefficients, <italic>u</italic> is a normalized basis functions, the hyperparameter <italic>q</italic> is the number of basis functions, <italic>x</italic>&#x02032; is a selected set of inputs that taken from PLS outputs, <inline-formula><mml:math id="M11"><mml:msubsup><mml:mrow><mml:mi>x</mml:mi></mml:mrow><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x02032;</mml:mi></mml:mrow></mml:msubsup></mml:math></inline-formula> are the basis function centers chosen randomly from the training set, <inline-formula><mml:math id="M12"><mml:mi>d</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msup><mml:mrow><mml:mi>x</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x02032;</mml:mi></mml:mrow></mml:msup><mml:mo>,</mml:mo><mml:msubsup><mml:mrow><mml:mi>x</mml:mi></mml:mrow><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x02032;</mml:mi></mml:mrow></mml:msubsup></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:math></inline-formula> is a dimensionless distance measure between <italic>x</italic>&#x02032; and <inline-formula><mml:math id="M13"><mml:msubsup><mml:mrow><mml:mi>x</mml:mi></mml:mrow><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x02032;</mml:mi></mml:mrow></mml:msubsup></mml:math></inline-formula>, and <italic>a</italic><sub><italic>ij</italic></sub> is a set of trainable parameters. Here, the two-dimensional input vectors <italic>x</italic>&#x02032; are given by</p>
<disp-formula id="E9"><label>(A9)</label><mml:math id="M14"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:msup><mml:mrow><mml:mi>x</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x02032;</mml:mi></mml:mrow></mml:msup><mml:mo>&#x02192;</mml:mo><mml:mrow><mml:mo>[</mml:mo><mml:mrow><mml:msup><mml:mrow><mml:mi>y</mml:mi></mml:mrow><mml:mrow><mml:mo>*</mml:mo></mml:mrow></mml:msup><mml:mo>,</mml:mo><mml:mi>&#x00177;</mml:mi></mml:mrow><mml:mo>]</mml:mo></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>for training the network and</p>
<disp-formula id="E10"><label>(A10)</label><mml:math id="M15"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:msup><mml:mrow><mml:mi>x</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x02032;</mml:mi></mml:mrow></mml:msup><mml:mo>&#x02192;</mml:mo><mml:mrow><mml:mo>[</mml:mo><mml:mrow><mml:mover accent="true"><mml:mrow><mml:mi>&#x00177;</mml:mi></mml:mrow><mml:mo>^</mml:mo></mml:mover><mml:mo>,</mml:mo><mml:mi>&#x00177;</mml:mi></mml:mrow><mml:mo>]</mml:mo></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>for evaluation. The basis centers <inline-formula><mml:math id="M16"><mml:msubsup><mml:mrow><mml:mi>x</mml:mi></mml:mrow><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x02032;</mml:mi></mml:mrow></mml:msubsup></mml:math></inline-formula> are q random selections from the training vectors given in Eq. 9. Note that this randomness causes small variation in the output from run to run for the same data set. In other words, the network is trained on actual data, which is available from the training set, but it is evaluated using the iterated process described above because the output is not yet known for the test/evaluation set.</p>
<p>We take the dimensionless distance d between an input vector and a basis center to be the Euclidean distance (<xref ref-type="bibr" rid="B29">29</xref>).</p>
<disp-formula id="E11"><label>(A11)</label><mml:math id="M17"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:mi>d</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msup><mml:mrow><mml:mi>x</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x02032;</mml:mi></mml:mrow></mml:msup><mml:mo>,</mml:mo><mml:msubsup><mml:mrow><mml:mi>x</mml:mi></mml:mrow><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x02032;</mml:mi></mml:mrow></mml:msubsup></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:mi>&#x003B2;</mml:mi><mml:mfrac><mml:mrow><mml:msup><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msup><mml:mrow><mml:mi>x</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x02032;</mml:mi></mml:mrow></mml:msup><mml:mo>-</mml:mo><mml:msubsup><mml:mrow><mml:mi>x</mml:mi></mml:mrow><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x02032;</mml:mi></mml:mrow></mml:msubsup></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow><mml:mrow><mml:mi>T</mml:mi></mml:mrow></mml:msup><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msup><mml:mrow><mml:mi>x</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x02032;</mml:mi></mml:mrow></mml:msup><mml:mo>-</mml:mo><mml:msubsup><mml:mrow><mml:mi>x</mml:mi></mml:mrow><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x02032;</mml:mi></mml:mrow></mml:msubsup></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow><mml:mrow><mml:msup><mml:mrow><mml:mi>&#x003C3;</mml:mi></mml:mrow><mml:mrow><mml:mo>*</mml:mo></mml:mrow></mml:msup></mml:mrow></mml:mfrac></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>where the hyperparameter &#x003B2; is a scaling parameter and &#x003C3;<sup>&#x0002A;</sup> is the standard deviation of all the observed outputs <italic>y</italic><sup>&#x0002A;</sup> in the training set. We typically set &#x003B2; &#x0003D; 1. Comparable results are found for values &#x003B2; &#x0003D; 0.2 to 5.</p>
<p>The normalized basis functions <italic>u</italic> are given by</p>
<disp-formula id="E12"><label>(A12)</label><mml:math id="M18"><mml:mrow><mml:mi>u</mml:mi><mml:mo stretchy='false'>[</mml:mo><mml:mi>d</mml:mi><mml:mo stretchy='false'>(</mml:mo><mml:mover accent='true'><mml:mi>x</mml:mi><mml:mo>&#x0005E;</mml:mo></mml:mover><mml:mo>,</mml:mo><mml:msub><mml:mover accent='true'><mml:mi>x</mml:mi><mml:mo>&#x0005E;</mml:mo></mml:mover><mml:mi>i</mml:mi></mml:msub><mml:mo stretchy='false'>)</mml:mo><mml:mo stretchy='false'>]</mml:mo><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:mi>&#x003C1;</mml:mi><mml:mo stretchy='false'>[</mml:mo><mml:mi>d</mml:mi><mml:mo stretchy='false'>(</mml:mo><mml:mover accent='true'><mml:mi>x</mml:mi><mml:mo>&#x0005E;</mml:mo></mml:mover><mml:mo>,</mml:mo><mml:msub><mml:mover accent='true'><mml:mi>x</mml:mi><mml:mo>&#x0005E;</mml:mo></mml:mover><mml:mi>i</mml:mi></mml:msub><mml:mo stretchy='false'>)</mml:mo><mml:mo stretchy='false'>]</mml:mo></mml:mrow><mml:mrow><mml:mstyle displaystyle='true'><mml:msubsup><mml:mo>&#x02211;</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mi>q</mml:mi></mml:msubsup><mml:mrow><mml:mi>&#x003C1;</mml:mi><mml:mo stretchy='false'>[</mml:mo><mml:mi>d</mml:mi><mml:mo stretchy='false'>(</mml:mo><mml:mover accent='true'><mml:mi>x</mml:mi><mml:mo>&#x0005E;</mml:mo></mml:mover><mml:mo>,</mml:mo><mml:msub><mml:mover accent='true'><mml:mi>x</mml:mi><mml:mo>&#x0005E;</mml:mo></mml:mover><mml:mi>i</mml:mi></mml:msub><mml:mo stretchy='false'>)</mml:mo><mml:mo stretchy='false'>]</mml:mo></mml:mrow></mml:mstyle></mml:mrow></mml:mfrac></mml:mrow></mml:math></disp-formula>
<p>where we used the convenient choice for the localized basis function (<xref ref-type="bibr" rid="B29">29</xref>)</p>
<disp-formula id="E13"><label>(A13)</label><mml:math id="M19"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:mi>&#x003C1;</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>d</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:mo class="qopname">exp</mml:mo><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mo>-</mml:mo><mml:mi>d</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>For evaluation, <inline-formula><mml:math id="M20"><mml:mover accent="true"><mml:mrow><mml:mi>&#x00177;</mml:mi></mml:mrow><mml:mo>^</mml:mo></mml:mover></mml:math></inline-formula> is an estimate for <italic>y</italic><sup>&#x0002A;</sup>. The PLSNN estimate for <inline-formula><mml:math id="M21"><mml:mover accent="true"><mml:mrow><mml:mi>&#x00177;</mml:mi></mml:mrow><mml:mo>^</mml:mo></mml:mover></mml:math></inline-formula> is evaluated in the same iterative manner as the PLS estimate, Eq. 3. The initial guess for <inline-formula><mml:math id="M22"><mml:mover accent="true"><mml:mrow><mml:mi>&#x00177;</mml:mi></mml:mrow><mml:mo>^</mml:mo></mml:mover></mml:math></inline-formula> is the PLS estimate <inline-formula><mml:math id="M23"><mml:mover accent="true"><mml:mrow><mml:mi>&#x00177;</mml:mi></mml:mrow><mml:mo>^</mml:mo></mml:mover><mml:mo>=</mml:mo><mml:mi>&#x00177;</mml:mi></mml:math></inline-formula>.</p>
<p>We train the network with the projection-operator technique [see, for example, (<xref ref-type="bibr" rid="B26">26</xref>, <xref ref-type="bibr" rid="B30">30</xref>)]:</p>
<disp-formula id="E14"><label>(A14)</label><mml:math id="M24"><mml:mrow><mml:mtable columnalign='left'><mml:mtr columnalign='left'><mml:mtd columnalign='left'><mml:mrow><mml:mi>&#x00394;</mml:mi><mml:msub><mml:mi>a</mml:mi><mml:mrow><mml:mi>i</mml:mi><mml:mi>j</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:mi>&#x003BD;</mml:mi><mml:mo stretchy='false'>[</mml:mo><mml:msup><mml:mi>y</mml:mi><mml:mo>*</mml:mo></mml:msup><mml:mo>&#x02212;</mml:mo><mml:mover accent='true'><mml:mrow><mml:mover accent='true'><mml:mi>y</mml:mi><mml:mo stretchy='true'>&#x0005E;</mml:mo></mml:mover></mml:mrow><mml:mo stretchy='true'>&#x0005E;</mml:mo></mml:mover><mml:mo stretchy='false'>]</mml:mo><mml:mfrac><mml:mrow><mml:msub><mml:mi>v</mml:mi><mml:mrow><mml:mi>i</mml:mi><mml:mi>j</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mrow><mml:mstyle displaystyle='true'><mml:msubsup><mml:mo>&#x02211;</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mi>q</mml:mi></mml:msubsup><mml:mrow><mml:mstyle displaystyle='true'><mml:msubsup><mml:mo>&#x02211;</mml:mo><mml:mrow><mml:mi>j</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mi>p</mml:mi></mml:msubsup><mml:mrow><mml:msubsup><mml:mi>v</mml:mi><mml:mrow><mml:mi>i</mml:mi><mml:mi>j</mml:mi></mml:mrow><mml:mn>2</mml:mn></mml:msubsup></mml:mrow></mml:mstyle></mml:mrow></mml:mstyle></mml:mrow></mml:mfrac><mml:mo>.</mml:mo></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:mrow></mml:math></disp-formula>
<p>where the hyperparameter 0 &#x0003C; &#x003BD; &#x0003C; 1 is the learning rate and</p>
<disp-formula id="E15"><label>(A15)</label><mml:math id="M25"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:msub><mml:mrow><mml:mi>v</mml:mi></mml:mrow><mml:mrow><mml:mi>i</mml:mi><mml:mi>j</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:msub><mml:mrow><mml:mi>B</mml:mi></mml:mrow><mml:mrow><mml:mi>j</mml:mi></mml:mrow></mml:msub><mml:mi>x</mml:mi><mml:mtext>&#x000A0;</mml:mtext><mml:mi>u</mml:mi><mml:mrow><mml:mo>[</mml:mo><mml:mrow><mml:mi>d</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msup><mml:mrow><mml:mi>x</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x02032;</mml:mi></mml:mrow></mml:msup><mml:mo>,</mml:mo><mml:msubsup><mml:mrow><mml:mi>x</mml:mi></mml:mrow><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x02032;</mml:mi></mml:mrow></mml:msubsup></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow><mml:mo>]</mml:mo></mml:mrow><mml:mo>.</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>The outcomes are insensitive to the learning rate. We take the rate to be &#x003BD; &#x0003D; 0.1. Equation 14 is updated for every sample <italic>x</italic>, <italic>x</italic>&#x02032;, and <inline-formula><mml:math id="M26"><mml:mover accent="true"><mml:mrow><mml:mi>&#x00177;</mml:mi></mml:mrow><mml:mo>^</mml:mo></mml:mover></mml:math></inline-formula> in the training set. Multiple training sets were formed by removing one sample for testing, shuffling the samples used as basis centers, and shuffling the order in which the samples were presented to the training algorithm Eq. 14.</p>
<p>A test set was created by randomly selecting and removing one sample from each training set. PLSNN was not trained on this sample. This sample formed a member of the leave-one-out test set. Performance parameters were calculated from this test set.</p>
<p>We built four separate models of the annual percent change (&#x00394;<italic>e</italic>GFR), one for each sub-population that receives a particular drug treatment (<xref ref-type="table" rid="T4">Table 4</xref>). The baseline sub-population are those patients who only received renin-angiotensin system inhibitor (RASi) (<xref ref-type="bibr" rid="B35">35</xref>). The remaining three treatment regimes involved the addition of a second drug to the baseline treatment: sodium-glucose cotransporter-2 inhibitor (SGLT2i) (<xref ref-type="bibr" rid="B36">36</xref>), glucagon-like peptide-1 (GLP-1a) (<xref ref-type="bibr" rid="B37">37</xref>), and antimineralocorticoid receptor antagonist (MCRa) (<xref ref-type="bibr" rid="B38">38</xref>). Distinct variable selection and &#x00394;<italic>e</italic>GFR prediction was performed for each of the four models.</p>
<p>The composite biomarker &#x00394;<sub><italic>R</italic></sub> is the estimated value of &#x00394;<italic>e</italic>GFR for the RASi-Alone Model.</p>
</sec>
</app>
</app-group>
</back>
</article>