<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" article-type="research-article" dtd-version="2.3" xml:lang="EN">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Med.</journal-id>
<journal-title>Frontiers in Medicine</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Med.</abbrev-journal-title>
<issn pub-type="epub">2296-858X</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fmed.2024.1397648</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Medicine</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Theoretical investigations on modeling blood flow through vessel for understanding effectiveness of magnetic nanocarrier drug delivery systems</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Alzhrani</surname> <given-names>Rami M.</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x002A;</sup></xref>
<uri xlink:href="https://loop.frontiersin.org/people/2667447/overview"/>
<role content-type="https://credit.niso.org/contributor-roles/data-curation/"/>
<role content-type="https://credit.niso.org/contributor-roles/investigation/"/>
<role content-type="https://credit.niso.org/contributor-roles/software/"/>
<role content-type="https://credit.niso.org/contributor-roles/writing-original-draft/"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Aldawsari</surname> <given-names>Mohammed F.</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="https://loop.frontiersin.org/people/2672630/overview"/>
<role content-type="https://credit.niso.org/contributor-roles/formal-analysis/"/>
<role content-type="https://credit.niso.org/contributor-roles/methodology/"/>
<role content-type="https://credit.niso.org/contributor-roles/validation/"/>
<role content-type="https://credit.niso.org/contributor-roles/writing-original-draft/"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Alamoudi</surname> <given-names>Jawaher Abdullah</given-names></name>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
<role content-type="https://credit.niso.org/contributor-roles/project-administration/"/>
<role content-type="https://credit.niso.org/contributor-roles/resources/"/>
<role content-type="https://credit.niso.org/contributor-roles/software/"/>
<role content-type="https://credit.niso.org/contributor-roles/writing-original-draft/"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Department of Pharmaceutics and Industrial Pharmacy, College of Pharmacy, Taif University</institution>, <addr-line>Taif</addr-line>, <country>Saudi Arabia</country></aff>
<aff id="aff2"><sup>2</sup><institution>Department of Pharmaceutics, College of Pharmacy, Prince Sattam Bin Abdulaziz University</institution>, <addr-line>Al-Kharj</addr-line>, <country>Saudi Arabia</country></aff>
<aff id="aff3"><sup>3</sup><institution>Department of Pharmaceutical Sciences, College of Pharmacy, Princess Nourah bint Abdulrahman University</institution>, <addr-line>Riyadh</addr-line>, <country>Saudi Arabia</country></aff>
<author-notes>
<fn fn-type="edited-by" id="fn0001">
<p>Edited by: Ajeet Kaushik, Florida Polytechnic University, United States</p>
</fn>
<fn fn-type="edited-by" id="fn0002">
<p>Reviewed by: Shivani R. Pandya, Parul University, India</p>
<p>Xiaolei Li, University of Pennsylvania, United States</p>
</fn>
<corresp id="c001">&#x002A;Correspondence: Rami M. Alzhrani, <email>r.zhrani@tu.edu.sa</email></corresp>
</author-notes>
<pub-date pub-type="epub">
<day>22</day>
<month>05</month>
<year>2024</year>
</pub-date>
<pub-date pub-type="collection">
<year>2024</year>
</pub-date>
<volume>11</volume>
<elocation-id>1397648</elocation-id>
<history>
<date date-type="received">
<day>07</day>
<month>03</month>
<year>2024</year>
</date>
<date date-type="accepted">
<day>30</day>
<month>04</month>
<year>2024</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x00A9; 2024 Alzhrani, Aldawsari and Alamoudi.</copyright-statement>
<copyright-year>2024</copyright-year>
<copyright-holder>Alzhrani, Aldawsari and Alamoudi</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p>
</license>
</permissions>
<abstract>
<p>For cancer therapy, the focus is now on targeting the chemotherapy drugs to cancer cells without damaging other normal cells. The new materials based on bio-compatible magnetic carriers would be useful for targeted cancer therapy, however understanding their effectiveness should be done. This paper presents a comprehensive analysis of a dataset containing variables <italic>x</italic>(m), <italic>y</italic>(m), and <italic>U</italic>(m/s), where <italic>U</italic> represents velocity of blood through vessel containing ferrofluid. The effect of external magnetic field on the fluid flow is investigated using a hybrid modeling. The primary aim of this research endeavor was to construct precise and dependable predictive models for velocity, utilizing the provided input variables. Several base models, including K-nearest neighbors (KNN), decision tree (DT), and multilayer perceptron (MLP), were trained and evaluated. Additionally, an ensemble model called AdaBoost was implemented to further enhance the predictive performance. The hyper-parameter optimization technique, specifically the BAT optimization algorithm, was employed to fine-tune the models. The results obtained from the experiments demonstrated the effectiveness of the proposed approach. The combination of the AdaBoost algorithm and the decision tree model yielded a highly impressive score of 0.99783 in terms of <italic>R</italic><sup>2</sup>, indicating a strong predictive performance. Additionally, the model exhibited a low error rate, as evidenced by the root mean square error (RMSE) of 5.2893&#x2009;&#x00D7;&#x2009;10<sup>&#x2212;3</sup>. Similarly, the AdaBoost-KNN model exhibited a high score of 0.98524 using <italic>R</italic><sup>2</sup> metric, with an RMSE of 1.3291&#x2009;&#x00D7;&#x2009;10<sup>&#x2212;2</sup>. Furthermore, the AdaBoost-MLP model obtained a satisfactory <italic>R</italic><sup>2</sup> score of 0.99603, accompanied by an RMSE of 7.1369&#x2009;&#x00D7;&#x2009;10<sup>&#x2212;3</sup>.</p>
</abstract>
<kwd-group>
<kwd>drug delivery</kwd>
<kwd>cancer therapy</kwd>
<kwd>nanocarrier</kwd>
<kwd>decision tree</kwd>
<kwd>multilayer perceptron</kwd>
</kwd-group>
<contract-num rid="cn1">PSAU/2023/R/1445</contract-num>
<contract-sponsor id="cn1">Prince Sattam bin Abdulaziz University<named-content content-type="fundref-id">10.13039/100009392</named-content></contract-sponsor>
<counts>
<fig-count count="12"/>
<table-count count="2"/>
<equation-count count="7"/>
<ref-count count="31"/>
<page-count count="12"/>
<word-count count="5501"/>
</counts>
<custom-meta-wrap>
<custom-meta>
<meta-name>section-at-acceptance</meta-name>
<meta-value>Gene and Cell Therapy</meta-value>
</custom-meta>
</custom-meta-wrap>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="sec1">
<label>1</label>
<title>Introduction</title>
<p>There are different challenges in medical science among which cancer therapy is one of the most major challenges which is currently being studied to improve the efficiency of treatment (<xref ref-type="bibr" rid="ref1">1</xref>, <xref ref-type="bibr" rid="ref2">2</xref>). For cancer therapy, the drug must reach the cancer cell at desired dosage, while other adjacent normal cells should be intact. Indeed, targeted cancer therapy would be of great importance for scientists to develop drug delivery systems with high efficacy (<xref ref-type="bibr" rid="ref3">3</xref>, <xref ref-type="bibr" rid="ref4">4</xref>). Recently, bio-compatible magnetic nanocarriers have attracted much attention due to their superior properties in cancer treatment (<xref ref-type="bibr" rid="ref5 ref6 ref7">5&#x2013;7</xref>). The motion of these particles in the blood circulating system can be monitored and controlled using magnetic field such as external permanent magnet (<xref ref-type="bibr" rid="ref8">8</xref>, <xref ref-type="bibr" rid="ref9">9</xref>).</p>
<p>Computational methods can be developed and implemented for magnetic-based drug delivery systems to understand the effectiveness of drug as well as the targeting the drug-carrier formulation. For modeling, fluid mechanics as well as magnetic models should be combined to build a holistic model of system (<xref ref-type="bibr" rid="ref10">10</xref>, <xref ref-type="bibr" rid="ref11">11</xref>). For model development, the interactions between the nanoparticles and the medium as well as the external force should be taken into account. Since the fluid flow contains magnetic nanoparticles, ferrohydrodynamics of blood would help one understand the flow pattern and monitor the agglomeration of nanoparticles in the blood stream. Indeed, the agglomeration of drug loaded nanoparticles would cause problems and reduce the efficacy of targeted cancer treatment.</p>
<p>Among different modeling approaches developed for drug delivery systems, the models based on fluids mechanics have shown great capability in which the blood flow in vessel can be modeled by solution of fluid mechanics equations (<xref ref-type="bibr" rid="ref12">12</xref>). The flow in this case is considered to be under the low Reynolds number flow regime. Therefore, the main forces applied on the fluid flow are magnetic force as well as viscous forces (<xref ref-type="bibr" rid="ref12">12</xref>). So, numerical solution of the governing equations is the main methodology for simulation of blood flow with magnetic nanoparticles. However, other modeling strategies can be integrated to the fluid mechanic models to facilitate the simulation, such as machine learning models which have attracted much attention in different fields. The methods of machine learning have been used with integration to computational fluid mechanics (CFD) models to reduce the complexity of CFD models (<xref ref-type="bibr" rid="ref13">13</xref>). This approach can be also adopted in this work for modeling targeted cancer therapy using magnetic nanoparticles.</p>
<p>The field of machine learning (ML) has proven to be highly effective in uncovering intricate patterns within complex systems and making accurate predictions based on input variables (<xref ref-type="bibr" rid="ref14">14</xref>, <xref ref-type="bibr" rid="ref15">15</xref>). These techniques have revolutionized various domains, including data analysis, artificial intelligence, and predictive modeling. By leveraging ML algorithms and models, researchers and practitioners can extract valuable insights from vast amounts of data. ML techniques excel at identifying hidden relationships and patterns that may not be immediately apparent to human observers. This ability to capture intricate patterns empowers ML models to make precise predictions and inform decision-making processes. A wide range of ML models have been developed and utilized in science and engineering.</p>
<p>The main objective of this research was to develop accurate and reliable predictive ML models for velocity simulation of blood flow using the given input variables. Various foundational models, such as K-nearest neighbors (KNN), decision tree (DT), and multilayer perceptron (MLP), were trained and assessed. Furthermore, an ensemble model known as AdaBoost was employed to augment the predictive performance. The models are integrated to CFD model developed for simulation of blood flow in vessel for targeted cancer therapy.</p>
<p>K-nearest neighbors (KNN) is a non-parametric classification and regression algorithm that assigns a data point to a class based on the majority class among its K-nearest neighbors (<xref ref-type="bibr" rid="ref16">16</xref>). While versatile, it faces challenges like the curse of dimensionality. Decision trees (DT) construct tree-shaped models for decision-making, offering interpretability but prone to overfitting and sensitivity to minor data variations (<xref ref-type="bibr" rid="ref17">17</xref>). Multilayer perceptron (MLP), with interconnected layers of neurons, excel in pattern recognition but encounter computational challenges and local optima during training (<xref ref-type="bibr" rid="ref18">18</xref>). AdaBoost combines weak models, transferring gradients to improve accuracy, adapting well to noisy data and outliers while leveraging knowledge from previous estimators for enhanced performance.</p>
<p>Employing individual machine learning methods in their basic forms may lead to models with reduced accuracy or potential overfitting. In this research, we hypothesized that utilizing AdaBoost and BAT algorithm to regulate hyperparameters and modulate the complexity of models could yield more precise and generalized models. This hypothesis was validated through the analysis of results.</p>
</sec>
<sec sec-type="materials|methods" id="sec2">
<label>2</label>
<title>Materials and methods</title>
<sec id="sec3">
<label>2.1</label>
<title>Data set description and model</title>
<p>In this study, the dataset used consists of more than 17,000 data entries. The dataset&#x2019;s structure involves utilizing spatial coordinates as input, while the output variable is represented as the velocity, indicated as <italic>U</italic>, and measured in meters per second (m/s). <italic>U</italic>, as the only response, is indeed the velocity field for blood flow through vessel which contain drug loaded magnetic nanoparticles. The influence of external magnetic force on the nanoparticles was considered in the CFD model development. The obtained velocity field in 2 dimensional (2D) using the CFD was then used for training/testing the ML models. Therefore, the model is built in two steps, i.e., CFD simulation and ML development using the CFD outputs. The description of the system containing vessel and the external magnet has been reported elsewhere (<xref ref-type="bibr" rid="ref19">19</xref>). The pairwise distribution of the dataset variables is visualized in <xref ref-type="fig" rid="fig1">Figure 1</xref> and the box plots are depicted in <xref ref-type="fig" rid="fig2">Figure 2</xref>. Also <xref ref-type="table" rid="tab1">Table 1</xref> shows the statistics of the dataset.</p>
<fig position="float" id="fig1">
<label>Figure 1</label>
<caption>
<p>Pair plot of the dataset for velocity field, <italic>U</italic>.</p>
</caption>
<graphic xlink:href="fmed-11-1397648-g001.tif"/>
</fig>
<fig position="float" id="fig2">
<label>Figure 2</label>
<caption>
<p>Variable box plots for the input and output parameters.</p>
</caption>
<graphic xlink:href="fmed-11-1397648-g002.tif"/>
</fig>
<table-wrap position="float" id="tab1">
<label>Table 1</label>
<caption>
<p>Statistical measures of dataset variables.</p>
</caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left" valign="top">Statistic</th>
<th align="center" valign="top"><italic>X</italic> (m)</th>
<th align="center" valign="top"><italic>Y</italic> (m)</th>
<th align="center" valign="top"><italic>U</italic> (m/s)</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="bottom">Mean</td>
<td align="char" valign="bottom" char=".">&#x2212;0.029661</td>
<td align="char" valign="bottom" char=".">&#x2212;0.015008</td>
<td align="char" valign="bottom" char=".">0.338124</td>
</tr>
<tr>
<td align="left" valign="bottom">Standard deviation</td>
<td align="char" valign="bottom" char=".">0.062820</td>
<td align="char" valign="bottom" char=".">0.002845</td>
<td align="char" valign="bottom" char=".">0.114155</td>
</tr>
<tr>
<td align="left" valign="bottom">Minimum</td>
<td align="char" valign="bottom" char=".">&#x2212;0.140000</td>
<td align="char" valign="bottom" char=".">&#x2212;0.020000</td>
<td align="char" valign="bottom" char=".">0.000000</td>
</tr>
<tr>
<td align="left" valign="bottom">Maximum</td>
<td align="char" valign="bottom" char=".">0.080000</td>
<td align="char" valign="bottom" char=".">&#x2212;0.010000</td>
<td align="char" valign="bottom" char=".">0.500050</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>The main equation which is solved via numerical technique is the Navier&#x2013;Stokes equations which are solved via finite element method (FEM). The equations can be expressed as:</p>
<disp-formula id="E1">
<mml:math id="M1">
<mml:mrow>
<mml:mi>&#x03C1;</mml:mi>
<mml:mfrac>
<mml:mrow>
<mml:mo>&#x2202;</mml:mo>
<mml:mi>U</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mo>&#x2202;</mml:mo>
<mml:mi>t</mml:mi>
</mml:mrow>
</mml:mfrac>
<mml:mo>&#x2212;</mml:mo>
<mml:mo>&#x2207;</mml:mo>
<mml:mo>&#x00B7;</mml:mo>
<mml:mi>&#x03BC;</mml:mi>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mrow>
<mml:mo>&#x2207;</mml:mo>
<mml:mi>U</mml:mi>
<mml:mo>+</mml:mo>
<mml:msup>
<mml:mrow>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mrow>
<mml:mo>&#x2207;</mml:mo>
<mml:mi>U</mml:mi>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mi mathvariant="normal">T</mml:mi>
</mml:msup>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>+</mml:mo>
<mml:mi>&#x03C1;</mml:mi>
<mml:mi>U</mml:mi>
<mml:mo>&#x00B7;</mml:mo>
<mml:mo>&#x2207;</mml:mo>
<mml:mi>U</mml:mi>
<mml:mo>+</mml:mo>
<mml:mo>&#x2207;</mml:mo>
<mml:mi>p</mml:mi>
<mml:mo>=</mml:mo>
<mml:mi>F</mml:mi>
</mml:mrow>
</mml:math>
</disp-formula>
<disp-formula id="E2">
<mml:math id="M2">
<mml:mrow>
<mml:mo>&#x2207;</mml:mo>
<mml:mo>&#x00B7;</mml:mo>
<mml:mi>U</mml:mi>
<mml:mo>=</mml:mo>
<mml:mn>0</mml:mn>
</mml:mrow>
</mml:math>
</disp-formula>
<p>where <italic>U</italic> is velocity of blood through the vessel (m/s). <italic>p</italic> is the pressure, and <italic>F</italic> is body force (<italic>N</italic>). <italic>F</italic> as the body forces is estimated using the external magnetic field based on Maxwell&#x2019; model (<xref ref-type="bibr" rid="ref19">19</xref>). The geometry of the vessel is considered as a tubular shape with axial symmetry where the input velocity is considered to be the well-known parabolic velocity profile. Additionally, a sinusoidal velocity profile was considered to take into account the influence of hear beat on the velocity profile. The simulations in this study were performed for the case at a hear beat.</p>
<p>In this study, prior to delving into the execution of regression analysis, sophisticated preprocessing steps were undertaken to ensure the integrity and reliability of the dataset. Beginning with the identification and isolation of outliers through the innovative Isolation Forest algorithm, the data underwent a rigorous cleansing process, effectively eliminating anomalous data points that could potentially skew the subsequent regression analysis. Following outlier detection, the dataset was subjected to min-max normalization, a transformation technique aimed at standardizing the range of values across different features, thereby enhancing the stability and interpretability of the regression model. Furthermore, to gauge the model&#x2019;s performance accurately, the dataset was judiciously partitioned into training and testing subsets, with an 80-20 ratio, ensuring a robust evaluation framework. Through this comprehensive preprocessing pipeline, the study lays a solid foundation for rigorous regression analysis, poised to uncover meaningful insights with confidence and precision.</p>
</sec>
<sec id="sec4">
<label>2.2</label>
<title>Base regression models</title>
<p>After the simulation of fluid flow using the Navier&#x2013;Stokes equations, the velocity distribution in two dimensional were obtained and extracted for ML model development. A number of ML models were used which will be explained in the following sections. Therefore, the ML models possess two inputs which are the coordinates and sole response, which is the velocity field, <italic>U</italic> (m/s).</p>
<p>The decision tree (DT) model is a highly advantageous option for regression applications. The technique is dependent on a data structure resembling a tree and functions as a means for selecting features optimally during the process of dividing the tree. The core aim is to identify a feature that effectively refines the split dataset and brings order to the initially disordered data. The decision tree model comprises three fundamental components: root nodes, intermediate nodes, and leaf or terminal nodes. The leaf nodes indicate the ultimate predictions, while the remaining nodes serve as evaluative points for various attributes. At each node, data samples are subdivided into child nodes (sub-nodes) based on property tests and the resultant insights (<xref ref-type="bibr" rid="ref20">20</xref>, <xref ref-type="bibr" rid="ref21">21</xref>).</p>
<p>All data points are inputted into the root node during the initial stage of the training phase. Subsequently, the DT algorithm determines the optimal strategy for dividing the data into partitions. As this method is applied, each sub-dataset resulting from the division adheres to the criteria of the division rule, ensuring that all samples are appropriately categorized. The initial dataset undergoes successive subdivisions until a tree-like structure is formed, giving rise to several meticulously refined datasets (<xref ref-type="bibr" rid="ref22">22</xref>).</p>
<p>The attainment of optimal &#x201C;purity&#x201D; in a DT occurs when all instances within a specific branch node are classified into the same category, as previously mentioned. Various metrics are commonly employed to assess the purity of divided samples and examine the integrity of datasets. The metrics encompassed in this set are information gain ratio, entropy, and the Gini index (<xref ref-type="bibr" rid="ref23">23</xref>).</p>
<p>Information entropy measures dataset impurity, reflecting uncertainty in sample distribution across categories. Decision tree algorithms leverage entropy to assess information gain from attribute-based data splits. Gain ratio evaluates split effectiveness, considering both information gain and intrinsic attributes&#x2019; information to mitigate biases from attributes with many distinct values. The Gini index, akin to entropy, gauges impurity by the probability of misclassifying a randomly chosen sample. Decision trees use the Gini index to identify optimal attribute splits minimizing impurity in branch nodes. Employing these metrics, decision tree algorithms ensure accurate and informative model construction, selecting attribute splits that enhance tree purity and effectiveness.</p>
<p>Another foundational model utilized in this research is the K-nearest neighbors (KNN) model. The KNN technique is rooted in non-parametric and similarity-based learning methods (<xref ref-type="bibr" rid="ref24">24</xref>). These methods do not impose any assumptions about the data distribution. The KNN algorithm belongs to the realm of supervised machine learning techniques and stands out for its simplicity, straightforward implementation, and the absence of a substantial training time requirement. This versatility makes it applicable to addressing both classification and regression challenges (<xref ref-type="bibr" rid="ref25">25</xref>, <xref ref-type="bibr" rid="ref26">26</xref>).</p>
<p>In this approach, the identification of nearest neighbor locations relies on distance metrics, commonly utilizing Euclidean distance. However, other distance metrics like Manhattan distance, Minkowski distance, and various alternatives are also employed. The Euclidean distance is calculated using the following equation (<xref ref-type="bibr" rid="ref27">27</xref>):</p>
<disp-formula id="E3">
<mml:math id="M3">
<mml:mrow>
<mml:mi>D</mml:mi>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mrow>
<mml:mi>X</mml:mi>
<mml:mi mathvariant="normal">,</mml:mi>
<mml:mi>Y</mml:mi>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>=</mml:mo>
<mml:msqrt>
<mml:mrow>
<mml:munderover>
<mml:mstyle displaystyle="true">
<mml:mo>&#x2211;</mml:mo>
</mml:mstyle>
<mml:mrow>
<mml:mi>i</mml:mi>
<mml:mo>=</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mi>k</mml:mi>
</mml:munderover>
<mml:msup>
<mml:mrow>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mrow>
<mml:msub>
<mml:mi>X</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mi>Y</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mn>2</mml:mn>
</mml:msup>
</mml:mrow>
</mml:msqrt>
</mml:mrow>
</mml:math>
</disp-formula>
<p>Multilayer perceptron regression (MLP) stands as an impressive and versatile machine learning model, capable of tackling both regression and classification tasks with finesse. This model belongs to the esteemed family of feedforward artificial neural networks, drawing inspiration from the intricate workings of the human brain.</p>
<p>Within the realm of regression, MLP boasts a sophisticated multilayer architecture comprising an input layer, one or multiple hidden layers, and an output layer. These layers house artificial neurons, or nodes, interconnected through weighted connections, forging a pathway for information flow.</p>
<p>At the heart of MLP lies the mission to comprehend intricate, nonlinear relationships within the data. This journey commences with the transformation of input features, traversing a realm of weighted computations and activation functions, ultimately yielding a predicted output. This intricate process is mathematically encapsulated as follows (<xref ref-type="bibr" rid="ref28">28</xref>):</p>
<disp-formula id="E4">
<mml:math id="M4">
<mml:mtable columnalign="left">
<mml:mtr>
<mml:mtd>
<mml:mi>y</mml:mi>
<mml:mo>=</mml:mo>
<mml:mi>f</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:msup>
<mml:mi>W</mml:mi>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mi>L</mml:mi>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:msup>
<mml:mi>f</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:msup>
<mml:mi>W</mml:mi>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mi>L</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:msup>
<mml:mo stretchy="false">(</mml:mo>
<mml:mn>...</mml:mn>
<mml:mi>f</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:msup>
<mml:mi>W</mml:mi>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mn>2</mml:mn>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:msup>
<mml:mi>f</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:msup>
<mml:mi>W</mml:mi>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo stretchy="false">)</mml:mo>
<mml:mi>x</mml:mi>
</mml:mrow>
</mml:msup>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mspace width="0.25em"/>
<mml:mspace width="0.25em"/>
<mml:mspace width="0.25em"/>
<mml:mspace width="0.25em"/>
<mml:mspace width="0.25em"/>
<mml:mspace width="0.25em"/>
<mml:mspace width="0.25em"/>
<mml:mspace width="0.25em"/>
<mml:mspace width="0.25em"/>
<mml:mo>+</mml:mo>
<mml:msup>
<mml:mi>b</mml:mi>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:msup>
<mml:mo stretchy="false">)</mml:mo>
<mml:mo>+</mml:mo>
<mml:msup>
<mml:mi>b</mml:mi>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mn>2</mml:mn>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:msup>
<mml:mo stretchy="false">)</mml:mo>
<mml:mn>...</mml:mn>
<mml:mo stretchy="false">)</mml:mo>
<mml:mo>+</mml:mo>
<mml:msup>
<mml:mi>b</mml:mi>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mi>L</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:msup>
<mml:mo>+</mml:mo>
<mml:msup>
<mml:mi>b</mml:mi>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mi>L</mml:mi>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:msup>
<mml:mo stretchy="false">)</mml:mo>
</mml:mtd>
</mml:mtr>
</mml:mtable>
</mml:math>
</disp-formula>
<p>Here, <inline-formula>
<mml:math id="M5">
<mml:mi>x</mml:mi>
</mml:math>
</inline-formula> stands for the illustrious input features, <inline-formula>
<mml:math id="M6">
<mml:mrow>
<mml:msup>
<mml:mi>W</mml:mi>
<mml:mrow>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>i</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:msup>
</mml:mrow>
</mml:math>
</inline-formula> symbolizes the weight matrix of layer <italic>i,</italic> and <inline-formula>
<mml:math id="M7">
<mml:mrow>
<mml:msup>
<mml:mi>b</mml:mi>
<mml:mrow>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>i</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:msup>
</mml:mrow>
</mml:math>
</inline-formula> embodies the captivating bias vector of layer <italic>i</italic>. Also, <italic>f</italic> signifies the activation function, often a mesmerizing nonlinear entity such as ReLU (Rectified Linear Unit) or sigmoid.</p>
<p>MLP embarks on a journey of enlightenment by minimizing an aptly chosen loss function (e.g., MSE) through an optimization algorithm like the enchanting gradient descent. This iterative voyage adjusts the weights and biases, unlocking the true potential of the model&#x2019;s predictive prowess. The learning rate (<inline-formula>
<mml:math id="M8">
<mml:mi>&#x03B7;</mml:mi>
</mml:math>
</inline-formula>) gracefully guides the magnitude of the weight updates.</p>
<p>The remarkable flexibility and capacity of MLP to capture intricate, nonlinear relationships make it an invaluable instrument for an array of regression tasks. From the captivating realm of financial forecasting to the captivating art of image analysis and the captivating mastery of natural language processing, MLP shines as a beacon of hope. With the right blend of adaptability and meticulous hyperparameter tuning, MLP emerges as a reliable and accurate solution, transcending barriers to conquer real-world regression challenges.</p>
</sec>
<sec id="sec5">
<label>2.3</label>
<title>AdaBoost method</title>
<p>Adaptive boosting, also known as AdaBoost, is a technique that utilizes a group of multiple base models, with each model performing slightly better than a random predictor. The key concept behind AdaBoost is the transfer of gradients from preceding base estimators to subsequent ones, enabling the minimization of inaccuracies in previous models and enhancing their overall accuracy (<xref ref-type="bibr" rid="ref29">29</xref>).</p>
<p>Through the sequential learning process, each base estimator in AdaBoost builds upon the knowledge of its predecessors, resulting in an increase in the overall cognitive ability of the learner. This sequential learning approach allows AdaBoost to effectively handle outliers and noisy data, making it a robust technique for predictive modeling.</p>
<p>The final prediction in AdaBoost is determined by combining the estimates from all the individual weak models using weighted averaging. This ensemble approach leverages the collective knowledge of the weak models to generate a more accurate and robust prediction.</p>
<p>The flowchart of <xref ref-type="fig" rid="fig3">Figure 3</xref> shows the workflow of AdaBoost. One of the advantages of AdaBoost is its adaptability, as it can effectively handle difficult-to-predict training examples by focusing the attention of subsequent base estimators on such instances. This adaptive nature allows AdaBoost to continually improve its performance and make accurate predictions.</p>
<fig position="float" id="fig3">
<label>Figure 3</label>
<caption>
<p>Flowchart of AdaBoost method.</p>
</caption>
<graphic xlink:href="fmed-11-1397648-g003.tif"/>
</fig>
</sec>
<sec id="sec6">
<label>2.4</label>
<title>BAT optimization algorithm for hyperparameter tuning</title>
<p>In recent years, the optimization of hyperparameters has become a critical aspect of enhancing the performance of machine learning models. The BAT (Bat Algorithm) optimization algorithm, inspired by the echolocation behavior of bats, presents an innovative approach to efficiently tuning hyperparameters.</p>
<p>The Bat Algorithm, simulates the echolocation behavior of bats to find optimal solutions in a search space. It is particularly well-suited for optimization problems due to its ability to balance exploration and exploitation effectively (<xref ref-type="bibr" rid="ref30">30</xref>).</p>
<p>The algorithm introduces a population of virtual bats, each representing a potential solution in the hyperparameter space. These bats fly through the search space while adjusting their frequencies and loudness, mimicking the echolocation characteristics observed in real bats. The algorithm optimizes the solutions based on the fitness of each bat in the given problem context.</p>
<p>The application of BAT algorithm to hyperparameter tuning involves formulating the optimization problem specific to the model and dataset at hand. Let <inline-formula>
<mml:math id="M9">
<mml:mi>&#x0398;</mml:mi>
</mml:math>
</inline-formula> represent the hyperparameter vector, and <inline-formula>
<mml:math id="M10">
<mml:mrow>
<mml:mi>f</mml:mi>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>&#x0398;</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:math>
</inline-formula> denote the objective function to be optimized.</p>
<p>The BAT algorithm updates the position of each bat in the hyperparameter space using the following equations (<xref ref-type="bibr" rid="ref31">31</xref>):</p>
<list list-type="bullet">
<list-item>
<p>Frequency:</p>
</list-item>
</list>
<disp-formula id="E5">
<mml:math id="M11">
<mml:mrow>
<mml:msub>
<mml:mi>f</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>=</mml:mo>
<mml:msub>
<mml:mi>f</mml:mi>
<mml:mrow>
<mml:mi>min</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>+</mml:mo>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mrow>
<mml:msub>
<mml:mi>f</mml:mi>
<mml:mrow>
<mml:mi>max</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mi>f</mml:mi>
<mml:mrow>
<mml:mi>min</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>&#x00D7;</mml:mo>
<mml:mi>&#x03B2;</mml:mi>
</mml:mrow>
</mml:math>
</disp-formula>
<list list-type="bullet">
<list-item>
<p>Velocity:</p>
</list-item>
</list>
<disp-formula id="E6">
<mml:math id="M12">
<mml:mrow>
<mml:msub>
<mml:mi>v</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>=</mml:mo>
<mml:msub>
<mml:mi>v</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>+</mml:mo>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mrow>
<mml:msub>
<mml:mi>&#x0398;</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mi>&#x0398;</mml:mi>
<mml:mrow>
<mml:mi mathvariant="normal">bat</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>&#x00D7;</mml:mo>
<mml:msub>
<mml:mi>f</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
</mml:mrow>
</mml:math>
</disp-formula>
<list list-type="bullet">
<list-item>
<p>New position:</p>
</list-item>
</list>
<disp-formula id="E7">
<mml:math id="M13">
<mml:mrow>
<mml:msub>
<mml:mi>&#x0398;</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>=</mml:mo>
<mml:msub>
<mml:mi>&#x0398;</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>+</mml:mo>
<mml:msub>
<mml:mi>v</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
</mml:mrow>
</mml:math>
</disp-formula>
<p>Here, <inline-formula>
<mml:math id="M14">
<mml:mrow>
<mml:msub>
<mml:mi>f</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
</mml:mrow>
</mml:math>
</inline-formula> represents the frequency of the bat, <inline-formula>
<mml:math id="M15">
<mml:mrow>
<mml:msub>
<mml:mi>v</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
</mml:mrow>
</mml:math>
</inline-formula> is the velocity, <inline-formula>
<mml:math id="M16">
<mml:mi>&#x03B2;</mml:mi>
</mml:math>
</inline-formula> is a random vector, and <inline-formula>
<mml:math id="M17">
<mml:mrow>
<mml:msub>
<mml:mi mathvariant="normal">&#x0398;</mml:mi>
<mml:mrow>
<mml:mi mathvariant="normal">bat</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:math>
</inline-formula> denotes the best solution found so far.</p>
<p>The BAT optimization algorithm for hyperparameter tuning offers several advantages. It explores the hyperparameter space efficiently, adapts to different problem landscapes, and is capable of escaping local optima. However, practitioners should consider the sensitivity of the algorithm to the choice of parameters, such as the population size and the range of frequencies.</p>
<p>In a nutshell the utilization of the BAT optimization algorithm for the purpose of hyperparameter tuning presents a novel and bio-inspired methodology aimed at improving the efficacy of machine learning models. The BAT algorithm&#x2019;s ability to effectively explore the hyperparameter space makes a significant contribution to the ongoing advancement of optimization techniques within the field.</p>
</sec>
</sec>
<sec sec-type="results" id="sec7">
<label>3</label>
<title>Results and discussion</title>
<p>In this study, we investigated the relationship between variables <italic>x</italic>(m), <italic>y</italic>(m), and <italic>U</italic>(m/s), where <italic>U</italic> represents the velocity. We employed several base models, namely decision tree (DT), K-nearest neighbors (KNN), and multilayer perceptron (MLP), to predict the velocity based on the given variables. Additionally, we utilized the ensemble model AdaBoost to enhance the predictive performance of our models. In the first step of modeling, CFD simulations were conducted to obtain the velocity field for the blood flow through the vessel. The results of CFD for velocity field are illustrated in <xref ref-type="fig" rid="fig12">Scheme 1</xref>. As seen, the velocity tends to zero near the wall as no-slip boundary condition was used for the wall. Moreover, the parabolic velocity profile can be seen in the vessel which resembles the flow through a tube. The maximum velocity occurs at the center of the blood vessel.</p>
<fig position="float" id="fig12">
<label>SCHEME 1</label>
<caption>
<p>Contour of velocity field in 2 dimensions, obtained by CFD simulations.</p>
</caption>
<graphic xlink:href="fmed-11-1397648-g012.tif"/>
</fig>
<p>To fine tune the hyper-parameters of our models, we employed the BAT optimization algorithm. This algorithm efficiently explores the parameter space and finds the optimal values, leading to improved model performance. The critical hyper-parameters include setting the optimal value of K to 2 for the base K-nearest neighbors (KNN) model, determining a maximum tree depth of 8 for decision trees (DT), and selecting hidden layer sizes of (66, 29) for the multi-layer perceptron (MLP). Additionally, the number of estimators in AdaBoost on top of the base models are 10, 180, and 450 for ADA-KNN, ADA-MLP, and ADA-DT, respectively. <xref ref-type="fig" rid="fig4">Figure 4</xref> illustrates the influence of the number of estimators on model performances.</p>
<fig position="float" id="fig4">
<label>Figure 4</label>
<caption>
<p>The impact of number of base models on the model performances.</p>
</caption>
<graphic xlink:href="fmed-11-1397648-g004.tif"/>
</fig>
<p>The results obtained from our experiments are presented in <xref ref-type="table" rid="tab2">Table 2</xref>. We evaluated the performance of each model in terms of the <italic>R</italic><sup>2</sup> score and the RMSE.</p>
<table-wrap position="float" id="tab2">
<label>Table 2</label>
<caption>
<p>Performance of base models and AdaBoost ensemble.</p>
</caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left" valign="top">Model</th>
<th align="center" valign="top"><italic>R</italic><sup>2</sup> score</th>
<th align="center" valign="top">RMSE</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="middle">ADA-DT</td>
<td align="char" valign="middle" char=".">0.99783</td>
<td align="char" valign="middle" char="&#x00D7;">5.2893 &#x00D7; 10<sup>&#x2212;3</sup></td>
</tr>
<tr>
<td align="left" valign="middle">ADA-KNN</td>
<td align="char" valign="middle" char=".">0.98524</td>
<td align="char" valign="middle" char="&#x00D7;">1.3291 &#x00D7; 10<sup>&#x2212;2</sup></td>
</tr>
<tr>
<td align="left" valign="middle">ADA-MLP</td>
<td align="char" valign="middle" char=".">0.99603</td>
<td align="char" valign="middle" char="&#x00D7;">7.1369 &#x00D7; 10<sup>&#x2212;3</sup></td>
</tr>
</tbody>
</table>
</table-wrap>
<p>Our results indicate that all base models, when combined with AdaBoost, achieved high accuracy in predicting the velocity. The ADA-DT model demonstrated outstanding performance, exhibiting a significant <italic>R</italic><sup>2</sup> score of 0.99783 and a low RMSE of 5.2893&#x2009;&#x00D7;&#x2009;10<sup>&#x2212;3</sup>. This suggests that the decision tree-based model, when boosted with AdaBoost, effectively captured the underlying patterns in the data and produced accurate predictions. The comparison between the expected values and the predicted values is depicted in <xref ref-type="fig" rid="fig5">Figure 5</xref> using the model.</p>
<fig position="float" id="fig5">
<label>Figure 5</label>
<caption>
<p>Visualization of expected values compared to predicted values using ADA-DT model.</p>
</caption>
<graphic xlink:href="fmed-11-1397648-g005.tif"/>
</fig>
<p>The ADA-KNN model also yielded promising results, with an <italic>R</italic><sup>2</sup> test score of 0.98524 and an RMSE of 1.3291&#x2009;&#x00D7;&#x2009;10<sup>&#x2212;2</sup>. This indicates that the K-nearest neighbors algorithm, in conjunction with AdaBoost, successfully captured the local relationships in the dataset and provided accurate predictions. This model is used to depict the comparison between the expected and predicted values in <xref ref-type="fig" rid="fig6">Figure 6</xref>.</p>
<fig position="float" id="fig6">
<label>Figure 6</label>
<caption>
<p>Visualization of expected values compared to predicted values using ADA-KNN model.</p>
</caption>
<graphic xlink:href="fmed-11-1397648-g006.tif"/>
</fig>
<p>Similarly, the ADA-MLP model demonstrated strong predictive performance, with an <italic>R</italic><sup>2</sup> test score of 0.99603 and an RMSE of 7.1369&#x2009;&#x00D7;&#x2009;10<sup>&#x2212;3</sup>. This suggests that the multilayer perceptron, coupled with AdaBoost, effectively learned the complex relationships between the variables and accurately predicted the velocity. The comparison between the expected values and the predicted values is depicted in <xref ref-type="fig" rid="fig7">Figure 7</xref> using the model.</p>
<fig position="float" id="fig7">
<label>Figure 7</label>
<caption>
<p>Visualization of expected values compared to predicted values using ADA-MLP model.</p>
</caption>
<graphic xlink:href="fmed-11-1397648-g007.tif"/>
</fig>
<p>Overall, our findings highlight the effectiveness of AdaBoost in improving the performance of base models in predicting the velocity based on variables <italic>x</italic>(m) and <italic>y</italic>(m). The high <italic>R</italic><sup>2</sup> scores and low RMSE values obtained demonstrate the accuracy and reliability of our models. The ADA-DT performs relatively better than the two other models. The learning curve depicted in <xref ref-type="fig" rid="fig8">Figure 8</xref>, serves as a validation of the ADA-DT performance. It illustrates how the model&#x2019;s training, and cross-validation scores evolve with an increasing number of training examples. Notably, as the number of training examples grows, both scores converge and stabilize, indicating that the model generalizes well to unseen data. This convergence suggests that the model is effectively learning from the training data and can make reliable predictions on new instances, affirming its validity and robustness.</p>
<fig position="float" id="fig8">
<label>Figure 8</label>
<caption>
<p>Learning curve for ADA-DT model.</p>
</caption>
<graphic xlink:href="fmed-11-1397648-g008.tif"/>
</fig>
<p>As a result, we chose this model as the best-fit model, with the partial dependencies depicted in <xref ref-type="fig" rid="fig9">Figures 9</xref>, <xref ref-type="fig" rid="fig10">10</xref>, and the 3D surface of this model depicted in <xref ref-type="fig" rid="fig11">Figure 11</xref>. The parabolic velocity profile can be observed in radial direction which is due to the imposed boundary conditions as well as the effect of viscous forces on the flow pattern. It should be noted that we considered continuum medium for the fluid flow containing the nanoparticles, however future study can develop two-phase flow models for considering the existence of solid particles and their influence on the flow pattern.</p>
<fig position="float" id="fig9">
<label>Figure 9</label>
<caption>
<p>Partial dependency of <italic>x</italic>(m) on <italic>U</italic>(m/s).</p>
</caption>
<graphic xlink:href="fmed-11-1397648-g009.tif"/>
</fig>
<fig position="float" id="fig10">
<label>Figure 10</label>
<caption>
<p>Partial dependency of <italic>y</italic>(m) on <italic>U</italic>(m/s).</p>
</caption>
<graphic xlink:href="fmed-11-1397648-g010.tif"/>
</fig>
<fig position="float" id="fig11">
<label>Figure 11</label>
<caption>
<p>Final 3D prediction surface plot of velocity distribution.</p>
</caption>
<graphic xlink:href="fmed-11-1397648-g011.tif"/>
</fig>
</sec>
<sec sec-type="conclusions" id="sec8">
<label>4</label>
<title>Conclusion</title>
<p>The main aim of the current study was to develop hybrid models for simulation of blood flow through vessel containing magnetic nanoparticles. The role of nanoparticles is the carrier for cancer drug to reach the target. The modeling strategy was conducted in two steps, i.e., CFD simulations followed by ML modeling. Based on the dataset containing variables <italic>x</italic>(m), <italic>y</italic>(m), and <italic>U</italic>(m/s), the aim of this research was to develop an ensemble model using the AdaBoost algorithm for predicting the velocity, represented by <italic>U</italic>(m/s). Three base models, namely DT, KNN, and MLP, were utilized in conjunction with AdaBoost to enhance predictive accuracy.</p>
<p>The results obtained from the AdaBoost ensemble model in combination with each of the base models were highly promising. The ADA-DT model demonstrated a highly notable <italic>R</italic><sup>2</sup> value of 0.99783 and a remarkably low RMSE of 5.2893&#x2009;&#x00D7;&#x2009;10<sup>&#x2212;3</sup>. In a similar vein, the ADA-KNN model demonstrated a noteworthy <italic>R</italic><sup>2</sup> score of 0.98524, accompanied by an RMSE of 1.3291&#x2009;&#x00D7;&#x2009;10<sup>&#x2212;2</sup>. The ADA-MLP model demonstrated exceptional performance, achieving an <italic>R</italic><sup>2</sup> value of 0.99603 and an RMSE of 7.1369&#x2009;&#x00D7;&#x2009;10<sup>&#x2212;3</sup>.</p>
<p>The results of this study underscore the efficacy and dependability of the AdaBoost ensemble model in forecasting velocity using the provided dataset. The high <italic>R</italic><sup>2</sup> scores and low RMSE values indicate that the model accurately captures the relationship between the input features [<italic>x</italic>(m) and <italic>y</italic>(m)] and the output variable [<italic>U</italic>(m/s)]. This showcases the potential of the ensemble approach in improving prediction accuracy over individual base models.</p>
<p>It is worth mentioning that the hyper-parameter optimization of the ensemble model was conducted using the BAT optimization algorithm. This approach ensured that the model parameters were fine-tuned to achieve optimal performance. The utilization of such advanced optimization techniques further enhances the credibility and robustness of the findings.</p>
<p>In conclusion, this study successfully developed an AdaBoost ensemble model incorporating base models such as DT, KNN, and MLP to predict velocity based on the provided dataset. The impressive performance of the ensemble model, as evidenced by high <italic>R</italic><sup>2</sup> scores and low RMSE values, underscores its efficacy in accurately estimating velocity. The utilization of the BAT optimization algorithm for hyper-parameter optimization adds a layer of sophistication to the research methodology.</p>
</sec>
<sec sec-type="data-availability" id="sec9">
<title>Data availability statement</title>
<p>The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding author.</p>
</sec>
<sec sec-type="author-contributions" id="sec10">
<title>Author contributions</title>
<p>RA: Data curation, Investigation, Software, Writing &#x2013; original draft. MA: Formal analysis, Methodology, Validation, Writing &#x2013; original draft. JA: Project administration, Resources, Software, Writing &#x2013; original draft.</p>
</sec>
</body>
<back>
<sec sec-type="funding-information" id="sec11">
<title>Funding</title>
<p>The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This research was funded by Taif University, Saudi Arabia, Project No. TU-DSPP-2024-96.</p>
</sec>
<ack>
<p>The authors extend their appreciation to Taif University, Saudi Arabia, for supporting this work through project number (TU-DSPP-2024-96). This Study is supported via funding from Prince Sattam bin Abdulaziz University, project number (PSAU/2023/R/1444). Princess Nourah bint Abdulrahman University Researchers Supporting Project number (PNURSP2024R340), Princess Nourah bint Abdulrahman University, Riyadh, Saudi Arabia.</p>
</ack>
<sec sec-type="COI-statement" id="sec12">
<title>Conflict of interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="sec13">
<title>Publisher&#x2019;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<ref-list>
<title>References</title>
<ref id="ref1"><label>1.</label> <citation citation-type="journal"><person-group person-group-type="author"><name><surname>Li</surname> <given-names>Y</given-names></name> <name><surname>Yan</surname> <given-names>B</given-names></name> <name><surname>He</surname> <given-names>S</given-names></name></person-group>. <article-title>Advances and challenges in the treatment of lung cancer</article-title>. <source>Biomed Pharmacother</source>. (<year>2023</year>) <volume>169</volume>:<fpage>115891</fpage>. doi: <pub-id pub-id-type="doi">10.1016/j.biopha.2023.115891</pub-id></citation></ref>
<ref id="ref2"><label>2.</label> <citation citation-type="journal"><person-group person-group-type="author"><name><surname>Raghuwanshi</surname> <given-names>S</given-names></name> <name><surname>Gartel</surname> <given-names>AL</given-names></name></person-group>. <article-title>Small-molecule inhibitors targeting FOXM1: current challenges and future perspectives in cancer treatments</article-title>. <source>Biochim Biophys Acta</source>. (<year>2023</year>) <volume>1878</volume>:<fpage>189015</fpage>. doi: <pub-id pub-id-type="doi">10.1016/j.bbcan.2023.189015</pub-id></citation></ref>
<ref id="ref3"><label>3.</label> <citation citation-type="journal"><person-group person-group-type="author"><name><surname>Li</surname> <given-names>D</given-names></name> <name><surname>Peng</surname> <given-names>X</given-names></name> <name><surname>Hu</surname> <given-names>Z</given-names></name> <name><surname>Li</surname> <given-names>S</given-names></name> <name><surname>Chen</surname> <given-names>J</given-names></name> <name><surname>Pan</surname> <given-names>W</given-names></name></person-group>. <article-title>Small molecules targeting selected histone methyltransferases (HMTs) for cancer treatment: current progress and novel strategies</article-title>. <source>Eur J Med Chem</source>. (<year>2023</year>) <volume>264</volume>:<fpage>115982</fpage>. doi: <pub-id pub-id-type="doi">10.1016/j.ejmech.2023.115982</pub-id></citation></ref>
<ref id="ref4"><label>4.</label> <citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wang</surname> <given-names>M</given-names></name> <name><surname>Vulcano</surname> <given-names>S</given-names></name> <name><surname>Xu</surname> <given-names>C</given-names></name> <name><surname>Xie</surname> <given-names>R</given-names></name> <name><surname>Peng</surname> <given-names>W</given-names></name> <name><surname>Wang</surname> <given-names>J</given-names></name> <etal/></person-group>. <article-title>Potentials of ribosomopathy gene as pharmaceutical targets for cancer treatment</article-title>. <source>J Pharm Anal</source>. (<year>2023</year>) <volume>14</volume>:<fpage>308</fpage>&#x2013;<lpage>20</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.jpha.2023.10.001</pub-id></citation></ref>
<ref id="ref5"><label>5.</label> <citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ayyanaar</surname> <given-names>S</given-names></name> <name><surname>Bhaskar</surname> <given-names>R</given-names></name> <name><surname>Esthar</surname> <given-names>S</given-names></name> <name><surname>Vadivel</surname> <given-names>M</given-names></name> <name><surname>Rajesh</surname> <given-names>J</given-names></name> <name><surname>Rajagopal</surname> <given-names>G</given-names></name></person-group>. <article-title>Design and development of 5-fluorouracil loaded biodegradable magnetic microspheres as site-specific drug delivery vehicle for cancer therapy</article-title>. <source>J Magn Magn Mater</source>. (<year>2022</year>) <volume>546</volume>:<fpage>168853</fpage>. doi: <pub-id pub-id-type="doi">10.1016/j.jmmm.2021.168853</pub-id></citation></ref>
<ref id="ref6"><label>6.</label> <citation citation-type="journal"><person-group person-group-type="author"><name><surname>Calder&#x00F3;n Bedoya</surname> <given-names>PA</given-names></name> <name><surname>Botta</surname> <given-names>PM</given-names></name> <name><surname>Bercoff</surname> <given-names>PG</given-names></name> <name><surname>Fanovich</surname> <given-names>MA</given-names></name></person-group>. <article-title>Influence of the milling materials on the mechanochemical synthesis of magnetic iron oxide nanoparticles</article-title>. <source>J Alloys Compd</source>. (<year>2023</year>) <volume>939</volume>:<fpage>168720</fpage>. doi: <pub-id pub-id-type="doi">10.1016/j.jallcom.2023.168720</pub-id></citation></ref>
<ref id="ref7"><label>7.</label> <citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mohammad</surname> <given-names>F</given-names></name> <name><surname>Bwatanglang</surname> <given-names>IB</given-names></name> <name><surname>Al-Lohedan</surname> <given-names>HA</given-names></name> <name><surname>Shaik</surname> <given-names>JP</given-names></name> <name><surname>Moosavi</surname> <given-names>M</given-names></name> <name><surname>Dahan</surname> <given-names>WM</given-names></name> <etal/></person-group>. <article-title>Magnetically controlled drug delivery and hyperthermia effects of core-shell Cu@Mn<sub>3</sub>O<sub>4</sub> nanoparticles towards cancer cells <italic>in vitro</italic></article-title>. <source>Int J Biol Macromol</source>. (<year>2023</year>) <volume>249</volume>:<fpage>126071</fpage>. doi: <pub-id pub-id-type="doi">10.1016/j.ijbiomac.2023.126071</pub-id>, PMID: <pub-id pub-id-type="pmid">37524291</pub-id></citation></ref>
<ref id="ref8"><label>8.</label> <citation citation-type="journal"><person-group person-group-type="author"><name><surname>Li</surname> <given-names>X</given-names></name> <name><surname>Lin</surname> <given-names>H</given-names></name> <name><surname>Li</surname> <given-names>Q</given-names></name> <name><surname>Xue</surname> <given-names>J</given-names></name> <name><surname>Xu</surname> <given-names>Y</given-names></name> <name><surname>Zhuang</surname> <given-names>L</given-names></name></person-group>. <article-title>Recyclable magnetic fluorescent Fe<sub>3</sub>O<sub>4</sub>@SiO<sub>2</sub> core&#x2013;shell nanoparticles decorated with carbon dots for fluoride ion removal</article-title>. <source>ACS Appl Nano Mater</source>. (<year>2021</year>) <volume>4</volume>:<fpage>3062</fpage>&#x2013;<lpage>74</lpage>. doi: <pub-id pub-id-type="doi">10.1021/acsanm.1c00238</pub-id></citation></ref>
<ref id="ref9"><label>9.</label> <citation citation-type="journal"><person-group person-group-type="author"><name><surname>Xue</surname> <given-names>J</given-names></name> <name><surname>Li</surname> <given-names>X</given-names></name> <name><surname>Li</surname> <given-names>Q</given-names></name> <name><surname>Lyu</surname> <given-names>J</given-names></name> <name><surname>Wang</surname> <given-names>W</given-names></name> <name><surname>Zhuang</surname> <given-names>L</given-names></name> <etal/></person-group>. <article-title>Magnetic drug-loaded osteoinductive Fe<sub>3</sub>O<sub>4</sub>/CaCO<sub>3</sub> hybrid microspheres system: efficient for sustained release of antibiotics</article-title>. <source>J Phys D Appl Phys</source>. (<year>2020</year>) <volume>53</volume>:<fpage>245401</fpage>. doi: <pub-id pub-id-type="doi">10.1088/1361-6463/ab7bb2</pub-id></citation></ref>
<ref id="ref10"><label>10.</label> <citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rotariu</surname> <given-names>O</given-names></name> <name><surname>Strachan</surname> <given-names>NJC</given-names></name></person-group>. <article-title>Modelling magnetic carrier particle targeting in the tumor microvasculature for cancer treatment</article-title>. <source>J Magn Magn Mater</source>. (<year>2005</year>) <volume>293</volume>:<fpage>639</fpage>&#x2013;<lpage>46</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.jmmm.2005.01.081</pub-id></citation></ref>
<ref id="ref11"><label>11.</label> <citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sadhasivam</surname> <given-names>J</given-names></name> <name><surname>Sugumaran</surname> <given-names>A</given-names></name></person-group>. <article-title>Magnetic nanocarriers: emerging tool for the effective targeted treatment of lung cancer</article-title>. <source>J Drug Deliv Technol</source>. (<year>2020</year>) <volume>55</volume>:<fpage>101493</fpage>. doi: <pub-id pub-id-type="doi">10.1016/j.jddst.2019.101493</pub-id></citation></ref>
<ref id="ref12"><label>12.</label> <citation citation-type="journal"><person-group person-group-type="author"><name><surname>Majee</surname> <given-names>S</given-names></name> <name><surname>Shit</surname> <given-names>GC</given-names></name></person-group>. <article-title>Modeling and simulation of blood flow with magnetic nanoparticles as carrier for targeted drug delivery in the stenosed artery</article-title>. <source>Eur J Mech B</source>. (<year>2020</year>) <volume>83</volume>:<fpage>42</fpage>&#x2013;<lpage>57</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.euromechflu.2020.04.004</pub-id></citation></ref>
<ref id="ref13"><label>13.</label> <citation citation-type="journal"><person-group person-group-type="author"><name><surname>Babanezhad</surname> <given-names>M</given-names></name> <name><surname>Behroyan</surname> <given-names>I</given-names></name> <name><surname>Nakhjiri</surname> <given-names>AT</given-names></name> <name><surname>Marjani</surname> <given-names>A</given-names></name> <name><surname>Rezakazemi</surname> <given-names>M</given-names></name> <name><surname>Heydarinasab</surname> <given-names>A</given-names></name> <etal/></person-group>. <article-title>Investigation on performance of particle swarm optimization (PSO) algorithm based fuzzy inference system (PSOFIS) in a combination of CFD modeling for prediction of fluid flow</article-title>. <source>Sci Rep</source>. (<year>2021</year>) <volume>11</volume>:<fpage>1505</fpage>. doi: <pub-id pub-id-type="doi">10.1038/s41598-021-81111-z</pub-id>, PMID: <pub-id pub-id-type="pmid">33452362</pub-id></citation></ref>
<ref id="ref14"><label>14.</label> <citation citation-type="book"><person-group person-group-type="author"><name><surname>Zhou</surname> <given-names>Z-H</given-names></name></person-group>. <source>Machine learning</source>. <publisher-name>Springer Nature</publisher-name> (<year>2021</year>).</citation></ref>
<ref id="ref15"><label>15.</label> <citation citation-type="journal"><person-group person-group-type="author"><name><surname>Goodfellow</surname> <given-names>I</given-names></name> <name><surname>Bengio</surname> <given-names>Y</given-names></name> <name><surname>Courville</surname> <given-names>A</given-names></name></person-group>. <article-title>Machine learning basics</article-title>. <source>Deep Learn</source>. (<year>2016</year>) <volume>1</volume>:<fpage>98</fpage>&#x2013;<lpage>164</lpage>.</citation></ref>
<ref id="ref16"><label>16.</label> <citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mailagaha Kumbure</surname> <given-names>M</given-names></name> <name><surname>Luukka</surname> <given-names>P</given-names></name></person-group>. <article-title>A generalized fuzzy K-nearest neighbor regression model based on Minkowski distance</article-title>. <source>Granul Comput</source>. (<year>2022</year>) <volume>7</volume>:<fpage>657</fpage>&#x2013;<lpage>71</lpage>. doi: <pub-id pub-id-type="doi">10.1007/s41066-021-00288-w</pub-id></citation></ref>
<ref id="ref17"><label>17.</label> <citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kotsiantis</surname> <given-names>SB</given-names></name></person-group>. <article-title>Decision trees: a recent overview</article-title>. <source>Artif Intell Rev</source>. (<year>2013</year>) <volume>39</volume>:<fpage>261</fpage>&#x2013;<lpage>83</lpage>. doi: <pub-id pub-id-type="doi">10.1007/s10462-011-9272-4</pub-id></citation></ref>
<ref id="ref18"><label>18.</label> <citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ferr&#x00E9;</surname> <given-names>L</given-names></name> <name><surname>Villa</surname> <given-names>N</given-names></name></person-group>. <article-title>Multilayer perceptron with functional inputs: an inverse regression approach</article-title>. <source>Scand J Stat</source>. (<year>2006</year>) <volume>33</volume>:<fpage>807</fpage>&#x2013;<lpage>23</lpage>. doi: <pub-id pub-id-type="doi">10.1111/j.1467-9469.2006.00496.x</pub-id></citation></ref>
<ref id="ref19"><label>19.</label> <citation citation-type="other"><person-group person-group-type="author"><collab id="coll1">COMSOL Multiphysics</collab></person-group>. (<year>2008</year>). <source>Comsol Multiphyscis model library</source></citation></ref>
<ref id="ref20"><label>20.</label> <citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wei</surname> <given-names>Z</given-names></name> <name><surname>He</surname> <given-names>Q</given-names></name> <name><surname>Zhao</surname> <given-names>Y</given-names></name></person-group>. <article-title>Machine learning for battery research</article-title>. <source>J Power Sources</source>. (<year>2022</year>) <volume>549</volume>:<fpage>232125</fpage>. doi: <pub-id pub-id-type="doi">10.1016/j.jpowsour.2022.232125</pub-id></citation></ref>
<ref id="ref21"><label>21.</label> <citation citation-type="journal"><person-group person-group-type="author"><name><surname>Li</surname> <given-names>X</given-names></name> <name><surname>Wang</surname> <given-names>Y</given-names></name> <name><surname>Fan</surname> <given-names>D</given-names></name> <name><surname>Al-Shati</surname> <given-names>AS</given-names></name></person-group>. <article-title>Separation of sulfur compounds from petroleum using hydrodesulfurization method to reduce SO<sub>2</sub> emission: process optimization and validation</article-title>. <source>Case Stud Therm Eng</source>. (<year>2023</year>) <volume>49</volume>:<fpage>103384</fpage>. doi: <pub-id pub-id-type="doi">10.1016/j.csite.2023.103384</pub-id></citation></ref>
<ref id="ref22"><label>22.</label> <citation citation-type="journal"><person-group person-group-type="author"><name><surname>Talekar</surname> <given-names>B</given-names></name> <name><surname>Agrawal</surname> <given-names>S</given-names></name></person-group>. <article-title>A detailed review on decision tree and random forest</article-title>. <source>Biosci Biotechnol Res Commun</source>. (<year>2020</year>) <volume>13</volume>:<fpage>245</fpage>&#x2013;<lpage>8</lpage>. doi: <pub-id pub-id-type="doi">10.21786/bbrc/13.14/57</pub-id></citation></ref>
<ref id="ref23"><label>23.</label> <citation citation-type="book"><person-group person-group-type="author"><name><surname>Leni&#x010D;</surname> <given-names>M</given-names></name> <name><surname>Povalej</surname> <given-names>P</given-names></name> <name><surname>Kokol</surname> <given-names>P</given-names></name></person-group>. <source>Impact of purity measures on knowledge extraction in decision trees</source>. <publisher-name>Springer</publisher-name> (<year>2006</year>).</citation></ref>
<ref id="ref24"><label>24.</label> <citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lubis</surname> <given-names>AR</given-names></name> <name><surname>Lubis</surname> <given-names>M</given-names></name></person-group>. <article-title>Optimization of distance formula in K-nearest neighbor method</article-title>. <source>Bull Electr Eng Inform</source>. (<year>2020</year>) <volume>9</volume>:<fpage>326</fpage>&#x2013;<lpage>38</lpage>. doi: <pub-id pub-id-type="doi">10.11591/eei.v9i1.1464</pub-id></citation></ref>
<ref id="ref25"><label>25.</label> <citation citation-type="journal"><person-group person-group-type="author"><name><surname>Parvin</surname> <given-names>H</given-names></name> <name><surname>Alizadeh</surname> <given-names>H</given-names></name> <name><surname>Minati</surname> <given-names>B</given-names></name></person-group>. <article-title>A modification on K-nearest neighbor classifier</article-title>. <source>Glob J Comput Sci Technol</source>. (<year>2010</year>) <volume>10</volume>:<fpage>37</fpage>.</citation></ref>
<ref id="ref26"><label>26.</label> <citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chen</surname> <given-names>C-R</given-names></name> <name><surname>Three Kartini</surname> <given-names>U</given-names></name></person-group>. <article-title>K-nearest neighbor neural network models for very short-term global solar irradiance forecasting based on meteorological data</article-title>. <source>Energies</source>. (<year>2017</year>) <volume>10</volume>:<fpage>186</fpage>. doi: <pub-id pub-id-type="doi">10.3390/en10020186</pub-id></citation></ref>
<ref id="ref27"><label>27.</label> <citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ace</surname> <given-names>A</given-names></name> <name><surname>Rio</surname> <given-names>A</given-names></name></person-group>. <article-title>Remote sensor network application for monitoring system and air quality classification</article-title>. <source>IAIC Trans Sustain Digit Innov</source>. (<year>2020</year>) <volume>2</volume>:<fpage>32</fpage>&#x2013;<lpage>45</lpage>. doi: <pub-id pub-id-type="doi">10.34306/itsdi.v2i1.350</pub-id></citation></ref>
<ref id="ref28"><label>28.</label> <citation citation-type="journal"><person-group person-group-type="author"><name><surname>Popescu</surname> <given-names>M-C</given-names></name> <etal/></person-group>. <article-title>Multilayer perceptron and neural networks</article-title>. <source>WSEAS Trans Circuits Syst</source>. (<year>2009</year>) <volume>8</volume>:<fpage>579</fpage>&#x2013;<lpage>88</lpage>.</citation></ref>
<ref id="ref29"><label>29.</label> <citation citation-type="journal"><person-group person-group-type="author"><name><surname>Freund</surname> <given-names>Y</given-names></name> <name><surname>Schapire</surname> <given-names>RE</given-names></name></person-group>. <article-title>A decision-theoretic generalization of on-line learning and an application to boosting</article-title>. <source>J Comput Syst Sci</source>. (<year>1997</year>) <volume>55</volume>:<fpage>119</fpage>&#x2013;<lpage>39</lpage>. doi: <pub-id pub-id-type="doi">10.1006/jcss.1997.1504</pub-id></citation></ref>
<ref id="ref30"><label>30.</label> <citation citation-type="book"><person-group person-group-type="author"><name><surname>Yang</surname> <given-names>X-S</given-names></name></person-group>. <article-title>A new metaheuristic bat-inspired algorithm</article-title>. In: <source>Nature inspired cooperative strategies for optimization (NICSO 2010)</source>: <publisher-name>Springer</publisher-name> (<year>2010</year>). <fpage>65</fpage>&#x2013;<lpage>74</lpage>.</citation></ref>
<ref id="ref31"><label>31.</label> <citation citation-type="other"><person-group person-group-type="author"><name><surname>Yang</surname> <given-names>X-S</given-names></name></person-group>. (<year>2013</year>) <article-title>Bat algorithm: literature review and applications</article-title>. <italic>arXiv</italic>. Available at: <ext-link xlink:href="https://doi.org/10.1504/IJBIC.2013.055093" ext-link-type="uri">https://doi.org/10.1504/IJBIC.2013.055093</ext-link>. [Epub ahead of preprint]</citation></ref>
</ref-list>
</back>
</article>