<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<?covid-19-tdm?>
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" article-type="research-article" dtd-version="2.3" xml:lang="EN">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Public Health</journal-id>
<journal-title>Frontiers in Public Health</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Public Health</abbrev-journal-title>
<issn pub-type="epub">2296-2565</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fpubh.2024.1398297</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Public Health</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>A follow up report validating long term predictions of the COVID-19 epidemic in the UK using a dynamic causal model</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Bowie</surname> <given-names>Cam</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x002A;</sup></xref>
<uri xlink:href="https://loop.frontiersin.org/people/1504352/overview"/>
<role content-type="https://credit.niso.org/contributor-roles/formal-analysis/"/>
<role content-type="https://credit.niso.org/contributor-roles/writing-original-draft/"/>
<role content-type="https://credit.niso.org/contributor-roles/writing-review-editing/"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Friston</surname> <given-names>Karl</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="https://loop.frontiersin.org/people/20407/overview"/>
<role content-type="https://credit.niso.org/contributor-roles/conceptualization/"/>
<role content-type="https://credit.niso.org/contributor-roles/data-curation/"/>
<role content-type="https://credit.niso.org/contributor-roles/formal-analysis/"/>
<role content-type="https://credit.niso.org/contributor-roles/funding-acquisition/"/>
<role content-type="https://credit.niso.org/contributor-roles/investigation/"/>
<role content-type="https://credit.niso.org/contributor-roles/methodology/"/>
<role content-type="https://credit.niso.org/contributor-roles/supervision/"/>
<role content-type="https://credit.niso.org/contributor-roles/validation/"/>
<role content-type="https://credit.niso.org/contributor-roles/writing-original-draft/"/>
<role content-type="https://credit.niso.org/contributor-roles/writing-review-editing/"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Retired</institution>, <addr-line>Somerset</addr-line>, <country>United Kingdom</country></aff>
<aff id="aff2"><sup>2</sup><institution>Queen Square Institute of Neurology, University College London</institution>, <addr-line>London</addr-line>, <country>United Kingdom</country></aff>
<author-notes>
<fn fn-type="edited-by" id="fn0001"><p>Edited by: Jie Huang, Southern University of Science and Technology, China</p></fn>
<fn fn-type="edited-by" id="fn0002"><p>Reviewed by: Chulwook Park, Seoul National University, Republic of Korea</p><p>Yali Zheng, Xiamen University, China</p></fn>
<corresp id="c001">&#x002A;Correspondence: Cam Bowie, <email>cam.bowie1@gmail.com</email></corresp>
</author-notes>
<pub-date pub-type="epub">
<day>09</day>
<month>09</month>
<year>2024</year>
</pub-date>
<pub-date pub-type="collection">
<year>2024</year>
</pub-date>
<volume>12</volume>
<elocation-id>1398297</elocation-id>
<history>
<date date-type="received">
<day>09</day>
<month>03</month>
<year>2024</year>
</date>
<date date-type="accepted">
<day>23</day>
<month>08</month>
<year>2024</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x00A9; 2024 Bowie and Friston.</copyright-statement>
<copyright-year>2024</copyright-year>
<copyright-holder>Bowie and Friston</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p>
</license>
</permissions>
<abstract>
<sec id="sec1">
<title>Background</title>
<p>This paper asks whether Dynamic Causal modelling (DCM) can predict the long-term clinical impact of the COVID-19 epidemic. DCMs are designed to continually assimilate data and modify model parameters, such as transmissibility of the virus, changes in social distancing and vaccine coverage&#x2014;to accommodate changes in population dynamics and virus behavior. But as a novel way to model epidemics do they produce valid predictions? We presented DCM predictions 12&#x2009;months ago, which suggested an increase in viral transmission was accompanied by a reduction in pathogenicity. These changes provided plausible reasons why the model underestimated deaths, hospital admissions and acute-post COVID-19 syndrome by 20%. A further 12-month validation exercise could help to assess how useful such predictions are.</p>
</sec>
<sec id="sec2">
<title>Methods</title>
<p>we compared DCM predictions&#x2014;made in October 2022&#x2014;with actual outcomes over the 12-months to October 2023. The model was then used to identify changes in COVID-19 transmissibility and the sociobehavioral responses that may explain discrepancies between predictions and outcomes over this period. The model was then used to predict future trends in infections, long-COVID, hospital admissions and deaths over 12-months to October 2024, as a prelude to future tests of predictive validity.</p>
</sec>
<sec id="sec3">
<title>Findings</title>
<p>Unlike the previous predictions&#x2014;which were an underestimate&#x2014;the predictions made in October 2022 overestimated incidence, death and admission rates. This overestimation appears to have been caused by reduced infectivity of new variants, less movement of people and a higher persistence of immunity following natural infection and vaccination.</p>
</sec>
<sec id="sec4">
<title>Interpretation</title>
<p>despite an expressive (generative) model, with time-dependent epidemiological and sociobehavioral parameters, the model overestimated morbidity and mortality. Effectively, the model failed to accommodate the &#x201C;law of declining virulence&#x201D; over a timescale of years. This speaks to a fundamental issue in long-term forecasting: how to model decreases in virulence over a timescale of years? A potential answer may be available in a year when the predictions for 2024&#x2014;under a model with slowly accumulating T-cell like immunity&#x2014;can be assessed against actual outcomes.</p>
</sec>
</abstract>
<kwd-group>
<kwd>dynamic causal model</kwd>
<kwd>COVID-19 mitigation measures</kwd>
<kwd>acute-post COVID-19</kwd>
<kwd>hospital admissions</kwd>
<kwd>mortality incidence</kwd>
</kwd-group>
<counts>
<fig-count count="10"/>
<table-count count="1"/>
<equation-count count="0"/>
<ref-count count="23"/>
<page-count count="14"/>
<word-count count="5476"/>
</counts>
<custom-meta-wrap>
<custom-meta>
<meta-name>section-at-acceptance</meta-name>
<meta-value>Public Health Policy</meta-value>
</custom-meta>
</custom-meta-wrap>
</article-meta>
</front>
<body>
<sec id="sec5">
<title>Background</title>
<p>Dynamic causal modelling (DCM) stands apart from most modelling in epidemiology by predicting <italic>mitigated</italic> outcomes and quantifying the uncertainty associated with those outcomes (<xref ref-type="bibr" rid="ref1 ref2 ref3">1&#x2013;3</xref>). This contrasts with quantitative epidemiological forecasts that do not consider the effect of prevalence on sociobehavioral responses. Usually, epidemiological projections are over few weeks&#x2014;and rest upon fitting curves to the recent trajectory of various data; e.g., (<xref ref-type="bibr" rid="ref4">4</xref>). DCM considers what is most likely to happen based upon a generative model that best explains all the data available. This mandates a model of sociobehavioral responses that mitigate viral transmission, such as social distancing, lockdown, testing and tracing, etc. In turn, this requires a detailed consideration of how various sorts of data are generated. For example, it has to model fluctuations in testing capacity and sampling bias due to people self-selecting when symptomatic. The advantage of this kind of modelling is that any data generated by the model can be used to inform the model parameters that underwrite fluctuations in latent states, such as the prevalence of infection. Latent states refer to those states of the population that cannot be estimated directly and have to be inferred from observable data.</p>
<p>In October 2022, the predictions carried out 12 months earlier using a Dynamic Causal model were assessed and found to underestimate the waves of new COVID-19 infections in the period October 2021 to October 2022 by 43%, deaths by 20%, tests by 24%, hospital admissions by 31% and long COVID by 21% (<xref ref-type="bibr" rid="ref5">5</xref>). This method of modelling besides predicting health outcomes can also estimate changing characteristics of the epidemic, such as the properties of viral transmission, immunity induced by vaccine or infection, and the propensity to leave home thereby increasing the risk of catching the infection. We concluded that the underestimation of predictions could be explained by the arrival of the Omicron variants and the changes in public health policies in the UK (<xref ref-type="bibr" rid="ref6 ref7 ref8">6&#x2013;8</xref>).</p>
<p>This paper is a sequel to the previous paper which, besides seeking to validate the previous 12-month predictions, makes predictions to October 2023. It sets out to assess the underlying properties of the epidemic during that period from October 2022 to October 2023. It also seeks to predict what will happen in the 12 months to October 2024 assuming the current properties of the epidemic remain as they are in October 2023. We take the opportunity to provide predictions under priors based upon recent empirical estimates of latent, incubation and infectious periods. In 2024, the accuracy of predictions should speak to the usefulness of constraining parameter estimates with informative (empirical) priors of this sort.</p>
<p>This article can be read as a technical report, following up on previous reports, in which certain predictions were made. We anticipate a follow-up report evaluating the predictions made in this article over the forthcoming year, which will also provide an overall synthesis of long-term forecasting with dynamic causal modelling. This report provides the opportunity to compare long-term forecasts with what actually happened over timescales of years. We therefore take the opportunity to compare the predictions and actual outcomes quantitatively. Crucially, this comparison is in the latent state space of the causes of epidemiological (and behavioral) measurements. In other words, because we are using a generative or forward model of the epidemic, we can revisit the predicted fluctuations in time-dependent epidemiological and behavioral parameters <italic>in the light of post-hoc estimates using the same model</italic>. This effectively identifies where prior assumptions about key time-dependent parameters were not endorsed by empirical outcomes. This may be useful for future modelling initiatives along these lines.</p>
</sec>
<sec sec-type="methods" id="sec6">
<title>Methods</title>
<sec id="sec7">
<title>Dynamic causal models</title>
<p>The dynamic causal model (DCM) used in this research has been continually updated with data as the epidemic has unfolded. It is designed to allow modification of model parameters, such as transmissibility of the virus, changes in social distancing, and vaccine coverage&#x2014;to accommodate changes in population dynamics and virus behavior. A recent model (26th September 2023) was used to explore the effect of changing transmission of the various Omicron variants and the likely seasonal effect of the coming winter. One modification was tightening the constraints on changes in antibody immunity over time. The potential benefit of a successful Find, Test, Trace, Isolate and Support scheme was also incorporated into the model.</p>
<sec id="sec8">
<title>General and specific features of DCMs</title>
<p>The general and specific features of Dynamic Causal Models have been described in our previous publication (<xref ref-type="bibr" rid="ref9">9</xref>). Since October 2022 our DCM COVID-19 model has been updated 20 times with the recent update on 26<sup>th</sup> September 2023 (<xref ref-type="bibr" rid="ref10">10</xref>).</p>
</sec>
</sec>
<sec id="sec9">
<title>Data sources and assumptions</title>
<p>16 of the 24 data sources used in the model and in our previous report have been discontinued (<xref ref-type="supplementary-material" rid="SM1">Supplementary Table S1</xref>):</p>
<list list-type="bullet">
<list-item><p>UKHSA COVID-19 data dashboard (<xref ref-type="bibr" rid="ref11">11</xref>)</p>
</list-item></list>
<list>
<list-item><p>&#x006F; Deaths within 28&#x2009;days of COVID-19 infection &#x2013; June 2023</p></list-item>
<list-item><p>&#x006F; Critical care bed admissions &#x2013; May 2023</p></list-item>
<list-item><p>&#x006F; Hospital occupancy of COVID-19 cases &#x2013; May 2023</p></list-item>
<list-item><p>&#x006F; COVID-19 antibody tests &#x2013; October 2022</p></list-item>
</list>
<list list-type="bullet">
<list-item><p>Office of National Statistics (<xref ref-type="bibr" rid="ref12">12</xref>)</p></list-item>
</list>
<list>
<list-item><p>&#x006F; Deaths by age &#x2013; July 2023</p></list-item>
<list-item><p>&#x006F; Vaccinations by age &#x2013; July 2023</p></list-item>
</list>
<list list-type="bullet">
<list-item><p>UK Government dashboard - Mobility &#x2013; April 2022</p></list-item>
<list-item><p>Google mobility Report (<xref ref-type="bibr" rid="ref13">13</xref>)&#x2013; October 2022</p></list-item>
<list-item><p>IHME estimate of Incidence (confirmed and non-confirmed cases) &#x2013; April 2023 (<xref ref-type="bibr" rid="ref14">14</xref>)</p></list-item>
</list>
<p>The UK Government COVID-19 dashboard still provides eight key input variables such as confirmed cases, hospital admissions, certified deaths, tests and vaccine coverage (<xref ref-type="bibr" rid="ref11">11</xref>). The Office of National Statistics (ONS) discontinued the Coronavirus (COVID-19) infection survey in March 2023 (<xref ref-type="bibr" rid="ref15">15</xref>) which had provided the best estimates of incidence using routine antibody tests and symptom questionnaires on a regular basis to a random population sample.</p>
<p>The trend in the use of non-pharmaceutical interventions by the UK government is measured using the Oxford Tracker stringency index (<xref ref-type="bibr" rid="ref7">7</xref>). The incidence of long COVID is calculated using the findings of a global meta-analysis of post-acute COVID-19 syndrome (with defined clusters of self-reported symptoms occurring 3&#x2009;months after initial infection) which found the risk of long COVID following symptoms in the community is 7.9%, in hospital admissions is 27.9% and ARDS (acute respiratory distress syndrome) is 41.4% (<xref ref-type="bibr" rid="ref16">16</xref>). The image of the proportion of variants in circulation used in Figures K-T is taken from Our World in Data (<xref ref-type="bibr" rid="ref17">17</xref>) which uses data sourced from Gisaid (<xref ref-type="bibr" rid="ref18">18</xref>).</p>
<p>For the predictions to October 2024, it is assumed that mitigation efforts such as improved ventilation in schools and workplaces will not take place, that lockdown will not be re-imposed, and that no new more virulent variants will arrive.</p>
</sec>
<sec id="sec10">
<title>Model priors</title>
<p>To predict outcomes over the next year, the model was run using the latest available data and prior estimates used by the DCM dashboard (<xref ref-type="bibr" rid="ref19">19</xref>). To address the predictive validity of empirical priors we ran the model to furnish predictions with changes to the prior estimates of the model parameters, where recent research suggests appropriate values. These empirical priors were as follows: prior time constant for the latent period is 5.5&#x2009;days and for the incubation period is 6.5&#x2009;days in line with the results of a recent meta-analysis (<xref ref-type="bibr" rid="ref20">20</xref>). The infectious period is given a prior time constant of 4.3&#x2009;days in line with a recent paper (<xref ref-type="bibr" rid="ref21">21</xref>), <xref ref-type="table" rid="tab1">Table 1</xref> [mean growth phase 1.6&#x2009;days; mean decline phase 2.7&#x2009;days]. <xref ref-type="supplementary-material" rid="SM1">Supplementary Table S2</xref> provides a comparison of the priors that maximize model evidence and the new (empirical) priors.</p>
<table-wrap position="float" id="tab1">
<label>Table 1</label>
<caption>
<p>Cumulative numbers of COVID-19 cases, deaths, tests, hospital admissions and post COVID-19 Syndrome &#x2013; 1st February 2020 &#x2013; 1st October 2023 and 12&#x2009;month projected numbers for 1st October 2023&#x2013;2024 &#x2013; UK.</p>
</caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left" valign="top">Scenario assuming FTTIS is 25% effective</th>
<th align="left" valign="top">DCM 2022 projection</th>
<th align="left" valign="top">Actual</th>
<th align="left" valign="top">Data source</th>
<th align="left" valign="top">DCM 2023 projection</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top">Cumulative totals from 1st February 2020 to</td>
<td align="left" valign="top">1st October 2023</td>
<td align="left" valign="top">1st October 2023</td>
<td/>
<td align="left" valign="top">1st October 2023 to 1st October 2024</td>
</tr>
<tr>
<td align="left" valign="bottom">Estimated incidence</td>
<td align="left" valign="bottom">485,603,813</td>
<td align="left" valign="bottom">131,242,140</td>
<td align="left" valign="bottom">IHME - 1 Apr 2023</td>
<td align="left" valign="bottom">40,692,662</td>
</tr>
<tr>
<td align="left" valign="bottom">Confirmed cases by PCR and LFT</td>
<td align="left" valign="bottom">53,409,837</td>
<td align="left" valign="bottom">24,743,787</td>
<td align="left" valign="bottom">Our World in Data - 30 Sep 2023</td>
<td align="left" valign="bottom">524,351</td>
</tr>
<tr>
<td align="left" valign="bottom">Deaths within 28&#x2009;days of a positive PCR test</td>
<td align="left" valign="bottom">330,957</td>
<td align="left" valign="bottom">229,765</td>
<td align="left" valign="bottom">Our World in Data - 30 Sep 2023</td>
<td align="left" valign="bottom">24,100</td>
</tr>
<tr>
<td align="left" valign="bottom">Tests (both PCR and LFD)</td>
<td align="left" valign="bottom">821,181,901</td>
<td align="left" valign="bottom">602,512,524</td>
<td align="left" valign="bottom">UK Covid-19 dashboard - 30 Sep 2023</td>
<td align="left" valign="bottom">14,080,675</td>
</tr>
<tr>
<td align="left" valign="bottom">Hospital admissions</td>
<td align="left" valign="bottom">1,867,580</td>
<td align="left" valign="bottom">862,553</td>
<td align="left" valign="bottom">UK Covid-19 dashboard - 30 Sep 2023</td>
<td align="left" valign="bottom">175,303</td>
</tr>
<tr>
<td align="left" valign="bottom">Post COVID-19 Syndrome</td>
<td align="left" valign="bottom">4,726,602</td>
<td align="left" valign="bottom">1,734,000</td>
<td align="left" valign="bottom">ONS Infection survey - 30 Mar 2023</td>
<td align="left" valign="bottom">3,139,699</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>For completeness, three scenarios were modelled to identify the likely effect of improving the Find Test Trace Isolate Support (FTTIS) system from a baseline of 25% effective to 40 and 60% effective.</p>
</sec>
</sec>
<sec id="sec11">
<title>Findings</title>
<sec id="sec12">
<title>Comparing projected with actual COVID-19 deaths, cases, tests, hospital admissions and incidence of long COVID</title>
<p>Last year&#x2019;s projections overestimated incidence three-fold, confirmed cases two-fold, deaths and tests by 1.4 times, hospital admissions by 2.2 times and long COVID by 2.7 times (<xref ref-type="table" rid="tab1">Table 1</xref>). The actual estimates of incidence and long COVID are only available for the first half of the year but the overestimates will still be substantial.</p>
<p>The reasons for the overestimations are found in the following two sets of graphics, which compare various outcome and parameters of model results made in October 2022 with and without knowledge of the course of the epidemic over the recent 12-month period to October 2023 (<xref ref-type="fig" rid="fig1">Figures 1</xref>&#x2013;<xref ref-type="fig" rid="fig5">5</xref>). In other words, we were able to compare the time course of key epidemiological parameters estimated with and without the data covering that period (from October 2022 until October 2023). The discrepancy between these predicted and post-dictive estimates provides one account of the overestimates above.</p>
<fig position="float" id="fig1">
<label>Figure 1</label>
<caption>
<p>Epidemic curves of COVID-19 incidence from Jan 2020 &#x2013; UK estimated by a DCM on two occasions (October 2022 and October 2023). The model can estimate incidence including cases not tested; each figure offers three projections: blue if the contact tracing system remains at 24% effective, green if it improves effectiveness to 40% and red to 60% from 1st October 2022 in the top graph and 1st October 2023 in the bottom graph: CIs, 90% credible intervals. Interpretation: The predictions with October 2022 priors are more than double the predictions using empirical priors in October 2023.</p>
</caption>
<graphic xlink:href="fpubh-12-1398297-g001.tif"/>
</fig>
<fig position="float" id="fig2">
<label>Figure 2</label>
<caption>
<p>Epidemic curves of COVID-19 mortality from Jan 2020 &#x2013; UK estimated by a DCM on two occasions (October 2022 and October 2023). The model can estimate projections of daily mortality certified as occurring within 28 days of a positive COVID-19 test; actual data in black is shown up till 16 June 2023&#x2014;the last day of available data; each figure offers three projections: blue if the contact tracing system remains at 24% effective, green if it improves effectiveness to 40% and red to 60% from 1st October 2022 in the top graph and 1st October 2023 in the bottom graph: CIs, 90% credible intervals. Interpretation: The model is able to ape the empirical mortality series closely; the model with empirical priors offers a prediction which is half the 2022 estimates in the Oct 22 to Oct 23 period.</p>
</caption>
<graphic xlink:href="fpubh-12-1398297-g002.tif"/>
</fig>
<fig position="float" id="fig3">
<label>Figure 3</label>
<caption>
<p>Epidemic curves of COVID-19 hospital admissions from Jan 2020 &#x2013; UK estimated by a DCM on two occasions (October 2022 and October 2023). The model estimates number of hospital admissions; actual data in black; each figure offers three projections: blue if the contact tracing system remains at 24% effective, green if it improves effectiveness to 40% and red to 60% from 1st October 2022 in the top graph and 1st October 2023 in the bottom graph: CIs, 90% credible intervals. Interpretation: The 2022 estimates follow the available actual data closely until August 2022 and predicted a much larger admission rate than what occurred later. The 2023 predictions with up-to-date priors got the admission rate more or less right.</p>
</caption>
<graphic xlink:href="fpubh-12-1398297-g003.tif"/>
</fig>
<fig position="float" id="fig4">
<label>Figure 4</label>
<caption>
<p>Epidemic curves of COVID-19 mobility from Jan 2020 &#x2013; UK estimated by a DCM on two occasions (October 2022 and October 2023). The model estimates the number of people leaving home each day; actual data in black taken from Google Global Mobility Report; the top figure offers three projections: blue if the contact tracing system remains at 24% effective, green if it improves effectiveness to 40% and red to 60% from 1st October 2022 in the top graph and 1st October 2023 in the bottom graph: CIs, 90% credible intervals. Interpretation: The model is able to ape the actual data with exceptions in Dec 2021. The empirical 2023 priors model is able to moderate the swings in estimates seen in the model using the 2022 priors.</p>
</caption>
<graphic xlink:href="fpubh-12-1398297-g004.tif"/>
</fig>
<fig position="float" id="fig5">
<label>Figure 5</label>
<caption>
<p>Epidemic curves of population immunity to COVID-19 from January 2020 &#x2013; UK estimated by a DCM on two occasions (October 2022 and October 2023). The model estimate of population immunity to COVID-19 (% of population) including that induced by infection, natural resistance and immunization; each figure offers three projections: blue if the contact tracing system remains at 24% effective, green if it improves effectiveness to 40% and red to 60% from 1st October 2022 in the top graph and 1st October 2023 in the bottom graph: CIs, 90% credible intervals. Interpretation: Both models share similar estimates of population immunity. Neither have been able to take into account the probable declining virulence over years found in pandemics with novel viruses.</p>
</caption>
<graphic xlink:href="fpubh-12-1398297-g005.tif"/>
</fig>
<p>The key overestimate was the projected large spike of infections over the winter period of 2022/2023 which did not materialize (<xref ref-type="fig" rid="fig1">Figure 1</xref>, top graph). Instead, we had continuous spikes of infection at lower numbers than in the previous year (<xref ref-type="fig" rid="fig1">Figure 1</xref>, bottom graph). The winter wave was predicted to be accompanied by large numbers of deaths and hospital admissions which did not materialize (<xref ref-type="fig" rid="fig2">Figures 2</xref>&#x2013;<xref ref-type="fig" rid="fig3">3</xref>). In short, the predicted winter wave was much greater than what transpired, partly due to a projected high level of mobility (i.e., contact rates) (<xref ref-type="fig" rid="fig4">Figure 4</xref>) and despite a sustained level of immunity (<xref ref-type="fig" rid="fig5">Figure 5</xref>).</p>
<p>To understand the overestimates, one can look at the trajectory of the time-dependent parameters used for both predictions (<xref ref-type="fig" rid="fig6">Figures 6</xref>&#x2013;<xref ref-type="fig" rid="fig10">10</xref>). The post-hoc or post-dictive estimates showed a tiny reduction but starting at a much longer starting point of 4.4 as compared to 2.8&#x2009;days in the latent period (<xref ref-type="fig" rid="fig6">Figure 6</xref>). The incubation period, however, was longer than originally anticipated, falling not to 1.94&#x2009;days but only to 4.6&#x2009;days from a starting point of 5.1 as compared to 2.1&#x2009;days (<xref ref-type="fig" rid="fig7">Figure 7</xref>). Transmission strength had increased from each infected person infecting 1 in 3 contacts to infections to infecting 80% of contacts (<xref ref-type="fig" rid="fig8">Figure 8</xref>). What may also be key is the change in expected antibody persistence, falling in the original from 197 to 159&#x2009;days but assumed to remain constant in the late model with a posterior prior value of 105&#x2009;days (<xref ref-type="fig" rid="fig9">Figure 9</xref>). Another key difference is the less than expected rise in the proportion of people leaving their homes, for example with only 30% of the older adult leaving home as compared to 60% in the earlier model (<xref ref-type="fig" rid="fig10">Figure 10</xref>). Unfortunately, the empirical data stopped at the start of the 12-months under review so we cannot be sure of the actual level of movement. By March 2023 18% of people were still wearing face masks outside and 11% in public transport (<xref ref-type="bibr" rid="ref22">22</xref>) and 14% of adults avoided contact with vulnerable people, so it is likely that mobility increased but did not return to pre-pandemic levels.</p>
<fig position="float" id="fig6">
<label>Figure 6</label>
<caption>
<p>Changing estimates of latent period of COVID-19 infection in relation to the emergence of new variants and changes in response to public health policies: UK February 2020 to October 2023. Latent period (between day infected and day infectious) is measured as time constant for all age groups combined; prior in top graph of 3 days with initial model estimate of 2.8 days (infected period - <xref ref-type="supplementary-material" rid="SM1">Supplementary Table S2</xref>) dropping to 2.64 by October 2023; prior in the bottom graph of 5.5 days with initial model estimate of 4.36 dropping to 3.9 by November 2023; stringency index dropping from 80% in March 2020 to 5% by December 2021; proportion of variant in circulation as backdrop showing variants from the original Wuhan variant in 2020 to Omicron strains more recently (reproduced from Our World in Data). Interpretation: The variants have evolved to increase infectivity by reducing the latent period between the day infected and the day infectious. This has occurred in the both models whatever the original prior assumption used.</p>
</caption>
<graphic xlink:href="fpubh-12-1398297-g006.tif"/>
</fig>
<fig position="float" id="fig7">
<label>Figure 7</label>
<caption>
<p>Changing estimates of incubation period of COVID-19 infection in relation to the emergence of new variants and changes in response to public health policies: UK February 2020 to October 2023. Incubation period (between day infected and start of symptoms) is measured as time constant for all age groups combined; prior in top graph of 4 days with initial model estimate of 2.06 days (asymptomatic period - <xref ref-type="supplementary-material" rid="SM1">Supplementary Table S2</xref>) dropping to 1.94 by October 2023; empirical prior in the bottom graph of 6.5 days with initial model estimate of 5.06 dropping to 4.6 by November 2023; stringency index dropping from 80% in March 2020 to 5% by December 2021; proportion of variant in circulation as backdrop showing variants from the original Wuhan variant in 2020 to Omicron strains more recently (reproduced from Our World in Data). Interpretation: As with the latent period the incubation period has shrunk in both models indicating the evolution of the variants which became more infectious.</p>
</caption>
<graphic xlink:href="fpubh-12-1398297-g007.tif"/>
</fig>
<fig position="float" id="fig8">
<label>Figure 8</label>
<caption>
<p>Changing estimates of transmission strength of COVID-19 infection in relation to the emergence of. Transmission strength is measured as the secondary attack rate; prior value of 0.3 (i.e, an infected person infects 1 in 3 contacts) which rises with the new variants to 0.7 (i.e. an infected person infects 70% of contacts); top graph combines all ages, bottom graph estimates transmission strength for each age group; stringency index dropping from 80% in March 2020 to 5% by December 2021; proportion of variant in circulation as backdrop showing variants from the original Wuhan variant in 2020 to Omicron strains more recently (reproduced from Our World in Data). Interpretation: Despite the different prior assumptions in the two figures the increase in transmission strength is evident in both models.</p>
</caption>
<graphic xlink:href="fpubh-12-1398297-g008.tif"/>
</fig>
<fig position="float" id="fig9">
<label>Figure 9</label>
<caption>
<p>Changing estimates of duration of antibody immunity induced by COVID-19 infection and vaccine in days in relation to the emergence of new variants and changes in response to public health policies: UK February 2020 to October 2023. Duration of antibody immunity induced by COVID-19 infection and vaccine measured as time constant for all age groups combined in top graph and by age group in bottom graph; with initial model estimate of 196 days falling to 160 days by October 2023 in top graph; model estimates for each age group in bottom graph maintained at those values throughout the period; proportion of variant in circulation as backdrop showing variants from the original Wuhan variant in 2020 to Omicron strains more recently (reproduced from Our World in Data). Interpretation: The model used in 2022 assumed the possible time related change in the antibody immunity parameter whereas the 2023 model assumes no change. Further empirical data will be required to understand the changes in antibody immunity over time.</p>
</caption>
<graphic xlink:href="fpubh-12-1398297-g009.tif"/>
</fig>
<fig position="float" id="fig10">
<label>Figure 10</label>
<caption>
<p>Changing estimates of the proportion of people leaving home each day in relation to the emergence of new variants and changes in response to public health policies: UK February 2020 to October 2023. The proportion of people leaving home each day for each age group; for example for those aged 70 years and above the top graph shows an estimate of 66% leaving home prior to the epidemic falling to 5% at first lockdown and rising slowly to 60% by October 2023; in the bottom graph the initial estimate for the same age group was 23% leaving home falling to 0% at the first lockdown rising to 32% by October 2023; stringency index dropping from 80% in March 2020 to 5% by December 202; proportion of variant in circulation as backdrop showing variants from the original Wuhan variant in 2020 to Omicron strains more recently (reproduced from Our World in Data). Interpretation: The 2023 predictions estimate a much less mobile population than the 2022 model. This could partly explain the overestimate of infections identified in the earlier model.</p>
</caption>
<graphic xlink:href="fpubh-12-1398297-g010.tif"/>
</fig>
</sec>
<sec id="sec13">
<title>Future predictions</title>
<p>For the period October 2023 to October 2024 the model was used to predict the cumulative effect of the epidemic on case numbers, deaths, tests, hospital admissions and long COVID (<xref ref-type="table" rid="tab1">Table 1</xref> and <xref ref-type="fig" rid="fig1">Figures 1</xref>&#x2013;<xref ref-type="fig" rid="fig3">3</xref>). The predictions using empirical priors suggest a wave this coming winter but with few deaths and tests but still plenty of hospital admissions and long COVID patients. Under the empirical priors COVID-19 cases will fall but still over 40 million cases and over 3 million long-COVID cases will occur in next the 12-month period. The effect of a more efficient Test and Trace system would have little influence in reducing cases using either set of priors (<xref ref-type="fig" rid="fig2">Figures 2</xref>, <xref ref-type="fig" rid="fig3">3</xref>).</p>
</sec>
</sec>
<sec sec-type="discussion" id="sec14">
<title>Discussion</title>
<p>The overestimates of the 12-month projections to October 2023 seem to relate to better retained immunity from previous infections and vaccines at the same time as a reduction in the trend of the new variants becoming more infectious. The reason the predicted large winter wave did not occur probably relates to these factors plus a more than anticipated caution by individuals in leaving home (i.e., exposing themselves to higher transmission risk). We have no way of assessing how many infections did actually occur because the ONS infection study was stopped and estimates from other models were discontinued. Tests became infrequent and not freely available, but many particularly older adult people still observed isolation periods when thought to be infected despite pressure to ignore such practices and the removal of legal sanctions in February 2022. The year also saw antiviral therapies improve associated with a drop in case fatalities.</p>
<p>Finally, we have specified predictions for the upcoming year, until October 2024 based on empirical priors over the successive periods of infection. It will be interesting to see whether these empirical priors improve the model&#x2019;s predictive validity.</p>
<p>In the next of these technical reports, we will use the current and previous reports as documentary evidence of predictions to assess the predictive accuracy of dynamic causal modelling over a forecasting timescale of weeks, months and years. We anticipate doing this by adopting the final structure of the generative model but estimating epidemiological and behavioral parameters from limited timeseries&#x2014;up until a certain point in time&#x2014;and assessing the posterior predictive accuracy at a series of points in the future, as the pandemic evolved. This may provide a useful reference for future pandemic modelling that leverages the unprecedented amount of data and insights generated by the COVID pandemic.</p>
</sec>
</body>
<back>
<sec sec-type="data-availability" id="sec18">
<title>Data availability statement</title>
<p>The datasets presented in this study can be found in online repositories. The names of the repository/repositories and accession number(s) can be found at: <ext-link xlink:href="https://www.fil.ion.ucl.ac.uk/spm/covid-19/" ext-link-type="uri">https://www.fil.ion.ucl.ac.uk/spm/covid-19/</ext-link>. The figures in <xref ref-type="fig" rid="fig1">Figure 1</xref> can be reproduced using annotated (MATLAB/Octave) code that is available as part of the free and open source academic software SPM (<xref ref-type="bibr" rid="ref23">23</xref>). The routines are called by a demonstration script that can be invoked by DEM_COVID, DEM_COVID_X, DEM_COVID_T, DEM_COVID_I or DEM_COVID_LTLA at the MATLAB prompt. At the time of writing, these routines are available in the development version of the next SPM release. An archive of the relevant source code for each publication is available from figshare (<ext-link xlink:href="https://figshare.com/articles/Dynamic_Causal_Modelling_of_COVID-19/12174006" ext-link-type="uri">https://figshare.com/articles/Dynamic_Causal_Modelling_of_COVID-19/12174006</ext-link>). The remaining results in this paper can be reproduced using modified scripts found at <ext-link xlink:href="https://www.dropbox.com/scl/fo/zyv10xs8sn9ueuw7mhkis/h?rlkey=ewxlffkdiki89yzgjw6tz355g&#x0026;dl=0" ext-link-type="uri">https://www.dropbox.com/scl/fo/zyv10xs8sn9ueuw7mhkis/h?rlkey=ewxlffkdiki89yzgjw6tz355g&#x0026;dl=0</ext-link>. The routine data used in the manuscripts are available from the COVID-19 Data Repository by the Center for Systems Science and Engineering (CSSE) at Johns Hopkins University, Coronavirus (COVID-19) UK Historical Data by Tom White and GOV.UK Coronavirus (COVID-19) in the UK.</p>
</sec>
<sec sec-type="ethics-statement" id="sec19">
<title>Ethics statement</title>
<p>Ethical approval was not required for the study involving humans in accordance with the local legislation and institutional requirements. Written informed consent to participate in this study was not required from the participants or the participants' legal guardians/next of kin in accordance with the national legislation and the institutional requirements.</p>
</sec>
<sec sec-type="author-contributions" id="sec20">
<title>Author contributions</title>
<p>CB: Formal analysis, Writing &#x2013; original draft, Writing &#x2013; review &#x0026; editing. KF: Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Supervision, Validation, Writing &#x2013; original draft, Writing &#x2013; review &#x0026; editing.</p>
</sec>
<sec sec-type="funding-information" id="sec21">
<title>Funding</title>
<p>The author(s) declare that financial support was received for the research, authorship, and/or publication of this article. KF is supported by Wellcome through core funding to the Wellcome Centre for Human Neuroimaging, UCL Queen Square Institute of Neurology [203147].</p>
</sec>
<sec sec-type="COI-statement" id="sec22">
<title>Conflict of interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
<p>The author(s) declared that they were an editorial board member of Frontiers, at the time of submission. This had no impact on the peer review process and the final decision.</p>
</sec>
<sec sec-type="disclaimer" id="sec23">
<title>Publisher&#x2019;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<sec sec-type="supplementary-material" id="sec24">
<title>Supplementary material</title>
<p>The Supplementary material for this article can be found online at: <ext-link xlink:href="https://www.frontiersin.org/articles/10.3389/fpubh.2024.1398297/full#supplementary-material" ext-link-type="uri">https://www.frontiersin.org/articles/10.3389/fpubh.2024.1398297/full#supplementary-material</ext-link></p>
<supplementary-material xlink:href="Table_1.DOCX" id="SM1" mimetype="application/vnd.openxmlformats-officedocument.wordprocessingml.document" xmlns:xlink="http://www.w3.org/1999/xlink"/>
<supplementary-material xlink:href="Table_2.pdf" id="SM2" mimetype="application/pdf" xmlns:xlink="http://www.w3.org/1999/xlink"/>
</sec>
<ref-list>
<title>References</title>
<ref id="ref1"><label>1.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Friston</surname> <given-names>K</given-names></name> <name><surname>Costello</surname> <given-names>A</given-names></name> <name><surname>Pillay</surname> <given-names>D</given-names></name></person-group>. <article-title>&#x2018;Dark matter&#x2019;, second waves and epidemiological modelling</article-title>. <source>BMJ Glob Health</source>. (<year>2020</year>) <volume>5</volume>:<fpage>e003978</fpage>. doi: <pub-id pub-id-type="doi">10.1136/bmjgh-2020-003978</pub-id></citation></ref>
<ref id="ref2"><label>2.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Friston</surname> <given-names>KJ</given-names></name> <name><surname>Flandin</surname> <given-names>G</given-names></name> <name><surname>Razi</surname> <given-names>A</given-names></name></person-group>. <article-title>Dynamic causal modelling of COVID-19 and its mitigations</article-title>. <source>Sci Rep</source>. (<year>2022</year>) <volume>12</volume>:<fpage>12419</fpage>. doi: <pub-id pub-id-type="doi">10.1038/s41598-022-16799-8</pub-id>, PMID: <pub-id pub-id-type="pmid">35859054</pub-id></citation></ref>
<ref id="ref3"><label>3.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Friston</surname> <given-names>KJ</given-names></name> <name><surname>Parr</surname> <given-names>T</given-names></name> <name><surname>Zeidman</surname> <given-names>P</given-names></name> <name><surname>Razi</surname> <given-names>A</given-names></name> <name><surname>Flandin</surname> <given-names>G</given-names></name> <name><surname>Daunizeau</surname> <given-names>J</given-names></name> <etal/></person-group>. <article-title>Second waves, social distancing, and the spread of COVID-19 across the USA</article-title>. <source>Wellcome Open Res</source>. (<year>2021</year>) <volume>5</volume>:<fpage>103</fpage>. doi: <pub-id pub-id-type="doi">10.12688/wellcomeopenres.15986.3</pub-id>, PMID: <pub-id pub-id-type="pmid">33954262</pub-id></citation></ref>
<ref id="ref4"><label>4.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Birrell</surname> <given-names>P</given-names></name> <name><surname>Blake</surname> <given-names>J</given-names></name> <name><surname>van Leeuwen</surname> <given-names>E</given-names></name> <name><surname>Gent</surname> <given-names>N</given-names></name> <name><surname>De Angelis</surname> <given-names>D</given-names></name></person-group>. <article-title>Real-time nowcasting and forecasting of COVID-19 dynamics in England: the first wave</article-title>. <source>Philos Trans R Soc B Biol Sci</source>. (<year>2021</year>) <volume>376</volume>:<fpage>20200279</fpage>. doi: <pub-id pub-id-type="doi">10.1098/rstb.2020.0279</pub-id></citation></ref>
<ref id="ref5"><label>5.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bowie</surname> <given-names>C</given-names></name> <name><surname>Friston</surname> <given-names>K</given-names></name></person-group>. <article-title>A 12-month projection to September 2022 of the COVID-19 epidemic in the UK using a dynamic causal model. <italic>Frontiers</italic></article-title>. <source>Public Health</source>. (<year>2022</year>) <volume>10</volume>:<fpage>210</fpage>. doi: <pub-id pub-id-type="doi">10.3389/fpubh.2022.999210</pub-id>, PMID: <pub-id pub-id-type="pmid">36457320</pub-id></citation></ref>
<ref id="ref6"><label>6.</label><citation citation-type="other"><person-group person-group-type="author"><collab id="coll1">FT Visual &#x0026; Data Journalism Team</collab></person-group>. Free to read: Lockdowns compared: Tracking governments&#x2019; coronavirus responses. Available at: <ext-link xlink:href="https://ig.ft.com/coronavirus-lockdowns" ext-link-type="uri">https://ig.ft.com/coronavirus-lockdowns</ext-link> (Accessed September 27, 2022).</citation></ref>
<ref id="ref7"><label>7.</label><citation citation-type="other"><person-group person-group-type="author"><collab id="coll2">Oxford tracker</collab></person-group>. COVID-19 Government Response Tracker. Available at: <ext-link xlink:href="https://www.bsg.ox.ac.uk/research/research-projects/covid-19-government-response-tracker" ext-link-type="uri">https://www.bsg.ox.ac.uk/research/research-projects/covid-19-government-response-tracker</ext-link> (Accessed September 27, 2022).</citation></ref>
<ref id="ref8"><label>8.</label><citation citation-type="other"><person-group person-group-type="author"><collab id="coll3">UKHSA</collab></person-group>. Investigation of SARS-CoV-2 variants: technical briefings. Available at: <ext-link xlink:href="https://www.gov.uk/government/publications/investigation-of-sars-cov-2-variants-technical-briefings" ext-link-type="uri">https://www.gov.uk/government/publications/investigation-of-sars-cov-2-variants-technical-briefings</ext-link> (Accessed September 27, 2022).</citation></ref>
<ref id="ref9"><label>9.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bowie</surname> <given-names>C</given-names></name> <name><surname>Friston</surname> <given-names>K</given-names></name></person-group>. <article-title>Using a dynamic causal model to validate previous predictions and offer a 12-month forecast of the long-term effects of the COVID-19 epidemic in the UK. <italic>Front</italic></article-title>. <source>Public Health</source>. (<year>2023</year>) <volume>10</volume>:<fpage>1108886</fpage>. doi: <pub-id pub-id-type="doi">10.3389/fpubh.2022.1108886</pub-id>, PMID: <pub-id pub-id-type="pmid">36684985</pub-id></citation></ref>
<ref id="ref10"><label>10.</label><citation citation-type="other"><person-group person-group-type="author"><name><surname>Friston</surname> <given-names>K.</given-names></name></person-group> Long-term forecasting of the COVID-19 epidemic. Available at: <ext-link xlink:href="https://www.fil.ion.ucl.ac.uk/spm/covid-19/forecasting/" ext-link-type="uri">https://www.fil.ion.ucl.ac.uk/spm/covid-19/forecasting/</ext-link> (Accessed October 24, 2023).</citation></ref>
<ref id="ref11"><label>11.</label><citation citation-type="other"><person-group person-group-type="author"><collab id="coll4">England Summary | Coronavirus (COVID-19) in the UK</collab></person-group>. (<year>2023</year>) <comment>Available at:</comment> <ext-link xlink:href="https://coronavirus.data.gov.uk" ext-link-type="uri">https://coronavirus.data.gov.uk</ext-link> (Accessed October 25, 2023).</citation></ref>
<ref id="ref12"><label>12.</label><citation citation-type="other"><person-group person-group-type="author"><collab id="coll5">Office for National Statistics</collab></person-group>. Search - Office for National Statistics. Available at: <ext-link xlink:href="https://www.ons.gov.uk/search?q=covid" ext-link-type="uri">https://www.ons.gov.uk/search?q=covid</ext-link> (Accessed October 25, 2023).</citation></ref>
<ref id="ref13"><label>13.</label><citation citation-type="other"><person-group person-group-type="author"><collab id="coll6">Google</collab></person-group>. COVID-19 Community Mobility Report. Available at: <ext-link xlink:href="https://www.google.com/covid19/mobility?hl=en" ext-link-type="uri">https://www.google.com/covid19/mobility?hl=en</ext-link> (Accessed October 4, 2022).</citation></ref>
<ref id="ref14"><label>14.</label><citation citation-type="other"><person-group person-group-type="author"><collab id="coll7">IHME</collab></person-group>. COVID-19 estimation updates: Institute for Health Metrics and Evaluation. (<year>2020</year>) <comment>Available at:</comment> <ext-link xlink:href="http://www.healthdata.org/covid/updates" ext-link-type="uri">http://www.healthdata.org/covid/updates</ext-link> (Accessed May 18, 2020).</citation></ref>
<ref id="ref15"><label>15.</label><citation citation-type="other"><person-group person-group-type="author"><collab id="coll8">Office for National Statistics</collab></person-group>. Coronavirus (COVID-19) Infection Survey, UK - Office for National Statistics. Available at: <ext-link xlink:href="https://www.ons.gov.uk/peoplepopulationandcommunity/healthandsocialcare/conditionsanddiseases/bulletins/coronaviruscovid19infectionsurveypilot/24march2023" ext-link-type="uri">https://www.ons.gov.uk/peoplepopulationandcommunity/healthandsocialcare/conditionsanddiseases/bulletins/coronaviruscovid19infectionsurveypilot/24march2023</ext-link> (Accessed October 25, 2023).</citation></ref>
<ref id="ref16"><label>16.</label><citation citation-type="journal"><person-group person-group-type="author"><collab id="coll9">Global Burden of Disease Long COVID Collaborators</collab></person-group>. <article-title>Estimated global proportions of individuals with persistent fatigue, cognitive, and respiratory symptom clusters following symptomatic COVID-19 in 2020 and 2021</article-title>. <source>JAMA</source>. (<year>2022</year>) <volume>328</volume>:<fpage>1604</fpage>&#x2013;<lpage>15</lpage>. doi: <pub-id pub-id-type="doi">10.1001/jama.2022.18931</pub-id>, PMID: <pub-id pub-id-type="pmid">36215063</pub-id></citation></ref>
<ref id="ref17"><label>17.</label><citation citation-type="other"><person-group person-group-type="author"><collab id="coll10">Our World in Data</collab></person-group> SARS-CoV-2 variants in analyzed sequences. Available at: <ext-link xlink:href="https://ourworldindata.org/grapher/covid-variants-area?country=~GBR" ext-link-type="uri">https://ourworldindata.org/grapher/covid-variants-area?country=~GBR</ext-link> (Accessed November 21, 2023).</citation></ref>
<ref id="ref18"><label>18.</label><citation citation-type="other"><person-group person-group-type="author"><collab id="coll11">GISAID</collab></person-group>. <source>Editorial Board affirms Open Access designation of GISAID. <ext-link xlink:href="https://Re3data.org" ext-link-type="uri">Re3data.org</ext-link></source>. (<year>2012</year>) . doi: <pub-id pub-id-type="doi">10.17616/R3Q59F</pub-id></citation></ref>
<ref id="ref19"><label>19.</label><citation citation-type="other"><person-group person-group-type="author"><name><surname>Friston</surname> <given-names>K.</given-names></name></person-group> Long-term forecasting of the COVID-19 epidemic. Available at: <ext-link xlink:href="https://www.fil.ion.ucl.ac.uk/spm/covid-19/forecasting/" ext-link-type="uri">https://www.fil.ion.ucl.ac.uk/spm/covid-19/forecasting/</ext-link> (Accessed November 6, 2023).</citation></ref>
<ref id="ref20"><label>20.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Xu</surname> <given-names>X</given-names></name> <name><surname>Wu</surname> <given-names>Y</given-names></name> <name><surname>Kummer</surname> <given-names>AG</given-names></name> <name><surname>Zhao</surname> <given-names>Y</given-names></name> <name><surname>Hu</surname> <given-names>Z</given-names></name> <name><surname>Wang</surname> <given-names>Y</given-names></name> <etal/></person-group>. <article-title>Assessing changes in incubation period, serial interval, and generation time of SARS-CoV-2 variants of concern: a systematic review and meta-analysis</article-title>. <source>BMC Med</source>. (<year>2023</year>) <volume>21</volume>:<fpage>374</fpage>. doi: <pub-id pub-id-type="doi">10.1186/s12916-023-03070-8</pub-id></citation></ref>
<ref id="ref21"><label>21.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hakki</surname> <given-names>S</given-names></name> <name><surname>Zhou</surname> <given-names>J</given-names></name> <name><surname>Jonnerby</surname> <given-names>J</given-names></name> <name><surname>Singanayagam</surname> <given-names>A</given-names></name> <name><surname>Barnett</surname> <given-names>JL</given-names></name> <name><surname>Madon</surname> <given-names>KJ</given-names></name> <etal/></person-group>. <article-title>Onset and window of SARS-CoV-2 infectiousness and temporal correlation with symptom onset: a prospective, longitudinal, community cohort study</article-title>. <source>Lancet Respir Med</source>. (<year>2022</year>) <volume>10</volume>:<fpage>1061</fpage>&#x2013;<lpage>73</lpage>. doi: <pub-id pub-id-type="doi">10.1016/S2213-2600(22)00226-0</pub-id></citation></ref>
<ref id="ref22"><label>22.</label><citation citation-type="other"><person-group person-group-type="author"><collab id="coll12">Office for National Statistics</collab></person-group>. Coronavirus (COVID-19) latest insights - Office for National Statistics. Available at: <ext-link xlink:href="https://www.ons.gov.uk/peoplepopulationandcommunity/healthandsocialcare/conditionsanddiseases/articles/coronaviruscovid19latestinsights/lifestyle" ext-link-type="uri">https://www.ons.gov.uk/peoplepopulationandcommunity/healthandsocialcare/conditionsanddiseases/articles/coronaviruscovid19latestinsights/lifestyle</ext-link> (Accessed October 30, 2023)</citation></ref>
<ref id="ref23"><label>23.</label><citation citation-type="other"><person-group person-group-type="author"><name><surname>Friston</surname> <given-names>Karl</given-names></name></person-group>. Dynamic Causal Modelling of COVID-19; dashboard. Available at: <ext-link xlink:href="https://www.fil.ion.ucl.ac.uk/spm/covid-19/" ext-link-type="uri">https://www.fil.ion.ucl.ac.uk/spm/covid-19/</ext-link> (Accessed May 24, 2021).</citation></ref>
</ref-list>
</back>
</article>