<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" article-type="research-article" dtd-version="2.3" xml:lang="EN">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Public Health</journal-id>
<journal-title>Frontiers in Public Health</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Public Health</abbrev-journal-title>
<issn pub-type="epub">2296-2565</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fpubh.2023.1198188</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Public Health</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Emergency department crowding and mortality: an observational multicenter study in Sweden</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name>
<surname>Wretborn</surname>
<given-names>Jens</given-names>
</name>
<xref rid="aff1" ref-type="aff"><sup>1</sup></xref>
<xref rid="aff2" ref-type="aff"><sup>2</sup></xref>
<xref rid="c001" ref-type="corresp"><sup>&#x002A;</sup></xref>
<uri xlink:href="https://loop.frontiersin.org/people/681834/overview"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Wilhelms</surname>
<given-names>Daniel B.</given-names>
</name>
<xref rid="aff1" ref-type="aff"><sup>1</sup></xref>
<xref rid="aff2" ref-type="aff"><sup>2</sup></xref>
<uri xlink:href="https://loop.frontiersin.org/people/533410/overview"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Ekelund</surname>
<given-names>Ulf</given-names>
</name>
<xref rid="aff3" ref-type="aff"><sup>3</sup></xref>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Department of Emergency Medicine, Faculty of Health Sciences, Link&#x00F6;ping University</institution>, <addr-line>Link&#x00F6;ping</addr-line>, <country>Sweden</country></aff>
<aff id="aff2"><sup>2</sup><institution>Department of Biomedical and Clinical Sciences, Faculty of Health Sciences, Link&#x00F6;ping University</institution>, <addr-line>Link&#x00F6;ping</addr-line>, <country>Sweden</country></aff>
<aff id="aff3"><sup>3</sup><institution>Department of Clinical Sciences Lund, Emergency Medicine, Faculty of Medicine, Lund University</institution>, <addr-line>Lund</addr-line>, <country>Sweden</country></aff>
<author-notes>
<fn id="fn0001" fn-type="edited-by"><p>Edited by: Ju Ok Park, Hallym University, Republic of Korea</p></fn>
<fn id="fn0002" fn-type="edited-by"><p>Reviewed by: Dagan Schwartz, Ben-Gurion University of the Negev, Israel; Matteo Paganini, University of Padua, Italy</p></fn>
<corresp id="c001">&#x002A;Correspondence: Jens Wretborn, <email>jens.wretborn@liu.se</email></corresp>
</author-notes>
<pub-date pub-type="epub">
<day>25</day>
<month>07</month>
<year>2023</year>
</pub-date>
<pub-date pub-type="collection">
<year>2023</year>
</pub-date>
<volume>11</volume>
<elocation-id>1198188</elocation-id>
<history>
<date date-type="received">
<day>31</day>
<month>03</month>
<year>2023</year>
</date>
<date date-type="accepted">
<day>05</day>
<month>07</month>
<year>2023</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x00A9; 2023 Wretborn, Wilhelms and Ekelund.</copyright-statement>
<copyright-year>2023</copyright-year>
<copyright-holder>Wretborn, Wilhelms and Ekelund</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p>
</license>
</permissions>
<abstract>
<sec>
<title>Background</title>
<p>Emergency department (ED) crowding is a serious problem worldwide causing decreased quality of care. It is reasonable to assume that the negative effects of crowding are at least partially due to high staff workload, but previous crowding metrics based on high workload have not been generalisable to Swedish EDs and have not been associated with increased mortality, in contrast to, e.g., occupancy rate. We recently derived and validated the modified Sk&#x00E5;ne Emergency Department Assessment of Patient Load model (mSEAL) that measures crowding based on staff workload in Swedish EDs, but its ability to identify situations with increased mortality is unclear. In this study, we aimed to investigate the association between ED crowding measured by mSEAL model, or occupancy rate, and mortality.</p>
</sec>
<sec>
<title>Methods</title>
<p>All ED patients from 2017-01-01 to 2017-06-30 from two regional healthcare systems (Sk&#x00E5;ne and &#x00D6;sterg&#x00F6;tland Counties with a combined population of approximately 1.8 million) in Sweden were included. Exposure was ED- and hour-adjusted mSEAL or occupancy rate. Primary outcome was mortality within 7&#x2009;days of ED arrival, with one-day and 30-day mortality as secondary outcomes. We used Cox regression hazard ratio (HR) adjusted for age, sex, arrival by ambulance, hospital admission and chief complaint.</p>
</sec>
<sec>
<title>Results</title>
<p>We included a total of 122,893 patients with 168,900 visits to the six participating EDs. Arriving at an hour with a mSEAL score above the 95th percentile for that ED and hour of day was associated with an non-significant HR for death at 7&#x2009;days of 1.04 (95% CI 0.96&#x2013;1.13). For one- and 30-day mortality the HR was non-significant at 1.03 (95% CI 0.9&#x2013;1.18) and 1.03 (95% CI 0.97&#x2013;1.09). Similarly, occupancy rate above the 95th percentile with a HR of 1.04 (95% CI 0.9&#x2013;1.19), 1.03 (95%CI 0.95&#x2013;1.13) and 1.04 (95% CI 0.98&#x2013;1.11) for one-, 7- and 30-day mortality, respectively.</p>
</sec>
<sec>
<title>Conclusion</title>
<p>In this multicenter study in Sweden, ED crowding measured by mSEAL or occupancy rate was not associated with a significant increase in short-term mortality.</p>
</sec>
</abstract>
<kwd-group>
<kwd>emergency department</kwd>
<kwd>crowding</kwd>
<kwd>overcrowding</kwd>
<kwd>occupancy</kwd>
<kwd>access block</kwd>
</kwd-group>
<contract-num rid="cn1">LIO-532001</contract-num>
<contract-num rid="cn1">LIO-700271</contract-num>
<contract-sponsor id="cn1">Region &#x00D6;sterg&#x00F6;tland</contract-sponsor>
<contract-sponsor id="cn2">Region Sk&#x00E5;ne<named-content content-type="fundref-id">10.13039/501100009780</named-content></contract-sponsor>
<counts>
<fig-count count="1"/>
<table-count count="4"/>
<equation-count count="0"/>
<ref-count count="36"/>
<page-count count="7"/>
<word-count count="4767"/>
</counts>
<custom-meta-wrap>
<custom-meta>
<meta-name>section-at-acceptance</meta-name>
<meta-value>Disaster and Emergency Medicine</meta-value>
</custom-meta>
</custom-meta-wrap>
</article-meta>
</front>
<body>
<sec id="sec5" sec-type="intro">
<title>Introduction</title>
<p>Emergency Department (ED) crowding occurs when the demand for ED care is higher than the available resources, and has been associated with increased morbidity, mortality and decreased quality of ED care (<xref ref-type="bibr" rid="ref1">1</xref>, <xref ref-type="bibr" rid="ref2">2</xref>). Historically, crowding has been a minor problem in Swedish EDs (<xref ref-type="bibr" rid="ref3">3</xref>), but recent reports have found an association between increased length of stay or high occupancy rate and increased mortality (<xref ref-type="bibr" rid="ref2">2</xref>, <xref ref-type="bibr" rid="ref4">4</xref>, <xref ref-type="bibr" rid="ref5">5</xref>). There are several combined measures based on staff assessment of crowding, like the national emergency department overcrowding score (NEDOCS), international crowding measure in emergency departments (ICMED) and Emergency Department Work Index (EDWIN). However, these models have not been evaluated against patient mortality and are not readily generalisable to Swedish EDs due to differences in ED operations between health care systems (<xref ref-type="bibr" rid="ref6">6</xref>).</p>
<p>We have previously derived and validated the modified Sk&#x00E5;ne Emergency Department Assessment of Patient Load model (mSEAL) to measure crowding based on workload in Swedish EDs (<xref ref-type="bibr" rid="ref6">6</xref>). The model includes the variables <italic>Patient Hours</italic> and <italic>Time to Physician. Patient hours</italic> is defined as the sum of time in hours that all patients spent in the ED during the previous hour, divided by the ED census during the same hour. <italic>Time to Physician</italic> is the average time in hours, from registration at the ED to first physician contact, for patients waiting for a physician during the previous hour. The mSEAL score is calculated as 1.485&#x2009;+&#x2009;(9.715&#x002A;<italic>Patient Hours</italic>)&#x2009;+&#x2009;(0.177&#x002A;<italic>Time to Physician</italic>), with results ranging from 1 (no crowding) to 6 (extreme crowding). The mSEAL model correlated well with staff-assessed crowding in the derivation and validation study, with test characteristics comparable to that of occupancy rate (<xref ref-type="bibr" rid="ref6">6</xref>). However, the model&#x2019;s ability to identify situations where crowding affects patient outcomes is still unclear.</p>
<p>Occupancy rate (OR) has been promoted as an easy-to-use metric for crowding that performs equal to more complex models (<xref ref-type="bibr" rid="ref7">7</xref>), like the mSEAL, but its ability to predict mortality related to crowding has varied in recent studies. Jo et al. (<xref ref-type="bibr" rid="ref8">8</xref>) and Af Ugglas et al. (<xref ref-type="bibr" rid="ref2">2</xref>) found an association between high OR and increased mortality in two Korean hospitals and in a Swedish county, respectively. In contrast, Jones et al. (<xref ref-type="bibr" rid="ref9">9</xref>) and Derose et al. (<xref ref-type="bibr" rid="ref10">10</xref>) found no association between OR and mortality in large studies from New Zealand and the US, respectively.</p>
<p>It is reasonable to assume that a substantial proportion of the negative effects of crowding are mediated through high workload, and that a metric based on staff perception may provide additional information compared to operational measures like OR. The aim of the present study was to investigate if ED crowding, as measured by mSEAL based on staff assessment or OR, is associated with increased all-cause short-term mortality.</p>
</sec>
<sec id="sec6" sec-type="methods">
<title>Methods</title>
<sec id="sec7">
<title>Study design and setting</title>
<p>This was a retrospective observational cross-sectional study of patients at six EDs in two regions in Sweden (Sk&#x00E5;ne and &#x00D6;sterg&#x00F6;tland Counties with a combined population of approximately 1.8 million at the time of the study), including three academic tertiary care centers, two urban community hospitals and one community hospital. EDs in Sweden are publicly funded and provide care for all with a small co-payment. All patients visiting any of the EDs from 2017-01-01 to 2017-06-30 were included in the analysis.</p>
</sec>
<sec id="sec8">
<title>Measurements</title>
<p>Data on age (0&#x2013;18, 19&#x2013;39, 40&#x2013;59, 60&#x2013;79, &#x003E;80&#x2009;years), sex (male/female), hospital admission (yes/no), arrival by ambulance, triage acuity and visit timestamps were extracted for each patient from the electronic health records at each site. All data were registered by ED providers as part of routine ED care. The only generally accepted quality indicator metrics in Sweden is ED length of stay and time to physician (<xref ref-type="bibr" rid="ref11">11</xref>). However, no reimbursements are associated with these metrics so any systematic influence on registration is unlikely. Mortality data were retrieved from the Swedish national ED quality registry (SVAR) (<xref ref-type="bibr" rid="ref12">12</xref>), censored at 30&#x2009;days. SVAR retrieves mortality data from the national population registry and includes all deaths of Swedish citizens. Acuity was defined as the first triage category assigned on ED according to the RETTS triage system (1&#x2013;4, 1 is the highest acuity) used by all EDs (<xref ref-type="bibr" rid="ref13">13</xref>) in this study and by a majority of EDs in Sweden (<xref ref-type="bibr" rid="ref14">14</xref>). Three EDs used an optional 5th category which were combined with category 4 in the analysis. In the regression model, acuity was inverted so that 1 represented the lowest acuity. To adjust for chief complaints, which may affect mortality, the ten complaints with the highest absolute 30-day mortality were each added as a category to the analysis, with the remaining ones categorized as <italic>other</italic>.</p>
</sec>
<sec id="sec9">
<title>Outcomes</title>
<p>The primary outcome was 7-day all-cause mortality for both admitted and discharged ED patients measured as cox proportional hazard ratios. We hypothesized that the negative effects of ED crowding would have the greatest impact on short-term mortality, which is more likely to be related to the quality of ED care. Secondary outcomes wereone- and 30-day mortality. Outcomes were analyzed unadjusted and adjusted for age, sex, acuity, arrival by ambulance, hospital admission and chief complaint.</p>
</sec>
<sec id="sec10">
<title>Exposures</title>
<p>The exposure was crowding, defined as a mSEAL score at the hour of arrival for each patient. Additional analyzes were performed using the alternative exposures of occupancy rate (occupancy rate; number of present ED patients divided by treatment beds) at patient arrival. To account for baseline differences in occupancy rate between the included study sites (<xref ref-type="bibr" rid="ref15">15</xref>) and intra-day variations (<xref ref-type="bibr" rid="ref2">2</xref>, <xref ref-type="bibr" rid="ref12">12</xref>, <xref ref-type="bibr" rid="ref16">16</xref>), each crowding metric was stratified by ED and arrival hour. The exposure variable for each patient was categorized by quantile (&#x003C;85%, 85&#x2013;90%, 90&#x2013;95, &#x003E;95%) since we hypothesized that the effects of crowding on mortality are non-linear which is supported by previous studies by Af Ugglas et al. (<xref ref-type="bibr" rid="ref2">2</xref>) and McCusker et al. (<xref ref-type="bibr" rid="ref17">17</xref>). The &#x003C;85% category was used as reference for each exposure group. To account for repeated visits, which may be more prevalent in patients who die, results are reported with and without left-truncation of data. Left truncation removes all subsequent ED visits until censoring for each index visit. Hours when the mSEAL score could not be calculated, often due to few patients or when no patients had been waiting for a physician, were denoted missing and excluded from the regression model.</p>
</sec>
<sec id="sec11">
<title>Analysis</title>
<p>Mortality risk was calculated using a cox proportional hazard model adjusted for age, sex, hospital admission, acuity, chief complaint and EMS arrival. Based on an estimated 7-day mortality of 0.5%, 20,000 visits were needed to identify an 0.4% absolute difference in mortality with a power of 0.8 and alpha risk of 0.05, using Fisher&#x2019;s exact test (<xref ref-type="bibr" rid="ref18">18</xref>, <xref ref-type="bibr" rid="ref19">19</xref>). To allow for subgroup analyzes and adjustments for confounding factors, we chose a 6-month inclusion period which would correspond to approximately 150,000 visits. A point estimate with 95% confidence intervals not including 1.0 and a value of p less than 0.05 were defined as statistically significant. Data were imported into Pandas (v 0.23) (<xref ref-type="bibr" rid="ref20">20</xref>) and analyzed with Python using the Scipy library (v 1.17) (<xref ref-type="bibr" rid="ref21">21</xref>) and the lifelines library for survival analysis (<xref ref-type="bibr" rid="ref22">22</xref>). This study was carried out in accordance with The Declaration of Helsinki (<xref ref-type="bibr" rid="ref23">23</xref>) and approved by the regional ethics review board at Lund (permit number 2016/69).</p>
</sec>
</sec>
<sec id="sec12" sec-type="results">
<title>Results</title>
<p>A total of 172,336 visits were made to the study EDs during the study period. After excluding duplicates (<italic>n</italic>&#x2009;=&#x2009;3,424), very long lengths of stay (LOS) likely to be incorrect (&#x003E;3&#x2009;days, <italic>n</italic>&#x2009;=&#x2009;2) and incorrect mortality data (<italic>n</italic>&#x2009;=&#x2009;10), 168,900 visits made by 122,833 patients were included in the final analysis (<xref rid="fig1" ref-type="fig">Figure 1</xref>). There were considerable differences in hospital admissions, 30&#x2009;day mortality and LOS between the included EDs (<xref rid="tab1" ref-type="table">Table 1</xref>).</p>
<fig position="float" id="fig1">
<label>Figure 1</label>
<caption><p>Flowchart of included visits and patients.</p></caption>
<graphic xlink:href="fpubh-11-1198188-g001.tif"/>
</fig>
<table-wrap position="float" id="tab1">
<label>Table 1</label>
<caption><p>Characteristics of the EDs included in this study.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left" valign="middle" rowspan="2">Type</th>
<th align="center" valign="middle">Helsingborg</th>
<th align="center" valign="middle">Link&#x00F6;ping</th>
<th align="center" valign="middle">Lund</th>
<th align="center" valign="middle">Malm&#x00F6;</th>
<th align="center" valign="middle">Motala</th>
<th align="center" valign="middle">Norrk&#x00F6;ping</th>
</tr>
<tr>
<th align="center" valign="middle">Urban Community</th>
<th align="center" valign="middle">Academic Tertiary Center</th>
<th align="center" valign="middle">Academic Tertiary Center</th>
<th align="center" valign="middle">Academic Tertiary Center</th>
<th align="center" valign="middle">Rural Community</th>
<th align="center" valign="middle">Urban Community</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="bottom">ED beds</td>
<td align="center" valign="bottom">52</td>
<td align="center" valign="bottom">48</td>
<td align="center" valign="bottom">35</td>
<td align="center" valign="bottom">72</td>
<td align="center" valign="bottom">16</td>
<td align="center" valign="bottom">29</td>
</tr>
<tr>
<td align="left" valign="bottom">Annual visits</td>
<td align="center" valign="bottom">88,486</td>
<td align="center" valign="bottom">40,502</td>
<td align="center" valign="bottom">67,458</td>
<td align="center" valign="bottom">79,412</td>
<td align="center" valign="bottom">21,194</td>
<td align="center" valign="bottom">40,748</td>
</tr>
<tr>
<td align="left" valign="bottom">Hospital Admissions</td>
<td align="center" valign="bottom">22%</td>
<td align="center" valign="bottom">21%</td>
<td align="center" valign="bottom">27%</td>
<td align="center" valign="bottom">28%</td>
<td align="center" valign="bottom">19%</td>
<td align="center" valign="bottom">24%</td>
</tr>
<tr>
<td align="left" valign="bottom" colspan="7">Mortality<xref rid="tfn1" ref-type="table-fn"><sup>a</sup></xref></td>
</tr>
<tr>
<td align="left" valign="bottom">1-day</td>
<td align="center" valign="bottom">0.33%</td>
<td align="center" valign="bottom">0.29%</td>
<td align="center" valign="bottom">0.37%</td>
<td align="center" valign="bottom">0.45%</td>
<td align="center" valign="bottom">0.28%</td>
<td align="center" valign="bottom">0.25%</td>
</tr>
<tr>
<td align="left" valign="bottom">7-day</td>
<td align="center" valign="bottom">0.77%</td>
<td align="center" valign="bottom">0.72%</td>
<td align="center" valign="bottom">0.85%</td>
<td align="center" valign="bottom">1.13%</td>
<td align="center" valign="bottom">0.95%</td>
<td align="center" valign="bottom">0.86%</td>
</tr>
<tr>
<td align="left" valign="bottom">30-day</td>
<td align="center" valign="bottom">1.72%</td>
<td align="center" valign="bottom">1.47%</td>
<td align="center" valign="bottom">2.00%</td>
<td align="center" valign="bottom">2.45%</td>
<td align="center" valign="bottom">2.05%</td>
<td align="center" valign="bottom">1.84%</td>
</tr>
<tr>
<td align="left" valign="bottom" colspan="7">Length of stay</td>
</tr>
<tr>
<td align="left" valign="bottom">Mean (SD)</td>
<td align="center" valign="bottom">04:18 (04:52)</td>
<td align="center" valign="bottom">03:40 (02:23)</td>
<td align="center" valign="bottom">05:02 (03:57)</td>
<td align="center" valign="bottom">04:19 (03:03)</td>
<td align="center" valign="bottom">03:11 (02:04)</td>
<td align="center" valign="bottom">03:20 (02:05)</td>
</tr>
<tr>
<td align="left" valign="bottom">Median (IQR)</td>
<td align="center" valign="bottom">03:00 (01:13&#x2013;05:29)</td>
<td align="center" valign="bottom">03:19 (01:50&#x2013;05:05)</td>
<td align="center" valign="bottom">04:10 (02:22&#x2013;06:39)</td>
<td align="center" valign="bottom">03:43 (02:05&#x2013;05:53)</td>
<td align="center" valign="bottom">02:47 (01:41&#x2013;04:21)</td>
<td align="center" valign="bottom">02:59 (01:50&#x2013;04:28)</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn id="tfn1"><label>a</label><p>Admitted and discharged patients combined.</p></fn>
</table-wrap-foot>
</table-wrap>
<p><xref rid="tab2" ref-type="table">Table 2</xref> shows that LOS and unadjusted mortality for all three follow-up periods seemed to increase with increased crowding. The reference group had higher mortality than the lowest crowding group and was similar to the &#x003E;90% groups. Mortality was generally higher in the reference group compared to patients arriving at hours when the mSEAL score could not be calculated (missing).</p>
<table-wrap position="float" id="tab2">
<label>Table 2</label>
<caption><p>Outcome characteristics stratified by mSEAL crowding category.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th/>
<th align="center" valign="top">&#x003C;85%</th>
<th align="center" valign="top">85&#x2013;90%</th>
<th align="center" valign="top">90&#x2013;95%</th>
<th align="center" valign="top">95&#x2013;100%</th>
<th align="center" valign="top">Missing</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="bottom">N</td>
<td align="center" valign="bottom">143,041</td>
<td align="center" valign="bottom">8,394</td>
<td align="center" valign="bottom">8,527</td>
<td align="center" valign="bottom">7,974</td>
<td align="center" valign="bottom">964</td>
</tr>
<tr>
<td align="left" valign="bottom">Arrival by ambulance</td>
<td align="center" valign="bottom">25.2%</td>
<td align="center" valign="bottom">25.4%</td>
<td align="center" valign="bottom">24.8%</td>
<td align="center" valign="bottom">24.6%</td>
<td align="center" valign="bottom">22.5%</td>
</tr>
<tr>
<td align="left" valign="bottom">Female</td>
<td align="center" valign="bottom">49.8%</td>
<td align="center" valign="bottom">50.4%</td>
<td align="center" valign="bottom">49.7%</td>
<td align="center" valign="bottom">49.6%</td>
<td align="center" valign="bottom">49.9%</td>
</tr>
<tr>
<td align="left" valign="bottom" colspan="6">Mortality (<italic>n</italic>)<xref rid="tfn2" ref-type="table-fn"><sup>a</sup></xref></td>
</tr>
<tr>
<td align="left" valign="bottom">1-day</td>
<td align="center" valign="bottom">0.35% (503)</td>
<td align="center" valign="bottom">0.27% (23)</td>
<td align="center" valign="bottom">0.34% (29)</td>
<td align="center" valign="bottom">0.41% (33)</td>
<td align="center" valign="bottom">0.21% (2)</td>
</tr>
<tr>
<td align="left" valign="bottom">7-day</td>
<td align="center" valign="bottom">0.89% (1277)</td>
<td align="center" valign="bottom">0.73% (61)</td>
<td align="center" valign="bottom">0.88% (75)</td>
<td align="center" valign="bottom">1.03% (82)</td>
<td align="center" valign="bottom">0.31% (3)</td>
</tr>
<tr>
<td align="left" valign="bottom">30-day</td>
<td align="center" valign="bottom">1.97% (2821)</td>
<td align="center" valign="bottom">1.6% (134)</td>
<td align="center" valign="bottom">1.97% (168)</td>
<td align="center" valign="bottom">2.03% (162)</td>
<td align="center" valign="bottom">1.14% (11)</td>
</tr>
<tr>
<td align="left" valign="bottom" colspan="6">LOS</td>
</tr>
<tr>
<td align="left" valign="bottom">Mean (SD)</td>
<td align="center" valign="bottom">04:05 (03:32)</td>
<td align="center" valign="bottom">04:40 (04:05)</td>
<td align="center" valign="bottom">04:41 (04:05)</td>
<td align="center" valign="bottom">04:58 (04:22)</td>
<td align="center" valign="bottom">04:39 (04:05)</td>
</tr>
<tr>
<td align="left" valign="bottom">Median(IQR)</td>
<td align="center" valign="bottom">03:19 (01:46&#x2013;05:25)</td>
<td align="center" valign="bottom">03:47 (02:01&#x2013;06:06)</td>
<td align="center" valign="bottom">03:49 (02:05&#x2013;06:04)</td>
<td align="center" valign="bottom">04:01 (02:09&#x2013;06:25)</td>
<td align="center" valign="bottom">03:46 (02:05&#x2013;06:04)</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn id="tfn2"><label>a</label><p>Admitted and discharged patients combined, unadjusted.</p></fn>
</table-wrap-foot>
</table-wrap>
<p>The Cox proportional hazard model adjusted for age, sex, hospital admission, acuity, chief complaint and EMS arrival is described in <xref rid="tab3" ref-type="table">Table 3</xref>. High levels of crowding, defined as a mSEAL score over the 95th percentile for ED and hour of day, was associated with a non-significant increase in HR for 7-day mortality of 1.04 (95% CI 0.96&#x2013;1.13). Similarly, an occupancy rate above the 95th percentile at arrival was associated with a non-significant increase HR for 7-day mortality of 1.03 (0.95&#x2013;1.13). The HR for one- and 30-day mortality for mSEAL and occupancy rate above the 95th percentile were also increased, but all results were not statistically significant with confidence intervals included one. When left-truncating the data, i.e., removing all subsequent visits by the patients during the follow-up period, the statistical power decreased and 95% confidence intervals widened for all models (<xref rid="SM1" ref-type="supplementary-material">Supplementary Tables S1</xref>). In our cohort, 4.6% of patients who died within 7&#x2009;days of a visit had &#x003E;1 visit during these 7&#x2009;days. Of patients who did not die, 7.5% had &#x003E;1 visit within 7&#x2009;days.</p>
<table-wrap position="float" id="tab3">
<label>Table 3</label>
<caption><p>Cox proportional hazard ratio for all cause mortality at each crowding exposure.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th/>
<th align="center" valign="top">1-day</th>
<th align="center" valign="top">7-day</th>
<th align="center" valign="top">30-day</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="bottom" char="(" colspan="4">mSEAL</td>
</tr>
<tr>
<td align="left" valign="bottom">85&#x2013;90%</td>
<td align="char" valign="bottom" char="(">1.05 (0.67&#x2013;1.63)</td>
<td align="char" valign="bottom" char="(">0.93 (0.71&#x2013;1.22)</td>
<td align="char" valign="bottom" char="(">0.85 (0.71&#x2013;1.02)</td>
</tr>
<tr>
<td align="left" valign="bottom">90&#x2013;95%</td>
<td align="char" valign="bottom" char="(">0.93 (0.76&#x2013;1.13)</td>
<td align="char" valign="bottom" char="(">1.01 (0.9&#x2013;1.14)</td>
<td align="char" valign="bottom" char="(">1.01 (0.93&#x2013;1.1)</td>
</tr>
<tr>
<td align="left" valign="bottom">&#x003E;95%</td>
<td align="char" valign="bottom" char="(">1.03 (0.9&#x2013;1.18)</td>
<td align="char" valign="bottom" char="(">1.04 (0.96&#x2013;1.13)</td>
<td align="char" valign="bottom" char="(">1.03 (0.97&#x2013;1.09)</td>
</tr>
<tr>
<td align="left" valign="bottom" char="(" colspan="4">Occupancy rate</td>
</tr>
<tr>
<td align="left" valign="bottom">85&#x2013;90%</td>
<td align="char" valign="bottom" char="(">0.98 (0.68&#x2013;1.42)</td>
<td align="char" valign="bottom" char="(">0.92 (0.72&#x2013;1.17)</td>
<td align="char" valign="bottom" char="(">0.92 (0.78&#x2013;1.08)</td>
</tr>
<tr>
<td align="left" valign="bottom">90&#x2013;95%</td>
<td align="char" valign="bottom" char="(">0.9 (0.71&#x2013;1.14)</td>
<td align="char" valign="bottom" char="(">0.92 (0.79&#x2013;1.06)</td>
<td align="char" valign="bottom" char="(">0.92 (0.84&#x2013;1.01)</td>
</tr>
<tr>
<td align="left" valign="bottom">&#x003E;95%</td>
<td align="char" valign="bottom" char="(">1.04 (0.9&#x2013;1.19)</td>
<td align="char" valign="bottom" char="(">1.03 (0.95&#x2013;1.13)</td>
<td align="char" valign="bottom" char="(">1.04 (0.98&#x2013;1.11)</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p>Models adjusted by: age, sex, EMS arrival, acuity and admission to hospital with 95% confidence intervals.</p>
</table-wrap-foot>
</table-wrap>
<p>There were large differences in average mSEAL score between the study EDs for each exposure group, as shown in <xref rid="tab4" ref-type="table">Table 4</xref>. The highest average reference and 95th percentile scores (3.79 and 5.17) were observed at Lund, and the lowest at Motala (3.03) and Norrk&#x00F6;ping (4.25), respectively. Similarly, there were large differences in occupancy rate at the 85th and 95th percentile for each hour of day and ED where the 95th percentile occupancy rate was consistently 2&#x2013;4 times higher in the ED with the highest occupancy rate (Lund) compared to the ED with the lowest occupancy rate (Link&#x00F6;ping) (<xref rid="SM1" ref-type="supplementary-material">Supplementary Tables S2, S3</xref>).</p>
<table-wrap position="float" id="tab4">
<label>Table 4</label>
<caption><p>mSEAL average score (SD) by hospital and crowding group.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th/>
<th align="center" valign="top">Helsingborg</th>
<th align="center" valign="top">Link&#x00F6;ping</th>
<th align="center" valign="top">Lund</th>
<th align="center" valign="top">Malm&#x00F6;</th>
<th align="center" valign="top">Motala</th>
<th align="center" valign="top">Norrk&#x00F6;ping</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="bottom">&#x003C;85% (reference)</td>
<td align="char" valign="bottom" char="(">3.60 (0.63)</td>
<td align="char" valign="bottom" char="(">3.36 (0.91)</td>
<td align="char" valign="bottom" char="(">3.79 (0.72)</td>
<td align="char" valign="bottom" char="(">3.55 (0.67)</td>
<td align="char" valign="bottom" char="(">3.03 (0.78)</td>
<td align="char" valign="bottom" char="(">3.11 (0.73)</td>
</tr>
<tr>
<td align="left" valign="bottom">85&#x2013;90%</td>
<td align="char" valign="bottom" char="(">4.40 (0.55)</td>
<td align="char" valign="bottom" char="(">4.07 (0.98)</td>
<td align="char" valign="bottom" char="(">4.61 (0.67)</td>
<td align="char" valign="bottom" char="(">4.24 (0.64)</td>
<td align="char" valign="bottom" char="(">3.81 (0.90)</td>
<td align="char" valign="bottom" char="(">3.73 (0.82)</td>
</tr>
<tr>
<td align="left" valign="bottom">90&#x2013;95%</td>
<td align="char" valign="bottom" char="(">4.60 (0.53)</td>
<td align="char" valign="bottom" char="(">4.26 (1.03)</td>
<td align="char" valign="bottom" char="(">4.81 (0.71)</td>
<td align="char" valign="bottom" char="(">4.40 (0.67)</td>
<td align="char" valign="bottom" char="(">3.99 (0.94)</td>
<td align="char" valign="bottom" char="(">3.88 (0.87)</td>
</tr>
<tr>
<td align="left" valign="bottom">95&#x2013;100%</td>
<td align="char" valign="bottom" char="(">5.09 (0.59)</td>
<td align="char" valign="bottom" char="(">4.86 (1.25)</td>
<td align="char" valign="bottom" char="(">5.17 (0.77)</td>
<td align="char" valign="bottom" char="(">4.70 (0.74)</td>
<td align="char" valign="bottom" char="(">4.40 (1.04)</td>
<td align="char" valign="bottom" char="(">4.25 (0.90)</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="sec13" sec-type="discussions">
<title>Discussion</title>
<p>In this study, crowding defined as an mSEAL score above the 95th percentile had no statistically significant association with increased HR for 7-day mortality adjusted for age, sex, arrival by EMS, acuity, chief complaint and admission to hospital, compared with non-crowding (score&#x2009;&#x003C;&#x2009;85th percentile). There were positive hazard ratios for death in the highest crowding group (&#x003E;95th percentile) for both mSEAL and occupancy rate, but the 95% CI included one, and the results were therefore not significant at the <italic>p</italic>&#x2009;&#x003C;&#x2009;0.05 level.</p>
<p>Crowding occurs when the demand for ED care is higher than the available resources with negative effects for patients and providers (<xref ref-type="bibr" rid="ref24">24</xref>). Although the definition is universal, the extent of the problem and its consequences may vary between institutions, being more prominent in urban and academic EDs (<xref ref-type="bibr" rid="ref25">25</xref>, <xref ref-type="bibr" rid="ref26">26</xref>). A recent study by Af Ugglas et al. (<xref ref-type="bibr" rid="ref27">27</xref>) found variable association between crowding and mortality within Sweden and a previous study by our group showed considerable differences in resource availability in Sweden, specifically treatment beds and staffing in relation to patient volume (<xref ref-type="bibr" rid="ref15">15</xref>). Our study included a mix of rural, urban and academic centers which may contribute to the lack of association between crowding and mortality. Although initial analysis indicated variation in mortality between sites, the differences were small given the limited overall absolute mortality and further subgroup analysis was not performed.</p>
<p>The average mSEAL score of the different crowding groups varied substantially between the EDs; Lund ED had the highest average score of 5.17 at the 95th percentile group and Norrk&#x00F6;ping ED the lowest at 4.25. There was also a large variation in baseline occupancy rate (<xref rid="SM1" ref-type="supplementary-material">Supplementary Table S2</xref>). Previous studies from our group and others (<xref ref-type="bibr" rid="ref15">15</xref>, <xref ref-type="bibr" rid="ref28">28</xref>&#x2013;<xref ref-type="bibr" rid="ref30">30</xref>) have shown that crowding may indeed vary between EDs and that scores need to be adjusted to the individual site. In this study, we also found large intra-day variations at all EDs for both mSEAL scores and occupancy rate (<xref rid="SM1" ref-type="supplementary-material">Supplementary Tables S2, S3</xref>). By stratifying the scores by ED and hour of day we accounted for these differences, making them comparable between EDs and likely interchangeable as markers of crowding.</p>
<p>When left-truncating the data (counting only the first visit during the follow-up period), the HR point estimates decreased and the uncertainty of the results increased, likely due to less statistical power. Truncation will potentially remove bias caused by multiple ED visits before death that may systematically skew the results if patients that are more likely to die visit the ED more often than other patients. This has been shown during the last year of life (<xref ref-type="bibr" rid="ref31">31</xref>&#x2013;<xref ref-type="bibr" rid="ref33">33</xref>), but is unknown for short-term follow-up. It was not the case in our study where patients with repeated visits within the follow-up period had lower mortality compared to the cohort, limiting the possible confounding. Furthermore, truncation may increase the risk of missing a true crowding effect on mortality since crowding may appear at an excluded ED visit. ED visit data were left truncated in the study by Af Ugglas et al. (<xref ref-type="bibr" rid="ref2">2</xref>), but not in the study by Jones et al. (<xref ref-type="bibr" rid="ref9">9</xref>).</p>
<sec id="sec14">
<title>Limitations</title>
<p>There are several limitations to this study, the first one being the lack of statistical power and a risk of a type II statistical error. At the time of power calculation there were only two previous studies available on the association between crowding and mortality, with effect sizes between 5 and 34%, which contributed to the uncertainty regarding the correct effect size (<xref ref-type="bibr" rid="ref18">18</xref>, <xref ref-type="bibr" rid="ref19">19</xref>). The mSEAL and OR effect estimates showed the expected trends towards increased HR which is consistent with the findings of Af Ugglas et al. (<xref ref-type="bibr" rid="ref2">2</xref>) in a larger study with comparable methods. Furthermore, several previous studies have found an association between ED crowding and mortality supporting an underlying association (<xref ref-type="bibr" rid="ref2">2</xref>, <xref ref-type="bibr" rid="ref9">9</xref>, <xref ref-type="bibr" rid="ref17">17</xref>, <xref ref-type="bibr" rid="ref18">18</xref>, <xref ref-type="bibr" rid="ref34">34</xref>).</p>
<p>This was a retrospective observational study and as such, it can only demonstrate association and not causation. We lacked data to control for previous medical history of the patients with the Charlson comorbidity index, as initially planned, which may explain some of the observed effect on mortality. However, we were able to control for all significant confounders found in a similar study where the addition of previous medical data did not alter the results (<xref ref-type="bibr" rid="ref2">2</xref>). There may be additional confounding variables like exogenous events (e.g., EHR malfunction, seasonal effects), that may affect our results (<xref ref-type="bibr" rid="ref35">35</xref>, <xref ref-type="bibr" rid="ref36">36</xref>).</p>
</sec>
</sec>
<sec id="sec15" sec-type="conclusions">
<title>Conclusion</title>
<p>In this multicenter study in Sweden, high ED crowding measured by mSEAL or occupancy rate was not significantly associated with an increase in short-term mortality.</p>
</sec>
<sec id="sec16" sec-type="data-availability">
<title>Data availability statement</title>
<p>The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.</p>
</sec>
<sec id="sec17">
<title>Ethics statement</title>
<p>The studies involving human participants were reviewed and approved by Ethics committee of Lund University, permit number 2016/69. The ethics committee waived the requirement of written informed consent for participation.</p>
</sec>
<sec id="sec18">
<title>Author contributions</title>
<p>JW, DW, and UE conceived the study and designed the trial. UE obtained the ethical permit. JW coordinated data collection and managed the data, with the assistance of DW and UE. DW and UE obtained the research funding. JW drafted the manuscript and takes responsibility for the paper as a whole. All authors contributed to the article and approved the submitted version.</p>
</sec>
<sec sec-type="funding-information" id="sec19">
<title>Funding</title>
<p>This work was supported by two grants from Region &#x00D6;sterg&#x00F6;tland to author DW (LIO-532001 and LIO-700271), and from Region Sk&#x00E5;ne to author UE. The funding bodies had no role in study design, data collection, data analysis or writing of the manuscript.</p>
</sec>
<sec sec-type="COI-statement" id="sec20">
<title>Conflict of interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec id="sec143" sec-type="disclaimer">
<title>Publisher&#x2019;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
</body>
<back>
<sec id="sec21" sec-type="supplementary-material">
<title>Supplementary material</title>
<p>The Supplementary material for this article can be found online at: <ext-link xlink:href="https://www.frontiersin.org/articles/10.3389/fpubh.2023.1198188/full#supplementary-material" ext-link-type="uri">https://www.frontiersin.org/articles/10.3389/fpubh.2023.1198188/full#supplementary-material</ext-link></p>
<supplementary-material xlink:href="Table_1.pdf" id="SM1" mimetype="application/pdf" xmlns:xlink="http://www.w3.org/1999/xlink"/>
</sec>
<ref-list>
<title>References</title>
<ref id="ref1"><label>1.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Stang</surname> <given-names>AS</given-names></name> <name><surname>Crotts</surname> <given-names>J</given-names></name> <name><surname>Johnson</surname> <given-names>DW</given-names></name> <name><surname>Hartling</surname> <given-names>L</given-names></name> <name><surname>Guttmann</surname> <given-names>A</given-names></name></person-group>. <article-title>Crowding measures associated with the quality of emergency department care: a systematic review</article-title>. <source>Acad Emerg Med</source>. (<year>2015</year>) <volume>22</volume>:<fpage>643</fpage>&#x2013;<lpage>56</lpage>. doi: <pub-id pub-id-type="doi">10.1111/acem.12682</pub-id>, PMID: <pub-id pub-id-type="pmid">25996053</pub-id></citation></ref>
<ref id="ref2"><label>2.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ugglas</surname> <given-names>BA</given-names></name> <name><surname>Dj&#x00E4;rv</surname> <given-names>T</given-names></name> <name><surname>Ljungman</surname> <given-names>PLS</given-names></name> <name><surname>Holzmann</surname> <given-names>MJ</given-names></name></person-group>. <article-title>Emergency department crowding associated with increased 30-day mortality: a cohort study in Stockholm region, Sweden, 2012 to 2016</article-title>. <source>J Am Coll Emerg Physicians Open</source>. (<year>2020</year>) <volume>1</volume>:<fpage>1312</fpage>&#x2013;<lpage>9</lpage>. doi: <pub-id pub-id-type="doi">10.1002/emp2.12243</pub-id>, PMID: <pub-id pub-id-type="pmid">33392538</pub-id></citation></ref>
<ref id="ref3"><label>3.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pines</surname> <given-names>JM</given-names></name> <name><surname>Hilton</surname> <given-names>JA</given-names></name> <name><surname>Weber</surname> <given-names>EJ</given-names></name> <name><surname>Alkemade</surname> <given-names>AJ</given-names></name> <name><surname>Al Shabanah</surname> <given-names>H</given-names></name> <name><surname>Anderson</surname> <given-names>PD</given-names></name> <etal/></person-group>. <article-title>International Perspectives on emergency department crowding: International Perspectives on Ed Crowding</article-title>. <source>Acad Emerg Med</source>. (<year>2011</year>) <volume>18</volume>:<fpage>1358</fpage>&#x2013;<lpage>70</lpage>. doi: <pub-id pub-id-type="doi">10.1111/j.1553-2712.2011.01235.x</pub-id></citation></ref>
<ref id="ref4"><label>4.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Berg</surname> <given-names>LM</given-names></name> <name><surname>Ehrenberg</surname> <given-names>A</given-names></name> <name><surname>Florin</surname> <given-names>J</given-names></name> <name><surname>&#x00D6;stergren</surname> <given-names>J</given-names></name> <name><surname>Discacciati</surname> <given-names>A</given-names></name> <name><surname>G&#x00F6;ransson</surname> <given-names>KE</given-names></name></person-group>. <article-title>Associations between crowding and ten-day mortality among patients allocated lower triage acuity levels without need of acute hospital care on departure from the emergency department</article-title>. <source>Ann Emerg Med</source>. (<year>2019</year>) <volume>74</volume>:<fpage>345</fpage>&#x2013;<lpage>56</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.annemergmed.2019.04.012</pub-id>, PMID: <pub-id pub-id-type="pmid">31229391</pub-id></citation></ref>
<ref id="ref5"><label>5.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Af Ugglas</surname> <given-names>B</given-names></name> <name><surname>Dj&#x00E4;rv</surname> <given-names>T</given-names></name> <name><surname>Ljungman</surname> <given-names>PLS</given-names></name> <name><surname>Holzmann</surname> <given-names>MJ</given-names></name></person-group>. <article-title>Association between hospital bed occupancy and outcomes in emergency care: a cohort study in Stockholm region, Sweden, 2012 to 2016</article-title>. <source>Ann Emerg Med</source>. (<year>2020</year>) <volume>76</volume>:<fpage>179</fpage>&#x2013;<lpage>90</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.annemergmed.2019.11.009</pub-id>, PMID: <pub-id pub-id-type="pmid">31983500</pub-id></citation></ref>
<ref id="ref6"><label>6.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wretborn</surname> <given-names>J</given-names></name> <name><surname>Khoshnood</surname> <given-names>A</given-names></name> <name><surname>Wieloch</surname> <given-names>M</given-names></name> <name><surname>Ekelund</surname> <given-names>U</given-names></name></person-group>. <article-title>Sk&#x00E5;ne emergency department assessment of patient load (SEAL)-a model to estimate crowding based on workload in Swedish emergency departments</article-title>. <source>PLoS One</source>. (<year>2015</year>) <volume>10</volume>:<fpage>e0130020</fpage>. doi: <pub-id pub-id-type="doi">10.1371/journal.pone.0130020</pub-id>, PMID: <pub-id pub-id-type="pmid">26083596</pub-id></citation></ref>
<ref id="ref7"><label>7.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>McCarthy</surname> <given-names>ML</given-names></name> <name><surname>Aronsky</surname> <given-names>D</given-names></name> <name><surname>Jones</surname> <given-names>ID</given-names></name> <name><surname>Miner</surname> <given-names>JR</given-names></name> <name><surname>Band</surname> <given-names>RA</given-names></name> <name><surname>Baren</surname> <given-names>JM</given-names></name> <etal/></person-group>. <article-title>The emergency department occupancy rate: a simple measure of emergency department crowding?</article-title> <source>Ann Emerg Med</source>. (<year>2008</year>) <volume>51</volume>:<fpage>15</fpage>&#x2013;<lpage>24.e2</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.annemergmed.2007.09.003</pub-id></citation></ref>
<ref id="ref8"><label>8.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jo</surname> <given-names>S</given-names></name> <name><surname>Jin</surname> <given-names>YH</given-names></name> <name><surname>Lee</surname> <given-names>JB</given-names></name> <name><surname>Jeong</surname> <given-names>T</given-names></name> <name><surname>Yoon</surname> <given-names>J</given-names></name> <name><surname>Park</surname> <given-names>B</given-names></name></person-group>. <article-title>Emergency department occupancy ratio is associated with increased early mortality</article-title>. <source>J Emerg Med</source>. (<year>2014</year>) <volume>46</volume>:<fpage>241</fpage>&#x2013;<lpage>9</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.jemermed.2013.05.026</pub-id>, PMID: <pub-id pub-id-type="pmid">23992849</pub-id></citation></ref>
<ref id="ref9"><label>9.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jones</surname> <given-names>PG</given-names></name> <name><surname>van der Werf</surname> <given-names>B</given-names></name></person-group>. <article-title>Emergency department crowding and mortality for patients presenting to emergency departments in new Zealand</article-title>. <source>Emerg Med Australas</source>. (<year>2020</year>) <volume>33</volume>:<fpage>655</fpage>&#x2013;<lpage>64</lpage>. doi: <pub-id pub-id-type="doi">10.1111/1742-6723.13699</pub-id>, PMID: <pub-id pub-id-type="pmid">33300257</pub-id></citation></ref>
<ref id="ref10"><label>10.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Derose</surname> <given-names>SF</given-names></name> <name><surname>Gabayan</surname> <given-names>GZ</given-names></name> <name><surname>Chiu</surname> <given-names>VY</given-names></name> <name><surname>Yiu</surname> <given-names>SC</given-names></name> <name><surname>Sun</surname> <given-names>BC</given-names></name></person-group>. <article-title>Emergency department crowding predicts admission length-of-stay but not mortality in a large health system</article-title>. <source>Med Care</source>. (<year>2014</year>) <volume>52</volume>:<fpage>602</fpage>&#x2013;<lpage>11</lpage>. doi: <pub-id pub-id-type="doi">10.1097/MLR.0000000000000141</pub-id>, PMID: <pub-id pub-id-type="pmid">24926707</pub-id></citation></ref>
<ref id="ref11"><label>11.</label><citation citation-type="web"><person-group person-group-type="author"><name><surname>Ruge</surname> <given-names>T</given-names></name> <name><surname>Granberg</surname> <given-names>M</given-names></name> <name><surname>Helmers</surname> <given-names>SB.</given-names></name></person-group>. V&#x00E4;ntetider och patientfl&#x00F6;den p&#x00E5; akutmottagningar &#x2013; Rapport februari (<year>2017</year>). <comment>Available at:</comment> <ext-link xlink:href="https://www.socialstyrelsen.se/globalassets/sharepoint-dokument/artikelkatalog/ovrigt/2017-2-16.pdf" ext-link-type="uri">https://www.socialstyrelsen.se/globalassets/sharepoint-dokument/artikelkatalog/ovrigt/2017-2-16.pdf</ext-link></citation></ref>
<ref id="ref12"><label>12.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ekelund</surname> <given-names>U</given-names></name> <name><surname>Kurland</surname> <given-names>L</given-names></name> <name><surname>Eklund</surname> <given-names>F</given-names></name> <name><surname>Torkki</surname> <given-names>P</given-names></name> <name><surname>Letterst&#x00E5;l</surname> <given-names>A</given-names></name> <name><surname>Lindmarker</surname> <given-names>P</given-names></name> <etal/></person-group>. <article-title>Patient throughput times and inflow patterns in Swedish emergency departments. A basis for ANSWER, a national SWedish emergency registry</article-title>. <source>Scand J Trauma Resusc Emerg Med</source>. (<year>2011</year>) <volume>19</volume>:<fpage>37</fpage>. doi: <pub-id pub-id-type="doi">10.1186/1757-7241-19-37</pub-id>, PMID: <pub-id pub-id-type="pmid">21668987</pub-id></citation></ref>
<ref id="ref13"><label>13.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Widgren</surname> <given-names>BR</given-names></name> <name><surname>Jourak</surname> <given-names>M</given-names></name></person-group>. <article-title>Medical emergency triage and treatment system (METTS): a new protocol in primary triage and secondary priority decision in emergency medicine</article-title>. <source>J Emerg Med</source>. (<year>2011</year>) <volume>40</volume>:<fpage>623</fpage>&#x2013;<lpage>8</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.jemermed.2008.04.003</pub-id></citation></ref>
<ref id="ref14"><label>14.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Farrokhnia</surname> <given-names>N</given-names></name> <name><surname>G&#x00F6;ransson</surname> <given-names>KE</given-names></name></person-group>. <article-title>Swedish emergency department triage and interventions for improved patient flows: a national update</article-title>. <source>Scand J Trauma Resusc Emerg Med</source>. (<year>2011</year>) <volume>19</volume>:<fpage>72</fpage>. doi: <pub-id pub-id-type="doi">10.1186/1757-7241-19-72</pub-id>, PMID: <pub-id pub-id-type="pmid">22151969</pub-id></citation></ref>
<ref id="ref15"><label>15.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wretborn</surname> <given-names>J</given-names></name> <name><surname>Ekelund</surname> <given-names>U</given-names></name> <name><surname>Wilhelms</surname> <given-names>B</given-names></name></person-group>. <article-title>Differentiating properties of occupancy rate and workload to estimate crowding: a Swedish national cross-sectional study</article-title>. <source>J Am Coll Emerg Physicians Open</source>. (<year>2022</year>) <volume>3</volume>:<fpage>e12648</fpage>. doi: <pub-id pub-id-type="doi">10.1002/emp2.12648</pub-id>, PMID: <pub-id pub-id-type="pmid">35079734</pub-id></citation></ref>
<ref id="ref16"><label>16.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>McCarthy</surname> <given-names>ML</given-names></name> <name><surname>Ding</surname> <given-names>R</given-names></name> <name><surname>Pines</surname> <given-names>JM</given-names></name> <name><surname>Zeger</surname> <given-names>SL</given-names></name></person-group>. <article-title>Comparison of methods for measuring crowding and its effects on length of stay in the emergency department</article-title>. <source>Acad Emerg Med</source>. (<year>2011</year>) <volume>18</volume>:<fpage>1269</fpage>&#x2013;<lpage>77</lpage>. doi: <pub-id pub-id-type="doi">10.1111/j.1553-2712.2011.01232.x</pub-id>, PMID: <pub-id pub-id-type="pmid">22168190</pub-id></citation></ref>
<ref id="ref17"><label>17.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>McCusker</surname> <given-names>J</given-names></name> <name><surname>Vadeboncoeur</surname> <given-names>A</given-names></name> <name><surname>L&#x00E9;vesque</surname> <given-names>JF</given-names></name> <name><surname>Ciampi</surname> <given-names>A</given-names></name> <name><surname>Belzile</surname> <given-names>E</given-names></name></person-group>. <article-title>Increases in emergency department occupancy are associated with adverse 30-day outcomes</article-title>. <source>Acad Emerg Med</source>. (<year>2014</year>) <volume>21</volume>:<fpage>1092</fpage>&#x2013;<lpage>100</lpage>. doi: <pub-id pub-id-type="doi">10.1111/acem.12480</pub-id>, PMID: <pub-id pub-id-type="pmid">25308131</pub-id></citation></ref>
<ref id="ref18"><label>18.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sun</surname> <given-names>BC</given-names></name> <name><surname>Hsia</surname> <given-names>RY</given-names></name> <name><surname>Weiss</surname> <given-names>RE</given-names></name> <name><surname>Zingmond</surname> <given-names>D</given-names></name> <name><surname>Liang</surname> <given-names>LJ</given-names></name> <name><surname>Han</surname> <given-names>W</given-names></name> <etal/></person-group>. <article-title>Effect of emergency department crowding on outcomes of admitted patients</article-title>. <source>Ann Emerg Med</source>. (<year>2013</year>) <volume>61</volume>:<fpage>605</fpage>&#x2013;<lpage>11.e6</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.annemergmed.2012.10.026</pub-id>, PMID: <pub-id pub-id-type="pmid">23218508</pub-id></citation></ref>
<ref id="ref19"><label>19.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Richardson</surname> <given-names>DB</given-names></name></person-group>. <article-title>Increase in patient mortality at 10 days associated with emergency department overcrowding</article-title>. <source>Med J Aust</source>. (<year>2006</year>) <volume>184</volume>:<fpage>213</fpage>&#x2013;<lpage>6</lpage>. doi: <pub-id pub-id-type="doi">10.5694/j.1326-5377.2006.tb00204.x</pub-id>, PMID: <pub-id pub-id-type="pmid">16515430</pub-id></citation></ref>
<ref id="ref20"><label>20.</label><citation citation-type="web"><person-group person-group-type="author"><name><surname>McKinney</surname> <given-names>W.</given-names></name></person-group> <article-title>Data structures for statistical computing in Python</article-title>. In: <person-group person-group-type="editor"><name><surname>Walt</surname> <given-names>S</given-names><prefix>van der</prefix></name> <name><surname>Millman</surname> <given-names>J</given-names></name></person-group>, editors. <source>Proceedings of the 9th Python in Science Conference</source>. (<year>2010</year>). p. <fpage>51</fpage>&#x2013;<lpage>56</lpage>. <comment>Available at:</comment> <ext-link xlink:href="https://conference.scipy.org/proceedings/scipy2010/mckinney.html" ext-link-type="uri">https://conference.scipy.org/proceedings/scipy2010/mckinney.html</ext-link></citation></ref>
<ref id="ref21"><label>21.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Millman</surname> <given-names>KJ</given-names></name> <name><surname>Aivazis</surname> <given-names>M</given-names></name></person-group>. <article-title>Python for scientists and engineers</article-title>. <source>Comput Sci Eng</source>. (<year>2011</year>) <volume>13</volume>:<fpage>9</fpage>&#x2013;<lpage>12</lpage>. doi: <pub-id pub-id-type="doi">10.1109/MCSE.2011.36</pub-id></citation></ref>
<ref id="ref22"><label>22.</label><citation citation-type="web"><person-group person-group-type="author"><name><surname>Davidson-Pilon</surname> <given-names>C</given-names></name> <name><surname>Kalderstam</surname> <given-names>J</given-names></name> <name><surname>Jacobson</surname> <given-names>N</given-names></name> <name><surname>Reed</surname> <given-names>S</given-names></name> <name><surname>Kuhn</surname> <given-names>B</given-names></name> <name><surname>Zivich</surname> <given-names>P</given-names></name> <etal/></person-group>. CamDavidsonPilon/lifelines: v0.25.8. (<year>2021</year>). <comment>Available at:</comment> <ext-link xlink:href="https://zenodo.org/record/4457577" ext-link-type="uri">https://zenodo.org/record/4457577</ext-link></citation></ref>
<ref id="ref23"><label>23.</label><citation citation-type="journal"><person-group person-group-type="author"><collab id="coll1">World Medical Association</collab></person-group>. <article-title>World medical association declaration of Helsinki: ethical principles for medical research involving human subjects</article-title>. <source>JAMA</source>. (<year>2013</year>) <volume>310</volume>:<fpage>2191</fpage>&#x2013;<lpage>4</lpage>. doi: <pub-id pub-id-type="doi">10.1001/jama.2013.281053</pub-id></citation></ref>
<ref id="ref24"><label>24.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Morley</surname> <given-names>C</given-names></name> <name><surname>Unwin</surname> <given-names>M</given-names></name> <name><surname>Peterson</surname> <given-names>GM</given-names></name> <name><surname>Stankovich</surname> <given-names>J</given-names></name> <name><surname>Kinsman</surname> <given-names>L</given-names></name></person-group>. <article-title>Emergency department crowding: a systematic review of causes, consequences and solutions</article-title>. <source>PLoS One</source>. (<year>2018</year>) <volume>13</volume>:<fpage>e0203316</fpage>. doi: <pub-id pub-id-type="doi">10.1371/journal.pone.0203316</pub-id>, PMID: <pub-id pub-id-type="pmid">30161242</pub-id></citation></ref>
<ref id="ref25"><label>25.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rowe</surname> <given-names>BH</given-names></name> <name><surname>McRae</surname> <given-names>A</given-names></name> <name><surname>Rosychuk</surname> <given-names>RJ</given-names></name></person-group>. <article-title>Temporal trends in emergency department volumes and crowding metrics in a western Canadian province: a population-based, administrative data study</article-title>. <source>BMC Health Serv Res</source>. (<year>2020</year>) <volume>20</volume>:<fpage>356</fpage>. doi: <pub-id pub-id-type="doi">10.1186/s12913-020-05196-4</pub-id>, PMID: <pub-id pub-id-type="pmid">32336295</pub-id></citation></ref>
<ref id="ref26"><label>26.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Joseph</surname> <given-names>JW</given-names></name> <name><surname>White</surname> <given-names>BA</given-names></name></person-group>. <article-title>Emergency department operations: an overview</article-title>. <source>Emerg Med Clin North Am</source>. (<year>2020</year>) <volume>38</volume>:<fpage>549</fpage>&#x2013;<lpage>62</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.emc.2020.04.005</pub-id></citation></ref>
<ref id="ref27"><label>27.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Af Ugglas</surname> <given-names>B</given-names></name> <name><surname>Lindmarker</surname> <given-names>P</given-names></name> <name><surname>Ekelund</surname> <given-names>U</given-names></name> <name><surname>Dj&#x00E4;rv</surname> <given-names>T</given-names></name> <name><surname>Holzmann</surname> <given-names>MJ</given-names></name></person-group>. <article-title>Emergency department crowding and mortality in 14 Swedish emergency departments, a cohort study leveraging the Swedish emergency registry (SVAR)</article-title>. <source>PLoS One</source>. (<year>2021</year>) <volume>16</volume>:<fpage>e0247881</fpage>. doi: <pub-id pub-id-type="doi">10.1371/journal.pone.0247881</pub-id>, PMID: <pub-id pub-id-type="pmid">33690653</pub-id></citation></ref>
<ref id="ref28"><label>28.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rahmani</surname> <given-names>F</given-names></name> <name><surname>Rezazadeh</surname> <given-names>F</given-names></name> <name><surname>Ala</surname> <given-names>A</given-names></name> <name><surname>Soleimanpour</surname> <given-names>M</given-names></name> <name><surname>Mehdizadeh Esfanjani</surname> <given-names>R</given-names></name> <name><surname>Soleimanpour</surname> <given-names>H</given-names></name></person-group>. <article-title>Evaluation of overcrowding of emergency Department in Imam Reza Hospital in 2015 by implementing 2 scales: NEDOCS and EDWIN</article-title>. <source>Iran Red Crescent Med J</source>. (<year>2017</year>). <volume>19</volume> <comment>Available at:</comment> <ext-link xlink:href="http://ircmj.com/en/articles/15609.html" ext-link-type="uri">http://ircmj.com/en/articles/15609.html</ext-link></citation></ref>
<ref id="ref29"><label>29.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Van Der Linden</surname> <given-names>MC</given-names></name> <name><surname>Van Loon</surname> <given-names>M</given-names></name> <name><surname>Gaakeer</surname> <given-names>MI</given-names></name> <name><surname>Richards</surname> <given-names>JR</given-names></name> <name><surname>Derlet</surname> <given-names>RW</given-names></name> <name><surname>Van Der Linden</surname> <given-names>N</given-names></name></person-group>. <article-title>A different crowd, a different crowding level? The predefined thresholds of crowding scales may not be optimal for all emergency departments</article-title>. <source>Int Emerg Nurs</source>. (<year>2018</year>) <volume>41</volume>:<fpage>25</fpage>&#x2013;<lpage>30</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.ienj.2018.05.004</pub-id>, PMID: <pub-id pub-id-type="pmid">29880260</pub-id></citation></ref>
<ref id="ref30"><label>30.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wretborn</surname> <given-names>J</given-names></name> <name><surname>Henricson</surname> <given-names>J</given-names></name> <name><surname>Ekelund</surname> <given-names>U</given-names></name> <name><surname>Wilhelms</surname> <given-names>DB</given-names></name></person-group>. <article-title>Prevalence of crowding, boarding and staffing levels in Swedish emergency departments - a National Cross Sectional Study</article-title>. <source>BMC Emerg Med</source>. (<year>2020</year>) <volume>20</volume>:<fpage>50</fpage>. doi: <pub-id pub-id-type="doi">10.1186/s12873-020-00342-x</pub-id>, PMID: <pub-id pub-id-type="pmid">32552701</pub-id></citation></ref>
<ref id="ref31"><label>31.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Goldsbury</surname> <given-names>DE</given-names></name> <name><surname>O&#x2019;Connell</surname> <given-names>DL</given-names></name> <name><surname>Girgis</surname> <given-names>A</given-names></name> <name><surname>Wilkinson</surname> <given-names>A</given-names></name> <name><surname>Phillips</surname> <given-names>JL</given-names></name> <name><surname>Davidson</surname> <given-names>PM</given-names></name> <etal/></person-group>. <article-title>Acute hospital-based services used by adults during the last year of life in New South Wales, Australia: a population-based retrospective cohort study</article-title>. <source>BMC Health Serv Res</source>. (<year>2015</year>) <volume>15</volume>:<fpage>537</fpage>. doi: <pub-id pub-id-type="doi">10.1186/s12913-015-1202-8</pub-id>, PMID: <pub-id pub-id-type="pmid">26637373</pub-id></citation></ref>
<ref id="ref32"><label>32.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Henson</surname> <given-names>LA</given-names></name> <name><surname>Gao</surname> <given-names>W</given-names></name> <name><surname>Higginson</surname> <given-names>IJ</given-names></name> <name><surname>Smith</surname> <given-names>M</given-names></name> <name><surname>Davies</surname> <given-names>JM</given-names></name> <name><surname>Ellis-Smith</surname> <given-names>C</given-names></name> <etal/></person-group>. <article-title>Emergency department attendance by patients with cancer in their last month of life: a systematic review and meta-analysis</article-title>. <source>J Clin Oncol</source>. (<year>2015</year>) <volume>33</volume>:<fpage>370</fpage>&#x2013;<lpage>6</lpage>. doi: <pub-id pub-id-type="doi">10.1200/JCO.2014.57.3568</pub-id>, PMID: <pub-id pub-id-type="pmid">25534384</pub-id></citation></ref>
<ref id="ref33"><label>33.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bone</surname> <given-names>AE</given-names></name> <name><surname>Evans</surname> <given-names>CJ</given-names></name> <name><surname>Etkind</surname> <given-names>SN</given-names></name> <name><surname>Sleeman</surname> <given-names>KE</given-names></name> <name><surname>Gomes</surname> <given-names>B</given-names></name> <name><surname>Aldridge</surname> <given-names>M</given-names></name> <etal/></person-group>. <article-title>Factors associated with older people&#x2019;s emergency department attendance towards the end of life: a systematic review</article-title>. <source>Eur J Public Health</source>. (<year>2019</year>) <volume>29</volume>:<fpage>67</fpage>&#x2013;<lpage>74</lpage>. doi: <pub-id pub-id-type="doi">10.1093/eurpub/cky241</pub-id>, PMID: <pub-id pub-id-type="pmid">30481305</pub-id></citation></ref>
<ref id="ref34"><label>34.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Richardson</surname> <given-names>DB</given-names></name></person-group>. <article-title>Access block in Australian emergency departments 2017-2020</article-title>. <source>Emerg Med Australas</source>. (<year>2021</year>) <volume>33</volume>:<fpage>529</fpage>&#x2013;<lpage>33</lpage>. doi: <pub-id pub-id-type="doi">10.1111/1742-6723.13738</pub-id>, PMID: <pub-id pub-id-type="pmid">33501766</pub-id></citation></ref>
<ref id="ref35"><label>35.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wretborn</surname> <given-names>J</given-names></name> <name><surname>Ekelund</surname> <given-names>U</given-names></name> <name><surname>Wilhelms</surname> <given-names>DB</given-names></name></person-group>. <article-title>Emergency department workload and crowding during a major electronic health record breakdown</article-title>. <source>Front Public Health</source>. (<year>2019</year>) <volume>7</volume>:<fpage>267</fpage>. doi: <pub-id pub-id-type="doi">10.3389/fpubh.2019.00267</pub-id>, PMID: <pub-id pub-id-type="pmid">31572707</pub-id></citation></ref>
<ref id="ref36"><label>36.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schull</surname> <given-names>MJ</given-names></name> <name><surname>Szalai</surname> <given-names>JP</given-names></name> <name><surname>Schwartz</surname> <given-names>B</given-names></name> <name><surname>Redelmeier</surname> <given-names>DA</given-names></name></person-group>. <article-title>Emergency department overcrowding following systematic hospital restructuring: trends at twenty hospitals over ten years</article-title>. <source>Acad Emerg Med</source>. (<year>2001</year>) <volume>8</volume>:<fpage>1037</fpage>&#x2013;<lpage>43</lpage>. doi: <pub-id pub-id-type="doi">10.1111/j.1553-2712.2001.tb01112.x</pub-id></citation></ref>
</ref-list>
<glossary>
<def-list>
<title>Abbreviations</title>
<def-item><term>ED</term><def><p>Emergency Department</p></def></def-item>
<def-item><term>NEDOCS</term><def><p>National Emergency Department Overcrowding Score</p></def></def-item>
<def-item><term>ICMED</term><def><p>International Crowding Metric in Emergency Department</p></def></def-item>
<def-item><term>EDWIN</term><def><p>Emergency Department Work Index</p></def></def-item>
<def-item><term>mSEAL</term><def><p>modified Swedish Emergency Department Assessment of Patient Load</p></def></def-item>
<def-item><term>EMS</term><def><p>Emergency Medical Services</p></def></def-item>
<def-item><term>LOS</term><def><p>Length of Stay</p></def></def-item>
<def-item><term>HR</term><def><p>Hazard Ratio</p></def></def-item>
</def-list>
</glossary>
</back>
</article>
