<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Pharmacol.</journal-id>
<journal-title>Frontiers in Pharmacology</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Pharmacol.</abbrev-journal-title>
<issn pub-type="epub">1663-9812</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fphar.2017.00568</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Pharmacology</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Time Investment in Drug Supply Problems by Flemish Community Pharmacies</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>De Weerdt</surname> <given-names>Elfi</given-names></name>
<xref ref-type="author-notes" rid="fn001"><sup>&#x002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/277989/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Simoens</surname> <given-names>Steven</given-names></name>
</contrib>
<contrib contrib-type="author">
<name><surname>Casteels</surname> <given-names>Minne</given-names></name>
</contrib>
<contrib contrib-type="author">
<name><surname>Huys</surname> <given-names>Isabelle</given-names></name>
<uri xlink:href="http://loop.frontiersin.org/people/348031/overview"/>
</contrib>
</contrib-group>
<aff><institution>Clinical Pharmacology and Pharmacotherapy, Department of Pharmaceutical and Pharmacological Sciences, KU Leuven</institution> <country>Leuven, Belgium</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: <italic>Liset Van Dijk, Netherlands Institute for Health Services Research, Netherlands</italic></p></fn>
<fn fn-type="edited-by"><p>Reviewed by: <italic>Sandor Kerpel-Fronius, Semmelweis University, Hungary; Domenico Criscuolo, Genovax, Italy</italic></p></fn>
<fn fn-type="corresp" id="fn001"><p>&#x002A;Correspondence: <italic>Elfi De Weerdt, <email>elfi.deweerdt@kuleuven.be</email></italic></p></fn>
<fn fn-type="other" id="fn002"><p>This article was submitted to Pharmaceutical Medicine and Outcomes Research, a section of the journal Frontiers in Pharmacology</p></fn></author-notes>
<pub-date pub-type="epub">
<day>23</day>
<month>08</month>
<year>2017</year>
</pub-date>
<pub-date pub-type="collection">
<year>2017</year>
</pub-date>
<volume>8</volume>
<elocation-id>568</elocation-id>
<history>
<date date-type="received">
<day>26</day>
<month>06</month>
<year>2017</year>
</date>
<date date-type="accepted">
<day>09</day>
<month>08</month>
<year>2017</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x00A9; 2017 De Weerdt, Simoens, Casteels and Huys.</copyright-statement>
<copyright-year>2017</copyright-year>
<copyright-holder>De Weerdt, Simoens, Casteels and Huys</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract>
<p><bold>Introduction:</bold> Drug supply problems are a known problem for pharmacies. Community and hospital pharmacies do everything they can to minimize impact on patients. This study aims to quantify the time spent by Flemish community pharmacies on drug supply problems.</p>
<p><bold>Materials and Methods:</bold> During 18 weeks, employees of 25 community pharmacies filled in a template with the total time spent on drug supply problems. The template stated all the steps community pharmacies could undertake to manage drug supply problems.</p>
<p><bold>Results:</bold> Considering the median over the study period, the median time spent on drug supply problems was 25 min per week, with a minimum of 14 min per week and a maximum of 38 min per week. After calculating the median of each pharmacy, large differences were observed between pharmacies: about 25% spent less than 15 min per week and one-fifth spent more than 1 h per week. The steps on which community pharmacists spent most time are: (i) &#x201C;check missing products from orders,&#x201D; (ii) &#x201C;contact wholesaler/manufacturers regarding potential drug shortages,&#x201D; and (iii) &#x201C;communicating to patients.&#x201D; These three steps account for about 50% of the total time spent on drug supply problems during the study period.</p>
<p><bold>Conclusion:</bold> Community pharmacies spend about half an hour per week on drug supply problems. Although 25 min per week does not seem that much, the time spent is not delineated and community pharmacists are constantly confronted with drug supply problems.</p>
</abstract>
<kwd-group>
<kwd>drug shortages</kwd>
<kwd>drug supply problems</kwd>
<kwd>community pharmacies</kwd>
<kwd>time investment</kwd>
<kwd>time and motion study</kwd>
</kwd-group>
<counts>
<fig-count count="4"/>
<table-count count="1"/>
<equation-count count="0"/>
<ref-count count="38"/>
<page-count count="8"/>
<word-count count="0"/>
</counts>
</article-meta>
</front>
<body>
<sec><title>Introduction</title>
<p>Shortages of &#x201C;human medicinal products&#x201D;, later referred to as &#x201C;drug&#x201D; shortages, are no longer a new phenomenon (<xref ref-type="bibr" rid="B3">Baumer et al., 2004</xref>; <xref ref-type="bibr" rid="B18">Fox et al., 2009</xref>; <xref ref-type="bibr" rid="B28">Pharmaceutical Group of the European Union, 2012</xref>; <xref ref-type="bibr" rid="B6">Collins, 2013</xref>; <xref ref-type="bibr" rid="B14">European Association of Hospital Pharmacists, 2014</xref>; <xref ref-type="bibr" rid="B10">De Weerdt et al., 2015a</xref>, <xref ref-type="bibr" rid="B9">2017</xref>; <xref ref-type="bibr" rid="B27">Pauwels et al., 2015</xref>). Different wordings are used to describe drug supply problems and additional different interpretations are perceived when discussing drug shortages (<xref ref-type="bibr" rid="B11">De Weerdt et al., 2015b</xref>). In this paper, the wording &#x201C;drug supply problem&#x201D; is used, a term that covers &#x201C;drug supply disruptions&#x201D; (i.e., when the supply of drugs does not meet the demand at the level of pharmacies and wholesalers) and &#x201C;drug shortages&#x201D; (i.e., when the supply of drugs does not meet the demand at consumer/patient level).</p>
<p>Various causes of drug supply problems are described in literature (<xref ref-type="bibr" rid="B15">European Medicines Agency, 2012</xref>; <xref ref-type="bibr" rid="B2">Barlas, 2013</xref>; <xref ref-type="bibr" rid="B5">Birgli<sup>&#x00AE;</sup>, 2013</xref>; <xref ref-type="bibr" rid="B19">Gupta and Huang, 2013</xref>; <xref ref-type="bibr" rid="B12">De Weerdt et al., 2015c</xref>). Reputational damage, economic and health implications, increased workload are just a few examples on how drug supply problems affect different stakeholders in the supply chain of delivering the medicinal products to patients (<xref ref-type="bibr" rid="B18">Fox et al., 2009</xref>; <xref ref-type="bibr" rid="B21">IMS, 2011</xref>; <xref ref-type="bibr" rid="B22">Kaakeh et al., 2011</xref>; <xref ref-type="bibr" rid="B36">Ventola, 2011</xref>; <xref ref-type="bibr" rid="B20">Havrilesky et al., 2012</xref>; <xref ref-type="bibr" rid="B26">Metzger et al., 2012</xref>; <xref ref-type="bibr" rid="B28">Pharmaceutical Group of the European Union, 2012</xref>; <xref ref-type="bibr" rid="B1">APB, 2015</xref>; <xref ref-type="bibr" rid="B9">De Weerdt et al., 2017</xref>).</p>
<p><bold>Figure <xref ref-type="fig" rid="F1">1</xref></bold> displays a simplified supply chain for human medicinal products in Belgium. Two types of wholesalers exist in Belgium: (i) general wholesalers and (ii) full-line wholesalers. Full-line wholesalers, in contrast to general wholesalers, have several obligations and rights. For example, full-line wholesalers have the right to be supplied by the pharmaceutical companies. In turn, full-line wholesalers have the obligation to supply community pharmacies and to have a stock of two-third of all medicines available in Belgium (art 101) (<xref ref-type="bibr" rid="B29">Royal Decree Concerning Medicines for Humand and Veterinary Use, 2006</xref>).</p>
<fig id="F1" position="float">
<label>FIGURE 1</label>
<caption><p>Supply chain of manufacturing and delivering human medicinal products. API = Active Pharmaceutical Ingredient; - - - - - = only a small part of the total products ordered by hospital pharmacies are ordered via wholesalers.</p></caption>
<graphic xlink:href="fphar-08-00568-g001.tif"/>
</fig>
<p>In Belgium (including Flanders) hospital pharmacies order the majority of their products directly from the manufacturer. Only a small number of products available in hospital pharmacies are ordered by full-line wholesalers. Community pharmacies, on the other hand, must order their products via wholesalers (art 3) (<xref ref-type="bibr" rid="B4">Belgian Law on Medicines, 1964</xref>). Most frequently, a community pharmacy co-operates with one main full-line wholesaler and one back-up full-line wholesaler. In Belgium, a distinction is made between private and cooperative community pharmacies. Cooperative pharmacies engage for the purchase and distribution of medicinal products, resulting in mutual benefits for the pharmacies and patients. Due to the cooperation, pharmacies are able to exchange medicinal products between cooperative pharmacies within the same cooperation, which may be very beneficial for patients in case of short-term supply disruptions.</p>
<p>According to previous papers, European community pharmacies spend a lot of time on managing drug supply problems to avoid patients&#x2019; impact (<xref ref-type="bibr" rid="B6">Collins, 2013</xref>; <xref ref-type="bibr" rid="B1">APB, 2015</xref>; <xref ref-type="bibr" rid="B8">De Boer et al., 2015</xref>). At European level, a survey concludes that community pharmacists spend between 3 and 15 h a month on drug shortages (<xref ref-type="bibr" rid="B28">Pharmaceutical Group of the European Union, 2012</xref>; <xref ref-type="bibr" rid="B25">Medicine Shortages, 2016</xref>). Results of a previous questionnaire in the United Kingdom indicate a time spent of less than 1 h to more than 10 h per week on drug supply problems (<xref ref-type="bibr" rid="B6">Collins, 2013</xref>). However, it remains unclear which step in the management process consumes most time. Therefore, the aim of this study is to quantify the time employees of Flemish community pharmacies spend on drug supply problems as well as to investigate in detail which steps are most time consuming. In this way, sustainable measures can be formulated to mitigate the problem of drug supply problems.</p>
</sec>
<sec id="s1" sec-type="materials|methods">
<title>Materials and Methods</title>
<sec><title>Study Design</title>
<p>Time spent by employees of Flemish community pharmacies was studied through a time-and-motion study, which is a non-interventional descriptive study (<xref ref-type="bibr" rid="B38">Zheng et al., 2011</xref>). Employees of the community pharmacies were asked to register all the time they spent on managing supply disruptions and drug shortages. Approval for this study was received from the Ethics Committee of the University Hospitals Leuven (S58539).</p>
<p>In Belgium, community pharmacies are obliged to order their medicinal products from wholesalers (art. 3) (<xref ref-type="bibr" rid="B4">Belgian Law on Medicines, 1964</xref>). Most community pharmacies have one main full-line wholesaler and one back up full-line wholesaler. If supply problems are experienced for a product, community pharmacies can contact other wholesalers to purchase the particular product or a substitute after consultation with the prescribing healthcare professional (art. 3 and art. 31) (<xref ref-type="bibr" rid="B17">Federale Overheidsdienst Justitie, 1967</xref>; <xref ref-type="bibr" rid="B7">Coordinated Law Concerning the Practice of Health Care Professions, 2015</xref>). Only when a supply disruption is the result of quota, community pharmacists can contact the manufacturer to purchase the product (art. 12) (<xref ref-type="bibr" rid="B4">Belgian Law on Medicines, 1964</xref>). Pharmaceutical industry introduced quota to avoid parallel export. Quota are precisely calculated amounts based on the needs of the Belgian population, including a small margin to ensure continued supply and avoid surpluses to limit parallel export (<xref ref-type="bibr" rid="B32">Sapentis, 2013</xref>; <xref ref-type="bibr" rid="B12">De Weerdt et al., 2015c</xref>).</p>
<p>Substitution of medicinal products is only allowed when the prescription states the international non-proprietary name (INN) (art. 3 and art. 31) (<xref ref-type="bibr" rid="B17">Federale Overheidsdienst Justitie, 1967</xref>; <xref ref-type="bibr" rid="B7">Coordinated Law Concerning the Practice of Health Care Professions, 2015</xref>), or if the prescription concerns antibiotics or antimycotics for short-term use. If the Belgian market has no therapeutic alternatives available, community pharmacists can order a substitute abroad. However, this is only possible for prescription medicinal products and if a statement of a healthcare professional is obtained (art. 14) (<xref ref-type="bibr" rid="B30">Royal Decree Regarding Instructions for Pharmacists, 2009</xref>). Foreign therapeutic alternative medicinal products are not always considered for reimbursement.</p>
<p>Through a convenience sample of pharmacists in the region of Leuven, three exploratory interviews were conducted to draft a template containing the different steps a community pharmacist and his personnel can undertake to manage drug supply disruptions. The interviews were based on a template from a previous study on time spent on drug supply problems in hospital pharmacies (<xref ref-type="bibr" rid="B9">De Weerdt et al., 2017</xref>). Six randomly selected community pharmacies validated the template. Minor improvements were implemented and consensus on this final draft was achieved. An English version of the template is presented in <bold>Table <xref ref-type="table" rid="T1">1</xref></bold>. The template is divided in three sections: (i) time spent on collecting information regarding the supply problem, (ii) time spent on obtaining a substitute, and (iii) time spent on settling the supply problem.</p>
<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption><p>Template to report time spent on drug supply problems.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<td valign="top" align="left"></td>
<th valign="top" align="left">Pharmacist (min)</th>
<th valign="top" align="left">Pharmacy technicians (min)</th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Collecting information about drug shortages</td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
</tr>
<tr>
<td valign="top" align="left">Check missing products from order</td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
</tr>
<tr>
<td valign="top" align="left">Contact wholesaler or manufacturer regarding possible drug supply problem</td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
</tr>
<tr>
<td valign="top" align="left">Check stock to see if a drug shortage can cause a problem</td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
</tr>
<tr>
<td valign="top" align="left">Check if there is a generic or biosimilar available in the pharmacy</td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
</tr>
<tr>
<td valign="top" align="left">Check if there is an alternative treatment available in the pharmacy</td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
</tr>
<tr>
<td valign="top" align="left">Contact and consult with prescribing medical doctor</td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
</tr>
<tr>
<td valign="top" align="left">Pharmaceutical compounding at pharmacy</td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
</tr>
<tr>
<td valign="top" align="left">Contact wholesaler or manufacturer to place order</td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
</tr>
<tr>
<td valign="top" align="left">Contact other pharmacies</td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
</tr>
<tr>
<td valign="top" align="left">Contact international pharmacy to order drugs from abroad</td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
</tr>
<tr>
<td valign="top" align="left">Set consumer price for drugs from abroad</td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
</tr>
<tr>
<td valign="top" align="left">Communication with other colleagues</td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
</tr>
<tr>
<td valign="top" align="left">Communication with patients</td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
</tr>
<tr>
<td valign="top" align="left">Adjusting medication schedule</td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
</tr>
<tr>
<td valign="top" align="left">Other: &#x2026;&#x2026;&#x2026;&#x2026;&#x2026;&#x2026;&#x2026;&#x2026;&#x2026;</td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td></tr>
</tbody>
</table>
</table-wrap>
<p>Time spent for drug supply problems was measured. In this study, the wording &#x201C;drug supply problems&#x201D; covers &#x201C;drug supply disruptions&#x201D; and &#x201C;drug shortages.&#x201D; A &#x201C;supply disruption&#x201D; was defined as &#x201C;when the supply of a standard product is interrupted,&#x201D; meaning the time spent on quota was also included in this study. However, this &#x201C;supply disruption&#x201D; does not necessarily lead to a drug shortage in the community pharmacy. A &#x201C;drug shortage&#x201D; was defined as a &#x201C;supply problem which leads to changing the standard therapy into a substituted therapy.&#x201D; A substituted therapy could be a substitution between generic or biosimilar medicines, changing to an alternative therapy or postpone the therapy if no substitute was available.</p>
<p>Blank templates for daily reporting during the study period were assembled in a map. The template needed to be filled in daily with the total time spent on supply problems, hence not specific per supply problem.</p>
</sec>
<sec><title>Sample Size Calculation</title>
<p>To obtain a representative sample size, the Association of Belgian Pharmacists (ABP) provided the numbers of the distribution of private community pharmacies in Flanders. The sample size was calculated considering: (i) the ratio private and cooperative pharmacies in Belgium; (ii) distribution of private community pharmacies in Flanders; (iii) a response rate of 20%; and (iv) the desired number of 35 participating community pharmacies (30 private community pharmacies and five cooperative). Based on these figures, the authors asked ABP to provide a list of 150 randomly selected private community pharmacies. At the beginning of November 2015, an invitation was sent to the 150 private community pharmacies with the request to participate in this study. Due to a low response rate, pharmacists who did not respond within 1 week were contacted in order to reach the desired number of 30 participating private community pharmacies.</p>
<p>Cooperative community pharmacies were gathered through Ophaco (association of cooperative pharmacies in Belgium). The invitation letter was posted on the intranet website of Ophaco. However, since there was no response to the intranet message, cooperative pharmacists were randomly selected and contacted by telephone to ask whether they would like to participate in the study. Eventually five cooperative community pharmacies consented to participate in the study.</p>
</sec>
<sec><title>Data Collection</title>
<p>The study started on November 30, 2015 and ended April 3, 2016. Participating pharmacists were contacted for a kick-off meeting before the start of the study for the provision of further information about the study and to deliver the map, containing the templates for all days during the study period as well as templates for 1 week before the study period. This extra week was added in order to familiarize the employees of the pharmacies with the reporting system; if they encountered difficulties, these could be solved before the study period.</p>
<p>Completed templates were collected twice. In February 2016, templates from November 2015 until January 2016 were collected and the remaining templates were collected after the study ended, in April 2016. In March 2016, additional information which might be useful for the analysis of the results was gathered through a questionnaire. This additional information included questions on the location of the pharmacy, the number of patients visiting the pharmacy per day, the number of prescriptions dispensed per day, the stock management and the number of employees. The questionnaires were collected during the last visit. Community pharmacies contributed voluntarily and were not remunerated.</p>
</sec>
<sec><title>Data Analysis</title>
<p>The time spent per week on each action to manage drug supply problems was collected in a database (Microsoft Excel 2013). Primary, descriptive analysis was performed due to a relatively small sample size. Medians and interquartile ranges (IQR) were used to express the variables, as the variables were not normally distributed. To control for potential correlation factors, the Pearson correlation was calculated.</p>
<p>Some of the steps as stated in the template (see <bold>Table <xref ref-type="table" rid="T1">1</xref></bold>) were grouped under a common denominator. Under &#x201C;gathering information&#x201D; the following steps were considered: (i) check missing products from order; (ii) contact wholesaler or manufacturer regarding possible drug shortage; and (iii) collecting information about drug shortages. Under &#x201C;search alternative treatment&#x201D; the following steps were considered: (i) contact and consult with prescribing medical doctor; (ii) check if there is a generic or biosimilar available in the pharmacy; and (iii) check if there is an alternative treatment available in the pharmacy. &#x201C;Ordering alternative treatment&#x201D; contains: (i) contact wholesaler or manufacturer to place order; (ii) contact other pharmacies; and (iii) contact international pharmacy to order drugs from abroad. &#x201C;Communication with patients&#x201D; and &#x201C;communication with other colleagues&#x201D; were combined as &#x201C;communication toward patients and colleagues.&#x201D;</p>
<p>Community pharmacies were excluded if they admitted or self-reported not to fill in the templates correctly. Preliminary results were shared with the participating community pharmacies via email and employees of the pharmacy were asked to validate the observed results and trends through a questionnaire.</p>
<p>After a preliminary analysis of the data on the time spent on drug supply problems, community pharmacists were asked to validate the observed results and trends through email.</p>
</sec>
</sec>
<sec><title>Results</title>
<p>A total of 35 community pharmacies started the study (about 1.33% of the Flemish community pharmacies), including 30 private community pharmacies and five cooperative community pharmacies. Eventually, 25 (i.e., 23 private and 2 cooperative community pharmacies) were retained for further analysis, which represents about 0.95% of the Flemish community pharmacies. Six community pharmacies dropped out and four community pharmacies were excluded based upon the exclusion criteria.</p>
<p>The starting sample (<italic>N</italic> = 35) and the final 25 pharmacies are representative to the Flemish situation in terms of the geographical distribution. Concerning the type of pharmacies, an underrepresentation is detected for cooperative community pharmacies. In 7 of the 25 community pharmacies included, only one pharmacist is employed. In 11 community pharmacies, the number of full time equivalent (FTE) pharmacists employed range from 1.25 to 2. Six pharmacies employ three FTE pharmacists and only one participating community pharmacy employ five FTE pharmacists.</p>
<p><bold>Figure <xref ref-type="fig" rid="F2">2</xref></bold> represents the median time spent by the 25 community pharmacies, together with its IQR. The median time spent by the personnel of a community pharmacy on drug supply problems is 25 min per week, with a minimum of 14 min and a maximum of 38 min per week. The majority of the participating community pharmacists confirms our result, about six pharmacists argue that 25 min per week is too low. The minimum is observed in the week of Christmas (December 21, 2015) and community pharmacists attributed this minimum to more closing days during this period. The maximum of 38 min is observed in the second week of February. According to the participants, this can be explained due to an increase of ill persons or by certain drug shortages which required an increased time investment. This increased time investment is detected, among others, in an increase of communication with patients, informing them about the drug supply problem.</p>
<fig id="F2" position="float">
<label>FIGURE 2</label>
<caption><p>Median (IQR) time spent (in min) per week on supply problems by community pharmacies in Flanders (<italic>N</italic> = 25). &#x00B0; = outlier [1.5 IQR &#x2013; 3 IQR]; <sup>&#x2217;</sup> = extreme (>3 IQR).</p></caption>
<graphic xlink:href="fphar-08-00568-g002.tif"/>
</fig>
<p>In <bold>Figure <xref ref-type="fig" rid="F2">2</xref></bold>, several outliers are observed. These outliers represent great differences among the community pharmacies. As displayed in <bold>Figure <xref ref-type="fig" rid="F3">3</xref></bold>, enormous differences in the reported times are observed among the 25 community pharmacies. The number of community pharmacies who spend on average less than 15 min per week practically equals the number of community pharmacies who spend more than 60 min per week on drug supply problems. About one-third of the community pharmacies spend on average between 15 and 30 min per week on drug supply problems.</p>
<fig id="F3" position="float">
<label>FIGURE 3</label>
<caption><p>Distribution of community pharmacies (<italic>N</italic> = 25) based on the average time spent on drug supply problems in minutes per week.</p></caption>
<graphic xlink:href="fphar-08-00568-g003.tif"/>
</fig>
<p>Several aspects of a community pharmacy are considered as potential confounding factors, e.g., the number of patients helped per day, the number of prescriptions dispensed per day, the location of the community pharmacy and the stock management. However, no correlation is found between the total time spent by the community pharmacies and any of these factors (<italic>p</italic> > 0.5).</p>
<p>The most time consuming step is gathering information on drug supply problems, which corresponds to almost half of the total time spent by community pharmacists (<bold>Figure <xref ref-type="fig" rid="F4">4</xref></bold>). This step includes checking the orders for missing products, contacting wholesalers and manufacturers and collecting more information on drug shortages via the website of the Federal Agency of Medicines and Health Products (FAMHP). The second most time consuming step is the communication toward patients and colleagues. Patients do not always understand why their product is in shortage and thus why they need to switch to a substitute. Ordering this substitute at another wholesaler or in case of quota at the manufacturer was the third most time consuming step.</p>
<fig id="F4" position="float">
<label>FIGURE 4</label>
<caption><p>Time spent (% of total time spent) on steps to manage drug supply problems by Flemish community pharmacies.</p></caption>
<graphic xlink:href="fphar-08-00568-g004.tif"/>
</fig>
<p>Most of the time spent on managing drug supply problems is executed by the pharmacist himself (95%). The remaining 5% of the total time spent is accomplished by the pharmacy technician. It should be noticed that only 11 of the 25 community pharmacies have a pharmacy technician employed. Pharmacy technicians spend most of their time on contacting the wholesaler or manufacturer to receive more information on supply disruptions. Communication toward patients regarding the drug supply problems is the second most time consuming step for pharmacy technicians.</p>
</sec>
<sec><title>Discussion</title>
<p>Flemish community pharmacies spend about 25 min on drug supply problems, with a minimum of 14 and a maximum of 38 min per week. The most time consuming step is searching for information on drug supply problems, which corresponds with almost half of the total time spent on managing drug supply problems.</p>
<p>The median time spent on drug supply problems by community pharmacies is much lower than previously reported (<xref ref-type="bibr" rid="B28">Pharmaceutical Group of the European Union, 2012</xref>; <xref ref-type="bibr" rid="B6">Collins, 2013</xref>). Previous research reveals a range on the time spent by United Kingdom community pharmacists going from less than 1 h a week to more than 10 h per week on managing drug shortages (<xref ref-type="bibr" rid="B6">Collins, 2013</xref>). However, of the 371 respondents, only 10% spend less than 1 h on drug shortages. Diverse explanations can clarify the observed difference with our result. First, differences in the applied research methodologies and semantics can result in differences in the time spent on drug shortages. A survey is often more subjective and therefore the result is probably an overestimation, while our study tries to be more objective. Second, national differences in the supply chain of community pharmacies might influence the time spent on drug supply problems.</p>
<p>In the United Kingdom, there are two main supply chains. The first one is similar to the Belgian supply chain (pharmaceutical industry to wholesalers and wholesalers to pharmacies). The second possibility to supply medicines in the United Kingdom is by pharmaceutical industry selling directly to pharmacies (DTP) and paying distributors or wholesalers a fixed fee for delivery (<xref ref-type="bibr" rid="B33">The Association of the British Pharmaceutical Industry [ABPI], 2017</xref>). Since the introduction of DTP-model, pharmacists spend apparently a lot more time on sourcing drugs, especially in comparison with the other &#x201C;standard&#x201D; supply chain (<xref ref-type="bibr" rid="B23">Kermani, 2010</xref>; <xref ref-type="bibr" rid="B35">The Pharmaceutical Journal, 2010</xref>). An important strength of the Belgian &#x201C;standard&#x201D; supply chain is that full-line wholesalers have medicinal products available of different pharmaceutical manufacturers. The DTP-model complicates the search toward generic or alternative medicines, which might result in an increased amount of time spent by community pharmacies in case of drug supply problems. However, more in-depth research is necessary to investigate the influence of the supply chain on the time spent by pharmacists on drug supply problems.</p>
<p>The time community pharmacists spend on drug supply problems (&#x00B1;25 min per week) also largely differs from the time spent by hospital pharmacists (&#x00B1;2 h per week) (<xref ref-type="bibr" rid="B9">De Weerdt et al., 2017</xref>). There are two important factors which can explain this difference: (i) the supply chain of pharmacies (see <bold>Figure <xref ref-type="fig" rid="F1">1</xref></bold>) and (ii) the amount of products ordered. In Belgium, most hospital pharmacies order their products directly from the manufacturer and are mostly bound to tender-contracts. The size of the order in combination with limitations due to the contract complicates ordering the product with other manufacturers for hospital pharmacies. Community pharmacies, on the other hand, order their products from wholesalers. Smaller orders and the possibility of easily switching between full-line wholesalers for ordering generic or alternative medicines can clarify the observed difference between the time spent by hospital pharmacies and community pharmacies.</p>
<p>About 90% of the total time spent on drug supply problems is spent by the community pharmacist himself. Taken into account that seven community pharmacies employ only one pharmacist, a median time spent of 25 min per week on drug shortages, can be experienced as a real problem for such pharmacies. Especially since the time spent on drug supply problems is not delineated, but rather a constant reminder of the problem.</p>
<p>The study design has several advantages. By using self-reporting methodology, a relatively high number of community pharmacies could participate in the study (<xref ref-type="bibr" rid="B13">Emmerton and Jefferson, 1996</xref>; <xref ref-type="bibr" rid="B31">Rutter et al., 1998</xref>). Secondly, our results are based on the time spent by 25 private and cooperative community pharmacies. Thirdly, since drug supply problems vary over time, the widespread study period of 18 weeks is another advantage. However, on the other hand, this study period does not allow observing yearly fluctuations. A fourth bonus of this study consists of the profound way the issue of drug supply problems has been studied, which resulted in suggesting targeted measures (see further) to mitigate the problem.</p>
<sec><title>Study Limitations</title>
<p>Despite its advantages, this study has also its limitations. Six community pharmacies dropped out of the study because it was too time consuming, four other community pharmacies were excluded based on the exclusion criteria. There is a risk that also other community pharmacies experienced similar problems, but did not admit resulting in an underestimation of the total time spent on drug supply problems.</p>
<p>Participants might have experienced their contribution as troublesome and time-consuming, leading to a risk of underreporting, especially when participants are burdened with work (<xref ref-type="bibr" rid="B13">Emmerton and Jefferson, 1996</xref>; <xref ref-type="bibr" rid="B31">Rutter et al., 1998</xref>). When validating our results, some participating pharmacists admitted they sometimes forgot to fill in the templates correctly and therefore the median time spent on drug supply problems is an underestimation.</p>
<p>Different interpretation of the wording used in the template should be considered as a third limitation of the study. This can result in inaccurate reporting of the time spent between the different steps. However, the total time spent on drug supply problems by community pharmacists will remain the same.</p>
<p>Our study suffers from a limited sample size of 25 community pharmacies. Since the templates were filled in manually and subsequently transferred manually to an Excel database, the sample size was restricted to guarantee the feasibility of the study. Additionally, the response rate was very low, as explained above, which resulted in originally 35 participating community pharmacies from which 10 dropped out or were excluded.</p>
<p>Although our sample is representative of the population of pharmacies in Belgium, no statistical formulae were applied to calculate the sample size or to test hypotheses given that there were no prior data about the time spent on drug supply problems in community pharmacies in Flanders. The data of our exploratory study may be informative for sample size calculations in future studies.</p>
</sec>
<sec><title>Potential Solutions</title>
<p>According to our results, gathering information is the most time consuming step and includes the following steps: (i) checking missing products from order; (ii) contacting wholesaler(s) or manufacturer regarding drug supply problem, and (iii) communication toward patients. Almost half of the total time spent on drug supply problems is spent on finding reliable information about the drug supply problem. By improving the communication between different stakeholders, together with the provision of reliable information about drug supply problems, the total time spent on drug supply problems can be reduced.</p>
<p>Market authorization holders (MAHs) are obliged to report drug shortages to the national competent authorities of the member states of the European Union (Directive 2001/83/EC, art. 23a) (<xref ref-type="bibr" rid="B34">The European Parliament and the Council of the European Union, 2011</xref>). To ensure up to date and reliable information of the current supply problems, reporting systems should be user friendly for all parties (MAHs, national competent authorities, etc.). When MAHs fail to report drug shortages, member states should consider introducing sanctions (e.g., financial penalty). In Belgium, a proposal to introduce such penalties when MAHs do not report appropriately is now discussed (<xref ref-type="bibr" rid="B37">Yoleen Van Camp, 2017</xref>).</p>
<p>In Belgium, the FAMHP publishes daily a list of the reported drug shortages on their website (<xref ref-type="bibr" rid="B16">Federaal Agentschap voor Geneesmiddelen en Gezondheidsproducten, 2014</xref>), but this list contains only drug shortages for which the supply is interrupted for more than 14 days. Drugs subjected to quota are not recorded in this list, however, another website<sup><xref ref-type="fn" rid="fn01">1</xref></sup> publishes a list of drugs which experience supply problems due to quota (<xref ref-type="bibr" rid="B24">Koninklijke Apothekersvereniging van Antwerpen [KAVA], 2009</xref>). Currently, both lists are not user friendly and are therefore not often consulted by pharmacies. Integrating these lists into the software program of pharmacies would be a great help and could reduce the total time spent by community and hospital pharmacies.</p>
<p>Substitution is not allowed by the Belgian legislation, unless for INN prescriptions. Exceptions are made for prescriptions of antibiotics or antimycotics in an acute treatment, and these prescriptions are always considered as INN prescriptions (<xref ref-type="bibr" rid="B17">Federale Overheidsdienst Justitie, 1967</xref>). The legislation on substitution implies that patients with a prescription of a drug experiencing supply problems are informed at the community pharmacy about the shortage. The prescribing physician needs to be contacted by the pharmacist in order to change the prescription, or to be revisited by the patient. Promoting INN prescriptions or allowing substitution in case of shortages are potential solutions to reduce the burden experienced by community pharmacists, prescribing physicians, and patients.</p>
</sec>
</sec>
<sec><title>Conclusion</title>
<p>This study provided exploratory results on the time spent by Flemish community pharmacists on drug supply problems as well as on the most time-consuming tasks within pharmacies. The sample of community pharmacies is relatively small, but representative for the Flemish situation and shows a large variation in the time spent. Though a median of 25 min per week seems not that much, the time spent on drug supply problems is not delineated and community pharmacists are constantly reminded of the problem. Further research in a larger sample of community pharmacies is needed to validate the results of this study. However, improving the provision of information about drug supply problems can reduce the total time spent by pharmacists. Similar results and recommendations were found for Belgian hospital pharmacies (<xref ref-type="bibr" rid="B9">De Weerdt et al., 2017</xref>).</p>
</sec>
<sec><title>Author Contributions</title>
<p>All authors participated in the design of the study. ED performed data collection and analyzed the data and drafted the manuscript. IH, SS, and MC revised the manuscript critically and contributed to the interpretation of the data. All authors read and approved the final manuscript.</p>
</sec>
<sec><title>Conflict of Interest Statement</title>
<p>The work was financially supported by TEVA and the Research Foundation Flanders (FWO). The research was carried out independently by KU Leuven. None of the authors is employed by TEVA. MC is member of the Scientific Advice Working Party at EMA. The other authors declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
</body>
<back>
<fn-group>
<fn fn-type="financial-disclosure">
<p><bold>Funding.</bold> ED is funded by the Research Foundation Flanders (FWO). The study is included in a project supported by Research Foundation Flanders (<ext-link ext-link-type="uri" xlink:href="http://www.fwo.be/en/">http://www.fwo.be/en/</ext-link>). The study is included in a project supported by TEVA. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.</p></fn>
</fn-group>
<ack>
<p>The authors would like to thank all employees of the participating community pharmacies as well as Stefanie D&#x2019;hooge for helping with the data collection.</p>
</ack>
<ref-list>
<title>References</title>
<ref id="B1"><citation citation-type="journal"><collab>APB</collab> (<year>2015</year>). <source><italic>Gecontingenteerd, Onbeschikbaar, Ontbrekend, Niet in Voorraad, De Apotheker Breekt er Dagelijks Zijn Hoofd Over!.</italic></source> <comment>Available at: <ext-link ext-link-type="uri" xlink:href="http://doc.mediplanet.be/pdf/06-AB-juni2015-Focus.pdf">http://doc.mediplanet.be/pdf/06-AB-juni2015-Focus.pdf</ext-link> [accessed March 30, 2017]</comment>.</citation></ref>
<ref id="B2"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Barlas</surname> <given-names>S.</given-names></name></person-group> (<year>2013</year>). <article-title>FDA strategies to prevent and respond to drug shortages.</article-title> <source><italic>Pharm. Ther.</italic></source> <volume>38</volume> <fpage>261</fpage>&#x2013;<lpage>263</lpage>.</citation></ref>
<ref id="B3"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Baumer</surname> <given-names>A. M.</given-names></name> <name><surname>Clark</surname> <given-names>A. M.</given-names></name> <name><surname>Witmer</surname> <given-names>D. R.</given-names></name> <name><surname>Geize</surname> <given-names>S. B.</given-names></name> <name><surname>Vermeulen</surname> <given-names>L. C.</given-names></name> <name><surname>Deffenbaugh</surname> <given-names>J. H.</given-names></name></person-group> (<year>2004</year>). <article-title>National survey of the impact of drug shortages in acute care hospitals.</article-title> <source><italic>Am. J. Health. Syst. Pharm.</italic></source> <volume>61</volume> <fpage>2015</fpage>&#x2013;<lpage>2022</lpage>.</citation></ref>
<ref id="B4"><citation citation-type="journal"><collab>Belgian Law on Medicines</collab> (<year>1964</year>). <comment>Available at: <ext-link ext-link-type="uri" xlink:href="http://www.ejustice.just.fgov.be/cgi_loi/change_lg.pl?language=nl&#x0026;la=N&#x0026;cn=1964032530&#x0026;table_name=wet">http://www.ejustice.just.fgov.be/cgi_loi/change_lg.pl?language=nl&#x0026;la=N&#x0026;cn=1964032530&#x0026;table_name=wet</ext-link></comment></citation></ref>
<ref id="B5"><citation citation-type="journal"><collab>Birgli<sup>&#x00AE;</sup></collab> (<year>2013</year>). <source><italic>An Evaluation of Medicines Shortages in Europe with more in-Depth Review of These in France, Greece, Poland, Spain and the United Kingdom.</italic></source> <comment>Available at: <ext-link ext-link-type="uri" xlink:href="http://static.correofarmaceutico.com/docs/2013/10/21/evaluation.pdf">http://static.correofarmaceutico.com/docs/2013/10/21/evaluation.pdf</ext-link>. [accessed June 11, 2017]</comment>.</citation></ref>
<ref id="B6"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Collins</surname> <given-names>G.</given-names></name></person-group> (<year>2013</year>). <source><italic>Medicines Shortages 2013. Chemist+Druggist, 31.</italic></source> <comment>Available at: <ext-link ext-link-type="uri" xlink:href="http://www.pharmacytoday.co.nz/media/592652/c_d_medicines_shortages_report_2013.pdf">http://www.pharmacytoday.co.nz/media/592652/c_d_medicines_shortages_report_2013.pdf</ext-link> [accessed March 13, 2017]</comment>.</citation></ref>
<ref id="B7"><citation citation-type="journal"><collab>Coordinated Law Concerning the Practice of Health Care Professions</collab> (<year>2015</year>). <comment>Available at: <ext-link ext-link-type="uri" xlink:href="http://www.ejustice.just.fgov.be/cgi_loi/change_lg.pl?language=nl&#x0026;la=N&#x0026;cn=2015051006&#x0026;table_name=wet">http://www.ejustice.just.fgov.be/cgi_loi/change_lg.pl?language=nl&#x0026;la=N&#x0026;cn=2015051006&#x0026;table_name=wet</ext-link></comment></citation></ref>
<ref id="B8"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>De Boer</surname> <given-names>A.</given-names></name> <name><surname>De Bekker</surname> <given-names>P.</given-names></name> <name><surname>Oom</surname> <given-names>C.</given-names></name></person-group> (<year>2015</year>). <article-title>Geneesmiddeltekorten zijn flinke kostenpost in farmazorg.</article-title> <source><italic>Pharm. Weekbl.</italic></source> <volume>150</volume> <fpage>12</fpage>&#x2013;<lpage>14</lpage>.</citation></ref>
<ref id="B9"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>De Weerdt</surname> <given-names>E.</given-names></name> <name><surname>De Rijdt</surname> <given-names>T.</given-names></name> <name><surname>Simoens</surname> <given-names>S.</given-names></name> <name><surname>Casteels</surname> <given-names>M.</given-names></name> <name><surname>Huys</surname> <given-names>I.</given-names></name></person-group> (<year>2017</year>). <article-title>Time spent by Belgian hospital pharmacists on supply disruptions and drug shortages: an exploratory study.</article-title> <source><italic>PLoS ONE</italic></source> <volume>12</volume>:<issue>e0174556</issue>. <pub-id pub-id-type="doi">10.1371/journal.pone.0174556</pub-id></citation></ref>
<ref id="B10"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>De Weerdt</surname> <given-names>E.</given-names></name> <name><surname>Pauwels</surname> <given-names>K.</given-names></name> <name><surname>Simoens</surname> <given-names>S.</given-names></name> <name><surname>Huys</surname> <given-names>I.</given-names></name></person-group> (<year>2015a</year>). <source><italic>Belgian Experiences with Drug Shortages.</italic></source> <publisher-loc>Palo Alto, CA</publisher-loc>: <publisher-name>Hewlett Packard Enterprise</publisher-name>.</citation></ref>
<ref id="B11"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>De Weerdt</surname> <given-names>E.</given-names></name> <name><surname>Simoens</surname> <given-names>S.</given-names></name> <name><surname>Casteels</surname> <given-names>M.</given-names></name> <name><surname>Huys</surname> <given-names>I.</given-names></name></person-group> (<year>2015b</year>). <article-title>Toward a European definition for a drug shortage: a qualitative study.</article-title> <source><italic>Front. Pharmacol.</italic></source> <volume>6</volume>:<issue>253</issue>. <pub-id pub-id-type="doi">10.3389/fphar.2015.00253</pub-id></citation></ref>
<ref id="B12"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>De Weerdt</surname> <given-names>E.</given-names></name> <name><surname>Simoens</surname> <given-names>S.</given-names></name> <name><surname>Hombroeckx</surname> <given-names>L.</given-names></name> <name><surname>Casteels</surname> <given-names>M.</given-names></name> <name><surname>Huys</surname> <given-names>I.</given-names></name></person-group> (<year>2015c</year>). <article-title>Causes of drug shortages in the legal pharmaceutical framework.</article-title> <source><italic>Regul. Toxicol. Pharmacol.</italic></source> <volume>71</volume> <fpage>251</fpage>&#x2013;<lpage>258</lpage>. <pub-id pub-id-type="doi">10.1016/j.yrtph.2015.01.005</pub-id></citation></ref>
<ref id="B13"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Emmerton</surname> <given-names>L.</given-names></name> <name><surname>Jefferson</surname> <given-names>K.</given-names></name></person-group> (<year>1996</year>). <article-title>Work sampling observations of community pharmacists: a review.</article-title> <source><italic>Int. J. Pharm. Pract.</italic></source> <volume>4</volume> <fpage>75</fpage>&#x2013;<lpage>78</lpage>. <pub-id pub-id-type="doi">10.1111/j.2042-7174.1996.tb00845.x</pub-id></citation></ref>
<ref id="B14"><citation citation-type="journal"><collab>European Association of Hospital Pharmacists</collab> (<year>2014</year>). <source><italic>Medicines Shortages in European Hospitals - The Evidence and Case for Action.</italic></source> <publisher-loc>Brussels</publisher-loc>: <publisher-name>European Association of Hospital Pharmacists</publisher-name>.</citation></ref>
<ref id="B15"><citation citation-type="journal"><collab>European Medicines Agency</collab> (<year>2012</year>). <source><italic>Reflection Paper on Medicinal Product Supply Shortages Caused by Manufacturing / GMP Compliance Problems.</italic></source> <publisher-loc>London</publisher-loc>: <publisher-name>European Medicines Agency</publisher-name>.</citation></ref>
<ref id="B16"><citation citation-type="journal"><collab>Federaal Agentschap voor Geneesmiddelen en Gezondheidsproducten</collab> (<year>2014</year>). <source><italic>Onbeschikbaarheid - Menselijk gebruik - FAGG.</italic></source> <comment>Available at: <ext-link ext-link-type="uri" xlink:href="http://www.fagg-afmps.be/nl/MENSELIJK_gebruik/geneesmiddelen/geneesmiddelen/distributie_aflevering/onbeschikbaarheid/">http://www.fagg-afmps.be/nl/MENSELIJK_gebruik/geneesmiddelen/geneesmiddelen/distributie_aflevering/onbeschikbaarheid/</ext-link> [accessed March 14, 2014]</comment>.</citation></ref>
<ref id="B17"><citation citation-type="journal"><collab>Federale Overheidsdienst Justitie</collab> (<year>1967</year>). <source><italic>Koninklijk Besluit nr 78 Betreffende de Uitoefening van de Gezondheidszorgberoepen.</italic></source> <publisher-loc>Belgium</publisher-loc>: <publisher-name>Federal Public Service Health</publisher-name>.</citation></ref>
<ref id="B18"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fox</surname> <given-names>E. R.</given-names></name> <name><surname>Birt</surname> <given-names>A.</given-names></name> <name><surname>James</surname> <given-names>K. B.</given-names></name> <name><surname>Kokko</surname> <given-names>H.</given-names></name> <name><surname>Salverson</surname> <given-names>S.</given-names></name> <name><surname>Soflin</surname> <given-names>D. L.</given-names></name></person-group> (<year>2009</year>). <article-title>ASHP guidelines on managing drug product shortages in hospitals and health systems.</article-title> <source><italic>Am. J. Health. Syst. Pharm.</italic></source> <volume>66</volume> <fpage>1399</fpage>&#x2013;<lpage>1406</lpage>. <pub-id pub-id-type="doi">10.2146/ajhp090026</pub-id></citation></ref>
<ref id="B19"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gupta</surname> <given-names>D. K.</given-names></name> <name><surname>Huang</surname> <given-names>S.-M.</given-names></name></person-group> (<year>2013</year>). <article-title>Drug shortages in the united states: a critical evaluation of root causes and the need for action.</article-title> <source><italic>Clin. Pharmacol. Ther.</italic></source> <volume>93</volume> <fpage>133</fpage>&#x2013;<lpage>155</lpage>. <pub-id pub-id-type="doi">10.1038/clpt.2012.229</pub-id></citation></ref>
<ref id="B20"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Havrilesky</surname> <given-names>L. J.</given-names></name> <name><surname>Garfield</surname> <given-names>C. F.</given-names></name> <name><surname>Barnett</surname> <given-names>J. C.</given-names></name> <name><surname>Cohn</surname> <given-names>D. E.</given-names></name></person-group> (<year>2012</year>). <article-title>Economic impact of paclitaxel shortage in patients with newly diagnosed ovarian cancer.</article-title> <source><italic>Gynecol. Oncol.</italic></source> <volume>125</volume> <fpage>631</fpage>&#x2013;<lpage>634</lpage>. <pub-id pub-id-type="doi">10.1016/j.ygyno.2012.03.028</pub-id></citation></ref>
<ref id="B21"><citation citation-type="journal"><collab>IMS</collab> (<year>2011</year>). <source><italic>ISSUES BULLETIN: The Impact of the Economic Downturn on Global Access to Medicines.</italic></source> <comment>Available at: <ext-link ext-link-type="uri" xlink:href="http://www.healthinternetwork.com/medicines/areas/policy/impact_economic_downturn_global_access_medicines.pdf">http://www.healthinternetwork.com/medicines/areas/policy/impact_economic_downturn_global_access_medicines.pdf</ext-link></comment></citation></ref>
<ref id="B22"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kaakeh</surname> <given-names>R.</given-names></name> <name><surname>Sweet</surname> <given-names>B. V.</given-names></name> <name><surname>Reilly</surname> <given-names>C.</given-names></name> <name><surname>Bush</surname> <given-names>C.</given-names></name> <name><surname>DeLoach</surname> <given-names>S.</given-names></name> <name><surname>Higgins</surname> <given-names>B.</given-names></name><etal/></person-group> (<year>2011</year>). <article-title>Impact of drug shortages on U.S. health systems.</article-title> <source><italic>Am. J. Health. Syst. Pharm.</italic></source> <volume>68</volume> <fpage>1811</fpage>&#x2013;<lpage>1819</lpage>. <pub-id pub-id-type="doi">10.2146/ajhp110210</pub-id></citation></ref>
<ref id="B23"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kermani</surname> <given-names>F.</given-names></name></person-group> (<year>2010</year>). <source><italic>Pharma Takes Control of Distribution Chains.</italic></source> <comment>Available at: <ext-link ext-link-type="uri" xlink:href="http://www.pharmtech.com/pharma-takes-control-distribution-chains">http://www.pharmtech.com/pharma-takes-control-distribution-chains</ext-link> [accessed July 25 2017]</comment>.</citation></ref>
<ref id="B24"><citation citation-type="journal"><collab>Koninklijke Apothekersvereniging van Antwerpen [KAVA]</collab> (<year>2009</year>). <source><italic>Over contingentering.</italic></source> <comment>Available at: <ext-link ext-link-type="uri" xlink:href="http://www.farmacontingentering.be/">http://www.farmacontingentering.be/</ext-link> [accessed February 17, 2014]</comment>.</citation></ref>
<ref id="B25"><citation citation-type="journal"><collab>Medicine Shortages</collab> (<year>2016</year>). <comment>Available at: <ext-link ext-link-type="uri" xlink:href="http://www.pgeu.eu/en/policy/20-medicine-shortages.html">http://www.pgeu.eu/en/policy/20-medicine-shortages.html</ext-link> [accessed April 27, 2016]</comment>.</citation></ref>
<ref id="B26"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Metzger</surname> <given-names>M. L.</given-names></name> <name><surname>Billett</surname> <given-names>A.</given-names></name> <name><surname>Link</surname> <given-names>M. P.</given-names></name></person-group> (<year>2012</year>). <article-title>The impact of drug shortages on children with cancer &#x2014; the example of mechlorethamine.</article-title> <source><italic>N. Engl. J. Med.</italic></source> <volume>367</volume> <fpage>2461</fpage>&#x2013;<lpage>2463</lpage>. <pub-id pub-id-type="doi">10.1056/NEJMp1212468</pub-id></citation></ref>
<ref id="B27"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pauwels</surname> <given-names>K.</given-names></name> <name><surname>Simoens</surname> <given-names>S.</given-names></name> <name><surname>Casteels</surname> <given-names>M.</given-names></name> <name><surname>Huys</surname> <given-names>I.</given-names></name></person-group> (<year>2015</year>). <article-title>Insights into European drug shortages: a survey of hospital pharmacists.</article-title> <source><italic>PLoS ONE</italic></source> <volume>10</volume>:<issue>e0119322</issue>. <pub-id pub-id-type="doi">10.1371/journal.pone.0119322</pub-id></citation></ref>
<ref id="B28"><citation citation-type="journal"><collab>Pharmaceutical Group of the European Union</collab> (<year>2012</year>). <source><italic>Medicine Shortages in European Community Pharmacies.</italic></source> <comment>Available at: <ext-link ext-link-type="uri" xlink:href="http://www.apotheker.or.at/Internet/OEAK/NewsPresse.nsf/ca4d14672a08756bc125697d004f8841/51236ff8a9e75beec1257c69003649c2/$FILE/PGEUStatementMedicineshortages2012.pdf">http://www.apotheker.or.at/Internet/OEAK/NewsPresse.nsf/ca4d14672a08756bc125697d004f8841/51236ff8a9e75beec1257c69003649c2/$FILE/PGEUStatementMedicineshortages2012.pdf</ext-link></comment></citation></ref>
<ref id="B29"><citation citation-type="journal"><collab>Royal Decree Concerning Medicines for Humand and Veterinary Use</collab> (<year>2006</year>). <comment>Available at: <ext-link ext-link-type="uri" xlink:href="http://www.ejustice.just.fgov.be/cgi_loi/change_lg.pl?language=nl&#x0026;la=N&#x0026;cn=2006121431&#x0026;table_name=wet">http://www.ejustice.just.fgov.be/cgi_loi/change_lg.pl?language=nl&#x0026;la=N&#x0026;cn=2006121431&#x0026;table_name=wet</ext-link></comment></citation></ref>
<ref id="B30"><citation citation-type="journal"><collab>Royal Decree Regarding Instructions for Pharmacists</collab> (<year>2009</year>). <comment>Available at: <ext-link ext-link-type="uri" xlink:href="http://www.ejustice.just.fgov.be/cgi_loi/change_lg.pl?language=nl&#x0026;la=N&#x0026;cn=2009012132&#x0026;table_name=wet">http://www.ejustice.just.fgov.be/cgi_loi/change_lg.pl?language=nl&#x0026;la=N&#x0026;cn=2009012132&#x0026;table_name=wet</ext-link></comment></citation></ref>
<ref id="B31"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rutter</surname> <given-names>P. M.</given-names></name> <name><surname>Brown</surname> <given-names>D.</given-names></name> <name><surname>Jones</surname> <given-names>I. F.</given-names></name></person-group> (<year>1998</year>). <article-title>Pharmacy research: the place of work measurement.</article-title> <source><italic>Int. J. Pharm. Pract.</italic></source> <volume>6</volume> <fpage>46</fpage>&#x2013;<lpage>58</lpage>. <pub-id pub-id-type="doi">10.1111/j.2042-7174.1998.tb00915.x</pub-id></citation></ref>
<ref id="B32"><citation citation-type="journal"><collab>Sapentis</collab> (<year>2013</year>). <source><italic>Bridging the Gap in Pharmaceutical Parallel Trade.</italic></source> <comment>Available at: <ext-link ext-link-type="uri" xlink:href="http://www.sapentis.com/bridging-the-gap/">http://www.sapentis.com/bridging-the-gap/</ext-link> [accessed April 18, 2014]</comment>.</citation></ref>
<ref id="B33"><citation citation-type="journal"><collab>The Association of the British Pharmaceutical Industry [ABPI].</collab> (<year>2017</year>). <source><italic>Medicines Pricing and Supply Chain.</italic></source> <comment>Available at: <ext-link ext-link-type="uri" xlink:href="http://www.abpi.org.uk/our-work/commercial/Pages/default.aspx">http://www.abpi.org.uk/our-work/commercial/Pages/default.aspx</ext-link> [accessed July 25, 2017]</comment>.</citation></ref>
<ref id="B34"><citation citation-type="journal"><collab>The European Parliament and the Council of the European Union</collab> (<year>2011</year>). <source><italic>Directive 2001/83/EC of The European Parliament and of The Council of 6 November 2001 on the Community Code Relating to Medicinal Products for Human Use.</italic></source> <publisher-loc>Belgium</publisher-loc>: <publisher-name>The European Parliament and the Council of the European Union</publisher-name>.</citation></ref>
<ref id="B35"><citation citation-type="journal"><collab>The Pharmaceutical Journal</collab> (<year>2010</year>). <article-title>DTP schemes&#x2019; pros and cons examined.</article-title> <source><italic>Pharm. J.</italic></source> <volume>284</volume> <issue>626</issue>.</citation></ref>
<ref id="B36"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ventola</surname> <given-names>C. L.</given-names></name></person-group> (<year>2011</year>). <article-title>The drug shortage crisis in the United States: causes, impact, and management strategies.</article-title> <source><italic>P T</italic></source> <volume>36</volume> <fpage>740</fpage>&#x2013;<lpage>757</lpage>.</citation></ref>
<ref id="B37"><citation citation-type="journal"><collab>Yoleen Van Camp.</collab> (<year>2017</year>). <source><italic>Wetscoorstel tot Wijziging Van de Wet Van 25 Maart 1964 op de Geneesmiddelen Wat de Tekorten van Geneesmiddelen Betreft.</italic></source> <comment>Available at: <ext-link ext-link-type="uri" xlink:href="http://www.dekamer.be/FLWB/PDF/54/2440/54K2440001.pdf">http://www.dekamer.be/FLWB/PDF/54/2440/54K2440001.pdf</ext-link> [accessed June 9, 2017]</comment>.</citation></ref>
<ref id="B38"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zheng</surname> <given-names>K.</given-names></name> <name><surname>Guo</surname> <given-names>M. H.</given-names></name> <name><surname>Hanauer</surname> <given-names>D. A.</given-names></name></person-group> (<year>2011</year>). <article-title>Using the time and motion method to study clinical work processes and workflow: methodological inconsistencies and a call for standardized research.</article-title> <source><italic>J. Am. Med. Inform. Assoc.</italic></source> <volume>18</volume> <fpage>704</fpage>&#x2013;<lpage>710</lpage>. <pub-id pub-id-type="doi">10.1136/amiajnl-2011-000083</pub-id></citation></ref>
</ref-list>
<fn-group>
<fn id="fn01"><label>1</label><p><ext-link ext-link-type="uri" xlink:href="http://www.farmacontingentering.be/">http://www.farmacontingentering.be/</ext-link></p></fn>
</fn-group>
</back>
</article>