<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<?covid-19-tdm?>
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" article-type="research-article" dtd-version="2.3" xml:lang="EN">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Public Health</journal-id>
<journal-title>Frontiers in Public Health</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Public Health</abbrev-journal-title>
<issn pub-type="epub">2296-2565</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fpubh.2023.1192155</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Public Health</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Volatility of the COVID-19 vaccine hesitancy: sentiment analysis conducted in Brazil</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name>
<surname>Machado J&#x00FA;nior</surname>
<given-names>Celso</given-names>
</name>
<xref rid="aff1" ref-type="aff"><sup>1</sup></xref>
<xref rid="aff2" ref-type="aff"><sup>2</sup></xref>
<xref rid="c001" ref-type="corresp"><sup>&#x002A;</sup></xref>
<uri xlink:href="https://loop.frontiersin.org/people/2161496/overview"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Mantovani</surname>
<given-names>Daielly Melina Nassif</given-names>
</name>
<xref rid="aff3" ref-type="aff"><sup>3</sup></xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>de Sandes-Guimar&#x00E3;es</surname>
<given-names>Lu&#x00ED;sa Veras</given-names>
</name>
<xref rid="aff1" ref-type="aff"><sup>1</sup></xref>
<uri xlink:href="https://loop.frontiersin.org/people/2260592/overview"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Romeiro</surname>
<given-names>Maria do Carmo</given-names>
</name>
<xref rid="aff1" ref-type="aff"><sup>1</sup></xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Furlaneto</surname>
<given-names>Cristiane Jaciara</given-names>
</name>
<xref rid="aff1" ref-type="aff"><sup>1</sup></xref>
<xref rid="aff2" ref-type="aff"><sup>2</sup></xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Bazanini</surname>
<given-names>Roberto</given-names>
</name>
<xref rid="aff2" ref-type="aff"><sup>2</sup></xref>
<uri xlink:href="https://loop.frontiersin.org/people/2259632/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Laboratory of Health Education, Institute of Innovation Multidisciplinary, Department of Administration, Municipal University of S&#x00E3;o Caetano do Sul</institution>, <addr-line>S&#x00E3;o Caetano do Sul</addr-line>, <country>Brazil</country></aff>
<aff id="aff2"><sup>2</sup><institution>Laboratory of Biodiversity, Biogeography and Conservation, Department Health Sciences, Institute of Biological Sciences, University Paulista</institution>, <addr-line>S&#x00E3;o Paulo</addr-line>, <country>Brazil</country></aff>
<aff id="aff3"><sup>3</sup><institution>Laboratory of Quantitative Methods and Informatics, Department of Administration, Institute of Analytics and Open Data, University of S&#x00E3;o Paulo</institution>, <addr-line>S&#x00E3;o Paulo</addr-line>, <country>Brazil</country></aff>
<author-notes>
<fn id="fn0001" fn-type="edited-by"><p>Edited by: Ke Jiang, Elon University, United States</p></fn>
<fn id="fn0002" fn-type="edited-by"><p>Reviewed by: Srikanth Umakanthan, The University of the West Indies St. Augustine, Trinidad and Tobago; Chiara Cadeddu, Catholic University of the Sacred Heart, Italy</p></fn>
<corresp id="c001">&#x002A;Correspondence: Celso Machado J&#x00FA;nior, <email>celso.junior@online.uscs.edu.br</email></corresp>
</author-notes>
<pub-date pub-type="epub">
<day>07</day>
<month>07</month>
<year>2023</year>
</pub-date>
<pub-date pub-type="collection">
<year>2023</year>
</pub-date>
<volume>11</volume>
<elocation-id>1192155</elocation-id>
<history>
<date date-type="received">
<day>23</day>
<month>03</month>
<year>2023</year>
</date>
<date date-type="accepted">
<day>16</day>
<month>06</month>
<year>2023</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x00A9; 2023 Machado J&#x00FA;nior, Mantovani, de Sandes-Guimar&#x00E3;es, Romeiro, Furlaneto and Bazanini.</copyright-statement>
<copyright-year>2023</copyright-year>
<copyright-holder>Machado J&#x00FA;nior, Mantovani, de Sandes-Guimar&#x00E3;es, Romeiro, Furlaneto and Bazanini</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p>
</license>
</permissions>
<abstract>
<sec id="sec1">
<title>Background</title>
<p>Vaccine hesitancy is a phenomenon that can interfere with the expansion of vaccination coverage and is positioned as one of the top 10 global health threats. Previous studies have explored factors that affect vaccine hesitancy, how it behaves in different locations, and the profile of individuals in which it is most present. However, few studies have analyzed the volatility of vaccine hesitancy.</p>
</sec>
<sec id="sec2">
<title>Objective</title>
<p>Identify the volatility of vaccine hesitancy manifested in social media.</p>
</sec>
<sec id="sec3">
<title>Methods</title>
<p>Twitter&#x2019;s academic application programming interface was used to retrieve all tweets in Brazilian Portuguese mentioning the COVID-19 vaccine in 3&#x2009;months (October 2020, June 2021, and October 2021), retrieving 1,048,576 tweets. A sentiment analysis was performed using the Orange software with the lexicon Multilingual sentiment in Portuguese.</p>
</sec>
<sec id="sec4">
<title>Results</title>
<p>The feelings associated with vaccine hesitancy were volatile within 1&#x2009;month, as well as throughout the vaccination process, being positioned as a resilient phenomenon. The themes that nurture vaccine hesitancy change dynamically and swiftly and are often associated with other topics that are also affecting society.</p>
</sec>
<sec id="sec5">
<title>Conclusion</title>
<p>People that manifest the vaccine hesitancy present arguments that vary in a short period of time, what demand that government strategies to mitigate vaccine hesitancy effects be agile and counteract the expressed fear, by presenting scientific arguments.</p>
</sec>
</abstract>
<kwd-group>
<kwd>vaccine hesitancy</kwd>
<kwd>COVID-19</kwd>
<kwd>social media</kwd>
<kwd>sentiment analysis</kwd>
<kwd>vaccine regret</kwd>
</kwd-group>
<counts>
<fig-count count="0"/>
<table-count count="3"/>
<equation-count count="0"/>
<ref-count count="72"/>
<page-count count="10"/>
<word-count count="9132"/>
</counts>
<custom-meta-wrap>
<custom-meta>
<meta-name>section-at-acceptance</meta-name>
<meta-value>Infectious Diseases: Epidemiology and Prevention</meta-value>
</custom-meta>
</custom-meta-wrap>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="sec6">
<label>1.</label>
<title>Introduction</title>
<p>Vaccine hesitancy (VH) is a global phenomenon that has a major impact on population health. According to the World Health Organization (WHO), it is among the top <bold>10</bold> threats to global health. (<xref ref-type="bibr" rid="ref1">1</xref>&#x2013;<xref ref-type="bibr" rid="ref3">3</xref>). The establishment of the strategic advisory group of experts (SAGE) by the World Health Organization (WHO) in 2012 was the first effort to understand, monitor, and find solutions for VH (<xref ref-type="bibr" rid="ref3">3</xref>). Since its establishment, there has been increased interest in research related to VH (<xref ref-type="bibr" rid="ref4">4</xref>&#x2013;<xref ref-type="bibr" rid="ref6">6</xref>), with the number of papers addressing &#x2018;vaccine&#x2019; or &#x2018;vaccination&#x2019; in the title increasing from 3.3% in 2019 to 8.3% in 2021 (<xref ref-type="bibr" rid="ref4">4</xref>).</p>
<p>The term vaccine hesitancy is still under development and is subject to controversy. The initial proposal from the World Health Organization (WHO) indicates VH as a behavioral phenomenon, where individuals neither accept nor completely reject the possibility of vaccination (<xref ref-type="bibr" rid="ref7">7</xref>, <xref ref-type="bibr" rid="ref8">8</xref>). The divergence that is established in the definition of the term VH lies in the understanding that it is not a social behavior, but rather &#x201C;a state of indecisiveness regarding the decision to become vaccinated&#x201D; (<xref ref-type="bibr" rid="ref3">3</xref>), a position shared by other researchers (<xref ref-type="bibr" rid="ref9">9</xref>).</p>
<p>Vaccine hesitancy is a global phenomenon. Still, public acceptance of the vaccine varies depending on the region (<xref ref-type="bibr" rid="ref10">10</xref>). Countries in Asia have higher rates of vaccine acceptance (Malaysia with an acceptance of 94.3%, Indonesia of 93.3%, and China of 91.3%) compared to Europe (France with an acceptance of 58.9%, Poland of 56.3%, and Italy of 53.7%) and the United States (acceptance of 56.9%), which have lower levels of vaccine acceptance (<xref ref-type="bibr" rid="ref11">11</xref>).</p>
<p>VH is positioned as a complex and dynamic social phenomenon, for which the influencing factors are still being researched (<xref ref-type="bibr" rid="ref9">9</xref>, <xref ref-type="bibr" rid="ref11">11</xref>). Sex, educational level, age, geographical location, income, professional occupation, race and ethnicity (<xref ref-type="bibr" rid="ref12">12</xref>), living with five or more people (<xref ref-type="bibr" rid="ref13">13</xref>), pregnancy (<xref ref-type="bibr" rid="ref14">14</xref>), being a health professional, and having previous vaccination experience (<xref ref-type="bibr" rid="ref15">15</xref>) are among the factors that influence VH. Research studies establish other factors, such as group and individual aspects that involve a lower understanding of the risk, lower fear of contamination, believing that the disease is not serious, and not having heart diseases, as influencing factors of VH (<xref ref-type="bibr" rid="ref16">16</xref>). The concepts of cognition or affection, behavior, and decision making have also been related to VH (<xref ref-type="bibr" rid="ref3">3</xref>), which is also identified as linked to government credibility, incorporating aspects related to wanting more data for decision making, doubts about vaccine efficacy and safety, feeling that personal rights are being infringed upon, and lack of trust in the government and health care institutions (<xref ref-type="bibr" rid="ref14">14</xref>, <xref ref-type="bibr" rid="ref15">15</xref>).</p>
<p>The factors influencing VH are proposed from two constructs: the HBM (<xref ref-type="bibr" rid="ref12">12</xref>) and the 7C (<xref ref-type="bibr" rid="ref17">17</xref>). The HBM construct examines the influence of perceived susceptibility, perceived severity, perceived benefits, perceived barriers, cues to action, and self-efficacy on VH (<xref ref-type="bibr" rid="ref18">18</xref>), which are mostly conditional on the prevalence of demographic, psychosocial, and structural variables (<xref ref-type="bibr" rid="ref12">12</xref>). While the 7C construct points to trust, complacency, convenience (or constraints), risk calculation, collective responsibility, compliance, and conspiracy as factors driving VH (<xref ref-type="bibr" rid="ref9">9</xref>, <xref ref-type="bibr" rid="ref17">17</xref>, <xref ref-type="bibr" rid="ref19">19</xref>).</p>
<p>The VH in Brazil is a phenomenon that originated before the COVID-19 pandemic and evolved from 2016 (<xref ref-type="bibr" rid="ref20">20</xref>). It is possible to identify this decline in vaccination coverage in the analysis of mandatory vaccination for Human Papillomavirus (HPV) among girls aged 9 to 14&#x2009;years, which showed a vaccination coverage rate of 83.4% for the first dose and only 55 0.6% in the second dose. For the general Brazilian vaccination system in 2021, the coverage rate considering all vaccines made available by the public network was 59% of citizens (<xref ref-type="bibr" rid="ref21">21</xref>). In Brazil, there are studies that show significant variability of information about the population&#x2019;s VH. Among the studies that analyzed VH in Brazil, one stands out, which consolidates the analysis of eleven other studies on the subject, in which a variation from 8.2 to 34% of vaccine hesitancy for COVID-19 was found (<xref ref-type="bibr" rid="ref22">22</xref>), the consolidation of these studies, indicated an average vaccine hesitancy of 11.1%. A justification for the discrepancy identified in these studies is based on the large territorial extension of the country, with locations that present different behaviors in relation to the general average of the country. In this sense, research carried out in the Brazilian state of Maranh&#x00E3;o identified a rate of hesitation to vaccinate against the SARS-CoV-2 virus of 17.5% (<xref ref-type="bibr" rid="ref23">23</xref>), which is higher in comparison with an average of 11.1% (<xref ref-type="bibr" rid="ref22">22</xref>).</p>
<p>Overall, previous studies have addressed the factors influencing VH and its variation across locations. However, it is unclear whether VH is subject to the volatility of people&#x2019;s decision to take the vaccine, as public sentiment is volatile (<xref ref-type="bibr" rid="ref24">24</xref>), or if the influence of digital media platforms on the decision to take the vaccine (<xref ref-type="bibr" rid="ref25">25</xref>). Therefore, the objective of this study was to identify the variability of vaccine hesitancy manifested in social media. Overall, based on the papers reviewed, this is one of the first studies to explore the volatility of VH using social media as a data source, a context that meets the view that public sentiment tends to be volatile toward VH (<xref ref-type="bibr" rid="ref24">24</xref>). It is also worth noting, the existence of studies that, relying on Twitter databases, have analyzed people&#x2019;s sentiment toward COVID-19 (<xref ref-type="bibr" rid="ref26">26</xref>&#x2013;<xref ref-type="bibr" rid="ref28">28</xref>) and toward the COVID-19 vaccine (<xref ref-type="bibr" rid="ref29">29</xref>&#x2013;<xref ref-type="bibr" rid="ref31">31</xref>).</p>
</sec>
<sec sec-type="materials|methods" id="sec7">
<label>2.</label>
<title>Materials and methods</title>
<sec id="sec8">
<label>2.1.</label>
<title>Data extraction and pre-processing</title>
<p>A dataset was obtained from Twitter&#x2019;s Application Programming Interface (API). The data search was divided into three periods delimited by the months of October 2020, June 2021, and October 2021, and encompassed Brazilian data. The months of data collection were defined to identify different moments of the vaccination process for COVID-19. Additionally, each month&#x2019;s data was divided into one-week periods, with October 2020 and June 2021 having five analysis periods, and October 2021 having four. The keywords used to search the tweets were &#x201C;COVID-19,&#x201D; &#x201C;vaccine&#x201D; and &#x201C;vaccination&#x201D; in Brazilian Portuguese. This data collection technique has been observed in similar studies (<xref ref-type="bibr" rid="ref26">26</xref>, <xref ref-type="bibr" rid="ref27">27</xref>, <xref ref-type="bibr" rid="ref31">31</xref>&#x2013;<xref ref-type="bibr" rid="ref33">33</xref>). Opted to use Brazilian Portuguese, as the research is being carried out by a group of Brazilian researchers, who seek to identify mechanisms for predicting future pandemics. The capture of the text, only in Brazilian Portuguese, excluding tweets generated in Portuguese from other countries, as well as the use only of tweets generated from the Brazilian territory, was possible using the knowledge-based model, which captures a wide variety of locative references from tweets, like proposed by Mart&#x00ED;nez and Pascual (<xref ref-type="bibr" rid="ref34">34</xref>). It is worth mentioning, that the authors of this article make a collaborative effort to expand knowledge on the subject, approaching productive research groups that address the theme of vaccine hesitancy and coping with COVID-19 (<xref ref-type="bibr" rid="ref35">35</xref>&#x2013;<xref ref-type="bibr" rid="ref40">40</xref>). Thus, the findings of this research make up a contribution to the mosaic of international studies that address VH, however, caveats must be taken when generalizing their findings, because they are characteristic of the Brazilian population.</p>
<p>The exported data had issues with character encoding (accents and other special formats) and provided a date formatting presented as year, day, month, hour (including minutes and seconds) that is different from the Brazilian standards. To correct these issues, it was necessary to use the R software to help edit the data, since the database had over 1 million observations. During data extraction, were removed all duplicate tweets and the same tweet from the same user. After this step, the data were exported from R as a .csv file, generating one file per month analyzed. It is worth mentioning, that in this study, there are no independent or dependent variables, since the paper focused on text sentiment analysis.</p>
<p>The .csv data was imported into the Orange Data Mining software to conduct the sentiment analysis, an unsupervised text mining technique (without an initial reference/classification as the initial input into the software) that aims to extract the emotion present in a message.</p>
<p>In the Orange software, the text corpus was pre-processed to remove stop words (prepositions, pronouns, etc.). Only whole words without numbers or other characters (Regexp) are maintained. Specific features of the Twitter language (for example, the use of hashtag and at signs) are identified and URLs removed from the text.</p>
</sec>
<sec id="sec9">
<label>2.2.</label>
<title>Sentiment analysis</title>
<p>The sentiment analysis was performed with the help of the software Orange, in which a sentiment analysis was initially performed with the Multilingual sentiment lexicon in Brazilian Portuguese, which contains a previous mapping of words categorized as positive and negative. It is noteworthy, that the research addresses the feelings of the Brazilian population, so the generalization of its findings must be carried out with reservations. In this method, each word is categorized as negative, positive, or neutral and the overall sentiment score of the text is calculated (positive words-negative words/total words). Each tweet was assigned a score for sentiment that ranged from &#x2212;1 to 1, where a classification above 0&#x2009;=&#x2009;positive, below 0&#x2009;=&#x2009;negative, and equal to 0&#x2009;=&#x2009;neutral. Since the article is specifically focused on vaccine hesitancy, the analysis presented below involved the manual selection of a few tweets that showed adherence to the topic, according to the definitions presented in the literature. Due to the size (over 1 million tweets) and subject of the database, it would be impossible to perform this analysis automatically, using only the tweets related to vaccine hesitancy. The approach adopted presents similarities with studies on this subject (<xref ref-type="bibr" rid="ref29">29</xref>, <xref ref-type="bibr" rid="ref30">30</xref>, <xref ref-type="bibr" rid="ref41">41</xref>, <xref ref-type="bibr" rid="ref42">42</xref>).</p>
</sec>
</sec>
<sec sec-type="results" id="sec10">
<label>3.</label>
<title>Results</title>
<p>The sentiment analysis of the VH was performed in three different periods of the vaccination process, which are presented in charts divided into 1-week periods. This distribution was planned to observe the sentiment of VH in short periods (week) within the same month, and in longer intervals (over 4&#x2009;months). The analysis relied on the selection of 1.047.018 tweets adhering to the topic of vaccine hesitancy. However, the overall sentiment of the analyzed tweets for October 2020 was &#x2212;0.0438, for June 2021 was &#x2212;0.0510, and for October 2021 was &#x2212;0.0519. The overall sentiment was therefore slightly negative in all periods.</p>
<p>In October 2020, the availability of a vaccine for COVID-19 was identified in the Brazilian media. Three vaccine possibilities were discussed, those offered by Pfizer/Biontech, Oxford/AstraZeneca, and Sinovac/Butantan (CoronaVac). Subsequently other possible vaccines to be purchased by Brazil were identified. However, only these three vaccines were employed in greater volume. The sentiment analysis was developed initially by the researchers&#x2019; perspective (presented in the sentiment analysis performed) and then by the score provided by the Orange Software (sentiment score column). The purpose of this double analysis was to identify the alignment of the researchers&#x2019; perception with that obtained later in the analysis developed in the Orange software. From this perspective, some differences in positioning were identified between the analyses, however, without contrasts (variation between negative and positive, as the divergences were centered on the neutral sentiment). For this research, each divergence was analyzed individually, and used to deepen the understanding of the data and broaden the discussion. <xref rid="tab1" ref-type="table">Table 1</xref> presents the sentiment analysis for October 2020. It is noteworthy that the sentiment analysis is focused on VH and not on other aspects pointed out in the tweets. The sentences that exemplify the sentiment identified and presented in the first columns of the tables were translated from Portuguese to English to present the research by the authors.</p>
<table-wrap position="float" id="tab1">
<label>Table 1</label>
<caption><p>Sentiment analysis of the COVID-19 vaccine in October 2020.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th/>
<th align="left" valign="top">Tweet example</th>
<th align="left" valign="top">Sentiment</th>
<th align="left" valign="top">Sentiment Score</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top">1</td>
<td align="left" valign="top">&#x201C;In a time of pandemic, confinement is a stimulus for creativity. It is worth remembering that it was in isolation from the bubonic plague that Isaac Newton created the Theory of Gravity.&#x201D;</td>
<td align="left" valign="top">The messages address the topic. There are no factors related to the vaccine yet. There is no discussion on the name of the vaccine (Neutral sentiment).</td>
<td align="left" valign="top">&#x2212;0.296 (negative)</td>
</tr>
<tr>
<td align="left" valign="top" rowspan="2">2</td>
<td align="left" valign="top">&#x201C;With the pandemic one must have the Mandalorian mindset &#x2013; never take off your mask.&#x201D; (Mandalorian is a character from a series based on the Star Wars movie, who constantly wears a mask).</td>
<td align="left" valign="top">The vaccine is still not presented as a possibility, the main focus of people&#x2019;s attention is related to preventive measures, such as using masks (Neutral sentiment).</td>
<td align="left" valign="top">0.0 (neutral)</td>
</tr>
<tr>
<td align="left" valign="top">&#x201C;The pandemic will kill many from depression because of social isolation. Human beings need to socialize, to hug, to talk.&#x201D;</td>
<td align="left" valign="top">Expression of concern for the psychological state of the people, and a sign of saturation of the lockdown model (Neutral sentiment).</td>
<td align="left" valign="top">0.0 (neutral)</td>
</tr>
<tr>
<td align="left" valign="top" rowspan="2">3</td>
<td align="left" valign="top">&#x201C;The COVID-19 pandemic and social isolation have profoundly changed the routine of Brazilians, affecting family and work relationships, and healthcare as well.&#x201D;</td>
<td align="left" valign="top">Expression of concern for the psychological aspects of people, and a sign of saturation of the lockdown model (Neutral sentiment).</td>
<td align="left" valign="top">0.0 (neutral)</td>
</tr>
<tr>
<td align="left" valign="top">&#x201C;I would really like my student side to become active again. I have things to study and I cannot concentrate.&#x201D;</td>
<td align="left" valign="top">The interference of social distancing, in people&#x2019;s lives, with an impact on professional and educational activities (Neutral sentiment).</td>
<td align="left" valign="top">0.0 (neutral)</td>
</tr>
<tr>
<td align="left" valign="top">4</td>
<td align="left" valign="top">&#x201C;Except for the Russian vaccine, all are following testing protocols and developmental steps.&#x201D;</td>
<td align="left" valign="top">Relevant moment, because it marks the beginning of the discussion about the vaccines that will be used in Brazil, as well as the approval process, with two possibilities appearing with greater intensity: (i) AstraZeneca (Oxford) and (ii) CoronaVac (Butantan). (Positive sentiment).</td>
<td align="left" valign="top">0.34 (positive)</td>
</tr>
<tr>
<td align="left" valign="top">5</td>
<td align="left" valign="top">&#x201C;But the biggest impact to the country could be with the amount of people who suffer from side effects worse than the virus itself. There have been no animal tests on the recommended scale.&#x201D;<break/>&#x201C;[It is] absurd to force a vaccine with no proven efficacy&#x2026;&#x201D;</td>
<td align="left" valign="top">The messages complain about the mandatory vaccination against COVID-19, especially with a vaccine supposedly without scientific proof. Most of the messages are against the obligation (Negative sentiment).</td>
<td align="left" valign="top">0.0 (neutral)</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p>Source: research data (2023).</p>
</table-wrap-foot>
</table-wrap>
<p>The data show the onset of vaccine topic within the spectrum of solutions for the COVID-19 pandemic in Brazil. In the first insertion the VH phenomenon is already observed, focusing on the efficacy of the vaccines that are being proposed. The data show an alternation between negative, neutral, and positive sentiments; however, with a prevailing neutral positioning.</p>
<p>According to the Brazilian government priority planning, COVID-19 vaccines began to be delivered in January 2021 through prioritizing health care workers and the older adults. By June 2021, most of the population identified as priority population had already received the first dose of the COVID-19 vaccine. Thus, the vaccination process was already within reach of the population, however, still following the planned schedule of making the vaccine available in an order of decreasing age. <xref rid="tab2" ref-type="table">Table 2</xref> presents the sentiment analysis in June 2021.</p>
<table-wrap position="float" id="tab2">
<label>Table 2</label>
<caption><p>Sentiment analysis of the COVID-19 vaccine in June 2021.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th/>
<th align="left" valign="top">Tweet example</th>
<th align="left" valign="top">Sentiment</th>
<th align="left" valign="top">Sentiment Score</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top" rowspan="2">1</td>
<td align="left" valign="top">&#x201C;Worst thing. People are suffering from vaccine backlash.&#x201D;</td>
<td align="left" valign="top">The central focus of the tweets was the manifestation of concerns with possible reactions from the vaccines, especially those originating from the AstraZeneca vaccine. In general, they were satisfied with the immunization despite the symptoms (Neutral sentiment).</td>
<td align="left" valign="top">0.0 (neutral)</td>
</tr>
<tr>
<td align="left" valign="top">&#x201C;Have any pregnant women been vaccinated against COVID and had a reaction? I am scared to death.&#x201D;</td>
<td align="left" valign="top">Concern about the effect of the vaccine on women who are pregnant (Negative sentiment).</td>
<td align="left" valign="top">0.0 (neutral)</td>
</tr>
<tr>
<td align="left" valign="top" rowspan="3">2</td>
<td align="left" valign="top">&#x201C;Wow, who would have thought that mass vaccination would be the solution, right? Nobody saw that coming.&#x201D;</td>
<td align="left" valign="top">The manifestations express the vaccine as the solution to the pandemic (Positive sentiment).</td>
<td align="left" valign="top">0.0 (neutral)</td>
</tr>
<tr>
<td align="left" valign="top">&#x201C;A CoronaVac study in Serrana shows that the pandemic can be controlled.&#x201D;</td>
<td align="left" valign="top">Great interest in the CoronaVac vaccine test results from the town of Serrana in the countryside of the state of S&#x00E3;o Paulo (Brazil) (Positive sentiment).</td>
<td align="left" valign="top">0.0 (neutral)</td>
</tr>
<tr>
<td align="left" valign="top">&#x201C;You have to see which is the vaccine, because they showed one on TV that was suspended for pregnant women because it was giving a reaction.&#x201D;</td>
<td align="left" valign="top">Concern about the effect of the vaccine on women who are pregnant. Perception that the vaccine manufacturer can influence the outcome (Negative sentiment).</td>
<td align="left" valign="top">0.0 (neutral)</td>
</tr>
<tr>
<td align="left" valign="top" rowspan="2">3</td>
<td align="left" valign="top">&#x201C;City Hall just released the return of Pfizer&#x2019;s second dose vaccination.&#x201D;</td>
<td align="left" valign="top">The population&#x2019;s attention is on the Pfizer vaccine. The other options do not appear, indicating a preference of the population for Pfizer (Neutral sentiment).</td>
<td align="left" valign="top">0.0 (neutral)</td>
</tr>
<tr>
<td align="left" valign="top">&#x201C;Vaccination of players and games without fans are among the country&#x2019;s requests to host the Copa America.&#x201D;</td>
<td align="left" valign="top">Although not directly related to the vaccine, the topic of the America&#x2019;s Cup (South American soccer tournament) appears prominently, with athletes&#x2019; immunization in the background (Neutral sentiment).</td>
<td align="left" valign="top">&#x2212;0.296 (negative)</td>
</tr>
<tr>
<td/>
<td align="left" valign="top">&#x201C;If you are pregnant, I do not know if it is good to take the vaccine.&#x201D;</td>
<td align="left" valign="top">Concern about the effect of the vaccine on women who are pregnant (Negative sentiment).</td>
<td align="left" valign="top">0.0 (neutral)</td>
</tr>
<tr>
<td align="left" valign="top" rowspan="5">4</td>
<td align="left" valign="top">&#x201C;The problem is not the America&#x2019;s Cup, but who authorized it. As everything in this pandemic is political, I believe that the media has a share of the blame in the uncontrolled pandemic.</td>
<td align="left" valign="top" rowspan="2">The tweets address the Brazilian government&#x2019;s decision to host the Copa America, refused in other countries. The tweets indicate the importance of players being vaccinated (Neutral sentiment).</td>
<td align="left" valign="top">&#x2212;0.435 (negative)</td>
</tr>
<tr>
<td align="left" valign="top">&#x201C;All people involved in the America&#x2019;s Cup are vaccinated with the two doses of the vaccine&#x201D;</td>
<td align="left" valign="top">0.0 (neutral)</td>
</tr>
<tr>
<td align="left" valign="top">&#x201C;Find out where there is Pfizer vaccine for pregnant women.&#x201D;</td>
<td align="left" valign="top">Concern about the effect of the vaccine on women who are pregnant. Perception that the vaccine manufacturer can influence the outcome (Negative sentiment).</td>
<td align="left" valign="top">0.0 (neutral)</td>
</tr>
<tr>
<td align="left" valign="top">&#x201C;Very nice, coercing teachers and education professionals to receive the vaccine in exchange to being forced to go back to work.&#x201D;</td>
<td align="left" valign="top" rowspan="2">With the return of face-to-face classes, teachers are speaking out against making the vaccine mandatory. (Negative sentiment).</td>
<td align="left" valign="top">&#x2212;0.373 (negative)</td>
</tr>
<tr>
<td align="left" valign="top">&#x201C;Forcing teachers to come back face-to-face, to have to take the vaccine.&#x201D;</td>
<td align="left" valign="top">0.0 (neutral)</td>
</tr>
<tr>
<td align="left" valign="top" rowspan="4">5</td>
<td align="left" valign="top">&#x201C;I am so happy when I see people close to me taking the vaccine, even without being a friend. I love it so much!!!&#x201D;</td>
<td align="left" valign="top">Enthusiasm for the positive result of the vaccine on the spread of COVID-19, as well as for the reduction in the number of deaths (Positive sentiment).</td>
<td align="left" valign="top">0.202 (positive)</td>
</tr>
<tr>
<td align="left" valign="top">&#x201C;How good it is to lay your head on the pillow knowing that my parents, my sister and I have taken the first dose of the vaccine against COVID-19.&#x201D;</td>
<td align="left" valign="top">The focus of the messages is no longer on the vaccine brand, but on having taken the first dose. (Positive sentiment).</td>
<td align="left" valign="top">0.296 (positive)</td>
</tr>
<tr>
<td align="left" valign="top">&#x201C;Teachers criticize the obligations for face-to-face return, such as the vaccination requirement.&#x201D;</td>
<td align="left" valign="top" rowspan="2">With the return of face-to-face classes, teachers are demonstrating against the obligation to take the vaccine. (Negative sentiment).</td>
<td align="left" valign="top">0.0 (neutral)</td>
</tr>
<tr>
<td align="left" valign="top">&#x201C;Here in Fortaleza, teachers are being blackmailed into taking the vaccine and signing a term to return to classes in August.&#x201D;</td>
<td align="left" valign="top">0.0 (neutral)</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p>Source: research data (2023).</p>
</table-wrap-foot>
</table-wrap>
<p>The data reflect an intense period of the vaccination process, with most of the tweets addressing this topic. The sentiment expressed is positive and adherent to the vaccination process promoted by the Brazilian government. The tweets present three interesting features and approaches, despite dealing with a common trend, which are: (i) the positive result of the CoronaVac vaccine (Sinovac/Butantan) tests carried out in the city of Serrana is expressed as a positive sentiment; (ii) despite the positive result of the CoronaVac vaccine, the population preferred the Pfizer/Biontech vaccine; (iii) people are satisfied for having taken the first dose of the COVID-19 vaccine and being close to taking the second dose. These analyzed aspects are intertwined in the understanding of the benefits resulting from taking the vaccine. However, two specific groups with VH are identified, the pregnant women and the teachers in the education network. The hesitation of pregnant women permeates the concern of the vaccines affecting the pregnancy or the fetus. In this context, there are discussions as to which vaccine is the safest. In the case of teachers, it is worth noting that classes were paralyzed in Brazil in March 2020, when classroom activities were expected to return in August 2021, causing concern among teachers. In this approach, it is possible to have a double interpretation of the data. The first one is related to the VH, while the second is related to the hesitation of returning to the classroom, regardless of having taken the vaccine. However, under both terms the vaccine is positioned as an element of argumentation for the hesitation expressed by the teachers. <xref rid="tab3" ref-type="table">Table 3</xref> presents the sentiment analysis for October 2021.</p>
<table-wrap position="float" id="tab3">
<label>Table 3</label>
<caption><p>Sentiment analysis of the COVID-19 vaccine in October 2021.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th/>
<th align="left" valign="top">Tweet example</th>
<th align="left" valign="top">Sentiment</th>
<th align="left" valign="top">Sentiment score</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top" rowspan="3">1</td>
<td align="left" valign="top">&#x201C;Oh my God, if it works out now, I&#x2019;m going to get a vaccine.&#x201D;</td>
<td align="left" valign="top">The messages focus on vaccination, which is identified as something positive (Positive sentiment).</td>
<td align="left" valign="top">1.0 (positive)</td>
</tr>
<tr>
<td align="left" valign="top">&#x201C;Everyone who wants a vaccine takes it.&#x201D;</td>
<td align="left" valign="top" rowspan="2">With vaccine availability for all, the manifestation of individuals not wanting to get vaccinated against COVID-19 is observed (Negative sentiment).</td>
<td align="left" valign="top">0.0 (neutral)</td>
</tr>
<tr>
<td align="left" valign="top">&#x201C;I do not agree with the minister. Vaccinate whoever wants to. I will not be a guinea pig.&#x201D;</td>
<td align="left" valign="top">0.0 (neutral)</td>
</tr>
<tr>
<td align="left" valign="top" rowspan="3">2</td>
<td align="left" valign="top">&#x201C;With the vaccine for everyone now, is the second dose guaranteed for those who have already taken the first?&#x201D;</td>
<td align="left" valign="top">Cycle of concern for the second dose of vaccination (Positive sentiment).</td>
<td align="left" valign="top">0.0 (neutral)</td>
</tr>
<tr>
<td align="left" valign="top">&#x201C;It would be ridiculous to force people to get a vaccine at an experimental stage.&#x201D;</td>
<td align="left" valign="top" rowspan="2">The concern is related to the developmental stage of the vaccine, as well as to the need for approval of the vaccine by the regulatory agency in Brazil (Negative sentiment).</td>
<td align="left" valign="top">0.0 (neutral)</td>
</tr>
<tr>
<td align="left" valign="top">&#x201C;[someone] badly wanted to vaccinate people without the consent of ANVISA.&#x201D;</td>
<td align="left" valign="top">&#x2212;0.526 (negative)</td>
</tr>
<tr>
<td align="left" valign="top" rowspan="3">3</td>
<td align="left" valign="top">&#x201C;YES! Wow, I miss that. Waiting for the pandemic to end so I can come back.&#x201D;</td>
<td align="left" valign="top">The vaccine does not appear as the prevailing theme, but rather the process of ending the pandemic, i.e., the post-pandemic (Neutral sentiment).</td>
<td align="left" valign="top">0.0 (neutral)</td>
</tr>
<tr>
<td align="left" valign="top">&#x201C;Now they are going to force everyone to take this crap of which the long-term effects are unknown.&#x201D;</td>
<td align="left" valign="top" rowspan="2">The uncertainty is related to the long-term effect of the vaccines on people, i.e., what possible adverse effects could occur in the future (Negative sentiment).</td>
<td align="left" valign="top">&#x2212;0.700 (negative)</td>
</tr>
<tr>
<td align="left" valign="top">&#x201C;None of the vaccines they are giving to the people have INSTRUCTIONS informing the reactions.&#x201D;</td>
<td align="left" valign="top">&#x2212;0.373 (negative)</td>
</tr>
<tr>
<td align="left" valign="top" rowspan="3">4</td>
<td align="left" valign="top">&#x201C;I&#x2019;m glad the pandemic is over. I simply could not stand this social detachment any longer.&#x201D;</td>
<td align="left" valign="top">The perception is that the pandemic is over. No messages are identified pointing to the collaboration of the vaccine in this process. (Neutral sentiment).</td>
<td align="left" valign="top">0.0 (neutral)</td>
</tr>
<tr>
<td align="left" valign="top">&#x201C;They made me take the vaccine. Imagine my regret. I should not have taken it.&#x201D;</td>
<td/>
<td align="left" valign="top">0.0 (neutral)</td>
</tr>
<tr>
<td align="left" valign="top">&#x201C;They&#x2019;re not putting a gun to anyone&#x2019;s head to force them to take this garbage, so those who choose to get it are the ones to blame.&#x201D;</td>
<td align="left" valign="top">Statements against the decision of having received the vaccine (Negative sentiment).</td>
<td align="left" valign="top">0.0 (neutral)</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p>Source: research data (2023).</p>
</table-wrap-foot>
</table-wrap>
<p>The data for October 2021 portray a period of a more advanced stage of the population vaccination process. This period showed a greater VH manifestation, probably due to the availability of the vaccine for everyone, encouraging those who are more resistant to the vaccine to manifest with greater intensity. The data show an alternation between negative and neutral sentiments, with little occurrence of positive sentiments. This indicates that almost a year after the beginning of the vaccination process VH still exists, consisting of a resilient phenomenon that, therefore, should be the object of planning and actions aimed at its mitigation. The tweets also indicate the expectation for the end of the COVID-19 pandemic. In this perspective, the vaccination process, added to other factors such as the reduction of infection, reduction of deaths, desire to return to normal activities, with the potential interaction among these factors, have set an important milestone for people to interpret the period as the end of the pandemic. It is worth mentioning, that these characteristics observed in the tweets, as well as the brands of vaccines available, the period and priority of vaccination of the population, are related to characteristics of the vaccination process in Brazil, thus presenting intrinsic limitations of generalization of the findings of this research.</p>
</sec>
<sec sec-type="discussions" id="sec11">
<label>4.</label>
<title>Discussion</title>
<p>Previous studies have revealed that vaccine hesitancy (VH) is a dynamic phenomenon influenced by many variables that impact it in a positive or negative way (<xref ref-type="bibr" rid="ref9">9</xref>, <xref ref-type="bibr" rid="ref11">11</xref>). The variables that influence VH operate differently in each region depending on characteristics of the society (<xref ref-type="bibr" rid="ref10">10</xref>, <xref ref-type="bibr" rid="ref11">11</xref>). Residents of sub-Saharan Africa, for example, feared being victims of vaccine experimentation (<xref ref-type="bibr" rid="ref43">43</xref>).</p>
<p>Vaccine hesitancy research studies show variations in vaccine acceptance rates for COVID-19 (<xref ref-type="bibr" rid="ref10">10</xref>, <xref ref-type="bibr" rid="ref11">11</xref>, <xref ref-type="bibr" rid="ref44">44</xref>). Note that VH is not a behavior, but rather a state of indecision (<xref ref-type="bibr" rid="ref3">3</xref>, <xref ref-type="bibr" rid="ref9">9</xref>), thus subject to temporal factors (<xref ref-type="bibr" rid="ref45">45</xref>) and changes resulting from the dissatisfaction or satisfaction of society concerning access to information and actions of the government (<xref ref-type="bibr" rid="ref44">44</xref>). The identification of factors that collaborate with or mitigate VH stand out for enabling the expansion of vaccination coverage, and thus facilitating the achievement of the theoretical 90% or higher rate needed to establish collective immunity (<xref ref-type="bibr" rid="ref46">46</xref>).</p>
<p>The first set of data analyzed shows the period before the vaccination process began (October 2020). The data indicate that this period was characterized by an initial phase of indifference to vaccine-related aspects and greater attention to the protocols adopted by society. At the end of this period, the manifestations of feelings related to the vaccine, both positive and negative, can be observed. Since it is a new vaccine, the reservations are related to the adverse effects resulting from its use and to its efficacy. The identified resistance occurs in the context of a new product, for which little is known concerning efficiency and potential adverse effects (<xref ref-type="bibr" rid="ref11">11</xref>, <xref ref-type="bibr" rid="ref15">15</xref>, <xref ref-type="bibr" rid="ref16">16</xref>, <xref ref-type="bibr" rid="ref47">47</xref>). These initial manifestations express concerns with the source of the vaccine, i.e., with which laboratory is developing it, highlighting the need for the government to establish partnerships with research and production laboratories to provide as much information as possible. Subsequent evidence showed that some vaccines were imperfect or even had a declining protection index, thus favoring new COVID-19 outbreaks (<xref ref-type="bibr" rid="ref48">48</xref>). In Brazil some politicians assured that the vaccine made contamination impossible, which increased VH when the first cases of contamination by COVID-19 of vaccinated people surfaced. From this perspective, the lack of trust in the government increased VH (<xref ref-type="bibr" rid="ref1">1</xref>, <xref ref-type="bibr" rid="ref10">10</xref>, <xref ref-type="bibr" rid="ref14">14</xref>, <xref ref-type="bibr" rid="ref15">15</xref>, <xref ref-type="bibr" rid="ref25">25</xref>, <xref ref-type="bibr" rid="ref49">49</xref>). The inappropriate manifestation of politicians regarding the vaccine strengthens VH, impacting trust in the government and in the COVID-19 vaccine. This suggests that politicians should base their communications on evidence provided by the experts and not on their own feelings about vaccination.</p>
<p>The second block of data analyzed concerns the month of June 2021, which is marked by a significant portion of the Brazilian population having already received at least the first dose of the vaccine. Meanwhile, VH was expressed as negative sentiments toward the vaccine. In this interval, three phenomena associated with the VH in relation to the COVID-19 vaccine stood out: pregnant women, the Copa Am&#x00E9;rica being held in Brazil (soccer championship between the national teams of South American countries), and the return to school.</p>
<p>The suitability of the COVID-19 vaccine for pregnant women was a dominant theme throughout the period. VH was expressed in questioning the suitability of vaccines in general as well as the suitability of one of the vaccines available (<xref ref-type="bibr" rid="ref50">50</xref>). However, in both VH motivations, it is possible to ponder that doubting the suitability of the vaccine for pregnant women may cause this negative sentiment toward the vaccine to overflow to the society.</p>
<p>Another aspect that pervaded the tweets in the analyzed period was the Copa Am&#x00E9;rica being held in Brazil. In this case, a negative aspect regarding the event was observed, as the risks and appropriateness of holding the tournament were questioned. From this perspective, the manifestation of HV was not identified. On the contrary, a concern for the vaccination of the tournament players was observed. Thus, the calculation of contamination risk and collective responsibility acted as elements of positive reinforcement for vaccination (<xref ref-type="bibr" rid="ref17">17</xref>, <xref ref-type="bibr" rid="ref51">51</xref>). Additionally, the attention given to sport-related activities during a pandemic outbreak can positively influence social connections and relieve psychological stress (<xref ref-type="bibr" rid="ref52">52</xref>).</p>
<p>Another interesting aspect observed in this period involves primary and secondary school teachers. Some teachers interpreted the need to get vaccinated as a coercion to return to classroom activities in schools. From this perspective, VH is not explicitly perceived. However, the teachers&#x2019; fear of returning to the classroom heightened VH in general. We can thus infer that their professional activity is influencing the vaccination process (<xref ref-type="bibr" rid="ref12">12</xref>, <xref ref-type="bibr" rid="ref15">15</xref>), and causing the feeling that their personal rights are being infringed upon (<xref ref-type="bibr" rid="ref15">15</xref>). In Brazil, primary and secondary education is largely the responsibility of municipal and state governments, which halted school classes in 2020. In turn, studies indicate that students in schools, with greater confidence in the management of the pandemic, tend to be more willing to be vaccinated (<xref ref-type="bibr" rid="ref53">53</xref>). This block of analysis (June 2021) shows the possibility of observing multiple social factors interfering with VH at short time intervals (1&#x2009;month).</p>
<p>This period is also a turning point as the pandemic is concerned, namely the proximity of the end of the crisis. At the end of June 2021, the beginning of manifestations alluding to the approach of the end of the COVID-19 pandemic are identified, and most of them relate this event to the COVID-19 vaccination process, i.e., there is a positive feeling toward vaccination and its influence on the end of the crisis.</p>
<p>The third block of analyzed data includes tweets from October 2021. In this period a significant portion of the population had already been vaccinated, and in many cases including the second dose. Given the advanced stage of vaccination, the COVID-19 vaccine was already available to the entire population. Until then, vaccination followed a decreasing schedule in relation to people&#x2019;s age, so the older adults had priority. In this perspective, we have the VH manifestations resulting from vaccine availability (<xref ref-type="bibr" rid="ref14">14</xref>). Such availability caused those who were hesitant to manifest their opinion with greater intensity. Despite the existence of COVID-19 variants circulating in Brazil, we did not encounter any manifestation of VH related to this issue (<xref ref-type="bibr" rid="ref48">48</xref>).</p>
<p>An interesting fact is that the increased occurrence of HIV manifestations in the period when vaccination is completed may be associated with the occurrence of reinfection and shorter duration of the immunity provided by the vaccine, which contradicts the initial information provided by politicians to the population (<xref ref-type="bibr" rid="ref54">54</xref>). Other plausible explanations for this increase are the prohibition of access of those who did not get the vaccine to certain public places and the political discussion of establishing a mandatory vaccination &#x201C;passport&#x201D; for the population. These actions highlight the association of VH with government policies (<xref ref-type="bibr" rid="ref1">1</xref>, <xref ref-type="bibr" rid="ref14">14</xref>, <xref ref-type="bibr" rid="ref15">15</xref>, <xref ref-type="bibr" rid="ref24">24</xref>), with the efficiency and potential adverse effects of the vaccine (<xref ref-type="bibr" rid="ref11">11</xref>, <xref ref-type="bibr" rid="ref14">14</xref>, <xref ref-type="bibr" rid="ref15">15</xref>, <xref ref-type="bibr" rid="ref47">47</xref>), and, in many cases, with the short time of vaccine development (<xref ref-type="bibr" rid="ref16">16</xref>). In this period, one can also observe the manifestation of regret for having taken the vaccine. This characteristic establishes an important point of future investigation, as it constitutes a new attitude of people that differs from hesitation before the fact &#x2013; the &#x201C;vaccine regret&#x201D; (VR). The VR can affect the VH and drive people to avoid getting booster doses.</p>
<p>It is worth mentioning, that no studies were identified in the literature that presented the concept of VR. Thus, this study establishes a new perspective to be analyzed in future studies. However, when performing a search in the literature, the term &#x201C;anticipated regret&#x201D; was identified (<xref ref-type="bibr" rid="ref55">55</xref>, <xref ref-type="bibr" rid="ref56">56</xref>). Anticipated regret is related to the feeling that we may regret a decision in the future, and in this condition, it&#x2019;s can potentially be used as a predictor of vaccine behavior (<xref ref-type="bibr" rid="ref57">57</xref>).</p>
<p>Typically, studies of anticipated regret are related to anticipated regret in decisions to vaccinate against Human Papillomavirus (HPV) (<xref ref-type="bibr" rid="ref58">58</xref>, <xref ref-type="bibr" rid="ref59">59</xref>) and address the antagonism between the daughter&#x2019;s anticipated regret of becoming more sexually active after vaccination and regret by inaction if the daughter develops an HPV infection if she is not vaccinated (<xref ref-type="bibr" rid="ref60">60</xref>). However, this concept was also used in a study of vaccination against influenza (<xref ref-type="bibr" rid="ref61">61</xref>) and COVID-19 (<xref ref-type="bibr" rid="ref58">58</xref>).</p>
<p>The joint analysis of the three researched periods made it possible to identify that the VH manifests itself continuously and in association with themes that are affecting society, thus characterizing it as a social and dynamic phenomenon (<xref ref-type="bibr" rid="ref9">9</xref>, <xref ref-type="bibr" rid="ref10">10</xref>). In manifestations expressed in the social media, the VH was associated with vaccine manufacturers and related to the public sentiment (<xref ref-type="bibr" rid="ref9">9</xref>, <xref ref-type="bibr" rid="ref24">24</xref>). Thus, social media is positioned as an important channel for to manifest VH (<xref ref-type="bibr" rid="ref10">10</xref>, <xref ref-type="bibr" rid="ref25">25</xref>). Therefore, it should also be a resource used by the government to disseminate information that reduces VH. The VH is volatile on social media, as it appears related to various social topics that change very quickly. Thus, the government&#x2019;s action on social media to reduce VH must be agile so as not to distance itself from the topics that are being addressed. It is important to emphasize, that if the government does not quickly combat tweets that encourage vaccine hesitancy, these messages can lead to an adverse result in the vaccination process, regardless of the frequency of communication (<xref ref-type="bibr" rid="ref52">52</xref>). This perspective validates VH as a social process under the influence of multiple meanings and logics, circumscribed to the individual and collectivity.</p>
<p>Agile government efforts may prevent occurrences such as the one observed in France, where a vaccine uptake level that positively fluctuated between 62.0 and 77.1% in March and April 2021 reduced to a markedly lower level of 58.9% in June 2021, likely due to concerns related to vaccine safety and efficacy (<xref ref-type="bibr" rid="ref54">54</xref>, <xref ref-type="bibr" rid="ref62">62</xref>, <xref ref-type="bibr" rid="ref63">63</xref>). Notably, the potential positive association between trust in the government and COVID-19 vaccination involves sociopolitical factors related to public health policy implementation (<xref ref-type="bibr" rid="ref64">64</xref>).</p>
<p>In vaccine hesitancy analyses, it becomes relevant to incorporate the position of healthcare workers (HCW) in the vaccination process. The inclusion of HCW in the effort to reduce VH comes from the fact that people trust these professionals and follow their guidelines (<xref ref-type="bibr" rid="ref65">65</xref>&#x2013;<xref ref-type="bibr" rid="ref67">67</xref>). The influence of HCW guidance on reducing VH is significant (<xref ref-type="bibr" rid="ref68">68</xref>) and proved to be important when coping with the COVID-19 pandemic. A study carried out in June 2020, with the population that presented VH for COVID-19, indicated that 51.9% presented VH even after the indication of HCW vaccination (<xref ref-type="bibr" rid="ref68">68</xref>). The same study was carried out in June 2021, and it was identified that this value had reduced to 35.8% (<xref ref-type="bibr" rid="ref68">68</xref>), that is, during the pandemic the population increased its confidence in health professionals, and in their recommendations for the vaccination.</p>
<p>The influence of the HCW, for the reduction of VH, with the population, can be compromised if these professionals also present this hesitation. There is no consensus on the dimension of VH in HCW, however two surveys stand out. The global survey, which analyzed 35 studies in the area, indicated a variation between 4.3 and 72% of VH in HCW, depending on the country in which they operated (<xref ref-type="bibr" rid="ref69">69</xref>). Another survey, which analyzed HCW according to their training, identified an average of 8.1% of VH among HCW, with the categories with the lowest VH indices being Physicians (3.1%) and Nurses (6.5%) (<xref ref-type="bibr" rid="ref68">68</xref>). In this perspective, it is worth noting that the HCW also have VH, however, they do not express their concerns due to institutional and social pressures (<xref ref-type="bibr" rid="ref70">70</xref>). Thus, the unspoken vaccine hesitancy of HCW is identified as an element of attention of health systems, as it can influence the reduction of confidence in the vaccine by the public.</p>
<p>Two relevant aspects of the participation of HCWs in the HV mitigation process are thus identified: the first is that they influence people&#x2019;s decision to take the vaccine, so this aspect should be used in favor of awareness campaigns. The second aspect indicates that HCW may have unspoken vaccine hesitancy, which requires health system managers to establish awareness programs, with this specific public, that include autonomy and freedom to express their hesitations.</p>
<p>The attention devoted to COVID-19 VH research should support ongoing efforts begun by the WHO in 2012 (<xref ref-type="bibr" rid="ref3">3</xref>), aimed at defining, monitoring, and mitigating VH. The benefit of the cooling of the COVID-19 pandemic should not impact the importance of VH research, as there are other infections that spread in waves, affecting all of society. One example is the influenza virus responsible for infecting 1 billion people per year (<xref ref-type="bibr" rid="ref48">48</xref>, <xref ref-type="bibr" rid="ref71">71</xref>), resulting in 290,000 to 650,000 influenza-related respiratory deaths (<xref ref-type="bibr" rid="ref72">72</xref>).</p>
</sec>
<sec sec-type="conclusions" id="sec12">
<label>5.</label>
<title>Conclusion</title>
<p>This study defines vaccine hesitancy as a complex and dynamic social phenomenon, subject to several influencing factors. Among the considerations and findings of this research are the arguments presented by society for not getting vaccinated, which vary over short periods of time, surely within the period of a month. Thus, actions aimed at reducing vaccine hesitancy must be agile in capturing the concerns that permeate society, and in presenting information that encourages people to take the vaccine. In Brazil, vaccine hesitancy studies are still in the initial phase, so this research presents itself as a strength, for Brazilian society, which has its own cultural traits. This characteristic establishes limitations, when applying the knowledge developed in this study, in countries with cultures other than Brazilian.</p>
<sec id="sec13">
<label>5.1.</label>
<title>Limitations</title>
<p>The origin of the data did not allow raising variables common to other studies, such as: age, sex, education, professional occupation, race and ethnicity. In this perspective, this study presents additional information on vaccine hesitancy. Additionally, the data from this study refer to the Brazilian population, so caveats should be established in generalizing the findings of this research to other populations.</p>
</sec>
</sec>
<sec sec-type="data-availability" id="sec14">
<title>Data availability statement</title>
<p>The datasets presented in this study can be found in online repositories. The names of the repository/repositories and accession number(s) can be found below: <ext-link xlink:href="https://docs.google.com/spreadsheets/d/1getfuzuxOFc_4V_TT_vm2TZHrxe3efUK/edit?usp=share_link&#x0026;ouid=117126578285990502154&#x0026;rtpof=true&#x0026;sd=true" ext-link-type="uri">https://docs.google.com/spreadsheets/d/1getfuzuxOFc_4V_TT_vm2TZHrxe3efUK/edit?usp=share_link&#x0026;ouid=117126578285990502154&#x0026;rtpof=true&#x0026;sd=true</ext-link>.</p>
</sec>
<sec id="sec15">
<title>Ethics statement</title>
<p>Ethical review and approval were not required for the study of human participants in accordance with local legislation and institutional requirements. Data were collected from social media preserving anonymity.</p>
</sec>
<sec id="sec16">
<title>Author contributions</title>
<p>CM, DM, LS-G, MR, CF, and RB were involved in the analysis and interpretation of the data. CM, DM, and LS-G did the drafting of the article. CM and LS-G performed the statistical analysis. DM, MR, CM, and RB improved the quality of the English of the manuscript. CF wrote the final version all the manuscript. All authors revisited critically the manuscript for intellectual content, approved the version to be published and agree to be responsible for all aspects of the work, and involved in the conception and design of the study.</p>
</sec>
<sec sec-type="funding-information" id="sec17">
<title>Funding</title>
<p>This work was funded by a Research Incentive Scholarship offered by the University of S&#x00E3;o Paulo &#x2013; USP.</p>
</sec>
<sec sec-type="COI-statement" id="sec18">
<title>Conflict of interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec id="sec100" sec-type="disclaimer">
<title>Publisher&#x2019;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
</body>
<back>
<ack>
<p>We would like to thank University of S&#x00E3;o Paulo for its support.</p>
</ack>
<ref-list>
<title>References</title>
<ref id="ref1"><label>1.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nuwarda</surname> <given-names>RF</given-names></name> <name><surname>Ramzan</surname> <given-names>I</given-names></name> <name><surname>Weekes</surname> <given-names>L</given-names></name> <name><surname>Kayser</surname> <given-names>V</given-names></name></person-group>. <article-title>Vaccine hesitancy: contemporary issues and historical background</article-title>. <source>Vaccine</source>. (<year>2022</year>) <volume>10</volume>:<fpage>e1595</fpage>. doi: <pub-id pub-id-type="doi">10.3390/vaccines10101595</pub-id>, PMID: <pub-id pub-id-type="pmid">36298459</pub-id></citation></ref>
<ref id="ref2"><label>2.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Larson</surname> <given-names>HJ</given-names></name></person-group>. <article-title>Defining and measuring vaccine hesitancy</article-title>. <source>Nat Human Behav</source>. (<year>2022</year>) <volume>6</volume>:<fpage>1609</fpage>&#x2013;<lpage>10</lpage>. doi: <pub-id pub-id-type="doi">10.1038/s41562-022-01484-7</pub-id>, PMID: <pub-id pub-id-type="pmid">36418535</pub-id></citation></ref>
<ref id="ref3"><label>3.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bussink-Voorend</surname> <given-names>D</given-names></name> <name><surname>Hautvast</surname> <given-names>JL</given-names></name> <name><surname>Vandeberg</surname> <given-names>L</given-names></name> <name><surname>Visser</surname> <given-names>O</given-names></name> <name><surname>Hulscher</surname> <given-names>ME</given-names></name></person-group>. <article-title>A systematic literature review to clarify the concept of vaccine hesitancy</article-title>. <source>Nat Hum Behav</source>. (<year>2022</year>) <volume>6</volume>:<fpage>1634</fpage>&#x2013;<lpage>48</lpage>. doi: <pub-id pub-id-type="doi">10.1038/s41562-022-01431-6</pub-id></citation></ref>
<ref id="ref4"><label>4.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Attwell</surname> <given-names>K</given-names></name> <name><surname>Hannah</surname> <given-names>A</given-names></name> <name><surname>Leask</surname> <given-names>J</given-names></name></person-group>. <article-title>COVID-19: talk of &#x2018;vaccine hesitancy&#x2019; lets governments off the hook</article-title>. <source>Nature</source>. (<year>2022</year>) <volume>602</volume>:<fpage>574</fpage>&#x2013;<lpage>7</lpage>. doi: <pub-id pub-id-type="doi">10.1038/d41586-022-00495-8</pub-id>, PMID: <pub-id pub-id-type="pmid">35194212</pub-id></citation></ref>
<ref id="ref5"><label>5.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Calac</surname> <given-names>AJ</given-names></name> <name><surname>Haupt</surname> <given-names>MR</given-names></name> <name><surname>Li</surname> <given-names>Z</given-names></name> <name><surname>Mackey</surname> <given-names>T</given-names></name></person-group>. <article-title>Spread of COVID-19 vaccine misinformation in the ninth inning: retrospective observational infodemic study</article-title>. <source>Jmir Infodemiol</source>. (<year>2022</year>) <volume>2</volume>:<fpage>e33587</fpage>. doi: <pub-id pub-id-type="doi">10.2196/33587</pub-id>, PMID: <pub-id pub-id-type="pmid">35320982</pub-id></citation></ref>
<ref id="ref6"><label>6.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hartert</surname> <given-names>TV</given-names></name> <name><surname>Ortiz</surname> <given-names>JR</given-names></name></person-group>. <article-title>Need for improved global measurement of early childhood respiratory syncytial virus disease</article-title>. <source>Lancet</source>. (<year>2022</year>) <volume>399</volume>:<fpage>1993</fpage>&#x2013;<lpage>5</lpage>. doi: <pub-id pub-id-type="doi">10.1016/S0140-6736(22)00623-7</pub-id></citation></ref>
<ref id="ref7"><label>7.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fisher</surname> <given-names>KA</given-names></name> <name><surname>Bloomstone</surname> <given-names>SJ</given-names></name> <name><surname>Walder</surname> <given-names>J</given-names></name> <name><surname>Crawford</surname> <given-names>S</given-names></name> <name><surname>Fouayzi</surname> <given-names>H</given-names></name> <name><surname>Mazor</surname> <given-names>KM</given-names></name></person-group>. <article-title>Attitudes toward a potential SARS-CoV-2 vaccine: a survey of U.S. adults</article-title>. <source>Ann Intern Med</source>. (<year>2020</year>) <volume>173</volume>:<fpage>964</fpage>&#x2013;<lpage>73</lpage>. doi: <pub-id pub-id-type="doi">10.7326/M20-3569</pub-id>, PMID: <pub-id pub-id-type="pmid">32886525</pub-id></citation></ref>
<ref id="ref8"><label>8.</label><citation citation-type="web"><person-group person-group-type="author"><collab id="coll1">World Health Organization</collab></person-group>. Report of the SAGE working group on vaccine hesitancy. (<year>2014</year>). Available at: (<ext-link xlink:href="https://www.who.int/immunization/sage/meetings/2014/october/1_Report_WORKING_GROUP_vaccine_hesitancy_!nal.pdf" ext-link-type="uri">https://www.who.int/immunization/sage/meetings/2014/october/1_Report_WORKING_GROUP_vaccine_hesitancy_!nal.pdf</ext-link>).</citation></ref>
<ref id="ref9"><label>9.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wiysonge</surname> <given-names>CS</given-names></name> <name><surname>Ndwandwe</surname> <given-names>D</given-names></name> <name><surname>Ryan</surname> <given-names>J</given-names></name> <name><surname>Jaca</surname> <given-names>A</given-names></name> <name><surname>Batour&#x00E9;</surname> <given-names>O</given-names></name> <name><surname>Anya</surname> <given-names>BPM</given-names></name> <etal/></person-group>. <article-title>Vaccine hesitancy in the era of COVID-19: could lessons from the past help in divining the future?</article-title> <source>Hum Vaccin Immunother</source>. (<year>2022</year>) <volume>18</volume>:<fpage>1</fpage>&#x2013;<lpage>2</lpage>. doi: <pub-id pub-id-type="doi">10.1080/21645515.2021.1893062</pub-id>, PMID: <pub-id pub-id-type="pmid">33684019</pub-id></citation></ref>
<ref id="ref10"><label>10.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Karafillakis</surname> <given-names>E</given-names></name> <name><surname>Van Damme</surname> <given-names>P</given-names></name> <name><surname>Hendrickx</surname> <given-names>G</given-names></name> <name><surname>Larson</surname> <given-names>HJ</given-names></name></person-group>. <article-title>COVID-19 in Europe: new challenges for addressing vaccine hesitancy</article-title>. <source>Lancet</source>. (<year>2022</year>) <volume>399</volume>:<fpage>699</fpage>&#x2013;<lpage>701</lpage>. doi: <pub-id pub-id-type="doi">10.1016/S0140-6736(22)00150-7</pub-id>, PMID: <pub-id pub-id-type="pmid">35123665</pub-id></citation></ref>
<ref id="ref11"><label>11.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sallam</surname> <given-names>M</given-names></name></person-group>. <article-title>COVID-19 vaccine hesitancy worldwide: a concise systematic review of vaccine acceptance rates</article-title>. <source>Vaccine</source>. (<year>2021</year>) <volume>9</volume>:<fpage>1</fpage>&#x2013;<lpage>14</lpage>. doi: <pub-id pub-id-type="doi">10.3390/vaccines9020160</pub-id></citation></ref>
<ref id="ref12"><label>12.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Limbu</surname> <given-names>YB</given-names></name> <name><surname>Gautam</surname> <given-names>RK</given-names></name> <name><surname>Pham</surname> <given-names>L</given-names></name></person-group>. <article-title>The health belief model applied to COVID-19 vaccine hesitancy: a systematic review</article-title>. <source>Vaccine</source>. (<year>2022</year>) <volume>10</volume>:<fpage>1</fpage>&#x2013;<lpage>13</lpage>. doi: <pub-id pub-id-type="doi">10.3390/vaccines10060973</pub-id>, PMID: <pub-id pub-id-type="pmid">35746581</pub-id></citation></ref>
<ref id="ref13"><label>13.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fajar</surname> <given-names>JK</given-names></name> <name><surname>Sallam</surname> <given-names>M</given-names></name> <name><surname>Soegiarto</surname> <given-names>G</given-names></name> <name><surname>Sugiri</surname> <given-names>YJ</given-names></name> <name><surname>Anshory</surname> <given-names>M</given-names></name> <name><surname>Wulandari</surname> <given-names>L</given-names></name> <etal/></person-group>. <article-title>Global prevalence and potential influencing factors of COVID-19 vaccination hesitancy: a meta-analysis</article-title>. <source>Vaccine</source>. (<year>2022</year>) <volume>10</volume>:<fpage>1</fpage>&#x2013;<lpage>20</lpage>. doi: <pub-id pub-id-type="doi">10.3390/vaccines10081356</pub-id></citation></ref>
<ref id="ref14"><label>14.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Truong</surname> <given-names>J</given-names></name> <name><surname>Bakshi</surname> <given-names>S</given-names></name> <name><surname>Wasim</surname> <given-names>A</given-names></name> <name><surname>Ahmad</surname> <given-names>M</given-names></name> <name><surname>Majid</surname> <given-names>U</given-names></name></person-group>. <article-title>What factors promote vaccine hesitancy or acceptance during pandemics? A systematic review and thematic analysis</article-title>. <source>Health Promot Int</source>. (<year>2022</year>) <volume>37</volume>:<fpage>daab105</fpage>. doi: <pub-id pub-id-type="doi">10.1093/heapro/daab105</pub-id></citation></ref>
<ref id="ref15"><label>15.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Peterson</surname> <given-names>CJ</given-names></name> <name><surname>Lee</surname> <given-names>B</given-names></name> <name><surname>Nugent</surname> <given-names>K</given-names></name></person-group>. <article-title>COVID-19 vaccination hesitancy among healthcare workers - a review</article-title>. <source>Vaccine</source>. (<year>2022</year>) <volume>10</volume>:<fpage>1</fpage>&#x2013;<lpage>30</lpage>. doi: <pub-id pub-id-type="doi">10.3390/vaccines10060948</pub-id></citation></ref>
<ref id="ref16"><label>16.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Aw</surname> <given-names>J</given-names></name> <name><surname>Seng</surname> <given-names>JJB</given-names></name> <name><surname>Seah</surname> <given-names>SSY</given-names></name> <name><surname>Low</surname> <given-names>LL</given-names></name></person-group>. <article-title>COVID-19 vaccine hesitancy - a scoping review of literature in high-income countries</article-title>. <source>Vaccine</source>. (<year>2021</year>) <volume>9</volume>:<fpage>1</fpage>&#x2013;<lpage>21</lpage>. doi: <pub-id pub-id-type="doi">10.3390/vaccines9080900</pub-id>, PMID: <pub-id pub-id-type="pmid">34452026</pub-id></citation></ref>
<ref id="ref17"><label>17.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Geiger</surname> <given-names>M</given-names></name> <name><surname>Rees</surname> <given-names>F</given-names></name> <name><surname>Lilleholt</surname> <given-names>L</given-names></name> <name><surname>Santana</surname> <given-names>AP</given-names></name> <name><surname>Zettler</surname> <given-names>I</given-names></name> <name><surname>Wilhelm</surname> <given-names>O</given-names></name> <etal/></person-group>. <article-title>Measuring the 7Cs of vaccination readiness</article-title>. <source>Eur J Psychol Assess</source>. (<year>2022</year>) <volume>38</volume>:<fpage>261</fpage>&#x2013;<lpage>9</lpage>. doi: <pub-id pub-id-type="doi">10.1027/1015-5759/a000663</pub-id></citation></ref>
<ref id="ref18"><label>18.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rosenstock</surname> <given-names>IM</given-names></name></person-group>. <article-title>Historical origins of the health belief model</article-title>. <source>Health Educ Monogr</source>. (<year>1974</year>) <volume>2</volume>:<fpage>328</fpage>&#x2013;<lpage>35</lpage>. doi: <pub-id pub-id-type="doi">10.1177/109019817400200403</pub-id></citation></ref>
<ref id="ref19"><label>19.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Betsch</surname> <given-names>C</given-names></name> <name><surname>Schmid</surname> <given-names>P</given-names></name> <name><surname>Heinemeier</surname> <given-names>D</given-names></name> <name><surname>Korn</surname> <given-names>L</given-names></name> <name><surname>Holtmann</surname> <given-names>C</given-names></name> <name><surname>B&#x00F6;hm</surname> <given-names>R</given-names></name></person-group>. <article-title>Beyond confidence: development of a measure assessing the 5C psychological antecedents of vaccination</article-title>. <source>PLoS One</source>. (<year>2018</year>) <volume>13</volume>:<fpage>e0208601</fpage>. doi: <pub-id pub-id-type="doi">10.1371/journal.pone.0208601</pub-id>, PMID: <pub-id pub-id-type="pmid">30532274</pub-id></citation></ref>
<ref id="ref20"><label>20.</label><citation citation-type="web"><person-group person-group-type="author"><collab id="coll2">Sociedade Brasileira de Imunizantes (SBIm)</collab></person-group>. Especialistas se re&#x00FA;nem para debater o fen&#x00F4;meno da hesita&#x00E7;&#x00E3;o vacinal no Brasil. (<year>2021</year>). Available at: (<ext-link xlink:href="https://sbim.org.br/noticias/1619-especialistas-se-reunem-para-debater-o-fenomeno-da-hesitacao-vacinal-no-brasil" ext-link-type="uri">https://sbim.org.br/noticias/1619-especialistas-se-reunem-para-debater-o-fenomeno-da-hesitacao-vacinal-no-brasil</ext-link>).</citation></ref>
<ref id="ref21"><label>21.</label><citation citation-type="web"><person-group person-group-type="author"><name><surname>de Fortaleza</surname> <given-names>Prefeitura</given-names></name></person-group>. I F&#x00F3;rum Hesita&#x00E7;&#x00E3;o em Vacinar alerta sobre a import&#x00E2;ncia da participa&#x00E7;&#x00E3;o da sociedade nas campanhas de imuniza&#x00E7;&#x00E3;o. (<year>2023</year>). <comment>Available at:</comment> <ext-link xlink:href="https://www.fortaleza.ce.gov.br/noticias/i-forum-hesitacao-em-vacinar-alerta-sobre-a-importancia-da-participacao-da-sociedade-nas-campanhas-de-imunizacao" ext-link-type="uri">https://www.fortaleza.ce.gov.br/noticias/i-forum-hesitacao-em-vacinar-alerta-sobre-a-importancia-da-participacao-da-sociedade-nas-campanhas-de-imunizacao</ext-link> (Accessed May 13, 2023).</citation></ref>
<ref id="ref22"><label>22.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Leite</surname> <given-names>ESF</given-names></name> <name><surname>Martins</surname> <given-names>MG</given-names></name> <name><surname>Martins</surname> <given-names>CMDCR</given-names></name></person-group>. <article-title>Hesita&#x00E7;&#x00E3;o vacinal e seus fatores associados no contexto da pandemia de COVID-19 no Brasil</article-title>. <source>Cadernos Prospec&#x00E7;&#x00E3;o</source>. (<year>2023</year>) <volume>16</volume>:<fpage>484</fpage>&#x2013;<lpage>502</lpage>. doi: <pub-id pub-id-type="doi">10.9771/cp.v16i2.50880</pub-id></citation></ref>
<ref id="ref23"><label>23.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Oliveira</surname> <given-names>BLCAD</given-names></name> <name><surname>Campos</surname> <given-names>MAG</given-names></name> <name><surname>Queiroz</surname> <given-names>RCDS</given-names></name> <name><surname>Alves</surname> <given-names>MTSSDB</given-names></name> <name><surname>Souza</surname> <given-names>BFD</given-names></name> <name><surname>Santos</surname> <given-names>AMD</given-names></name> <etal/></person-group>. <article-title>Preval&#x00EA;ncia e fatores associados &#x00E0; hesita&#x00E7;&#x00E3;o vacinal contra a COVID-19 no Maranh&#x00E3;o</article-title>. <source>Brasil Revist Sa&#x00FA;de P&#x00FA;blica</source>. (<year>2021</year>) <volume>55</volume>:<fpage>1</fpage>:<fpage>12</fpage>. doi: <pub-id pub-id-type="doi">10.11606/s1518-8787.2021055003417</pub-id>, PMID: <pub-id pub-id-type="pmid">33909868</pub-id></citation></ref>
<ref id="ref24"><label>24.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pertwee</surname> <given-names>E</given-names></name> <name><surname>Simas</surname> <given-names>C</given-names></name> <name><surname>Larson</surname> <given-names>HJ</given-names></name></person-group>. <article-title>An epidemic of uncertainty: rumors, conspiracy theories and vaccine hesitancy</article-title>. <source>Nat Med</source>. (<year>2022</year>) <volume>28</volume>:<fpage>456</fpage>&#x2013;<lpage>9</lpage>. doi: <pub-id pub-id-type="doi">10.1038/s41591-022-01728-z</pub-id>, PMID: <pub-id pub-id-type="pmid">35273403</pub-id></citation></ref>
<ref id="ref25"><label>25.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Larson</surname> <given-names>HJ</given-names></name> <name><surname>Murray CJ</surname> <given-names>GE</given-names></name></person-group>. <article-title>The vaccine-hesitant moment</article-title>. <source>N Engl J Med</source>. (<year>2022</year>) <volume>387</volume>:<fpage>58</fpage>&#x2013;<lpage>65</lpage>. doi: <pub-id pub-id-type="doi">10.1056/NEJMra2106441</pub-id>, PMID: <pub-id pub-id-type="pmid">35767527</pub-id></citation></ref>
<ref id="ref26"><label>26.</label><citation citation-type="web"><person-group person-group-type="author"><name><surname>Dubey</surname> <given-names>AD</given-names></name></person-group>. <source>Twitter sentiment analysis during COVID-19 outbreak</source>. (<year>2020</year>). Available at: <ext-link xlink:href="https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3572023" ext-link-type="uri">https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3572023</ext-link></citation></ref>
<ref id="ref27"><label>27.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Priyadarshini</surname> <given-names>I</given-names></name> <name><surname>Mohanty</surname> <given-names>P</given-names></name> <name><surname>Kumar</surname> <given-names>R</given-names></name> <name><surname>Sharma</surname> <given-names>R</given-names></name> <name><surname>Puri</surname> <given-names>V</given-names></name> <name><surname>Singh</surname> <given-names>PK</given-names></name></person-group>. <article-title>A study on the sentiments and psychology of twitter users during COVID-19 lockdown period</article-title>. <source>Multimed Tools Appl</source>. (<year>2022</year>) <volume>81</volume>:<fpage>27009</fpage>&#x2013;<lpage>31</lpage>. doi: <pub-id pub-id-type="doi">10.1007/s11042-021-11004-w</pub-id>, PMID: <pub-id pub-id-type="pmid">34149302</pub-id></citation></ref>
<ref id="ref28"><label>28.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Singh</surname> <given-names>C</given-names></name> <name><surname>Imam</surname> <given-names>T</given-names></name> <name><surname>Wibowo</surname> <given-names>S</given-names></name> <name><surname>Grandhi</surname> <given-names>S</given-names></name></person-group>. <article-title>A deep learning approach for sentiment analysis of COVID-19 reviews</article-title>. <source>Appl Sci</source>. (<year>2022</year>) <volume>12</volume>:<fpage>3709</fpage>. doi: <pub-id pub-id-type="doi">10.3390/app12083709</pub-id></citation></ref>
<ref id="ref29"><label>29.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nezhad</surname> <given-names>ZB</given-names></name> <name><surname>Deihimi</surname> <given-names>MA</given-names></name></person-group>. <article-title>Twitter sentiment analysis from Iran about COVID 19 vaccine</article-title>. <source>Diabetes Metab Syndr Clin Res Rev</source>. (<year>2022</year>) <volume>16</volume>:<fpage>102367</fpage>. doi: <pub-id pub-id-type="doi">10.1016/j.dsx.2021.102367</pub-id>, PMID: <pub-id pub-id-type="pmid">34933273</pub-id></citation></ref>
<ref id="ref30"><label>30.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Marcec</surname> <given-names>R</given-names></name> <name><surname>Likic</surname> <given-names>R</given-names></name></person-group>. <article-title>Using twitter for sentiment analysis towards AstraZeneca/Oxford, Pfizer/BioNTech and Moderna COVID-19 vaccines</article-title>. <source>Postgrad Med J</source>. (<year>2022</year>) <volume>98</volume>:<fpage>544</fpage>&#x2013;<lpage>50</lpage>. doi: <pub-id pub-id-type="doi">10.1136/postgradmedj-2021-140685</pub-id>, PMID: <pub-id pub-id-type="pmid">34373343</pub-id></citation></ref>
<ref id="ref31"><label>31.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Niu</surname> <given-names>Q</given-names></name> <name><surname>Liu</surname> <given-names>J</given-names></name> <name><surname>Kato</surname> <given-names>M</given-names></name> <name><surname>Shinohara</surname> <given-names>Y</given-names></name> <name><surname>Matsumura</surname> <given-names>N</given-names></name> <name><surname>Aoyama</surname> <given-names>T</given-names></name> <etal/></person-group>. <article-title>Public opinion and sentiment before and at the beginning of COVID-19 vaccinations in Japan: twitter analysis</article-title>. <source>JMIR Infodemiol</source>. (<year>2022</year>) <volume>2</volume>:<fpage>e32335</fpage>. doi: <pub-id pub-id-type="doi">10.2196/32335</pub-id>, PMID: <pub-id pub-id-type="pmid">35578643</pub-id></citation></ref>
<ref id="ref32"><label>32.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Qorib</surname> <given-names>M</given-names></name> <name><surname>Oladunni</surname> <given-names>T</given-names></name> <name><surname>Denis</surname> <given-names>M</given-names></name> <name><surname>Ososanya</surname> <given-names>E</given-names></name> <name><surname>Cotae</surname> <given-names>P</given-names></name></person-group>. <article-title>COVID-19 vaccine hesitancy: text mining, sentiment analysis and machine learning on COVID-19 vaccination twitter dataset</article-title>. <source>Expert Syst Appl</source>. (<year>2023</year>) <volume>212</volume>:<fpage>118715</fpage>. doi: <pub-id pub-id-type="doi">10.1016/j.eswa.2022.118715</pub-id>, PMID: <pub-id pub-id-type="pmid">36092862</pub-id></citation></ref>
<ref id="ref33"><label>33.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chauhan</surname> <given-names>U</given-names></name> <name><surname>Shah</surname> <given-names>A</given-names></name></person-group>. <article-title>Topic modeling using latent Dirichlet allocation</article-title>. <source>ACM Comput Surv</source>. (<year>2022</year>) <volume>54</volume>:<fpage>1</fpage>&#x2013;<lpage>35</lpage>. doi: <pub-id pub-id-type="doi">10.1145/3462478</pub-id></citation></ref>
<ref id="ref34"><label>34.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mart&#x00ED;nez</surname> <given-names>NJF</given-names></name> <name><surname>Pascual</surname> <given-names>CP</given-names></name></person-group>. <article-title>Knowledge-based rules for the extraction of complex, fine-grained locative references from tweets</article-title>. <source>Revista Electron Linguist Aplicada</source>. (<year>2020</year>) <volume>19</volume>:<fpage>136</fpage>&#x2013;<lpage>63</lpage>.</citation></ref>
<ref id="ref35"><label>35.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Umakanthan</surname> <given-names>S</given-names></name> <name><surname>Sahu</surname> <given-names>P</given-names></name> <name><surname>Ranade</surname> <given-names>AV</given-names></name> <name><surname>Bukelo</surname> <given-names>MM</given-names></name> <name><surname>Rao</surname> <given-names>JS</given-names></name> <name><surname>Abrahao-Machado</surname> <given-names>LF</given-names></name> <etal/></person-group>. <article-title>Origin, transmission, diagnosis and management of coronavirus disease 2019 (COVID-19)</article-title>. <source>Postgrad Med J</source>. (<year>2020</year>) <volume>96</volume>:<fpage>753</fpage>&#x2013;<lpage>8</lpage>. doi: <pub-id pub-id-type="doi">10.1136/postgradmedj-2020-138234</pub-id></citation></ref>
<ref id="ref36"><label>36.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Umakanthan</surname> <given-names>S</given-names></name> <name><surname>Patil</surname> <given-names>S</given-names></name> <name><surname>Subramaniam</surname> <given-names>N</given-names></name> <name><surname>Sharma</surname> <given-names>R</given-names></name></person-group>. <article-title>COVID-19 vaccine hesitancy and resistance in India explored through a population-based longitudinal survey</article-title>. <source>Vaccine</source>. (<year>2021</year>) <volume>9</volume>:<fpage>1064</fpage>. doi: <pub-id pub-id-type="doi">10.3390/vaccines9101064</pub-id>, PMID: <pub-id pub-id-type="pmid">34696172</pub-id></citation></ref>
<ref id="ref37"><label>37.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Umakanthan</surname> <given-names>S</given-names></name> <name><surname>Senthil</surname> <given-names>S</given-names></name> <name><surname>John</surname> <given-names>S</given-names></name> <name><surname>Madhavan</surname> <given-names>MK</given-names></name> <name><surname>Das</surname> <given-names>J</given-names></name> <name><surname>Patil</surname> <given-names>S</given-names></name> <etal/></person-group>. <article-title>The effect of statins on clinical outcome among hospitalized patients with COVID-19: a multi-centric cohort study</article-title>. <source>Front Pharmacol</source>. (<year>2022</year>) <volume>13</volume>:<fpage>1</fpage>&#x2013;<lpage>11</lpage>. doi: <pub-id pub-id-type="doi">10.3389/fphar.2022.742273</pub-id>, PMID: <pub-id pub-id-type="pmid">35865966</pub-id></citation></ref>
<ref id="ref38"><label>38.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Umakanthan</surname> <given-names>S</given-names></name> <name><surname>Lawrence</surname> <given-names>S</given-names></name></person-group>. <article-title>Predictors of COVID-19 vaccine hesitancy in Germany: a cross-sectional, population-based study</article-title>. <source>Postgrad Med J</source>. (<year>2022</year>) <volume>98</volume>:<fpage>756</fpage>&#x2013;<lpage>64</lpage>. doi: <pub-id pub-id-type="doi">10.1136/postgradmedj-2021-141365</pub-id>, PMID: <pub-id pub-id-type="pmid">35115377</pub-id></citation></ref>
<ref id="ref39"><label>39.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Umakanthan</surname> <given-names>S</given-names></name> <name><surname>Bukelo</surname> <given-names>MM</given-names></name> <name><surname>Bukelo</surname> <given-names>MJ</given-names></name> <name><surname>Patil</surname> <given-names>S</given-names></name> <name><surname>Subramaniam</surname> <given-names>N</given-names></name> <name><surname>Sharma</surname> <given-names>R</given-names></name></person-group>. <article-title>Social environmental predictors of COVID-19 vaccine hesitancy in India: a population-based survey</article-title>. <source>Vaccine</source>. (<year>2022</year>) <volume>10</volume>:<fpage>1749</fpage>. doi: <pub-id pub-id-type="doi">10.3390/vaccines10101749</pub-id>, PMID: <pub-id pub-id-type="pmid">36298614</pub-id></citation></ref>
<ref id="ref40"><label>40.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Umakanthan</surname> <given-names>S</given-names></name> <name><surname>Bukelo</surname> <given-names>MM</given-names></name> <name><surname>Gajula</surname> <given-names>SS</given-names></name></person-group>. <article-title>The commonwealth Caribbean COVID-19: regions resilient pathway during pandemic</article-title>. <source>Front Public Health</source>. (<year>2022</year>) <volume>10</volume>:<fpage>844333</fpage>. doi: <pub-id pub-id-type="doi">10.3389/fpubh.2022.844333</pub-id>, PMID: <pub-id pub-id-type="pmid">35664108</pub-id></citation></ref>
<ref id="ref41"><label>41.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nia</surname> <given-names>ZM</given-names></name> <name><surname>Ahmadi</surname> <given-names>A</given-names></name> <name><surname>Bragazzi</surname> <given-names>NL</given-names></name> <name><surname>Woldegerima</surname> <given-names>WA</given-names></name> <name><surname>Mellado</surname> <given-names>B</given-names></name> <name><surname>Wu</surname> <given-names>J</given-names></name> <etal/></person-group>. <article-title>A cross-country analysis of macroeconomic responses to COVID-19 pandemic using twitter sentiments</article-title>. <source>PLoS One</source>. (<year>2022</year>) <volume>17</volume>:<fpage>e0272208</fpage>. doi: <pub-id pub-id-type="doi">10.1371/journal.pone.0272208</pub-id>, PMID: <pub-id pub-id-type="pmid">36001531</pub-id></citation></ref>
<ref id="ref42"><label>42.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Reshi</surname> <given-names>AA</given-names></name> <name><surname>Rustam</surname> <given-names>F</given-names></name> <name><surname>Aljedaani</surname> <given-names>W</given-names></name> <name><surname>Shafi</surname> <given-names>S</given-names></name> <name><surname>Alhossan</surname> <given-names>A</given-names></name> <name><surname>Alrabiah</surname> <given-names>Z</given-names></name> <etal/></person-group>. <article-title>COVID-19 vaccination-related sentiments analysis: a case study using worldwide twitter dataset</article-title>. <source>Healthcare</source>. (<year>2022</year>) <volume>10</volume>:<fpage>411</fpage>. doi: <pub-id pub-id-type="doi">10.3390/healthcare10030411</pub-id>, PMID: <pub-id pub-id-type="pmid">35326889</pub-id></citation></ref>
<ref id="ref43"><label>43.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Anjorin</surname> <given-names>AA</given-names></name> <name><surname>Odetokun</surname> <given-names>IA</given-names></name> <name><surname>Abioye</surname> <given-names>AI</given-names></name> <name><surname>Elnadi</surname> <given-names>H</given-names></name> <name><surname>Umoren</surname> <given-names>MV</given-names></name> <name><surname>Damaris</surname> <given-names>BF</given-names></name> <etal/></person-group>. <article-title>Will Africans take COVID-19 vaccination?</article-title> <source>PLoS One</source>. (<year>2021</year>) <volume>16</volume>:<fpage>e0260575</fpage>. doi: <pub-id pub-id-type="doi">10.1371/journal.pone.0260575</pub-id>, PMID: <pub-id pub-id-type="pmid">34851998</pub-id></citation></ref>
<ref id="ref44"><label>44.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kanyanda</surname> <given-names>S</given-names></name> <name><surname>Markhof</surname> <given-names>Y</given-names></name> <name><surname>Wollburg</surname> <given-names>P</given-names></name> <name><surname>Zezza</surname> <given-names>A</given-names></name></person-group>. <article-title>Acceptance of COVID-19 vaccines in sub-Saharan Africa: evidence from six national phone surveys</article-title>. <source>BMJ Open</source>. (<year>2021</year>) <volume>11</volume>:<fpage>e055159</fpage>. doi: <pub-id pub-id-type="doi">10.1136/bmjopen-2021-055159</pub-id>, PMID: <pub-id pub-id-type="pmid">34911723</pub-id></citation></ref>
<ref id="ref45"><label>45.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Groves</surname> <given-names>HE</given-names></name> <name><surname>Pich&#x00E9;-Renaud</surname> <given-names>PP</given-names></name> <name><surname>Peci</surname> <given-names>A</given-names></name> <name><surname>Farrar</surname> <given-names>DS</given-names></name> <name><surname>Buckrell</surname> <given-names>S</given-names></name> <name><surname>Bancej</surname> <given-names>C</given-names></name> <etal/></person-group>. <article-title>The impact of the COVID-19 pandemic on influenza, respiratory syncytial virus, and other seasonal respiratory virus circulation in Canada: a population- based study</article-title>. <source>Lancet Region Health Am</source>. (<year>2021</year>) <volume>1</volume>:<fpage>100015</fpage>. doi: <pub-id pub-id-type="doi">10.1016/j.lana.2021.100015</pub-id>, PMID: <pub-id pub-id-type="pmid">34386788</pub-id></citation></ref>
<ref id="ref46"><label>46.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fontanet</surname> <given-names>A</given-names></name> <name><surname>Cauchemez</surname> <given-names>S</given-names></name></person-group>. <article-title>COVID-19 herd immunity: where are we?</article-title> <source>Nat Rev Immunol</source>. (<year>2020</year>) <volume>20</volume>:<fpage>583</fpage>&#x2013;<lpage>4</lpage>. doi: <pub-id pub-id-type="doi">10.1038/s41577-020-00451-5</pub-id>, PMID: <pub-id pub-id-type="pmid">32908300</pub-id></citation></ref>
<ref id="ref47"><label>47.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sol&#x00ED;s Arce</surname> <given-names>JS</given-names></name> <name><surname>Warren</surname> <given-names>SS</given-names></name> <name><surname>Meriggi</surname> <given-names>NF</given-names></name> <name><surname>Scacco</surname> <given-names>A</given-names></name> <name><surname>McMurry</surname> <given-names>N</given-names></name> <name><surname>Voors</surname> <given-names>M</given-names></name> <etal/></person-group>. <article-title>COVID-19 vaccine acceptance and hesitancy in low-and middle-income countries</article-title>. <source>Nat Med</source>. (<year>2021</year>) <volume>27</volume>:<fpage>1385</fpage>&#x2013;<lpage>94</lpage>. doi: <pub-id pub-id-type="doi">10.1038/s41591-021-01454-y</pub-id>, PMID: <pub-id pub-id-type="pmid">34272499</pub-id></citation></ref>
<ref id="ref48"><label>48.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Majeed</surname> <given-names>B</given-names></name> <name><surname>David</surname> <given-names>JF</given-names></name> <name><surname>Bragazzi</surname> <given-names>NL</given-names></name> <name><surname>McCarthy</surname> <given-names>Z</given-names></name> <name><surname>Grunnill</surname> <given-names>MD</given-names></name> <name><surname>Heffernan</surname> <given-names>J</given-names></name> <etal/></person-group>. <article-title>Mitigating co-circulation of seasonal influenza and COVID-19 pandemic in the presence of vaccination: a mathematical modeling approach</article-title>. <source>Front Public Health</source>. (<year>2023</year>) <volume>10</volume>:<fpage>1</fpage>&#x2013;<lpage>20</lpage>. doi: <pub-id pub-id-type="doi">10.3389/fpubh.2022.1086849</pub-id>, PMID: <pub-id pub-id-type="pmid">36684896</pub-id></citation></ref>
<ref id="ref49"><label>49.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Soares</surname> <given-names>P</given-names></name> <name><surname>Rocha</surname> <given-names>JV</given-names></name> <name><surname>Moniz</surname> <given-names>M</given-names></name> <name><surname>Gama</surname> <given-names>A</given-names></name> <name><surname>Laires</surname> <given-names>PA</given-names></name> <name><surname>Pedro</surname> <given-names>AR</given-names></name> <etal/></person-group>. <article-title>Factors associated with COVID-19 vaccine hesitancy</article-title>. <source>Vaccine</source>. (<year>2021</year>) <volume>9</volume>:<fpage>1</fpage>&#x2013;<lpage>14</lpage>. doi: <pub-id pub-id-type="doi">10.3390/vaccines9030300</pub-id>, PMID: <pub-id pub-id-type="pmid">33810131</pub-id></citation></ref>
<ref id="ref50"><label>50.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Silva</surname> <given-names>MC</given-names></name> <name><surname>Silva</surname> <given-names>NCH</given-names></name> <name><surname>Ferreira</surname> <given-names>ALCG</given-names></name> <name><surname>Ferreira</surname> <given-names>FCG</given-names></name> <name><surname>Melo</surname> <given-names>MIB</given-names></name> <name><surname>Silva</surname> <given-names>LMX</given-names></name> <etal/></person-group>. <article-title>Neutralizing antibodies against SARS-CoV-2 in Brazilian pregnant women vaccinated with one or two doses of BNT162b2 mRNA vaccine (Pfizer/WyethTM)</article-title>. <source>Front Public Health</source>. (<year>2023</year>) <volume>10</volume>:<fpage>1</fpage>&#x2013;<lpage>7</lpage>. doi: <pub-id pub-id-type="doi">10.3389/fpubh.2022.1054460</pub-id>, PMID: <pub-id pub-id-type="pmid">36684877</pub-id></citation></ref>
<ref id="ref51"><label>51.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bussink-Voorend</surname> <given-names>D</given-names></name> <name><surname>Hautvast</surname> <given-names>JL</given-names></name> <name><surname>Vandeberg</surname> <given-names>L</given-names></name> <name><surname>Visser</surname> <given-names>O</given-names></name> <name><surname>Hulscher</surname> <given-names>ME</given-names></name></person-group>. <article-title>A systematic literature review to clarify the concept of vaccine hesitancy. Nature human</article-title>. <source>Behaviour</source>. (<year>2022</year>) <volume>6</volume>:<fpage>1634</fpage>&#x2013;<lpage>48</lpage>. doi: <pub-id pub-id-type="doi">10.1038/s41562-022-01431-6</pub-id></citation></ref>
<ref id="ref52"><label>52.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shan</surname> <given-names>D</given-names></name> <name><surname>Xu</surname> <given-names>J</given-names></name> <name><surname>Liu</surname> <given-names>T</given-names></name> <name><surname>Zhang</surname> <given-names>Y</given-names></name> <name><surname>Dai</surname> <given-names>Z</given-names></name> <name><surname>Zheng</surname> <given-names>Y</given-names></name> <etal/></person-group>. <article-title>Subjective attitudes moderate the social connectedness in esports gaming during COVID-19 pandemic: a cross-sectional study</article-title>. <source>Front Public Health</source>. (<year>2022</year>) <volume>10</volume>:<fpage>1</fpage>&#x2013;<lpage>10</lpage>. doi: <pub-id pub-id-type="doi">10.3389/fpubh.2022.1020114</pub-id>, PMID: <pub-id pub-id-type="pmid">36684856</pub-id></citation></ref>
<ref id="ref53"><label>53.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Xiong</surname> <given-names>Y</given-names></name> <name><surname>Weng</surname> <given-names>X</given-names></name> <name><surname>Snyder</surname> <given-names>B</given-names></name> <name><surname>Ma</surname> <given-names>L</given-names></name> <name><surname>Cong</surname> <given-names>M</given-names></name> <name><surname>Miller</surname> <given-names>EL</given-names></name> <etal/></person-group>. <article-title>Perceptions and knowledge regarding the COVID-19 pandemic between US and China: a mixed methods study</article-title>. <source>Glob Health</source>. (<year>2022</year>) <volume>18</volume>:<fpage>1</fpage>&#x2013;<lpage>14</lpage>. doi: <pub-id pub-id-type="doi">10.1186/s12992-022-00864-y</pub-id>, PMID: <pub-id pub-id-type="pmid">35941625</pub-id></citation></ref>
<ref id="ref54"><label>54.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Takoudjou Dzomo</surname> <given-names>GR</given-names></name> <name><surname>Mbario</surname> <given-names>E</given-names></name> <name><surname>Djarma</surname> <given-names>O</given-names></name> <name><surname>Soumbatingar</surname> <given-names>N</given-names></name> <name><surname>Madengar</surname> <given-names>M</given-names></name> <name><surname>Djimera</surname> <given-names>N</given-names></name> <etal/></person-group>. <article-title>Predictors of COVID-19 vaccine hesitancy in Chad: a cross-sectional study</article-title>. <source>Front Public Health</source>. (<year>2023</year>) <volume>10</volume>:<fpage>1</fpage>&#x2013;<lpage>18</lpage>. doi: <pub-id pub-id-type="doi">10.3389/fpubh.2022.1063954</pub-id>, PMID: <pub-id pub-id-type="pmid">36684864</pub-id></citation></ref>
<ref id="ref55"><label>55.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Caso</surname> <given-names>D</given-names></name> <name><surname>Carfora</surname> <given-names>V</given-names></name> <name><surname>Starace</surname> <given-names>C</given-names></name> <name><surname>Conner</surname> <given-names>M</given-names></name></person-group>. <article-title>Key factors influencing Italian mothers&#x2019; intention to vaccinate sons against HPV: the influence of trust in health authorities, anticipated regret and past behaviour</article-title>. <source>Sustainability</source>. (<year>2019</year>) <volume>11</volume>:<fpage>e6879</fpage>. doi: <pub-id pub-id-type="doi">10.3390/su11236879</pub-id></citation></ref>
<ref id="ref56"><label>56.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Grodzicka</surname> <given-names>ED</given-names></name></person-group>. <article-title>Taking vaccine regret and hesitancy seriously. The role of truth, conspiracy theories, gender relations and trust in the HPV immunisation programmes in Ireland</article-title>. <source>J Cult Res</source>. (<year>2021</year>) <volume>25</volume>:<fpage>69</fpage>&#x2013;<lpage>87</lpage>. doi: <pub-id pub-id-type="doi">10.1080/14797585.2021.1886422</pub-id></citation></ref>
<ref id="ref57"><label>57.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pokharel</surname> <given-names>M</given-names></name> <name><surname>Lillie</surname> <given-names>HM</given-names></name> <name><surname>Nagatsuka</surname> <given-names>K</given-names></name> <name><surname>Barbour</surname> <given-names>JB</given-names></name> <name><surname>Ratcliff</surname> <given-names>CL</given-names></name> <name><surname>Jensen</surname> <given-names>JD</given-names></name></person-group>. <article-title>Social media narratives can influence vaccine intentions: the impact of depicting regret and character death</article-title>. <source>Comput Hum Behav</source>. (<year>2023</year>) <volume>141</volume>:<fpage>e107612</fpage>:<fpage>107612</fpage>. doi: <pub-id pub-id-type="doi">10.1016/j.chb.2022.107612</pub-id></citation></ref>
<ref id="ref58"><label>58.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Christy</surname> <given-names>SM</given-names></name> <name><surname>Winger</surname> <given-names>JG</given-names></name> <name><surname>Raffanello</surname> <given-names>EW</given-names></name> <name><surname>Halpern</surname> <given-names>LF</given-names></name> <name><surname>Danoff-Burg</surname> <given-names>S</given-names></name> <name><surname>Mosher</surname> <given-names>CE</given-names></name></person-group>. <article-title>The role of anticipated regret and health beliefs in HPV vaccination intentions among young adults</article-title>. <source>J Behav Med</source>. (<year>2016</year>) <volume>39</volume>:<fpage>429</fpage>&#x2013;<lpage>40</lpage>. doi: <pub-id pub-id-type="doi">10.1007/s10865-016-9716-z</pub-id>, PMID: <pub-id pub-id-type="pmid">26782668</pub-id></citation></ref>
<ref id="ref59"><label>59.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pen&#x0163;a</surname> <given-names>MA</given-names></name> <name><surname>Cr&#x0103;ciun</surname> <given-names>IC</given-names></name> <name><surname>B&#x0103;ban</surname> <given-names>A</given-names></name></person-group>. <article-title>The power of anticipated regret: predictors of HPV vaccination and seasonal influenza vaccination acceptability among young Romanians</article-title>. <source>Vaccine</source>. (<year>2020</year>) <volume>38</volume>:<fpage>1572</fpage>&#x2013;<lpage>8</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.vaccine.2019.11.042</pub-id>, PMID: <pub-id pub-id-type="pmid">31786001</pub-id></citation></ref>
<ref id="ref60"><label>60.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ziarnowski</surname> <given-names>KL</given-names></name> <name><surname>Brewer</surname> <given-names>NT</given-names></name> <name><surname>Weber</surname> <given-names>B</given-names></name></person-group>. <article-title>Present choices, future outcomes: anticipated regret and HPV vaccination</article-title>. <source>Prev Med</source>. (<year>2009</year>) <volume>48</volume>:<fpage>411</fpage>&#x2013;<lpage>4</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.ypmed.2008.10.006</pub-id>, PMID: <pub-id pub-id-type="pmid">18996144</pub-id></citation></ref>
<ref id="ref61"><label>61.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pan</surname> <given-names>Y</given-names></name> <name><surname>Ng</surname> <given-names>CT</given-names></name> <name><surname>Cheng</surname> <given-names>TCE</given-names></name></person-group>. <article-title>Effect of free-riding behavior on vaccination coverage with customer regret</article-title>. <source>Comput Ind Eng</source>. (<year>2021</year>) <volume>159</volume>:<fpage>e107494</fpage>:<fpage>107494</fpage>. doi: <pub-id pub-id-type="doi">10.1016/j.cie.2021.107494</pub-id></citation></ref>
<ref id="ref62"><label>62.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schwarzinger</surname> <given-names>M</given-names></name> <name><surname>Watson</surname> <given-names>V</given-names></name> <name><surname>Arwidson</surname> <given-names>P</given-names></name> <name><surname>Alla</surname> <given-names>F</given-names></name> <name><surname>Luchini</surname> <given-names>S</given-names></name></person-group>. <article-title>COVID-19 vaccine hesitancy in a representative working-age population in France: a survey experiment based on vaccine characteristics</article-title>. <source>Lancet Public Health</source>. (<year>2021</year>) <volume>6</volume>:<fpage>e210</fpage>&#x2013;<lpage>21</lpage>. doi: <pub-id pub-id-type="doi">10.1016/S2468-2667(21)00012-8</pub-id>, PMID: <pub-id pub-id-type="pmid">33556325</pub-id></citation></ref>
<ref id="ref63"><label>63.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sallam</surname> <given-names>M</given-names></name></person-group>. <article-title>COVID-19 vaccine hesitancy worldwide: a concise systematic review of vaccine acceptance rates</article-title>. <source>Vaccine</source>. (<year>2021</year>) <volume>9</volume>:<fpage>160</fpage>. doi: <pub-id pub-id-type="doi">10.3390/vaccines9020160</pub-id>, PMID: <pub-id pub-id-type="pmid">33669441</pub-id></citation></ref>
<ref id="ref64"><label>64.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chung</surname> <given-names>GKK</given-names></name> <name><surname>Chan</surname> <given-names>L</given-names></name> <name><surname>Chan</surname> <given-names>SM</given-names></name> <name><surname>Chen</surname> <given-names>JK</given-names></name> <name><surname>Wong</surname> <given-names>H</given-names></name> <name><surname>Chung</surname> <given-names>YN</given-names></name></person-group>. <article-title>The impact of trust in government on pandemic management on the compliance with voluntary COVID-19 vaccination policy among adolescents after social unrest in Hong Kong</article-title>. <source>Front Public Health</source>. (<year>2022</year>) <volume>10</volume>:<fpage>1</fpage>&#x2013;<lpage>12</lpage>. doi: <pub-id pub-id-type="doi">10.3389/fpubh.2022.992895</pub-id>, PMID: <pub-id pub-id-type="pmid">36660556</pub-id></citation></ref>
<ref id="ref65"><label>65.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sol&#x00ED;s Arce</surname> <given-names>JS</given-names></name> <name><surname>Warren</surname> <given-names>SS</given-names></name> <name><surname>Meriggi</surname> <given-names>NF</given-names></name> <name><surname>Scacco</surname> <given-names>A</given-names></name> <name><surname>McMurry</surname> <given-names>N</given-names></name> <name><surname>Voors</surname> <given-names>M</given-names></name> <etal/></person-group>. <article-title>COVID-19 vaccine acceptance and hesitancy in low- and middle-income countries</article-title>. <source>Nat Med</source>. (<year>2021</year>) <volume>27</volume>:<fpage>1385</fpage>&#x2013;<lpage>94</lpage>. doi: <pub-id pub-id-type="doi">10.1038/s41591-021-01454-y</pub-id>, PMID: <pub-id pub-id-type="pmid">34272499</pub-id></citation></ref>
<ref id="ref66"><label>66.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fu</surname> <given-names>C</given-names></name> <name><surname>Wei</surname> <given-names>Z</given-names></name> <name><surname>Pei</surname> <given-names>S</given-names></name> <name><surname>Li</surname> <given-names>S</given-names></name> <name><surname>Sun</surname> <given-names>X</given-names></name> <name><surname>Liu</surname> <given-names>P</given-names></name></person-group>. <article-title>Acceptance of and preference for COVID-19 vaccination in healthcare workers: a comparative analysis and discrete choice experiment</article-title>. <source>MedRxiv</source>. (<year>2020</year>) <volume>4</volume>:<fpage>1</fpage>&#x2013;<lpage>35</lpage>. doi: <pub-id pub-id-type="doi">10.1101/2020.04.09.20060103</pub-id></citation></ref>
<ref id="ref67"><label>67.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Maltezou</surname> <given-names>HC</given-names></name> <name><surname>Pavli</surname> <given-names>A</given-names></name> <name><surname>Dedoukou</surname> <given-names>X</given-names></name> <name><surname>Georgakopoulou</surname> <given-names>T</given-names></name> <name><surname>Raftopoulos</surname> <given-names>V</given-names></name> <name><surname>Drositis</surname> <given-names>I</given-names></name> <etal/></person-group>. <article-title>Determinants of intention to get vaccinated against COVID-19 among healthcare personnel in hospitals in Greece</article-title>. <source>Infect. Disease Health</source>. (<year>2021</year>) <volume>26</volume>:<fpage>189</fpage>&#x2013;<lpage>97</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.idh.2021.03.002</pub-id>, PMID: <pub-id pub-id-type="pmid">33906828</pub-id></citation></ref>
<ref id="ref68"><label>68.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lazarus</surname> <given-names>JV</given-names></name> <name><surname>Wyka</surname> <given-names>K</given-names></name> <name><surname>White</surname> <given-names>TM</given-names></name> <name><surname>Picchio</surname> <given-names>CA</given-names></name> <name><surname>Rabin</surname> <given-names>K</given-names></name> <name><surname>Ratzan</surname> <given-names>SC</given-names></name> <etal/></person-group>. <article-title>Revisiting COVID-19 vaccine hesitancy around the world using data from 23 countries in 2021</article-title>. <source>Nat Commun</source>. (<year>2022</year>) <volume>13</volume>:<fpage>3801</fpage>&#x2013;<lpage>14</lpage>. doi: <pub-id pub-id-type="doi">10.1038/s41467-022-31441-x</pub-id>, PMID: <pub-id pub-id-type="pmid">35778396</pub-id></citation></ref>
<ref id="ref69"><label>69.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Biswas</surname> <given-names>N</given-names></name> <name><surname>Mustapha</surname> <given-names>T</given-names></name> <name><surname>Khubchandani</surname> <given-names>J</given-names></name> <name><surname>Price</surname> <given-names>JH</given-names></name></person-group>. <article-title>The nature and extent of COVID-19 vaccination hesitancy in healthcare workers</article-title>. <source>J Community Health</source>. (<year>2021</year>) <volume>46</volume>:<fpage>1244</fpage>&#x2013;<lpage>51</lpage>. doi: <pub-id pub-id-type="doi">10.1007/S10900-021-00984-3</pub-id>, PMID: <pub-id pub-id-type="pmid">33877534</pub-id></citation></ref>
<ref id="ref70"><label>70.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Heyerdahl</surname> <given-names>LW</given-names></name> <name><surname>Dielen</surname> <given-names>S</given-names></name> <name><surname>Nguyen</surname> <given-names>T</given-names></name> <name><surname>van Riet</surname> <given-names>C</given-names></name> <name><surname>Kattumana</surname> <given-names>T</given-names></name> <name><surname>Simas</surname> <given-names>C</given-names></name> <etal/></person-group>. <article-title>Doubt at the core: unspoken vaccine hesitancy among healthcare workers</article-title>. <source>Lancet Regional Health Europe</source>. (<year>2022</year>) <volume>12</volume>:<fpage>100289</fpage>&#x2013;<lpage>2</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.lanepe.2021.100289</pub-id>, PMID: <pub-id pub-id-type="pmid">34927116</pub-id></citation></ref>
<ref id="ref71"><label>71.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Paget</surname> <given-names>J</given-names></name> <name><surname>Spreeuwenberg</surname> <given-names>P</given-names></name> <name><surname>Charu</surname> <given-names>V</given-names></name> <name><surname>Taylor</surname> <given-names>RJ</given-names></name> <name><surname>Iuliano</surname> <given-names>AD</given-names></name> <name><surname>Bresee</surname> <given-names>J</given-names></name> <etal/></person-group>. <article-title>Global mortality associated with seasonal influenza epidemics: new burden estimates and predictors from the GLaMOR project</article-title>. <source>J Glob Health</source>. (<year>2019</year>) <volume>9</volume>:<fpage>9</fpage>. doi: <pub-id pub-id-type="doi">10.7189/jogh.09.020421</pub-id>, PMID: <pub-id pub-id-type="pmid">31673337</pub-id></citation></ref>
<ref id="ref72"><label>72.</label><citation citation-type="web"><person-group person-group-type="author"><collab id="coll3">World Health Organization</collab></person-group>. Influenza (seasonal). World Health Organization (<year>2022</year>). Available online at: <ext-link xlink:href="https://www.who.int/news-room/fact-sheets/detail/influenza-(seasonal)" ext-link-type="uri">https://www.who.int/news-room/fact-sheets/detail/influenza-(seasonal)</ext-link> (Accessed February 10, 2023).</citation></ref>
</ref-list>
</back>
</article>
