<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="review-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Big Data</journal-id>
<journal-title>Frontiers in Big Data</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Big Data</abbrev-journal-title>
<issn pub-type="epub">2624-909X</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fdata.2023.1132764</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Big Data</subject>
<subj-group>
<subject>Mini Review</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Google Trends for health research: Its advantages, application, methodological considerations, and limitations in psychiatric and mental health infodemiology</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Alibudbud</surname> <given-names>Rowalt</given-names></name>
<xref ref-type="corresp" rid="c001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/2105726/overview"/>
</contrib>
</contrib-group>
<aff><institution>Department of Sociology and Behavioral Sciences, De La Salle University</institution>, <addr-line>Manila</addr-line>, <country>Philippines</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Vegard Engen, Bournemouth University, United Kingdom</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Eric David Ornos, University of the Philippines Manila, Philippines; Qinyi Tan, Southwest University, China; Adrian Galido, Mindanao State University&#x02014;Iligan Institute of Technology, Philippines</p></fn>
<corresp id="c001">&#x0002A;Correspondence: Rowalt Alibudbud <email>rowalt.alibudbud&#x00040;dlsu.edu.ph</email></corresp>
<fn fn-type="other" id="fn001"><p>This article was submitted to Medicine and Public Health, a section of the journal Frontiers in Big Data</p></fn></author-notes>
<pub-date pub-type="epub">
<day>27</day>
<month>03</month>
<year>2023</year>
</pub-date>
<pub-date pub-type="collection">
<year>2023</year>
</pub-date>
<volume>6</volume>
<elocation-id>1132764</elocation-id>
<history>
<date date-type="received">
<day>27</day>
<month>12</month>
<year>2022</year>
</date>
<date date-type="accepted">
<day>14</day>
<month>03</month>
<year>2023</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2023 Alibudbud.</copyright-statement>
<copyright-year>2023</copyright-year>
<copyright-holder>Alibudbud</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license> </permissions>
<abstract>
<p>The high utilization of infodemiological tools for psychiatric and mental health topics signals the emergence of a new discipline. Drawing on the definition of infodemiology by Eysenbach, this emerging field can be termed &#x0201C;psychiatric and mental health infodemiology,&#x0201D; defined as the science of distribution and determinants of information in an electronic medium, including the internet, or in a population to inform mental health services and policies. Since Google Trends is one of its popular tools, this minireview describes its advantages, application, methodological considerations, and limitations in psychiatric and mental health research. The advantage of Google Trends is the nature of its data, which may represent the actual behavior rather than their users&#x00027; stated preferences in real-time through automatic anonymization. As such, it can provide readily available data about sensitive health topics like mental disorders. Therefore, Google Trends has been used to explore public concerns, interests, and behaviors about psychiatric and mental health phenomena, service providers, and specific disciplines. In this regard, several methodological can be considered by studies using Google Trends, including documenting their exact keywords, query category, time range, location, and date of retrieval. Likewise, its limitations should be accounted for in its interpretation, including restricted representation of people who use the Google search engine, limited validity in areas with low internet penetration or freedom of speech, does not provide absolute search volumes, unknown sampled queries, and limited transparency in its algorithm, especially the terms and idioms it subsumes under its &#x0201C;topic&#x0201D; keywords.</p></abstract>
<kwd-group>
<kwd>psychiatry</kwd>
<kwd>infodemiology</kwd>
<kwd>internet-based intervention</kwd>
<kwd>health informatics</kwd>
<kwd>Google Trends</kwd>
<kwd>methodological study</kwd>
<kwd>mental health</kwd>
<kwd>research methodology</kwd>
</kwd-group>
<counts>
<fig-count count="0"/>
<table-count count="2"/>
<equation-count count="0"/>
<ref-count count="32"/>
<page-count count="6"/>
<word-count count="4842"/>
</counts>
</article-meta>
</front>
<body>
<sec id="s1">
<title>1. Introduction</title>
<p>With the ubiquity of the internet, searching and finding information has become more accessible and widespread (Bach and Wenz, <xref ref-type="bibr" rid="B5">2020</xref>). Many people use the internet to understand their health and wellbeing (Bach and Wenz, <xref ref-type="bibr" rid="B5">2020</xref>). Motivations for such behaviors can range from knowing more about symptoms they experience to understanding the treatment of their medical conditions (Bach and Wenz, <xref ref-type="bibr" rid="B5">2020</xref>). However, increasing online health information, including misinformation, can also pose a risk to public health (Borges do Nascimento et al., <xref ref-type="bibr" rid="B6">2022</xref>; World Health Organization, <xref ref-type="bibr" rid="B32">n.d.</xref>).</p>
<p>This phenomenon of &#x0201C;<italic>too much information, including false or misleading information in digital platforms</italic>,&#x0201D; has been termed Infodemic (World Health Organization, <xref ref-type="bibr" rid="B32">n.d.</xref>). Infodemics can lead to confusion and mistrust in health authorities, lengthening disease outbreaks and undermining public health responses (Borges do Nascimento et al., <xref ref-type="bibr" rid="B6">2022</xref>; World Health Organization, <xref ref-type="bibr" rid="B32">n.d.</xref>). Thus, the World Health Organization (<xref ref-type="bibr" rid="B32">n.d.</xref>) recommended understanding community concerns and questions. While the rapid growth of internet information can amplify harmful messages (Borges do Nascimento et al., <xref ref-type="bibr" rid="B6">2022</xref>; World Health Organization, <xref ref-type="bibr" rid="B32">n.d.</xref>), internet &#x0201C;big data&#x0201D; has also been used in health informatics over the past decade to understand, analyze, and predict human behavior and concerns (Mavragani and Ochoa, <xref ref-type="bibr" rid="B18">2019</xref>). Eysenbach (<xref ref-type="bibr" rid="B10">2009</xref>) termed this field, infodemiology, a portmanteau of information and epidemiology.</p>
<p>Eysenbach (<xref ref-type="bibr" rid="B10">2009</xref>) defined infodemiology as &#x0201C;<italic>the science of distribution and determinants of information in an electronic medium, specifically the Internet, or in a population, with the ultimate aim to inform public health and public policy.&#x0201D;</italic> A popular tool in infodemiology is Google Trends, an open online tool that provides real-time and archived information about Google queries from 2004 onward (Nuti et al., <xref ref-type="bibr" rid="B22">2014</xref>; Mavragani et al., <xref ref-type="bibr" rid="B19">2018</xref>; Mavragani and Ochoa, <xref ref-type="bibr" rid="B18">2019</xref>). This minireview describes its advantages, application, methodological considerations, and limitations related to psychiatric and mental health research.</p></sec>
<sec id="s2">
<title>2. Google Trends for health research</title>
<p>To use Google Trends for research, data are retrieved by inputting a specific keyword in its &#x0201C;Explore&#x0201D; feature (Mavragani and Ochoa, <xref ref-type="bibr" rid="B18">2019</xref>). It allows the retrieval of real-time data during the last 7 days and archival data from January 2004 up to 36 h before the search is conducted by setting the desired period in various regions and countries around the globe (Mavragani and Ochoa, <xref ref-type="bibr" rid="B18">2019</xref>; <xref ref-type="bibr" rid="B13">Google, n.d.</xref>). To display interest in a specific topic from around the world to the city level, Google Trends anonymized users&#x00027; data, categorized their search queries into topics, and aggregated them together (Mavragani and Ochoa, <xref ref-type="bibr" rid="B18">2019</xref>; <xref ref-type="bibr" rid="B13">Google, n.d.</xref>). According to Google (<xref ref-type="bibr" rid="B13">n.d.</xref>), &#x0201C;<italic>each data point is divided by the total searches of the geography and time range it represents to compare relative popularity. Otherwise, places with the most search volume would always be ranked highest.&#x0201D;</italic> The resulting numbers are then scaled from 0 to 100 &#x0201C;based on a topic&#x00027;s proportion to all searches on all topics&#x0201D; (Mavragani and Ochoa, <xref ref-type="bibr" rid="B18">2019</xref>).</p>
<p>Google Trends also provides the top related queries and topics, which are the most frequently searched for terms and topics by Google users concerning the keyword of interest (Mavragani and Ochoa, <xref ref-type="bibr" rid="B18">2019</xref>; Google, <xref ref-type="bibr" rid="B13">n.d.</xref>). Likewise, it provides rising related queries and topics, which are the terms and topics with the most significant search volume growth in the requested time and location (Mavragani and Ochoa, <xref ref-type="bibr" rid="B18">2019</xref>; Google, <xref ref-type="bibr" rid="B13">n.d.</xref>). These queries and topics have been analyzed to understand other health concerns related to a particular keyword (Moalong et al., <xref ref-type="bibr" rid="B20">2021</xref>; Alibudbud, <xref ref-type="bibr" rid="B1">2022a</xref>; Alibudbud and Cleofas, <xref ref-type="bibr" rid="B3">2022</xref>; Roberto et al., <xref ref-type="bibr" rid="B25">2022</xref>).</p>
<sec>
<title>2.1. The advantages of Google Trends for health research</title>
<p>Google Trends&#x00027; popularity may stem from its predominant search engine market share and inherent advantages (Nuti et al., <xref ref-type="bibr" rid="B22">2014</xref>; Mavragani et al., <xref ref-type="bibr" rid="B19">2018</xref>; Arora et al., <xref ref-type="bibr" rid="B4">2019</xref>; Mavragani and Ochoa, <xref ref-type="bibr" rid="B18">2019</xref>). According to Statista (<xref ref-type="bibr" rid="B28">2023</xref>), Google has dominated the global search engine market since its inception and had a share of around 84.08 percent as of December 2022. This market share is far greater than other leading search engines, such as Bing (8.95%), Baidu (0.67%), and Yahoo! (2.60%). Thereby, it may represent a large proportion of the population compared to other search engine data providers. Google Trends data are also freely available, unlike other paid search engine data providers, such as Baidu Index (Fang et al., <xref ref-type="bibr" rid="B11">2021</xref>). Nonetheless, it may have limited applicability in countries where Google has limited services, such as China (Fang et al., <xref ref-type="bibr" rid="B11">2021</xref>; Dai and Han, <xref ref-type="bibr" rid="B7">2023</xref>) (<xref ref-type="table" rid="T1">Table 1</xref>).</p>
<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption><p>Advantages, applications, topics, and limitations of Google Trends for health research and psychiatric and mental health infodemiology.</p></caption> 
<table frame="box" rules="all">
<thead><tr style="background-color:#919497;color:#ffffff">
<th valign="top" align="left"><bold>Advantages of Google Trends for health research</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">1. Predominant search engine market share</td>
</tr> <tr>
<td valign="top" align="left">2. Freely available</td>
</tr> <tr>
<td valign="top" align="left">3. Inputted queries of its users may represent the actual behavior of users rather than their preferences</td>
</tr> <tr>
<td valign="top" align="left">4. Can provide real-time data</td>
</tr> <tr>
<td valign="top" align="left">5. Anonymized users&#x00027; information</td>
</tr> <tr>
<td valign="top" align="left">6. Can provide readily available data about sensitive health topics (e.g., AIDS, mental disorders)</td>
</tr> <tr>
<td valign="top" align="left"><bold>Applications of Google Trends for health research</bold></td>
</tr> <tr>
<td valign="top" align="left">1. Exploration of online public concerns, interests, and behaviors using search volumes worldwide and among and between countries</td>
</tr> <tr>
<td valign="top" align="left">2. Predictions, nowcasting, and forecasting (limited by varying degrees of correlation)</td>
</tr> <tr style="background-color:#919497;color:#ffffff">
<td valign="top" align="left"><bold>Psychiatric and mental health topics explored using Google Trends</bold></td>
</tr> <tr>
<td valign="top" align="left">1. Mental health</td>
</tr> <tr>
<td valign="top" align="left">2. Mental disorders (e.g., substance use disorder)</td>
</tr> <tr>
<td valign="top" align="left">3. Mental health service providers (e.g., psychiatrists, psychologists)</td>
</tr> <tr>
<td valign="top" align="left">4. Psychiatric sympmtoms (e.g., loneliness, self-harm)</td>
</tr> <tr>
<td valign="top" align="left">5. Psychiatric disciplines (e.g., social psychiatry)</td>
</tr> <tr style="background-color:#919497;color:#ffffff">
<td valign="top" align="left"><bold>Limitations of Google Trends for psychiatric and mental health infodemiology</bold></td>
</tr> <tr>
<td valign="top" align="left">1. Google Trends only reflects the interests and behaviors of people with internet access and those who use the Google search engine</td>
</tr> <tr>
<td valign="top" align="left">2. Limited validity in areas with low internet penetration or freedom of speech</td>
</tr> <tr>
<td valign="top" align="left">3. It provides relative values rather than absolute search volumes and queries</td>
</tr> <tr>
<td valign="top" align="left">4. The sampled queries are unknown</td>
</tr> <tr>
<td valign="top" align="left">5. The terms and idioms under their topics keywords are unknown</td>
</tr> <tr>
<td valign="top" align="left">6. There can be various reasons for changes in search behaviors</td>
</tr></tbody>
</table>
</table-wrap>
<p>Another advantage is that its data represent the inputted queries of its users, thereby representing the actual behavior rather than the users&#x00027; stated preferences (Mavragani and Ochoa, <xref ref-type="bibr" rid="B18">2019</xref>). It can also provide real-time data that can be used to monitor behavior (Mavragani and Ochoa, <xref ref-type="bibr" rid="B18">2019</xref>). Thus, it may represent difficult and time-consuming information to collect (Mavragani and Ochoa, <xref ref-type="bibr" rid="B18">2019</xref>). Likewise, it provides data about web queries by automatically anonymizing the users&#x00027; information (Mavragani and Ochoa, <xref ref-type="bibr" rid="B18">2019</xref>; Google, <xref ref-type="bibr" rid="B13">n.d.</xref>). Hence, it can provide readily available data about sensitive health topics like AIDS, mental disorders, suicide, and illegal drugs (Mavragani and Ochoa, <xref ref-type="bibr" rid="B18">2019</xref>). Furthermore, it has previously been used in predictions, nowcasting, and forecasting health-related topics (Mavragani and Ochoa, <xref ref-type="bibr" rid="B18">2019</xref>). Hence, it has been increasingly used by health researchers over the years as an indicator of public behavior. For instance, from its inception (January 2004) to January 2014, Nuti et al. (<xref ref-type="bibr" rid="B22">2014</xref>) noted 70 studies that utilized Google Trends. Among them, more than a quarter (27%) were used to explore mental health topics (Nuti et al., <xref ref-type="bibr" rid="B22">2014</xref>). By 2016, Mavragani et al. (<xref ref-type="bibr" rid="B19">2018</xref>) noted 109 studies using Google Trends.</p></sec>
<sec>
<title>2.2. Applications of Google Trends in psychiatric and mental health research</title>
<p>Over the years, Google Trends has been used to explore various topics and phenomena related to psychiatry and mental health (Nuti et al., <xref ref-type="bibr" rid="B22">2014</xref>; Mavragani and Ochoa, <xref ref-type="bibr" rid="B18">2019</xref>), such as depression (Monzani et al., <xref ref-type="bibr" rid="B21">2021</xref>; Silverio-Murillo et al., <xref ref-type="bibr" rid="B27">2021</xref>; de la Rosa et al., <xref ref-type="bibr" rid="B8">2022</xref>; Wang et al., <xref ref-type="bibr" rid="B31">2022</xref>), anxiety (Monzani et al., <xref ref-type="bibr" rid="B21">2021</xref>; de la Rosa et al., <xref ref-type="bibr" rid="B8">2022</xref>; Lekkas et al., <xref ref-type="bibr" rid="B16">2022</xref>), suicide (Kristoufek et al., <xref ref-type="bibr" rid="B15">2016</xref>; Parker et al., <xref ref-type="bibr" rid="B23">2017</xref>; Silverio-Murillo et al., <xref ref-type="bibr" rid="B27">2021</xref>; de la Rosa et al., <xref ref-type="bibr" rid="B8">2022</xref>), insomnia (Syci&#x00144;ska-Dziarnowska et al., <xref ref-type="bibr" rid="B29">2021</xref>; Lekkas et al., <xref ref-type="bibr" rid="B16">2022</xref>), stress (Silverio-Murillo et al., <xref ref-type="bibr" rid="B27">2021</xref>), substance use disorder (Parker et al., <xref ref-type="bibr" rid="B23">2017</xref>; Alibudbud and Cleofas, <xref ref-type="bibr" rid="B3">2022</xref>), neurocognitive disorder (Piamonte et al., <xref ref-type="bibr" rid="B24">2021</xref>), and mental health, itself (Alibudbud, <xref ref-type="bibr" rid="B2">2022b</xref>). It has also been used to explore online interests and concerns about mental health service providers such as psychiatrists and psychologists (Syci&#x00144;ska-Dziarnowska et al., <xref ref-type="bibr" rid="B29">2021</xref>). Likewise, it has been utilized in psychiatric and mental health research by using search volumes worldwide and among and between countries (Monzani et al., <xref ref-type="bibr" rid="B21">2021</xref>; Silverio-Murillo et al., <xref ref-type="bibr" rid="B27">2021</xref>; Syci&#x00144;ska-Dziarnowska et al., <xref ref-type="bibr" rid="B29">2021</xref>; Alibudbud, <xref ref-type="bibr" rid="B2">2022b</xref>; Alibudbud and Cleofas, <xref ref-type="bibr" rid="B3">2022</xref>; de la Rosa et al., <xref ref-type="bibr" rid="B8">2022</xref>; Lekkas et al., <xref ref-type="bibr" rid="B16">2022</xref>; Wang et al., <xref ref-type="bibr" rid="B31">2022</xref>). It has also been used to analyze specific psychiatric disciplines, such as social psychiatry (Alibudbud, <xref ref-type="bibr" rid="B1">2022a</xref>). It has been correlated with survey and surveillance datasets to predict, nowcast, and forecast particular psychiatric symptoms, such as loneliness and self-harm, with varying degrees of correlation (Mavragani and Ochoa, <xref ref-type="bibr" rid="B18">2019</xref>; Knipe et al., <xref ref-type="bibr" rid="B14">2021</xref>). Thus, future correlations with surveillance datasets of symptoms need to be explored to determine their applicability as a predictor of symptoms at a population level.</p>
<p>Nonetheless, Google Trends remains an excellent and popular tool for indodemiological studies that aim to explore and understand online public concerns, interests, and behaviors about health phenomena, including mental health (Nuti et al., <xref ref-type="bibr" rid="B22">2014</xref>; Mavragani and Ochoa, <xref ref-type="bibr" rid="B18">2019</xref>; Mavragani, <xref ref-type="bibr" rid="B17">2020</xref>; Gianfredi et al., <xref ref-type="bibr" rid="B12">2021</xref>; Rovetta, <xref ref-type="bibr" rid="B26">2021</xref>). A review by Gianfredi et al. (<xref ref-type="bibr" rid="B12">2021</xref>) reiterated that studies of online information could be used to inform mental health policies and services. Thus, it can be posited that the high utilization of infodemiological tools, including Google Trends, for psychiatric and mental health topics to inform mental health services and policies can signal the emergence of a new discipline between infodemiology, psychiatric and mental health research.</p>
<p>Drawing on the definition of infodemiology by Eysenbach (<xref ref-type="bibr" rid="B10">2009</xref>), this emerging field can be termed as &#x0201C;psychiatric and mental health infodemiology,&#x0201D; and similarly, it can be defined as the <italic>science of distribution and determinants of information in an electronic medium or in a population to inform mental health services and policies</italic>.</p></sec>
<sec>
<title>2.3. Methodological considerations in Google Trends for psychiatric and mental health infodemiology</title>
<p>Google Trends remains an excellent and popular tool in psychiatric and mental health infodemiology. However, reviews suggest that studies using Google Trends may have inconsistent methodological documentation limiting the reproducibility and replicability of their findings (Nuti et al., <xref ref-type="bibr" rid="B22">2014</xref>; Arora et al., <xref ref-type="bibr" rid="B4">2019</xref>; Mavragani and Ochoa, <xref ref-type="bibr" rid="B18">2019</xref>). Thus, this minireview describes the methodological considerations for infodemiological studies suggested by Nuti et al. (<xref ref-type="bibr" rid="B22">2014</xref>), Arora et al. (<xref ref-type="bibr" rid="B4">2019</xref>), and Mavragani and Ochoa (<xref ref-type="bibr" rid="B18">2019</xref>) to strengthen the replicability of results and methodological soundness of future psychiatric and mental health infodemiology. As a minimum, the three articles recommended that the following should be documented by studies utilizing Google Trends (<xref ref-type="table" rid="T2">Table 2</xref>).</p>
<table-wrap position="float" id="T2">
<label>Table 2</label>
<caption><p>Suggested minimum methodological documentation and consideration by studies using Google Trends for psychiatric and mental health topics.</p></caption> 
<table frame="box" rules="all">
<thead><tr style="background-color:#919497;color:#ffffff">
<th valign="top" align="left"><bold>Minimum methodological documentation by studies using Google Trends</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">1. Keyword selection</td>
</tr> <tr>
<td valign="top" align="left">2. Time period selection</td>
</tr> <tr>
<td valign="top" align="left">3. Region selection</td>
</tr> <tr>
<td valign="top" align="left">4. Query category</td>
</tr> <tr>
<td valign="top" align="left">5. Type of search</td>
</tr> <tr>
<td valign="top" align="left">6. Date of data retrieval</td>
</tr></tbody>
</table>
</table-wrap>
<sec>
<title>2.3.1. Keyword selection</title>
<p>Studies should include the exact keyword used (Nuti et al., <xref ref-type="bibr" rid="B22">2014</xref>; Arora et al., <xref ref-type="bibr" rid="B4">2019</xref>; Mavragani and Ochoa, <xref ref-type="bibr" rid="B18">2019</xref>), whether quotation marks were used (Nuti et al., <xref ref-type="bibr" rid="B22">2014</xref>), any combination of keywords (i.e., whether a &#x0201C;&#x0002B;&#x0201D; used in combining keywords) (Arora et al., <xref ref-type="bibr" rid="B4">2019</xref>; Mavragani and Ochoa, <xref ref-type="bibr" rid="B18">2019</xref>), and whether the keyword was under a &#x0201C;mental disorder,&#x0201D; &#x0201C;topic,&#x0201D; or &#x0201C;disease&#x0201D; (Mavragani and Ochoa, <xref ref-type="bibr" rid="B18">2019</xref>). Note that keywords under &#x0201C;disease&#x0201D; or &#x0201C;topics&#x0201D; can include keywords that fall within the category, or, as Google describes it, &#x0201C;<italic>topics are a group of terms that share the same concept in any language&#x0201D;</italic> (Mavragani and Ochoa, <xref ref-type="bibr" rid="B18">2019</xref>). Similarly, the reason behind choosing the keyword can also be added (Nuti et al., <xref ref-type="bibr" rid="B22">2014</xref>).</p></sec>
<sec>
<title>2.3.2. Time period selection</title>
<p>Google Trends&#x00027; search volumes and results are adjusted based on the selected location (i.e., hourly data points are shown if the period is the past 7 days, weekly data points are shown if the period is the past 5 years, and monthly data points are used if the period is beyond 5 years) (Nuti et al., <xref ref-type="bibr" rid="B22">2014</xref>; Mavragani and Ochoa, <xref ref-type="bibr" rid="B18">2019</xref>). Therefore, the exact period entered in Google Trends should be included.</p></sec>
<sec>
<title>2.3.3. Region selection</title>
<p>Similar to time selection, search volumes and results are adjusted based on the selected location (i.e., there might be different search volume results in a country and its cities or regions) (Mavragani and Ochoa, <xref ref-type="bibr" rid="B18">2019</xref>). As such, results may vary whether regions were compared (i.e., country X <italic>vis-&#x000E0;-vis</italic> country Y) (Mavragani and Ochoa, <xref ref-type="bibr" rid="B18">2019</xref>). Thus, it is imperative to include the exact region or regions selected during data retrieval.</p></sec>
<sec>
<title>2.3.4. Query category</title>
<p>Google Trends&#x00027; users can choose from 25 topic categories and more than 300 subcategories (i.e., health as a category, mental health as a subcategory) to restrict their search (Nuti et al., <xref ref-type="bibr" rid="B22">2014</xref>; Arora et al., <xref ref-type="bibr" rid="B4">2019</xref>; Mavragani and Ochoa, <xref ref-type="bibr" rid="B18">2019</xref>). Similarly, they can search all categories for a particular keyword. The results may vary according to the category used. For instance, if researchers are interested only in health-related searches, they should adjust the query category to &#x0201C;Health.&#x0201D;</p></sec>
<sec>
<title>2.3.5. Type of search</title>
<p>Users can also conduct a search using the &#x0201C;Web Search,&#x0201D; &#x0201C;Image Search,&#x0201D; &#x0201C;News Search,&#x0201D; &#x0201C;Google Shopping,&#x0201D; and &#x0201C;YouTube Search&#x0201D; options. &#x0201C;Web Search&#x0201D; is the default option and should be selected unless researchers need to search for a particular type (Mavragani and Ochoa, <xref ref-type="bibr" rid="B18">2019</xref>). In this case, it is recommended to include the rationale for these other types.</p></sec>
<sec>
<title>2.3.6. Date of data retrieval</title>
<p>Google Trends search volumes may vary slightly based on the date collected (Mavragani and Ochoa, <xref ref-type="bibr" rid="B18">2019</xref>). Thus, studies utilizing it should note the exact date when the data was retrieved. In cases where the infodemiological research may not be replicated due to adjustments in Google Trends&#x00027; algorithm, this documentation may allow data retrieval and study replications using web-archiving services and initiatives. This is because web-archiving services and initiatives may have access to past Google Trends data (Vlassenroot et al., <xref ref-type="bibr" rid="B30">2021</xref>).</p></sec></sec>
<sec>
<title>2.4. Limitations and other considerations in using Google Trends for psychiatric and mental health infodemiology</title>
<p>While Google Trends has been a useful tool for psychiatric and mental health infodemiology, it has several limitations that must be accounted for. Therefore, there is a need to address some of its important limitations in its interpretation.</p>
<p><italic>First</italic>, Google Trends only reflects the interests and behaviors of people with internet access and those who use the Google search engine (Moalong et al., <xref ref-type="bibr" rid="B20">2021</xref>; Alibudbud, <xref ref-type="bibr" rid="B1">2022a</xref>). Hence, it may not reflect the interests and behaviors of areas with limited internet connection and low Google market share. <italic>Second</italic>, a recent review by Mavragani and Ochoa (<xref ref-type="bibr" rid="B18">2019</xref>) has shown that it may have limited validity in areas with low internet penetration or freedom of speech. Thus, it can be recommended that traditional methods such as surveys be done to better understand public interest and concerns, especially if the study aims to understand the concerns of the whole public, including those who are not internet users. Similarly, other search engines, such as Bing, Baidu, Yandex, or Yahoo, can be explored in areas with low Google Search Engine usage (Mavragani, <xref ref-type="bibr" rid="B17">2020</xref>). Additionally, Google Trends can be complemented with data from other highly utilized online platforms, such as Wikipedia, to understand further online public behaviors and concerns (Mavragani, <xref ref-type="bibr" rid="B17">2020</xref>).</p>
<p><italic>Third</italic>, Google Trends provides relative values rather than absolute search volumes and queries. Thus, a particular topic&#x00027;s exact number of queries for a particular topic is unknown (Nuti et al., <xref ref-type="bibr" rid="B22">2014</xref>; Moalong et al., <xref ref-type="bibr" rid="B20">2021</xref>). <italic>Fourth</italic>, Google samples its data to provide a dataset in Google Trends that represents all Google searches for a particular topic (Google, <xref ref-type="bibr" rid="B13">n.d.</xref>). However, the sampled queries are unknown (Mavragani and Ochoa, <xref ref-type="bibr" rid="B18">2019</xref>; Rovetta, <xref ref-type="bibr" rid="B26">2021</xref>). As such, it has been noted that their data may vary slightly based on the time of retrieval (Mavragani and Ochoa, <xref ref-type="bibr" rid="B18">2019</xref>; Rovetta, <xref ref-type="bibr" rid="B26">2021</xref>; Eichenauer et al., <xref ref-type="bibr" rid="B9">2022</xref>).</p>
<p><italic>Fifth</italic>, Google takes advantage of artificial intelligence in aggregating their search queries. However, the terms and idioms subsumed under their topic keywords are unknown due to limited transparency in Google Trends&#x00027; algorithm (Nuti et al., <xref ref-type="bibr" rid="B22">2014</xref>). Thus, previous studies have recommended several measures to improve reliability and replicability, such as using statistical methods (Eichenauer et al., <xref ref-type="bibr" rid="B9">2022</xref>), to collect the average search volumes for several days (Rovetta, <xref ref-type="bibr" rid="B26">2021</xref>), or as previously recommended, noting the setting used in their methodology including the exact keywords, query category, use of quotation marks, the rationale for keyword selection, time range, location, and date of retrieval (Nuti et al., <xref ref-type="bibr" rid="B22">2014</xref>; Mavragani and Ochoa, <xref ref-type="bibr" rid="B18">2019</xref>). <italic>Sixth</italic>, there can be various reasons for changes in search behaviors about specific topics (i.e., increased media coverage) (Bach and Wenz, <xref ref-type="bibr" rid="B5">2020</xref>). Therefore, researchers must be clear on their assumptions about search behaviors and carefully interpret Google Trends data in light of their limitations.</p></sec></sec>
<sec id="s3">
<title>3. Discussion and conclusions</title>
<p>Psychiatric and mental health infodemiology can be defined as the science of distribution and determinants of information in an electronic medium or in a population to inform mental health services and policies. Since Google Trends is one of its most popular tools (Nuti et al., <xref ref-type="bibr" rid="B22">2014</xref>; Mavragani et al., <xref ref-type="bibr" rid="B19">2018</xref>; Gianfredi et al., <xref ref-type="bibr" rid="B12">2021</xref>; Syci&#x00144;ska-Dziarnowska et al., <xref ref-type="bibr" rid="B29">2021</xref>), this minireview describes its use, advantages, methodological considerations, limitations, and application to psychiatric and mental health research over the years.</p>
<p>Google Trends has been applied in health research to explore public concerns, interests, and behaviors online using search volumes, as well as to predict, nowcast, and forecast. It has been used for psychiatric and mental health infodemiology to explore mental health, mental disorders, mental health service providers, psychiatric symptoms, and psychiatric disciplines. This may be because it has several advantages, including the possible representation of a large portion of the population since it has a predominant search engine market share (Nuti et al., <xref ref-type="bibr" rid="B22">2014</xref>; Mavragani et al., <xref ref-type="bibr" rid="B19">2018</xref>; Arora et al., <xref ref-type="bibr" rid="B4">2019</xref>; Mavragani and Ochoa, <xref ref-type="bibr" rid="B18">2019</xref>). In addition, its results may represent users&#x00027; actual behaviors instead of their preferences (Mavragani and Ochoa, <xref ref-type="bibr" rid="B18">2019</xref>). It can also provide free real-time statistics and anonymized data, including data on sensitive health topics, that can be used for predictions, nowcasting, and forecasting (Mavragani and Ochoa, <xref ref-type="bibr" rid="B18">2019</xref>; Fang et al., <xref ref-type="bibr" rid="B11">2021</xref>). Several methodological considerations should also be considered in using Google Trends, including documenting the keyword, time period, region, query category, type of search, and date of data retrieval. Nonetheless, it also has several limitations, including being only reflective of people with internet access and those who use the Google search engine, limited validity in regions with low internet penetration or freedom of speech, providing relative values, unknown sampled queries, and unknown terms and idioms under their topics keywords.</p>
<p>While generally an emerging field, its future directions may be similar to the general field of infodemiology, which is the exploration, prediction, nowcasting, and forecasting of behaviors and epidemics among and between populations (Mavragani et al., <xref ref-type="bibr" rid="B19">2018</xref>; Mavragani, <xref ref-type="bibr" rid="B17">2020</xref>). However, the predictive ability and correlation of infodemiological tools remain to be fully understood, developed, and adjusted to forecast future outbreaks and the prevalence of various diseases and disorders (Nuti et al., <xref ref-type="bibr" rid="B22">2014</xref>; Mavragani et al., <xref ref-type="bibr" rid="B19">2018</xref>; Arora et al., <xref ref-type="bibr" rid="B4">2019</xref>; Knipe et al., <xref ref-type="bibr" rid="B14">2021</xref>). These challenges in predictions and correlations have also been observed in psychiatric and mental health infodemiology. For instance, Google Trends has varying predictive abilities and correlations with suicidal behaviors (Kristoufek et al., <xref ref-type="bibr" rid="B15">2016</xref>; Parker et al., <xref ref-type="bibr" rid="B23">2017</xref>). Thus, several steps can be considered in developing psychiatric and mental health infodemiology.</p>
<p>First, future studies can determine and explore models and methods to improve the predictive ability and correlation of Google Trends data in predicting mental health phenomena. By doing so, it can be used to predict trends in mental health problems that need additional intervention and prevention measures. Second, since psychiatric and mental health infodemiology is a growing and emerging field, future reviews can account for the field&#x00027;s extent and further utilization. Lastly, infodemics may negatively impact mental health (Borges do Nascimento et al., <xref ref-type="bibr" rid="B6">2022</xref>). Therefore, the applications of mental health and psychiatric infodemiology, a field at the intersection of mental health and information sciences, should be explored and developed to address infodemics and their repercussions.</p></sec>
<sec sec-type="author-contributions" id="s4">
<title>Author contributions</title>
<p>RA had substantial contributions to the design, drafting, revision, acquisition, interpretation, and final approval of the data and work.</p></sec>
</body>
<back>
<sec sec-type="COI-statement" id="conf1">
<title>Conflict of interest</title>
<p>The author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="s5">
<title>Publisher&#x00027;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Alibudbud</surname> <given-names>R.</given-names></name></person-group> (<year>2022a</year>). <article-title>Decreasing public interest in social psychiatry: an infodemiological study of worldwide Google search volumes from 2004 to 2021</article-title>. <source>Int. J. Social Psychiatry</source> <fpage>207640221090960</fpage>. <pub-id pub-id-type="doi">10.1177/00207640221090960</pub-id><pub-id pub-id-type="pmid">35443821</pub-id></citation></ref>
<ref id="B2">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Alibudbud</surname> <given-names>R.</given-names></name></person-group> (<year>2022b</year>). <article-title>Insights from an infodemiological study of mental health in Malaysia, the Philippines, Singapore, and Thailand from 2004 to 2021</article-title>. <source>Asian J. Psychiatr.</source> <volume>78</volume>, <fpage>103311</fpage>. <pub-id pub-id-type="doi">10.1016/j.ajp.2022.103311</pub-id><pub-id pub-id-type="pmid">36335844</pub-id></citation></ref>
<ref id="B3">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Alibudbud</surname> <given-names>R.</given-names></name> <name><surname>Cleofas</surname> <given-names>J. V.</given-names></name></person-group> (<year>2022</year>). <article-title>Global utilization of online information for substance use disorder: an infodemiological study of Google and Wikipedia from 2004 to 2022</article-title>. <source>J. Nurs. Scholarship</source>. <fpage>1</fpage>&#x02013;<lpage>16</lpage>. <pub-id pub-id-type="doi">10.1111/jnu.12844</pub-id><pub-id pub-id-type="pmid">36345730</pub-id></citation></ref>
<ref id="B4">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Arora</surname> <given-names>V. S.</given-names></name> <name><surname>McKee</surname> <given-names>M.</given-names></name> <name><surname>Stuckler</surname> <given-names>D.</given-names></name></person-group> (<year>2019</year>). <article-title>Google Trends: opportunities and limitations in health and health policy research</article-title>. <source>Health Policy</source> <volume>123</volume>, <fpage>338</fpage>&#x02013;<lpage>341</lpage>. <pub-id pub-id-type="doi">10.1016/j.healthpol.2019.01.001</pub-id><pub-id pub-id-type="pmid">30660346</pub-id></citation></ref>
<ref id="B5">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bach</surname> <given-names>R. L.</given-names></name> <name><surname>Wenz</surname> <given-names>A.</given-names></name></person-group> (<year>2020</year>). <article-title>Studying health-related internet and mobile device use using web logs and smartphone records</article-title>. <source>PLoS ONE</source> <volume>15</volume>, <fpage>e0234663</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0234663</pub-id><pub-id pub-id-type="pmid">32530937</pub-id></citation></ref>
<ref id="B6">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Borges do Nascimento</surname> <given-names>I. J.</given-names></name> <name><surname>Pizarro</surname> <given-names>A. B.</given-names></name> <name><surname>Almeida</surname> <given-names>J. M.</given-names></name> <name><surname>Azzopardi-Muscat</surname> <given-names>N.</given-names></name> <name><surname>Gon&#x000E7;alves</surname> <given-names>M. A.</given-names></name> <name><surname>Bj&#x000F6;rklund</surname> <given-names>M.</given-names></name> <etal/></person-group>. (<year>2022</year>). <article-title>Infodemics and health misinformation: a systematic review of reviews</article-title>. <source>Bull. World Health Organ.</source> <volume>100</volume>, <fpage>544</fpage>&#x02013;<lpage>561</lpage>. <pub-id pub-id-type="doi">10.2471/BLT.21.287654</pub-id><pub-id pub-id-type="pmid">36062247</pub-id></citation></ref>
<ref id="B7">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dai</surname> <given-names>S.</given-names></name> <name><surname>Han</surname> <given-names>L.</given-names></name></person-group> (<year>2023</year>). <article-title>Influenza surveillance with Baidu index and attention-based long short-term memory model</article-title>. <source>PLoS ONE</source> <volume>18</volume>, <fpage>e0280834</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0280834</pub-id><pub-id pub-id-type="pmid">36689543</pub-id></citation></ref>
<ref id="B8">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>de la Rosa</surname> <given-names>P. A.</given-names></name> <name><surname>Cowden</surname> <given-names>R. G.</given-names></name> <name><surname>de Filippis</surname> <given-names>R.</given-names></name> <name><surname>Jerotic</surname> <given-names>S.</given-names></name> <name><surname>Nahidi</surname> <given-names>M.</given-names></name> <name><surname>Ori</surname> <given-names>D.</given-names></name> <etal/></person-group>. (<year>2022</year>). <article-title>Associations of lockdown stringency and duration with Google searches for mental health terms during the COVID-19 pandemic: a nine-country study</article-title>. <source>J. Psychiatr. Res.</source> <volume>150</volume>, <fpage>237</fpage>&#x02013;<lpage>245</lpage>. <pub-id pub-id-type="doi">10.1016/j.jpsychires.2022.03.026</pub-id><pub-id pub-id-type="pmid">35398667</pub-id></citation></ref>
<ref id="B9">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Eichenauer</surname> <given-names>V. Z.</given-names></name> <name><surname>Indergand</surname> <given-names>R.</given-names></name> <name><surname>Mart&#x000ED;nez</surname> <given-names>I. Z.</given-names></name> <name><surname>Sax</surname> <given-names>C.</given-names></name></person-group> (<year>2022</year>). <article-title>Obtaining consistent time series from Google Trends</article-title>. <source>Econ. Inq.</source> <volume>60</volume>, <fpage>694</fpage>&#x02013;<lpage>705</lpage>. <pub-id pub-id-type="doi">10.1111/ecin.13049</pub-id></citation>
</ref>
<ref id="B10">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Eysenbach</surname> <given-names>G.</given-names></name></person-group> (<year>2009</year>). <article-title>Infodemiology and infoveillance: framework for an emerging set of public health informatics methods to analyze search, communication and publication behavior on the internet</article-title>. <source>J. Med. Internet Res.</source> <volume>11</volume>, <fpage>e11</fpage>. <pub-id pub-id-type="doi">10.2196/jmir.1157</pub-id><pub-id pub-id-type="pmid">19329408</pub-id></citation></ref>
<ref id="B11">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fang</surname> <given-names>J.</given-names></name> <name><surname>Zhang</surname> <given-names>X.</given-names></name> <name><surname>Tong</surname> <given-names>Y.</given-names></name> <name><surname>Xia</surname> <given-names>Y.</given-names></name> <name><surname>Liu</surname> <given-names>H.</given-names></name> <name><surname>Wu</surname> <given-names>K.</given-names></name></person-group> (<year>2021</year>). <article-title>Baidu index and COVID-19 epidemic forecast: evidence from China</article-title>. <source>Front. Public Health</source> <volume>9</volume>, <fpage>685141</fpage>. <pub-id pub-id-type="doi">10.3389/fpubh.2021.685141</pub-id><pub-id pub-id-type="pmid">34026721</pub-id></citation></ref>
<ref id="B12">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gianfredi</surname> <given-names>V.</given-names></name> <name><surname>Provenzano</surname> <given-names>S.</given-names></name> <name><surname>Santangelo</surname> <given-names>O. E.</given-names></name></person-group> (<year>2021</year>). <article-title>What can internet users&#x00027; behaviours reveal about the mental health impacts of the COVID-19 pandemic? A systematic review</article-title>. <source>Public health</source> <volume>198</volume>, <fpage>44</fpage>&#x02013;<lpage>52</lpage>. <pub-id pub-id-type="doi">10.1016/j.puhe.2021.06.024</pub-id><pub-id pub-id-type="pmid">34352615</pub-id></citation></ref>
<ref id="B13">
<citation citation-type="web"><person-group person-group-type="author"><collab>Google (n.d.)</collab></person-group>. <source>FAQ About Google Trends Data</source>. Google. Available online at: <ext-link ext-link-type="uri" xlink:href="https://support.google.com/trends/answer/4365533?hl=en">https://support.google.com/trends/answer/4365533?hl=en</ext-link> (accessed February 16, 2023).</citation>
</ref>
<ref id="B14">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Knipe</surname> <given-names>D.</given-names></name> <name><surname>Gunnell</surname> <given-names>D.</given-names></name> <name><surname>Evans</surname> <given-names>H.</given-names></name> <name><surname>John</surname> <given-names>A.</given-names></name> <name><surname>Fancourt</surname> <given-names>D.</given-names></name></person-group> (<year>2021</year>). <article-title>Is Google Trends a useful tool for tracking mental and social distress during a public health emergency? A time-series analysis</article-title>. <source>J. Affect. Disord.</source> <volume>294</volume>, <fpage>737</fpage>&#x02013;<lpage>744</lpage>. <pub-id pub-id-type="doi">10.1016/j.jad.2021.06.086</pub-id><pub-id pub-id-type="pmid">34348169</pub-id></citation></ref>
<ref id="B15">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kristoufek</surname> <given-names>L.</given-names></name> <name><surname>Moat</surname> <given-names>H. S.</given-names></name> <name><surname>Preis</surname> <given-names>T.</given-names></name></person-group> (<year>2016</year>). <article-title>Estimating suicide occurrence statistics using Google Trends</article-title>. <source>EPJ Data Sci.</source> <volume>5</volume>, <fpage>32</fpage>. <pub-id pub-id-type="doi">10.1140/epjds/s13688-016-0094-0</pub-id><pub-id pub-id-type="pmid">32355600</pub-id></citation></ref>
<ref id="B16">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lekkas</surname> <given-names>D.</given-names></name> <name><surname>Gyorda</surname> <given-names>J. A.</given-names></name> <name><surname>Price</surname> <given-names>G. D.</given-names></name> <name><surname>Wortzman</surname> <given-names>Z.</given-names></name> <name><surname>Jacobson</surname> <given-names>N. C.</given-names></name></person-group> (<year>2022</year>). <article-title>Using the COVID-19 pandemic to assess the influence of news affect on online mental health-related search behavior across the United States: integrated sentiment analysis and the circumplex model of affect</article-title>. <source>J. Med. Internet Res.</source> <volume>24</volume>, <fpage>e32731</fpage>. <pub-id pub-id-type="doi">10.2196/32731</pub-id><pub-id pub-id-type="pmid">34932494</pub-id></citation></ref>
<ref id="B17">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mavragani</surname> <given-names>A.</given-names></name></person-group> (<year>2020</year>). <article-title>Infodemiology and infoveillance: scoping review</article-title>. <source>J. Med. Internet Res.</source> <volume>22</volume>, <fpage>e16206</fpage>. <pub-id pub-id-type="doi">10.2196/16206</pub-id><pub-id pub-id-type="pmid">32310818</pub-id></citation></ref>
<ref id="B18">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mavragani</surname> <given-names>A.</given-names></name> <name><surname>Ochoa</surname> <given-names>G.</given-names></name></person-group> (<year>2019</year>). <article-title>Google Trends in infodemiology and infoveillance: methodology framework</article-title>. <source>JMIR Public Health Surv.</source> <volume>5</volume>:<fpage>e13439</fpage>. <pub-id pub-id-type="doi">10.2196/13439</pub-id><pub-id pub-id-type="pmid">31144671</pub-id></citation></ref>
<ref id="B19">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mavragani</surname> <given-names>A.</given-names></name> <name><surname>Ochoa</surname> <given-names>G.</given-names></name> <name><surname>Tsagarakis</surname> <given-names>K. P.</given-names></name></person-group> (<year>2018</year>). <article-title>Assessing the methods, tools, and statistical approaches in Google Trends research: systematic review</article-title>. <source>J. Med. Internet Res.</source> <volume>20</volume>, <fpage>e270</fpage>. <pub-id pub-id-type="doi">10.2196/jmir.9366</pub-id><pub-id pub-id-type="pmid">30401664</pub-id></citation></ref>
<ref id="B20">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Moalong</surname> <given-names>K. M. C.</given-names></name> <name><surname>Jamora</surname> <given-names>R. D. G.</given-names></name> <name><surname>Roberto</surname> <given-names>K. T.</given-names></name> <name><surname>Espiritu</surname> <given-names>A. I.</given-names></name></person-group> (<year>2021</year>). <article-title>Patterns of Google search behavior for epilepsy and seizures in the Philippines: an infodemiological study</article-title>. <source>Epilepsy Behav.</source> <volume>125</volume>, <fpage>108377</fpage>. <pub-id pub-id-type="doi">10.1016/j.yebeh.2021.108377</pub-id><pub-id pub-id-type="pmid">34717171</pub-id></citation></ref>
<ref id="B21">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Monzani</surname> <given-names>D.</given-names></name> <name><surname>Vergani</surname> <given-names>L.</given-names></name> <name><surname>Marton</surname> <given-names>G.</given-names></name> <name><surname>Pizzoli</surname> <given-names>S. F. M.</given-names></name> <name><surname>Pravettoni</surname> <given-names>G.</given-names></name></person-group> (<year>2021</year>). <article-title>When in doubt, Google it: distress-related information seeking in Italy during the COVID-19 pandemic</article-title>. <source>BMC Public Health</source> <volume>21</volume>, <fpage>1902</fpage>. <pub-id pub-id-type="doi">10.1186/s12889-021-11887-2</pub-id><pub-id pub-id-type="pmid">34670540</pub-id></citation></ref>
<ref id="B22">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nuti</surname> <given-names>S. V.</given-names></name> <name><surname>Wayda</surname> <given-names>B.</given-names></name> <name><surname>Ranasinghe</surname> <given-names>I.</given-names></name> <name><surname>Wang</surname> <given-names>S.</given-names></name> <name><surname>Dreyer</surname> <given-names>R. P.</given-names></name> <name><surname>Chen</surname> <given-names>S. I.</given-names></name> <etal/></person-group>. (<year>2014</year>). <article-title>The use of google trends in health care research: a systematic review</article-title>. <source>PLoS ONE</source> <volume>9</volume>, <fpage>e109583</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0109583</pub-id><pub-id pub-id-type="pmid">25337815</pub-id></citation></ref>
<ref id="B23">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Parker</surname> <given-names>J.</given-names></name> <name><surname>Cuthbertson</surname> <given-names>C.</given-names></name> <name><surname>Loveridge</surname> <given-names>S.</given-names></name> <name><surname>Skidmore</surname> <given-names>M.</given-names></name> <name><surname>Dyar</surname> <given-names>W.</given-names></name></person-group> (<year>2017</year>). <article-title>Forecasting state-level premature deaths from alcohol, drugs, and suicides using Google Trends data</article-title>. <source>J. Affect. Disord.</source> <volume>213</volume>, <fpage>9</fpage>&#x02013;<lpage>15</lpage>. <pub-id pub-id-type="doi">10.1016/j.jad.2016.10.038</pub-id><pub-id pub-id-type="pmid">28171770</pub-id></citation></ref>
<ref id="B24">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Piamonte</surname> <given-names>B. L. C.</given-names></name> <name><surname>Anlacan</surname> <given-names>V. M. M.</given-names></name> <name><surname>Jamora</surname> <given-names>R. D. G.</given-names></name> <name><surname>Espiritu</surname> <given-names>A. I.</given-names></name></person-group> (<year>2021</year>). <article-title>Googling Alzheimer disease: an infodemiological and ecological study</article-title>. <source>Dement. Geriatr. Cogn. Dis. Extra</source> <volume>11</volume>, <fpage>333</fpage>&#x02013;<lpage>339</lpage>. <pub-id pub-id-type="doi">10.1159/000520692</pub-id><pub-id pub-id-type="pmid">35111193</pub-id></citation></ref>
<ref id="B25">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Roberto</surname> <given-names>K. T.</given-names></name> <name><surname>Jamora</surname> <given-names>R. D. G.</given-names></name> <name><surname>Moalong</surname> <given-names>K. M. C.</given-names></name> <name><surname>Espiritu</surname> <given-names>A. I.</given-names></name></person-group> (<year>2022</year>). <article-title>Infodemiology of autoimmune encephalitis, autoimmune seizures, and autoimmune epilepsy: an analysis of online search behavior using Google Trends</article-title>. <source>Epilepsy Behav.</source> <volume>132</volume>, <fpage>108730</fpage>. <pub-id pub-id-type="doi">10.1016/j.yebeh.2022.108730</pub-id><pub-id pub-id-type="pmid">35623205</pub-id></citation></ref>
<ref id="B26">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rovetta</surname> <given-names>A.</given-names></name></person-group> (<year>2021</year>). <article-title>Reliability of Google Trends: analysis of the limits and potential of web infoveillance during COVID-19 pandemic and for future research</article-title>. <source>Front. Res. Metrics Anal.</source> <volume>6</volume>, <fpage>670226</fpage>. <pub-id pub-id-type="doi">10.3389/frma.2021.670226</pub-id><pub-id pub-id-type="pmid">34113751</pub-id></citation></ref>
<ref id="B27">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Silverio-Murillo</surname> <given-names>A.</given-names></name> <name><surname>Hoehn-Velasco</surname> <given-names>L.</given-names></name> <name><surname>Rodriguez Tirado</surname> <given-names>A.</given-names></name> <name><surname>Balmori de la Miyar</surname> <given-names>J. R.</given-names></name></person-group> (<year>2021</year>). <article-title>COVID-19 blues: lockdowns and mental health-related google searches in Latin America</article-title>. <source>Social Sci. Med. (1982)</source> <volume>281</volume>, <fpage>114040</fpage>. <pub-id pub-id-type="doi">10.1016/j.socscimed.2021.114040</pub-id><pub-id pub-id-type="pmid">34144481</pub-id></citation></ref>
<ref id="B28">
<citation citation-type="web"><person-group person-group-type="author"><collab>Statista</collab></person-group> (<year>2023</year>). <source>Worldwide Desktop Market Share of Leading Search Engines From January 2015 to December 2022. Statista</source>. Available online at: <ext-link ext-link-type="uri" xlink:href="https://www.statista.com/statistics/216573/worldwide-market-share-of-search-engines/">https://www.statista.com/statistics/216573/worldwide-market-share-of-search-engines/</ext-link> (accessed February 16, 2023).</citation>
</ref>
<ref id="B29">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Syci&#x00144;ska-Dziarnowska</surname> <given-names>M.</given-names></name> <name><surname>Szyszka-Sommerfeld</surname> <given-names>L.</given-names></name> <name><surname>K&#x00142;oda</surname> <given-names>K.</given-names></name> <name><surname>Simeone</surname> <given-names>M.</given-names></name> <name><surname>Wozniak</surname> <given-names>K.</given-names></name> <name><surname>Spagnuolo</surname> <given-names>G.</given-names></name></person-group> (<year>2021</year>). <article-title>Mental health interest and its prediction during the COVID-19 pandemic using Google Trends</article-title>. <source>Int. J. Environ. Res. Public Health</source> <volume>18</volume>, <fpage>12369</fpage>. <pub-id pub-id-type="doi">10.3390/ijerph182312369</pub-id><pub-id pub-id-type="pmid">34886094</pub-id></citation></ref>
<ref id="B30">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Vlassenroot</surname> <given-names>E.</given-names></name> <name><surname>Chambers</surname> <given-names>S.</given-names></name> <name><surname>Lieber</surname> <given-names>S.</given-names></name> <name><surname>Michel</surname> <given-names>A.</given-names></name> <name><surname>Geeraert</surname> <given-names>F.</given-names></name> <name><surname>Pranger</surname> <given-names>J.</given-names></name> <etal/></person-group>. (<year>2021</year>). <article-title>Web-archiving and social media: an exploratory analysis: call for papers digital humanities and web archives&#x02014;a special issue of international journal of digital humanities</article-title>. <source>Int. J. Digital Human.</source> <volume>2</volume>, <fpage>107</fpage>&#x02013;<lpage>128</lpage>. <pub-id pub-id-type="doi">10.1007/s42803-021-00036-1</pub-id></citation>
</ref>
<ref id="B31">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wang</surname> <given-names>A.</given-names></name> <name><surname>McCarron</surname> <given-names>R.</given-names></name> <name><surname>Azzam</surname> <given-names>D.</given-names></name> <name><surname>Stehli</surname> <given-names>A.</given-names></name> <name><surname>Xiong</surname> <given-names>G.</given-names></name> <name><surname>DeMartini</surname> <given-names>J.</given-names></name></person-group> (<year>2022</year>). <article-title>Utilizing Big Data from Google Trends to map population depression in the United States: exploratory infodemiology study</article-title>. <source>JMIR Mental Health</source> <volume>9</volume>, <fpage>e35253</fpage>. <pub-id pub-id-type="doi">10.2196/35253</pub-id><pub-id pub-id-type="pmid">35357320</pub-id></citation></ref>
<ref id="B32">
<citation citation-type="web"><person-group person-group-type="author"><collab>World Health Organization (n.d.)</collab></person-group>. <source>Infodemic</source>. <publisher-name>World Health Organization</publisher-name>. Available online at: <ext-link ext-link-type="uri" xlink:href="https://www.who.int/health-topics/infodemic&#x00023;tab=tab_1">https://www.who.int/health-topics/infodemic&#x00023;tab=tab_1</ext-link> (accessed February 16 2023).</citation>
</ref>
</ref-list> 
</back>
</article> 