<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Public Health</journal-id>
<journal-title>Frontiers in Public Health</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Public Health</abbrev-journal-title>
<issn pub-type="epub">2296-2565</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fpubh.2022.1061590</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Public Health</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Mind the gap: Exploring differences in suicide literacy between cybersuicide and offline suicide</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Li</surname> <given-names>Ang</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x0002A;</sup></xref>
</contrib>
<contrib contrib-type="author">
<name><surname>Jiao</surname> <given-names>Dongdong</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Department of Psychology, Beijing Forestry University</institution>, <addr-line>Beijing</addr-line>, <country>China</country></aff>
<aff id="aff2"><sup>2</sup><institution>National Computer System Engineering Research Institute of China</institution>, <addr-line>Beijing</addr-line>, <country>China</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Wulf R&#x000F6;ssler, Charit&#x000E9; Universit&#x000E4;tsmedizin Berlin, Germany</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Zepeng Huang, Second Affiliated Hospital of Shantou University Medical College, China; Sijia Li, The University of Hong Kong, Hong Kong SAR, China</p></fn>
<corresp id="c001">&#x0002A;Correspondence: Ang Li &#x02709; <email>angli&#x00040;bjfu.edu.cn</email></corresp>
<fn fn-type="other" id="fn001"><p>This article was submitted to Public Mental Health, a section of the journal Frontiers in Public Health</p></fn></author-notes>
<pub-date pub-type="epub">
<day>16</day>
<month>01</month>
<year>2023</year>
</pub-date>
<pub-date pub-type="collection">
<year>2022</year>
</pub-date>
<volume>10</volume>
<elocation-id>1061590</elocation-id>
<history>
<date date-type="received">
<day>04</day>
<month>10</month>
<year>2022</year>
</date>
<date date-type="accepted">
<day>23</day>
<month>12</month>
<year>2022</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2023 Li and Jiao.</copyright-statement>
<copyright-year>2023</copyright-year>
<copyright-holder>Li and Jiao</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license> </permissions>
<abstract>
<sec>
<title>Introduction</title>
<p>The highly public nature of cybersuicide contradicts long-held beliefs of offline suicide, which may cause differences in the way people perceive and respond to both of them. However, knowledge of whether and how suicide literacy differs between cybersuicide and offline suicide is limited.</p></sec>
<sec>
<title>Methods</title>
<p>By analyzing social media data, this paper focused on livestreamed suicide and aimed to compare suicide literacy between cybersuicide and offline suicide on three aspects, including false knowledge structure, extent of association with stigma, and linguistic expression pattern. 7,236 Sina Weibo posts with relevant keywords were downloaded and analyzed. First, a content analysis was performed by human coders to determine whether each post reflected suicide-related false knowledge and stigma. Second, a text analysis was conducted using the Simplified Chinese version of LIWC software to automatically extract psycholinguistic features from each post. Third, based on selected features, classification models were developed using machine learning techniques to differentiate false knowledge of cybersuicide from that of offline suicide.</p></sec>
<sec>
<title>Results</title>
<p>Results showed that, first, cybersuicide-related posts generally reflected more false knowledge than offline suicide-related posts (<inline-formula><mml:math id="M1"><mml:msubsup><mml:mrow><mml:mi>&#x003C7;</mml:mi></mml:mrow><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup><mml:mo>=</mml:mo></mml:math></inline-formula>255.13, <italic>p</italic> &#x0003C; 0.001). Significant differences were also observed in seven false knowledge types. Second, among posts reflecting false knowledge, cybersuicide-related posts generally carried more stigma than offline suicide-related posts (<inline-formula><mml:math id="M2"><mml:msubsup><mml:mrow><mml:mi>&#x003C7;</mml:mi></mml:mrow><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup></mml:math></inline-formula> = 116.77, <italic>p</italic> &#x0003C; 0.001). Significant differences were also observed in three false knowledge types. Third, among established classification models, the highest F1 value reached 0.70.</p></sec>
<sec>
<title>Discussion</title>
<p>The findings provide evidence of differences in suicide literacy between cybersuicide and offline suicide, and indicate the need for public awareness campaigns that specifically target cybersuicide.</p></sec></abstract>
<kwd-group>
<kwd>suicide literacy</kwd>
<kwd>cybersuicide</kwd>
<kwd>psycholinguistic analysis</kwd>
<kwd>LIWC</kwd>
<kwd>social media</kwd>
</kwd-group>
<counts>
<fig-count count="3"/>
<table-count count="4"/>
<equation-count count="0"/>
<ref-count count="26"/>
<page-count count="8"/>
<word-count count="5165"/>
</counts>
</article-meta>
</front>
<body>
<sec id="s1">
<title>1. Introduction</title>
<p>Mental health literacy refers to &#x0201C;knowledge and beliefs about mental disorders which aid their recognition, management or prevention&#x0201D; (<xref ref-type="bibr" rid="B1">1</xref>). Low mental health literacy is known to negatively affect health outcomes for people with mental disorders, particularly when stigma is also present (<xref ref-type="bibr" rid="B2">2</xref>, <xref ref-type="bibr" rid="B3">3</xref>). Promising practices for improving mental health literacy should be designed to suit the targeted audience (<xref ref-type="bibr" rid="B4">4</xref>). Therefore, it is important to understand the content and nature of false knowledge and beliefs that people hold about specific mental disorders.</p>
<p>Suicide is one of the leading causes of death across all ages, especially among adolescents (<xref ref-type="bibr" rid="B5">5</xref>, <xref ref-type="bibr" rid="B6">6</xref>). Suicide itself is not a specific mental disorder, but one of the most important factors that cause suicide is mental disorders. Improving suicide literacy (public knowledge about the causes, risk factors, treatment and prevention of suicide) may lead to better outcomes for those at suicide risk. In recent decades, the development of internet creates a new form of suicide that covers a variety of internet-mediated suicidal behaviors and phenomena (i.e., cybersuicide) (<xref ref-type="bibr" rid="B7">7</xref>). Unlike the traditional form of suicide that is not influenced by the internet (i.e., offline suicide), cybersuicide enables suicidal people to share suicidal thoughts and behaviors with their online social networks, and allows real time interaction between suicidal people and their audience. Therefore, the highly public nature of cybersuicide contradicts long-held beliefs of offline suicide that suicide should be a personal and private action (<xref ref-type="bibr" rid="B8">8</xref>, <xref ref-type="bibr" rid="B9">9</xref>). This contradiction implies the internet is changing the context and socio-cultural norms of death-related behaviors and phenomena, which may influence the way people perceive and respond to suicide (<xref ref-type="bibr" rid="B10">10</xref>, <xref ref-type="bibr" rid="B11">11</xref>).</p>
<p>In recent years, considerable research effort has been devoted to investigating public reaction to cybersuicide. Results showed that cybersuicide carries more stigma than offline suicide (<xref ref-type="bibr" rid="B12">12</xref>&#x02013;<xref ref-type="bibr" rid="B15">15</xref>). Besides, significant differences were also found between cybersuicide and offline suicide in linguistic pattern of stigmatizing expressions (<xref ref-type="bibr" rid="B12">12</xref>). These findings provide evidence that the public reacts differently to cybersuicide and offline suicide. However, knowledge of whether and how suicide literacy differs between cybersuicide and offline suicide is still very limited.</p>
<p>To address this concern, by analyzing Chinese social media data, this study purposed to systematically investigate differences in suicide literacy between cybersuicide and offline suicide on three aspects, including false knowledge structure, extent of association with stigma, and linguistic expression pattern.</p>
<p>It is worth noting here that, in China, livestreamed suicide is one of the most common forms of cybersuicide (<xref ref-type="bibr" rid="B16">16</xref>, <xref ref-type="bibr" rid="B17">17</xref>). Therefore, it is expected that the public should feel more familiar with livestreamed suicide than other forms of cybersuicide, and subsequently should be more likely to express their opinions about livestreamed suicide on social media. Therefore, in order to collect sufficient cybersuicide-related social media data, this study mainly focused on livestreamed suicide and compared this representative form of cybersuicide with offline suicide.</p></sec>
<sec id="s2">
<title>2. Materials and methods</title>
<p>Research process of this study consisted of three stages, including (i) data collection, (ii) data preprocessing, and (iii) data analysis. All data were obtained from Sina Weibo, a popular Chinese microblogging website. Research process is shown in <xref ref-type="fig" rid="F1">Figure 1</xref>.</p>
<fig id="F1" position="float">
<label>Figure 1</label>
<caption><p>The research process.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fpubh-10-1061590-g0001.tif"/>
</fig>
<p>This study was reviewed and approved by the Institutional Review Board of the Institute of Psychology, Chinese Academy of Sciences (protocol number: H15009). Because this study collected and analyzed publicly available social media data and involved no personally identifiable data, the ethics committee waived the requirement of written informed consent for participation.</p>
<sec>
<title>2.1. Data collection</title>
<p>Weibo posts with relevant keywords were obtained from a self-established dataset, which was composed of 1.06 million active Weibo users and all their publicly available Weibo posts since registration (<xref ref-type="bibr" rid="B18">18</xref>). Keywords indicating cybersuicide and offline suicide were selected respectively, including &#x0201C;livestreamed suicide&#x0201D; (&#x076F4;&#x064AD;&#x081EA;&#x06740;, &#x081EA;&#x06740;&#x076F4;&#x064AD;) and &#x0201C;suicide&#x0201D; (&#x081EA;&#x06740;). It is worth noting here that, in China, offline suicide is much more prevalent than cybersuicide. Therefore, unless otherwise specified, this term &#x0201C;suicide&#x0201D; is commonly used to refer to offline suicide in China.</p>
<p>In May 2020, selected keywords were used to search the dataset and download 4,460 posts with keywords &#x0201C;livestreamed suicide&#x0201D; and 933,172 posts with keywords &#x0201C;suicide&#x0201D; (but without keywords &#x0201C;livestreamed suicide&#x0201D;), respectively.</p></sec>
<sec>
<title>2.2. Data preprocessing</title>
<p>After data collection, data preprocessing was performed to transform raw data into quality data that is ready for further analysis.</p>
<p>First, 4,500 posts were randomly selected from offline suicide group to balance the number of posts between cybersuicide group and offline suicide group (cybersuicide: 4,460 posts; offline suicide: 4,500 posts).</p>
<p>Second, on downloaded posts, manual scrutiny of irrelevant posts was performed by an experienced researcher. In this study, irrelevant posts were defined as those describing suicide in fiction works and animals (e.g., movies and pets) or talking about suicide without suicidal purposes (e.g., making jokes). After removal of 1,716 irrelevant posts, there remained 7,244 posts (cybersuicide: 4,324 posts; offline suicide: 2,920 posts).</p>
<p>Third, during manual scrutiny of irrelevant posts, 77 mislabeled posts from offline suicide group were reclassified as cybersuicide-related posts. Among these mislabeled posts, 69, 4, 2, and 2 posts were related to livestreamed suicide, suicide &#x0201C;game&#x0201D;, prosuicide website and forum, and internet suicide pact, respectively. Because this study exclusively focused on livestreamed suicide, eight posts associated with other three forms of cybersuicide were not involved in further data analysis. Finally, in this study, the sample size reached 7,236 posts, including 4,393 cybersuicide-related posts (men: 2,473 posts; women: 1,920 posts) and 2,843 offline suicide-related posts (men: 1,589 posts; women: 1,254 posts).</p>
<p>Fourth, text analysis was conducted using the Simplified Chinese version of LIWC software (SCLIWC) to automatically extract psycholinguistic features from each of 7,236 posts. SCLIWC is a lexicon-based tool that aggregates individual words into semantic and syntactic categories (<xref ref-type="bibr" rid="B19">19</xref>). For each post, after computation of word frequency in psychologically meaningful categories, standardized values of psycholinguistic features were estimated accordingly.</p></sec>
<sec>
<title>2.3. Data analysis</title>
<p>In this study, data analyses were carried out in two phases, including human coding and computational model training. Specifically, in the phase of human coding, analyses were made for exploring differences in false knowledge structure and extent of association with stigma between cybersuicide and offline suicide; while in the phase of computational model training, analyses were made for exploring differences in linguistic expression pattern between cybersuicide and offline suicide.</p>
<sec>
<title>2.3.1. Human coding</title>
<p>All 7,236 posts were analyzed manually by two independent human coders to determine whether each post reflected suicide-related false knowledge and stigma. The coding framework of suicide literacy was based on available evidence and expert consensus, which finally contained 11 items from Calear&#x00027;s Literacy of Suicide Scale (LOSS) (<xref ref-type="bibr" rid="B20">20</xref>) (<xref ref-type="table" rid="T1">Table 1</xref>). Details on coding framework and coding results of stigma can be found in another paper (<xref ref-type="bibr" rid="B12">12</xref>).</p>
<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption><p>Results of human coding for suicide literacy: <italic>n</italic> = 863.</p></caption>
<table frame="box" rules="all">
<thead><tr>
<th valign="top" align="left" style="background-color:#919497;color:#ffffff"><bold>False knowledge types</bold></th>
<th valign="top" align="center" colspan="2" style="background-color:#919497;color:#ffffff"><bold>Unbalanced dataset</bold></th>
<th valign="top" align="center" colspan="2" style="background-color:#919497;color:#ffffff"><bold>Balanced dataset</bold></th>
</tr>
</thead>
<tbody>
 <tr>
<td style="background-color:#919497;color:#ffffff"></td>
<td valign="top" align="center" style="background-color:#919497;color:#ffffff"><bold>Cybersuicide</bold></td>
<td valign="top" align="center" style="background-color:#919497;color:#ffffff"><bold>Offline suicide</bold></td>
<td valign="top" align="center" style="background-color:#919497;color:#ffffff"><bold>Cybersuicide</bold></td>
<td valign="top" align="center" style="background-color:#919497;color:#ffffff"><bold>Offline suicide</bold></td>
</tr>
<tr>
<td style="background-color:#919497;color:#ffffff"></td>
<td valign="top" align="center" style="background-color:#919497;color:#ffffff"><bold>(</bold><italic><bold>n</bold></italic>=<bold>739)</bold></td>
<td valign="top" align="center" style="background-color:#919497;color:#ffffff"><bold>(</bold><italic><bold>n</bold></italic>=<bold>124)</bold></td>
<td valign="top" align="center" style="background-color:#919497;color:#ffffff"><bold>(</bold><italic><bold>n</bold></italic>=<bold>76)</bold></td>
<td valign="top" align="center" style="background-color:#919497;color:#ffffff"><bold>(</bold><italic><bold>n</bold></italic>=<bold>76)</bold></td>
</tr> <tr>
<td valign="top" align="left">1 &#x0201C;Unpreventable&#x0201D;: nothing can be done to stop people from making the attempt once they have made up their minds to kill themselves</td>
<td valign="top" align="center">9 (1.22%)</td>
<td valign="top" align="center">2 (1.61%)</td>
<td valign="top" align="center">2 (2.63%)</td>
<td valign="top" align="center">2 (2.63%)</td>
</tr> <tr>
<td valign="top" align="left">2 &#x0201C;Should keep secrets&#x0201D;: people who have thoughts about suicide should not tell others about it</td>
<td valign="top" align="center">176 (23.82%)</td>
<td valign="top" align="center">16 (12.90%)</td>
<td valign="top" align="center">16 (21.05%)</td>
<td valign="top" align="center">16 (21.05%)</td>
</tr> <tr>
<td valign="top" align="left">3 &#x0201C;Well-planned&#x0201D;: all people who attempt suicide plan their attempt in advance</td>
<td valign="top" align="center">4 (0.54%)</td>
<td valign="top" align="center">49 (39.52%)</td>
<td valign="top" align="center">4 (5.26%)</td>
<td valign="top" align="center">4 (5.26%)</td>
</tr> <tr>
<td valign="top" align="left">4 &#x0201C;No future plans&#x0201D;: most people who suicide don&#x00027;t make future plans</td>
<td valign="top" align="center">10 (1.35%)</td>
<td valign="top" align="center">7 (5.65%)</td>
<td valign="top" align="center">7 (9.21%)</td>
<td valign="top" align="center">7 (9.21%)</td>
</tr> <tr>
<td valign="top" align="left">5 &#x0201C;Must &#x02018;succeed&#x0201D;&#x00027;: very few people who attempt suicide fail to kill themselves</td>
<td valign="top" align="center">51 (6.90%)</td>
<td valign="top" align="center">4 (3.23%)</td>
<td valign="top" align="center">4 (5.26%)</td>
<td valign="top" align="center">4 (5.26%)</td>
</tr> <tr>
<td valign="top" align="left">6 &#x0201C;Manipulating/attracting attention&#x0201D;: those who attempt suicide do so only to manipulate others and attract attention to themselves</td>
<td valign="top" align="center">380 (51.42%)</td>
<td valign="top" align="center">23 (18.55%)</td>
<td valign="top" align="center">23 (30.26%)</td>
<td valign="top" align="center">23 (30.26%)</td>
</tr> <tr>
<td valign="top" align="left">7 &#x0201C;Mentally ill&#x0201D;: a person who suicides is mentally ill</td>
<td valign="top" align="center">3 (0.41%)</td>
<td valign="top" align="center">6 (4.84%)</td>
<td valign="top" align="center">3 (3.95%)</td>
<td valign="top" align="center">3 (3.95%)</td>
</tr> <tr>
<td valign="top" align="left">8 &#x0201C;Depressed&#x0201D;: if assessed by a psychiatrist, everyone who suicides would be diagnosed as depressed</td>
<td valign="top" align="center">7 (0.95%)</td>
<td valign="top" align="center">6 (4.84%)</td>
<td valign="top" align="center">6 (7.89%)</td>
<td valign="top" align="center">6 (7.89%)</td>
</tr> <tr>
<td valign="top" align="left">9 &#x0201C;No change of mind&#x0201D;: people who want to attempt suicide cannot change their mind quickly</td>
<td valign="top" align="center">26 (3.52%)</td>
<td valign="top" align="center">7 (5.65%)</td>
<td valign="top" align="center">7 (9.21%)</td>
<td valign="top" align="center">7 (9.21%)</td>
</tr> <tr>
<td valign="top" align="left">10 &#x0201C;Stop media coverage of suicide&#x0201D;: media coverage of suicide will inevitably encourage other people to attempt suicide</td>
<td valign="top" align="center">72 (9.74%)</td>
<td valign="top" align="center">3 (2.42%)</td>
<td valign="top" align="center">3 (3.95%)</td>
<td valign="top" align="center">3 (3.95%)</td>
</tr> <tr>
<td valign="top" align="left">11 &#x0201C;Waiting for experts&#x0201D;: only experts can help people who want to suicide</td>
<td valign="top" align="center">1 (0.14%)</td>
<td valign="top" align="center">1 (0.81%)</td>
<td valign="top" align="center">1 (1.32%)</td>
<td valign="top" align="center">1 (1.32%)</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>The IBM SPSS Statistics software (SPSS, version 20) was used to analyze statistics below. The agreement between pairs of human coders was measured by Cohen <italic>k</italic> coefficient, and any disagreement was resolved by a researcher. Besides, between cybersuicide and offline suicide, the differences in proportions of posts reflecting suicide literacy were estimated by Pearson&#x00027;s chi-square test and Fisher&#x00027;s exact test.</p></sec>
<sec>
<title>2.3.2. Computational model training</title>
<p>A series of machine learning models were trained to differentiate false knowledge of cybersuicide from that of offline suicide. Within the training process, human coding results and psycholinguistic feature values were considered as the ground truth and the predictors, respectively.</p>
<p>For the ground truth, in this study, class imbalance problem existed. Specifically, between cybersuicide and offline suicide, obvious differences were observed in amounts of both general false knowledge and specific false knowledge types. In machine learning, when the dataset is extremely imbalanced, most existing classification algorithms may not perform well on minority class. To resolve this concern and obtain a well-balanced dataset, at the level of specific false knowledge types, data from the majority class were randomly eliminated until there were as many data in both classes. The balanced dataset composed of 152 posts is shown in <xref ref-type="table" rid="T1">Table 1</xref>.</p>
<p>For the predictors, to improve the predictive performance of models, psycholinguistic features that were valid for differentiating suicide literacy between cybersuicide and offline suicide were selected as key features. It is worth noting here that, to avoid overfitting in computational model training, the data used for feature selection remained independent of the data used for model training. Specifically, based on a random selection of 15 posts from each class of the balanced dataset, a series of two-tailed independent <italic>t</italic> tests were performed by the SPSS software to compare values of psycholinguistic features between cybersuicide and offline suicide, and then effect sizes (Cohen <italic>d</italic> coefficient) were computed from the estimated <italic>t</italic> values by the Effect Size Calculators (<ext-link ext-link-type="uri" xlink:href="https://lbecker.uccs.edu/">https://lbecker.uccs.edu/</ext-link>). Features that were statistically significant at 0.05 and had a Cohen <italic>d</italic> &#x0003E; 0.20 or &#x0003C;-0.20 were considered as key features.</p>
<p>Finally, based on the remaining 122 posts from the balanced dataset (152&#x02013;30 = 122), a series of classification models were built on selected key features. The Waikato Environment for Knowledge Analysis software (WEKA, version 3.9.4) was used to train machine learning models. By using the five-fold cross-validation technique, the classification performance of models was evaluated in terms of precision, recall, and F1.</p></sec></sec></sec>
<sec id="s3">
<title>3. Results</title>
<sec>
<title>3.1. Human coding</title>
<p>The Cohen <italic>k</italic> coefficients for &#x0201C;general false knowledge&#x0201D; and &#x0201C;specific false knowledge types&#x0201D; reached 0.91 and 0.87, respectively, reflecting almost perfect agreement. Results of human coding for suicide literacy are shown in <xref ref-type="table" rid="T1">Table 1</xref>.</p>
<p>First, for differences in false knowledge structure, cybersuicide-related posts generally reflected more false knowledge than offline suicide-related posts (cybersuicide: 739/4,393, 16.82%; offline suicide: 124/2,843, 4.36%; <inline-formula><mml:math id="M3"><mml:msubsup><mml:mrow><mml:mi>&#x003C7;</mml:mi></mml:mrow><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup><mml:mo>=</mml:mo></mml:math></inline-formula>255.13, <italic>p</italic> &#x0003C; 0.001). Furthermore, between cybersuicide and offline suicide, significant differences were also observed in specific false knowledge types (Fisher exact test <italic>p</italic> &#x0003C; 0.001) (<xref ref-type="fig" rid="F2">Figure 2</xref>). Specifically, cybersuicide-related posts were more likely than offline suicide-related posts to be coded as three false knowledge types, including &#x0201C;Should keep secrets&#x0201D; (cybersuicide: 176/739, 23.82%; offline suicide: 16/124, 12.90%; <inline-formula><mml:math id="M4"><mml:msubsup><mml:mrow><mml:mi>&#x003C7;</mml:mi></mml:mrow><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup><mml:mo>=</mml:mo></mml:math></inline-formula>7.31, <italic>p</italic> &#x0003C; 0.01), &#x0201C;Manipulating/attracting attention&#x0201D; (cybersuicide: 380/739, 51.42%; offline suicide: 23/124, 18.55%; <inline-formula><mml:math id="M5"><mml:msubsup><mml:mrow><mml:mi>&#x003C7;</mml:mi></mml:mrow><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup><mml:mo>=</mml:mo></mml:math></inline-formula>46.10, <italic>p</italic> &#x0003C; 0.001), and &#x0201C;Stop media coverage of suicide&#x0201D; (cybersuicide: 72/739, 9.74%; offline suicide: 3/124, 2.42%; <inline-formula><mml:math id="M6"><mml:msubsup><mml:mrow><mml:mi>&#x003C7;</mml:mi></mml:mrow><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup><mml:mo>=</mml:mo></mml:math></inline-formula>7.18, <italic>p</italic> &#x0003C; 0.01); while offline suicide-related posts were more likely than cybersuicide-related posts to be coded as four false knowledge types, including &#x0201C;Well-planned&#x0201D; (cybersuicide: 4/739, 0.54%; offline suicide: 49/124, 39.52%; <inline-formula><mml:math id="M7"><mml:msubsup><mml:mrow><mml:mi>&#x003C7;</mml:mi></mml:mrow><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup><mml:mo>=</mml:mo></mml:math></inline-formula>279.82, <italic>p</italic> &#x0003C; 0.001), &#x0201C;No future plans&#x0201D; (cybersuicide: 10/739, 1.35%; offline suicide: 7/124, 5.65%; Fisher exact test <italic>p</italic> &#x0003C; 0.01), &#x0201C;Mentally ill&#x0201D; (cybersuicide: 3/739, 0.41%; offline suicide: 6/124, 4.84%; Fisher exact test <italic>p</italic> &#x0003C; 0.001), and &#x0201C;Depressed&#x0201D; (cybersuicide: 7/739, 0.95%; offline suicide: 6/124, 4.84%; Fisher exact test <italic>p</italic> &#x0003C; 0.01). Besides, cybersuicide-related posts were often coded as &#x0201C;Manipulating/attracting attention&#x0201D; (51.42%) and &#x0201C;Should keep secrets&#x0201D; (23.82%); while offline suicide-related posts were often coded as &#x0201C;Well-planned&#x0201D; (39.52%).</p>
<fig id="F2" position="float">
<label>Figure 2</label>
<caption><p>Comparison of proportions of posts indicating specific false knowledge types between cybersuicide and offline suicide. &#x0002A;Statistically significant.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fpubh-10-1061590-g0002.tif"/>
</fig>
<p>Similar results were also found for different genders. Cybersuicide-related posts generally reflected more false knowledge than offline suicide-related posts for both of men (cybersuicide: 369/2,473, 14.92%; offline suicide: 66/1,589, 4.15%; <inline-formula><mml:math id="M8"><mml:msubsup><mml:mrow><mml:mi>&#x003C7;</mml:mi></mml:mrow><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup></mml:math></inline-formula> = 117.30, <italic>p</italic> &#x0003C; 0.001) and women (cybersuicide: 370/1,920, 19.27%; offline suicide: 58/1,254, 4.63%; <inline-formula><mml:math id="M9"><mml:msubsup><mml:mrow><mml:mi>&#x003C7;</mml:mi></mml:mrow><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup></mml:math></inline-formula> = 139.47, <italic>p</italic> &#x0003C; 0.001). Furthermore, between cybersuicide and offline suicide, significant differences in specific false knowledge types were also observed for both of men (Fisher exact test <italic>p</italic> &#x0003C; 0.001) and women (Fisher exact test <italic>p</italic> &#x0003C; 0.001). Specifically, for men, cybersuicide-related posts were more likely than offline suicide-related posts to be coded as three false knowledge types, including &#x0201C;Should keep secrets&#x0201D; (cybersuicide: 89/369, 24.12%; offline suicide: 4/66, 6.06%; <inline-formula><mml:math id="M10"><mml:msubsup><mml:mrow><mml:mi>&#x003C7;</mml:mi></mml:mrow><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup></mml:math></inline-formula> = 10.86, <italic>p</italic> &#x0003C; 0.01), &#x0201C;Manipulating/attracting attention&#x0201D; (cybersuicide: 194/369, 52.57%; offline suicide: 11/66, 16.67%; <inline-formula><mml:math id="M11"><mml:msubsup><mml:mrow><mml:mi>&#x003C7;</mml:mi></mml:mrow><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup></mml:math></inline-formula> = 28.97, <italic>p</italic> &#x0003C; 0.001), and &#x0201C;Stop media coverage of suicide&#x0201D; (cybersuicide: 42/369, 11.38%; offline suicide: 1/66, 1.52%; <inline-formula><mml:math id="M12"><mml:msubsup><mml:mrow><mml:mi>&#x003C7;</mml:mi></mml:mrow><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup></mml:math></inline-formula> = 6.12, <italic>p</italic> &#x0003C; 0.05); while offline suicide-related posts were more likely than cybersuicide-related posts to be coded as four false knowledge types, including &#x0201C;Well-planned&#x0201D; (cybersuicide: 1/369, 0.27%; offline suicide: 35/66, 53.03%; <inline-formula><mml:math id="M13"><mml:msubsup><mml:mrow><mml:mi>&#x003C7;</mml:mi></mml:mrow><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup><mml:mo>=</mml:mo></mml:math></inline-formula>205.30, <italic>p</italic> &#x0003C; 0.001), &#x0201C;No future plans&#x0201D; (cybersuicide: 3/369, 0.81%; offline suicide: 3/66, 4.55%; Fisher exact test <italic>p</italic> &#x0003C; 0.05), &#x0201C;Mentally ill&#x0201D; (cybersuicide: 0/369, 0%; offline suicide: 2/66, 3.03%; Fisher exact test <italic>p</italic> &#x0003C; 0.05), and &#x0201C;Depressed&#x0201D; (cybersuicide: 4/369, 1.08%; offline suicide: 4/66, 6.06%; Fisher exact test <italic>p</italic> &#x0003C; 0.05). For women, cybersuicide-related posts were more likely than offline suicide-related posts to be coded as &#x0201C;Manipulating/attracting attention&#x0201D; (cybersuicide: 186/370, 50.27%; offline suicide: 12/58, 20.69%; <inline-formula><mml:math id="M14"><mml:msubsup><mml:mrow><mml:mi>&#x003C7;</mml:mi></mml:mrow><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup><mml:mo>=</mml:mo></mml:math></inline-formula>17.65, <italic>p</italic> &#x0003C; 0.001); while offline suicide-related posts were more likely than cybersuicide-related posts to be coded as three false knowledge types, including &#x0201C;Well-planned&#x0201D; (cybersuicide: 3/370, 0.81%; offline suicide: 14/58, 24.14%; Fisher exact test <italic>p</italic> &#x0003C; 0.001), &#x0201C;No future plans&#x0201D; (cybersuicide: 7/370, 1.89%; offline suicide: 4/58, 6.90%; Fisher exact test <italic>p</italic> &#x0003C; 0.05), and &#x0201C;Mentally ill&#x0201D; (cybersuicide: 3/370, 0.81%; offline suicide: 4/58, 6.90%; Fisher exact test <italic>p</italic> &#x0003C; 0.01).</p>
<p>Second, for differences in extent of association with stigma, among posts reflecting false knowledge, cybersuicide-related posts generally reflected more stigma than offline suicide-related posts (cybersuicide: 596/739, 80.65%; offline suicide: 43/124, 34.68%; <inline-formula><mml:math id="M15"><mml:msubsup><mml:mrow><mml:mi>&#x003C7;</mml:mi></mml:mrow><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup></mml:math></inline-formula> = 116.77, <italic>p</italic> &#x0003C; 0.001) (<xref ref-type="table" rid="T2">Table 2</xref>). Furthermore, cybersuicide-related posts were more likely than offline suicide-related posts to be coded as stigmatizing across three specific false knowledge types (<xref ref-type="fig" rid="F3">Figure 3</xref>), including &#x0201C;Well-planned&#x0201D; (cybersuicide: 3/4, 75.00%; offline suicide: 5/49, 10.20%; Fisher exact test <italic>p</italic> &#x0003C; 0.01), &#x0201C;Manipulating/attracting attention&#x0201D; (cybersuicide: 314/380, 82.63%; offline suicide: 15/23, 65.22%; Fisher exact test <italic>p</italic>=0.05), and &#x0201C;No change of mind&#x0201D; (cybersuicide: 22/26, 84.62%; offline suicide: 3/7, 42.86%; Fisher exact test <italic>p</italic> &#x0003C; 0.05).</p>
<table-wrap position="float" id="T2">
<label>Table 2</label>
<caption><p>Proportions of stigmatizing posts across different false knowledge types: <italic>n</italic> = 863.</p></caption>
<table frame="box" rules="all">
<thead><tr>
<th valign="top" align="left" style="background-color:#919497;color:#ffffff"><bold>False knowledge types</bold></th>
<th valign="top" align="center" colspan="2" style="background-color:#919497;color:#ffffff"><bold>Cybersuicide</bold></th>
<th valign="top" align="center" colspan="2" style="background-color:#919497;color:#ffffff"><bold>Offline suicide</bold></th>
</tr>
<tr>
<th style="background-color:#919497;color:#ffffff"></th>
<th valign="top" align="center" colspan="2" style="background-color:#919497;color:#ffffff"><bold>(</bold><italic><bold>n</bold></italic> = <bold>739)</bold></th>
<th valign="top" align="center" colspan="2" style="background-color:#919497;color:#ffffff"><bold>(</bold><italic><bold>n</bold></italic> = <bold>124)</bold></th>
</tr>
</thead>
<tbody>
 <tr>
<td style="background-color:#919497;color:#ffffff"></td>
<td valign="top" align="center" style="background-color:#919497;color:#ffffff"><bold>Stigma</bold></td>
<td valign="top" align="center" style="background-color:#919497;color:#ffffff"><bold>Non-stigma</bold></td>
<td valign="top" align="center" style="background-color:#919497;color:#ffffff"><bold>Stigma</bold></td>
<td valign="top" align="center" style="background-color:#919497;color:#ffffff"><bold>Non-stigma</bold></td>
</tr> <tr>
<td valign="top" align="left">1 &#x0201C;Unpreventable&#x0201D;</td>
<td valign="top" align="center">8 (88.89%)</td>
<td valign="top" align="center">1 (11.11%)</td>
<td valign="top" align="center">1 (50.00%)</td>
<td valign="top" align="center">1 (50.00%)</td>
</tr> <tr>
<td valign="top" align="left">2 &#x0201C;Should keep secrets&#x0201D;</td>
<td valign="top" align="center">153 (86.93%)</td>
<td valign="top" align="center">23 (13.07%)</td>
<td valign="top" align="center">11 (68.75%)</td>
<td valign="top" align="center">5 (31.25%)</td>
</tr> <tr>
<td valign="top" align="left">3 &#x0201C;Well-planned&#x0201D;</td>
<td valign="top" align="center">3 (75.00%)</td>
<td valign="top" align="center">1 (25.00%)</td>
<td valign="top" align="center">5 (10.20%)</td>
<td valign="top" align="center">44 (89.80%)</td>
</tr> <tr>
<td valign="top" align="left">4 &#x0201C;No future plans&#x0201D;</td>
<td valign="top" align="center">6 (60.00%)</td>
<td valign="top" align="center">4 (40.00%)</td>
<td valign="top" align="center">2 (28.57%)</td>
<td valign="top" align="center">5 (71.43%)</td>
</tr> <tr>
<td valign="top" align="left">5 &#x0201C;Must &#x02018;succeed&#x0201D;&#x00027;</td>
<td valign="top" align="center">48 (94.12%)</td>
<td valign="top" align="center">3 (5.88%)</td>
<td valign="top" align="center">3 (75.00%)</td>
<td valign="top" align="center">1 (25.00%)</td>
</tr> <tr>
<td valign="top" align="left">6 &#x0201C;Manipulating/attracting attention&#x0201D;</td>
<td valign="top" align="center">314 (82.63%)</td>
<td valign="top" align="center">66 (17.37%)</td>
<td valign="top" align="center">15 (65.22%)</td>
<td valign="top" align="center">8 (34.78%)</td>
</tr> <tr>
<td valign="top" align="left">7 &#x0201C;Mentally ill&#x0201D;</td>
<td valign="top" align="center">2 (66.67%)</td>
<td valign="top" align="center">1 (33.33%)</td>
<td valign="top" align="center">3 (50.00%)</td>
<td valign="top" align="center">3 (50.00%)</td>
</tr> <tr>
<td valign="top" align="left">8 &#x0201C;Depressed&#x0201D;</td>
<td valign="top" align="center">3 (42.86%)</td>
<td valign="top" align="center">4 (57.14%)</td>
<td valign="top" align="center">0 (0%)</td>
<td valign="top" align="center">6 (100%)</td>
</tr> <tr>
<td valign="top" align="left">9 &#x0201C;No change of mind&#x0201D;</td>
<td valign="top" align="center">22 (84.62%)</td>
<td valign="top" align="center">4 (15.38%)</td>
<td valign="top" align="center">3 (42.86%)</td>
<td valign="top" align="center">4 (57.14%)</td>
</tr> <tr>
<td valign="top" align="left">10 &#x0201C;Stop media coverage of suicide&#x0201D;</td>
<td valign="top" align="center">37 (51.39%)</td>
<td valign="top" align="center">35 (48.61%)</td>
<td valign="top" align="center">0 (0%)</td>
<td valign="top" align="center">3 (100%)</td>
</tr> <tr>
<td valign="top" align="left">11 &#x0201C;Waiting for experts&#x0201D;</td>
<td valign="top" align="center">0 (0%)</td>
<td valign="top" align="center">1 (100%)</td>
<td valign="top" align="center">0 (0%)</td>
<td valign="top" align="center">1 (100%)</td>
</tr>
</tbody>
</table>
</table-wrap>
<fig id="F3" position="float">
<label>Figure 3</label>
<caption><p>Comparison of proportions of stigmatizing posts between cybersuicide and offline suicide across specific false knowledge types. &#x0002A;Statistically significant.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fpubh-10-1061590-g0003.tif"/>
</fig>
<p>Similar results were also found for different genders. Among posts reflecting false knowledge, cybersuicide-related posts generally reflected more stigma than offline suicide-related posts for both of men (cybersuicide: 291/369, 78.86%; offline suicide: 13/66, 19.70%; <inline-formula><mml:math id="M16"><mml:msubsup><mml:mrow><mml:mi>&#x003C7;</mml:mi></mml:mrow><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup><mml:mo>=</mml:mo></mml:math></inline-formula>93.12, <italic>p</italic> &#x0003C; 0.001) and women (cybersuicide: 305/370, 82.43%; offline suicide: 30/58, 51.72%; <inline-formula><mml:math id="M17"><mml:msubsup><mml:mrow><mml:mi>&#x003C7;</mml:mi></mml:mrow><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup></mml:math></inline-formula> = 27.80, <italic>p</italic> &#x0003C; 0.001). Furthermore, for men, cybersuicide-related posts were more likely than offline suicide-related posts to be coded as stigmatizing across two specific false knowledge types, including &#x0201C;Must &#x02018;succeed&#x0201D;&#x00027; (cybersuicide: 24/24, 100%; offline suicide: 0/1, 0%; Fisher exact test <italic>p</italic> &#x0003C; 0.05) and &#x0201C;Manipulating/attracting attention&#x0201D; (cybersuicide: 159/194, 81.96%; offline suicide: 5/11, 45.45%; Fisher exact test <italic>p</italic> &#x0003C; 0.05).</p></sec>
<sec>
<title>3.2. Computational model training</title>
<p>Based on randomly selected 30 posts from the balanced dataset, five key features were selected for model training (<xref ref-type="table" rid="T3">Table 3</xref>). Based on the remaining 122 posts from the balanced dataset, by using five different machine learning algorithms (Logistic Regression, Support Vector Machine, Multilayer Perceptron Neutral Network, C4.5 Decision Tree, and SPAARC Decision Tree), a series of classification models were built on key features. Results showed that the SPAARC Decision Tree model had the best classification performance (precision: 0.82; recall: 0.72; F1: 0.70) (<xref ref-type="table" rid="T4">Table 4</xref>).</p>
<table-wrap position="float" id="T3">
<label>Table 3</label>
<caption><p>Key features selection: <italic>n</italic> = 30.</p></caption>
<table frame="box" rules="all">
<thead><tr>
<th valign="top" align="left" style="background-color:#919497;color:#ffffff"><bold>Key features</bold></th>
<th valign="top" align="center" style="background-color:#919497;color:#ffffff"><bold><italic>t</italic> (<italic>df</italic>)</bold></th>
<th valign="top" align="center" style="background-color:#919497;color:#ffffff"><bold><italic>p</italic></bold></th>
<th valign="top" align="center" style="background-color:#919497;color:#ffffff"><bold>Cohen <italic>d</italic></bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Signal words for past tense</td>
<td valign="top" align="center">2.39 (28)</td>
<td valign="top" align="center">&#x0003C; 0.05</td>
<td valign="top" align="center">0.90</td>
</tr> <tr>
<td valign="top" align="left">Signal words for present tense</td>
<td valign="top" align="center">2.72 (28)</td>
<td valign="top" align="center">&#x0003C; 0.05</td>
<td valign="top" align="center">1.03</td>
</tr> <tr>
<td valign="top" align="left">Family</td>
<td valign="top" align="center">&#x02212;2.14 (28)</td>
<td valign="top" align="center">&#x0003C; 0.05</td>
<td valign="top" align="center">&#x02212;0.81</td>
</tr> <tr>
<td valign="top" align="left">Time</td>
<td valign="top" align="center">3.05 (28)</td>
<td valign="top" align="center">&#x0003C; 0.01</td>
<td valign="top" align="center">1.15</td>
</tr> <tr>
<td valign="top" align="left">Leisure</td>
<td valign="top" align="center">4.68 (28)</td>
<td valign="top" align="center">&#x0003C; 0.001</td>
<td valign="top" align="center">1.77</td>
</tr>
</tbody>
</table>
</table-wrap>
<table-wrap position="float" id="T4">
<label>Table 4</label>
<caption><p>Performance of classification models: <italic>n</italic> = 122.</p></caption>
<table frame="box" rules="all">
<thead><tr>
<th valign="top" align="left" style="background-color:#919497;color:#ffffff"><bold>Classification models</bold></th>
<th valign="top" align="center" style="background-color:#919497;color:#ffffff"><bold>Precision</bold></th>
<th valign="top" align="center" style="background-color:#919497;color:#ffffff"><bold>Recall</bold></th>
<th valign="top" align="center" style="background-color:#919497;color:#ffffff"><bold>F1</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Logistic Regression</td>
<td valign="top" align="center">0.63</td>
<td valign="top" align="center">0.63</td>
<td valign="top" align="center">0.63</td>
</tr> <tr>
<td valign="top" align="left">Support Vector Machine</td>
<td valign="top" align="center">0.62</td>
<td valign="top" align="center">0.62</td>
<td valign="top" align="center">0.62</td>
</tr> <tr>
<td valign="top" align="left">Multilayer Perceptron Neutral Network</td>
<td valign="top" align="center">0.68</td>
<td valign="top" align="center">0.68</td>
<td valign="top" align="center">0.68</td>
</tr> <tr>
<td valign="top" align="left">C4.5 Decision Tree</td>
<td valign="top" align="center">0.80</td>
<td valign="top" align="center">0.71</td>
<td valign="top" align="center">0.69</td>
</tr> <tr>
<td valign="top" align="left">SPAARC Decision Tree</td>
<td valign="top" align="center">0.82</td>
<td valign="top" align="center">0.72</td>
<td valign="top" align="center">0.70</td>
</tr>
</tbody>
</table>
</table-wrap></sec></sec>
<sec id="s4">
<title>4. Discussion</title>
<sec>
<title>4.1. Principal findings</title>
<p>According to our knowledge, this is the first study that compares suicide literacy between cybersuicide and offline suicide directly and systematically. Findings of this study provide evidence for understanding the content and nature of false knowledge and beliefs that people hold about different forms of suicide, and also provide insights for designing future public awareness campaigns.</p>
<p>First, in terms of false knowledge structure, the public has different interpretations and reactions to cybersuicide and offline suicide. Results showed that cybersuicide (16.82%) carried more false knowledge and beliefs than offline suicide (4.36%), reflecting a dire need for improving suicide literacy about cybersuicide. Furthermore, between cybersuicide and offline suicide, significant differences were also observed in proportions of specific false knowledge types, reflecting the differences in weights assigned to the prevalence of false knowledge types. For example, cybersuicide was more likely than offline suicide to be associated with three false knowledge types, including &#x0201C;Should keep secrets&#x0201D;, &#x0201C;Manipulating/attracting attention&#x0201D;, and &#x0201C;Stop media coverage of suicide&#x0201D;, which may be due to the prevalence of a distinctive stigmatizing stereotype (false representation stigma, a belief that people livestreaming their suicides do not really want to kill themselves) influenced by the highly public and interactive nature of cybersuicide (<xref ref-type="bibr" rid="B12">12</xref>). Similar results were also found for different genders. It implies that, as a social action, cybersuicide may have a different structure from offline suicide as a private action (<xref ref-type="bibr" rid="B8">8</xref>), which could facilitate the creation of emerging socio-cultural contexts and norms surrounding cybersuicide. Therefore, the general public is in dire need of guidelines on how people can perceive, communicate, and respond to cybersuicide appropriately.</p>
<p>Second, in terms of extent of association with stigma, cybersuicide and offline suicide have different priorities for raising the public awareness. Results showed that, among posts with false knowledge, cybersuicide-related posts (80.65%) generally carried more stigma than offline suicide-related posts (34.68%), reflecting the public reacts strongly to cybersuicide (<xref ref-type="bibr" rid="B13">13</xref>&#x02013;<xref ref-type="bibr" rid="B15">15</xref>). Furthermore, between cybersuicide and offline suicide, significant differences were also observed in proportions of stigma across different false knowledge types, reflecting the differences in priorities for improvement. Similar results were also found for different genders, except that an additional significant difference was found in &#x0201C;Must succeed&#x0201D; only for posts by men. In specific, for men, cybersuicide-related posts were more likely than offline suicide-related posts to be coded as stigmatizing in the false knowledge type &#x0201C;Must succeed&#x0201D;. This inconsistency may be associated with greater glorification of cybersuicide by men (<xref ref-type="bibr" rid="B21">21</xref>). Because obvious differences existed in prevalence and dangerousness of false knowledge types between cybersuicide and offline suicide, public awareness campaigns should be designed to target specific form of suicide rather than to combine and confront different forms of suicide as a whole. For cybersuicide, in the future, literacy promotion efforts should be made to correct those more widespread and dangerous false knowledge types, like &#x0201C;Should keep secrets&#x0201D; and &#x0201C;Manipulating/attracting attention&#x0201D;.</p>
<p>Third, in terms of linguistic expression pattern, cybersuicide and offline suicide have different ways of expressing false knowledge. Results showed that, between cybersuicide and offline suicide, significant differences existed in psycholinguistic features of suicide literacy expressions. For example, suicide literacy expressions of cybersuicide were associated with more frequent use of words related to leisure (e.g., chat) and time (e.g., end), which may be attributed to the reality of real-time and long-lasting interaction between suicidal people and their audience. By contrast, suicide literacy expressions of offline suicide were associated with more frequent use of family-related words (e.g., baby, parent, husband), which may be attributed to public comments about the harmful effect of suicide death on family, friends and others in suicidal people&#x00027;s social networks. The reason for less frequent use of family-related words in cybersuicide-related posts may be due to the prevalent misbelief that cybersuicide is not real (<xref ref-type="bibr" rid="B21">21</xref>). Recent studies suggested the highly prevalence and spread of health misinformation on the internet (<xref ref-type="bibr" rid="B22">22</xref>, <xref ref-type="bibr" rid="B23">23</xref>), and confirmed the potential for using new media to achieve improved health outcomes (<xref ref-type="bibr" rid="B24">24</xref>&#x02013;<xref ref-type="bibr" rid="B26">26</xref>). Therefore, sufficient understanding in different ways of expressing false knowledge could make the automatic detection of suicide literacy expressions more targeted and improve the delivery of tailored messages for health promotion.</p></sec>
<sec>
<title>4.2. Limitations</title>
<p>Findings of this study may have limited generalizability. First, this study exclusively focused on livestreamed suicide and did not involve other forms of cybersuicide. Therefore, it remains unknown whether findings of this study can be applicable to other forms of cybersuicide. Second, social media users are not representative of all people in the real world. Findings of this study need to be further examined with more diverse populations in the future.</p></sec></sec>
<sec id="s5">
<title>5. Conclusion</title>
<p>By analyzing social media data, this study compared suicide literacy between cybersuicide and offline suicide directly and systematically. The findings provide evidence of differences in suicide literacy between cybersuicide and offline suicide, and indicate the need for designing public awareness campaigns that specifically target cybersuicide.</p></sec>
<sec sec-type="data-availability" id="s6">
<title>Data availability statement</title>
<p>The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.</p></sec>
<sec sec-type="ethics-statement" id="s7">
<title>Ethics statement</title>
<p>The studies involving human participants were reviewed and approved by Institutional Review Board of the Institute of Psychology, Chinese Academy of Sciences. Written informed consent for participation was not required for this study in accordance with the national legislation and the institutional requirements.</p></sec>
<sec sec-type="author-contributions" id="s8">
<title>Author contributions</title>
<p>AL contributed to conception and design of the study, interpreted psychological results, and wrote the first draft of the manuscript. AL and DJ collected data and performed the statistical analyses. Both authors took responsibility for the integrity of the data, the accuracy of the data analysis, contributed to the article, and approved the submitted version.</p>
</sec>
</body>
<back>
<ack><p>We are deeply grateful to Mr. ZR Huang and are terribly sorry to hear about the sad news of his passing.</p>
</ack>
<sec sec-type="COI-statement" id="conf1">
<title>Conflict of interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="s9">
<title>Publisher&#x00027;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<ref-list>
<title>References</title>
<ref id="B1">
<label>1.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jorm</surname> <given-names>AF</given-names></name> <name><surname>Korten</surname> <given-names>AE</given-names></name> <name><surname>Jacomb</surname> <given-names>PA</given-names></name> <name><surname>Christensen</surname> <given-names>H</given-names></name> <name><surname>Rodgers</surname> <given-names>B</given-names></name> <name><surname>Pollitt</surname> <given-names>P</given-names></name></person-group>. <article-title>&#x0201C;Mental health literacy&#x0201D;: a survey of the public&#x00027;s ability to recognise mental disorders and their beliefs about the effectiveness of treatment</article-title>. <source>Med J Aust.</source> (<year>1997</year>) <volume>166</volume>:<fpage>182</fpage>&#x02013;<lpage>6</lpage>. <pub-id pub-id-type="doi">10.5694/j.1326-5377.1997.tb140071.x</pub-id><pub-id pub-id-type="pmid">9066546</pub-id></citation></ref>
<ref id="B2">
<label>2.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Johnco</surname> <given-names>C</given-names></name> <name><surname>Rapee</surname> <given-names>RM</given-names></name></person-group>. <article-title>Depression literacy and stigma influence how parents perceive and respond to adolescent depressive symptoms</article-title>. <source>J Affect Disord.</source> (<year>2018</year>) <volume>241</volume>:<fpage>599</fpage>&#x02013;<lpage>607</lpage>. <pub-id pub-id-type="doi">10.1016/j.jad.2018.08.062</pub-id><pub-id pub-id-type="pmid">30172212</pub-id></citation></ref>
<ref id="B3">
<label>3.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chan</surname> <given-names>WI</given-names></name> <name><surname>Batterham</surname> <given-names>P</given-names></name> <name><surname>Christensen</surname> <given-names>H</given-names></name> <name><surname>Galletly</surname> <given-names>C</given-names></name></person-group>. <article-title>Suicide literacy, suicide stigma and help-seeking intentions in Australian medical students</article-title>. <source>Aust Psychiatry.</source> (<year>2014</year>) <volume>22</volume>:<fpage>132</fpage>&#x02013;<lpage>9</lpage>. <pub-id pub-id-type="doi">10.1177/1039856214522528</pub-id><pub-id pub-id-type="pmid">24526795</pub-id></citation></ref>
<ref id="B4">
<label>4.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kelly</surname> <given-names>CM</given-names></name> <name><surname>Jorm</surname> <given-names>AF</given-names></name> <name><surname>Wright</surname> <given-names>A</given-names></name></person-group>. <article-title>Improving mental health literacy as a strategy to facilitate early intervention for mental disorders</article-title>. <source>Med J Aust.</source> (<year>2007</year>) <volume>187</volume>:<fpage>S26</fpage>&#x02013;<lpage>30</lpage>. <pub-id pub-id-type="doi">10.5694/j.1326-5377.2007.tb01332.x</pub-id><pub-id pub-id-type="pmid">17908021</pub-id></citation></ref>
<ref id="B5">
<label>5.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cunningham</surname> <given-names>RM</given-names></name> <name><surname>Walton</surname> <given-names>MA</given-names></name> <name><surname>Carter</surname> <given-names>PM</given-names></name></person-group>. <article-title>The major causes of death in children and adolescents in the United States</article-title>. <source>N Engl J Med.</source> (<year>2018</year>) <volume>379</volume>:<fpage>2468</fpage>&#x02013;<lpage>75</lpage>. <pub-id pub-id-type="doi">10.1056/NEJMsr1804754</pub-id><pub-id pub-id-type="pmid">30575483</pub-id></citation></ref>
<ref id="B6">
<label>6.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Patton</surname> <given-names>GC</given-names></name> <name><surname>Coffey</surname> <given-names>C</given-names></name> <name><surname>Sawyer</surname> <given-names>SM</given-names></name> <name><surname>Viner</surname> <given-names>RM</given-names></name> <name><surname>Haller</surname> <given-names>DM</given-names></name> <name><surname>Bose</surname> <given-names>K</given-names></name> <etal/></person-group>. <article-title>Global patterns of mortality in young people: a systematic analysis of population health data</article-title>. <source>Lancet.</source> (<year>2009</year>) <volume>374</volume>:<fpage>881</fpage>&#x02013;<lpage>92</lpage>. <pub-id pub-id-type="doi">10.1016/S0140-6736(09)60741-8</pub-id><pub-id pub-id-type="pmid">19748397</pub-id></citation></ref>
<ref id="B7">
<label>7.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Starcevic</surname> <given-names>V</given-names></name> <name><surname>Aboujaoude</surname> <given-names>E</given-names></name></person-group>. <article-title>Cyberchondria, cyberbullying, cybersuicide, cybersex: &#x0201C;new&#x0201D; psychopathologies for the 21st century?</article-title> <source>World Psychiatry.</source> (<year>2015</year>) <volume>14</volume>:<fpage>97</fpage>&#x02013;<lpage>100</lpage>. <pub-id pub-id-type="doi">10.1002/wps.20195</pub-id><pub-id pub-id-type="pmid">25655165</pub-id></citation></ref>
<ref id="B8">
<label>8.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fratini</surname> <given-names>A</given-names></name> <name><surname>Hemer</surname> <given-names>SR</given-names></name></person-group>. <article-title>Broadcasting your death through livestreaming: understanding cybersuicide through concepts of performance</article-title>. <source>Cult Med Psychiatry.</source> (<year>2020</year>) <volume>44</volume>:<fpage>524</fpage>&#x02013;<lpage>43</lpage>. <pub-id pub-id-type="doi">10.1007/s11013-020-09671-9</pub-id><pub-id pub-id-type="pmid">32222946</pub-id></citation></ref>
<ref id="B9">
<label>9.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>La Fontaine</surname> <given-names>J</given-names></name></person-group>. <article-title>Explaining suicide: an afterword</article-title>. <source>Cult Med Psychiatry.</source> (<year>2012</year>) <volume>36</volume>:<fpage>409</fpage>&#x02013;<lpage>18</lpage>. <pub-id pub-id-type="doi">10.1007/s11013-012-9256-0</pub-id><pub-id pub-id-type="pmid">22395949</pub-id></citation></ref>
<ref id="B10">
<label>10.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Money</surname> <given-names>TT</given-names></name> <name><surname>Batterham</surname> <given-names>PJ</given-names></name></person-group>. <article-title>Sociocultural factors associated with attitudes toward suicide in Australia</article-title>. <source>Death Stud.</source> (<year>2021</year>) <volume>45</volume>:<fpage>219</fpage>&#x02013;<lpage>25</lpage>. <pub-id pub-id-type="doi">10.1080/07481187.2019.1626943</pub-id><pub-id pub-id-type="pmid">31190630</pub-id></citation></ref>
<ref id="B11">
<label>11.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Beaunoyer</surname> <given-names>E</given-names></name> <name><surname>Guitton</surname> <given-names>MJ</given-names></name></person-group>. <article-title>Cyberthanathology: death and beyond in the digital age</article-title>. <source>Comput Human Behav.</source> (<year>2021</year>) <volume>122</volume>:<fpage>106849</fpage>. <pub-id pub-id-type="doi">10.1016/j.chb.2021.106849</pub-id></citation>
</ref>
<ref id="B12">
<label>12.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Li</surname> <given-names>A</given-names></name> <name><surname>Jiao</surname> <given-names>D</given-names></name> <name><surname>Zhu</surname> <given-names>T</given-names></name></person-group>. <article-title>Stigmatizing attitudes across cybersuicides and offline suicides: content analysis of Sina Weibo</article-title>. <source>J Med Internet Res.</source> (<year>2022</year>) <volume>24</volume>:<fpage>e36489</fpage>. <pub-id pub-id-type="doi">10.2196/36489</pub-id><pub-id pub-id-type="pmid">35394437</pub-id></citation></ref>
<ref id="B13">
<label>13.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>O&#x00027;Dea</surname> <given-names>B</given-names></name> <name><surname>Achilles</surname> <given-names>MR</given-names></name> <name><surname>Larsen</surname> <given-names>ME</given-names></name> <name><surname>Batterham</surname> <given-names>PJ</given-names></name> <name><surname>Calear</surname> <given-names>AL</given-names></name> <name><surname>Christensen</surname> <given-names>H</given-names></name></person-group>. <article-title>The rate of reply and nature of responses to suicide-related posts on Twitter</article-title>. <source>Internet Interv.</source> (<year>2018</year>) <volume>13</volume>:<fpage>105</fpage>&#x02013;<lpage>7</lpage>. <pub-id pub-id-type="doi">10.1016/j.invent.2018.07.004</pub-id><pub-id pub-id-type="pmid">30206524</pub-id></citation></ref>
<ref id="B14">
<label>14.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ma</surname> <given-names>J</given-names></name> <name><surname>Zhang</surname> <given-names>W</given-names></name> <name><surname>Harris</surname> <given-names>K</given-names></name> <name><surname>Chen</surname> <given-names>Q</given-names></name> <name><surname>Xu</surname> <given-names>X</given-names></name></person-group>. <article-title>Dying online: live broadcasts of Chinese emerging adult suicides and crisis response behaviors</article-title>. <source>BMC Public Health.</source> (<year>2016</year>) <volume>16</volume>:<fpage>774</fpage>. <pub-id pub-id-type="doi">10.1186/s12889-016-3415-0</pub-id><pub-id pub-id-type="pmid">27515312</pub-id></citation></ref>
<ref id="B15">
<label>15.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fu</surname> <given-names>KW</given-names></name> <name><surname>Cheng</surname> <given-names>Q</given-names></name> <name><surname>Wong</surname> <given-names>PW</given-names></name> <name><surname>Yip</surname> <given-names>PS</given-names></name></person-group>. <article-title>Responses to a self-presented suicide attempt in social media: a social network analysis</article-title>. <source>Crisis.</source> (<year>2013</year>) <volume>34</volume>:<fpage>406</fpage>&#x02013;<lpage>12</lpage>. <pub-id pub-id-type="doi">10.1027/0227-5910/a000221</pub-id><pub-id pub-id-type="pmid">23871954</pub-id></citation></ref>
<ref id="B16">
<label>16.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chen</surname> <given-names>R</given-names></name> <name><surname>An</surname> <given-names>J</given-names></name> <name><surname>Ou</surname> <given-names>J</given-names></name></person-group>. <article-title>Suicidal behaviour among children and adolescents in China</article-title>. <source>Lancet Child Adolesc Health.</source> (<year>2018</year>) <volume>2</volume>:<fpage>551</fpage>&#x02013;<lpage>3</lpage>. <pub-id pub-id-type="doi">10.1016/S2352-4642(18)30170-6</pub-id><pub-id pub-id-type="pmid">30119712</pub-id></citation></ref>
<ref id="B17">
<label>17.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Li</surname> <given-names>A</given-names></name> <name><surname>Huang</surname> <given-names>X</given-names></name> <name><surname>Zhu</surname> <given-names>T</given-names></name></person-group>. <article-title>A systematic analysis of online broadcasts of suicidality in China</article-title>. <source>Asia Pac Psychiatry.</source> (<year>2018</year>) <volume>10</volume>:<fpage>e12302</fpage>. <pub-id pub-id-type="doi">10.1111/appy.12302</pub-id><pub-id pub-id-type="pmid">28976066</pub-id></citation></ref>
<ref id="B18">
<label>18.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Li</surname> <given-names>L</given-names></name> <name><surname>Li</surname> <given-names>A</given-names></name> <name><surname>Hao</surname> <given-names>B</given-names></name> <name><surname>Guan</surname> <given-names>Z</given-names></name> <name><surname>Zhu</surname> <given-names>T</given-names></name></person-group>. <article-title>Predicting active users&#x00027; personality based on micro-blogging behaviors</article-title>. <source>PLoS ONE.</source> (<year>2014</year>) <volume>9</volume>:<fpage>e84997</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0084997</pub-id><pub-id pub-id-type="pmid">24465462</pub-id></citation></ref>
<ref id="B19">
<label>19.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhao</surname> <given-names>N</given-names></name> <name><surname>Jiao</surname> <given-names>D</given-names></name> <name><surname>Bai</surname> <given-names>S</given-names></name> <name><surname>Zhu</surname> <given-names>T</given-names></name></person-group>. <article-title>Evaluating the validity of simplified Chinese version of LIWC in detecting psychological expressions in short texts on social network services</article-title>. <source>PLoS ONE.</source> (<year>2016</year>) <volume>11</volume>:<fpage>e0157947</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0157947</pub-id><pub-id pub-id-type="pmid">27322382</pub-id></citation></ref>
<ref id="B20">
<label>20.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Calear</surname> <given-names>AL</given-names></name> <name><surname>Batterham</surname> <given-names>PJ</given-names></name> <name><surname>Trias</surname> <given-names>A</given-names></name> <name><surname>Christensen</surname> <given-names>H</given-names></name></person-group>. <article-title>The literacy of suicide scale</article-title>. <source>Crisis.</source> (<year>2021</year>). <pub-id pub-id-type="doi">10.1027/0227-5910/a000798</pub-id><pub-id pub-id-type="pmid">34128704</pub-id></citation></ref>
<ref id="B21">
<label>21.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Li</surname> <given-names>A</given-names></name> <name><surname>Huang</surname> <given-names>X</given-names></name> <name><surname>Hao</surname> <given-names>B</given-names></name> <name><surname>O&#x00027;Dea</surname> <given-names>B</given-names></name> <name><surname>Christensen</surname> <given-names>H</given-names></name> <name><surname>Zhu</surname> <given-names>T</given-names></name></person-group>. <article-title>Attitudes towards suicide attempts broadcast on social media: an exploratory study of Chinese microblogs</article-title>. <source>PeerJ.</source> (<year>2015</year>) <volume>8</volume>:<fpage>e1209</fpage>. <pub-id pub-id-type="doi">10.7717/peerj.1209</pub-id><pub-id pub-id-type="pmid">26380801</pub-id></citation></ref>
<ref id="B22">
<label>22.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Suarez-Lledo</surname> <given-names>V</given-names></name> <name><surname>Alvarez-Galvez</surname> <given-names>J</given-names></name></person-group>. <article-title>Prevalence of health misinformation on social media: systematic review</article-title>. <source>J Med Internet Res.</source> (<year>2021</year>) <volume>23</volume>:<fpage>e17187</fpage>. <pub-id pub-id-type="doi">10.2196/17187</pub-id><pub-id pub-id-type="pmid">33470931</pub-id></citation></ref>
<ref id="B23">
<label>23.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Vosoughi</surname> <given-names>S</given-names></name> <name><surname>Roy</surname> <given-names>D</given-names></name> <name><surname>Aral</surname> <given-names>S</given-names></name></person-group>. <article-title>The spread of true and false news online</article-title>. <source>Science.</source> (<year>2018</year>) <volume>359</volume>:<fpage>1146</fpage>&#x02013;<lpage>51</lpage>. <pub-id pub-id-type="doi">10.1126/science.aap9559</pub-id><pub-id pub-id-type="pmid">29590045</pub-id></citation></ref>
<ref id="B24">
<label>24.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chen</surname> <given-names>J</given-names></name> <name><surname>Wang</surname> <given-names>Y</given-names></name></person-group>. <article-title>Social media use for health purposes: systematic review</article-title>. <source>J Med Internet Res.</source> (<year>2021</year>) <volume>23</volume>:<fpage>e17917</fpage>. <pub-id pub-id-type="doi">10.2196/17917</pub-id><pub-id pub-id-type="pmid">33978589</pub-id></citation></ref>
<ref id="B25">
<label>25.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yom-Tov</surname> <given-names>E</given-names></name> <name><surname>Brunstein-Klomek</surname> <given-names>A</given-names></name> <name><surname>Mandel</surname> <given-names>O</given-names></name> <name><surname>Hadas</surname> <given-names>A</given-names></name> <name><surname>Fennig</surname> <given-names>S</given-names></name></person-group>. <article-title>Inducing behavioral change in seekers of pro-anorexia content using internet advertisements: randomized controlled trial</article-title>. <source>JMIR Ment Health.</source> (<year>2018</year>) <volume>5</volume>:<fpage>e6</fpage>. <pub-id pub-id-type="doi">10.2196/mental.8212</pub-id><pub-id pub-id-type="pmid">29472176</pub-id></citation></ref>
<ref id="B26">
<label>26.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Korda</surname> <given-names>H</given-names></name> <name><surname>Itani</surname> <given-names>Z</given-names></name></person-group>. <article-title>Harnessing social media for health promotion and behavior change</article-title>. <source>Health Promot Pract.</source> (<year>2013</year>) <volume>14</volume>:<fpage>15</fpage>&#x02013;<lpage>23</lpage>. <pub-id pub-id-type="doi">10.1177/1524839911405850</pub-id><pub-id pub-id-type="pmid">21558472</pub-id></citation></ref>
</ref-list> 
</back>
</article> 