<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Res. Metr. Anal.</journal-id>
<journal-title>Frontiers in Research Metrics and Analytics</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Res. Metr. Anal.</abbrev-journal-title>
<issn pub-type="epub">2504-0537</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/frma.2017.00002</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Research Metrics and Analytics</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>The Length and Semantic Structure of Article Titles&#x02014;Evolving Disciplinary Practices and Correlations with Impact</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Milojevi&#x00107;</surname> <given-names>Sta&#x00161;a</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="corresp" rid="cor1">&#x0002A;</xref>
<uri xlink:href="http://frontiersin.org/people/u/284377"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Center for Complex Networks and Systems Research, School of Informatics and Computing, Indiana University</institution>, <addr-line>Bloomington, IN</addr-line>, <country>USA</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Henk F. Moed, Sapienza University, Italy</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Michael Julian Kurtz, Harvard-Smithsonian Center for Astrophysics, USA; Fereshteh Didegah, Aarhus University, Denmark</p></fn>
<corresp content-type="corresp" id="cor1">&#x0002A;Correspondence: Sta&#x00161;a Milojevi&#x00107;, <email>smilojev&#x00040;indiana.edu</email></corresp>
</author-notes>
<pub-date pub-type="epub">
<day>06</day>
<month>04</month>
<year>2017</year>
</pub-date>
<pub-date pub-type="collection">
<year>2017</year>
</pub-date>
<volume>2</volume>
<elocation-id>2</elocation-id>
<history>
<date date-type="received">
<day>07</day>
<month>01</month>
<year>2017</year>
</date>
<date date-type="accepted">
<day>20</day>
<month>03</month>
<year>2017</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2017 Milojevi&#x00107;.</copyright-statement>
<copyright-year>2017</copyright-year>
<copyright-holder>Milojevi&#x00107;</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract>
<p>In this paper, we examine the characteristics of titles (average length, proportion of titles with subtitles, proportion of interrogatory, and indicative titles) and how they changed over a substantial period of time (half a century). We consistently analyze core literature in five diverse fields, in order to probe the usage of titles as a disciplinary identity building tool. In addition, we study whether different types of titles are used differently by authors depending on their academic age and productivity and collaboration levels, which has not been studied before. Finally, we revisit the connection between title characteristics and impact. We found that belonging to some discipline is the strongest determinant for the length of the titles and the occurrence of different forms of titles. This suggests that authors try to comply with the norms set in their fields. However, these norms are not fixed in time. Over the decades, the practices have changed, some of them quite abruptly. Individual groups of authors most often did not differ in their practices regarding the use of titles. We find that using titles posed as questions or titles stating the result do not lead to citation benefit.</p>
</abstract>
<kwd-group>
<kwd>article titles</kwd>
<kwd>research impact</kwd>
<kwd>scholarly communication</kwd>
<kwd>discourse analysis</kwd>
<kwd>computational linguistics</kwd>
</kwd-group>
<counts>
<fig-count count="5"/>
<table-count count="1"/>
<equation-count count="0"/>
<ref-count count="46"/>
<page-count count="10"/>
<word-count count="7944"/>
</counts>
</article-meta>
</front>
<body>
<sec id="S1" sec-type="introduction">
<title>Introduction</title>
<p>Scientific documents are &#x0201C;the central medium for the dissemination and exchange of ideas&#x0201D; (Bowker, <xref ref-type="bibr" rid="B9">2005</xref>, p. 126), and therefore represent the key element in the practice of science (Callon et al., <xref ref-type="bibr" rid="B12">1983</xref>; Latour and Woolgar, <xref ref-type="bibr" rid="B27">1986</xref>). In many scientific fields the principal type of scientific document is a research article (&#x0201C;paper&#x0201D;). Titles and the choice of words in them play two important roles: they inform the reader about the content of the paper, while at the same time attempting to trigger their attention (Bazerman, <xref ref-type="bibr" rid="B6">1985</xref>, <xref ref-type="bibr" rid="B7">1988</xref>; Ball, <xref ref-type="bibr" rid="B4">2009</xref>). For the first role, the words are chosen to &#x0201C;convey credible information for a given population of producer-readers&#x0201D; (Callon et al., <xref ref-type="bibr" rid="B12">1983</xref>, p. 199). Thus, the choice of words is a negotiation process reflecting both the behavior of individual authors and scholarly collectives (Hyland, <xref ref-type="bibr" rid="B22">2004</xref>, <xref ref-type="bibr" rid="B23">2012</xref>; Nagano, <xref ref-type="bibr" rid="B36">2015</xref>). Authors choose particular words to denote their alliance with particular communities, sub-communities, and lines of thought. Thus, titles serve a very important third role, which is the denotation of academic identity. According to Hyland (<xref ref-type="bibr" rid="B23">2012</xref>) &#x0201C;we use language as the raw materials for the presentation of ourselves to the world and that what we say and write aligns us with or separates us from other people and their positions&#x0201D; (p. x). Identity is socially and historically constituted by individuals through their social relations and is thus something that does not belong <italic>within</italic> an individual, but <italic>between</italic> persons (Vygotsky, <xref ref-type="bibr" rid="B43">1978</xref>).</p>
<p>Titles are co-constructed within the &#x0201C;conceptual frames&#x0201D; (Hyland, <xref ref-type="bibr" rid="B23">2012</xref>) of disciplines (Nagano, <xref ref-type="bibr" rid="B36">2015</xref>). The usage of the acceptable discourse is a sign that a novice author is being socialized into a discipline (Becher and Trowler, <xref ref-type="bibr" rid="B8">2001</xref>). We see that as early as dissertation work (Demarest and Sugimoto, <xref ref-type="bibr" rid="B15">2015</xref>), where it was possible to discern among three disciplines (physics, psychology, and philosophy) based on a limited set of terms they used. Nagano (<xref ref-type="bibr" rid="B36">2015</xref>) claimed that the choices made in title construction are &#x0201C;largely matter of custom, habit, and copying others&#x0201D; (p. 134). The great influence of individual disciplines was supported by a number of studies that found greater differences in title characteristics between rather than within disciplines (van Wesel et al., <xref ref-type="bibr" rid="B42">2014</xref>). This was also supported by the finding that time is the most important factor related to title length (White, <xref ref-type="bibr" rid="B45">1991</xref>).</p>
<p>In relation to their role as attention triggers, titles are perceived to be an integral part of a strategy to attract an audience (Thelwall, <xref ref-type="bibr" rid="B41">2017</xref>). Many studies from researchers from a number of fields: scientometrics, medicine, ecology (ECL), and linguistics, among others, focused on identifying title characteristics that may be correlated with high impact. Thus, these studies take a normative stance, trying to assist researchers in choosing title characteristics that have been found to lead to more citations. These studies range in the size of the corpus they use: from 50 articles (Jacques and Sebire, <xref ref-type="bibr" rid="B24">2010</xref>) to nearly 20 million articles (Ball, <xref ref-type="bibr" rid="B4">2009</xref>). The following title characteristics have been most studied: length, presence of non-alphanumeric characters, syntax/type, and word analysis.</p>
<p>The title length has been considered important for the retrieval of articles, which is an essential step toward reading, and eventually citing them. Namely, longer titles contain more words and, therefore, more potential keywords, thus increasing the potential for retrieval. On the other hand, longer titles may be &#x0201C;more difficult to digest and may reduce the attraction factor&#x0201D; (Hudson, <xref ref-type="bibr" rid="B21">2016</xref>, p. 878). Shorter titles may also indicate a narrower scope. The results of the studies examining title lengths did not universally support the hypothesis of the greater impact of longer titles. Positive correlation between length and impact has been found for 25 most cited articles in medical journals published in top four journals in 2005 (Jacques and Sebire, <xref ref-type="bibr" rid="B24">2010</xref>), and general and internal medicine articles (van Wesel et al., <xref ref-type="bibr" rid="B42">2014</xref>). However, a very large number of studies found the negative relationship in biology (Didegah and Thelwall, <xref ref-type="bibr" rid="B16">2013</xref>), social sciences (Didegah and Thelwall, <xref ref-type="bibr" rid="B16">2013</xref>), sociology (van Wesel et al., <xref ref-type="bibr" rid="B42">2014</xref>), and psychology (Subotic and Mukherjee, <xref ref-type="bibr" rid="B40">2014</xref>). Others have found no correlation; e.g., in chemistry (Didegah and Thelwall, <xref ref-type="bibr" rid="B16">2013</xref>), management science (Nair and Gibbert, <xref ref-type="bibr" rid="B37">2016</xref>), ECL (Fox and Burns, <xref ref-type="bibr" rid="B17">2015</xref>), or in articles published in six PLoS journals (Jamali and Nikzad, <xref ref-type="bibr" rid="B25">2011</xref>). Anthony (<xref ref-type="bibr" rid="B2">2001</xref>) found that the lengths of titles within computer science literature varied widely, attributing it to different subdisciplines, claiming that &#x0201C;an adequate description depends more on the type of study or problem being investigated than the discipline itself&#x0201D; (p. 193).</p>
<p>Titles containing non-alphanumeric characters, such as colons, hyphens, dashes, and periods, indicating titles with a subtitle, or a multicomponent title, have been found to be common across the disciplines and generally associated with higher citation (Buter and van Raan, <xref ref-type="bibr" rid="B11">2011</xref>). Specifically, the usage of colon has become more prevalent, although it differed across the fields (Lewison and Hartley, <xref ref-type="bibr" rid="B28">2005</xref>). For example, a study of the medical literature found that 70% of highly cited articles included a colon (Jacques and Sebire, <xref ref-type="bibr" rid="B24">2010</xref>), while a study of PLoS articles found that articles with colon had both fewer downloads and citations (Jamali and Nikzad, <xref ref-type="bibr" rid="B25">2011</xref>).</p>
<p>Turning to title syntax, three types of article titles have been identified as most common: descriptive (or indicative), declarative (or informative), and titles posed as a question (or interrogatory) (Jamali and Nikzad, <xref ref-type="bibr" rid="B25">2011</xref>; Wager et al., <xref ref-type="bibr" rid="B44">2016</xref>). Descriptive (or indicative) titles describe the subject or topic of the article. Declarative (or informative) titles, in addition to describing the topic also state the main conclusion, or findings, of the study. Thus descriptive titles consist only of noun phrases, while declarative titles include action verbs. Rosner (<xref ref-type="bibr" rid="B38">1990</xref>), who calls such titles &#x0201C;the assertive sentence titles,&#x0201D; found that in biological sciences they first appeared in the 1970s and have been on the rise ever since, being especially prominent in molecular biology, making up to 45% of all the titles in <italic>Cell</italic> since 1986. Goodman (<xref ref-type="bibr" rid="B18">2010</xref>) also found a trend toward the usage of longer words and active verbs in medical literature over the period between 1970 and 2009. Usage of declarative titles has been somewhat controversial, especially in medical literature (Rosner, <xref ref-type="bibr" rid="B38">1990</xref>; Aronson, <xref ref-type="bibr" rid="B3">2010</xref>). While some journals ban the use of declarative titles (e.g., <italic>Microbiology</italic>), others (e.g., <italic>The Journal of Clinical Epidemiology</italic>) have been enforcing their usage (McGowan and Tugwell, <xref ref-type="bibr" rid="B30">2005</xref>). While their usage has increased, the study that used randomized trial on doctors and senior medical and dental students found that declarative titles did not have significant effect on &#x0201C;readers&#x02019; perceptions of the conclusions&#x0201D; (Wager et al., <xref ref-type="bibr" rid="B44">2016</xref>, p. 3).</p>
<p>Although the usage of question marks in titles has increased over time, they still account for a very small proportion of all the titles (Cook and Plourde, <xref ref-type="bibr" rid="B13">2016</xref>). Anthony (<xref ref-type="bibr" rid="B2">2001</xref>) found interrogatory titles to be rare in computer science literature. Fox and Burns (<xref ref-type="bibr" rid="B17">2015</xref>) found that although the proportion of submitted articles to the journal <italic>Functional Ecology</italic> including questions in titles has decreased, the percentage of such articles among the published articles has increased over the 10-year period they had studied. Hudson (<xref ref-type="bibr" rid="B21">2016</xref>) found that the titles that include question marks were longer than other titles. The increase in the usage of questions in titles has been attributed to marketing purposes (Ball, <xref ref-type="bibr" rid="B4">2009</xref>). The study of over 2,000 articles published in 6 PLoS journals found that articles with question titles were more often downloaded, but less frequently cited (Jamali and Nikzad, <xref ref-type="bibr" rid="B25">2011</xref>).</p>
<p>Of all the title characteristics, the intellectual content of article titles, as expressed in terms or concepts, should be the one most closely related to their success and impact. Some studies tried to characterize the usage of concepts (terms) in titles. For example, a recent study of word frequency distribution in nanoscience/nanotechnology confirmed the power law distribution of the frequency of words used in the titles (Bartol and Stopar, <xref ref-type="bibr" rid="B5">2015</xref>). Another study quantified lexical diversity in titles using title phrases rather than individual words (Milojevi&#x00107;, <xref ref-type="bibr" rid="B34">2015</xref>) and found that the fields expanded their cognitive extent over time even when normalized for increased productivity. Other studies, focused more closely on the sematic aspects of the words used in the titles. For example, Nagano (<xref ref-type="bibr" rid="B35">2009</xref>) analyzed word usage in four disciplines [history, sociology, economics (ECN), and education] and found history to be different from the others in terms of high usage of personal names, while sociology did not include a large number of unique terms. At the same time, medical literature titles that referred to a specific country (Jacques and Sebire, <xref ref-type="bibr" rid="B24">2010</xref>), all the articles published by Italian researchers that included a country&#x02019;s name in the title (Abramo et al., <xref ref-type="bibr" rid="B1">2016</xref>), and ECL articles that referred to specific names of study organisms in the titles (Fox and Burns, <xref ref-type="bibr" rid="B17">2015</xref>) fared poorly in terms of impact, or in the case of ECL even in terms of being accepted for publication. Although amusing titles might be perceived as a good strategy to boost attention, studies have shown that they either did not have any citation advantage (Sagi and Yechiam, <xref ref-type="bibr" rid="B39">2008</xref>; Subotic and Mukherjee, <xref ref-type="bibr" rid="B40">2014</xref>). By analyzing word frequency of over 800,000 article titles from 18 different Scopus categories (excluding social sciences, arts and humanities), Thelwall (<xref ref-type="bibr" rid="B41">2017</xref>) found that usage of obscure (not frequently used) words in titles is associated with below average citation. The analysis of the diversity of ECN words in titles based on the ECN dictionary showed cyclical patterns (of varying length&#x02014;30 or 40&#x02009;years) of word usage (Guo et al., <xref ref-type="bibr" rid="B20">2015</xref>). A study of 420 titles in medical journals found that the largest number of titles included topics related words, followed by the methods, with most articles lacking information on research design, methods, and results (Goodman et al., <xref ref-type="bibr" rid="B19">2001</xref>).</p>
<p>Contemporary science is becoming more collaborative. This trend has naturally led some researchers to examine whether the change in authorship had an effect on title construction (e.g., Hudson, <xref ref-type="bibr" rid="B21">2016</xref>). And in general, studies have found some differences in titles depending on the number of authors. For example, coauthored papers by UK researchers published in 2014 use colons and question marks less, which was explained by a difficulty to reach consensus about their usage (Hudson, <xref ref-type="bibr" rid="B21">2016</xref>). At the same time, the titles of coauthored papers were found to be longer, which was attributed to a need to accommodate all the authors&#x02019; views and needs (Hudson, <xref ref-type="bibr" rid="B21">2016</xref>). Hudson also found that the titles of papers authored by a very large number of authors started resembling titles of papers authored by a small number of authors. This might be due to the fact that in, hyperauthorship scenario, only a very small number of authors were actually responsible for making decisions regarding the paper. Namely, Hudson (<xref ref-type="bibr" rid="B21">2016</xref>) has found that the single-authored papers have the shortest titles, with the title length increasing with the increase of number of authors on a paper up to 25&#x02013;49 authors and then declining. However, the positive correlation between title length (measured as the number of substantive words per title) and number of authors on papers was found not to be universal&#x02014;while common in sciences, it was not present in social sciences, and there was a negative correlation in humanities (Yitzhaki, <xref ref-type="bibr" rid="B46">1994</xref>).</p>
<p>Some studies have looked into the nationality of authors and have found that it was not always decisive in the construction of titles. While Lewison and Hartley (<xref ref-type="bibr" rid="B28">2005</xref>) found that the nationality of authors did not affect title characteristics, Ball (<xref ref-type="bibr" rid="B4">2009</xref>) found national and regional differences in the use of question marks in article titles over a 40-year period he studied. These discrepancies might be described by the different disciplines studied, because researchers have found, analyzing the full text of articles, that disciplinary identity in medicine transcends national differences, while in ECN and linguistics the national writing tradition is more visible (Breivega et al., <xref ref-type="bibr" rid="B10">2002</xref>; Dahl, <xref ref-type="bibr" rid="B14">2004</xref>).</p>
<p>The aforementioned studies paint a complex and sometimes contradictory picture of the usage of titles in science. Few studies have analyzed multiple, diverse fields <italic>and</italic> multiple title characteristics with consistent methodology. Furthermore, most studies focused on possible correlations between titles and impact, paying less attention to the role that may be played by different characteristics of the authors. This study aims to disentangle the effects of time and discipline with those of the characteristics of the authors. We examine the characteristics of the titles and whether they have changed over a substantial period of time (half a century). We do so consistently for five diverse fields, in order to probe the usage of titles as a disciplinary identity building tool. The secondary objective is to establish whether different types of titles are used differently <italic>today</italic> by authors depending on their academic age, productivity, and collaboration levels, potentially important determinants that have not been explored before. Finally, we revisit the connection between title characteristics and impact.</p>
</sec>
<sec id="S2" sec-type="methods">
<title>Data and Methods</title>
<p>We analyzed title characteristics in five scientific fields: astronomy (AST), mathematics (MAT), robotics (ROB), ECL, and ECN. These diverse fields have been chosen in order to allow us to capture a wide range of practices and discern whether certain practices are field-specific. AST is representative of a classical field with a range of knowledge production modes (small and large teams). MAT is different from other fields by being done individually or in small teams. ROB and ECL are representative of fields with more recent history and higher interdisciplinarity. Finally, ECN is representative of a field with a social component, unlike the other four.</p>
<p>The data consist of research articles published in up to 10 core journals in each of the five fields between 1961 and 2010 (from 1984 for ROB). The list of journal titles and the details of the selection criteria are given in Milojevi&#x00107; (<xref ref-type="bibr" rid="B32">2012</xref>), which did not analyze the titles. Research articles are defined as publications classified as &#x0201C;article&#x0201D; or &#x0201C;conference paper.&#x0201D; In several cases in which the journal changed its title, we collected data corresponding to all predecessor titles. In total, the data set contained records for 213,756 articles. Table <xref ref-type="table" rid="T1">1</xref> shows breakdown by field. To study the practices with respect to authors&#x02019; characteristics, such as academic age, productivity, and number of collaborators and their relationship with title characteristics, we focused on the papers published in the most recent 5-year period (2006&#x02013;2010). To explore correlations with impact, we obtained citations to these 2006&#x02013;2010 articles received as of the end of 2013. All data were obtained from the Web of Science database.</p>
<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption><p><bold>Summary of the data used in this study</bold>.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th valign="top" align="left">Field</th>
<th valign="top" align="center">Papers 1960&#x02013;2010</th>
<th valign="top" align="center">Papers 2006&#x02013;2010</th>
<th valign="top" align="center">Citations in 2013 to 2006&#x02013;2010 papers</th>
<th valign="top" align="center">Unique lead authors 2006&#x02013;2010</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top">Astronomy</td>
<td align="center" valign="top">154,221</td>
<td align="center" valign="top">30,968</td>
<td align="center" valign="top">748,650</td>
<td align="center" valign="top">13,224</td>
</tr>
<tr>
<td align="left" valign="top">Ecology</td>
<td align="center" valign="top">33,052</td>
<td align="center" valign="top">5,409</td>
<td align="center" valign="top">129,038</td>
<td align="center" valign="top">3,965</td>
</tr>
<tr>
<td align="left" valign="top">Economics</td>
<td align="center" valign="top">18,807</td>
<td align="center" valign="top">1,097</td>
<td align="center" valign="top">17,195</td>
<td align="center" valign="top">885</td>
</tr>
<tr>
<td align="left" valign="top">Mathematics</td>
<td align="center" valign="top">21,602</td>
<td align="center" valign="top">1,754</td>
<td align="center" valign="top">14,664</td>
<td align="center" valign="top">1,470</td>
</tr>
<tr>
<td align="left" valign="top">Robotics</td>
<td align="center" valign="top">8,350</td>
<td align="center" valign="top">2,616</td>
<td align="center" valign="top">28,263</td>
<td align="center" valign="top">2,018</td>
</tr>
</tbody>
</table>
</table-wrap>
<sec id="S2-1">
<title>Title Characteristics</title>
<p>In this study, we focus on five title characteristics: title length, titles with subtitles, titles posed as questions, titles with active verbs, and the cognitive extent (conceptual diversity) of titles.</p>
<sec id="S2-1-1">
<title>Title Length</title>
<p>We define title length as a number of individual words [string of characters separated by space(s)] in a title. Hyphenated words count as one.</p>
</sec>
<sec id="S2-1-2">
<title>Titles with Subtitles (Multicomponent Titles)</title>
<p>We have identified the presence of subtitles automatically. The title is considered to have a subtitle if it has one of the following non-alphanumeric symbols: colon, period, or dash, anywhere in the title. Dash and hyphen use the same character, so we require it to be preceded and followed by a space, in order to differentiate it from hyphenated words.</p>
</sec>
<sec id="S2-1-3">
<title>Titles Posed As Questions</title>
<p>We have identified such titles automatically by detecting the presence of question mark in the title. However, many interrogative titles omit the question mark, so we additionally include all titles starting with: how, where, what, why, or which.</p>
</sec>
<sec id="S2-1-4">
<title>Titles Containing Active Verbs</title>
<p>We have automatically identified articles containing active verbs by matching them to a list of 1,000 common verbs, from which we have manually excluded 370 that are more often used in the same form as nouns or adjectives (for example: study, change, open). To this list, we added &#x0201C;has.&#x0201D; The original list was obtained from an online resource.<xref ref-type="fn" rid="fn1"><sup>1</sup></xref></p>
<p>Note that a given title can fall in more than one of the three above categories.</p>
</sec>
<sec id="S2-1-5">
<title>Cognitive Extent</title>
<p>Conceptual diversity of an ensemble of titles is a new measure designed to quantify the cognitive extent of scientific literature (Milojevi&#x00107;, <xref ref-type="bibr" rid="B34">2015</xref>). It is defined as the number of unique phrases appearing in titles of a statistically large unit quota of literature (thousands of articles). It is similar to the lexical diversity used in computational linguistics to study richness of verbal expression (McKee et al., <xref ref-type="bibr" rid="B31">2000</xref>; McCarthy and Jarvis, <xref ref-type="bibr" rid="B29">2007</xref>; Koizumi, <xref ref-type="bibr" rid="B26">2012</xref>), but uses phrases (concepts) instead of individual words. Bodies of literature that have more diverse concepts in titles will have a higher fraction of unique phrases and could be considered to cover larger cognitive extents. When possible, we use literature quota containing 10,000 title phrases, which is large enough not to suffer from the effects of non-linearity. Otherwise, we use 1,000 or 3,000 phrases and apply a statistical correction to relate it to the number of unique phrases in a quota of 10,000 phrases (Milojevi&#x00107;, <xref ref-type="bibr" rid="B34">2015</xref>).</p>
</sec>
</sec>
<sec id="S2-2">
<title>Author Characteristics</title>
<p>Here, we wish to examine whether author characteristics impact the choices regarding titles. After all, titles are one of the tools for building professional identity and may reflect different characteristics of authors. Furthermore, it is reasonable to assume that in the case of coauthored articles, which are the norm in most disciplines, it is the lead author (first-listed, or corresponding author) who is expected to have had the greatest influence on the choice of the paper title. Therefore, in this study, we associate each author only to papers that he or she has led. We exclude articles that do not permit the identification of a lead author, such as when the authors are listed alphabetically. In order to examine the relationship between the characteristics of authors and the characteristics of their paper titles quantitatively, we follow (Milojevi&#x00107;, <xref ref-type="bibr" rid="B32">2012</xref>) and classify recent authors (those who have published between 2006 and 2010) by the following three properties.</p>
<sec id="S2-2-1">
<title>Academic Age</title>
<p>Academic age is defined as the span in years, for a given author, between the first and the most recent article in the dataset, regardless of the role in the article (lead author or coauthor).</p>
</sec>
<sec id="S2-2-2">
<title>Individual Productivity</title>
<p>Number of articles published between 2006 and 2010 (5&#x02009;years) by an author in the role of a lead author. Focusing on recent individual productivity decouples it from the effects of collaboration, which we explore separately.</p>
</sec>
<sec id="S2-2-3">
<title>Collaboration Level</title>
<p>Collaboration level is defined as the number of different lead authors on recent articles on which the author was listed as a coauthor. To decouple this measure from productivity, we do not count coauthors on articles on which the author him/herself was the lead author. Note that this measure is very different from the number of coauthors on a paper (team size), which would be the characteristic of a paper, not of the lead author.</p>
<p>We disambiguated author names using the hybrid method (Milojevi&#x00107;, <xref ref-type="bibr" rid="B33">2013</xref>), which considers only the first initial for infrequent last names (thus avoiding splitting due to the inconsistent reporting of the middle initial), and both initials for more common last names (thus providing better disambiguation for cases when the mix-up is more likely).</p>
<p>We have performed and will discuss the analysis regarding titles and author characteristics for all five fields, but in order to make the graphs more legible, we will show in them only for AST, where the current dataset is the largest and the trends are best revealed. Trends are fit with a linear function and the resulting slopes and their errors are presented in order to evaluate the significance of trends (assuming they are linear). Trends are considered significant if the absolute values of slopes are more than three times their errors. We will mention any disciplinary particulars if warranted by the analysis.</p>
</sec>
</sec>
<sec id="S2-3">
<title>Paper Characteristics</title>
<p>Previous studies have looked extensively at a relation between the characteristics of the papers (e.g., the number of authors) and their titles and impact, with mixed results. Here, we revisit that question examining the relation between title characteristics and the impact of a paper.</p>
<sec id="S2-3-1">
<title>Impact</title>
<p>Impact is defined as all citations received by recent papers (2006&#x02013;2010) as of the end of 2013. The citation window varies from 4 to 9&#x02009;years, which is not ideal, but is still reasonable, and does not produce spurious relations.</p>
</sec>
</sec>
</sec>
<sec id="S3">
<title>Results</title>
<p>We analyzed five title characteristics: length, proportion of subtitles, proportion of question titles, proportion of assertive titles, and cognitive extent over the period of 50&#x02009;years (1961&#x02013;2010) in five disciplines. We also analyzed the same characteristics against author characteristics, such as academic age, productivity and collaboration level, and paper citation for the most recent 5-year period (2006&#x02013;2010).</p>
<sec id="S3-1">
<title>Title Length</title>
<p>As discussed above, the title length is an important characteristic in that it needs to strike a balance between informativeness (i.e., providing enough keywords for retrieval purposes) and attractiveness (with shorter titles being able to keep the attention on them longer). Figure <xref ref-type="fig" rid="F1">1</xref>A shows that the average length of titles is strongly discipline dependent. Currently, the average length ranges from 8 words in MAT and economy, to 13 words in ECL. Trends show that, on average, the titles have been increasing in length in AST, MAT, ROB, and ECL. ECN is the only field where the titles have not increased in size in recent decades. In relative sense, the greatest expansion has been seen in AST, with the most recent titles being 40% longer, on average, than the titles in 1960.</p>
<fig id="F1" position="float">
<label>Figure 1</label>
<caption><p><bold>Trends involving title length (measured in words)</bold>. <bold>(A)</bold> Average title length for five disciplines [astronomy (AST), mathematics (MAT), robotics (ROB), ecology (ECL), and economics (ECN)] from 1961 to 2010. Data for ROB start in 1983. Data points are averaged in bins of 5&#x02009;years. <bold>(B)</bold> Average title length for authors of different academic age (number of years spent in the field) in AST from 2006 to 2010. Data points are averaged in bins of ranging from 1 to 10&#x02009;years (bin size increases with age). <bold>(C)</bold> Average title length for authors of different recent productivity in AST from 2006 to 2010. <bold>(D)</bold> Average title length for authors of different recent collaboration level in AST from 2006 to 2010. <bold>(E)</bold> Average title length for papers of different impact, measured by citations received through the end of 2013. For panels <bold>(C&#x02013;E)</bold>, data are binned in logarithmic intervals of 0.2 decades. Slopes of linear fits and their errors are given for trends in panels <bold>(B&#x02013;E)</bold>. Significant trends are emphasized by bold script.</p></caption>
<graphic xlink:href="frma-02-00002-g001.tif"/>
</fig>
<p>To test whether author characteristics have strong influence on self-representation <italic>via</italic> titles, we examine the characteristics of titles for the period 2006&#x02013;2010. We first look at the academic age of the lead author and see that in AST (Figure <xref ref-type="fig" rid="F1">1</xref>B), on average, authors of different academic ages use titles of the same length. A small downward trend is present in ECL and MAT. We do not find a correlation between the productivity and title length in AST (Figure <xref ref-type="fig" rid="F1">1</xref>C) or other fields. However, there is a statistically significant positive correlation between the level of collaboration and title length, at least in AST where the collaboration is most extensive (Figure <xref ref-type="fig" rid="F1">1</xref>D). There, the authors who collaborate with large number of diverse individuals tend to have longer titles (13 versus 11).</p>
<p>Also, we found that titles with more citations tend to have, on average, longer titles, in AST (Figure <xref ref-type="fig" rid="F1">1</xref>E), and to some extent in economy, but not in other three fields. Even for fields where there is a correlation on average, the range of title lengths at any citation level is large (90 percentile range is between 6 and 20 words almost irrespective of citation), which casts doubt on the ability to use extensiveness of the title as an attention grabbing strategy. It has been shown that papers having more authors tend to have higher citation rates. To separate possible influence of this factor, we also look at the trend between title length and citations based only on papers having three to five authors, and find that in that case the trend is diminished.</p>
<p>To summarize, our analysis has shown that between-field differences dominate over the within-field differences at a given time, whereas the trends over time in some cases reach the level of between-field difference.</p>
</sec>
<sec id="S3-2">
<title>Titles with Subtitles or Multiple Components</title>
<p>Previous studies have not directly examined the prevalence of titles with subtitles. However, the studies have examined the usage of different non-alphanumeric symbols which in most cases (except the usage of question mark at the end of the title) corresponds to the presence of subtitles. One of the most common ways to introduce subtitles is <italic>via</italic> a colon. Previous studies have found the usage of colons to be more prevalent than the usage of other non-alphanumeric symbols, but different across the fields. We find that subtitles are least common in MAT (currently 5%) and most common in AST and ECL (around 30%, Figure <xref ref-type="fig" rid="F2">2</xref>A). The usage of subtitles in different subfields followed different trends over the last 50&#x02009;years. It has increased in AST and ECL (from &#x0007E;20 to &#x0007E;30%), while it stayed more constant in other fields. One may wonder if the increased usage of subtitles is what drives the overall lengthening of titles in AST and ECL. To this end, we have calculated the trends like the ones shown in Figure <xref ref-type="fig" rid="F1">1</xref>A, but only keeping the longest single component of a title. We found that the length of titles in AST and ECL has been increasing nevertheless.</p>
<fig id="F2" position="float">
<label>Figure 2</label>
<caption><p><bold>Trends involving the presence of subtitles in titles</bold>. <bold>(A)</bold> Percentage of titles with subtitles for five disciplines [astronomy (AST), mathematics (MAT), robotics (ROB), ecology (ECL), and economics (ECN)] from 1961 to 2010. Percentage of titles with subtitles for authors of different academic age <bold>(B)</bold>, productivity <bold>(C)</bold>, collaboration level <bold>(D)</bold>, and papers of different impact level <bold>(E)</bold>.</p></caption>
<graphic xlink:href="frma-02-00002-g002.tif"/>
</fig>
<p>When we examine presence of subtitles for different groups of authors, focusing on the most recent 5-year period, we see that the usage of subtitles in AST is pretty stable, around 33% for authors of all ages, except for the ones just starting, where it is 25% (Figure <xref ref-type="fig" rid="F2">2</xref>B). There is also no overall correlation between author productivity and the usage of subtitles in AST (Figure <xref ref-type="fig" rid="F2">2</xref>C), which is similar to the situation in other fields. However, in AST, the usage of subtitles is positively correlated with the number of unique collaborators a researcher has had, reaching 70% of all titles for the authors who had 100 collaborators in the 5-year period (Figure <xref ref-type="fig" rid="F2">2</xref>D).</p>
<p>We have also found that the usage of subtitles is positively correlated with number of citations in AST, with almost 50% of the most highly cited papers having subtitles, while less than 30% of less highly cited papers having them (Figure <xref ref-type="fig" rid="F2">2</xref>E). The trend is weaker, but remains significant when only papers with three to five authors are selected. Positive correlations are seen in other fields, except in ECL.</p>
<p>As in the case of title length, we conclude that between-field differences in the usage of subtitles dominate over the trends with time, and over some of the author characteristics. However, the trends with respect to the level of collaboration and with respect to citedness can be as strong, at least in some fields.</p>
</sec>
<sec id="S3-3">
<title>Interrogatory Titles</title>
<p>Previous studies have found the increase of interrogatory titles over time, and yet, these titles still constituted only a small portion of all titles. For example, such titles were not found to be common in computer science (Anthony, <xref ref-type="bibr" rid="B2">2001</xref>). Our study confirms these findings (Figure <xref ref-type="fig" rid="F3">3</xref>A). In the period between 1960 and mid-1990s, interrogatory titles were almost non-existent in all the fields we examined except in ECN, where close to 1% of titles posed a question. Today, ECN is the field with the largest proportion of titles posed as questions (&#x0007E;10%), followed by ECL (&#x0007E;7%) and AST (&#x0007E;3%). Interrogatory titles remain non-existent in MAT and ROB. It is interesting that in the three fields that found usage of questions in titles acceptable, the surge in their usage occurred at the same time, in the mid-1990s. The growth in their usage has mostly leveled just a few years after the surge, and there may be some decline most recently.</p>
<fig id="F3" position="float">
<label>Figure 3</label>
<caption><p><bold>Trends involving interrogatory titles</bold>. <bold>(A)</bold> Percentage of interrogatory titles for five disciplines [astronomy (AST), mathematics (MAT), robotics (ROB), ecology (ECL), and economics (ECN)] from 1961 to 2010. Percentage of interrogatory titles for authors of different academic age <bold>(B)</bold>, productivity <bold>(C)</bold>, collaboration level <bold>(D)</bold>, and papers of different impact level <bold>(E)</bold>.</p></caption>
<graphic xlink:href="frma-02-00002-g003.tif"/>
</fig>
<p>When it comes to how different groups of authors use interrogatory titles, in AST we find no correlation between academic age and using questions (Figure <xref ref-type="fig" rid="F3">3</xref>B), and a positive correlation between usage of questions and productivity, with &#x0007E;6% of titles of most productive authors having questions compared to &#x0007E;3% of the least productive ones (Figure <xref ref-type="fig" rid="F3">3</xref>C). There are indications of such correlation other fields as well. We find no significant correlation with respect to the level of collaboration in AST (Figure <xref ref-type="fig" rid="F3">3</xref>D) or other fields. Interestingly, posing title as a question does not seem to be more prevalent in highly cited articles (Figure <xref ref-type="fig" rid="F3">3</xref>E) in any field.</p>
<p>We conclude that when it comes to titles posed as questions, it is a recent practice, but one which has taken hold at various levels in various disciplines, from none to &#x0007E;10%. Inter-field differences among different groups of authors or different impact levels are small.</p>
</sec>
<sec id="S3-4">
<title>Declarative (or Informative) Titles</title>
<p>The usage of declarative titles, the ones that place the result in the title in the form of a sentence (thus containing an active verb), has been somewhat controversial, especially in medical literature. Such titles appeared in biological sciences in 1970s and have been on the rise (Rosner, <xref ref-type="bibr" rid="B38">1990</xref>). We find that declarative titles appeared in the five fields that we examined here much later, in the mid-1990s (Figure <xref ref-type="fig" rid="F4">4</xref>A). Interestingly, this is the same time that saw the rise of interrogatory titles. Declarative titles have experienced very strong rise in usage in ECL, which currently contains the largest percentage of such titles (14%) and is still on the rise, and ECN, which at the peak usage had &#x0007E;11%, but experienced a drop starting in 2000, to be at 8% at the moment. Both ROB and MAT (which never use interrogative titles) have experienced an increase in usage of declarative titles, although at a smaller scale than ECL and ECN, and both saw the usage of declarative titles decrease in mid 2000s. Declarative titles were the least prevalent in AST, never reaching even 1% of titles.</p>
<fig id="F4" position="float">
<label>Figure 4</label>
<caption><p><bold>Trends involving declarative (or informative) titles</bold>. <bold>(A)</bold> Percentage of declarative titles for five disciplines [astronomy (AST), mathematics (MAT), robotics (ROB), ecology (ECL), and economics (ECN)] from 1961 to 2010. Percentage of titles containing active verbs for authors of different academic age <bold>(B)</bold>, productivity <bold>(C)</bold>, collaboration level <bold>(D)</bold>, and papers of different impact level <bold>(E)</bold>.</p></caption>
<graphic xlink:href="frma-02-00002-g004.tif"/>
</fig>
<p>When it comes to differences in usage among different groups of authors in AST, we find no significant correlations with the academic age (Figure <xref ref-type="fig" rid="F4">4</xref>B) or a level of productivity (Figure <xref ref-type="fig" rid="F4">4</xref>C). This also holds for other fields. We also find that the biggest users of this type of titles are authors with very large number of unique collaborators (Figure <xref ref-type="fig" rid="F4">4</xref>D) (the like of which are not present in other fields). Even 10% of articles written by authors who had 100 unique collaborators in the 5-year period we studied used declarative titles.</p>
<p>While the usage of declarative titles may appear to offer a special advantage in grabbing readers&#x02019; attention, we do not find that the prevalence of such titles is different for articles of different citation level, in AST (Figure <xref ref-type="fig" rid="F4">4</xref>E), or in other fields.</p>
<p>Again, we conclude that once the practice of declarative titles has entered fields other than biomedicine, it has established itself at varying levels depending on the field, with little intra-field difference.</p>
</sec>
<sec id="S3-5">
<title>Cognitive Extent</title>
<p>Cognitive extent is a measure of lexical diversity of titles, measuring the number of unique title phrases over set quotas of text (Milojevi&#x00107;, <xref ref-type="bibr" rid="B34">2015</xref>). As such, this is not the characteristic of any given title (as in the case of previous properties studied here) but the characteristic of an ensemble of titles. It is interesting that all five fields have been experiencing the expansion of their cognitive extents, although not at the same rate (Figure <xref ref-type="fig" rid="F5">5</xref>A). ECL has had the largest cognitive extent in all the periods, although it had the slowest growth rate. AST has the second largest cognitive extent, but it has experienced faster growth in 1970s than today. ROB, which now has the third largest cognitive extent has undergone the period of fastest expansion since 1990s (when we start following it). MAT and ECN have had similar cognitive extents and MAT, much like AST, has experienced accelerated growth in the 1970s.</p>
<fig id="F5" position="float">
<label>Figure 5</label>
<caption><p><bold>Trends involving cognitive extent (number of unique title phrases)</bold>. <bold>(A)</bold> Cognitive extent for five disciplines [astronomy (AST), mathematics (MAT), robotics (ROB), ecology (ECL), and economics (ECN)] from 1961 to 2010. Cognitive extent for authors of different academic age <bold>(B)</bold>, productivity <bold>(C)</bold>, collaboration level <bold>(D)</bold>, and papers of different impact level <bold>(E)</bold>.</p></caption>
<graphic xlink:href="frma-02-00002-g005.tif"/>
</fig>
<p>When it comes to the cognitive extent and author characteristics, in AST (and in other fields) we find no significant correlation between the academic age and cognitive extent. Thus, authors of all ages maintain the same diversity of topics that they study (Figure <xref ref-type="fig" rid="F5">5</xref>B). There is a negative correlation between the cognitive extent and productivity in all fields including AST (Figure <xref ref-type="fig" rid="F5">5</xref>C), in the sense that very productive authors tend to work on a more focused set of concepts. The same is true for authors who collaborate more, in AST (Figure <xref ref-type="fig" rid="F5">5</xref>D) and other fields. Finally, we find the negative correlation between cognitive extent and citations papers accrue, in AST (Figure <xref ref-type="fig" rid="F5">5</xref>E) and other fields.</p>
<p>For the case of cognitive extent, we find that intra-field and between-field variations are comparable to each other and to changes that occur over time.</p>
</sec>
</sec>
<sec id="S4">
<title>Discussion and Conclusion</title>
<p>Article titles are a rich source of data that can be used not only to elucidate the development of disciplines, fields, and research areas, identify trendy topics or subfields, but to help us better understand the processes of knowledge creation. Namely, a large number of studies have found titles to be the product of interaction between both individual and disciplinary identity building. While there were a number of studies that explored a particular aspect of titles for particular fields at particular times, mostly focusing on correlations with impact, the present study has simultaneously and consistently explored (a) a range of disciplines over long periods of time, (b) a suite of title characteristics, and (c) a number of variables related to author characteristics.</p>
<p>We found that belonging to some discipline is the strongest determinant for the average length of the titles and the occurrence of different forms of titles. This suggests that authors try to comply with the norms set in their fields. However, these norms are not fixed in time. Over the decades, the practices have changed. The increase in length over time has been well documented and should come as no surprise. As the field evolves, the studies become more detailed, and require more words to distinguish them with respect to previous studies, which were probably more general in scope. We have shown that this is the result of more detailed/specific description of article contents, and not the mere inclusion of subtitles.</p>
<p>The most drastic example of change in practices is the nearly simultaneous appearance, across different fields, of titles of interrogatory and declarative types in the mid-1990s, suggesting a common origin, perhaps influenced by the practices in prestigious multidisciplinary journals. We are in the epoch of increased overall assertiveness in title-giving practices.</p>
<p>Overall, we confirmed the importance of both the discipline and time period on the construction of titles. Interestingly, we found that not only the authors follow one another in their title choices (Nagano, <xref ref-type="bibr" rid="B36">2015</xref>) within disciplines but that certain trends emerged in a whole range of disciplines at the same time. This is worth further study.</p>
<p>While individual groups of authors often did not differ in their practices regarding the use of titles, occasionally they did. Most notably, we find that authors with many collaborators tend to use more subtitles. Authors with many collaborators are often members of large teams, whose papers tend to be published in installments, which thus necessitate the use of subtitles. Also, the authors with a lot of collaborators tend to work on a smaller set of topics, as a group, than the ones who tend to work in smaller collaborations or alone. More productive authors tend to use interrogatory titles more often, suggesting that more productive authors tend to publish on more speculative topics. In some fields, older authors use shorter titles, perhaps reflecting the fact that these authors have started their careers when titles used to be shorter.</p>
<p>It would be interesting to further explore whether these differences are truly due to different author characteristics or due to authors with certain characteristics being more prevalent in particular subfields which may have differing practices.</p>
<p>A topic that has received much interest is whether the titles of articles with greater impact tend to have special characteristics. We find that the prevalence of what may be considered more aggressive or assertive titles (the ones posed as questions or which state the result) is actually similar among the articles having vastly diverse impacts (from zero to hundreds of citations), suggesting that the use of such strategies does not confer any citation benefit. More highly cited papers do have longer titles and more often contain subtitles in AST and ECL, but this does not necessarily imply a causal connection. Longer titles are the characteristic of articles produced by larger teams, which tend to be cited more. Furthermore, no such correlation is seen in MAT, ECN, and ROB. In any case, it would be interesting to see whether in instances when certain title characteristics were correlated with impact, such a correlation was due to either paper or title characteristics, as opposed to the a fact that certain subfields or modes of doing science may have particular title preferences or even constraints, and that at the same time these subfields are moving the research front, therefore accruing more citations quicker.</p>
<p>Interesting, in all the fields, we find that the higher the impact, the narrower the diversity of title concepts. This means that while the papers covering all the topics can do poorly, a more restricted set of topics does very well in terms of citations. This may be the effect of very active subfields or a small number of &#x0201C;hot&#x0201D; topics pushing the research frontier.</p>
</sec>
<sec id="S6">
<title>Authors Note</title>
<p>The work uses Web of Science data by Thomson Reuters provided by the Network Science Institute and the Cyberinfrastructure for Network Science Center at Indiana University.</p>
</sec>
<sec id="S7" sec-type="author-contributor">
<title>Author Contributions</title>
<p>SM designed the study, performed the analyses, and wrote the manuscript.</p>
</sec>
<sec id="S8">
<title>Conflict of Interest Statement</title>
<p>The author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
</body>
<back>
<ref-list>
<title>References</title>
<ref id="B1"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Abramo</surname> <given-names>G.</given-names></name> <name><surname>D&#x02019;Angelo</surname> <given-names>C. A.</given-names></name> <name><surname>Di Costa</surname> <given-names>F.</given-names></name></person-group> (<year>2016</year>). <article-title>The effects of a country&#x02019;s name in the title of a publication on its visibility and citability</article-title>. <source>Scientometrics</source> <volume>109</volume>, <fpage>1895</fpage>&#x02013;<lpage>1909</lpage>.<pub-id pub-id-type="doi">10.1007/s11192-016-2120-1</pub-id></citation></ref>
<ref id="B2"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Anthony</surname> <given-names>L.</given-names></name></person-group> (<year>2001</year>). <article-title>Characteristic features of research article titles in computer science</article-title>. <source>IEEE Trans. Prof. Commun.</source> <volume>44</volume>, <fpage>187</fpage>&#x02013;<lpage>194</lpage>.<pub-id pub-id-type="doi">10.1109/47.946464</pub-id></citation></ref>
<ref id="B3"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Aronson</surname> <given-names>J.</given-names></name></person-group> (<year>2010</year>). <article-title>When I use a word&#x02026; Declarative titles</article-title>. <source>Q. J. Med.</source> <volume>103</volume>, <fpage>207</fpage>&#x02013;<lpage>209</lpage>.<pub-id pub-id-type="doi">10.1093/qjmed/hcp084</pub-id></citation></ref>
<ref id="B4"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ball</surname> <given-names>R.</given-names></name></person-group> (<year>2009</year>). <article-title>Scholarly communication in transition: the use of question marks in the titles of scientific articles in medicine, life sciences and physics 1966-2005</article-title>. <source>Scientometrics</source> <volume>79</volume>, <fpage>667</fpage>&#x02013;<lpage>679</lpage>.<pub-id pub-id-type="doi">10.1007/s11192-007-1984-5</pub-id></citation></ref>
<ref id="B5"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bartol</surname> <given-names>T.</given-names></name> <name><surname>Stopar</surname> <given-names>K.</given-names></name></person-group> (<year>2015</year>). <article-title>Nano language and distribution of article title terms according to power laws</article-title>. <source>Scientometrics</source> <volume>103</volume>, <fpage>435</fpage>&#x02013;<lpage>451</lpage>.<pub-id pub-id-type="doi">10.1007/s11192-015-1546-1</pub-id></citation></ref>
<ref id="B6"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bazerman</surname> <given-names>C.</given-names></name></person-group> (<year>1985</year>). <article-title>Physicists reading physics, schema-laden purposes and purpose-laden schema</article-title>. <source>Writ. Commun.</source> <volume>2</volume>, <fpage>3</fpage>&#x02013;<lpage>23</lpage>.<pub-id pub-id-type="doi">10.1177/0741088385002001001</pub-id></citation></ref>
<ref id="B7"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Bazerman</surname> <given-names>C.</given-names></name></person-group> (<year>1988</year>). <source>Shaping Written Knowledge: The Genre and Activity of the Experimental Article in Science</source>. <publisher-loc>Madison</publisher-loc>: <publisher-name>University of Wisconsin Press</publisher-name>.</citation></ref>
<ref id="B8"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Becher</surname> <given-names>T.</given-names></name> <name><surname>Trowler</surname> <given-names>P. R.</given-names></name></person-group> (<year>2001</year>). <source>Academic Tribes and Territories: Intellectual Enquiry and the Culture of Disciplines</source>. <publisher-loc>Buckingham</publisher-loc>: <publisher-name>The Society for Research into Higher Education &#x00026; Open University Press</publisher-name>.</citation></ref>
<ref id="B9"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Bowker</surname> <given-names>G. C.</given-names></name></person-group> (<year>2005</year>). <source>Memory Practices in the Sciences</source>. <publisher-loc>Cambridge, MA</publisher-loc>: <publisher-name>The MIT Press</publisher-name>.</citation></ref>
<ref id="B10"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Breivega</surname> <given-names>K. R.</given-names></name> <name><surname>Dahl</surname> <given-names>T.</given-names></name> <name><surname>Fl&#x000F8;ttum</surname> <given-names>K.</given-names></name></person-group> (<year>2002</year>). <article-title>Traces of self and others in research articles. A comparative pilot study of English, French and Norwegian research articles in medicine, economics, and linguistics</article-title>. <source>Int. J. Appl. Linguist.</source> <volume>12</volume>, <fpage>218</fpage>&#x02013;<lpage>239</lpage>.<pub-id pub-id-type="doi">10.1111/1473-4192.00032</pub-id></citation></ref>
<ref id="B11"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Buter</surname> <given-names>R. K.</given-names></name> <name><surname>van Raan</surname> <given-names>A. F. J.</given-names></name></person-group> (<year>2011</year>). <article-title>Non-alphanumeric characters in titles of scientific publications: an analysis of their occurrence and correlation with citation impact</article-title>. <source>J. Informetrics</source> <volume>5</volume>, <fpage>608</fpage>&#x02013;<lpage>617</lpage>.<pub-id pub-id-type="doi">10.1016/j.joi.2011.05.008</pub-id></citation></ref>
<ref id="B12"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Callon</surname> <given-names>M.</given-names></name> <name><surname>Courtial</surname> <given-names>J. P.</given-names></name> <name><surname>Turner</surname> <given-names>W. A.</given-names></name> <name><surname>Bauin</surname> <given-names>S.</given-names></name></person-group> (<year>1983</year>). <article-title>From translations to problematic networks: an introduction to co-word analysis</article-title>. <source>Soc. Sci. Inf.</source> <volume>22</volume>, <fpage>191</fpage>&#x02013;<lpage>235</lpage>.<pub-id pub-id-type="doi">10.1177/053901883022002003</pub-id></citation></ref>
<ref id="B13"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cook</surname> <given-names>J. M.</given-names></name> <name><surname>Plourde</surname> <given-names>D.</given-names></name></person-group> (<year>2016</year>). <article-title>Do scholars follow Betteridge&#x02019;s Law? The use of questions in journal article titles</article-title>. <source>Scientometrics</source> <volume>108</volume>, <fpage>1119</fpage>&#x02013;<lpage>1128</lpage>.<pub-id pub-id-type="doi">10.1007/s11192-016-2030-2</pub-id></citation></ref>
<ref id="B14"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dahl</surname> <given-names>T.</given-names></name></person-group> (<year>2004</year>). <article-title>Textual metadiscourse in research articles: a marker of national culture or of academic discipline?</article-title> <source>J. Pragmatics</source> <volume>36</volume>, <fpage>1807</fpage>&#x02013;<lpage>1825</lpage>.<pub-id pub-id-type="doi">10.1016/j.pragma.2004.05.004</pub-id></citation></ref>
<ref id="B15"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Demarest</surname> <given-names>B.</given-names></name> <name><surname>Sugimoto</surname> <given-names>C. R.</given-names></name></person-group> (<year>2015</year>). <article-title>Argue, observe, assess: measuring disciplinary identities and differences through socio-epistemic discourse</article-title>. <source>J. Assoc. Inf. Sci. Technol.</source> <volume>66</volume>, <fpage>1374</fpage>&#x02013;<lpage>1387</lpage>.<pub-id pub-id-type="doi">10.1002/asi.23271</pub-id></citation></ref>
<ref id="B16"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Didegah</surname> <given-names>F.</given-names></name> <name><surname>Thelwall</surname> <given-names>M.</given-names></name></person-group> (<year>2013</year>). <article-title>Which factors help authors produce the highest impact research? Collaboration, journal and document properties</article-title>. <source>J. Informetrics</source> <volume>7</volume>, <fpage>861</fpage>&#x02013;<lpage>873</lpage>.<pub-id pub-id-type="doi">10.1016/j.joi.2013.08.006</pub-id></citation></ref>
<ref id="B17"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fox</surname> <given-names>C. W.</given-names></name> <name><surname>Burns</surname> <given-names>C. S.</given-names></name></person-group> (<year>2015</year>). <article-title>The relationship between manuscript title structure and success: editorial decisions and citation performance for an ecological journal</article-title>. <source>Ecol. Evol.</source> <volume>5</volume>, <fpage>1970</fpage>&#x02013;<lpage>1980</lpage>.<pub-id pub-id-type="doi">10.1002/ece3.1480</pub-id><pub-id pub-id-type="pmid">26045949</pub-id></citation></ref>
<ref id="B18"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Goodman</surname> <given-names>D. J.</given-names></name></person-group> (<year>2010</year>). <article-title>Novel tool constitutes a paradigm: how title words in medical journal articles have changed since 1970</article-title>. <source>J. Eur. Med. Writers Assoc.</source> <volume>19</volume>, <fpage>269</fpage>&#x02013;<lpage>271</lpage>.</citation></ref>
<ref id="B19"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Goodman</surname> <given-names>D. J.</given-names></name> <name><surname>Thacker</surname> <given-names>S. B.</given-names></name> <name><surname>Siegel</surname> <given-names>P. Z.</given-names></name></person-group> (<year>2001</year>). <article-title>What&#x02019;s in a title? A descriptive study of article titles in peer-reviewed medical journals</article-title>. <source>Sci. Editor</source> <volume>24</volume>, <fpage>75</fpage>&#x02013;<lpage>78</lpage>.</citation></ref>
<ref id="B20"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Guo</surname> <given-names>S.</given-names></name> <name><surname>Zhang</surname> <given-names>G.</given-names></name> <name><surname>Ju</surname> <given-names>Q.</given-names></name> <name><surname>Chen</surname> <given-names>Y.</given-names></name> <name><surname>Chen</surname> <given-names>Q.</given-names></name> <name><surname>Li</surname> <given-names>L.</given-names></name></person-group> (<year>2015</year>). <article-title>The evolution of conceptual diversity in economics titles from 1890 to 2012</article-title>. <source>Scientometrics</source> <volume>102</volume>, <fpage>2073</fpage>&#x02013;<lpage>2088</lpage>.<pub-id pub-id-type="doi">10.1007/s11192-014-1501-6</pub-id></citation></ref>
<ref id="B21"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hudson</surname> <given-names>J.</given-names></name></person-group> (<year>2016</year>). <article-title>An analysis of the titles of papers submitted to the UK REF in 2014: authors, disciplines, and stylistic details</article-title>. <source>Scientometrics</source> <volume>109</volume>, <fpage>871</fpage>&#x02013;<lpage>889</lpage>.<pub-id pub-id-type="doi">10.1007/s11192-016-2081-4</pub-id><pub-id pub-id-type="pmid">27795594</pub-id></citation></ref>
<ref id="B22"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Hyland</surname> <given-names>K.</given-names></name></person-group> (<year>2004</year>). <source>Disciplinary Discourses: Social Interactions in Academic Writing</source>. <publisher-loc>Ann Arbor</publisher-loc>: <publisher-name>The University of Michigan Press</publisher-name>.</citation></ref>
<ref id="B23"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Hyland</surname> <given-names>K.</given-names></name></person-group> (<year>2012</year>). <source>Disciplinary Identities: Individuality and Community in Academic Discourse</source>. <publisher-loc>Cambridge</publisher-loc>: <publisher-name>Cambridge University Press</publisher-name>.</citation></ref>
<ref id="B24"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jacques</surname> <given-names>T. S.</given-names></name> <name><surname>Sebire</surname> <given-names>N. J.</given-names></name></person-group> (<year>2010</year>). <article-title>The impact of article titles on citation hits: an analysis of general and specialist medical journals</article-title>. <source>JRSM Short Rep.</source> <volume>1</volume>, <fpage>2</fpage>.<pub-id pub-id-type="doi">10.1258/shorts.2009.100020</pub-id><pub-id pub-id-type="pmid">21103094</pub-id></citation></ref>
<ref id="B25"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jamali</surname> <given-names>H. R.</given-names></name> <name><surname>Nikzad</surname> <given-names>M.</given-names></name></person-group> (<year>2011</year>). <article-title>Article title type and its relation with the number of downloads and citations</article-title>. <source>Scientometrics</source> <volume>88</volume>, <fpage>653</fpage>&#x02013;<lpage>661</lpage>.<pub-id pub-id-type="doi">10.1007/s11192-011-0412-z</pub-id></citation></ref>
<ref id="B26"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Koizumi</surname> <given-names>R.</given-names></name></person-group> (<year>2012</year>). <article-title>Relationship between text length and lexical diversity measures: can we use short texts of less than 100 tokens?</article-title> <source>Vocabulary Learn. Instr.</source> <volume>1</volume>, <fpage>60</fpage>&#x02013;<lpage>69</lpage>.<pub-id pub-id-type="doi">10.7820/vli.v01.1.koizumi</pub-id></citation></ref>
<ref id="B27"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Latour</surname> <given-names>B.</given-names></name> <name><surname>Woolgar</surname> <given-names>S.</given-names></name></person-group> (<year>1986</year>). <source>Laboratory Life: The Construction of Scientific Facts</source>. <publisher-loc>Princeton</publisher-loc>: <publisher-name>Princeton University Press</publisher-name>.</citation></ref>
<ref id="B28"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lewison</surname> <given-names>G.</given-names></name> <name><surname>Hartley</surname> <given-names>J.</given-names></name></person-group> (<year>2005</year>). <article-title>What&#x02019;s in a title? Numbers of words and the presence of colons</article-title>. <source>Scientometrics</source> <volume>63</volume>, <fpage>341</fpage>&#x02013;<lpage>356</lpage>.<pub-id pub-id-type="doi">10.1007/s11192-005-0216-0</pub-id></citation></ref>
<ref id="B29"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>McCarthy</surname> <given-names>P. M.</given-names></name> <name><surname>Jarvis</surname> <given-names>S.</given-names></name></person-group> (<year>2007</year>). <article-title>vocd: a theoretical and empirical evaluation</article-title>. <source>Lang. Test.</source> <volume>24</volume>, <fpage>459</fpage>&#x02013;<lpage>488</lpage>.<pub-id pub-id-type="doi">10.1177/0265532207080767</pub-id></citation></ref>
<ref id="B30"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>McGowan</surname> <given-names>J.</given-names></name> <name><surname>Tugwell</surname> <given-names>P.</given-names></name></person-group> (<year>2005</year>). <article-title>Informative titles described article content</article-title>. <source>J. Can. Health Libr. Assoc.</source> <volume>26</volume>, <fpage>83</fpage>&#x02013;<lpage>84</lpage>.<pub-id pub-id-type="doi">10.5596/c05-029</pub-id></citation></ref>
<ref id="B31"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>McKee</surname> <given-names>G.</given-names></name> <name><surname>Malvern</surname> <given-names>D.</given-names></name> <name><surname>Richards</surname> <given-names>B.</given-names></name></person-group> (<year>2000</year>). <article-title>Measuring vocabulary diversity using dedicated software</article-title>. <source>Lit. Linguist. Comput.</source> <volume>15</volume>, <fpage>323</fpage>&#x02013;<lpage>337</lpage>.<pub-id pub-id-type="doi">10.1093/llc/15.3.323</pub-id></citation></ref>
<ref id="B32"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Milojevi&#x00107;</surname> <given-names>S.</given-names></name></person-group> (<year>2012</year>). <article-title>How are academic age, productivity and collaboration related to citing behavior of researchers?</article-title> <source>PLoS ONE</source> <volume>7</volume>:<fpage>e49176</fpage>.<pub-id pub-id-type="doi">10.1371/journal.pone.0049176</pub-id><pub-id pub-id-type="pmid">23145111</pub-id></citation></ref>
<ref id="B33"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Milojevi&#x00107;</surname> <given-names>S.</given-names></name></person-group> (<year>2013</year>). <article-title>Accuracy of simple, initials-based methods for author name disambiguation</article-title>. <source>J. Informetrics</source> <volume>7</volume>, <fpage>767</fpage>&#x02013;<lpage>773</lpage>.<pub-id pub-id-type="doi">10.1016/j.joi.2013.06.006</pub-id></citation></ref>
<ref id="B34"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Milojevi&#x00107;</surname> <given-names>S.</given-names></name></person-group> (<year>2015</year>). <article-title>Quantifying the cognitive extent of science</article-title>. <source>J. Informetrics</source> <volume>9</volume>, <fpage>962</fpage>&#x02013;<lpage>973</lpage>.<pub-id pub-id-type="doi">10.1016/j.joi.2015.10.005</pub-id></citation></ref>
<ref id="B35"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nagano</surname> <given-names>R. L.</given-names></name></person-group> (<year>2009</year>). <article-title>Lexical comparison of journal article titles in soft disciplines</article-title>. <source>Porta Lingua</source> <volume>2009</volume>, <fpage>111</fpage>&#x02013;<lpage>117</lpage>.</citation></ref>
<ref id="B36"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nagano</surname> <given-names>R. L.</given-names></name></person-group> (<year>2015</year>). <article-title>Research article titles and disciplinary conventions: a corpus study of eight disciplines</article-title>. <source>J. Acad. Writing</source> <volume>5</volume>, <fpage>133</fpage>&#x02013;<lpage>144</lpage>.<pub-id pub-id-type="doi">10.18552/joaw.v5i1.168</pub-id></citation></ref>
<ref id="B37"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nair</surname> <given-names>L. B.</given-names></name> <name><surname>Gibbert</surname> <given-names>M.</given-names></name></person-group> (<year>2016</year>). <article-title>What makes a &#x02018;good&#x02019; title and (how) does it matter for citations? A review and general model of article title attributes in management science</article-title>. <source>Scientometrics</source> <volume>107</volume>, <fpage>1331</fpage>&#x02013;<lpage>1359</lpage>.<pub-id pub-id-type="doi">10.1007/s11192-016-1937-y</pub-id></citation></ref>
<ref id="B38"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rosner</surname> <given-names>J. L.</given-names></name></person-group> (<year>1990</year>). <article-title>Reflections of science as a product</article-title>. <source>Nature</source> <volume>345</volume>, <fpage>108</fpage>.<pub-id pub-id-type="doi">10.1038/345108a0</pub-id></citation></ref>
<ref id="B39"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sagi</surname> <given-names>I.</given-names></name> <name><surname>Yechiam</surname> <given-names>E.</given-names></name></person-group> (<year>2008</year>). <article-title>Amusing titles in scientific journals and article citation</article-title>. <source>J. Inf. Sci.</source> <volume>34</volume>, <fpage>680</fpage>&#x02013;<lpage>687</lpage>.<pub-id pub-id-type="doi">10.1177/0165551507086261</pub-id></citation></ref>
<ref id="B40"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Subotic</surname> <given-names>S.</given-names></name> <name><surname>Mukherjee</surname> <given-names>B.</given-names></name></person-group> (<year>2014</year>). <article-title>Short and amusing: the relationship between title characteristics, downloads, and citations in psychology articles</article-title>. <source>J. Inf. Sci.</source> <volume>40</volume>, <fpage>115</fpage>&#x02013;<lpage>124</lpage>.<pub-id pub-id-type="doi">10.1177/0165551513511393</pub-id></citation></ref>
<ref id="B41"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Thelwall</surname> <given-names>M.</given-names></name></person-group> (<year>2017</year>). <article-title>Avoiding obscure topics and generalising findings produces higher impact research</article-title>. <source>Scientometrics</source> <volume>110</volume>, <fpage>307</fpage>&#x02013;<lpage>320</lpage>.<pub-id pub-id-type="doi">10.1007/s11192-016-2159-z</pub-id></citation></ref>
<ref id="B42"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>van Wesel</surname> <given-names>M.</given-names></name> <name><surname>Wyatt</surname> <given-names>S.</given-names></name> <name><surname>ten Haaf</surname> <given-names>J.</given-names></name></person-group> (<year>2014</year>). <article-title>What a difference a colon makes: how superficial factors influence subsequent citation</article-title>. <source>Scientometrics</source> <volume>98</volume>, <fpage>1601</fpage>&#x02013;<lpage>1615</lpage>.<pub-id pub-id-type="doi">10.1007/s11192-013-1154-x</pub-id></citation></ref>
<ref id="B43"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Vygotsky</surname> <given-names>L. S.</given-names></name></person-group> (<year>1978</year>). <source>Mind in Society</source>. <publisher-loc>Cambridge, MA</publisher-loc>: <publisher-name>Harvard University Press</publisher-name>.</citation></ref>
<ref id="B44"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wager</surname> <given-names>E.</given-names></name> <name><surname>Altman</surname> <given-names>D. G.</given-names></name> <name><surname>Simera</surname> <given-names>I.</given-names></name> <name><surname>Toma</surname> <given-names>T. P.</given-names></name></person-group> (<year>2016</year>). <article-title>Do declarative titles affect readers&#x02019; perceptions of research findings? A randomized trial</article-title>. <source>Res. Integr. Peer Rev.</source> <volume>1</volume>, <fpage>11</fpage>.<pub-id pub-id-type="doi">10.1186/s41073-016-0018-3</pub-id></citation></ref>
<ref id="B45"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>White</surname> <given-names>A.</given-names></name></person-group> (<year>1991</year>). <article-title>A further exploration of title size and author number</article-title>. <source>J. Am. Soc. Inf. Sci.</source> <volume>42</volume>, <fpage>384</fpage>&#x02013;<lpage>385</lpage>.<pub-id pub-id-type="doi">10.1002/(SICI)1097-4571(199106)42:5&#x0003C;384::AID-ASI9&#x0003E;3.0.CO;2-G</pub-id></citation></ref>
<ref id="B46"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yitzhaki</surname> <given-names>M.</given-names></name></person-group> (<year>1994</year>). <article-title>Relation of title length of journal articles to number of authors</article-title>. <source>Scientometrics</source> <volume>30</volume>, <fpage>321</fpage>&#x02013;<lpage>332</lpage>.<pub-id pub-id-type="doi">10.1007/BF02017231</pub-id></citation></ref>
</ref-list>
<fn-group>
<fn id="fn1"><p><sup>1</sup><uri xlink:href="http://www.enchantedlearning.com/wordlist/verbs.shtml">http://www.enchantedlearning.com/wordlist/verbs.shtml</uri>.</p></fn>
</fn-group>
</back>
</article>