<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Psychol.</journal-id>
<journal-title>Frontiers in Psychology</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Psychol.</abbrev-journal-title>
<issn pub-type="epub">1664-1078</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fpsyg.2018.02538</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Psychology</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Norms for a Pictographic System: The Aragonese Portal of Augmentative/Alternative Communication (ARASAAC) System</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name><surname>Paolieri</surname> <given-names>Daniela</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/653004/overview"/>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name><surname>Marful</surname> <given-names>Alejandra</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x002A;</sup></xref>
<xref ref-type="author-notes" rid="fn002"><sup>&#x2020;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/583256/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Mind, Brain and Behavior Research Center, University of Granada</institution>, <addr-line>Granada</addr-line>, <country>Spain</country></aff>
<aff id="aff2"><sup>2</sup><institution>Department of Psychology, University of Ja&#x00E9;n</institution>, <addr-line>Ja&#x00E9;n</addr-line>, <country>Spain</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Niels Janssen, Universidad de La Laguna, Spain</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Eduardo Navarrete, Universit&#x00E0; degli Studi di Padova, Italy; Cyril Perret, University of Poitiers, France</p></fn>
<corresp id="c001">&#x002A;Correspondence: Alejandra Marful, <email>mmarful@ujaen.es</email>; <email>marful@ugr.es</email></corresp>
<fn fn-type="other" id="fn002"><p><sup>&#x2020;</sup>Present address: Alejandra Marful, Department of Experimental Psychology, University of Granada, Granada, Spain</p></fn>
<fn fn-type="other" id="fn003"><p>This article was submitted to Language Sciences, a section of the journal Frontiers in Psychology</p></fn>
</author-notes>
<pub-date pub-type="epub">
<day>14</day>
<month>12</month>
<year>2018</year>
</pub-date>
<pub-date pub-type="collection">
<year>2018</year>
</pub-date>
<volume>9</volume>
<elocation-id>2538</elocation-id>
<history>
<date date-type="received">
<day>02</day>
<month>07</month>
<year>2018</year>
</date>
<date date-type="accepted">
<day>28</day>
<month>11</month>
<year>2018</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x00A9; 2018 Paolieri and Marful.</copyright-statement>
<copyright-year>2018</copyright-year>
<copyright-holder>Paolieri and Marful</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract>
<p>Different systems are used to facilitate communication for people with speech problems. Among these, pictographic systems offer an extraordinary solution for many people with severe communication disorders; for example, people with autism spectrum disorders, aphasia, cognitive impairment, cerebral palsy, etc. The pictographic system called Aragonese Portal of Augmentative and Alternative Communication (ARASAAC <ext-link ext-link-type="uri" xlink:href="http://arasaac.org">http://arasaac.org</ext-link>), freely distributed under the Creative Commons License (BY-NC-SA), is an important reference in many countries. Although these images are widely used, there are no previous studies on their reliability and validity. In order to obtain a useful tool in the clinical context, scores of name agreement, H index, tip-of-the-tongue responses, conceptual familiarity, image agreement, visual complexity, and response times were collected for the 295 most frequent images in the ARASAAC dataset. The psychometric analyses showed adequate validity and reliability values. The regression analysis indicated that naming times were explained by picture-name agreement, age of acquisition, and conceptual familiarity, while the tip-of-the-tongue states were mainly predicted by picture-name agreement and name agreement. In conclusion, these norms from the ARASAAC dataset offer a valuable tool for clinical intervention as well as for psycholinguistic research.</p>
</abstract>
<kwd-group>
<kwd>augmentative and alternative communication</kwd>
<kwd>pictographic system</kwd>
<kwd>picture naming</kwd>
<kwd>Spanish normative study</kwd>
<kwd>language production</kwd>
</kwd-group>
<contract-num rid="cn001">PSI2013-46033-P</contract-num>
<contract-num rid="cn001">PSI2017-89324-C2-2-P</contract-num>
<contract-num rid="cn001">PCIN-2015-165-C02-01</contract-num>
<contract-num rid="cn001">PSI2017-89324-P</contract-num>
<contract-sponsor id="cn001">Ministerio de Econom&#x00ED;a y Competitividad<named-content content-type="fundref-id">10.13039/501100003329</named-content></contract-sponsor>
<counts>
<fig-count count="0"/>
<table-count count="4"/>
<equation-count count="0"/>
<ref-count count="53"/>
<page-count count="9"/>
<word-count count="0"/>
</counts>
</article-meta>
</front>
<body>
<sec><title>Introduction</title>
<p>Among all possible ways of responding to the basic need of human communication, pictographic language offers an extraordinary solution for many people with serious expressive or receptive communication disorders (<xref ref-type="bibr" rid="B5">Beukelman and Mirenda, 2013</xref>). The pictographic language transmits a message with simplicity and clarity, beyond cultural, linguistic, or cognitive boundaries, using images or symbols that represent people, objects, or ideas (see <xref ref-type="bibr" rid="B44">Romski et al., 2015</xref>, for a review on augmentative communication intervention). The Aragonese Portal of Augmentative and Alternative Communication (ARASAAC) pictographic system (<xref ref-type="bibr" rid="B41">Palao, 2013</xref>) was implemented in 2007 as part of a project financed and coordinated by the Department of Education, Culture and Sports of the Government of Aragon and coordinated by the General Direction of Innovation, Equity, and Participation with the collaboration of the Aragon Center for Technologies for Education (CATEDU) and the Public School of Special Education in Alborada (Zaragoza), Spain. In recent years, this system has become an important reference in countries such as Spain, France, Brazil, Italy, Finland, Germany, and Belgium, and it is becoming increasingly more widespread worldwide (United States, Senegal, Qatar, etc.) (<xref ref-type="bibr" rid="B43">Romero Corral and Marcos Rodrigo, 2016</xref>). The dictionary of Spanish words within the complete set of pictograms has been translated to 17 languages: Arabic, Chinese, Romanian, Russian, Polish, Bulgarian, English, French, Italian, German, Portuguese, Brazilian, Croatian, Euskera, Galician, Catalan, and Valencian. All the pictograms and their corresponding names (in color <italic>N</italic> = 18206; 2018, July) are freely distributed under the Creative-Commons License (BY-NC-SA). This has allowed the presence of ARASAAC in different areas such as education, hospitals, care for the elderly, adaptation of documents, accessibility of a means of communication, accessible tourism, or signage. Proof of this relevance and diffusion are the numerous awards it has received, including candidacy for the Prince of Asturias Awards for Communication and Humanities.</p>
<p>Beyond these merits, the ARASAAC database seems to be one of the most appropriate augmentative alternative communication systems when compared with other pictographic systems. Thus, the research of <xref ref-type="bibr" rid="B11">Cabello and Bertola (2015)</xref> was focused on the analysis of iconicity and transparency of 38 ARASAAC pictograms taken from 4 grammatical categories: names, verbs, adjectives, and linguistic symbols. This study compared this set of pictograms with other well-known pictographic systems, such as Picture Communication Symbols (<xref ref-type="bibr" rid="B31">Johnson, 1981</xref>) and Bliss (<xref ref-type="bibr" rid="B6">Bliss, 1965</xref>; <xref ref-type="bibr" rid="B29">Hehner, 1980</xref>). The results showed that the ARASAAC pictograms had a greater degree of transparency and iconicity than the Picture Communication Symbols (with the exception of transparency for linguistic symbols, where there was no difference) and Bliss systems. Consequently, ARASAAC is one of the preferred augmentative alternative communication systems.</p>
<p>The usefulness of this database can, however, be constrained by several limitations that modulate language production. First, the provided names in the ARASAAC dataset have been assigned to a given picture according to subjective criteria, and are not based on controlled and systematic normative studies. Therefore, the corresponding name-picture in this dataset may not be the most appropriate, and consequently, it is possible that professionals might employ a label for a given pictogram that differs from the meaning assigned by the patients. Second, psycholinguistic variables have been proven to affect the development of name production. Some of these variables refer to general properties of a concept (e.g., word frequency, concreteness, word length, age of acquisition etc.) and can be easily obtained from existing databases that contain normative data for wide sets of words, for example EsPal (<xref ref-type="bibr" rid="B20">Duchon et al., 2013</xref>), NIM (<xref ref-type="bibr" rid="B27">Guasch et al., 2013</xref>) or NIPE (D&#x00ED;ez et al., 2014). Other variables, however, are strongly tied to the selected stimuli in a dataset and need to be derived from the specific group of pictures in which we are interested. Thus, for example, the relation between the picture of a concept and our mental image of this concept (image agreement), conceptual familiarity and the visual complexity of the picture (<xref ref-type="bibr" rid="B48">Snodgrass and Vanderwart, 1980</xref>) depend on the images we are presented with. These indices, among others, can explain why one picture is easily named and/or recognizable, but a similar one is not.</p>
<p>Most views of word production (e.g., <xref ref-type="bibr" rid="B18">Dell, 1986</xref>; <xref ref-type="bibr" rid="B24">Glaser, 1992</xref>; <xref ref-type="bibr" rid="B12">Caramazza, 1997</xref>; <xref ref-type="bibr" rid="B35">Levelt et al., 1999</xref>; <xref ref-type="bibr" rid="B8">Bonin et al., 2002</xref>) assume that object naming involves several processing levels to reach the correct articulation and execution of the necessary motor program. According to <xref ref-type="bibr" rid="B35">Levelt et al. (1999)</xref> influential model, the first level is the perceptual analysis of the visual input, which results in the activation of structural representation and in the recognition of the object. Next, the activation spreads to the central level of lexical access, with the retrieval of semantic/conceptual information, lexical (&#x201C;lemma&#x201D;) selection and lexeme formation, with the composition of the phonological information. Each of the variables for which we recollect the norms (name agreement, visual complexity, image agreement, conceptual familiarity) affects one (or more) of these processing levels, as we specify in the following part, and it is also desirable to know the specific values of these dimensions for the ARASAAC set of pictures.</p>
<p>To achieve this aim, we collected normative data for a set of pictures from the ARASAAC system. For example, two indices for name agreement were calculated: first, the name agreement index refers to the percentage of modal name responses out of the total responses for a given picture. Given that name agreement is not sensitive to the heterogeneity of the names produced for a picture, we also calculated the preferable name agreement index, called the H statistic (<xref ref-type="bibr" rid="B48">Snodgrass and Vanderwart, 1980</xref>).</p>
<p>Lower levels of name agreement typically produce slower responses to a picture (<xref ref-type="bibr" rid="B52">Vitkovitch and Tyrrell, 1995</xref>; <xref ref-type="bibr" rid="B3">Barry et al., 1997</xref>; <xref ref-type="bibr" rid="B8">Bonin et al., 2002</xref>; <xref ref-type="bibr" rid="B47">Shao et al., 2014</xref>). Two main sources of this effect have been proposed: uncertainty regarding pictures or alternative names of depicted objects. The first one seems to have its locus at the stage of object recognition, whereas the second one, regarding the activation of more than one alternative name, occurs after conceptual access at the name retrieval stage (<xref ref-type="bibr" rid="B52">Vitkovitch and Tyrrell, 1995</xref>; <xref ref-type="bibr" rid="B8">Bonin et al., 2002</xref>; <xref ref-type="bibr" rid="B13">Cheng et al., 2010</xref>).</p>
<p>Also located in the structural level, visual complexity is defined as the number of lines or the intricacy of the lines. The more visually complex a picture is, the harder it is to process (<xref ref-type="bibr" rid="B28">Hartje et al., 1986</xref>), although not much experimental evidence has found this factor to be a significant predictor of picture-naming speed (e.g., <xref ref-type="bibr" rid="B3">Barry et al., 1997</xref>; <xref ref-type="bibr" rid="B16">Cycowicz et al., 1997</xref>; <xref ref-type="bibr" rid="B8">Bonin et al., 2002</xref>, <xref ref-type="bibr" rid="B9">2003</xref>; but see <xref ref-type="bibr" rid="B22">Ellis and Morrison, 1998</xref>; <xref ref-type="bibr" rid="B2">Alario et al., 2004</xref>; and <xref ref-type="bibr" rid="B42">Perret and Bonin, 2018</xref> for a recent meta-analysis). However, we consider it relevant to include this variable in our database, as it can have some effect at the level of picture&#x2019; visual characteristic processing, especially considering that the pictures in the ARASAAC dataset can vary according to various physical features (shape, surface details, background, color etc.). Moreover, image agreement refers to the degree of correspondence between the provided picture for a given concept and the mental image we have for this concept in the corresponding stored structural representation (<xref ref-type="bibr" rid="B3">Barry et al., 1997</xref>). Pictures with higher values of image agreement produce faster responses in a naming task (<xref ref-type="bibr" rid="B3">Barry et al., 1997</xref>; <xref ref-type="bibr" rid="B8">Bonin et al., 2002</xref>).</p>
<p>Finally, conceptual familiarity was defined as the degree of physical or mental contact with an object, influencing the facility of access to semantic/conceptual representations. Despite the mixed evidence observed on the impact of this variable on the picture-naming performance of healthy participants (e.g.,<xref ref-type="bibr" rid="B49">Snodgrass and Yuditsky, 1996</xref>; <xref ref-type="bibr" rid="B15">Cuetos et al., 1999</xref>; but see also <xref ref-type="bibr" rid="B8">Bonin et al., 2002</xref>; <xref ref-type="bibr" rid="B2">Alario et al., 2004</xref>), the importance of conceptual familiarity in picture naming has been highlighted in a recent meta-analysis (<xref ref-type="bibr" rid="B42">Perret and Bonin, 2018</xref>) and in the picture-naming performance of aphasic patients (e.g., <xref ref-type="bibr" rid="B30">Hirsh and Funnell, 1995</xref>), with direct relevance for a tool for communication disorders like ARASAAC.</p>
<p>In sum, for a set of the most frequent pictures in the ARASAAC system, the modal name, name agreement index, H index, number of ToT states, image agreement scores, visual complexity scores, conceptual familiarity scores and naming times were collected. We expect that these data were useful in both clinical and research realms.</p>
</sec>
<sec id="s1" sec-type="materials|methods">
<title>Materials and Methods</title>
<sec><title>Participants</title>
<p>A total of 219 students from the University of Ja&#x00E9;n in Spain participated in this experiment in exchange for course credits. All were native Spanish speakers and had normal or corrected vision. There were different participants for each of the main tasks reported below. All participants gave written informed consent. This protocol was approved by the University of Ja&#x00E9;n (Spain) ethics committee.</p>
</sec>
<sec><title>Materials and Procedure</title>
<p>A set of words from the ARASAAC dataset and their corresponding pictures were included in this normative study. As a general outline, we first selected a set of concepts (word selection phase) and their corresponding pictures (picture selection phase). Later, pictures were presented in isolation in a written naming task (name agreement task) and next to these pictures, the most commonly produced name for each picture was selected for the following phases. Here, conceptual familiarity (conceptual familiarity task), image agreement (image agreement task) and visual complexity (visual complexity task) scores and response times, as well as other related measures (response time task), were collected. Stimulus presentation and data collection were controlled by E-prime software (version 2.0; <xref ref-type="bibr" rid="B46">Schneider et al., 2012</xref>).</p>
<sec><title>Word Selection Phase</title>
<p>From the color pictogram catalog at the ARASAAC website<sup><xref ref-type="fn" rid="fn01">1</xref></sup> we selected the 300 common names and verbs that were rated as more frequent in the ESPAL database (<xref ref-type="bibr" rid="B20">Duchon et al., 2013</xref>). Prepositions, conjunctions, adverbs, adjectives, proper names, and words without concrete values in ESPAL were previously eliminated from this set of words. A deeper revision of the resulting set of stimuli ended with the elimination of 1 item, since there was not a pictogram for the general concept (i.e., there were pictograms for the numbers 1, 2, 3, etc., but not for the token &#x201C;number&#x201D;) and 4 items with double grammatical functions (name/verb and adjective) where the corresponding pictogram only reflected the adjectival meaning. Consequently, out of the 300 initial stimuli, 295 items passed to the following phase. These stimuli were downloaded between December 2016 and January 2017.</p>
</sec>
<sec><title>Picture Selection Phase</title>
<p>Only one picture was selected for each collected word. Given that in this dataset, there were some cases where words were associated with more than one picture, a set of criteria for selecting a unique picture were followed. First, we chose the picture that corresponded in gender and number to the selected words (e.g., if the word was the masculine &#x201C;abogado&#x201D; (lawyer) we eliminated the pictures of a woman lawyer and the pictures of a group of lawyers). Second, if for one word there were pictures that referred to general terms and pictures that referred to cases, we selected the picture of the most general term. For example, the ARASAAC database contained different pictures for the word &#x201C;die.&#x201D; Thus, there were (a) one picture with a cube rotted at an angle that showed some of its sides or (b) six pictures of a cube showing one only side with one, two,&#x2026; or six dots. In order to select an only picture, we considered that the first one was more general and a better representation of the general concept &#x201C;die&#x201D; and consequently, we selected this item. Third, we also selected the pictures most appropriate for the geographic context of these norms, thus, for the countries and flags, we selected the items that corresponded to Spain. Fourth, in the cases of pictures that were associated with ambiguous words (i.e., words with more than one meaning or sense; for example, in Spanish, <italic>banco</italic> means bank but also bench), we selected the most frequent meaning based on the databases for ambiguous words from <xref ref-type="bibr" rid="B23">Fraga et al. (2017)</xref> and <xref ref-type="bibr" rid="B26">G&#x00F3;mez-Veiga et al. (2010)</xref>. Out of the 28 words identified as ambiguous, two showed a tie in the frequency of production of their different senses or meanings, and 15 did not appear in either of these norms. This implied that there were no objective criteria to find an individual picture to 17 (15+2) ambiguous words. To select only one picture for these ambiguous words and for the rest of the words where more than one pictured referred to the same item and did not fulfill any of the four previously described criteria, we conducted a preliminary study in which each word and the different associated pictures appeared in a picture selection task. In total, 155 words were selected for this task. Subsequently, a sample of 41 participants (34 females, mean age = 20.98, <italic>SD</italic> = 1.93) were presented with each word beside their corresponding pictures (from 2 to 11 pictures per word). The pictures associated with each word were numbered and appeared centered on the computer screen above the corresponding word. Each slide (preceded by a 1-s fixation point) appeared in random order for each participant for 8 s, or until a response was given. Frequency and response times were recorded. Participants indicated which picture was the most related to the word using the keyboard. For each word, the most frequently selected picture (or the pictures with fastest responses in the case of tied results) was selected to be employed in the following phase. On average, these pictures were selected by the 66.4% of the participants (<italic>SD</italic> = 18.4; range = 26.8&#x2013;100%). Mean RTs for the responses to these items were 3153 ms (<italic>SD</italic> = 816; range = 1989&#x2013;5601 ms).</p>
</sec>
<sec><title>Written Name Agreement Task</title>
<p>The previously selected pictures appeared in a written name agreement task. A total of 39 participants (29 females, mean age = 21.23, <italic>SD</italic> = 4.22) were presented with the 295 pictures and, following <xref ref-type="bibr" rid="B48">Snodgrass and Vanderwart (1980)</xref> procedure, participants were instructed to write the first name that came to mind (without explicit reference to respond as fast as possible). If participants were not able to respond, (they did not know the picture, they knew the picture but not its name; they knew the picture name, but they suffered a ToT experience<sup><xref ref-type="fn" rid="fn02">2</xref></sup>) using an apposite option on the computer&#x2019;s numeric keyboard. The stimuli appeared in a random order for each participant. Each trial started with a fixation point (300 ms), followed by a picture for name generation (6 s), a blank slide (300 ms), and a slide to indicate the reason for a non-response (5 s) when appropriate.</p>
<p>For each picture, the most frequently produced instances were selected to be employed in the following phase. In the few cases where there was a tie between the frequency of two instances (4% of the total), the one associated with faster response times was preferred (but note that we did not instruct participants to respond as quickly as possible).</p>
<p>In two cases, the fastest response was not selected by error; these words are highlighted by an asterisk in the data set.</p>
</sec>
<sec><title>Index Recollection</title>
<p>The previously selected stimuli presented in the index recollection tasks appeared in a random order for each participant, using procedures like the ones employed in other studies (<xref ref-type="bibr" rid="B10">Bonin et al., 2008</xref>; <xref ref-type="bibr" rid="B38">Marful et al., 2018</xref>).</p>
<sec>
<title>Conceptual familiarity task</title>
<p>Conceptual familiarity ratings were collected by following <xref ref-type="bibr" rid="B3">Barry et al. (1997)</xref> and <xref ref-type="bibr" rid="B15">Cuetos et al. (1999)</xref> procedure. Thirty participants (26 females, mean age = 22, <italic>SD</italic> = 5.21) were instructed to rate the conceptual familiarity of each picture defined as &#x2018;the degree to which you come in contact with, or think about, the thing depicted&#x2019;. Thus, after a fixation point (500 ms), the picture appeared for 4 s or until a response, and participants rated its conceptual familiarity on a five-point Likert scale (1 = very unfamiliar, 5 = highly familiar).</p>
</sec>
<sec>
<title>Image agreement task</title>
<p>In this task, 34 participants (29 females, mean age = 20.35, <italic>SD</italic> = 1.62) indicated the extent to which a presented picture corresponded to the mental image they had of the corresponding concept (e.g., <xref ref-type="bibr" rid="B37">Marful et al., 2015</xref>). Thus, after a fixation point (500 ms), the corresponding word appeared on the center of the screen (2 s). After that, a fixation point was showed and participants were instructed to create their mental image of this concept (5 s). Finally, the picture was presented for 4 s or until a response, and participants rated the agreement between their mental image and the presented picture on a 5-point Likert scale (1 = low agreement, 5 = high agreement).</p>
</sec>
<sec>
<title>Visual complexity task</title>
<p>Following previously established procedures (e.g., <xref ref-type="bibr" rid="B14">Cuetos and Alija, 2003</xref>; <xref ref-type="bibr" rid="B7">Bonin et al., 2004</xref>), 35 participants (30 females, mean age = 21.65, <italic>SD</italic> = 5.24) were instructed to rate the complexity of each picture. They were told to rate the picture itself rather than the complexity of the concept that it represented. Visual complexity was defined as the number of details of the picture or the intricacy of the lines. Thus, after a fixation point (500 ms), the picture appeared for 4 s or until a response, and participants rated its visual complexity in a 5-point Likert scale (1 = very simple, 5 = very complex).</p>
<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption><p>Descriptive statistics in the normative study.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<th valign="top" align="left"></th>
<th valign="top" align="center">Name agreement</th>
<th valign="top" align="center">H index</th>
<th valign="top" align="center">Conceptual familiarity</th>
<th valign="top" align="center">Image Agreement</th>
<th valign="top" align="center">Visual Complexity</th>
<th valign="top" align="center">Phonemes</th>
<th valign="top" align="center">ToTs</th>
<th valign="top" align="center">RTs</th>
<th valign="top" align="center">AoA</th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Mean</td>
<td valign="top" align="center">0.5</td>
<td valign="top" align="center">2.04</td>
<td valign="top" align="center">3.6</td>
<td valign="top" align="center">4.14</td>
<td valign="top" align="center">2.38</td>
<td valign="top" align="center">6.2</td>
<td valign="top" align="center">0.89</td>
<td valign="top" align="center">1097</td>
<td valign="top" align="center">2.66</td>
</tr>
<tr>
<td valign="top" align="left">Standard Deviation</td>
<td valign="top" align="center">0.25</td>
<td valign="top" align="center">0.92</td>
<td valign="top" align="center">0.8</td>
<td valign="top" align="center">1.2</td>
<td valign="top" align="center">1.46</td>
<td valign="top" align="center">2.03</td>
<td valign="top" align="center">1.34</td>
<td valign="top" align="center">236</td>
<td valign="top" align="center">0.80</td>
</tr>
<tr>
<td valign="top" align="left">Asymmetry Percentile</td>
<td valign="top" align="center">0.346</td>
<td valign="top" align="center">&#x2212;0.345</td>
<td valign="top" align="center">&#x2212;0.84</td>
<td valign="top" align="center">&#x2212;1.01</td>
<td valign="top" align="center">0.25</td>
<td valign="top" align="center">0.69</td>
<td valign="top" align="center">3.01</td>
<td valign="top" align="center">0.97</td>
<td valign="top" align="center">0.88</td>
</tr>
<tr>
<td valign="top" align="left">25</td>
<td valign="top" align="center">0.29</td>
<td valign="top" align="center">1.3</td>
<td valign="top" align="center">3.21</td>
<td valign="top" align="center">3.89</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">5</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">925</td>
<td valign="top" align="center">2.16</td>
</tr>
<tr>
<td valign="top" align="left">50</td>
<td valign="top" align="center">0.46</td>
<td valign="top" align="center">2.16</td>
<td valign="top" align="center">3.73</td>
<td valign="top" align="center">4.24</td>
<td valign="top" align="center">2.36</td>
<td valign="top" align="center">6</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">1059</td>
<td valign="top" align="center">2.60</td>
</tr>
<tr>
<td valign="top" align="left">75</td>
<td valign="top" align="center">0.72</td>
<td valign="top" align="center">2.77</td>
<td valign="top" align="center">4.23</td>
<td valign="top" align="center">4.53</td>
<td valign="top" align="center">2.76</td>
<td valign="top" align="center">7</td>
<td valign="top" align="center">1.00</td>
<td valign="top" align="center">1233</td>
<td valign="top" align="center">2.96</td>
</tr>
<tr>
<td valign="top" align="left">Reliability</td>
<td valign="top" align="center">0.93</td>
<td valign="top" align="center">0.91</td>
<td valign="top" align="center">0.94</td>
<td valign="top" align="center">0.91</td>
<td valign="top" align="center">0.88</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="center">0.84</td>
<td valign="top" align="center">&#x2013;</td>
</tr>
</tbody>
</table>
</table-wrap>
<table-wrap position="float" id="T2">
<label>Table 2</label>
<caption><p>Correlations.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<th valign="top" align="left"></th>
<th valign="top" align="center">Name agreement</th>
<th valign="top" align="center">H</th>
<th valign="top" align="center">Conceptual familiarity</th>
<th valign="top" align="center">Image agreement</th>
<th valign="top" align="center">Visual complexity</th>
<th valign="top" align="center">Phonemes</th>
<th valign="top" align="center">AoA</th>
<th valign="top" align="center">ToTs</th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">H</td>
<td valign="top" align="center">&#x2212;0.931<sup>&#x2217;&#x2217;</sup></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">Conceptual familiarity</td>
<td valign="top" align="center">0.433<sup>&#x2217;&#x2217;</sup></td>
<td valign="top" align="center">&#x2212;0.351<sup>&#x2217;&#x2217;</sup></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">Image agreement</td>
<td valign="top" align="center">0.486<sup>&#x2217;&#x2217;</sup></td>
<td valign="top" align="center">&#x2212;0.413<sup>&#x2217;&#x2217;</sup></td>
<td valign="top" align="center">0.462<sup>&#x2217;&#x2217;</sup></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">Visual complexity</td>
<td valign="top" align="center">&#x2212;0.166<sup>&#x2217;&#x2217;</sup></td>
<td valign="top" align="center">0.148<sup>&#x2217;</sup></td>
<td valign="top" align="center">&#x2212;0.017</td>
<td valign="top" align="center">&#x2212;0.049</td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">Phonemes</td>
<td valign="top" align="center">&#x2212;0.109</td>
<td valign="top" align="center">0.157<sup>&#x2217;&#x2217;</sup></td>
<td valign="top" align="center">0.152<sup>&#x2217;&#x2217;</sup></td>
<td valign="top" align="center">0.068</td>
<td valign="top" align="center">0.199<sup>&#x2217;&#x2217;</sup></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">AoA</td>
<td valign="top" align="center">&#x2212;0.138</td>
<td valign="top" align="center">0.170<sup>&#x2217;</sup></td>
<td valign="top" align="center">&#x2212;0.086</td>
<td valign="top" align="center">&#x2212;0.110</td>
<td valign="top" align="center">0.268<sup>&#x2217;&#x2217;</sup></td>
<td valign="top" align="center">0.348<sup>&#x2217;&#x2217;</sup></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">ToTs</td>
<td valign="top" align="center">&#x2212;0.360<sup>&#x2217;&#x2217;</sup></td>
<td valign="top" align="center">0.290<sup>&#x2217;&#x2217;</sup></td>
<td valign="top" align="center">&#x2212;0.204<sup>&#x2217;&#x2217;</sup></td>
<td valign="top" align="center">&#x2212;0.349<sup>&#x2217;&#x2217;</sup></td>
<td valign="top" align="center">0.121<sup>&#x2217;</sup></td>
<td valign="top" align="center">0.006</td>
<td valign="top" align="center">0.120</td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">RT</td>
<td valign="top" align="center">&#x2212;0.335<sup>&#x2217;&#x2217;</sup></td>
<td valign="top" align="center">0.334<sup>&#x2217;&#x2217;</sup></td>
<td valign="top" align="center">&#x2212;0.294<sup>&#x2217;&#x2217;</sup></td>
<td valign="top" align="center">&#x2212;0.415<sup>&#x2217;&#x2217;</sup></td>
<td valign="top" align="center">0.227<sup>&#x2217;&#x2217;</sup></td>
<td valign="top" align="center">0.122<sup>&#x2217;</sup></td>
<td valign="top" align="center">0.355<sup>&#x2217;&#x2217;</sup></td>
<td valign="top" align="center">0.266<sup>&#x2217;&#x2217;</sup></td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<attrib><italic><sup>&#x2217;&#x2217;</sup>p &#x003C; 0.01; <sup>&#x2217;</sup>p &#x003C; 0.05.</italic></attrib>
</table-wrap-foot>
</table-wrap>
</sec>
</sec>
<sec><title>Response Time (RT) Task</title>
<p>The previous 295 pictures were presented to 40 participants (34 females, mean age = 20.86, <italic>SD</italic> = 2.54) in a response time naming task using a vocal key. Participants were instructed to name each picture as soon as possible without error or hesitation, or they had to indicate the reason in case they were not able to produce a response (they did not know the picture, they knew the picture but not its name, or they knew the picture name, but they suffered a ToT experience) using an appropriate choice on the computer&#x2019;s numeric keyboard. One randomized list was created and divided in two blocks counterbalanced across participants. Each trial started with a fixation point (500 ms), followed by a picture to name (4 s), a slide to indicate the reason for a non-response when appropriate (4 s), and a blank inter-trial slide (2 s). Stimuli appeared with breaks every 20 assays. Naming errors, hesitations, and voice-key failures were recorded by the experimenter.</p>
</sec>
</sec></sec>
<sec><title>Results</title>
<p>This dataset is available in Supplementary Table <xref ref-type="supplementary-material" rid="SM1">S1</xref>, that contains the modal name of each picture and its English translation, the name of the picture in the ARASAAC norms followed by its English translation, a column indicating if the modal name and the name provided in ARASAAC coincide, the name of the file for each picture, two measures of name agreement (name agreement scores and H scores), means of conceptual familiarity, visual complexity, image agreement, number of ToTs, and response times (RT). The number of phonemes of the modal name and values of age of acquisition (AoA) from the ESPAL database (<xref ref-type="bibr" rid="B20">Duchon et al., 2013</xref>) and <xref ref-type="bibr" rid="B17">Davies et al. (2013)</xref>, respectively, were also provided. Unless otherwise indicated, item analyses were performed averaging or counting over subjects.</p>
<sec><title>Validity and Reliability</title>
<p>Finally, in the last column, a measure of the validity of the different scales is provided. Since this is the first normative study with ARASAAC pictograms collected in Spain, validity cannot be tested by comparison to an external study. However, given that two different samples of subjects performed name generation tasks when presented the same set of pictures (i.e., participants produced written names in the proper name agreement task and named pictures vocally in the RT task), we conducted a validity test on these data. Although correlational analyses have traditionally been carried out to estimate this psychometric index, when the assignment involves a generation task, other indices seem more convenient (e.g., see <xref ref-type="bibr" rid="B53">Yoon et al., 2004</xref>, for a list of possible limitations of correlational analysis in a similar context). Consequently, we calculate the Hellinger affinity (HA) scores for each concept (see the equation below and <xref ref-type="bibr" rid="B34">Lausen et al., 2005</xref>, for a more complete description). This index has also been calculated in other normative studies that included generation tasks (e.g., <xref ref-type="bibr" rid="B53">Yoon et al., 2004</xref>; <xref ref-type="bibr" rid="B37">Marful et al., 2015</xref>).</p>
<p>Hellinger affinity indicates the degrees of overlap between two distributions (the written name agreement and the oral name agreement data in this case), and its value range from 1 (two identical distributions) to 0 (indicating no overlap between the distributions). For each concept, HA is calculated by finding the square root of the product of the two distribution proportions (<italic>p<sub>i</sub>, q<sub>i</sub>)</italic>. Results indicate a high degree of overlap between the two naming tasks (mean = 0.78, <italic>SD</italic> = 0.14); in fact, HA values higher than 0.50 were obtained for 95% of the concepts (see Supplementary Table <xref ref-type="supplementary-material" rid="SM1">S1</xref>). Taken together, these data confirmed the general validity of the normative study.</p>
<disp-formula><mml:math id="M1"><mml:mrow><mml:mtext>HA</mml:mtext><mml:mo stretchy='false'>(</mml:mo><mml:mi>p</mml:mi><mml:mo>,</mml:mo><mml:mtext>&#x00A0;</mml:mtext><mml:mi>q</mml:mi><mml:mo stretchy='false'>)</mml:mo><mml:mo>=</mml:mo><mml:mstyle displaystyle='true'><mml:munderover><mml:mo>&#x2211;</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mtext>n</mml:mtext></mml:munderover><mml:mrow><mml:msqrt><mml:mrow><mml:msub><mml:mi>p</mml:mi><mml:mtext>i</mml:mtext></mml:msub><mml:msub><mml:mi>q</mml:mi><mml:mtext>i</mml:mtext></mml:msub></mml:mrow></mml:msqrt></mml:mrow></mml:mstyle></mml:mrow></mml:math></disp-formula>
<p>The reliability of the different scales was evaluated employing the split-half method. To this aim, participants were randomly divided into two equal groups in each scale, and the values obtained were correlated employing the Spearman&#x2013;Brown correction. High levels of reliability were observed in all the scales as depicted in Table <xref ref-type="table" rid="T1">1</xref> (rank 0.84&#x2013;0.93, average = 0.89).</p>
</sec>
<sec><title>Descriptive Statistics</title>
<p>Table <xref ref-type="table" rid="T1">1</xref> contains the means of the descriptive statistics for the different tasks. First, name agreement scores for each picture were calculated.</p>
<p>As described below, two indices of name agreement were computed. First, we calculated the name agreement index, that is, the percentage of modal name responses out of the total responses for a given picture. Given that NA is not sensitive to the heterogeneity of the names produced for a picture, we also calculated the preferable name agreement index, called the H statistic (<xref ref-type="bibr" rid="B48">Snodgrass and Vanderwart, 1980</xref>). <italic>H</italic>-values close to 0 indicate a high degree of agreement between participants, while higher values show a reduced degree of agreement. The formula used to calculate H scores is depicted below: <italic>K</italic> refers to the number of different names provided for each picture and <italic>p<sub>i</sub></italic> is the proportion of responses to each name. The three categories of naming problems (i.e., &#x201C;do not know the picture,&#x201D; &#x201C;do not know its name,&#x201D; or a &#x201C;ToT&#x201D; state), that were included when calculating proper name agreement were eliminated when calculating H.</p>
<disp-formula><mml:math id="M2"><mml:mrow><mml:mtext>H</mml:mtext><mml:mo>=</mml:mo><mml:mstyle displaystyle='true'><mml:munderover><mml:mo>&#x2211;</mml:mo><mml:mrow><mml:mtext>i</mml:mtext><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mtext>K</mml:mtext></mml:munderover><mml:mrow><mml:msub><mml:mi>p</mml:mi><mml:mtext>i</mml:mtext></mml:msub><mml:msub><mml:mrow><mml:mi>log</mml:mi></mml:mrow><mml:mn>2</mml:mn></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:mrow><mml:mn>1</mml:mn><mml:mo>/</mml:mo><mml:mrow><mml:msub><mml:mi>p</mml:mi><mml:mi>i</mml:mi></mml:msub></mml:mrow></mml:mrow><mml:mo stretchy='false'>)</mml:mo></mml:mrow></mml:mstyle></mml:mrow></mml:math></disp-formula>
<p>Results for these two indices showed a low level of agreement accompanied by a high variability in these values (see Table <xref ref-type="table" rid="T1">1</xref> for descriptive statistics). The name agreement distribution showed a positive asymmetry, illustrating that low levels of name agreement were more frequent than high levels of name agreement. In the same sense, the distribution of H scores showed a negative asymmetry, indicating that high H scores were more frequent. As traditionally observed, there was a significant negative correlation between the name agreement and the H scores (<italic>r</italic> = 0.93, <italic>p &#x003C;</italic> 0.0001).</p>
<p>We also compared the total number of coincidences between the modal category obtained in the name agreement task and the name provided by the ARASAAC norms. Out of 295, there were 188 cases (63.7%) where these two names differed.</p>
<p>The results of the conceptual familiarity scores indicated that, on average, participants rated the selected pictures with a medium level of familiarity. These values were negatively distributed; that is, higher values of familiarity were more frequent (see Table <xref ref-type="table" rid="T1">1</xref>).</p>
<p>Mean values of Image Agreement indicate a high level of correspondence between the picture and the mental image of the concept. The distribution of the values showed a negative asymmetry, indicating that higher values of correspondence were more frequent.</p>
<p>Visual complexity scores showed that the selected pictures were, on average, considered relatively simple (see Table <xref ref-type="table" rid="T1">1</xref>). Supporting this idea, lower values of complexity were more frequent in the data distribution as revealed by the negative asymmetry value.</p>
<p>ToTs were rarely elicited by these stimuli (<italic>M</italic> = 0.89) and the distribution showed a positive asymmetry; low numbers of ToTs were more frequent.</p>
</sec>
<sec><title>Response Times and ToTs</title>
<p>Similar to the written name agreement task, responses during the RT task were highly variable. We employed the same cut-offs used in <xref ref-type="bibr" rid="B10">Bonin et al. (2008)</xref> and in <xref ref-type="bibr" rid="B38">Marful et al. (2018)</xref>. Thus, we deleted data from participants with less than 21% of correct responses (a total of 3 participants) and RTs that exceeded 2 SD from each item&#x2019;s mean.</p>
<p>Interestingly, RTs correlated with all indices (see Table <xref ref-type="table" rid="T2">2</xref>). Concretely, RT was positively correlated with the H index, visual complexity, number of phonemes, AoA, and ToTs, and negatively with name agreement, conceptual familiarity, and image agreement. The H index correlated positively with visual complexity, number of phonemes, AoA, and ToTs and, negatively with name agreement and conceptual familiarity. Name agreement correlated positively with image agreement and conceptual familiarity and negatively with visual complexity and ToTs. Conceptual familiarity and ToTs were negatively correlated while conceptual familiarity and image agreement correlated positively. Finally, visual complexity correlated positively with number of phonemes, AoA, and ToTs, and number of phonemes correlated positively with conceptual familiarity and AoA.</p>
<p>All the variables with the exception of the H index (that were strongly correlated with name agreement) were submitted as independent variables to a step-wise regression analysis with response times as dependent variable<sup><xref ref-type="fn" rid="fn03">3</xref></sup>. In the stepwise regression analysis, each independent variable with the smallest <italic>p</italic>-value was entered, and variables already in the model were removed if their probabilities were sufficiently large. This method terminated when no more variables were eligible for inclusion or removal (IBM SPSS, Version 20).</p>
<p>Results indicated that image agreement, AoA and conceptual familiarity predicted RTs; see Table <xref ref-type="table" rid="T3">3</xref>. When only exemplars with higher levels of name agreement were selected (i.e., values equal to or higher than 0.50), results indicated that visual complexity, name agreement, image agreement, and AoA explained the variability in response times.</p>
<p>A different step-wise regression analysis was carried out with the number of ToTs as dependent variables and the rest of the variables, with the exception of the H index, as independent variables. Results indicated that the best model included image agreement and name agreement as predictors. When only values equal to or higher than 0.50 in the name agreement scores were selected, image agreement and visual complexity entered in to the model. See Table <xref ref-type="table" rid="T4">4</xref>.</p>
<table-wrap position="float" id="T3">
<label>Table 3</label>
<caption><p>Step-wise regression with RT as a dependent variable.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<th valign="top" align="left">Variables</th>
<th valign="top" align="center"><italic>B</italic></th>
<th valign="top" align="center"><italic>SE</italic></th>
<th valign="top" align="center"><italic>t</italic></th>
<th valign="top" align="center">Sig.</th>
<th valign="top" align="center"><italic>R</italic><sup>2</sup></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Image agreement</td>
<td valign="top" align="center">&#x2212;149.13</td>
<td valign="top" align="center">30.1</td>
<td valign="top" align="center">&#x2212;4.94</td>
<td valign="top" align="center">0.0001</td>
<td valign="top" align="center">0.31</td>
</tr>
<tr>
<td valign="top" align="left">AoA</td>
<td valign="top" align="center">89.63</td>
<td valign="top" align="center">17.830</td>
<td valign="top" align="center">5.03</td>
<td valign="top" align="center">0.0001</td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">Conceptual familiarity</td>
<td valign="top" align="center">&#x2212;51.50</td>
<td valign="top" align="center">20.85</td>
<td valign="top" align="center">&#x2212;2.47</td>
<td valign="top" align="center">0.014</td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="center" colspan="5"><bold><underline>Name Agreement &#x003E; = 0.50</underline></bold></td>
</tr>
<tr>
<td valign="top" align="left">Visual complexity</td>
<td valign="top" align="center">103.17</td>
<td valign="top" align="center">27.19</td>
<td valign="top" align="center">3.79</td>
<td valign="top" align="center">0.0001</td>
<td valign="top" align="center">0.37</td>
</tr>
<tr>
<td valign="top" align="left">Name agreement</td>
<td valign="top" align="center">&#x2212;294.26</td>
<td valign="top" align="center">120.19</td>
<td valign="top" align="center">&#x2212;2.45</td>
<td valign="top" align="center">0.016</td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">Image agreement</td>
<td valign="top" align="center">&#x2212;89.0</td>
<td valign="top" align="center">43.23</td>
<td valign="top" align="center">&#x2212;2.06</td>
<td valign="top" align="center">0.042</td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">AoA</td>
<td valign="top" align="center">43.741</td>
<td valign="top" align="center">21.24</td>
<td valign="top" align="center">2.060</td>
<td valign="top" align="center">0.042</td>
<td valign="top" align="center"></td>
</tr>
</tbody>
</table>
</table-wrap>
<table-wrap position="float" id="T4">
<label>Table 4</label>
<caption><p>Step-wise regression with ToT as a dependent variable.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<th valign="top" align="left">Variables</th>
<th valign="top" align="center"><italic>B</italic></th>
<th valign="top" align="center"><italic>SE</italic></th>
<th valign="top" align="center"><italic>T</italic></th>
<th valign="top" align="center">Sig.</th>
<th valign="top" align="center"><italic>R</italic><sup>2</sup></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Image agreement</td>
<td valign="top" align="center">&#x2212;0.91</td>
<td valign="top" align="center">0.16</td>
<td valign="top" align="center">&#x2212;5.76</td>
<td valign="top" align="center">0.0001</td>
<td valign="top" align="center">0.31</td>
</tr>
<tr>
<td valign="top" align="left">Name agreement</td>
<td valign="top" align="center">&#x2212;0.98</td>
<td valign="top" align="center">0.31</td>
<td valign="top" align="center">&#x2212;3.11</td>
<td valign="top" align="center">0.002</td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="center" colspan="5"><bold><underline>Name Agreement &#x003E; = 0.50</underline></bold></td>
</tr>
<tr>
<td valign="top" align="left">Image agreement</td>
<td valign="top" align="center">&#x2212;0.70</td>
<td valign="top" align="center">0.13</td>
<td valign="top" align="center">&#x2212;5.55</td>
<td valign="top" align="center">0.0001</td>
<td valign="top" align="center">0.31</td>
</tr>
<tr>
<td valign="top" align="left">Visual complexity</td>
<td valign="top" align="center">0.26</td>
<td valign="top" align="center">0.08</td>
<td valign="top" align="center">3.27</td>
<td valign="top" align="center">0.002</td>
<td valign="top" align="center"></td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
</sec>
<sec><title>Discussion</title>
<p>With the aim of developing a useful tool for professionals in the field of communication disorders and researchers of speech production, this study provides normative data for the 295 most frequent stimuli from the ARASAAC pictographic system. For each stimulus, the modal name, two measures of name agreement (name agreement and H scores), visual complexity and conceptual familiarity scores, image agreement scores, proportion of TOTs, and RTs in production tasks were collected. Reliability and validity of these scales were shown to be adequate.</p>
<p>Importantly, this study provides the modal name obtained from a name production task for each selected pictogram. In general, there is a low level of overlapping between the modal names obtained in this study and the labels provided in the ARASAAC database (36% concurrence). This result is important because it indicates that the names that have traditionally been linked to each picture in the ARASAAC database may not be the most suitable. One possible reason for these discrepancies could be that the ARASAAC names are based on subjective criteria and not on controlled normative studies. From this view, this study is in accordance with the increasing trend in speech therapy, psychology, and related fields toward the integration of the best available research in applied practice (evidence-based practice approach).</p>
<p>Furthermore, results from the current study showed that image agreement, age of acquisition, and conceptual familiarity predicted naming times. Thus, stimuli with higher values of image agreement, conceptual familiarity, and early acquisition were named more quickly. When only stimuli with higher levels of name agreement (higher than 0.50) were selected, visual complexity and name agreement also entered in to the model, indicating that those stimuli were less visually complex, produced higher levels of agreement in their names, and were more rapidly named. Regarding the ToT responses, results indicated that image agreement and name agreement modulated the number of ToTs (more image agreement and more name agreement produced fewer ToTs). When stimuli with higher levels of name agreement were selected (values higher than 0.50), image agreement and visual complexity entered in to the model, indicating that higher values of image agreement and less visual complexity elicited a reduced number of ToTs. These patterns of results in the regression analyses are relevant because they demonstrate that the set of indices collected in the current study are suitable modulators of speech processes. These data are also in accordance with principal models of speech production in that, with differences in the conceptualization of the specific mechanisms, they support the assumption that picture naming involves the retrieval of different types of information: the visual information extracted from the picture, the meaning of the depicted stimulus, and the lexical and phonological information associated with the intended target word in order to initiate the articulatory motor program of the name (<xref ref-type="bibr" rid="B18">Dell, 1986</xref>; <xref ref-type="bibr" rid="B12">Caramazza, 1997</xref>; <xref ref-type="bibr" rid="B35">Levelt et al., 1999</xref>). In this context, the ease of processing in production acts at the level of the structural stage of object recognition for the visual complexity and image agreement dimensions related to the uncertainty of pictures (<xref ref-type="bibr" rid="B52">Vitkovitch and Tyrrell, 1995</xref>; <xref ref-type="bibr" rid="B8">Bonin et al., 2002</xref>; <xref ref-type="bibr" rid="B13">Cheng et al., 2010</xref>). Meanwhile, conceptual familiarity is assumed to take place at the semantic/conceptual level (<xref ref-type="bibr" rid="B42">Perret and Bonin, 2018</xref>). At the subsequent level of lexical access, the name agreement related to the activation of more than one alternative name arises (<xref ref-type="bibr" rid="B52">Vitkovitch and Tyrrell, 1995</xref>; <xref ref-type="bibr" rid="B8">Bonin et al., 2002</xref>; <xref ref-type="bibr" rid="B13">Cheng et al., 2010</xref>) when the correct name needs to be selected from among competing alternatives (<xref ref-type="bibr" rid="B32">Kan and Thompson-Schill, 2004a</xref>,<xref ref-type="bibr" rid="B33">b</xref>; <xref ref-type="bibr" rid="B47">Shao et al., 2014</xref>). During the selection, nouns that are acquired early seem to have a more consolidated connection within the speech production system (<xref ref-type="bibr" rid="B21">Ellis and Lambon Ralph, 2000</xref>; <xref ref-type="bibr" rid="B4">Belke et al., 2005</xref>; <xref ref-type="bibr" rid="B40">Navarrete et al., 2013</xref>).</p>
<p>The current dataset provides valuables indices to be employed in different speech-related domains. Its validity, however, can be limited to the geographical and linguistic context where the norms are being collected. In this line, researchers of linguistic materials have opted to develop specific normative studies in different countries. For example, after the seminal work of Snodgrass and Vanderwart that provided normative data for a set of pictures in an English-speaking population, researchers from different countries developed new normative studies on these stimuli in Spanish (<xref ref-type="bibr" rid="B45">Sanfeliu and Fernandez, 1996</xref>; <xref ref-type="bibr" rid="B15">Cuetos et al., 1999</xref>; <xref ref-type="bibr" rid="B39">Moreno-Mart&#x00ED;nez and Montoro, 2012</xref>), in English (<xref ref-type="bibr" rid="B3">Barry et al., 1997</xref>), in French (<xref ref-type="bibr" rid="B1">Alario and Ferrand, 1999</xref>), in Mandarin Chinese (<xref ref-type="bibr" rid="B36">Liu et al., 2011</xref>) and in Russian (<xref ref-type="bibr" rid="B50">Tsaparina et al., 2011</xref>). Even in the case of Spanish-speaking countries other than Spain, the generalization of the current norms must be made with caution.</p>
</sec>
<sec><title>Conclusion</title>
<p>This dataset is expected to facilitate communication processes for those people who demand visual support in their interaction with the environment, both in the field of disability (autism, cerebral palsy, cognitive deficit, aphasia, dementia, etc.), as well as in the social sphere (relations in hospital settings, retirement homes, or interlingual communication) since communication and language are essential for every human being and a fundamental right recognized by all international organizations (<xref ref-type="bibr" rid="B51">United Nations, 2006</xref>).</p>
</sec>
<sec><title>Data Availability Statement</title>
<p>The raw data supporting the conclusions of this manuscript will be made available by the authors, without undue reservation, to any qualified researcher.</p>
</sec>
<sec><title>Author Contributions</title>
<p>DP conceived the study. DP and AM designed the experiments, drafted the manuscript, and provided critical revisions. AM performed the statistical analysis. All authors approved the final version of the manuscript for submission.</p>
</sec>
<sec><title>Conflict of Interest Statement</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
</body>
<back>
<fn-group>
<fn fn-type="financial-disclosure">
<p><bold>Funding.</bold> This work was done thanks to financial aid provided by the Spanish Ministry of Economy and Competitiveness to AM (PSI2013-46033-P and PSI2017-89324-C2-2-P) and to DP (PCIN-2015-165-C02-01 and PSI2017-89324-P). This work was done thanks to financial aid provided by the Spanish Ministry of Economy and Competitiveness to AM (PSI2013-46033-P and PSI2017-89324-C2-2-P) and to DP (PCIN-2015-165-C02-01 and PSI2017-89324-P) and by the Vice-Rectorate for Social Responsibility, Equality and Inclusion (PROGRAM 45) to DP.</p>
</fn>
</fn-group>
<sec sec-type="supplementary material">
<title>Supplementary Material</title>
<p>The Supplementary Material for this article can be found online at: <ext-link ext-link-type="uri" xlink:href="https://www.frontiersin.org/articles/10.3389/fpsyg.2018.02538/full#supplementary-material">https://www.frontiersin.org/articles/10.3389/fpsyg.2018.02538/full#supplementary-material</ext-link></p>
<supplementary-material xlink:href="Table_1.xlsx" id="SM1" mimetype="application/vnd.openxmlformats-officedocument.spreadsheetml.sheet" xmlns:xlink="http://www.w3.org/1999/xlink">
<label>TABLE S1</label>
<caption><p>Normative data for 295 ARASAAC pictures.</p></caption>
</supplementary-material>
</sec>
<ref-list>
<title>References</title>
<ref id="B1"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Alario</surname> <given-names>F. X.</given-names></name> <name><surname>Ferrand</surname> <given-names>L.</given-names></name></person-group> (<year>1999</year>). <article-title>A set of 400 pictures standardized for French: norms for name agreement, image agreement, familiarity, visual complexity, image variability, and age of acquisition.</article-title> <source><italic>Behav. Res. Methods Instrum. Comput.</italic></source> <volume>31</volume> <fpage>531</fpage>&#x2013;<lpage>552</lpage>. <pub-id pub-id-type="doi">10.3758/BF03200732</pub-id></citation></ref>
<ref id="B2"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Alario</surname> <given-names>F.-X.</given-names></name> <name><surname>Ferrand</surname> <given-names>L.</given-names></name> <name><surname>Laganaro</surname> <given-names>M.</given-names></name> <name><surname>New</surname> <given-names>B.</given-names></name> <name><surname>Frauenfelder</surname> <given-names>U. H.</given-names></name> <name><surname>Segui</surname> <given-names>J.</given-names></name></person-group> (<year>2004</year>). <article-title>Predictors of picture naming speed.</article-title> <source><italic>Behav. Res. Methods</italic></source> <volume>36</volume> <fpage>140</fpage>&#x2013;<lpage>155</lpage>. <pub-id pub-id-type="doi">10.3758/BF03195559</pub-id></citation></ref>
<ref id="B3"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Barry</surname> <given-names>C.</given-names></name> <name><surname>Morrison</surname> <given-names>C. M.</given-names></name> <name><surname>Ellis</surname> <given-names>A. W.</given-names></name></person-group> (<year>1997</year>). <article-title>Naming the snodgrass and vanderwart pictures: effects of age of acquisition, frequency, and name agreement.</article-title> <source><italic>Q. J. Exp. Psychol. A</italic></source> <volume>50</volume> <fpage>560</fpage>&#x2013;<lpage>585</lpage>. <pub-id pub-id-type="doi">10.1080/783663595</pub-id></citation></ref>
<ref id="B4"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Belke</surname> <given-names>E.</given-names></name> <name><surname>Brysbaert</surname> <given-names>M.</given-names></name> <name><surname>Meyer</surname> <given-names>A. S.</given-names></name> <name><surname>Ghyselinck</surname> <given-names>M.</given-names></name></person-group> (<year>2005</year>). <article-title>Age of acquisition effects in picture naming: evidence for a lexical&#x2013;semantic competition hypothesis.</article-title> <source><italic>Cognition</italic></source> <volume>96</volume> <fpage>B45</fpage>&#x2013;<lpage>B54</lpage>. <pub-id pub-id-type="doi">10.1016/j.cognition.2004.11.006</pub-id> <pub-id pub-id-type="pmid">15925568</pub-id></citation></ref>
<ref id="B5"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Beukelman</surname> <given-names>D.</given-names></name> <name><surname>Mirenda</surname> <given-names>P.</given-names></name></person-group> (<year>2013</year>). <source><italic>Augmentative and Alternative communication: Supporting Children and Adults with Complex Communication Needs.</italic></source> <publisher-loc>Baltimore, MA</publisher-loc>: <publisher-name>Paul H. Brookes Publishing Co.</publisher-name></citation></ref>
<ref id="B6"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bliss</surname> <given-names>C. K.</given-names></name></person-group> (<year>1965</year>). <source><italic>Semantography: Blissymbolics.</italic></source> <publisher-loc>Sydney, NSW</publisher-loc>: <publisher-name>Sematography Publications</publisher-name>.</citation></ref>
<ref id="B7"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bonin</surname> <given-names>P.</given-names></name> <name><surname>Barry</surname> <given-names>C.</given-names></name> <name><surname>M&#x00E9;ot</surname> <given-names>A.</given-names></name> <name><surname>Chalard</surname> <given-names>M.</given-names></name></person-group> (<year>2004</year>). <article-title>The influence of age of acquisition in word reading and other tasks: a never ending story?</article-title> <source><italic>J. Mem. Lang.</italic></source> <volume>50</volume> <fpage>456</fpage>&#x2013;<lpage>476</lpage>. <pub-id pub-id-type="doi">10.1016/j.jml.2004.02.001</pub-id></citation></ref>
<ref id="B8"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bonin</surname> <given-names>P.</given-names></name> <name><surname>Chalard</surname> <given-names>M.</given-names></name> <name><surname>M&#x00E9;ot</surname> <given-names>A.</given-names></name> <name><surname>Fayol</surname> <given-names>M.</given-names></name></person-group> (<year>2002</year>). <article-title>The determinants of spoken and written picture naming latencies.</article-title> <source><italic>Br. J. Psychol.</italic></source> <volume>93</volume> <fpage>89</fpage>&#x2013;<lpage>114</lpage>. <pub-id pub-id-type="doi">10.1348/000712602162463</pub-id> <pub-id pub-id-type="pmid">11839103</pub-id></citation></ref>
<ref id="B9"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bonin</surname> <given-names>P.</given-names></name> <name><surname>Peereman</surname> <given-names>R.</given-names></name> <name><surname>Malardier</surname> <given-names>N.</given-names></name> <name><surname>M&#x00E9;ot</surname> <given-names>A.</given-names></name> <name><surname>Chalard</surname> <given-names>M.</given-names></name></person-group> (<year>2003</year>). <article-title>A new set of 299 pictures for psycholinguistic studies: french norms for name agreement, image agreement, conceptual familiarity, visual complexity, image variability, age of acquisition, and naming latencies.</article-title> <source><italic>Behav. Res. Methods Instrum. Comput.</italic></source> <volume>35</volume> <fpage>158</fpage>&#x2013;<lpage>167</lpage>. <pub-id pub-id-type="doi">10.3758/BF03195507</pub-id> <pub-id pub-id-type="pmid">12723790</pub-id></citation></ref>
<ref id="B10"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bonin</surname> <given-names>P.</given-names></name> <name><surname>Perret</surname> <given-names>C.</given-names></name> <name><surname>M&#x00E9;ot</surname> <given-names>A.</given-names></name> <name><surname>Ferrand</surname> <given-names>L.</given-names></name> <name><surname>Mermillod</surname> <given-names>M.</given-names></name></person-group> (<year>2008</year>). <article-title>Psycholinguistic norms and face naming times for photographs of celebrities in French.</article-title> <source><italic>Behav. Res. Methods</italic></source> <volume>40</volume> <fpage>137</fpage>&#x2013;<lpage>146</lpage>. <pub-id pub-id-type="doi">10.3758/BRM.40.1.137</pub-id> <pub-id pub-id-type="pmid">18411536</pub-id></citation></ref>
<ref id="B11"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cabello</surname> <given-names>F.</given-names></name> <name><surname>Bertola</surname> <given-names>E.</given-names></name></person-group> (<year>2015</year>). <article-title>Caracter&#x00ED;sticas formales y transparencia de los s&#x00ED;mbolos pictogr&#x00E1;ficos de ARASAAC.</article-title> <source><italic>Rev. Inv. Logop.</italic></source> <volume>5</volume> <fpage>60</fpage>&#x2013;<lpage>70</lpage>.</citation></ref>
<ref id="B12"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Caramazza</surname> <given-names>A.</given-names></name></person-group> (<year>1997</year>). <article-title>How many levels of processing are there in lexical access?</article-title> <source><italic>Cogn. Neuropsychol.</italic></source> <volume>14</volume> <fpage>177</fpage>&#x2013;<lpage>208</lpage>. <pub-id pub-id-type="doi">10.1080/026432997381664</pub-id></citation></ref>
<ref id="B13"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cheng</surname> <given-names>X.</given-names></name> <name><surname>Schafer</surname> <given-names>G.</given-names></name> <name><surname>Aky&#x00FC;rek</surname> <given-names>E. G.</given-names></name></person-group> (<year>2010</year>). <article-title>Name agreement in picture naming: an ERP study.</article-title> <source><italic>Int. J. Psychophysiol.</italic></source> <volume>76</volume> <fpage>130</fpage>&#x2013;<lpage>141</lpage>. <pub-id pub-id-type="doi">10.1016/j.ijpsycho.2010.03.003</pub-id> <pub-id pub-id-type="pmid">20227446</pub-id></citation></ref>
<ref id="B14"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cuetos</surname> <given-names>F.</given-names></name> <name><surname>Alija</surname> <given-names>M.</given-names></name></person-group> (<year>2003</year>). <article-title>Normative data and naming times for action pictures.</article-title> <source><italic>Behav. Res. Methods Instrum. Comput.</italic></source> <volume>35</volume>:<issue>168</issue>. <pub-id pub-id-type="doi">10.3758/BF03195508</pub-id></citation></ref>
<ref id="B15"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cuetos</surname> <given-names>F.</given-names></name> <name><surname>Ellis</surname> <given-names>A. W.</given-names></name> <name><surname>Alvarez</surname> <given-names>B.</given-names></name></person-group> (<year>1999</year>). <article-title>Naming times for the snodgrass and vanderwart pictures in Spanish.</article-title> <source><italic>Behav. Res. Methods Instrum. Comput.</italic></source> <volume>31</volume> <fpage>650</fpage>&#x2013;<lpage>658</lpage>. <pub-id pub-id-type="doi">10.3758/BF03200741</pub-id></citation></ref>
<ref id="B16"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cycowicz</surname> <given-names>Y.</given-names></name> <name><surname>Friedman</surname> <given-names>D.</given-names></name> <name><surname>Rothstein</surname> <given-names>M.</given-names></name> <name><surname>Snodgrass</surname> <given-names>J.</given-names></name></person-group> (<year>1997</year>). <article-title>Picture naming by young children: norms for name agreement, familiarity, and visual complexity.</article-title> <source><italic>J. Exp. Child Psychol.</italic></source> <volume>65</volume> <fpage>171</fpage>&#x2013;<lpage>237</lpage>. <pub-id pub-id-type="doi">10.1006/jecp.1996.2356</pub-id> <pub-id pub-id-type="pmid">9169209</pub-id></citation></ref>
<ref id="B17"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Davies</surname> <given-names>R.</given-names></name> <name><surname>Barb&#x00F3;n</surname> <given-names>A.</given-names></name> <name><surname>Cuetos</surname> <given-names>F.</given-names></name></person-group> (<year>2013</year>). <article-title>Lexical and semantic age-of-acquisition effects on word naming in Spanish.</article-title> <source><italic>Mem. Cognit.</italic></source> <volume>41</volume> <fpage>297</fpage>&#x2013;<lpage>311</lpage>. <pub-id pub-id-type="doi">10.3758/s13421-012-0263-8</pub-id> <pub-id pub-id-type="pmid">23180310</pub-id></citation></ref>
<ref id="B18"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dell</surname> <given-names>G. S.</given-names></name></person-group> (<year>1986</year>). <article-title>A spreading-activation theory of retrieval in sentence production.</article-title> <source><italic>Psychol. Rev.</italic></source> <volume>93</volume> <fpage>283</fpage>&#x2013;<lpage>321</lpage>. <pub-id pub-id-type="doi">10.1037/0033-295X.93.3.283</pub-id></citation></ref>
<ref id="B19"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>D&#x00ED;ez</surname> <given-names>E.</given-names></name> <name><surname>Fernandez</surname> <given-names>A.</given-names></name> <name><surname>Alonso</surname> <given-names>M. A.</given-names></name></person-group> (<year>2014</year>). <source><italic>NIPE: Normas e &#x00EC;ndices de inter&#x00E8;s en Psicolog&#x00EC;a Experimental.</italic></source> Available at: <ext-link ext-link-type="uri" xlink:href="http://campus.usal.es/gimc/nipe/">http://campus.usal.es/gimc/nipe/</ext-link></citation></ref>
<ref id="B20"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Duchon</surname> <given-names>A.</given-names></name> <name><surname>Perea</surname> <given-names>M.</given-names></name> <name><surname>Sebasti&#x00E0;n-Gall&#x00E8;s</surname> <given-names>N.</given-names></name> <name><surname>Mart&#x00EC;</surname> <given-names>A.</given-names></name> <name><surname>Carreiras</surname> <given-names>M.</given-names></name></person-group> (<year>2013</year>). <article-title>EsPal: one-stop shopping for Spanish word properties.</article-title> <source><italic>Behav. Res. Methods</italic></source> <volume>45</volume> <fpage>1246</fpage>&#x2013;<lpage>1258</lpage>. <pub-id pub-id-type="doi">10.3758/s13428-013-0326-1</pub-id> <pub-id pub-id-type="pmid">23468181</pub-id></citation></ref>
<ref id="B21"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ellis</surname> <given-names>A. W.</given-names></name> <name><surname>Lambon Ralph</surname> <given-names>M. A.</given-names></name></person-group> (<year>2000</year>). <article-title>Age of acquisition effects in adult lexical processing reflect loss of plasticity in maturing systems: insights from connectionist networks.</article-title> <source><italic>J. Exp. Psychol. Learn. Mem. Cogn.</italic></source> <volume>26</volume> <fpage>1103</fpage>&#x2013;<lpage>1123</lpage>. <pub-id pub-id-type="doi">10.1037/0278-7393.26.5.1103</pub-id> <pub-id pub-id-type="pmid">11009247</pub-id></citation></ref>
<ref id="B22"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ellis</surname> <given-names>A. W.</given-names></name> <name><surname>Morrison</surname> <given-names>C. M.</given-names></name></person-group> (<year>1998</year>). <article-title>Real age-of-acquisition effects in lexical retrieval.</article-title> <source><italic>J. Exp. Psychol. Learn. Mem. Cogn.</italic></source> <volume>24</volume> <fpage>515</fpage>&#x2013;<lpage>523</lpage>. <pub-id pub-id-type="doi">10.1037//0278-7393.24.2.515</pub-id> <pub-id pub-id-type="pmid">9530847</pub-id></citation></ref>
<ref id="B23"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fraga</surname> <given-names>I.</given-names></name> <name><surname>Padr&#x00F3;n</surname> <given-names>I.</given-names></name> <name><surname>Perea</surname> <given-names>M.</given-names></name> <name><surname>Comesa&#x00F1;a</surname> <given-names>M.</given-names></name></person-group> (<year>2017</year>). <article-title>I saw this somewhere else: the Spanish Ambiguous Words (SAW) database.</article-title> <source><italic>Lingua</italic></source> <volume>185</volume> <fpage>1</fpage>&#x2013;<lpage>10</lpage>. <pub-id pub-id-type="doi">10.1016/j.lingua.2016.07.002</pub-id></citation></ref>
<ref id="B24"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Glaser</surname> <given-names>W. R.</given-names></name></person-group> (<year>1992</year>). <article-title>Picture naming.</article-title> <source><italic>Cognition</italic></source> <volume>42</volume> <fpage>61</fpage>&#x2013;<lpage>105</lpage>. <pub-id pub-id-type="doi">10.1016/0010-0277(92)90040-O</pub-id></citation></ref>
<ref id="B25"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gollan</surname> <given-names>T. H.</given-names></name> <name><surname>Brown</surname> <given-names>A. S.</given-names></name></person-group> (<year>2006</year>). <article-title>From tip-of-the-tongue (TOT) data to theoretical implications in two steps: when more TOTs means better retrieval.</article-title> <source><italic>J. Exp. Psychol. Gen.</italic></source> <volume>135</volume> <fpage>462</fpage>&#x2013;<lpage>483</lpage>. <pub-id pub-id-type="doi">10.1037/0096-3445.135.3.462</pub-id> <pub-id pub-id-type="pmid">16846276</pub-id></citation></ref>
<ref id="B26"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>G&#x00F3;mez-Veiga</surname> <given-names>I.</given-names></name> <name><surname>Carriedo</surname> <given-names>N.</given-names></name> <name><surname>Ruci&#x00E0;n</surname> <given-names>M.</given-names></name> <name><surname>Vila</surname> <given-names>J. O.</given-names></name></person-group> (<year>2010</year>). <article-title>Estudio normativo de ambig&#x00FC;edad l&#x00E8;xica en castellano, en ni&#x00F1;os y en adultos (Norming study on lexical ambiguity in Spanish, in children and adults).</article-title> <source><italic>Psicologica</italic></source> <volume>31</volume> <fpage>25</fpage>&#x2013;<lpage>47</lpage>.</citation></ref>
<ref id="B27"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Guasch</surname> <given-names>M.</given-names></name> <name><surname>Boada</surname> <given-names>R.</given-names></name> <name><surname>Ferr&#x00E8;</surname> <given-names>P.</given-names></name> <name><surname>S&#x00E0;nchez-Casas</surname> <given-names>R.</given-names></name></person-group> (<year>2013</year>). <article-title>NIM: a web-based Swiss army knife to select stimuli for psycholinguistic studies.</article-title> <source><italic>Behav. Res. Methods</italic></source> <volume>45</volume> <fpage>765</fpage>&#x2013;<lpage>771</lpage>. <pub-id pub-id-type="doi">10.3758/s13428-012-0296-8</pub-id> <pub-id pub-id-type="pmid">23271155</pub-id></citation></ref>
<ref id="B28"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hartje</surname> <given-names>W.</given-names></name> <name><surname>Hannen</surname> <given-names>P.</given-names></name> <name><surname>Willmes</surname> <given-names>K.</given-names></name></person-group> (<year>1986</year>). <article-title>Effects of visual complexity in tachistoscopic recognition of Kanji and Kana symbols by German participants.</article-title> <source><italic>Neuropsychologia</italic></source> <volume>24</volume> <fpage>297</fpage>&#x2013;<lpage>300</lpage>. <pub-id pub-id-type="doi">10.1016/0028-3932(86)90065-5</pub-id></citation></ref>
<ref id="B29"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hehner</surname> <given-names>B.</given-names></name></person-group> (<year>1980</year>). <source><italic>Blissymbolics for Use.</italic></source> <publisher-loc>Toronto, ON</publisher-loc>: <publisher-name>Blissymbolics Communication Institute Pub.</publisher-name></citation></ref>
<ref id="B30"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hirsh</surname> <given-names>K. W.</given-names></name> <name><surname>Funnell</surname> <given-names>E.</given-names></name></person-group> (<year>1995</year>). <article-title>Those old, familiar things: age of acquisition, familiarity, and lexical access in progressive aphasia.</article-title> <source><italic>J. Neurolinguistics</italic></source> <volume>9</volume> <fpage>23</fpage>&#x2013;<lpage>32</lpage>. <pub-id pub-id-type="doi">10.1016/0911-6044(95)00003-8</pub-id></citation></ref>
<ref id="B31"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Johnson</surname> <given-names>R.</given-names></name></person-group> (<year>1981</year>). <source><italic>The Picture Communication System.</italic></source> <publisher-loc>Solana Beach, CA</publisher-loc>: <publisher-name>MayerJohnson Co.</publisher-name></citation></ref>
<ref id="B32"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kan</surname> <given-names>I. P.</given-names></name> <name><surname>Thompson-Schill</surname> <given-names>S. L.</given-names></name></person-group> (<year>2004a</year>). <article-title>Effect of name agreement on prefrontal activity during overt and covert picture naming.</article-title> <source><italic>Cogn. Affect. Behav. Neurosci.</italic></source> <volume>4</volume> <fpage>43</fpage>&#x2013;<lpage>57</lpage>. <pub-id pub-id-type="doi">10.3758/CABN.4.1.43</pub-id> <pub-id pub-id-type="pmid">15259888</pub-id></citation></ref>
<ref id="B33"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kan</surname> <given-names>I. P.</given-names></name> <name><surname>Thompson-Schill</surname> <given-names>S. L.</given-names></name></person-group> (<year>2004b</year>). <article-title>Selection from perceptual and conceptual representations.</article-title> <source><italic>Cogn. Affect. Behav. Neurosci.</italic></source> <volume>4</volume> <fpage>466</fpage>&#x2013;<lpage>482</lpage>. <pub-id pub-id-type="doi">10.3758/CABN.4.4.466</pub-id></citation></ref>
<ref id="B34"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lausen</surname> <given-names>B.</given-names></name> <name><surname>Krolak-Schwerdt</surname> <given-names>S.</given-names></name> <name><surname>B&#x00F6;hmer</surname> <given-names>M.</given-names></name></person-group> (<role>eds</role>) (<year>2005</year>). <source><italic>Data Science, Learning by Latent Structures, and Knowledge Discovery.</italic></source> <publisher-loc>Heidelberg</publisher-loc>: <publisher-name>Springer</publisher-name>.</citation></ref>
<ref id="B35"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Levelt</surname> <given-names>W. J.</given-names></name> <name><surname>Roelofs</surname> <given-names>A.</given-names></name> <name><surname>Meyer</surname> <given-names>A. S.</given-names></name></person-group> (<year>1999</year>). <article-title>A theory of lexical access in speech production.</article-title> <source><italic>Behav. Brain Sci.</italic></source> <volume>22</volume> <fpage>1</fpage>&#x2013;<lpage>38</lpage>. <pub-id pub-id-type="doi">10.1017/S0140525X99001776</pub-id></citation></ref>
<ref id="B36"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Liu</surname> <given-names>Y.</given-names></name> <name><surname>Hao</surname> <given-names>M.</given-names></name> <name><surname>Li</surname> <given-names>P.</given-names></name> <name><surname>Shu</surname> <given-names>H.</given-names></name></person-group> (<year>2011</year>). <article-title>Timed picture naming norms for Mandarin Chinese.</article-title> <source><italic>PLoS One</italic></source> <volume>6</volume>:<issue>e16505</issue>. <pub-id pub-id-type="doi">10.1371/journal.pone.0016505</pub-id> <pub-id pub-id-type="pmid">21298065</pub-id></citation></ref>
<ref id="B37"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Marful</surname> <given-names>A.</given-names></name> <name><surname>D&#x00ED;ez</surname> <given-names>E.</given-names></name> <name><surname>Fernandez</surname> <given-names>A.</given-names></name></person-group> (<year>2015</year>). <article-title>Normative data for the 56 categories of battig &#x0026; montague (1969) in Spanish.</article-title> <source><italic>Behav. Res. Methods</italic></source> <volume>47</volume> <fpage>902</fpage>&#x2013;<lpage>910</lpage>. <pub-id pub-id-type="doi">10.3758/s13428-014-0513-8</pub-id> <pub-id pub-id-type="pmid">25159692</pub-id></citation></ref>
<ref id="B38"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Marful</surname> <given-names>A.</given-names></name> <name><surname>D&#x00EC;ez-&#x00C1;lamo</surname> <given-names>A. M.</given-names></name> <name><surname>Plaza-Navas</surname> <given-names>S.</given-names></name> <name><surname>Fernandez</surname> <given-names>A.</given-names></name></person-group> (<year>2018</year>). <article-title>A normative study for photographs of celebrities in Spain.</article-title> <source><italic>PLoS One</italic></source> <volume>13</volume>:<issue>e0197554</issue>. <pub-id pub-id-type="doi">10.1371/journal.pone.0197554</pub-id> <pub-id pub-id-type="pmid">29768497</pub-id></citation></ref>
<ref id="B39"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Moreno-Mart&#x00ED;nez</surname> <given-names>F. J.</given-names></name> <name><surname>Montoro</surname> <given-names>P. R.</given-names></name></person-group> (<year>2012</year>). <article-title>An ecological alternative to snodgrass and Vanderwart: 360 high quality colour images with norms for seven psycholinguistic variables.</article-title> <source><italic>PLoS One</italic></source> <volume>7</volume>:<issue>e37527</issue>. <pub-id pub-id-type="doi">10.1371/journal.pone.0037527</pub-id> <pub-id pub-id-type="pmid">22662166</pub-id></citation></ref>
<ref id="B40"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Navarrete</surname> <given-names>E.</given-names></name> <name><surname>Scaltritti</surname> <given-names>M.</given-names></name> <name><surname>Mulatti</surname> <given-names>C.</given-names></name> <name><surname>Peressotti</surname> <given-names>F.</given-names></name></person-group> (<year>2013</year>). <article-title>Age-of-acquisition effects in delayed picture-naming tasks.</article-title> <source><italic>Psychon. B. Rev.</italic></source> <volume>20</volume> <fpage>148</fpage>&#x2013;<lpage>153</lpage>. <pub-id pub-id-type="doi">10.3758/s13423-012-0310-2</pub-id> <pub-id pub-id-type="pmid">22893113</pub-id></citation></ref>
<ref id="B41"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Palao</surname> <given-names>S.</given-names></name></person-group> (<year>2013</year>). <source><italic>ARASAAC Symbol Dictionary. Portal aragon&#x00E9;s de la comunicaci&#x00F3;n aumentativa y alternative.</italic></source> Available at: <ext-link ext-link-type="uri" xlink:href="http://www.arasaac.org/">http://www.arasaac.org/</ext-link></citation></ref>
<ref id="B42"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Perret</surname> <given-names>C.</given-names></name> <name><surname>Bonin</surname> <given-names>P.</given-names></name></person-group> (<year>2018</year>). <article-title>Which variables should be controlled for to investigate picture naming in adults? A Bayesian meta-analysis.</article-title> <source><italic>Behav. Res. Methods.</italic></source> <pub-id pub-id-type="doi">10.3758/s13428-018-1100-1</pub-id> <pub-id pub-id-type="pmid">30066263</pub-id></citation></ref>
<ref id="B43"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Romero Corral</surname> <given-names>D.</given-names></name> <name><surname>Marcos Rodrigo</surname> <given-names>J. M.</given-names></name></person-group> (<year>2016</year>). <article-title>&#x201C;Portal Aragon&#x00E9;s de la Comunicaci&#x00F3;n Aumentativa y Alternativa (ARASAAC),&#x201D; in</article-title> <source><italic>Paper Presented at the Workshop Arasaac: Portal Aragon&#x00E9;</italic>s de la Comunicaci&#x00F3;n Aumentativa y Alternativa. Software, Herramientas y Materiales para la Comunicaci&#x00F3;n</source>, <publisher-loc>Otros recursos para CAA</publisher-loc>: <publisher-name>Soyvisual. University of Granada</publisher-name>.</citation></ref>
<ref id="B44"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Romski</surname> <given-names>M.</given-names></name> <name><surname>Sevcik</surname> <given-names>R. A.</given-names></name> <name><surname>Barton-Hulsey</surname> <given-names>A.</given-names></name> <name><surname>Whitmore</surname> <given-names>A. S.</given-names></name></person-group> (<year>2015</year>). <article-title>Early intervention and AAC: what a difference 30 years makes.</article-title> <source><italic>Augment. Altern. Commun.</italic></source> <volume>31</volume> <fpage>181</fpage>&#x2013;<lpage>202</lpage>. <pub-id pub-id-type="doi">10.3109/07434618.2015.1064163</pub-id> <pub-id pub-id-type="pmid">26153901</pub-id></citation></ref>
<ref id="B45"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sanfeliu</surname> <given-names>M. C.</given-names></name> <name><surname>Fernandez</surname> <given-names>A.</given-names></name></person-group> (<year>1996</year>). <article-title>A set of 254 Snodgrass-Vanderwart pictures standardized for Spanish: norms for name agreement, image agreement, familiarity, and visual complexity.</article-title> <source><italic>Behav. Res. Methods Instrum. Comput.</italic></source> <volume>28</volume> <fpage>537</fpage>&#x2013;<lpage>555</lpage>. <pub-id pub-id-type="doi">10.3758/BF03200541</pub-id></citation></ref>
<ref id="B46"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schneider</surname> <given-names>W.</given-names></name> <name><surname>Eschman</surname> <given-names>A.</given-names></name> <name><surname>Zuccolotto</surname> <given-names>A.</given-names></name></person-group> (<year>2012</year>). <source><italic>E-Prime User&#x2019;s Guide.</italic></source> <publisher-loc>Pittsburgh, PA</publisher-loc>: <publisher-name>Psychology Software Tools, Inc.</publisher-name></citation></ref>
<ref id="B47"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shao</surname> <given-names>Z.</given-names></name> <name><surname>Roelofs</surname> <given-names>A.</given-names></name> <name><surname>Acheson</surname> <given-names>D. J.</given-names></name> <name><surname>Meyer</surname> <given-names>A. S.</given-names></name></person-group> (<year>2014</year>). <article-title>Electro- physiological evidence that inhibition supports lexical selection in picture naming.</article-title> <source><italic>Brain Res.</italic></source> <volume>1586</volume> <fpage>130</fpage>&#x2013;<lpage>142</lpage>. <pub-id pub-id-type="doi">10.1016/j.brainres.2014.07.009</pub-id> <pub-id pub-id-type="pmid">25219485</pub-id></citation></ref>
<ref id="B48"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Snodgrass</surname> <given-names>J. G.</given-names></name> <name><surname>Vanderwart</surname> <given-names>M.</given-names></name></person-group> (<year>1980</year>). <article-title>A standardized set of 260 pictures: norms for name agreement, image agreement, familiarity, and visual complexity.</article-title> <source><italic>J. Exp. Psychol. Hum. Learn.</italic></source> <volume>6</volume> <fpage>174</fpage>&#x2013;<lpage>215</lpage>. <pub-id pub-id-type="doi">10.1037/0278-7393.6.2.174</pub-id></citation></ref>
<ref id="B49"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Snodgrass</surname> <given-names>J. G.</given-names></name> <name><surname>Yuditsky</surname> <given-names>T.</given-names></name></person-group> (<year>1996</year>). <article-title>Naming times for the Snodgrass and vanderwart pictures.</article-title> <source><italic>Behav. Res. Methods</italic></source> <volume>28</volume> <fpage>516</fpage>&#x2013;<lpage>536</lpage>. <pub-id pub-id-type="doi">10.3758/BF03200540</pub-id></citation></ref>
<ref id="B50"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tsaparina</surname> <given-names>D.</given-names></name> <name><surname>Bonin</surname> <given-names>P.</given-names></name> <name><surname>M&#x00E9;ot</surname> <given-names>A.</given-names></name></person-group> (<year>2011</year>). <article-title>Russian norms for name agreement, image agreement for the colorized version of the Snodgrass and Vanderwart pictures and age of acquisition, conceptual familiarity, and imageability scores for modal object names.</article-title> <source><italic>Behav. Res. Methods</italic></source> <volume>43</volume> <fpage>1085</fpage>&#x2013;<lpage>1099</lpage>. <pub-id pub-id-type="doi">10.3758/s13428-011-0121-9</pub-id> <pub-id pub-id-type="pmid">21717267</pub-id></citation></ref>
<ref id="B51"><citation citation-type="journal"><collab>United Nations</collab> (<year>2006</year>). <source><italic>Convention on the Rights of Persons with Disabilities.</italic></source> Available at: <ext-link ext-link-type="uri" xlink:href="https://www.un.org/development/desa/disabilities/convention-on-the-rights-of-persons-with-disabilities.html">https://www.un.org/development/desa/disabilities/convention-on-the-rights-of-persons-with-disabilities.html</ext-link></citation></ref>
<ref id="B52"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Vitkovitch</surname> <given-names>M.</given-names></name> <name><surname>Tyrrell</surname> <given-names>L.</given-names></name></person-group> (<year>1995</year>). <article-title>Sources of disagreement in object naming.</article-title> <source><italic>Q. J. Exp. Psychol.</italic></source> <volume>48A</volume>, <fpage>822</fpage>&#x2013;<lpage>848</lpage>. <pub-id pub-id-type="doi">10.1080/14640749508401419</pub-id></citation></ref>
<ref id="B53"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yoon</surname> <given-names>C.</given-names></name> <name><surname>Feinberg</surname> <given-names>F.</given-names></name> <name><surname>Hu</surname> <given-names>P.</given-names></name> <name><surname>Gutchess</surname> <given-names>A. H.</given-names></name> <name><surname>Hedden</surname> <given-names>T.</given-names></name> <name><surname>Chen</surname> <given-names>H.-Y. M.</given-names></name><etal/></person-group> (<year>2004</year>). <article-title>Category norms as a function of culture and age: comparisons of item responses to 105 categories by American and Chinese adults.</article-title> <source><italic>Psychol. Aging</italic></source> <volume>19</volume> <fpage>379</fpage>&#x2013;<lpage>393</lpage>. <pub-id pub-id-type="doi">10.1037/0882-7974.19.3.379</pub-id> <pub-id pub-id-type="pmid">15382989</pub-id></citation></ref>
</ref-list>
<fn-group>
<fn id="fn01"><label>1</label><p><ext-link ext-link-type="uri" xlink:href="http://www.arasaac.org/pictogramas_color.php">http://www.arasaac.org/pictogramas_color.php</ext-link></p></fn>
<fn id="fn02"><label>2</label><p>Notice that ToTs were not collected employing the standard procedure. In the standard ToT collection procedure, when a participant reports being in a ToT state, the target word appears in a recognition test to distinguish between positive and false ToTs (e.g., <xref ref-type="bibr" rid="B25">Gollan and Brown, 2006</xref>). However, in the current normative study, we did not have any <italic>a priori</italic> correct item to be used as a target in the recognition phase, since all possible responses were potentially correct. For example, if participants are presented by the picture called &#x201C;human&#x201D; (humano.png) in the ARASAAC database, different correct responses can be generated (body, man, human being, silhouette, etc). If the label &#x201C;human&#x201D; being is selected as a target, responses from participants that suffered ToTs when tried to recover other correct labels (body, silhouette, etc) would not be considered as positive ToTs, decreasing artificially the total number of ToTs experiences in the study. This limitation is important because there is a wide mismatch (64%) between the label assigned in the ARASAAC database and the label that we obtained after the written name agreement phase. Thus, we did not include this recognition phase in the ToT task procedure (see <xref ref-type="bibr" rid="B38">Marful et al., 2018</xref>, for a similar procedure), and the raw number of ToTs were included in the analysis. These data, in consequence, must be interpreted with caution (see <xref ref-type="bibr" rid="B25">Gollan and Brown, 2006</xref>, for a description of the possible limitations of this approach).</p></fn>
<fn id="fn03"><label>3</label><p>Name agreement was included in the analysis following the procedure of <xref ref-type="bibr" rid="B10">Bonin et al. (2008)</xref>. Following the suggestion of an reviewer, we also included H (instead of name agreement) in the regression analysis. Results resembled the previously observed pattern with name agreement, and the same variables were included in the best models (with the exception that, when the previous model entered name agreement, H statistics were added) when testing RTs (image agreement, <italic>B</italic> = &#x2212;149.13, <italic>SD</italic> = 30.17, <italic>t</italic>(189) = &#x2212;4.94, <italic>p</italic> = 0.0001; AoA, <italic>B</italic> = 89.63, <italic>SD</italic> = 17.8, <italic>t</italic>(189) = 5.03, <italic>p</italic> = 0.0001, and conceptual familiarity, <italic>B</italic> = &#x2212;51.50, <italic>SD</italic> = 20.85, <italic>t</italic>(189) = &#x2212;2.47, <italic>p</italic> = 0.014, R<sup>2</sup> = 0.31) and ToTs (image agreement, <italic>B</italic> = &#x2212;0.97, <italic>SD</italic> = 0.15, <italic>t</italic>(192) = &#x2212;6.35, <italic>p</italic> = 0.0001; H statistics, <italic>B</italic> = &#x2212;0.22, <italic>SD</italic> = 0.08, <italic>t</italic>(192) = 2.65, <italic>p</italic> = 0.009, R<sup>2</sup> = 0.30).</p></fn>
</fn-group>
</back>
</article>