<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" article-type="research-article" dtd-version="2.3">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Psychol.</journal-id>
<journal-title>Frontiers in Psychology</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Psychol.</abbrev-journal-title>
<issn pub-type="epub">1664-1078</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fpsyg.2022.869055</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Psychology</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Vocabulary Mobile Learning Application in Blended English Language Learning</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name>
<surname>Polakova</surname>
<given-names>Petra</given-names>
</name>
<xref rid="c001" ref-type="corresp"><sup>&#x002A;</sup></xref>
<uri xlink:href="https://loop.frontiersin.org/people/1663929/overview"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Klimova</surname>
<given-names>Blanka</given-names>
</name>
<uri xlink:href="https://loop.frontiersin.org/people/338430/overview"/>
</contrib>
</contrib-group>
<aff><institution>Department of Applied Linguistics, Faculty of Informatics and Management, University of Hradec Kr&#x00E1;lov&#x00E9;</institution>, <addr-line>Hradec Kr&#x00E1;lov&#x00E9;</addr-line>, <country>Czechia</country></aff>
<author-notes>
<fn id="fn0001" fn-type="edited-by"><p>Edited by: Xuesong Gao, University of New South Wales, Australia</p></fn>
<fn id="fn0002" fn-type="edited-by"><p>Reviewed by: Lucas Kohnke, The Education University of Hong Kong, Hong Kong SAR, China;Jalil Fathi, University of Kurdistan, Iran</p></fn>
<corresp id="c001">&#x002A;Correspondence: Petra Polakova, <email>petra.polakova.3@uhk.cz</email></corresp>
<fn id="fn0003" fn-type="other"><p>This article was submitted to Language Sciences, a section of the journal Frontiers in Psychology</p></fn>
</author-notes>
<pub-date pub-type="epub">
<day>03</day>
<month>05</month>
<year>2022</year>
</pub-date>
<pub-date pub-type="collection">
<year>2022</year>
</pub-date>
<volume>13</volume>
<elocation-id>869055</elocation-id>
<history>
<date date-type="received">
<day>03</day>
<month>02</month>
<year>2022</year>
</date>
<date date-type="accepted">
<day>21</day>
<month>03</month>
<year>2022</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x00A9; 2022 Polakova and Klimova.</copyright-statement>
<copyright-year>2022</copyright-year>
<copyright-holder>Polakova and Klimova</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p>
</license>
</permissions>
<abstract>
<p>Mobile devices and applications, which have become an integral part of our lives, are gradually used for different purposes, including learning languages in EFL classrooms. Since vocabulary plays an important role in the process of foreign language learning, the aim of this study was to explore the use of the vocabulary mobile learning application and its usefulness in blended English learning. Quantitative and qualitative approach to research was used, since the integration of both approaches created the possibility to solve complex research problem. The case study was based on the use of the developed mobile application called <italic>Angli&#x010D;tina Today</italic> the content of which corresponded to the language needs of the target group of students. The quantitative approach used a method of quasi-experiment aiming to achieve the pre-tests and post-test results of the students from the experimental and control groups. The results showed that the students facing blended learning, including mobile application in the process of language learning, achieved better results than the students exposed to the traditional, face-to-face education. In addition, the results revealed students&#x2019; overall satisfaction with the application. The main reasons for their satisfaction were improved vocabulary knowledge, ease of use, and enhanced motivation. Based on these findings from the current study, it can be argued that the vocabulary mobile learning application proved to be useful in the process of blended English language learning.</p>
</abstract>
<kwd-group>
<kwd>mobile applications</kwd>
<kwd>apps</kwd>
<kwd>English language</kwd>
<kwd>vocabulary learning</kwd>
<kwd>blended learning</kwd>
</kwd-group>
<counts>
<fig-count count="5"/>
<table-count count="2"/>
<equation-count count="0"/>
<ref-count count="43"/>
<page-count count="10"/>
<word-count count="6798"/>
</counts>
</article-meta>
</front>
<body>
<sec id="sec1" sec-type="intro">
<title>Introduction</title>
<p>In recent years, blended learning (BL) has become popular in educational environment. As it combines traditional and online learning modes, the promise of BL rests on the strengths of both learning approaches. Having this in consideration, the most important aim of the BL design is to find an effective combination of different learning methods which can motivate students to participate inside and outside of the classroom environment (<xref ref-type="bibr" rid="ref33">Neumeier, 2005</xref>; <xref ref-type="bibr" rid="ref39">Senffner and Kepler, 2015</xref>). <xref ref-type="bibr" rid="ref39">Senffner and Kepler (2015)</xref> pointed out that BL is flexible, scalable, and meaningful way of learning since its online component allows students to learn anytime and anywhere without being limited to groups or partners. Regarding this, the mobile technology appears to be an appropriate approach to education since smartphones and other portable Wi-Fi gadgets are related to both traditional and innovative ways of learning and are well aligned with strategic educational goals (<xref ref-type="bibr" rid="ref26">Kukulska-Hulme, 2009</xref>). <xref ref-type="bibr" rid="ref22">Kl&#x00ED;mov&#x00E1; (2017)</xref> argued that characteristics such as portability, individuality, unobtrusiveness, availability, adaptability, persistence, usefulness, and usability make mobile devices an ideal language-learning tool. Moreover, the ownership of smartphones among students has grown fast which led to a great popularity of the mobile technology in education, including English as Foreign Language (EFL) learning. Mobile devices have been adapted in the traditional classroom environment and are increasingly used by English language learners (<xref ref-type="bibr" rid="ref31">Nasab and Taki, 2016</xref>).</p>
<p>Since vocabulary acquisition is considered to be an essential part of language learning, vocabulary mobile learning applications (apps) have become a popular form of mobile-assisted language learning (MALL) (<xref ref-type="bibr" rid="ref04">Kl&#x00ED;mov&#x00E1;, 2019</xref>). Research has shown that a mobile application designed and based on students&#x2019; needs and continuously facilitated by a teacher is effective in the enhancement of students&#x2019; performance and contributes to positive learning outcomes (<xref ref-type="bibr" rid="ref06">Mahdi, 2017</xref>; <xref ref-type="bibr" rid="ref001">Rezaei et al., 2013</xref>; <xref ref-type="bibr" rid="ref04">Kl&#x00ED;mov&#x00E1;, 2019</xref>). Despite an increasing number of mobile learning applications offering a powerful learning environment, it is certain that the traditional methods of learning foreign languages are still useful. However, they need to be updated and combined with new trends in education (<xref ref-type="bibr" rid="ref30">Mikuleck&#x00FD;, 2019</xref>). Before the onset of coronavirus, in Slovakia, teaching and learning had been mainly based on the traditional face-to-face learning approach. The technology-based learning tools were implemented only in the case when teachers were willing to do so. After the spread of coronavirus, the traditional learning was disrupted and sudden lockdown forced teachers and students to adapt their teaching and learning. New circumstances made educational institution recognize the importance of technology-based learning tools since they appear to be effective tools for ensuring students&#x2019; education. This is especially true for mobile devices. Considering the importance of mobile technology, the present study investigated a mobile learning application called <italic>Angli&#x010D;tina Today</italic> [English Today] and its usefulness in the process of vocabulary acquisition in the EFL setting of Slovakia. The following research questions guided this research:</p>
<list list-type="order">
<list-item>
<p>To what extent is the use of a mobile application useful for second language vocabulary acquisition?</p>
</list-item>
<list-item>
<p>What are the perceptions of EFL students of the vocabulary mobile learning application?</p>
</list-item>
<list-item>
<p>Has the use of the mobile application helped students to extend their vocabulary knowledge?</p>
</list-item>
</list>
</sec>
<sec id="sec2">
<title>Literature Review</title>
<p>It is commonly thought that vocabulary lies in the center of language learning since it is impossible to convey information without having knowledge of vocabulary (<xref ref-type="bibr" rid="ref44">Wilkins, 1972</xref>; <xref ref-type="bibr" rid="ref32">Nation, 2001</xref>; <xref ref-type="bibr" rid="ref46">Zhang, 2011</xref>; <xref ref-type="bibr" rid="ref2">Alquahtani, 2015</xref>; <xref ref-type="bibr" rid="ref002">G&#x00FC;rkan, 2018</xref>). In order to increase vocabulary size, both incidental and instructional vocabulary acquisition are required. Incidental learning has been portrayed as implicit since knowledge is acquired independently of conscious attempts to learn. In other words, incidental learning is taken as it is learning without intent to learn (<xref ref-type="bibr" rid="ref32">Nation, 2001</xref>; <xref ref-type="bibr" rid="ref14">Eraut, 2004</xref>). According to <xref ref-type="bibr" rid="ref38">Schmitt (2010)</xref>, only ten encounters with vocabulary can lead to its sizeable gain since the repetition affects incidental vocabulary learning. According to his findings, learners who encounter an unknown word more times in informative contexts are able to demonstrate significantly larger gains in vocabulary knowledge than learners who have fewer encounters with a new word. This is in line with <xref ref-type="bibr" rid="ref40">Soleimani et al. (2022)</xref> whose study revealed that repeated exposure to vocabulary leads to significant EFL vocabulary gains. Despite of this, there is an unknown boundary between word which has been recognized and the word which has been fully understood and learnt in the process of incidental vocabulary learning. Therefore, there is a need of some systematic approach, to ensure vocabulary acquisition which can be reached by intentional learning (<xref ref-type="bibr" rid="ref8">Bj&#x00F6;rgvinsson, 2012</xref>). It is in accordance with <xref ref-type="bibr" rid="ref47">Zhang and Teng (2012)</xref> whose study pronounced a significant role of intentional learning. Students need to get input in forms of explanation and clear instructions and they need to practice the language they have learnt which could possibly lead to a successful output (<xref ref-type="bibr" rid="ref7">Birkner, 2016</xref>). The role of input, information processing, and output has been gradually acknowledged in second language learning. <xref ref-type="bibr" rid="ref07">Zhang (2009)</xref> believed that these are essential elements in foreign language acquisition, including vocabulary acquisition. Different phases of vocabulary learning can take place in different environments such as traditional school learning environment or technology-based learning environment. Combination of educational technology with traditional methods can lead to effective vocabulary acquisition and thus to achievement of balance in the learning process (<xref ref-type="bibr" rid="ref06">Mahdi, 2017</xref>).</p>
<p><xref ref-type="bibr" rid="ref36">Pol&#x00E1;kov&#x00E1; (2019)</xref> recommended the combination of online interaction with traditional classroom methods. She assumed that blended learning can make learning process more interesting and motivational. Moreover, the previous studies reported positive attitudes of the students toward the use of the mobile application in learning vocabulary which is in accordance with the findings of the study conducted by <xref ref-type="bibr" rid="ref05">Lu (2008)</xref> who found out that the positive attitudes toward learning vocabulary <italic>via</italic> mobile phone might be influenced by its characteristics such as portability, immediacy, novelty, and legibility. With regard to the previous statement, <xref ref-type="bibr" rid="ref37">Prensky (2005)</xref> claimed that when conducting the research regularly delivered information <italic>via</italic> mobile phone was manageable while the traditional manner of learning failed to arouse students&#x2019; interest in study. In other words, using mobile devices as learning tools leads to enhancement of learners&#x2019; motivation. The learning materials delivered by mobile devices are more appealing to students, which is not the case with paper-based learning materials.  (<xref ref-type="bibr" rid="ref002">G&#x00FC;rkan 2018</xref>), Butarbutar (2020), and <xref ref-type="bibr" rid="ref25">Kohnke (2020)</xref> also emphasized that using mobile apps increases students&#x2019; motivation since it is more enjoyable in comparison with the traditional methods of learning. The motivation level of the participants seemed to be an important aspect of the study conducted by <xref ref-type="bibr" rid="ref02">Ekinci (2017)</xref> since, according to him, most of the participants consider BL as motivating and entertaining because it is considered a new method of learning. This is in line with <xref ref-type="bibr" rid="ref42">Viberg and Gr&#x00F6;nlund (2013)</xref> who found out that the perceptions of the mobile application users are extremely positive and their motivational level is high toward mobile learning.</p>
<p>Another benefit of using the mobile apps in the process of vocabulary acquisition is the corrective and immediate feedback. This found concordance with <xref ref-type="bibr" rid="ref28">Liu (2008)</xref>, <xref ref-type="bibr" rid="ref04">Kl&#x00ED;mov&#x00E1; (2019)</xref>, and <xref ref-type="bibr" rid="ref24">Kl&#x00ED;mov&#x00E1; and Pol&#x00E1;kov&#x00E1; (2020)</xref>. The research participants of their studies claimed that feedback helps them to learn new vocabulary items and understand their meaning which helps them to improve their language skills. The other factors affecting the learning process are the ease of use and the ubiquitous character of mobile phones. They are portable devices and can be operated anywhere and anytime with no difficulties. These factors have a stimulating effect on the students and their willingness to continue using the mobile app. These findings were supported by different studies (<xref ref-type="bibr" rid="ref15">Gafni, 2008</xref>; <xref ref-type="bibr" rid="ref02">Ekinci, 2017</xref>; <xref ref-type="bibr" rid="ref16">Gafni et al., 2017</xref>; <xref ref-type="bibr" rid="ref24">Kl&#x00ED;mov&#x00E1; and Pol&#x00E1;kov&#x00E1;, 2020</xref>).</p>
<p>However, the aim of the current study is to discover the impact of the vocabulary mobile learning application on students&#x2019; range of vocabulary and to understand the students&#x2019; views on the usefulness of the vocabulary mobile learning application in the process of language learning. To the best knowledge of the researchers, no study to date has investigated the overall perception of the students of the mobile applications as learning tools in EFL context in Slovakia. In order to shed more light on this subject, the authors of this study found it an opportunity to conduct research on vocabulary acquisition through the use of BL, including mobile technology, in order to discover the impact of the vocabulary mobile learning application on students&#x2019; range of vocabulary, to define the usefulness of the application, and to understand students&#x2019; views on the usefulness of the mobile technology in the process of language acquisition.</p>
</sec>
<sec id="sec3" sec-type="materials|methods">
<title>Materials and Methods</title>
<sec id="sec4">
<title>Participants</title>
<p>A total number of 36 Slovak EFL students took part in this case study. The research participants were students with intermediate level of English of two different classes in the Secondary Vocational School of Gastronomy and Tourism, Nitra, Slovakia. The students were randomly assigned to an experimental group (<italic>N</italic>&#x2009;=&#x2009;17) and a control group (<italic>N</italic>&#x2009;=&#x2009;19). All the participants were students aged between 17 and 18&#x2009;years. They had been learning English for 12&#x2009;years on average. The English proficiency of the participants was measured by pre-test whose results indicated that there was no statistically significant difference between these two groups.</p>
</sec>
<sec id="sec5">
<title>Research Instrument</title>
<p>The mobile application <italic>Angli&#x010D;tina Today</italic>, used as the research instrument, has two separate parts. The first application part is designed as a web interface for the teacher and it is responsible for storing information, authenticating users, efficiently collecting large data, processing, distributing messages, and responding to events. Each teacher can manage several lessons, register their students, distribute news or alerts through notifications, and respond to their comments. Using these options, the teacher can make contact with students and draw attention to the upcoming events. The key element of the web interface is the visualization of the results of all students. Based on the visualization, it is possible to evaluate each student separately, to compare the results between several study courses, or to modify the study plan (<xref ref-type="bibr" rid="ref6">Berger et al., 2019</xref>). <xref rid="fig1" ref-type="fig">Figure 1</xref> portrays the web part of the app designed for teachers.</p>
<fig position="float" id="fig1">
<label>Figure 1</label>
<caption><p>The web part of the application designed for the teachers.</p></caption>
<graphic xlink:href="fpsyg-13-869055-g001.tif"/>
</fig>
<p>The second application part is presented with a mobile application for students. Through a mobile application, the students are enrolled into a specific course to study and test available vocabulary and phrases. For each phrase or vocabulary, students can get a translation, while using TextToSpeech technology, as well as pronunciation. The application also enables immediate communication with the teacher. At the same time, the application collects all user data and distributes it to the server part to be evaluated by teacher. The students are advised by means of notifications, e.g., to study a certain lesson (Berger et al., <italic>ibid.</italic>). An overview of the students&#x2019; mobile app is shown in <xref rid="fig2" ref-type="fig">Figure 2</xref>.</p>
<fig position="float" id="fig2">
<label>Figure 2</label>
<caption><p>An overview of the students&#x2019; application.</p></caption>
<graphic xlink:href="fpsyg-13-869055-g002.tif"/>
</fig>
</sec>
<sec id="sec6">
<title>Procedure</title>
<p>This case study was conducted in the winter semester of 2021. The intervention, which lasted 10&#x2009;weeks, was carried out to investigate the usefulness of the mobile application which was defined by an improved language proficiency and general overall satisfaction of the users with the application. During the first session, both experimental and control groups were given a pre-test in order to prove the same level of language proficiency. Consequently, students from the experimental group were facing BL approach. Firstly, they were introduced to new vocabulary in the traditional classroom environment; secondly, mobile application intervention was used to process the information; and thirdly, new vocabulary gained was used in context. It was done through different activities such as role-plays, discussions, or debates on the corresponding topics, in the traditional school environment. Meanwhile, students from the control group were facing traditional approach to learning. At the end of the mobile application treatment, the post-test was given to the participants of both groups. Moreover, students from the experimental group were required to answer minute papers&#x2019; questions after completing each online lesson, to fill the questionnaire and participate in the virtual interview.</p>
</sec>
<sec id="sec7">
<title>Data Collection and Analysis</title>
<p>Based on the concept of <xref ref-type="bibr" rid="ref45">Yin&#x2019;s (2009)</xref> case study, different quantitative and qualitative methods were used in order to collect and analyze data. Aiming to compare the proficiency level of the research participants before and after the mobile application intervention, standardized multiple pre-test and post-test were used in the quasi-experimental phase of the study. The test results were calculated using IBM SPSS Statistics 26 software. After the vocabulary mobile learning application treatment, the questionnaire survey was conducted as a complementary method to quasi-experiment. The results obtained from the quantitative data collection were analyzed by descriptive statistics.</p>
<p>The qualitative data were collected to understand the students&#x2019; perceptions of the mobile vocabulary learning application. Students were provided minute papers while using the mobile application. Despite the fact that minute papers represent a very commonly used classroom assessment technique, in the current study, it was used as the method of qualitative data collection. Moreover, virtual focus group was organized after the mobile application treatment. The ZOOM platform was used in the present study to interview the research participant. The results gained from the qualitative methods were analyzed by categorization and coding. For better understanding, the research design is provided in <xref rid="fig3" ref-type="fig">Figure 3</xref>.</p>
<fig position="float" id="fig3">
<label>Figure 3</label>
<caption><p>Research design.</p></caption>
<graphic xlink:href="fpsyg-13-869055-g003.tif"/>
</fig>
</sec>
</sec>
<sec id="sec8" sec-type="results">
<title>Results</title>
<p>The aim of this study was to obtain information on the usefulness of the mobile application. On the basis of the research analyses, it may be stated that the results obtained from the quasi-experiment, questionnaire, minute papers, and virtual focus group have been in agreement. There were many results to comment on, but those which could be mutually compared were specifically m-learners&#x2019; performance, m-learners&#x2019; satisfaction, m-learners&#x2019; motivation, content quality, and ease of mobile application use. The comparison and the interpretation of the research results are provided below.</p>
<sec id="sec9">
<title>Quantitative Approach to the Research</title>
<p>The group N consisting of 36 students was divided into two independent groups. The experimental group, the size of which was <italic>n</italic><sub>1</sub>&#x2009;=&#x2009;17, used the vocabulary mobile learning application in the process of language learning. The control group, whose size was <italic>n</italic><sub>2</sub>&#x2009;=&#x2009;19, did not use the mobile application and was taught by the use of the traditional methods. Students&#x2019; results were measured by the pre-test and post-test and their values were recorded. The results were calculated using IBM SPSS Statistics 26 software. A significance level of 5% was considered when performing the tests.</p>
<p>In order to assess whether the students&#x2019; knowledge of the subject, specifically English language, did not differ in the groups at the beginning of the study, the pre-test was revealed. The results divided according to both groups are shown in <xref rid="tab1" ref-type="table">Table 1</xref> in which the success of students is given as percentages and <xref rid="fig4" ref-type="fig">Figure 4</xref>.</p>
<table-wrap position="float" id="tab1">
<label>Table 1</label>
<caption><p>Descriptive statistics of the experimental (E) and control (C) groups in the pre-test.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left" valign="top">Group</th>
<th align="center" valign="top">Mean</th>
<th align="center" valign="top">Std. deviation</th>
<th align="center" valign="top">Median</th>
<th align="center" valign="top">Minimum</th>
<th align="center" valign="top">Maximum</th>
</tr>
</thead>
<tbody>
<tr>
<td align="char" valign="top" char=".">E (n<sub>1</sub> = 17)</td>
<td align="char" valign="top" char=".">38.18%</td>
<td align="char" valign="top" char=".">16.88%</td>
<td align="char" valign="top" char=".">33.0%</td>
<td align="char" valign="top" char=".">18.00%</td>
<td align="char" valign="top" char=".">70.00%</td>
</tr>
<tr>
<td align="char" valign="top" char=".">C (n<sub>2</sub> = 19)</td>
<td align="char" valign="top" char=".">39.68%</td>
<td align="char" valign="top" char=".">16.83%</td>
<td align="char" valign="top" char=".">39.0%</td>
<td align="char" valign="top" char=".">18.00%</td>
<td align="char" valign="top" char=".">73.00%</td>
</tr>
</tbody>
</table>
</table-wrap>
<fig position="float" id="fig4">
<label>Figure 4</label>
<caption><p>Box diagram of pre-test results for the experimental (E) and control (C) groups.</p></caption>
<graphic xlink:href="fpsyg-13-869055-g004.tif"/>
</fig>
<p>The Shapiro&#x2013;Wilk test did not reject the hypothesis that both the selection in the E group (value of <italic>p</italic> 0.061) and the selection in the C group (value of <italic>p</italic> 0.271) came from a normal division of the students. The variances in both groups can be considered identical based on Levene&#x2019;s test (<italic>F</italic>&#x2009;=&#x2009;0.024, value of <italic>p</italic> 0.877). To compare the mean values of the pre-test results, a <italic>t</italic>-test could be used for two independent samples with the same variances (<italic>t</italic>&#x2009;=&#x2009;&#x2212;0.268, value of p 0.790), according to which the hypothesis of equality of mean values was not rejected. It can be assumed that at the beginning of the study, i.e., at the time when the pre-test was given, the average results of students in both groups did not significantly differ. Furthermore, the following research hypothesis was stated as:</p>
<disp-quote>
<p><italic>H</italic>: The students using the vocabulary mobile learning application achieve significantly higher learning outcomes that the students not using the application.</p>
</disp-quote>
<p>The box diagram of the post-test results of both groups is shown in <xref rid="fig5" ref-type="fig">Figure 5</xref>. Based on this, it can be concluded that the students from the research group (E) achieved higher results than the students from the control group (C), as expected. However, we concluded this observation by calculation. Descriptive statistics of the post-test results are provided in <xref rid="tab2" ref-type="table">Table 2</xref>.</p>
<fig position="float" id="fig5">
<label>Figure 5</label>
<caption><p>Box diagram of post-test results for the experimental (E) and control (C) groups, 10,000%.</p></caption>
<graphic xlink:href="fpsyg-13-869055-g005.tif"/>
</fig>
<table-wrap position="float" id="tab2">
<label>Table 2</label>
<caption><p>Descriptive statistics of the experimental (E) and control (C) groups in the post-test.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left" valign="top">Group</th>
<th align="center" valign="top">Mean</th>
<th align="center" valign="top">Std. deviation</th>
<th align="center" valign="top">Median</th>
<th align="center" valign="top">Minimum</th>
<th align="center" valign="top">Maximum</th>
</tr>
</thead>
<tbody>
<tr>
<td align="char" valign="top" char=".">E (n<sub>1</sub> = 17)</td>
<td align="char" valign="top" char=".">71.47%</td>
<td align="char" valign="top" char=".">16.45%</td>
<td align="char" valign="top" char=".">72.0%</td>
<td align="char" valign="top" char=".">43.00%</td>
<td align="char" valign="top" char=".">98.00%</td>
</tr>
<tr>
<td align="char" valign="top" char=".">C (n<sub>2</sub> = 19)</td>
<td align="char" valign="top" char=".">52.26%</td>
<td align="char" valign="top" char=".">17.33%</td>
<td align="char" valign="top" char=".">49.0%</td>
<td align="char" valign="top" char=".">29.00%</td>
<td align="char" valign="top" char=".">81.00%</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>The Shapiro&#x2013;Wilk test did not reject the hypothesis that both the selection in the experimental group (value of <italic>p</italic> 0.598) and the selection in the control group (value of <italic>p</italic> 0.110) came from a normal division of the students. The variances in both groups can be considered identical based on Levene&#x2019;s test (<italic>F</italic>&#x2009;=&#x2009;0.001, value of <italic>p</italic> 0.976). To compare the mean values of the post-test results, a <italic>t</italic>-test could be used for two independent samples with the same variances (<italic>t</italic>&#x2009;=&#x2009;3,400, value of <italic>p</italic> 0,002), according to which the hypothesis of equality of mean values was rejected. Based on this test, it can be stated that at the level of significance of 5%, there is a statistically significant difference between the results of the post-test for the experimental and control groups. After comparison of the found estimates of the mean values of the classification in both groups, hypothesis H can be accepted.</p>
<p>Furthermore, the following consideration assessed whether there was a statistically significant improvement of individuals in the experimental group. Students&#x2019; results in the pre-test and post-test (<italic>t</italic>&#x2009;=&#x2009;13.949, value of <italic>p</italic>&#x2009;&#x003C;&#x2009;0.001) were compared by using a paired t-test. Based on the results of this test, it can be assumed, at the level of significance of 5%, that there is a significant difference between the results of individual students in the pre-test and post-test. As the results obtained in the post-test are higher (see the line E in the <xref rid="tab1" ref-type="table">Tables 1, 2</xref>), it can be stated that the use of a mobile application leads to a significant improvement in the learning of languages.</p>
<p>For a more comprehensive assessment, the ANOVA can be performed with repeated measurements using the time/test factor, whose values are pre-test and post-test, and the group factor, whose values are experimental and control groups, as two independent factors (<xref ref-type="bibr" rid="ref19">Hendl, 2005</xref>). Thanks to the method of measurement, where the measurement was repeated on the selected research sample/students, the time/test factor can be considered to be a factor with a within-subject effect, and a group factor that divides the population can be considered to be a factor expressing an intergroup effect (between-subject effect). The Mauchly test was used to verify sphericity. ANOVA for repeated measures confirmed the effect of time/test (<italic>F</italic>&#x2009;=&#x2009;(1.34)&#x2009;=&#x2009;253.515; value of <italic>p</italic>&#x2009;&#x003C;&#x2009;0.001 and correlation ratio 0.882), thus, an increase in the average score in the post-test. The group influence was not statistically significant (<italic>F</italic>&#x2009;=&#x2009;(1.34)&#x2009;=&#x2009;2.636, value of <italic>p</italic> 0.114 and correlation ratio 0.072), i.e., it does not matter to which group, experimental or control, the student belongs. The calculations also show that the interaction between the group factor and the time/test factor (<italic>F</italic>(1.34)&#x2009;=&#x2009;51.697, value of <italic>p</italic>&#x2009;&#x003C;&#x2009;0.001 and correlation ratio 0.603) is statistically significant, which with respect to the values, given in <xref rid="tab1" ref-type="table">Tables 1, 2</xref> means that students in the experimental group have a significantly higher average success rate in the post-test than other students. Regarding this, hypothesis H was supported.</p>
</sec>
<sec id="sec10">
<title>Qualitative Approach to the Research</title>
<sec id="sec11">
<title>M-Learners&#x2019; Performance</title>
<p>The students&#x2019; perception of the vocabulary enhancement was examined by using the questionnaire and minute papers. The findings showed that a high percentage of the students (82%) perceived an improvement in vocabulary knowledge. In addition, the mobile application users (57%) stated that their vocabulary retention had been better, in other words, they remembered the vocabulary and phrases provided in the mobile app and were able to use them in the conversation, in the phase of output. Furthermore, the students stated that they had been able to express themselves better and more fluently after mobile application intervention (71%). Based on these findings, it can be claimed that the use of the mobile application helped students to improve their language skills. Moreover, an improvement was also perceived by the research participants.</p>
</sec>
<sec id="sec12">
<title>M-Learners&#x2019; Satisfaction</title>
<p>The questionnaire results showed that 82% of the students had been satisfied with the mobile application and would recommend it to others. This is in accordance with the minute papers and virtual focus group findings, which revealed that the students had especially appreciated an easy access to the study materials, the clear arrangement, and fast learning. Most of the students (64%) agreed that learning and practicing vocabulary through the mobile application had suited them better than learning and revising new words through the book. However, many of them also pointed out that the combination of the traditional learning and innovative methods had been an interesting and satisfying form of learning; therefore, they (64%) would like to continue using the mobile app in the future. The results indicate the students&#x2019; satisfaction with the mobile application.</p>
</sec>
<sec id="sec13">
<title>M-Learners&#x2019; Motivation</title>
<p>The increase of the students&#x2019; motivation was examined through the questionnaire, minute papers, and virtual focus group. The results revealed from the questionnaire showed that students (71%) had felt motivated by using the mobile application in the process of education. Learning was perceived as more fun and less stressful (100%). This information was also confirmed in the minute papers since many students added that their motivation was increased thanks to better learning outcomes, which were verified in the form of the additional tests. Based on the data obtained from the focus group, it can be stated that the above-mentioned tests were perceived as extrinsic motivation for students to use the mobile application. Nevertheless, such motivation was not perceived negatively by students. At the same time, mobile application users&#x2019; intrinsic motivation was to increase their language skills. Regarding the findings from the various methods, the results demonstrate that the mobile application has a motivating effect on students.</p>
</sec>
<sec id="sec14">
<title>Mobile Application&#x2019;s Functions</title>
<p>When comparing the data obtained from the questionnaire, the minute papers and the virtual focus group, it was found that the results of these methods matched. For a better understanding, the information provided in the mobile application was considered clear, readable, and easy to absorb (100%). The corrective feedback function was perceived as the biggest advantage of the mobile application (100%), as it helped students to learn and understand vocabulary faster. In addition, according to the students&#x2019; opinion, the corrective feedback helped them to improve and extend their vocabulary, which was also claimed by the results obtained from the post-test. On the contrary, the mobile application notifications and the pronunciation verification were considered to be the shortcomings of the mobile application (71%) since they did not work for many students during the research period. It was also confirmed that the students were not satisfied with the fact that the application could not be used offline. It can be stated that despite the benefits of the mobile application which helped students to improve their language skills, <italic>Angli&#x010D;tina Today</italic> proved to have certain shortcomings that should be eliminated in order to make it more effective in the process of language learning.</p>
</sec>
<sec id="sec15">
<title>Ease of Use</title>
<p>The findings revealed from the different research methods were in concordance, since they confirmed that the vocabulary mobile learning application was easy to use (100%). Students stated that using the mobile app was much easier to use in order to revise the vocabulary than using the textbooks. The mobile application users appreciated the possibility to use the mobile application anytime and anywhere, its easy manipulation, and the time-saving work with it. Therefore, it can be stated that <italic>Angli&#x010D;tina Today</italic> was perceived to be a user-friendly mobile application.</p>
</sec>
</sec>
</sec>
<sec id="sec16" sec-type="discussions">
<title>Discussion</title>
<p>The aim of the current research was to explore the usefulness of the mobile application defined by an improved language proficiency and also general overall satisfaction of the users with the app. The results from this study offer some key findings:</p>
<p>First, the questionnaire, minute papers, and virtual focus group revealed the following positive perceptions of the mobile application users:</p>
<list>
<list-item>
<p>&#x2013; Vocabulary knowledge was improved after the mobile application treatment.</p>
</list-item>
<list-item>
<p>&#x2013; Vocabulary retention was better after using the mobile application.</p>
</list-item>
<list-item>
<p>&#x2013; Students&#x2019; ability to express themselves more fluently was enhanced.</p>
</list-item>
<list-item>
<p>&#x2013; Students would recommend <italic>Angli&#x010D;tina Today</italic> to others since the easy access, clear arrangement, and fast learning were appreciated by them.</p>
</list-item>
<list-item>
<p>&#x2013; Learning vocabulary through the mobile application was found to be more practical than using the textbook for the same purpose.</p>
</list-item>
<list-item>
<p>&#x2013; Students&#x2019; motivation was increased thanks to the better learning outcomes.</p>
</list-item>
<list-item>
<p>&#x2013; Learning was perceived as more fun and less stressful.</p>
</list-item>
<list-item>
<p>&#x2013; The mobile application was considered clear, readable, and easy to absorb.</p>
</list-item>
<list-item>
<p>&#x2013; The corrective feedback function helped students to improve their vocabulary.</p>
</list-item>
<list-item>
<p>&#x2013; The vocabulary mobile learning application was easy to use.</p>
</list-item>
<list-item>
<p>&#x2013; The ubiquitous character, easy manipulation, and time-saving work with the mobile application were appreciated.</p>
</list-item>
</list>
<p>These findings accord with those of <xref ref-type="bibr" rid="ref16">Gafni et al. (2017)</xref> which revealed that using vocabulary mobile learning application has a stimulating effect on the process of learning and contributes to the willingness to continue using the application and to recommend it to others. These findings also support those of <xref ref-type="bibr" rid="ref21">Kacetl and Kl&#x00ED;mov&#x00E1; (2019)</xref> who indicated that the key benefits of MALL are the enhancement of the learner&#x2019;s cognitive capacity, the learner&#x2019;s motivation to study in both formal and informal settings, the learner&#x2019;s autonomy and confidence, as well as the promotion of personalized learning, and helping low-achieving students to reach their study goals. These findings also re-echo <xref ref-type="bibr" rid="ref34">Nuareni&#x2019;s (2020)</xref> claim that the majority of the students has positive perception on the usage of MALL in learning English language. These findings are also in line with the most recent study by <xref ref-type="bibr" rid="ref20">Jeong (2022)</xref>, who claim that MALL helped his students with access to learning contents, created flexible and self-directed learning environment, better interaction, and improved self-efficacy in English learning performance.</p>
<p>Second, the implementation of the vocabulary mobile learning application was effective because the students from the experimental group reached better results than the students from the control group. Moreover, an enhancement of the language skills was also perceived by the mobile application users. This is in line with the results of several other studies that implemented MALL in the process of education when conducting research. For instance, <xref ref-type="bibr" rid="ref3">Alqahtani and Mohhamad (2015)</xref> claimed that using the mobile learning application enhanced students&#x2019; performance as well as their satisfaction. Similar results were found by <xref ref-type="bibr" rid="ref05">Lu (2008)</xref>who stated that the participants from the experimental group identified more vocabulary than the group learning vocabulary through the printed materials. The same findings were revealed by <xref ref-type="bibr" rid="ref35">Palalas (2011)</xref> and <xref ref-type="bibr" rid="ref03">Gharehblagh and Nasri (2020)</xref> who indicated that MALL helped to improve the vocabulary knowledge of EFL students.</p>
<p>Overall, the results obtained from the different quantitative and qualitative research methods proved a high level of the mobile application usefulness. This claim is based on the fact that using mobile application in the process of education helped students to reach better results in the post-test, helped to improve students&#x2019; vocabulary and the ability to express themselves more fluently, proved to be user-friendly, and enhanced students&#x2019; motivation to learn. Nevertheless, as <xref ref-type="bibr" rid="ref23">Klimova (2021)</xref> states, teachers have to guide their students in the use of such an app to make the learning process effective and meaningful.</p>
<p>This study helps to understand the perceived advantages and disadvantages of using vocabulary mobile learning application in blended foreign language learning. It turned out that most of the participants found the mobile application beneficial additional learning tool since it helped them to improve their language skills and made learning more fun and less stressful. The obtained research findings can help foreign language teachers to understand the benefits of combining mobile learning with traditional face-to-face learning. It can motivate them to innovate their teaching and lose the fear of using technology due to its seemingly disruptive nature. Furthermore, it might motivate foreign language students to use their mobile devices as the learning tool. Moreover, the findings can assist developers of vocabulary mobile learning applications since students&#x2019; preferences are provided in the present study.</p>
</sec>
<sec id="sec17">
<title>Implications</title>
<p>In view of the results of this study, some pedagogical recommendations are suggested to EFL instructors. Teachers should be the role models for their students and <bold>teach them how to use mobile phones in the process of language learning</bold>. Despite the fact that students use their mobile phones on a daily basis, they might not know how to use them as learning tools. Therefore, they need the guidance of a teacher.</p>
<p>It is sufficient for MALL to be implemented only in one of the learning phases, preferably during the information processing phase. Students can be introduced new vocabulary in the classroom environment through the traditional methods of learning and, subsequently, <bold>the new vocabulary can be revised through a mobile application, outside the school environment</bold>. The last phase of output should take place in the classroom, where the various activities can be used to verify students&#x2019; vocabulary knowledge.</p>
<p>When revealing the mobile lessons, it is important to provide learning materials that are in concordance with the curriculum taught in the classroom. <bold>The information provided should be well organized, readable, and easy to absorb.</bold></p>
<p>It is not necessary to provide a large amount of vocabulary in each mobile lesson. However, <bold>it is recommended to add new vocabulary regularly</bold>, preferably after each face-to-face lesson.</p>
<p>Teachers should regularly <bold>send notifications</bold> and remind their students of new material or testing. If mobile application notifications do not work, it is necessary to look for new solutions to inform students about these events.</p>
<p><bold>It is important to carry out a formative assessment</bold>, which makes it possible to monitor students&#x2019; progress. The results obtained from the assessment can help teachers to understand the needs of the students and possibly change the learning plans. Formative assessment can also be a motivation for students to use the mobile application; moreover, students are provided with feedback on their learning performance.</p>
<p>It is essential for teachers to <bold>ask for feedback from the students</bold> and understand their perception of the use of new technologies in the learning process. It can help teachers to improve their teaching and, what is more, students value being asked for their opinion since they feel being recognized when they are given space to express their views. Such an approach can help teachers to create a positive school climate and thus improve the learning process.</p>
<p>It is recommended to <bold>give students a free choice</bold> and let them decide whether they want to use the mobile technologies in the process of learning or prefer traditional learning through textbooks. Forcing students to use the mobile technologies could provoke resistance to learning. Students must not be punished for their decisions.</p>
<p>Furthermore, it would be suitable to <bold>raise other teachers&#x2019; awareness</bold> of the implementation of the mobile technologies in the process of the language learning which can help students to improve their language skills. The older generation of teachers often resist the use of innovative trends, but nowadays, the implementation of the technology in education seems to be essential. The COVID-19 pandemic clarified the importance of the technologies as traditional learning suddenly switched into distance learning. This could not have worked without the inclusion of the technology in the process of learning.</p>
</sec>
<sec id="sec18">
<title>Limitations</title>
<p>Naturally, there are certain limitations to be considered in this study. To start with, the research sample size was small; therefore, it was difficult to get more statistically significant results and generalize the study. Additionally, the time the secondary school students experienced the mobile application was relatively short. A longer period may have provided an additional and deeper insight. Furthermore, there was no space to examine the vocabulary retention perceived by the students in the follow-up period. However, this fact was confirmed by different studies whose results were in line with the findings of the present research.</p>
</sec>
<sec id="sec19" sec-type="data-availability">
<title>Data Availability Statement</title>
<p>The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.</p>
</sec>
<sec id="sec20">
<title>Author Contributions</title>
<p>All authors listed have made a substantial, direct, and intellectual contribution to the work and approved it for publication.</p>
</sec>
<sec id="sec27" sec-type="funding-information">
<title>Funding</title>
<p>The paper is supported by the project Excellence (2202/2022) at the Faculty of Informatics and Management, University of Hradec Kr&#x00E1;lov&#x00E9;, Czechia.</p>
</sec>
<sec id="conf1" sec-type="COI-statement">
<title>Conflict of Interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec id="sec220" sec-type="disclaimer">
<title>Publisher&#x2019;s Note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
</body>
<back>
<ref-list>
<title>References</title>
<ref id="ref2"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Alquahtani</surname> <given-names>M.</given-names></name></person-group> (<year>2015</year>). <article-title>The importance of vocabulary in language learning and how to be taught</article-title>. <source>Int. J. Teach. Educ.</source> <volume>3</volume>, <fpage>21</fpage>&#x2013;<lpage>34</lpage>. doi: <pub-id pub-id-type="doi">10.20472/TE.2015.3.3.002</pub-id></citation></ref>
<ref id="ref3"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Alqahtani</surname> <given-names>M.</given-names></name> <name><surname>Mohhamad</surname> <given-names>H.</given-names></name></person-group> (<year>2015</year>). <article-title>Mobile applications&#x2019; impact on students&#x2019; performance and satisfaction</article-title>. <source>J. Educ. Technol.</source> <volume>14</volume>, <fpage>102</fpage>&#x2013;<lpage>112</lpage>. doi: <pub-id pub-id-type="doi">10.29252/ijree.3.2.48</pub-id></citation></ref>
<ref id="ref6"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Berger</surname> <given-names>A.</given-names></name> <name><surname>Kl&#x00ED;mov&#x00E1;</surname> <given-names>B.</given-names></name> <name><surname>Poulov&#x00E1;</surname> <given-names>P.</given-names></name></person-group> (<year>2019</year>). <article-title>Mobile application as support of English on-line learning</article-title>. <source>Educ. Comput. Sci.</source> <fpage>647</fpage>&#x2013;<lpage>653</lpage>. doi: <pub-id pub-id-type="doi">10.5220/0007732506470653</pub-id></citation></ref>
<ref id="ref7"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Birkner</surname> <given-names>V. A.</given-names></name></person-group> (<year>2016</year>). <article-title>Revisting input and output hypotheses in second language learning</article-title>. <source>Asian Educ. Stud.</source> <volume>1</volume>:<fpage>19</fpage>. doi: <pub-id pub-id-type="doi">10.20849/aes.v1i1.18</pub-id></citation></ref>
<ref id="ref8"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Bj&#x00F6;rgvinsson</surname> <given-names>L. A.</given-names></name></person-group> (<year>2012</year>). Incidental and instructional vocabulary. Available at: <ext-link xlink:href="https://www.academia.edu/3321504/Incidental_and_Instructional_Vocabular_Acquistision" ext-link-type="uri">https://www.academia.edu/3321504/Incidental_and_Instructional_Vocabular_Acquistision</ext-link> (Accessed January 3, 2022).</citation></ref>
<ref id="ref01"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Butarbutar</surname> <given-names>R.</given-names></name></person-group> (<year>2020</year>). &#x201C;<article-title>Mobile assisted language learning</article-title>,&#x201D; in  <source>Advances in Social Science, Education and Humanities Research, Proceedings of the 3rd International Conference on Social Sciences.</source> <publisher-name>Atlantis Press</publisher-name>, <fpage>390</fpage>&#x2013;<lpage>392</lpage>.</citation></ref>
<ref id="ref1"><citation citation-type="other"><person-group person-group-type="author"><collab id="coll1">Council of Europe</collab></person-group> (<year>2018</year>). Available at: <ext-link xlink:href="https://www.coe.int/en/web/common-european-framework-reference-languages" ext-link-type="uri">https://www.coe.int/en/web/common-european-framework-reference-languages</ext-link> (Accessed January 19, 2022).</citation></ref>
<ref id="ref02"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ekinci</surname> <given-names>M.</given-names></name></person-group> (<year>2017</year>). <article-title>Perceptions of EFL learners about using mobile applications for English language learnings: a case study</article-title>. <source>Int. J. Acad. Res.</source> <volume>5</volume>, <fpage>175</fpage>&#x2013;<lpage>193</lpage>. doi: <pub-id pub-id-type="doi">10.18033/ijla.3659</pub-id></citation></ref>
<ref id="ref14"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Eraut</surname> <given-names>M.</given-names></name></person-group> (<year>2004</year>). <article-title>The practice of reflection</article-title>. <source>Learn. Health Soc. Care</source> <volume>3</volume>, <fpage>47</fpage>&#x2013;<lpage>52</lpage>. doi: <pub-id pub-id-type="doi">10.1111/j.1473-6861.2004.00066.x</pub-id></citation></ref>
<ref id="ref15"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Gafni</surname> <given-names>R.</given-names></name></person-group> (<year>2008</year>). <source>Measuring Quality of M-Learning Systems.</source> <publisher-loc>Santa Rosa, CA</publisher-loc>: <publisher-name>Informing Science Press</publisher-name>.</citation></ref>
<ref id="ref16"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gafni</surname> <given-names>R.</given-names></name> <name><surname>Achituv</surname> <given-names>D. B.</given-names></name> <name><surname>Rachmani</surname> <given-names>G. J.</given-names></name></person-group> (<year>2017</year>). <article-title>Learning foreign languages using mobile applications</article-title>. <source>J. Inf. Technol. Educ. Res.</source> <volume>13</volume>, <fpage>49</fpage>&#x2013;<lpage>89</lpage>.</citation></ref>
<ref id="ref002"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>G&#x00FC;rkan</surname> <given-names>S.</given-names></name></person-group> (<year>2018</year>). <article-title>The effects of a mobile assisted vocabulary learning application on vocabulary learning</article-title>. <source>Turhish J. Qual. Inq.</source> <volume>9</volume>, <fpage>288</fpage>&#x2013;<lpage>311</lpage>. doi: <pub-id pub-id-type="doi">10.17569/tojqi.407512</pub-id></citation></ref>
<ref id="ref03"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gharehblagh</surname> <given-names>N. M.</given-names></name> <name><surname>Nasri</surname> <given-names>N.</given-names></name></person-group> (<year>2020</year>). <article-title>Developing EFL elementary learners&#x2019; writing skills through mobile-assisted language learning (MALL)</article-title>. <source>Teach. Engl. Technol.</source> <volume>20</volume>, <fpage>104</fpage>&#x2013;<lpage>121</lpage>.</citation></ref>
<ref id="ref19"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Hendl</surname> <given-names>J.</given-names></name></person-group> (<year>2005</year>). <source>Kvalitativn&#x00ED; v&#x00FD;zkum: Z&#x00E1;kladn&#x00ED; metody a aplikace.</source> <publisher-loc>Praha</publisher-loc>: <publisher-name>Port&#x00E1;l</publisher-name>.</citation></ref>
<ref id="ref20"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jeong</surname> <given-names>K. O.</given-names></name></person-group> (<year>2022</year>). <article-title>Facilitating sustainable self-directed learning experience with the use of mobile-assisted language learning</article-title>. <source>Sustainability</source> <volume>14</volume>:<fpage>2894</fpage>. doi: <pub-id pub-id-type="doi">10.3390/su14052894</pub-id></citation></ref>
<ref id="ref21"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kacetl</surname> <given-names>J.</given-names></name> <name><surname>Kl&#x00ED;mov&#x00E1;</surname> <given-names>B.</given-names></name></person-group> (<year>2019</year>). <article-title>Use of smartphone applications in English language learning: a challenge for foreign language education</article-title>. <source>Educ. Sci.</source> <volume>9</volume>:<fpage>179</fpage>. doi: <pub-id pub-id-type="doi">10.3390/educsci9030179</pub-id></citation></ref>
<ref id="ref22"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kl&#x00ED;mov&#x00E1;</surname> <given-names>B.</given-names></name></person-group> (<year>2017</year>). <article-title>Mobile phones and/or smartphones and their apps for teaching English as a foreign language</article-title>. <source>Educ. Inf. Technol.</source> <volume>23</volume>, <fpage>1091</fpage>&#x2013;<lpage>1099</lpage>. doi: <pub-id pub-id-type="doi">10.1007/s10639-017-9655-5</pub-id></citation></ref>
<ref id="ref04"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kl&#x00ED;mov&#x00E1;</surname> <given-names>B.</given-names></name></person-group> (<year>2019</year>). <article-title>Impact of mobile learning on students&#x2019; achievement results</article-title>. <source>Educ. Sci.</source> <volume>9</volume>:<fpage>90</fpage>. doi: <pub-id pub-id-type="doi">10.3390/educsci9020090</pub-id></citation></ref>
<ref id="ref23"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Klimova</surname> <given-names>B.</given-names></name></person-group> (<year>2021</year>). <article-title>Evaluating impact of mobile applications on EFL university learners' vocabulary learning: a review study</article-title>. <source>Procedia Comput. Sci.</source> <volume>184</volume>, <fpage>859</fpage>&#x2013;<lpage>864</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.procs.2021.03.108</pub-id></citation></ref>
<ref id="ref24"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kl&#x00ED;mov&#x00E1;</surname> <given-names>B.</given-names></name> <name><surname>Pol&#x00E1;kov&#x00E1;</surname> <given-names>P.</given-names></name></person-group> (<year>2020</year>). <article-title>Students&#x2019; perception of an EFL vocabulary learning mobile application: a case study</article-title>. <source>Educ. Sci.</source> <volume>10</volume>:<fpage>37</fpage>. doi: <pub-id pub-id-type="doi">10.3390/educscil0020037</pub-id></citation></ref>
<ref id="ref25"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kohnke</surname> <given-names>L.</given-names></name></person-group> (<year>2020</year>). <article-title>Exploring learner perception, experience and motivation of using a mobile app in L2 vocabulary acquisition</article-title>. <source>IJCALLT</source> <volume>10</volume>, <fpage>15</fpage>&#x2013;<lpage>26</lpage>. doi: <pub-id pub-id-type="doi">10.4018/IJCALLT.2020010102</pub-id></citation></ref>
<ref id="ref26"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kukulska-Hulme</surname> <given-names>A.</given-names></name></person-group> (<year>2009</year>). <article-title>Will mobile learning change language learning?</article-title> <source>ReCALL</source> <volume>21</volume>, <fpage>157</fpage>&#x2013;<lpage>165</lpage>. doi: <pub-id pub-id-type="doi">10.1017/S0958344009000202</pub-id></citation></ref>
<ref id="ref28"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Liu</surname> <given-names>M.</given-names></name></person-group> (<year>2008</year>). <article-title>Effectiveness of vocabulary learning via mobile phone</article-title>. <source>J. Comput. Assist. Learn.</source> <volume>24</volume>, <fpage>515</fpage>&#x2013;<lpage>525</lpage>. doi: <pub-id pub-id-type="doi">10.1111/j.1365-2729.2008.00289.x</pub-id></citation></ref>
<ref id="ref05"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lu</surname> <given-names>M.</given-names></name></person-group> (<year>2008</year>). <article-title>Effectiveness of vocabulary learning via mobile phone</article-title>. <source>J. Comput. Assist. Learn.</source> <volume>24</volume>, <fpage>515</fpage>&#x2013;<lpage>525</lpage>. doi: <pub-id pub-id-type="doi">10.1111/j.1365-2729.2008.00289.x</pub-id></citation></ref>
<ref id="ref06"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mahdi</surname> <given-names>S. H.</given-names></name></person-group> (<year>2017</year>). <article-title>Effectiveness of mobile devices on vocabulary learning: A meta-analysis</article-title>. <source>J. Educ. Comput. Res.</source> <volume>56</volume>, <fpage>134</fpage>&#x2013;<lpage>154</lpage>. doi: <pub-id pub-id-type="doi">10.1177/0735633117698826</pub-id></citation></ref>
<ref id="ref30"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Mikuleck&#x00FD;</surname> <given-names>P.</given-names></name></person-group> (<year>2019</year>). &#x201C;<article-title>Blended learning in smart learning environments</article-title>,&#x201D; in <italic>EPIA Conference on Artificial Intelligence</italic>. August 24-27, 2020.</citation></ref>
<ref id="ref31"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nasab</surname> <given-names>H. S.</given-names></name> <name><surname>Taki</surname> <given-names>S.</given-names></name></person-group> (<year>2016</year>). <article-title>Effects of MALL in blended learning on Iranian EFL learners&#x2019; reading comprehension</article-title>. <source>Modern J. Lang. Teach. Methods.</source> <volume>6</volume>, <fpage>854</fpage>&#x2013;<lpage>869</lpage>.</citation></ref>
<ref id="ref32"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Nation</surname> <given-names>I. S. P.</given-names></name></person-group> (<year>2001</year>). <source>Learning Vocabulary in Another Language.</source> <publisher-loc>Cambridge, England</publisher-loc>: <publisher-name>Cambridge University Press</publisher-name>.</citation></ref>
<ref id="ref33"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Neumeier</surname> <given-names>P.</given-names></name></person-group> (<year>2005</year>). <article-title>A closer look at blended learning: parameters for designing a blended learning environment for language teaching and learning</article-title>. <source>ReCALL</source> <volume>17</volume>, <fpage>163</fpage>&#x2013;<lpage>178</lpage>. doi: <pub-id pub-id-type="doi">10.1017/S0958344005000224</pub-id></citation></ref>
<ref id="ref34"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nuareni</surname> <given-names>C.</given-names></name></person-group> (<year>2020</year>). <article-title>Mobile-assisted language learning (MALL): Students' perception and problems towards Mobile learning in English language</article-title>. <source>J. Phys. Conf. Ser.</source> <volume>1641</volume>:<fpage>7.</fpage></citation></ref>
<ref id="ref35"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Palalas</surname> <given-names>A.</given-names></name></person-group> (<year>2011</year>). &#x201C;Mobile-Assisted Language Learning: Designing for Your Students,&#x201D; in <source>Second Language Teaching and Learning with Technology: Views of Emergent Researcher.</source> <publisher-loc>Dublin</publisher-loc>: <publisher-name>Research-Publishing.net</publisher-name>.</citation></ref>
<ref id="ref36"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Pol&#x00E1;kov&#x00E1;</surname> <given-names>P.</given-names></name></person-group> (<year>2019</year>). Using mobile technologies in foreign Language Learning. Zborn&#x00ED;k &#x0161;t&#x00FA;di&#x00ED; z medzin&#x00E1;rodnej vedeckej konferencie Inovat&#x00ED;vne trendy v odborov&#x00FD;ch didaktik&#x00E1;c. Prepojenie te&#x00F3;rie a praxe v&#x00FD;u&#x010D;bov&#x00FD;ch strat&#x00E9;gi&#x00ED; ktitick&#x00E9;ho a tvoriv&#x00E9;ho myslenia.</citation></ref>
<ref id="ref37"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Prensky</surname> <given-names>M.</given-names></name></person-group> (<year>2005</year>). What can you learn from a cell phone? Almost anything! Available at: <ext-link xlink:href="https://archive.ceciis.ori.hr/app/public/conferences/1/ceciis2015/papers/745.pdf" ext-link-type="uri">https://archive.ceciis.ori.hr/app/public/conferences/1/ceciis2015/papers/745.pdf</ext-link> (Accessed December 20, 2021).</citation></ref>
<ref id="ref001"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rezaei</surname> <given-names>A.</given-names></name> <name><surname>Mai</surname> <given-names>N. B.</given-names></name> <name><surname>Pesaranghader</surname> <given-names>A. J.</given-names></name></person-group> (<year>2013</year>). &#x201C;<article-title>Effectiveness of using english vocabulary mobile applications on ESL&#x2019;s learning performance</article-title>,&#x201D; in <source>International Conference on Informatics and Creative Multimedia, 2013.</source> <publisher-loc>Kuala Lumpur, Malaysia</publisher-loc>; <publisher-name>IEEE</publisher-name>; <fpage>114</fpage>&#x2013;<lpage>118</lpage>. September 4-6, 2013</citation></ref>
<ref id="ref38"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Schmitt</surname> <given-names>N.</given-names></name></person-group> (<year>2010</year>). <source>Researching Vocabulary: A Vocabulary Research Manual.</source> <publisher-loc>Great Britain</publisher-loc>: <publisher-name>Palgrave Macmillan</publisher-name>.</citation></ref>
<ref id="ref39"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Senffner</surname> <given-names>D.</given-names></name> <name><surname>Kepler</surname> <given-names>L. G.</given-names></name></person-group> (<year>2015</year>). <source>Blended Learning that Works.</source> <publisher-loc>Alexandria, VA</publisher-loc>: <publisher-name>Association for Talent Development</publisher-name>.</citation></ref>
<ref id="ref40"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Soleimani</surname> <given-names>H.</given-names></name> <name><surname>Mohammaddokht</surname> <given-names>F.</given-names></name> <name><surname>Fathi</surname> <given-names>J.</given-names></name></person-group> (<year>2022</year>). <article-title>Exploring the effect of assisted repeated Reading on incidental vocabulary learning and vocabulary learning self-efficacy in an EFL context</article-title>. <source>Front. Psychol.</source> <volume>13</volume>:<fpage>851812</fpage>. doi: <pub-id pub-id-type="doi">10.3389/fpsyg.2022.851812</pub-id>, PMID: <pub-id pub-id-type="pmid">35250786</pub-id></citation></ref>
<ref id="ref42"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Viberg</surname> <given-names>O.</given-names></name> <name><surname>Gr&#x00F6;nlund</surname> <given-names>A.</given-names></name></person-group> (<year>2013</year>). <article-title>Cross-cultural analysis of users&#x2019; attitudes toward the use of mobile devices in second and foreign language learning in higher education: a case from Sweden and China</article-title>. <source>Comput. Educ.</source> <volume>69</volume>, <fpage>169</fpage>&#x2013;<lpage>180</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.compedu.2013.07.014</pub-id></citation></ref>
<ref id="ref44"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Wilkins</surname> <given-names>D.</given-names></name></person-group> (<year>1972</year>). <source>Linguistics in Language Teaching.</source> <publisher-loc>London, England</publisher-loc>: <publisher-name>Arnold</publisher-name>.</citation></ref>
<ref id="ref45"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Yin</surname> <given-names>R. K</given-names></name></person-group> (<year>2009</year>). <source>Case Study Research: Design and Methods. 4th Edn.</source> <publisher-loc>Thousand Oaks, CA</publisher-loc>: <publisher-name>Sage publications</publisher-name>.</citation></ref>
<ref id="ref07"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhang</surname></name></person-group> (<year>2009</year>). <article-title>The role of input, interaction and output in the development of oral Fluency</article-title>. <source>CCSE J.</source> <volume>2</volume>.</citation></ref>
<ref id="ref46"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhang</surname> <given-names>H.</given-names></name></person-group> (<year>2011</year>). <article-title>Reexamining the effectiveness of vocabulary learning via mobile phones</article-title>. <source>TOJET</source> <volume>10</volume>, <fpage>203</fpage>&#x2013;<lpage>214</lpage>.</citation></ref>
<ref id="ref47"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhang</surname> <given-names>D.</given-names></name> <name><surname>Feng Teng</surname> <given-names>M.</given-names></name></person-group> (<year>2012</year>). <article-title>The associations between working memory and the effects of multimedia input on L2 vocabulary learning</article-title>. <source>Int. Rev. Appl. Ling. Lang. Teach.</source></citation></ref>
</ref-list>
</back>
</article>