<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="editorial">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Psychol.</journal-id>
<journal-title>Frontiers in Psychology</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Psychol.</abbrev-journal-title>
<issn pub-type="epub">1664-1078</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fpsyg.2021.793399</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Psychology</subject>
<subj-group>
<subject>Editorial</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Editorial: Process Data in Educational and Psychological Measurement</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Jiao</surname> <given-names>Hong</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/25044/overview"/>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name><surname>He</surname> <given-names>Qiwei</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<xref ref-type="corresp" rid="c002"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/484649/overview"/>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name><surname>Veldkamp</surname> <given-names>Bernard P.</given-names></name>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
<xref ref-type="corresp" rid="c003"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/404945/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Department of Human Development and Quantitative Methodology, University of Maryland</institution>, <addr-line>College Park, MD</addr-line>, <country>United States</country></aff>
<aff id="aff2"><sup>2</sup><institution>Educational Testing Service</institution>, <addr-line>Princeton, NJ</addr-line>, <country>United States</country></aff>
<aff id="aff3"><sup>3</sup><institution>Department of Learning, Data Analytics and Technology, Faculty of Behavioral Management and Social Sciences, University of Twente</institution>, <addr-line>Enschede</addr-line>, <country>Netherlands</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited and reviewed by: Huali Wang, Peking University Sixth Hospital, China</p></fn>
<corresp id="c001">&#x0002A;Correspondence: Hong Jiao <email>hjiao&#x00040;umd.edu</email></corresp>
<corresp id="c002">Qiwei He <email>qhe&#x00040;ets.org</email></corresp>
<corresp id="c003">Bernard P. Veldkamp <email>b.p.veldkamp&#x00040;utwente.nl</email></corresp>
<fn fn-type="other" id="fn001"><p>This article was submitted to Quantitative Psychology and Measurement, a section of the journal Frontiers in Psychology</p></fn></author-notes>
<pub-date pub-type="epub">
<day>03</day>
<month>12</month>
<year>2021</year>
</pub-date>
<pub-date pub-type="collection">
<year>2021</year>
</pub-date>
<volume>12</volume>
<elocation-id>793399</elocation-id>
<history>
<date date-type="received">
<day>12</day>
<month>10</month>
<year>2021</year>
</date>
<date date-type="accepted">
<day>25</day>
<month>10</month>
<year>2021</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2021 Jiao, He and Veldkamp.</copyright-statement>
<copyright-year>2021</copyright-year>
<copyright-holder>Jiao, He and Veldkamp</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<related-article id="RA1" related-article-type="commentary-article" xlink:href="https://www.frontiersin.org/research-topics/7035/process-data-in-educational-and-psychological-measurement" ext-link-type="uri">Editorial on the Research Topic <article-title>Process Data in Educational and Psychological Measurement</article-title></related-article>
<kwd-group>
<kwd>process data</kwd>
<kwd>psychological assessment</kwd>
<kwd>data mining</kwd>
<kwd>educational assessment</kwd>
<kwd>computer based assessment</kwd>
</kwd-group>
<counts>
<fig-count count="0"/>
<table-count count="1"/>
<equation-count count="0"/>
<ref-count count="16"/>
<page-count count="5"/>
<word-count count="3422"/>
</counts>
</article-meta>
</front>
<body>
<p>The increasing use of computer-based testing and learning environments is leading to a significant reform on the traditional form of measurement, with tremendous extra available data collected during the process of learning and assessment (Bennett et al., <xref ref-type="bibr" rid="B3">2007</xref>, <xref ref-type="bibr" rid="B2">2010</xref>). It means that we can learn and describe the respondents&#x00027; performances not only by their responses, but also their responding processes, in addition to the response accuracy in the traditional tests (Ercikan and Pellegrino, <xref ref-type="bibr" rid="B5">2017</xref>).</p>
<p>The recent advances in computer technology enhance the convenient collection of process data in computer-based assessment. One such example is time-stamped action data in an innovative item which allow for the interaction between a respondent and the item. When a respondent attempts an interactive item, his/her actions are recorded, in the form of an ordered sequence of multi-type, time-stamped events. These sorts of data stored in log files, referred to as <italic>process data</italic> in this book, provide information beyond response data that typically show response accuracy only. This additional information holds promise to help us understand the strategies that underlie test performance and identify key actions that lead to success or failure of answering an item (e.g., Han et al., <xref ref-type="bibr" rid="B7">2019</xref>; <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.00646">Liao et al.</ext-link>; Stadler et al., <xref ref-type="bibr" rid="B11">2019</xref>; He et al., <xref ref-type="bibr" rid="B8">2021</xref>; Ulitzsch et al., <xref ref-type="bibr" rid="B13">2021a</xref>; Xiao et al., <xref ref-type="bibr" rid="B15">2021</xref>).</p>
<p>With the availability of process data in addition to response data, the measurement field is becoming increasingly interested in borrowing additional auxiliary information from the responding process to serve different assessment purposes. For instance, recently researchers proposed different models for response time and the joint modeling of responses and response time (e.g., <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2018.01525">Bolsinova and Molenaar</ext-link>; <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2021.579128">Costa et al.</ext-link>; <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.00051">Wang et al.</ext-link>). In addition, other process data such as the path collected based on eye-tracking devices (e.g., Zhu and Feng, <xref ref-type="bibr" rid="B16">2015</xref>; Maddox et al., <xref ref-type="bibr" rid="B9">2018</xref>; Man and Harring, <xref ref-type="bibr" rid="B10">2021</xref>), action sequences in problem-solving tasks (e.g., <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.00486">Chen et al.</ext-link>; Tang et al., <xref ref-type="bibr" rid="B12">2020</xref>; He et al., <xref ref-type="bibr" rid="B8">2021</xref>; Ulitzsch et al., <xref ref-type="bibr" rid="B14">2021b</xref>), and processes in collaborative problem solving (e.g., Graesser et al., <xref ref-type="bibr" rid="B6">2018</xref>; Andrews-Todd and Kerr, <xref ref-type="bibr" rid="B1">2019</xref>; De Boeck and Scalise, <xref ref-type="bibr" rid="B4">2019</xref>), are also worthy of exploration and integration with product data for assessment purposes.</p>
<p>This Research Topic (formed in this edited e-book) intends to explore the forefront of responding to the needs in modeling new data sources and incorporating process data in the statistical modeling of multiple possible assessment data. This edited book presents the cutting-edge research related to utilizing process data in addition to product data such as item responses in educational and psychological measurement for enhancing accuracy in ability parameter estimation (e.g., <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2018.01525">Bolsinova and Molenaar</ext-link>; <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.00102">De Boeck and Jeon</ext-link>; <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.01131">Engelhardt and Goldhammer</ext-link>; <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.01675">Klotzke and Fox</ext-link>; <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.00829">Liu C. et al.</ext-link>; <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.00620">Park et al.</ext-link>; <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.00887">Schweizer et al.</ext-link>; <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.00051">Wang et al.</ext-link>; <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2018.02339">Zhang and Wang</ext-link>), cognitive diagnosis facilitation (e.g., <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.01122">Guo and Zheng</ext-link>; <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.02910">Guo et al.</ext-link>; <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2018.02142">Jiang and Ma</ext-link>; <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2018.00607">Zhan, Liao et al.</ext-link>; <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2021.469196">Zhan, Jiao et al.</ext-link>), and aberrant responding behavior detection (e.g., <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2018.01372">Liu H. et al.</ext-link>; <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/feduc.2019.00049">Toton and Maynes</ext-link>).</p>
<p>Throughout the book, the methods for analyzing process data in technology-enhanced innovative items in large-scale assessment for high-stakes decisions are addressed (e.g., <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.00906">Lee et al.</ext-link>; <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.00777">Stadler et al.</ext-link>). Further, the methods for the extraction of useful information in process data in assessments such as serious games and simulations were also discussed (e.g., <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.00646">Liao et al.</ext-link>; <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fams.2019.00002">Kroehne et al.</ext-link>; <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.01975">Ren et al.</ext-link>; <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.00369">Yuan et al.</ext-link>). The interdisciplinary studies that borrow data-driven methods from computer science, machine learning, artificial intelligence, and natural language processing are also highlighted in this Research Topic (e.g., <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.00083">Ariel-Attali et al.</ext-link>; <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.00486">Chen et al.</ext-link>; <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.01011">Hao and Mislevy</ext-link>; <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2018.02231">Qiao and Jiao</ext-link>; <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.01186">Smink et al.</ext-link>), which provide new perspectives in data exploration in educational and psychological measurement. Most importantly, the models presenting the integration of the process data and the product data in this book are of critical significance to link the traditional test data with the new features extracted from the new data sources. Meanwhile, the papers included in the book provide an excellent source for data and coding sharing, which entails significant contributions to the applications of the innovative statistical modeling of assessment data in the measurement field.</p>
<p>The book chapters demonstrate the use of process data and the integration of process and product data (item responses) in educational and psychological measurement. The chapters address issues in adaptive testing, problem-solving strategy, validity of test score interpretation, item pre-knowledge detection, cognitive diagnosis, complex dependence in joint modeling of responses and response time, and multidimensional modeling of these data types. The originality of this book lies in the statistical modeling of innovative assessment data such as log data, response time data, collaborative problem-solving tasks, dyad data, change process data, testlet data, and multidimensional data. Further, new statistical models are presented for analyzing process data in addition to response data such as transition profile analysis, the event history analysis approach, hidden Markov modeling, conditional scaling, multilevel modeling, text mining, Bayesian covariance structure modeling, mixture modeling, and multidimensional modeling. The integration of multiple data sources and the use of process data provides the measurement field with new perspectives to solve assessment issues and challenges such as problem-solving strategy, cheating detection, and cognitive diagnosis.</p>
<p>An overview of all the papers included in this Research Topic is summarized in <xref ref-type="table" rid="T1">Table 1</xref> with respect to their key features. The scope of the Research Topic can be classified into five major categories:</p>
<list list-type="order">
<list-item><p>leveraging process data to explore test-takers&#x00027; behaviors and problem-solving strategies,</p></list-item>
<list-item><p>proposing joint modeling for response accuracy and response times,</p></list-item>
<list-item><p>proposing new statistical models on analyzing response processes (e.g., time-stamped sequential events),</p></list-item>
<list-item><p>advancing cognitive diagnostic models with new data sources, and</p></list-item>
<list-item><p>using data streams in estimating collaborative problem-solving skills.</p></list-item>
</list>
<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption><p>An overview of papers collected in this Research Topic.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th valign="top" align="left"><bold>References</bold></th>
<th valign="top" align="left"><bold>Areas of advancement</bold></th>
<th valign="top" align="left"><bold>Data types</bold></th>
<th valign="top" align="left"><bold>Statistical approaches</bold></th>
<th valign="top" align="left"><bold>Assessment domains</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left" colspan="5"><bold>Leveraging process data to explore test-takers&#x00027; behaviors and strategies</bold></td>
</tr>
<tr>
<td valign="top" align="left"><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.01975">Ren et al.</ext-link></td>
<td valign="top" align="left">Exploring multiple goals in interactive problem-solving items</td>
<td valign="top" align="left">Extracted response process variables, correctness of responses</td>
<td valign="top" align="left">Cluster analysis, logistics, and least-squares regression</td>
<td valign="top" align="left">Interactive problem-solving in PISA 2012</td>
</tr>
<tr>
<td valign="top" align="left"><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.01131">Engelhardt and Goldhammer</ext-link></td>
<td valign="top" align="left">Proposing a validity research that uses processing times to provide both convergent and discriminant validity evidence for the construct interpretation of reasoning and reading ability scores</td>
<td valign="top" align="left">Response data, response times</td>
<td valign="top" align="left">MLR estimator (maximum likelihood estimation with robust standard error)</td>
<td valign="top" align="left">PIAAC 2012 literacy assessments</td>
</tr>
<tr>
<td valign="top" align="left"><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.00777">Stadler et al.</ext-link></td>
<td valign="top" align="left">Exploring successful and unsuccessful strategies with process data in complex problem-solving items</td>
<td valign="top" align="left">Response process data, correctness of responses</td>
<td valign="top" align="left">N-grams model</td>
<td valign="top" align="left">Interactive problem-solving items</td>
</tr>
<tr>
<td valign="top" align="left"><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.00906">Lee et al.</ext-link></td>
<td valign="top" align="left">Exploring response times in complex simulation-based tasks to understand test-takers&#x00027; interactions</td>
<td valign="top" align="left">Response data, response times</td>
<td valign="top" align="left">Cluster analysis and hierarchical framework for joint modeling item responses and response times</td>
<td valign="top" align="left">Interactive problem-solving items</td>
</tr>
<tr>
<td valign="top" align="left"><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/feduc.2019.00049">Toton and Maynes</ext-link></td>
<td valign="top" align="left">Detecting examinees with pre-knowledge in experimental data with conditional scaling of response times</td>
<td valign="top" align="left">Item scores, response times</td>
<td valign="top" align="left">Cluster analysis, factor analysis</td>
<td valign="top" align="left">Simulation study and empirical study in GRE quantitative testing</td>
</tr>
<tr>
<td valign="top" align="left"><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.00083">Arieli-Attali et al.</ext-link></td>
<td valign="top" align="left">Understanding test-takers&#x00027; choices using hidden Markov modeling of process data</td>
<td valign="top" align="left">Response data, answer change, item difficulty</td>
<td valign="top" align="left">Hidden Markov model</td>
<td valign="top" align="left">Self-adapted tests</td>
</tr>
<tr>
<td valign="top" align="left"><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2018.02231">Qiao and Jiao</ext-link></td>
<td valign="top" align="left">Using data mining techniques in analyzing process data and making comparisons among machine-learning algorithms in exploring problem-solving items</td>
<td valign="top" align="left">Extracted response process variables, correctness of responses</td>
<td valign="top" align="left">Multiple machine learning algorithms: supervised techniques (CART, gradient boosting, random forest, and SVM), unsupervised techniques (SOM, k-means)</td>
<td valign="top" align="left">Interactive problem-solving in PISA 2012</td>
</tr>
<tr>
<td valign="top" align="left"><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2018.01372">Liu H. et al.</ext-link></td>
<td valign="top" align="left">Exploring test-takers&#x00027; problem-solving strategies with a modified multilevel mixture IRT model</td>
<td valign="top" align="left">Extracted response process variables, correctness of responses</td>
<td valign="top" align="left">Modified multilevel mixture IRT model, latent class analysis</td>
<td valign="top" align="left">Interactive problem-solving in PISA 2012</td>
</tr>
<tr>
<td valign="top" align="left"><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.00646">Liao et al.</ext-link></td>
<td valign="top" align="left">Exploring sequential patterns in problem-solving items and relationship with individual differences in background variables</td>
<td valign="top" align="left">Extracted response process variables, response data, background variables</td>
<td valign="top" align="left">N-grams model, feature selection model, regression analysis</td>
<td valign="top" align="left">PIAAC 2012 problem-solving in technology-rich environment</td>
</tr>
<tr>
<td valign="top" align="left" colspan="5"><bold>Joint model for response accuracy and response times</bold></td>
</tr>
<tr>
<td valign="top" align="left"><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2021.469196">Zhan, Jiao et al.</ext-link></td>
<td valign="top" align="left">Proposing a joint model for multidimensional abilities and multifactor speed</td>
<td valign="top" align="left">Response data, response times</td>
<td valign="top" align="left">Joint modeling of response and response time, exploratory factor analysis</td>
<td valign="top" align="left">Simulation study and empirical study in computer-based math assessment (PISA 2012)</td>
</tr>
<tr>
<td valign="top" align="left"><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2021.579128">Costa et al.</ext-link></td>
<td valign="top" align="left">Proposing a joint model for item response and time-on-task to increase the precision of ability estimates</td>
<td valign="top" align="left">Response data, response times</td>
<td valign="top" align="left">Multidimensional latent model for response and response time</td>
<td valign="top" align="left">Interactive problem-solving in PISA 2012</td>
</tr>
<tr>
<td valign="top" align="left"><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.02910">Guo et al.</ext-link></td>
<td valign="top" align="left">Proposing a joint model for a speed-accuracy tradeoff hierarchical model based on cognitive experiment</td>
<td valign="top" align="left">Response data, response times</td>
<td valign="top" align="left">Bayesian MCMC algorithm, speed-accuracy hierarchical model</td>
<td valign="top" align="left">Simulation study and empirical study in Raven&#x00027;s Standard Progressive Matrices</td>
</tr>
<tr>
<td valign="top" align="left"><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.01675">Klotzke and Fox</ext-link></td>
<td valign="top" align="left">Proposing a Bayesian modeling framework for response accuracy, response times, and other process data variables</td>
<td valign="top" align="left">Response data, response times, extracted response process variables</td>
<td valign="top" align="left">Bayesian covariance structure models</td>
<td valign="top" align="left">Simulation study and empirical study in PIAAC 2012 cognitive assessments</td>
</tr>
<tr>
<td valign="top" align="left"><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fams.2019.00002">Kroehne et al.</ext-link></td>
<td valign="top" align="left">Proposing a parameterized joint model of response data and response time to detect invariance by gender and mode between computer-based and paper-based tests</td>
<td valign="top" align="left">Response data, response times</td>
<td valign="top" align="left">Bivariate generalized linear IRT model framework (B-GLIRT)</td>
<td valign="top" align="left">PISA 2012 and PISA 2009 reading assessments</td>
</tr>
<tr>
<td valign="top" align="left"><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.00102">De Boeck and Jeon</ext-link></td>
<td valign="top" align="left">An overview of models for joint modeling of response times and response accuracy in cognitive tests</td>
<td valign="top" align="left">Response data, response times</td>
<td valign="top" align="left">Multiple response models and joint models of response data and response times</td>
<td valign="top" align="left">Literature review</td>
</tr>
<tr>
<td valign="top" align="left"><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.00051">Wang et al.</ext-link></td>
<td valign="top" align="left">Modeling response time and responses in multidimensional health measurement</td>
<td valign="top" align="left">Response data, response times</td>
<td valign="top" align="left">Multidimensional-graded response model, hierarchical joint model of responses and response times</td>
<td valign="top" align="left">Health measurement</td>
</tr>
<tr>
<td valign="top" align="left"><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2018.02339">Zhang and Wang</ext-link></td>
<td valign="top" align="left">Proposing a mixture learning model that utilizes the response times and response accuracy in learning progression</td>
<td valign="top" align="left">Response data, response times</td>
<td valign="top" align="left">Diagnostic classification model framework, Bayesian estimation</td>
<td valign="top" align="left">Simulation study and empirical study in a computer-based learning environment</td>
</tr>
<tr>
<td valign="top" align="left"><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2018.01525">Bolsinova and Molenaar</ext-link></td>
<td valign="top" align="left">Proposing a joint model for response accuracy and response times with consideration on non-linear conditional dependence</td>
<td valign="top" align="left">Response data, response times</td>
<td valign="top" align="left">Joint model for quadratic conditional dependence, joint model for multiple-category conditional dependence, indicator-level non-parametric moderation method</td>
<td valign="top" align="left">Simulation study and empirical study in high-stakes arithmetic assessment</td>
</tr>
<tr>
<td valign="top" align="left" colspan="5"><bold>Statistical model on response process</bold></td>
</tr>
<tr>
<td valign="top" align="left"><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.01186">Smink et al.</ext-link></td>
<td valign="top" align="left">Therapeutic change process research through multilevel and text mining</td>
<td valign="top" align="left">Life narratives textual data and response data</td>
<td valign="top" align="left">Multilevel models, text mining</td>
<td valign="top" align="left">Epidemiologic Studies Depression Scale and life narratives (CES-D)</td>
</tr>
<tr>
<td valign="top" align="left"><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.00887">Schweizer et al.</ext-link></td>
<td valign="top" align="left">Investigating how the major outcome of a confirmatory factor investigation is preserved when scaling the variance of a latent variable by the various scaling methods</td>
<td valign="top" align="left">Scaling data</td>
<td valign="top" align="left">Multiple confirmatory factor analysis</td>
<td valign="top" align="left">Simulation study and empirical study in Multitrait-Multimethod (MTMM) design</td>
</tr>
<tr>
<td valign="top" align="left"><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.00829">Liu C. et al.</ext-link></td>
<td valign="top" align="left">Proposing a model with a leakage parameter to better characterize the item leaking process and develop a more generalized detection method by monitoring responses of test-takers</td>
<td valign="top" align="left">Response data</td>
<td valign="top" align="left">Generalized linear model for detection, leakage simulation model</td>
<td valign="top" align="left">Simulation study and empirical study in operational computerized adaptative testing</td>
</tr>
<tr>
<td valign="top" align="left"><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.00620">Park et al.</ext-link></td>
<td valign="top" align="left">Proposing a multidimensional IRT approach for dynamically monitoring ability growth in adaptive learning systems</td>
<td valign="top" align="left">Response data, response times</td>
<td valign="top" align="left">Multidimensional IRT</td>
<td valign="top" align="left">Simulation study and web-based learning platform</td>
</tr>
<tr>
<td valign="top" align="left"><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.00486">Chen et al.</ext-link></td>
<td valign="top" align="left">Proposing an event history analysis approach to predict duration and outcome of solving a complex problem by making use of process data</td>
<td valign="top" align="left">Time-stamped sequential events data, correctness of responses</td>
<td valign="top" align="left">Regression model</td>
<td valign="top" align="left">Interactive problem-solving in PISA 2012</td>
</tr>
<tr>
<td valign="top" align="left" colspan="5"><bold>Advancement in cognitive diagnostic model with process information</bold></td>
</tr>
<tr>
<td valign="top" align="left"><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.01122">Guo and Zheng</ext-link></td>
<td valign="top" align="left">Comparing termination rules for variable-length CD-CAT from the information theory perspective</td>
<td valign="top" align="left">Response data, test construction variables</td>
<td valign="top" align="left">Multiple cognitive diagnostic models</td>
<td valign="top" align="left">Simulation study</td>
</tr>
<tr>
<td valign="top" align="left"><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2018.02142">Jiang and Ma</ext-link></td>
<td valign="top" align="left">Proposing a model to integrate differential evolution optimization into the EM framework in the log-linear cognitive diagnostic model estimation</td>
<td valign="top" align="left">Response data</td>
<td valign="top" align="left">Log-linear cognitive diagnostic model with EM algorithm, differential evolution</td>
<td valign="top" align="left">Simulation study and empirical study in assessment of a health profession</td>
</tr>
<tr>
<td valign="top" align="left"><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2018.00607">Zhan, Liao et al.</ext-link></td>
<td valign="top" align="left">Proposing a joint testlet cognitive diagnostic model for paired local item dependence using response time and response accuracy</td>
<td valign="top" align="left">Response data, response times</td>
<td valign="top" align="left">Joint testlet cognitive diagnosis modeling</td>
<td valign="top" align="left">PISA 2015 computer-based math assessment</td>
</tr>
<tr>
<td valign="top" align="left" colspan="5"><bold>Using data streams for estimating collaborative problem-solving skills</bold></td>
</tr>
<tr>
<td valign="top" align="left"><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.01011">Hao and Mislevy</ext-link></td>
<td valign="top" align="left">Characterizing interactive communications in collaborative problem-solving using a conditional transition profile approach</td>
<td valign="top" align="left">Conversations collected in a computer-based collaborative problem-solving platform</td>
<td valign="top" align="left">Conditional transition profile, cluster analysis</td>
<td valign="top" align="left">Collaborative problem-solving platform</td>
</tr>
<tr>
<td valign="top" align="left"><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2019.00369">Yuan et al.</ext-link></td>
<td valign="top" align="left">Assessing collaborative problem-solving competence by extracting indictors from process stream data and modeling dyad data</td>
<td valign="top" align="left">Process stream data in collaborative problem solving, response data</td>
<td valign="top" align="left">Multidimensional Random Coefficients Multinomial Logit Model (MRCMLM)</td>
<td valign="top" align="left">Collaborative problem-solving platform adapted from a problem-solving task in PISA 2012</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>The above categorization focused on each paper&#x00027;s core contribution though some papers can be cross-classified. The papers&#x00027; key findings and advancements impressively represent the current state-of-the-art methods in the field of process data analysis in educational and psychological assessments. As topic editors, we were happy to receive such a great collection of papers with various foci and submit these publications right as digital assessments are booming. The papers collected in this Research Topic are also diverse in data types, statistical approaches, and assessment with an extensive scope in both high-stake and low-stake assessments, covering research fields in education, psychology, health, and other applied disciplines.</p>
<p>As one of the first comprehensive books addressing the modeling and application of process data, this e-book has drawn great attention since its debut was cross-loaded on three journals in <italic>Frontiers in Psychology, Frontiers in Education</italic>, and <italic>Frontiers in Applied Mathematics and Statistics</italic>. With 29 papers from 77 authors, this book enhances interdisciplinary research in fields such as psychometrics, psychology, statistics, computer science, educational technology, and educational data mining, to name a few. As highlighted on the e-book webpage, (<ext-link ext-link-type="uri" xlink:href="https://www.frontiersin.org/research-topics/7035/process-data-in-educational-and-psychological-measurement&#x00023;impact">https://www.frontiersin.org/research-topics/7035/process-data-in-educational-and-psychological-measurement&#x00023;impact</ext-link>) on November 13, 2021, this e-book has accumulated 115,069 total reviews and 17,940 article downloads since the Research Topic project launched in 2017. This number keeps growing on a daily basis. The diversified demographics provide convincing evidence that the papers in this book reached the global research community, addressing the critical issues of statistical modeling of multiple types of assessment data in the digital era. This book is just on time to provide tools and methods to shape this new measurement horizon.</p>
<p>As more and more data are being collected in computer-based testing, process data will become a very important source of information to validate and facilitate measuring response accuracy and provide supplementary information in understanding test-takers&#x00027; behaviors, the reasons of missing data, and links with motivation studies. There is no doubt that there is high demand of such research in the large-scale assessment, both high-stake and low-stake, as well as in the personalized learning and assessment to tailor the best source and methods to help people learn and grow. This book is a timely addition to the current literature on psychological and educational measurement. It is expected to be applied more extensively in educational and psychological measurement, such as in computerized adaptive testing and dynamic learning.</p>
<sec id="s1">
<title>Author Contributions</title>
<p>All authors listed have made a substantial, direct, and intellectual contribution to the work and approved it for publication.</p>
</sec>
<sec sec-type="funding-information" id="s2">
<title>Funding</title>
<p>QH was partially supported by the National Science Foundation grants IIS-1633353.</p>
</sec>
<sec sec-type="COI-statement" id="conf1">
<title>Conflict of Interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="s3">
<title>Publisher&#x00027;s Note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
</body>
<back>
<ack><p>We thank all authors who have contributed to this Research Topic and the reviewers for their valuable feedback on the manuscript.</p>
</ack>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Andrews-Todd</surname> <given-names>J.</given-names></name> <name><surname>Kerr</surname> <given-names>D.</given-names></name></person-group> (<year>2019</year>). <article-title>Application of ontologies for assessing collaborative problem-solving skills</article-title>. <source>Int. J. Testing</source> <volume>19</volume>, <fpage>172</fpage>&#x02013;<lpage>187</lpage>. <pub-id pub-id-type="doi">10.1080/15305058.2019.1573823</pub-id></citation>
</ref>
<ref id="B2">
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Bennett</surname> <given-names>R. E.</given-names></name> <name><surname>Persky</surname> <given-names>H.</given-names></name> <name><surname>Weiss</surname> <given-names>A.</given-names></name> <name><surname>Jenkins</surname> <given-names>F.</given-names></name></person-group> (<year>2010</year>). <article-title>Measuring problem solving with technology: A demonstration study for NAEP</article-title>. <source>J. Technol. Learn. Assessment</source> <volume>8</volume>, <fpage>1</fpage>&#x02013;<lpage>44</lpage>. Retrieved from <ext-link ext-link-type="uri" xlink:href="https://ejournals.bc.edu/index.php/jtla/article/view/1627">https://ejournals.bc.edu/index.php/jtla/article/view/1627</ext-link></citation>
</ref>
<ref id="B3">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Bennett</surname> <given-names>R. E.</given-names></name> <name><surname>Persky</surname> <given-names>H.</given-names></name> <name><surname>Weiss</surname> <given-names>A. R.</given-names></name> <name><surname>Jenkins</surname> <given-names>F.</given-names></name></person-group> (<year>2007</year>). <source>Problem Solving in Technology-Rich Environments. A Report From the NAEP Technology Based Assessment Project, Research and Development Series</source> (NCES 2007-466). <publisher-name>National Center for Education Statistics</publisher-name>.</citation>
</ref>
<ref id="B4">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>De Boeck</surname> <given-names>P.</given-names></name> <name><surname>Scalise</surname> <given-names>K.</given-names></name></person-group> (<year>2019</year>). <article-title>Collaborative problem solving: Processing actions, time, and performance</article-title>. <source>Front. Psychol.</source> <volume>10</volume>:<fpage>1280</fpage>. <pub-id pub-id-type="doi">10.3389/fpsyg.2019.01280</pub-id><pub-id pub-id-type="pmid">31231281</pub-id></citation></ref>
<ref id="B5">
<citation citation-type="book"><person-group person-group-type="editor"><name><surname>Ercikan</surname> <given-names>K.</given-names></name> <name><surname>Pellegrino</surname> <given-names>J. W.</given-names></name></person-group> (Eds.). (<year>2017</year>). <source>Validation of Score Meaning for the Next Generation of Assessments: The Use of Response Processes</source>. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Routledge</publisher-name>.</citation>
</ref>
<ref id="B6">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Graesser</surname> <given-names>A. C.</given-names></name> <name><surname>Fiore</surname> <given-names>S. M.</given-names></name> <name><surname>Greiff</surname> <given-names>S.</given-names></name> <name><surname>Andrews-Todd</surname> <given-names>J.</given-names></name> <name><surname>Foltz</surname> <given-names>P. W.</given-names></name> <name><surname>Hesse</surname> <given-names>F. W.</given-names></name></person-group> (<year>2018</year>). <article-title>Advancing the science of collaborative problem solving</article-title>. <source>Psychol. Sci. Public Interest</source> <volume>19</volume>, <fpage>59</fpage>&#x02013;<lpage>92</lpage>. <pub-id pub-id-type="doi">10.1177/1529100618808244</pub-id><pub-id pub-id-type="pmid">30497346</pub-id></citation></ref>
<ref id="B7">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Han</surname> <given-names>Z.</given-names></name> <name><surname>He</surname> <given-names>Q.</given-names></name> <name><surname>von Davier</surname> <given-names>M.</given-names></name></person-group> (<year>2019</year>). <article-title>Predictive feature generation and selection using process data from PISA interactive problem-solving items: an application of random forests</article-title>. <source>Front. Psychol.</source> <volume>10</volume>:<fpage>2461</fpage>. <pub-id pub-id-type="doi">10.3389/fpsyg.2019.02461</pub-id><pub-id pub-id-type="pmid">31824363</pub-id></citation></ref>
<ref id="B8">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>He</surname> <given-names>Q.</given-names></name> <name><surname>Borgonovi</surname> <given-names>F.</given-names></name> <name><surname>Paccagnella</surname> <given-names>M.</given-names></name></person-group> (<year>2021</year>). <article-title>Leveraging process data to assess adults&#x00027; problem-solving skills: Identifying generalized behavioral patterns with sequence mining</article-title>. <source>Comp. Educ.</source> <volume>166</volume>:<fpage>104170</fpage>. <pub-id pub-id-type="doi">10.1016/j.compedu.2021.104170</pub-id></citation>
</ref>
<ref id="B9">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Maddox</surname> <given-names>B.</given-names></name> <name><surname>Bayliss</surname> <given-names>A. P.</given-names></name> <name><surname>Fleming</surname> <given-names>P.</given-names></name> <name><surname>Engelhardt</surname> <given-names>P. E.</given-names></name> <name><surname>Edwards</surname> <given-names>S. G.</given-names></name> <name><surname>Borgonovi</surname> <given-names>F.</given-names></name></person-group> (<year>2018</year>). <article-title>Observing response processes with eye tracking in international large-scale assessments: evidence from the OECD PIAAC assessment</article-title>. <source>Eur. J. Psychol. Educ.</source> <volume>33</volume>, <fpage>543</fpage>&#x02013;<lpage>558</lpage>. <pub-id pub-id-type="doi">10.1007/s10212-018-0380-2</pub-id></citation>
</ref>
<ref id="B10">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Man</surname> <given-names>K.</given-names></name> <name><surname>Harring</surname> <given-names>J. R.</given-names></name></person-group> (<year>2021</year>). <article-title>Assessing preknowledge cheating via innovative measures: A multiple-group analysis of jointly modeling item responses, response times, and visual fixation counts</article-title>. <source>Educ. Psychol. Meas.</source> <volume>81</volume>, <fpage>441</fpage>&#x02013;<lpage>465</lpage>. <pub-id pub-id-type="doi">10.1177/0013164420968630</pub-id><pub-id pub-id-type="pmid">33994559</pub-id></citation></ref>
<ref id="B11">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Stadler</surname> <given-names>M.</given-names></name> <name><surname>Fischer</surname> <given-names>F.</given-names></name> <name><surname>Greiff</surname> <given-names>S.</given-names></name></person-group> (<year>2019</year>). <article-title>Taking a closer look: an exploratory analysis of successful and unsuccessful strategy use in complex problems</article-title>. <source>Front. Psychol</source>. <volume>10</volume>:<fpage>777</fpage>. <pub-id pub-id-type="doi">10.3389/fpsyg.2019.00777</pub-id><pub-id pub-id-type="pmid">31133910</pub-id></citation></ref>
<ref id="B12">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tang</surname> <given-names>X.</given-names></name> <name><surname>Wang</surname> <given-names>Z.</given-names></name> <name><surname>He</surname> <given-names>Q.</given-names></name> <name><surname>Liu</surname> <given-names>J.</given-names></name> <name><surname>Ying</surname> <given-names>Z.</given-names></name></person-group> (<year>2020</year>). <article-title>Latent feature extraction for process data via multidimensional scaling</article-title>. <source>Psychometrika</source> <volume>85</volume>, <fpage>378</fpage>&#x02013;<lpage>397</lpage>. <pub-id pub-id-type="doi">10.1007/s11336-020-09708-3</pub-id><pub-id pub-id-type="pmid">32572672</pub-id></citation></ref>
<ref id="B13">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ulitzsch</surname> <given-names>E.</given-names></name> <name><surname>He</surname> <given-names>Q.</given-names></name> <name><surname>Pohl</surname> <given-names>S.</given-names></name></person-group> (<year>2021a</year>). <article-title>Using sequence mining techniques for understanding incorrect behavioral patterns on interactive tasks</article-title>. <source>J. Educ. Behav. Statistics</source> <volume>45</volume>, <fpage>59</fpage>&#x02013;<lpage>96</lpage>. <pub-id pub-id-type="doi">10.3102/10769986211010467</pub-id></citation>
</ref>
<ref id="B14">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ulitzsch</surname> <given-names>E.</given-names></name> <name><surname>He</surname> <given-names>Q.</given-names></name> <name><surname>Ulitzsch</surname> <given-names>V.</given-names></name> <name><surname>Nichterlein</surname> <given-names>A.</given-names></name> <name><surname>Molter</surname> <given-names>H.</given-names></name> <name><surname>Niedermeier</surname> <given-names>R.</given-names></name> <etal/></person-group>. (<year>2021b</year>). <article-title>Combining clickstream analyses and graph-modeled data clustering for identifying common response process using time-stamped action sequence</article-title>. <source>Psychometrika</source> <volume>86</volume>, <fpage>190</fpage>&#x02013;<lpage>214</lpage>. <pub-id pub-id-type="doi">10.1007/s11336-020-09743-0</pub-id><pub-id pub-id-type="pmid">33544300</pub-id></citation></ref>
<ref id="B15">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Xiao</surname> <given-names>Y.</given-names></name> <name><surname>He</surname> <given-names>Q.</given-names></name> <name><surname>Veldkamp</surname> <given-names>B.</given-names></name> <name><surname>Liu</surname> <given-names>H.</given-names></name></person-group> (<year>2021</year>). <article-title>Exploring latent states of problem-solving competence using hidden markov modeling on process data</article-title>. <source>J. Comp. Assisted Learn</source>. <volume>37</volume>, <fpage>1232</fpage>&#x02013;<lpage>1247</lpage>. <pub-id pub-id-type="doi">10.1111/jcal.12559</pub-id></citation>
</ref>
<ref id="B16">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhu</surname> <given-names>M.</given-names></name> <name><surname>Feng</surname> <given-names>G.</given-names></name></person-group> (<year>2015</year>). <article-title>An exploratory study using social network analysis to model eye movements in mathematics problem solving</article-title>, in <source>LAK &#x00027;15: Proceedings of the Fifth International Conference on Learning Analytics and Knowledge</source>, <fpage>383</fpage>&#x02013;<lpage>387</lpage>. <pub-id pub-id-type="doi">10.1145/2723576.2723591</pub-id></citation>
</ref>
</ref-list> 
</back>
</article>