<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Archiving and Interchange DTD v2.3 20070202//EN" "archivearticle.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="methods-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Psychol.</journal-id>
<journal-title>Frontiers in Psychology</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Psychol.</abbrev-journal-title>
<issn pub-type="epub">1664-1078</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fpsyg.2017.01823</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Psychology</subject>
<subj-group>
<subject>Methods</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Advances in Measurement Invariance and Mean Comparison of Latent Variables: Equivalence Testing and A Projection-Based Approach</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name><surname>Jiang</surname> <given-names>Ge</given-names></name>
<uri xlink:href="http://loop.frontiersin.org/people/419102/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Mai</surname> <given-names>Yujiao</given-names></name>
<uri xlink:href="http://loop.frontiersin.org/people/480157/overview"/>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name><surname>Yuan</surname> <given-names>Ke-Hai</given-names></name>
<xref ref-type="author-notes" rid="fn001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/429898/overview"/>
</contrib>
</contrib-group>
<aff><institution>Department of Psychology, University of Notre Dame</institution>, <addr-line>Notre Dame, IN</addr-line>, <country>United States</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Oi-Man Kwok, Texas A&#x00026;M University, United States</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Mark Lai, University of Cincinnati, United States; Eun Sook Kim, University of South Florida, United States</p></fn>
<fn fn-type="corresp" id="fn001"><p>&#x0002A;Correspondence: Ke-Hai Yuan <email>kyuan&#x00040;nd.edu</email></p></fn>
<fn fn-type="other" id="fn002"><p>This article was submitted to Quantitative Psychology and Measurement, a section of the journal Frontiers in Psychology</p></fn></author-notes>
<pub-date pub-type="epub">
<day>24</day>
<month>10</month>
<year>2017</year>
</pub-date>
<pub-date pub-type="collection">
<year>2017</year>
</pub-date>
<volume>8</volume>
<elocation-id>1823</elocation-id>
<history>
<date date-type="received">
<day>02</day>
<month>08</month>
<year>2017</year>
</date>
<date date-type="accepted">
<day>02</day>
<month>10</month>
<year>2017</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2017 Jiang, Mai and Yuan.</copyright-statement>
<copyright-year>2017</copyright-year>
<copyright-holder>Jiang, Mai and Yuan</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract><p>Measurement invariance (MI) entails that measurements in different groups are comparable, and is a logical prerequisite when studying difference or change across groups. MI is commonly evaluated using multi-group structural equation modeling through a sequence of chi-square and chi-square-difference tests. However, under the conventional null hypothesis testing (NHT) one can never be confident enough to claim MI even when all test statistics are not significant. Equivalence testing (ET) has been recently proposed to replace NHT for studying MI. ET informs researchers a size of possible misspecification and allows them to claim that measurements are practically equivalent across groups if the size of misspecification is smaller than a tolerable value. Another recent advancement in studying MI is a projection-based method under which testing the cross-group equality of means of latent traits does not require the intercepts equal across groups. The purpose of this article is to introduce the key ideas of the two advancements in MI and present a newly developed R package <monospace>equaltestMI</monospace> for researchers to easily apply the two methods. A real data example is provided to illustrate the use of the package. It is advocated that researchers should always consider using the two methods whenever MI needs to be examined.</p></abstract>
<kwd-group>
<kwd>equivalence testing</kwd>
<kwd>measurement invariance</kwd>
<kwd>minimum tolerable size</kwd>
<kwd>projection method</kwd>
<kwd>scalar invariance</kwd>
</kwd-group>
<contract-num rid="cn001">SES-1461355</contract-num>
<contract-sponsor id="cn001">National Science Foundation<named-content content-type="fundref-id">10.13039/100000001</named-content></contract-sponsor>
<counts>
<fig-count count="1"/>
<table-count count="8"/>
<equation-count count="12"/>
<ref-count count="34"/>
<page-count count="13"/>
<word-count count="10036"/>
</counts>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="s1">
<title>1. Introduction</title>
<p>Reliable and valid measurements are key to social and behavioral sciences. When studying difference across groups, an equally important concept is measurement invariance (MI) or equivalence (Mellenbergh, <xref ref-type="bibr" rid="B17">1989</xref>; Meredith, <xref ref-type="bibr" rid="B18">1993</xref>; Millsap, <xref ref-type="bibr" rid="B20">2011</xref>; Kim et al., <xref ref-type="bibr" rid="B11">2012</xref>), which entails that measurements in different groups are comparable. Equivalent measurements are logical prerequisites to the evaluation of substantive hypotheses, regardless of whether the interest is as simple as a test of mean difference between groups or as complex as a test for possible changes of theoretical constructs across groups (Vandenberg and Lance, <xref ref-type="bibr" rid="B29">2000</xref>). In particular, the observed or estimated cross-group difference can be simply due to different types of attributes being measured across populations, rather than the difference in the same attribute. Then, the observed cross-group difference is not interpretable nor valid for quantifying the cross-group difference on the target attribute.</p>
<p>The most widely used approach to examine MI is multi-group structural equation modeling (SEM) which relies on a sequence of chi-square and chi-square-difference tests (S&#x000F6;rbom, <xref ref-type="bibr" rid="B26">1974</xref>; Horn et al., <xref ref-type="bibr" rid="B9">1983</xref>; Meredith, <xref ref-type="bibr" rid="B18">1993</xref>). With multi-group SEM, the test of MI typically starts with the equality of population covariance matrices across groups. Rejection of this equality does not imply that the groups are not comparable. A series of tests are then conducted to identify the source of non-equivalence (e.g., factor structure, factor loadings, etc.) and also to determine the degree of equivalence. Equality constraints are added in a logical order, and the models being tested also become increasingly more restrictive (Byrne, <xref ref-type="bibr" rid="B2">2010</xref>). Two models are connected by each set of equality constraints: a base model and a nested (constrained) model. The normal-distribution-based maximum likelihood (NML) is typically used to estimate the models, and we also have a test statistic that approximately follows a chi-square distribution. The difference between the values of the test statistic at the base and restricted models is called the chi-square-difference statistic, which is commonly used to evaluate the plausibility of the constraints. The most widely used statistic is the likelihood ratio test statistic corresponding to NML estimation, which is also what we use in this article.</p>
<p>Two major concerns exist over the multi-group SEM approach to MI. First, there is a logical issue when the conventional null hypothesis testing (NHT) is used to establish equivalence of measurements. In every step of MI tests, whenever the chi-square or chi-square-difference statistic is not significant at a given level (e.g., &#x003B1; &#x0003D; 0.05), we move to the next step of the analysis by assuming that the current model under the null hypothesis holds. However, a non-significant test statistic does not imply that the involved model is correct or the involved components are invariant across groups. This is because NHT is constructed to reject the null hypothesis, and one can never be confident enough to claim equivalence even when all the statistics are not significant. Under such a practice, any violation against the previous hypotheses will be carried over to the next test. Yuan and Chan (<xref ref-type="bibr" rid="B33">2016</xref>) contains an example in which a sequence of tests for endorsing MI yields a rather different conclusion from that of testing the equality of covariance matrices across groups. Yuan and Bentler (<xref ref-type="bibr" rid="B31">2004</xref>) also showed that nested chi-square test is unable to control type I errors when the based model is misspecified, and the power of the test can also become rather weak.</p>
<p>Second, multi-group SEM approach for MI requires the intercepts of the manifest variables to be equal across groups before the means of latent constructs can be estimated (S&#x000F6;rbom, <xref ref-type="bibr" rid="B26">1974</xref>). The cross-group equality of intercepts is commonly called <italic>scalar invariance</italic> (Horn and McArdle, <xref ref-type="bibr" rid="B8">1992</xref>). The review by Vandenberg and Lance (<xref ref-type="bibr" rid="B29">2000</xref>) indicated that scalar invariance is rarely satisfied in practice. Marsh et al. (<xref ref-type="bibr" rid="B16">2017</xref>) also noted that &#x0201C;scalar invariance is an unachievable ideal that in practice can only be approximated.&#x0201D; However, without scalar invariance, the means of the latent constructs cannot be compared under the conventional setup. Such a requirement greatly limits the use of the multi-group SEM approach to mean comparison of latent variables.</p>
<p>To address the first issue regarding the use of NHT, Yuan and Chan (<xref ref-type="bibr" rid="B33">2016</xref>) recently proposed using equivalence testing (ET) to replace NHT in multi-group SEM. In a sequence of tests for MI under ET, researchers are informed about a possible misspecification in every step, which enables them to effectively control the size of misspecification. Researchers can evaluate their results based on their own degrees of tolerance or using the adjusted cutoff values in connection with established rules of labeling the goodness of model fit in SEM. Yuan and Chan (<xref ref-type="bibr" rid="B33">2016</xref>) illustrated their approach using a simulated example with 2 groups, 9 variables, and 3 latent factors. They also provided an R program to compute the minimum tolerable size and adjusted cutoff values of fit indices for evaluating the goodness of the model under ET. However, one has to use a separate program to estimate the SEM model under different constraints before conducting ET using their R program. Thus, it is rather difficult for substantive researchers to correctly perform or interpret results at each step of the sequence of conducting the tests for MI. Also, although ET has been used in many areas of psychological and educational research, there is no self-contained software for conducting ET using chi-square and chi-square difference tests, especially for the purpose of MI. Our experience indicates that a statistical package must be in place before any new cutting-edge methodology can be applied by substantive researchers. Thus, we have developed an all-in-one R package <monospace>equaltestMI</monospace> that will be introduced in this article. Our illustration of the package with real data will also contribute to promoting ET in substantive areas where MI is routinely used in group comparison.</p>
<p>To address the second issue with the multi-group SEM approach to MI, Deng and Yuan (<xref ref-type="bibr" rid="B4">2016</xref>) proposed a new projection method to circumvent the scalar-invariance assumption by decomposing the observed means of the manifest variables into two orthogonal components. One component represents the means of the common scores and the other represents the mean of the specific factors. These two components are uniquely identified although the means of specific factors have been ignored in conventional factor analysis (Harman, <xref ref-type="bibr" rid="B6">1976</xref>; Gorsuch, <xref ref-type="bibr" rid="B5">1983</xref>). As we will see, the projection method allows us to test the cross-group equality of latent means independently from that of specific factors, and there is no need to constrain intercepts to be equal in this approach. In particular, only factor loadings are required equal across groups for conducting mean comparison of latent constructs. However, Deng and Yuan (<xref ref-type="bibr" rid="B4">2016</xref>) only presented the projection method using conventional NHT, not ET. Thus, the method still has the logical issues inherited from NHT, which will be addressed in this article by putting the projection method under ET.</p>
<p>The contributions of the current article are as follows: (1) using plain language to introduce the key ideas of ET and the projection method for examining MI; (2) combine ET and the projection method to provide valid inference on the tests of equality of latent factors and specific factors; (3) developing an accompanying R package <monospace>equaltestMI</monospace> so that substantive researchers can easily apply the two new methods as well as combining them in conducting MI analysis; and (4) providing a detailed tutorial to illustrate the use of <monospace>equaltestMI</monospace> with a real data example.</p>
<p>In the following sections, we first briefly review the types of tests in the conventional approach to MI. Then, we introduce the ET framework and the projection method. Next, we provide a step-by-step tutorial to illustrate the use of the accompanying R package <monospace>equaltestMI</monospace> with a real data example. We conclude this article with some remarks on the two new methods and the use of the R package.</p>
</sec>
<sec sec-type="methods" id="s2">
<title>2. Methods</title>
<p>This section introduces two recent methodological advancements in examining MI. By avoiding the logical problem and unrealistic assumptions with the conventional multi-group SEM approach, the new methods provide a more valid platform for studying MI. In particular, ET is proposed to replace the NHT framework and the projection method is proposed to replace the tests of mean structure under the conventional multi-group SEM as developed in S&#x000F6;rbom (<xref ref-type="bibr" rid="B26">1974</xref>). To help introduce the two new methods, we first review the models and notations used in multi-group SEM and the sequence of tests for examining MI.</p>
<sec>
<title>2.1. Multi-group SEM</title>
<p>Suppose a set of <italic>p</italic> variables are collected for each of <italic>m</italic> groups, and they are obtained by administering the same instrument or properly adjusted to be on the same scale. Let <bold>x</bold><sup>(<italic>j</italic>)</sup> represent the vector of variables in the population for group <italic>j</italic>, <italic>j</italic> &#x0003D; 1, .., <italic>m</italic>, and the following SEM model holds within each group:</p>
<disp-formula id="E1"><label>(1)</label><mml:math id="M1"><mml:mtable columnalign="left"><mml:mtr><mml:mtd><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mtext>x</mml:mtext></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup><mml:mo>=</mml:mo><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003B3;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup><mml:mo>&#x0002B;</mml:mo><mml:msup><mml:mrow><mml:mo>&#x0039B;</mml:mo></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BE;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup><mml:mo>&#x0002B;</mml:mo><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003B5;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup><mml:mo>,</mml:mo><mml:mi>j</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn><mml:mo>,</mml:mo><mml:mo>&#x022EF;</mml:mo><mml:mspace width="0.3em" class="thinspace"/><mml:mo>,</mml:mo><mml:mi>m</mml:mi><mml:mo>,</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>where the superscript (<italic>j</italic>) indicates the group membership; <bold>&#x003B3;</bold><sup>(<italic>j</italic>)</sup> is a vector of <italic>p</italic> intercepts of the manifest variables, &#x0039B;<sup>(<italic>j</italic>)</sup> is <italic>p</italic> &#x000D7; <italic>k</italic> matrix of factor loadings, <bold>&#x003BE;</bold><sup>(<italic>j</italic>)</sup> is a vector of <italic>k</italic> factor scores, and <bold>&#x003B5;</bold><sup>(<italic>j</italic>)</sup> is a vector of <italic>p</italic> errors. We assume that errors are uncorrelated and &#x003A8;<sup>(<italic>j</italic>)</sup> &#x0003D; Cov(<bold>&#x003B5;</bold><sup>(<italic>j</italic>)</sup>) is a diagonal matrix. The errors and the factors are also assumed to be uncorrelated with <italic>E</italic>(<bold>&#x003BE;</bold><sup>(<italic>j</italic>)</sup>) &#x0003D; <bold>&#x003C4;</bold><sup>(<italic>j</italic>)</sup> and Cov(<bold>&#x003BE;</bold><sup>(<italic>j</italic>)</sup>) &#x0003D; &#x003A6;<sup>(<italic>j</italic>)</sup>. It follows from Equation (1) that the model-implied mean and covariance structures for the <italic>m</italic> groups are respectively</p>
<disp-formula id="E3"><label>(2)</label><mml:math id="M3"><mml:mtable columnalign='left'><mml:mtr><mml:mtd><mml:msup><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>&#x003BC;</mml:mi></mml:mstyle><mml:mrow><mml:mo stretchy='false'>(</mml:mo><mml:mi>j</mml:mi><mml:mo stretchy='false'>)</mml:mo></mml:mrow></mml:msup><mml:mo>=</mml:mo><mml:msup><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>&#x003B3;</mml:mi></mml:mstyle><mml:mrow><mml:mo stretchy='false'>(</mml:mo><mml:mi>j</mml:mi><mml:mo stretchy='false'>)</mml:mo></mml:mrow></mml:msup><mml:mo>+</mml:mo><mml:msup><mml:mo>&#x0039B;</mml:mo><mml:mrow><mml:mo stretchy='false'>(</mml:mo><mml:mi>j</mml:mi><mml:mo stretchy='false'>)</mml:mo></mml:mrow></mml:msup><mml:msup><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>&#x003C4;</mml:mi></mml:mstyle><mml:mrow><mml:mo stretchy='false'>(</mml:mo><mml:mi>j</mml:mi><mml:mo stretchy='false'>)</mml:mo></mml:mrow></mml:msup><mml:mtext>&#x000A0;and</mml:mtext></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:msup><mml:mo>&#x003A3;</mml:mo><mml:mrow><mml:mo stretchy='false'>(</mml:mo><mml:mi>j</mml:mi><mml:mo stretchy='false'>)</mml:mo></mml:mrow></mml:msup><mml:mo>=</mml:mo><mml:msup><mml:mo>&#x0039B;</mml:mo><mml:mrow><mml:mo stretchy='false'>(</mml:mo><mml:mi>j</mml:mi><mml:mo stretchy='false'>)</mml:mo></mml:mrow></mml:msup><mml:msup><mml:mo>&#x003A6;</mml:mo><mml:mrow><mml:mo stretchy='false'>(</mml:mo><mml:mi>j</mml:mi><mml:mo stretchy='false'>)</mml:mo></mml:mrow></mml:msup><mml:mo>&#x0039B;</mml:mo><mml:msup><mml:mo>&#x02032;</mml:mo><mml:mrow><mml:mo stretchy='false'>(</mml:mo><mml:mi>j</mml:mi><mml:mo stretchy='false'>)</mml:mo></mml:mrow></mml:msup><mml:mo>+</mml:mo><mml:msup><mml:mo>&#x003A8;</mml:mo><mml:mrow><mml:mo stretchy='false'>(</mml:mo><mml:mi>j</mml:mi><mml:mo stretchy='false'>)</mml:mo></mml:mrow></mml:msup><mml:mo>,</mml:mo><mml:mi>j</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn><mml:mo>,</mml:mo><mml:mo>&#x022EF;</mml:mo><mml:mo>,</mml:mo><mml:mi>m</mml:mi><mml:mo>.</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>Note that different groups might have different structures in (2), and <bold>&#x003B3;</bold><sup>(<italic>j</italic>)</sup>, &#x0039B;<sup>(<italic>j</italic>)</sup>, <bold>&#x003C4;</bold><sup>(<italic>j</italic>)</sup>, &#x003A6;<sup>(<italic>j</italic>)</sup>, and &#x003A8;<sup>(<italic>j</italic>)</sup> are free to vary. The key point here is that the latent variables &#x003BE;<sup>(<italic>j</italic>)</sup> cannot be directly observed and must be measured with a set of manifest variables. These are standard assumptions in structural equation modeling and factor analysis, not particular to MI. With these notations, the steps of tests of MI (Vandenberg and Lance, <xref ref-type="bibr" rid="B29">2000</xref>) and their corresponding chi-square and chi-square-difference statistics are given in Table <xref ref-type="table" rid="T1">1</xref>. In the table, each subscript of the letter <italic>H</italic> represents the hypothesis for the involved parameters; and the subscripts of <italic>T</italic> represent the joint hypotheses under which the statistic is computed; while the superscript of <italic>T</italic> represents the hypothesis being tested by the nested chi-square statistic.</p>
<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption><p>Types and steps of tests with the conventional approach to measurement invariance.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th valign="top" align="left"><bold>Step</bold></th>
<th valign="top" align="center"><bold>Hypothesis</bold></th>
<th valign="top" align="center"><bold>Name</bold></th>
<th valign="top" align="center" colspan="2" style="border-bottom: thin solid #000000;"><bold>Test statistics</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td/>
<td/>
<td/>
<td valign="top" align="left"><bold>Overall model</bold></td>
<td valign="top" align="left"><bold>Nested model</bold></td>
</tr> <tr>
<td valign="top" align="left">1</td>
<td valign="top" align="left"><inline-formula><mml:math id="M4"><mml:msub><mml:mrow><mml:mi>H</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x003C3;</mml:mi></mml:mrow></mml:msub><mml:mo>:</mml:mo><mml:msup><mml:mrow><mml:mo>&#x003A3;</mml:mo></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup><mml:mo>=</mml:mo><mml:mo>&#x022EF;</mml:mo><mml:mo>=</mml:mo><mml:msup><mml:mrow><mml:mo>&#x003A3;</mml:mo></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>m</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup></mml:math></inline-formula></td>
<td/>
<td valign="top" align="left"><italic>T</italic><sub>&#x003C3;</sub></td>
<td/>
</tr>
<tr>
<td valign="top" align="left">2</td>
<td valign="top" align="left"><inline-formula><mml:math id="M5"><mml:msub><mml:mrow><mml:mi>H</mml:mi></mml:mrow><mml:mrow><mml:mi>c</mml:mi></mml:mrow></mml:msub><mml:mo>:</mml:mo><mml:msup><mml:mrow><mml:mo>&#x003A3;</mml:mo></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup><mml:mo>=</mml:mo><mml:mo>&#x003A3;</mml:mo><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003B8;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:math></inline-formula></td>
<td valign="top" align="left">configural</td>
<td valign="top" align="left"><italic>T</italic><sub><italic>c</italic></sub></td>
<td/>
</tr>
<tr>
<td valign="top" align="left">3</td>
<td valign="top" align="left"><inline-formula><mml:math id="M6"><mml:msub><mml:mrow><mml:mi>H</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x003BB;</mml:mi></mml:mrow></mml:msub><mml:mo>:</mml:mo><mml:msup><mml:mrow><mml:mo>&#x0039B;</mml:mo></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup><mml:mo>=</mml:mo><mml:mo>&#x022EF;</mml:mo><mml:mo>=</mml:mo><mml:msup><mml:mrow><mml:mo>&#x0039B;</mml:mo></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>m</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup></mml:math></inline-formula></td>
<td valign="top" align="left">metric</td>
<td valign="top" align="left"><italic>T</italic><sub><italic>c</italic>&#x003BB;</sub></td>
<td valign="top" align="left"><inline-formula><mml:math id="M7"><mml:msubsup><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>c</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x003BB;</mml:mi></mml:mrow></mml:msubsup><mml:mo>=</mml:mo><mml:msub><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>c</mml:mi><mml:mi>&#x003BB;</mml:mi></mml:mrow></mml:msub><mml:mo>-</mml:mo><mml:msub><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>c</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula></td>
</tr>
<tr>
<td valign="top" align="left">4a</td>
<td valign="top" align="left"><inline-formula><mml:math id="M8"><mml:msub><mml:mrow><mml:mi>H</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x003C8;</mml:mi></mml:mrow></mml:msub><mml:mo>:</mml:mo><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003A8;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup><mml:mo>=</mml:mo><mml:mo>&#x022EF;</mml:mo><mml:mo>=</mml:mo><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003A8;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>m</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup></mml:math></inline-formula></td>
<td/>
<td valign="top" align="left"><italic>T</italic><sub><italic>c</italic>&#x003BB;&#x003C8;</sub></td>
<td valign="top" align="left"><inline-formula><mml:math id="M9"><mml:msubsup><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>c</mml:mi><mml:mi>&#x003BB;</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x003C8;</mml:mi></mml:mrow></mml:msubsup><mml:mo>=</mml:mo><mml:msub><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>c</mml:mi><mml:mi>&#x003BB;</mml:mi><mml:mi>&#x003C8;</mml:mi></mml:mrow></mml:msub><mml:mo>-</mml:mo><mml:msub><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>c</mml:mi><mml:mi>&#x003BB;</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula></td>
</tr>
<tr>
<td valign="top" align="left">5a</td>
<td valign="top" align="left"><inline-formula><mml:math id="M10"><mml:msub><mml:mrow><mml:mi>H</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x003D5;</mml:mi></mml:mrow></mml:msub><mml:mo>:</mml:mo><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003A6;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup><mml:mo>=</mml:mo><mml:mo>&#x022EF;</mml:mo><mml:mo>=</mml:mo><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003A6;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>m</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup></mml:math></inline-formula></td>
<td/>
<td valign="top" align="left"><italic>T</italic><sub><italic>c</italic>&#x003BB;&#x003C8;&#x003D5;</sub></td>
<td valign="top" align="left"><inline-formula><mml:math id="M11"><mml:msubsup><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>c</mml:mi><mml:mi>&#x003BB;</mml:mi><mml:mi>&#x003C8;</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x003D5;</mml:mi></mml:mrow></mml:msubsup><mml:mo>=</mml:mo><mml:msub><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>c</mml:mi><mml:mi>&#x003BB;</mml:mi><mml:mi>&#x003C8;</mml:mi><mml:mi>&#x003D5;</mml:mi></mml:mrow></mml:msub><mml:mo>-</mml:mo><mml:msub><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>c</mml:mi><mml:mi>&#x003BB;</mml:mi><mml:mi>&#x003C8;</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula></td>
</tr>
<tr>
<td valign="top" align="left">4b</td>
<td valign="top" align="left"><inline-formula><mml:math id="M12"><mml:msub><mml:mrow><mml:mi>H</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x003B3;</mml:mi></mml:mrow></mml:msub><mml:mo>:</mml:mo><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003B3;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup><mml:mo>=</mml:mo><mml:mo>&#x022EF;</mml:mo><mml:mo>=</mml:mo><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003B3;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>m</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup></mml:math></inline-formula></td>
<td valign="top" align="left">scalar</td>
<td valign="top" align="left"><italic>T</italic><sub><italic>c</italic>&#x003BB;&#x003B3;</sub></td>
<td valign="top" align="left"><inline-formula><mml:math id="M13"><mml:msubsup><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>c</mml:mi><mml:mi>&#x003BB;</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x003B3;</mml:mi></mml:mrow></mml:msubsup><mml:mo>=</mml:mo><mml:msub><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>c</mml:mi><mml:mi>&#x003BB;</mml:mi><mml:mi>&#x003B3;</mml:mi></mml:mrow></mml:msub><mml:mo>-</mml:mo><mml:msub><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>c</mml:mi><mml:mi>&#x003BB;</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula></td>
</tr>
<tr>
<td valign="top" align="left">5b</td>
<td valign="top" align="left"><inline-formula><mml:math id="M14"><mml:msub><mml:mrow><mml:mi>H</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x003C4;</mml:mi></mml:mrow></mml:msub><mml:mo>:</mml:mo><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003C4;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup><mml:mo>=</mml:mo><mml:mo>&#x022EF;</mml:mo><mml:mo>=</mml:mo><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003C4;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>m</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup></mml:math></inline-formula></td>
<td/>
<td valign="top" align="left"><italic>T</italic><sub><italic>c</italic>&#x003BB;&#x003B3;&#x003C4;</sub></td>
<td valign="top" align="left"><inline-formula><mml:math id="M15"><mml:msubsup><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>c</mml:mi><mml:mi>&#x003BB;</mml:mi><mml:mi>&#x003B3;</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x003C4;</mml:mi></mml:mrow></mml:msubsup><mml:mo>=</mml:mo><mml:msub><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>c</mml:mi><mml:mi>&#x003BB;</mml:mi><mml:mi>&#x003B3;</mml:mi><mml:mi>&#x003C4;</mml:mi></mml:mrow></mml:msub><mml:mo>-</mml:mo><mml:msub><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>c</mml:mi><mml:mi>&#x003BB;</mml:mi><mml:mi>&#x003B3;</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula></td>
</tr>
<tr>
<td valign="top" align="left">4c</td>
<td valign="top" align="left"><inline-formula><mml:math id="M16"><mml:msub><mml:mrow><mml:mi>H</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x003B3;</mml:mi></mml:mrow></mml:msub><mml:mo>:</mml:mo><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003B3;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup><mml:mo>=</mml:mo><mml:mo>&#x022EF;</mml:mo><mml:mo>=</mml:mo><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003B3;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>m</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup></mml:math></inline-formula></td>
<td valign="top" align="left">scalar</td>
<td valign="top" align="left"><italic>T</italic><sub><italic>c</italic>&#x003BB;&#x003B3;</sub></td>
<td valign="top" align="left"><inline-formula><mml:math id="M17"><mml:msubsup><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>c</mml:mi><mml:mi>&#x003BB;</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x003B3;</mml:mi></mml:mrow></mml:msubsup><mml:mo>=</mml:mo><mml:msub><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>c</mml:mi><mml:mi>&#x003BB;</mml:mi><mml:mi>&#x003B3;</mml:mi></mml:mrow></mml:msub><mml:mo>-</mml:mo><mml:msub><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>c</mml:mi><mml:mi>&#x003BB;</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula></td>
</tr>
<tr>
<td valign="top" align="left">5c</td>
<td valign="top" align="left"><inline-formula><mml:math id="M18"><mml:msub><mml:mrow><mml:mi>H</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x003C8;</mml:mi></mml:mrow></mml:msub><mml:mo>:</mml:mo><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003A8;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup><mml:mo>=</mml:mo><mml:mo>&#x022EF;</mml:mo><mml:mo>=</mml:mo><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003A8;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>m</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup></mml:math></inline-formula></td>
<td/>
<td valign="top" align="left"><italic>T</italic><sub><italic>c</italic>&#x003BB;&#x003B3;&#x003C8;</sub></td>
<td valign="top" align="left"><inline-formula><mml:math id="M19"><mml:msubsup><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>c</mml:mi><mml:mi>&#x003BB;</mml:mi><mml:mi>&#x003B3;</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x003C8;</mml:mi></mml:mrow></mml:msubsup><mml:mo>=</mml:mo><mml:msub><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>c</mml:mi><mml:mi>&#x003BB;</mml:mi><mml:mi>&#x003B3;</mml:mi><mml:mi>&#x003C8;</mml:mi></mml:mrow></mml:msub><mml:mo>-</mml:mo><mml:msub><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>c</mml:mi><mml:mi>&#x003BB;</mml:mi><mml:mi>&#x003B3;</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula></td>
</tr>
<tr>
<td valign="top" align="left">6c</td>
<td valign="top" align="left"><inline-formula><mml:math id="M20"><mml:msub><mml:mrow><mml:mi>H</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x003C4;</mml:mi></mml:mrow></mml:msub><mml:mo>:</mml:mo><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003C4;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup><mml:mo>=</mml:mo><mml:mo>&#x022EF;</mml:mo><mml:mo>=</mml:mo><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003C4;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>m</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup></mml:math></inline-formula></td>
<td/>
<td valign="top" align="left"><italic>T</italic><sub><italic>c</italic>&#x003BB;&#x003B3;&#x003C8;&#x003C4;</sub></td>
<td valign="top" align="left"><inline-formula><mml:math id="M21"><mml:msubsup><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>c</mml:mi><mml:mi>&#x003BB;</mml:mi><mml:mi>&#x003B3;</mml:mi><mml:mi>&#x003C8;</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x003C4;</mml:mi></mml:mrow></mml:msubsup><mml:mo>=</mml:mo><mml:msub><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>c</mml:mi><mml:mi>&#x003BB;</mml:mi><mml:mi>&#x003B3;</mml:mi><mml:mi>&#x003C8;</mml:mi><mml:mi>&#x003C4;</mml:mi></mml:mrow></mml:msub><mml:mo>-</mml:mo><mml:msub><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>c</mml:mi><mml:mi>&#x003BB;</mml:mi><mml:mi>&#x003B3;</mml:mi><mml:mi>&#x003C8;</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula></td>
</tr>
</tbody>
</table>
</table-wrap>
<p>Following the work of S&#x000F6;rbom (<xref ref-type="bibr" rid="B26">1974</xref>) and J&#x000F6;reskog (<xref ref-type="bibr" rid="B10">1971</xref>), the tests of MI usually start with a test of equality of the population covariance matrices. Statistically speaking, the first step tests <inline-formula><mml:math id="M22"><mml:msub><mml:mrow><mml:mi>H</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x003C3;</mml:mi></mml:mrow></mml:msub><mml:mo>:</mml:mo><mml:msup><mml:mrow><mml:mo>&#x003A3;</mml:mo></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup><mml:mo>=</mml:mo><mml:mo>&#x022EF;</mml:mo><mml:mo>=</mml:mo><mml:msup><mml:mrow><mml:mo>&#x003A3;</mml:mo></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>m</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup></mml:math></inline-formula>, where &#x003A3;<sup>(<italic>j</italic>)</sup> is the population covariance matrix of group <italic>j</italic>. A non-significant statistic of this test is generally regarded as an endorsement of overall measurement equivalence. However, a significant test statistic does not mean that the involved groups are not comparable and it is necessary to conduct subsequent tests to identify the sources of non-equivalence. To test if any aspects of the groups are invariant, a common SEM model is assumed and the equalities of its components across groups are tested in an increasingly restrictive fashion. In step 2, the SEM model is fitted to each group separately and one examines if the same model structure holds across groups (configural invariance). We denote configural invariance as <inline-formula><mml:math id="M23"><mml:msub><mml:mrow><mml:mi>H</mml:mi></mml:mrow><mml:mrow><mml:mi>c</mml:mi></mml:mrow></mml:msub><mml:mo>:</mml:mo><mml:msup><mml:mrow><mml:mo>&#x003A3;</mml:mo></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup><mml:mo>=</mml:mo><mml:mo>&#x003A3;</mml:mo><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003B8;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:math></inline-formula>, <italic>j</italic> &#x0003D; 1, &#x022EF;&#x000A0;, <italic>m</italic>, implying that the same structured model &#x003A3;(<bold>&#x003B8;</bold><sup>(<italic>j</italic>)</sup>) holds in all the groups but their parameters <bold>&#x003B8;</bold><sup>(<italic>j</italic>)</sup> can differ across groups. If <italic>H</italic><sub><italic>c</italic></sub> holds, configural invariance is established, and one tests the equality of factor loading matrices (metric invariance) in step 3. We denote metric invariance as <inline-formula><mml:math id="M24"><mml:msub><mml:mrow><mml:mi>H</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x003BB;</mml:mi></mml:mrow></mml:msub><mml:mo>:</mml:mo><mml:msup><mml:mrow><mml:mo>&#x0039B;</mml:mo></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup><mml:mo>=</mml:mo><mml:mo>&#x022EF;</mml:mo><mml:mo>=</mml:mo><mml:msup><mml:mrow><mml:mo>&#x0039B;</mml:mo></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>m</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup></mml:math></inline-formula>, implying that the factor loadings are invariant across all the groups. After both configural (<italic>H</italic><sub><italic>c</italic></sub>) and metric invariances (<italic>H</italic><sub>&#x003BB;</sub>) are established, one next separately tests the equalities in covariance structure and mean structure. For the covariance structure, one first tests the equality of error variances &#x003A8;<sup>(<italic>j</italic>)</sup> across groups; and if that holds, one then tests the equality of factor covariance matrices &#x003A6;<sup>(<italic>j</italic>)</sup> across groups.</p>
<p>For the mean structure, two types of invariance have been conceptualized (Meredith, <xref ref-type="bibr" rid="B18">1993</xref>; Vandenberg and Lance, <xref ref-type="bibr" rid="B29">2000</xref>). Measurements satisfying Steps 2, 3, and 4b are called <italic>strong invariance</italic> (Meredith, <xref ref-type="bibr" rid="B18">1993</xref>), while those satisfying Steps 2, 3, 4c, and 5c are called <italic>strict invariance</italic>. For either of the invariances, the equality of intercepts of manifest variables (scalar invariance, <italic>H</italic><sub>&#x003B3;</sub>) is tested first. If scalar invariance holds, strong invariance is achieved, and one continues to test the equality of latent means (<italic>H</italic><sub>&#x003C4;</sub>). To achieve strict invariance, one needs to test the equality of error variances &#x003A8;<sup>(<italic>j</italic>)</sup> after scalar invariance and then tests the equality of latent means. In summary, the steps to examine MI of covariance structure is 1 &#x02192; 2 &#x02192; 3 &#x02192; 4<italic>a</italic> &#x02192; 5<italic>a</italic>, the sequence for testing mean structure and achieving strong invariance is 1 &#x02192; 2 &#x02192; 3 &#x02192; 4<italic>b</italic>, and the sequence for achieving strict invariance is 1 &#x02192; 2 &#x02192; 3 &#x02192; 4<italic>c</italic> &#x02192; 5<italic>c</italic>. Step 5b or 6c might not be needed if the interest of the MI analysis is to compare individuals. But the test of <italic>H</italic><sub>&#x003C4;</sub> will be the ultimate goal if the interest is to compare groups, as in ANOVA or <italic>t</italic>-test.</p>
<p>To test the hypotheses mentioned above, chi-square and chi-square-difference statistics are computed in the last two columns of Table <xref ref-type="table" rid="T1">1</xref> with the superscripts and subscripts denoting the involved hypotheses. In any of the three sequences above, a model with more constraints is nested in a model with fewer constraints and the additional constraints can be tested using the chi-square-difference statistic. For example, the statistic <italic>T</italic><sub><italic>c</italic>&#x003BB;&#x003B3;</sub> in step 4b of Table <xref ref-type="table" rid="T1">1</xref> evaluates the joint hypothesis <italic>H</italic><sub><italic>c</italic>&#x003BB;&#x003B3;</sub> &#x0003D; <italic>H</italic><sub><italic>c</italic></sub> &#x0002B; <italic>H</italic><sub>&#x003BB;</sub> &#x0002B; <italic>H</italic><sub>&#x003B3;</sub>, and the model under <italic>H</italic><sub><italic>c</italic>&#x003BB;&#x003B3;</sub> is nested in the model under <italic>H</italic><sub><italic>c</italic>&#x003BB;</sub>. The corresponding chi-square-difference statistic <inline-formula><mml:math id="M25"><mml:msubsup><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>c</mml:mi><mml:mi>&#x003BB;</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x003B3;</mml:mi></mml:mrow></mml:msubsup></mml:math></inline-formula> evaluates the additional constraints under <italic>H</italic><sub>&#x003B3;</sub>, and it is computed as the difference between <italic>T</italic><sub><italic>c</italic>&#x003BB;&#x003B3;</sub> and <italic>T</italic><sub><italic>c</italic>&#x003BB;</sub>, i.e., <inline-formula><mml:math id="M26"><mml:msubsup><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>c</mml:mi><mml:mi>&#x003BB;</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x003B3;</mml:mi></mml:mrow></mml:msubsup><mml:mo>=</mml:mo><mml:msub><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>c</mml:mi><mml:mi>&#x003BB;</mml:mi><mml:mi>&#x003B3;</mml:mi></mml:mrow></mml:msub><mml:mo>-</mml:mo><mml:msub><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>c</mml:mi><mml:mi>&#x003BB;</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula>.</p>
</sec>
<sec>
<title>2.2. Equivalence testing</title>
<p>ET was proposed to address the logical issues with NHT to establish equivalence of measures across groups (Yuan and Chan, <xref ref-type="bibr" rid="B33">2016</xref>). A major distinction between ET and NHT is the formulation of null hypothesis. The null hypothesis under NHT is that the model or constraints hold in the population, whereas the null hypothesis under ET is that the size of misspecification in the model or constraints is greater than a tolerable value. When the null hypothesis is rejected under ET at level &#x003B1;, we are confident with probability 1 &#x02212; &#x003B1; that the size of misspecification is less than or equal to the tolerable value. Consequently, the current model or components are deemed<xref ref-type="fn" rid="fn0001"><sup>1</sup></xref> as MI, and we continue with testing the subsequent hypothesis. Otherwise, we declare that the size of misspecification in the current model or hypothesis is not tolerable and stop at the previous level of equivalence. We will further discuss the specification of tolerable values using the fit index RMSEA (root mean square error of approximation, Steiger and Lind, <xref ref-type="bibr" rid="B28">1980</xref>).</p>
<p>As with NHT, we need to have a statistic to work with under ET. In this article, we use the likelihood ratio statistic <italic>T</italic><sub><italic>ml</italic></sub> &#x0003D; (<italic>N</italic> &#x02212; <italic>m</italic>)<italic>F</italic><sub><italic>ml</italic></sub>, where <italic>N</italic> is the total sample size across the <italic>m</italic> groups and <italic>F</italic><sub><italic>ml</italic></sub> is the normal-distribution-based discrepancy function proportionally weighted according to the sample sizes in the <italic>m</italic> groups (e.g., Equations 23 and 4 in Yuan and Bentler, <xref ref-type="bibr" rid="B32">2006</xref>). Let <italic>F</italic><sub><italic>ml</italic>0</sub> be the population counterpart of <italic>F</italic><sub><italic>ml</italic></sub>, the null hypothesis under NHT is <italic>H</italic><sub>0</sub>:<italic>F</italic><sub><italic>ml</italic>0</sub> &#x0003D; 0 whereas that under ET is</p>
<disp-formula id="E4"><label>(3)</label><mml:math id="M27"><mml:mtable columnalign="left"><mml:mtr><mml:mtd><mml:msub><mml:mrow><mml:mi>H</mml:mi></mml:mrow><mml:mrow><mml:mi>e</mml:mi><mml:mn>0</mml:mn></mml:mrow></mml:msub><mml:mo>:</mml:mo><mml:msub><mml:mrow><mml:mi>F</mml:mi></mml:mrow><mml:mrow><mml:mi>m</mml:mi><mml:mi>l</mml:mi><mml:mn>0</mml:mn></mml:mrow></mml:msub><mml:mo>&#x0003E;</mml:mo><mml:msub><mml:mrow><mml:mi>&#x003F5;</mml:mi></mml:mrow><mml:mrow><mml:mn>0</mml:mn></mml:mrow></mml:msub></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>with &#x003F5;<sub>0</sub> being a small positive number that one can tolerate for the size of misspecification. As for NHT, we need to assume that <italic>T</italic><sub><italic>ml</italic></sub> follows a central chi-square distribution <inline-formula><mml:math id="M28"><mml:msubsup><mml:mrow><mml:mi>&#x003C7;</mml:mi></mml:mrow><mml:mrow><mml:mi>d</mml:mi><mml:mi>f</mml:mi></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup></mml:math></inline-formula> when <italic>F</italic><sub><italic>ml</italic>0</sub> &#x0003D; 0 and a non-central chi-square distribution <inline-formula><mml:math id="M29"><mml:msubsup><mml:mrow><mml:mi>&#x003C7;</mml:mi></mml:mrow><mml:mrow><mml:mi>d</mml:mi><mml:mi>f</mml:mi></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>&#x003B4;</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:math></inline-formula> when <italic>F</italic><sub><italic>ml</italic>0</sub> &#x0003E; 0, where &#x003B4; &#x0003D; (<italic>N</italic> &#x02212; <italic>m</italic>)<italic>F</italic><sub><italic>ml</italic>0</sub> is the non-centrality parameter (ncp). Let &#x003B4;<sub>0</sub> &#x0003D; (<italic>N</italic> &#x02212; <italic>m</italic>)&#x003F5;<sub>0</sub> and <italic>c</italic><sub>&#x003B1;</sub>(&#x003B4;<sub>0</sub>) be the left-tail critical value of <inline-formula><mml:math id="M30"><mml:msubsup><mml:mrow><mml:mi>&#x003C7;</mml:mi></mml:mrow><mml:mrow><mml:mi>d</mml:mi><mml:mi>f</mml:mi></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msub><mml:mrow><mml:mi>&#x003B4;</mml:mi></mml:mrow><mml:mrow><mml:mn>0</mml:mn></mml:mrow></mml:msub></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:math></inline-formula> at level &#x003B1;. Then we reject the null hypothesis <italic>H</italic><sub><italic>e</italic>0</sub> in (3) when <italic>T</italic><sub><italic>ml</italic></sub> &#x0003C; <italic>c</italic><sub>&#x003B1;</sub>(&#x003B4;<sub>0</sub>) and the type I error is controlled at level &#x003B1;. When the <italic>H</italic><sub><italic>e</italic>0</sub> in (3) is rejected, we conclude that the size of misspecification of the current model is no greater than &#x003F5;<sub>0</sub> with 1 &#x02212; &#x003B1; confidence.</p>
<p>Similarly, when the chi-square-difference statistic is formulated according to <italic>T</italic><sub><italic>ml</italic></sub>, and our null hypothesis under ET is</p>
<disp-formula id="E5"><label>(4)</label><mml:math id="M31"><mml:mtable columnalign="left"><mml:mtr><mml:mtd><mml:msub><mml:mrow><mml:mi>H</mml:mi></mml:mrow><mml:mrow><mml:mi>e</mml:mi><mml:mi>a</mml:mi><mml:mi>b</mml:mi></mml:mrow></mml:msub><mml:mo>:</mml:mo><mml:msub><mml:mrow><mml:mi>F</mml:mi></mml:mrow><mml:mrow><mml:mi>m</mml:mi><mml:mi>l</mml:mi><mml:mi>a</mml:mi><mml:mn>0</mml:mn></mml:mrow></mml:msub><mml:mo>-</mml:mo><mml:msub><mml:mrow><mml:mi>F</mml:mi></mml:mrow><mml:mrow><mml:mi>m</mml:mi><mml:mi>l</mml:mi><mml:mi>b</mml:mi><mml:mn>0</mml:mn></mml:mrow></mml:msub><mml:mo>&#x0003E;</mml:mo><mml:msub><mml:mrow><mml:mi>&#x003F5;</mml:mi></mml:mrow><mml:mrow><mml:mn>0</mml:mn><mml:mi>a</mml:mi><mml:mi>b</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>where &#x003F5;<sub>0<italic>ab</italic></sub> is a tolerable value of misspecification due to the additional constraints in model <italic>A</italic> beyond that in the based model <italic>B</italic>. When the difference statistic is smaller than the left-tail critical value corresponding to <inline-formula><mml:math id="M32"><mml:msubsup><mml:mrow><mml:mi>&#x003C7;</mml:mi></mml:mrow><mml:mrow><mml:mi>d</mml:mi><mml:mi>f</mml:mi><mml:mi>a</mml:mi><mml:mi>b</mml:mi></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msub><mml:mrow><mml:mi>&#x003B4;</mml:mi></mml:mrow><mml:mrow><mml:mn>0</mml:mn><mml:mi>a</mml:mi><mml:mi>b</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:math></inline-formula> with &#x003B4;<sub>0<italic>ab</italic></sub> &#x0003D; (<italic>N</italic> &#x02212; <italic>m</italic>)&#x003F5;<sub>0<italic>ab</italic></sub>, we reject <italic>H</italic><sub><italic>eab</italic></sub> and conclude with probability 1 &#x02212; &#x003B1; that the size of misspecification due to the additional constraints in model <italic>A</italic> (beyond that in model <italic>B</italic>) is smaller than the tolerable value or is tolerable.</p>
<p>The specification of a tolerable value &#x003F5;<sub>0</sub> is crucial for ET. Although any choice of &#x003F5;<sub>0</sub> cannot avoid an arbitrary nature, it is a necessary element for conducting ET. Following Yuan and Chan (<xref ref-type="bibr" rid="B33">2016</xref>), we specify &#x003F5;<sub>0</sub> by relating it to the population value of the fit index RMSEA through</p>
<disp-formula id="E6"><label>(5)</label><mml:math id="M33"><mml:mtable columnalign="left"><mml:mtr><mml:mtd><mml:msub><mml:mrow><mml:mi>&#x003F5;</mml:mi></mml:mrow><mml:mrow><mml:mn>0</mml:mn></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:mi>d</mml:mi><mml:mi>f</mml:mi><mml:msup><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msub><mml:mrow><mml:mtext>RMSEA</mml:mtext></mml:mrow><mml:mrow><mml:mn>0</mml:mn></mml:mrow></mml:msub></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msup><mml:mo>/</mml:mo><mml:mi>m</mml:mi><mml:mo>,</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>where <inline-formula><mml:math id="M34"><mml:msub><mml:mrow><mml:mtext>RMSEA</mml:mtext></mml:mrow><mml:mrow><mml:mn>0</mml:mn></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:msup><mml:mrow><mml:mrow><mml:mo>{</mml:mo><mml:mrow><mml:mi>m</mml:mi><mml:msub><mml:mrow><mml:mi>&#x003B4;</mml:mi></mml:mrow><mml:mrow><mml:mn>0</mml:mn></mml:mrow></mml:msub><mml:mo>/</mml:mo><mml:mrow><mml:mo>[</mml:mo><mml:mrow><mml:mi>d</mml:mi><mml:mi>f</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>N</mml:mi><mml:mo>-</mml:mo><mml:mi>m</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow><mml:mo>]</mml:mo></mml:mrow></mml:mrow><mml:mo>}</mml:mo></mml:mrow></mml:mrow><mml:mrow><mml:mn>1</mml:mn><mml:mo>/</mml:mo><mml:mn>2</mml:mn></mml:mrow></mml:msup></mml:math></inline-formula> with &#x003B4;<sub>0</sub> being the ncp of the nominal chi-square distribution corresponding to the statistic <italic>T</italic><sub><italic>ml</italic></sub> with <italic>m</italic> groups (Steiger, <xref ref-type="bibr" rid="B27">1998</xref>). With respect to the use of the conventional<xref ref-type="fn" rid="fn0002"><sup>2</sup></xref> RMSEA, MacCallum et al. (<xref ref-type="bibr" rid="B14">1996</xref>) suggested cutoff<xref ref-type="fn" rid="fn0003"><sup>3</sup></xref> values 0.01, 0.05, 0.008, and 0.10 to distinguish between excellent, close, fair, mediocre, and poor fit, respectively. As can be seen from Equation (5), when other terms are held constant, the larger the value of &#x003F5;<sub>0</sub>, the larger the RMSEA<sub>0</sub> is. This means that for a given model, a larger tolerable value of misspecification &#x003F5;<sub>0</sub> implies that we allow for a less ideal model as quantified by RMSEA<sub>0</sub>. There are two ways to use the relationship in Equation (5) to evaluate the fit of the current model. One can obtain the values of &#x003F5;<sub>0</sub> corresponding to RMSEA<sub>0</sub> &#x0003D; 0.01, 0.05, 0.08, and 0.10, respectively, and compare <italic>T</italic><sub><italic>ml</italic></sub> against the critical values <italic>c</italic><sub>&#x003B1;</sub>(&#x003F5;<sub>0</sub>) with those &#x003F5;<sub>0</sub> values. If <italic>T</italic><sub><italic>ml</italic></sub> is between the critical values corresponding to RMSEA<sub>0</sub> &#x0003D; 0.01 and 0.05, then the model achieves a close fit for the observed samples.</p>
<p>Alternatively, we can solve the equation</p>
<disp-formula id="E7"><label>(6)</label><mml:math id="M35"><mml:mtable columnalign="left"><mml:mtr><mml:mtd><mml:msub><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>m</mml:mi><mml:mi>l</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:msub><mml:mrow><mml:mi>c</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x003B1;</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msub><mml:mrow><mml:mi>&#x003F5;</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mo>.</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>for the value of &#x003F5;<sub><italic>t</italic></sub>, which is an increasing function of <italic>T</italic><sub><italic>ml</italic></sub>. Unlike the &#x003F5;<sub>0</sub> in Equation (3) or (5) that is specified a priori, the &#x003F5;<sub><italic>t</italic></sub> in (6) is data dependent. However, rejection of the hypothesis in (3) is equivalent to &#x003F5;<sub><italic>t</italic></sub> &#x0003C; &#x003F5;<sub>0</sub>. Yuan and Chan (<xref ref-type="bibr" rid="B33">2016</xref>) called the &#x003F5;<sub><italic>t</italic></sub> in (6) <italic>the minimum tolerable size</italic> (T-size) of misspecification. If one cannot tolerate the T-size &#x003F5;<sub><italic>t</italic></sub>, then hypothesis with any prespecified &#x003F5;<sub>0</sub> that is less than &#x003F5;<sub><italic>t</italic></sub> cannot be rejected since <italic>T</italic><sub><italic>ml</italic></sub> &#x0003E; <italic>c</italic><sub>&#x003B1;</sub>(&#x003F5;<sub>0</sub>), and we will not be able to continue with the analysis in the sequence of endorsing MI. Let RMSEA<sub><italic>t</italic></sub> be the value of RMSEA defined at &#x003F5;<sub><italic>t</italic></sub>. ET can be equivalently conducted using the established cutoff values of RMSEA and the values of RMSEA<sub><italic>t</italic></sub> corresponding to the &#x003F5;<sub><italic>t</italic></sub> in (6). We will illustrate this procedure in a later section via a real data example.</p>
<p>Compared with the conventional methods, ET informs us the size of a possible misspecification at each step of endorsing MI, and it is still up to the researcher to decide whether the size is tolerable. Established values of RMSEA facilitate us to make a decision on the size of misspecification according to the values of RMSEA<sub><italic>t</italic></sub>. However, the conventional cutoff values of RMSEA are too stringent to evaluate the model fit under ET, and the cutoff values need to be modified accordingly. Yuan and Chan (<xref ref-type="bibr" rid="B33">2016</xref>) developed formulas of adjusted cutoff values for evaluating RMSEA<sub><italic>t</italic></sub> so that labeling of goodness of fit is comparable to evaluating the conventional RMSEA by existing cutoff values. These formulas are incorporated in our R package and new cutoffs will be used in the real data example. Technical details and formulas can be found in Yuan and Chan (<xref ref-type="bibr" rid="B33">2016</xref>).</p>
</sec>
<sec>
<title>2.3. Projection method</title>
<p>One major goal of MI is to test the cross-group equality of means of latent traits, especially when our interest is to study the effect of different experimental conditions or group difference. However, with the conventional approach, the test of <italic>H</italic><sub>&#x003C4;</sub> in Table <xref ref-type="table" rid="T1">1</xref> or even the estimation of <bold>&#x003C4;</bold> requires the hypothesis <italic>H</italic><sub>&#x003B3;</sub> to hold, which is theoretically unnecessary and practically hard to achieve. In this subsection, we introduce a new setup proposed in Deng and Yuan (<xref ref-type="bibr" rid="B4">2016</xref>) under which the means of the latent traits can be compared even when the intercepts of manifest variables are not equal across groups. A projection method is used so that the means of manifest variables in each group are decomposed into orthogonal components of common scores and specific factors. The test of cross-group equality of the means of the common scores is essentially the test of cross-group equality of means of latent traits under the conventional setup whereas the test of cross-group equality of means of specific factors is related to but different from the test of cross-group equality of the intercepts under the conventional setup.</p>
<p>In the conventional setup of examining MI via Equation (1), the mean structure involves the intercepts and the means of the latent traits. The intercepts <bold>&#x003B3;</bold><sup>(<italic>j</italic>)</sup> need to be set as equal across groups so that the means <bold>&#x003C4;</bold><sup>(<italic>j</italic>)</sup> &#x0003D; <italic>E</italic>(<bold>&#x003BE;</bold><sup>(<italic>j</italic>)</sup>) can be identified and estimated (S&#x000F6;rbom, <xref ref-type="bibr" rid="B26">1974</xref>). Similarly, the means <bold>&#x003C4;</bold><sup>(<italic>j</italic>)</sup> of one group need to be set at <bold>0</bold> as the baseline so that the <bold>&#x003C4;</bold><sup>(<italic>j</italic>)</sup> of the other groups are the differences from those of the baseline group. To circumvent this assumption, Deng and Yuan (<xref ref-type="bibr" rid="B4">2016</xref>) proposed to decompose the observed variables into common scores, specific factors, and measurement errors</p>
<disp-formula id="E8"><label>(7)</label><mml:math id="M36"><mml:mtable columnalign="left"><mml:mtr><mml:mtd><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mtext>x</mml:mtext></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup><mml:mo>=</mml:mo><mml:mo>&#x0039B;</mml:mo><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mtext>f</mml:mtext></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup><mml:mo>&#x0002B;</mml:mo><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mtext>u</mml:mtext></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup><mml:mo>&#x0002B;</mml:mo><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mtext>e</mml:mtext></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup><mml:mo>,</mml:mo><mml:mi>j</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn><mml:mo>,</mml:mo><mml:mo>&#x022EF;</mml:mo><mml:mspace width="0.3em" class="thinspace"/><mml:mo>,</mml:mo><mml:mi>m</mml:mi><mml:mo>,</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>where &#x0039B;<bold>f</bold><sup>(<italic>j</italic>)</sup> represents the vector of <italic>p</italic> common scores, <bold>u</bold><sup>(<italic>j</italic>)</sup> represents the vector of <italic>p</italic> specific factors, and <bold>e</bold><sup>(<italic>j</italic>)</sup> is a vector of <italic>p</italic> measurement errors, with <italic>E</italic>[<bold>f</bold><sup>(<italic>j</italic>)</sup>] &#x0003D; <bold>&#x003BA;</bold><sup>(<italic>j</italic>)</sup>, <italic>E</italic>[<bold>u</bold><sup>(<italic>j</italic>)</sup>] &#x0003D; <bold>&#x003BD;</bold><sup>(<italic>j</italic>)</sup>, and <italic>E</italic>[<bold>e</bold><sup>(<italic>j</italic>)</sup>] &#x0003D; <bold>0</bold>. There is no superscript on the factor loading matrix &#x0039B; because the decomposition in Equation (7) is a step following metric invariance <inline-formula><mml:math id="M37"><mml:msub><mml:mrow><mml:mi>H</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x003BB;</mml:mi></mml:mrow></mml:msub><mml:mo>:</mml:mo><mml:msup><mml:mrow><mml:mstyle><mml:mo>&#x0039B;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup><mml:mo>=</mml:mo><mml:mo>&#x022EF;</mml:mo><mml:mo>=</mml:mo><mml:msup><mml:mrow><mml:mstyle><mml:mo>&#x0039B;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>m</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup><mml:mo>=</mml:mo><mml:mstyle><mml:mo>&#x0039B;</mml:mo></mml:mstyle></mml:math></inline-formula>. When metric invariance does not hold, researchers have the option to identify a subset of variables that satisfy metric invariance (Byrne et al., <xref ref-type="bibr" rid="B3">1989</xref>; Millsap and Kwok, <xref ref-type="bibr" rid="B19">2004</xref>). Then the projection method can be equally applied to the identified subset, as was discussed in Deng and Yuan (<xref ref-type="bibr" rid="B4">2016</xref>).</p>
<p>Note that the new setup in Equation (7) is not a simple reparameterization of the conventional setup in Equation (1). In fact, the interpretation has changed entirely. With the projection method, we assume that the space of common score is orthogonal to that of specific factors, and the comparison of means of the common scores or factors <bold>f</bold><sup>(<italic>j</italic>)</sup> is conducted independently from those of <bold>u</bold><sup>(<italic>j</italic>)</sup>. Under the new setup, the mean structure of <bold>x</bold><sup>(<italic>j</italic>)</sup> is decomposed as</p>
<disp-formula id="E9"><label>(8)</label><mml:math id="M38"><mml:mtable columnalign="left"><mml:mtr><mml:mtd><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BC;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup><mml:mo>=</mml:mo><mml:msubsup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BC;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mi>&#x003BA;</mml:mi></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msubsup><mml:mo>&#x0002B;</mml:mo><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BD;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup><mml:mo>,</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>where <inline-formula><mml:math id="M39"><mml:msubsup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BC;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mi>&#x003BA;</mml:mi></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msubsup><mml:mo>=</mml:mo><mml:mo>&#x0039B;</mml:mo><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BA;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup></mml:math></inline-formula> is the part of <bold>&#x003BC;</bold><sup>(<italic>j</italic>)</sup> &#x0003D; <italic>E</italic>(<bold>x</bold><sup>(<italic>j</italic>)</sup>) that is projected onto the space of common scores, and <bold>&#x003BD;</bold><sup>(<italic>j</italic>)</sup> is the part of <bold>&#x003BC;</bold><sup>(<italic>j</italic>)</sup> that is projected onto the space of specific factors. The two components are identified once &#x0039B; is identified. Regardless of the values of <bold>&#x003BA;</bold><sup>(<italic>j</italic>)</sup>, <inline-formula><mml:math id="M40"><mml:msubsup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BC;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mi>&#x003BA;</mml:mi></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msubsup></mml:math></inline-formula> is always the linear combinations of the columns of &#x0039B;.</p>
<p>Let <inline-formula><mml:math id="M41"><mml:mover accent="true"><mml:mrow><mml:mo>&#x0039B;</mml:mo></mml:mrow><mml:mo>^</mml:mo></mml:mover></mml:math></inline-formula> be the estimated factor loading matrix and <inline-formula><mml:math id="M42"><mml:msup><mml:mrow><mml:mover accent="true"><mml:mrow><mml:mstyle mathvariant="bold"><mml:mtext>x</mml:mtext></mml:mstyle></mml:mrow><mml:mo>&#x00304;</mml:mo></mml:mover></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup></mml:math></inline-formula> be the sample means of the <italic>j</italic>th group. Then the space of the estimated common scores consists of vectors of linear combinations of the columns of <inline-formula><mml:math id="M43"><mml:mover accent="true"><mml:mrow><mml:mo>&#x0039B;</mml:mo></mml:mrow><mml:mo>^</mml:mo></mml:mover></mml:math></inline-formula>, and is totally determined by <inline-formula><mml:math id="M44"><mml:mover accent="true"><mml:mrow><mml:mo>&#x0039B;</mml:mo></mml:mrow><mml:mo>^</mml:mo></mml:mover></mml:math></inline-formula>. The estimated means of the common scores are consequently obtained by projecting <inline-formula><mml:math id="M45"><mml:msup><mml:mrow><mml:mover accent="true"><mml:mrow><mml:mstyle mathvariant="bold"><mml:mtext>x</mml:mtext></mml:mstyle></mml:mrow><mml:mo>&#x00304;</mml:mo></mml:mover></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup></mml:math></inline-formula> onto the column space of <inline-formula><mml:math id="M46"><mml:mover accent="true"><mml:mrow><mml:mo>&#x0039B;</mml:mo></mml:mrow><mml:mo>^</mml:mo></mml:mover></mml:math></inline-formula>, and we denote it as <inline-formula><mml:math id="M47"><mml:msubsup><mml:mrow><mml:mover accent="true"><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BC;</mml:mo></mml:mstyle></mml:mrow><mml:mo>^</mml:mo></mml:mover></mml:mrow><mml:mrow><mml:mi>&#x003BA;</mml:mi></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msubsup></mml:math></inline-formula>. Similarly, the estimated means of the specific factors are obtained by projecting <inline-formula><mml:math id="M48"><mml:msup><mml:mrow><mml:mover accent="true"><mml:mrow><mml:mstyle mathvariant="bold"><mml:mtext>x</mml:mtext></mml:mstyle></mml:mrow><mml:mo>&#x00304;</mml:mo></mml:mover></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup></mml:math></inline-formula> onto the space that is orthogonal to that of <inline-formula><mml:math id="M49"><mml:mover accent="true"><mml:mrow><mml:mo>&#x0039B;</mml:mo></mml:mrow><mml:mo>^</mml:mo></mml:mover></mml:math></inline-formula>, and we denote it as <inline-formula><mml:math id="M50"><mml:msup><mml:mrow><mml:mover accent="true"><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BD;</mml:mo></mml:mstyle></mml:mrow><mml:mo>^</mml:mo></mml:mover></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup></mml:math></inline-formula>. Details of the projection matrix and examples are provided in Deng and Yuan (<xref ref-type="bibr" rid="B4">2016</xref>). In particular, there exists <inline-formula><mml:math id="M51"><mml:msup><mml:mrow><mml:mover accent="true"><mml:mrow><mml:mstyle mathvariant="bold"><mml:mtext>x</mml:mtext></mml:mstyle></mml:mrow><mml:mo>&#x00304;</mml:mo></mml:mover></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup><mml:mo>=</mml:mo><mml:msubsup><mml:mrow><mml:mover accent="true"><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BC;</mml:mo></mml:mstyle></mml:mrow><mml:mo>^</mml:mo></mml:mover></mml:mrow><mml:mrow><mml:mi>&#x003BA;</mml:mi></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msubsup><mml:mo>&#x0002B;</mml:mo><mml:msup><mml:mrow><mml:mover accent="true"><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BD;</mml:mo></mml:mstyle></mml:mrow><mml:mo>^</mml:mo></mml:mover></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup></mml:math></inline-formula>. Also, an estimate of <bold>&#x003BA;</bold><sup>(<italic>j</italic>)</sup> is uniquely obtained from <inline-formula><mml:math id="M52"><mml:msubsup><mml:mrow><mml:mover accent="true"><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BC;</mml:mo></mml:mstyle></mml:mrow><mml:mo>^</mml:mo></mml:mover></mml:mrow><mml:mrow><mml:mi>&#x003BA;</mml:mi></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msubsup></mml:math></inline-formula>, and we denote it as <inline-formula><mml:math id="M53"><mml:msup><mml:mrow><mml:mover accent="true"><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BA;</mml:mo></mml:mstyle></mml:mrow><mml:mo>^</mml:mo></mml:mover></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup></mml:math></inline-formula>. Thus, the estimates of means of common and specific factors only depend on the sample means and estimated common factor loading matrix, and do not involve estimating the intercepts in Equation (1).</p>
<p>Two types of invariance tests on means can be conducted under the new setup. One test is about cross-group equality of means of common scores, which is equivalent to the test on cross-group equality of means of the latent constructs. The other test is on cross-group equality of means of specific factors. The corresponding hypotheses are</p>
<disp-formula id="E10"><label>(9)</label><mml:math id="M54"><mml:mtable columnalign="left"><mml:mtr><mml:mtd><mml:msub><mml:mrow><mml:mi>H</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x003BA;</mml:mi></mml:mrow></mml:msub><mml:mo>:</mml:mo><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BA;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup><mml:mo>=</mml:mo><mml:mo>&#x022EF;</mml:mo><mml:mo>=</mml:mo><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BA;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>m</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup><mml:mtext>or</mml:mtext><mml:msubsup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BC;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mi>&#x003BA;</mml:mi></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msubsup><mml:mo>=</mml:mo><mml:mo>&#x022EF;</mml:mo><mml:mo>=</mml:mo><mml:msubsup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BC;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mi>&#x003BA;</mml:mi></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>m</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msubsup><mml:mo>,</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>and</p>
<disp-formula id="E11"><label>(10)</label><mml:math id="M55"><mml:mtable columnalign="left"><mml:mtr><mml:mtd><mml:msub><mml:mrow><mml:mi>H</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x003BD;</mml:mi></mml:mrow></mml:msub><mml:mo>:</mml:mo><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BD;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup><mml:mo>=</mml:mo><mml:mo>&#x022EF;</mml:mo><mml:mo>=</mml:mo><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BD;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>m</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup><mml:mo>.</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>The two hypotheses can also be formulated as <inline-formula><mml:math id="M56"><mml:msub><mml:mrow><mml:mi>H</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x003BA;</mml:mi></mml:mrow></mml:msub><mml:mo>:</mml:mo><mml:msubsup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BA;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mi>d</mml:mi></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msubsup><mml:mo>=</mml:mo><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BA;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup><mml:mo>-</mml:mo><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BA;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup><mml:mo>=</mml:mo><mml:mstyle mathvariant="bold"><mml:mn>0</mml:mn></mml:mstyle></mml:math></inline-formula> and <inline-formula><mml:math id="M57"><mml:msub><mml:mrow><mml:mi>H</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x003BD;</mml:mi></mml:mrow></mml:msub><mml:mo>:</mml:mo><mml:msubsup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BD;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mi>d</mml:mi></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msubsup><mml:mo>=</mml:mo><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BD;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup><mml:mo>-</mml:mo><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BD;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup><mml:mo>=</mml:mo><mml:mstyle mathvariant="bold"><mml:mn>0</mml:mn></mml:mstyle></mml:math></inline-formula>, <italic>j</italic> &#x0003D; 2, &#x022EF;&#x000A0;, <italic>m</italic>. Deng and Yuan (<xref ref-type="bibr" rid="B4">2016</xref>) showed that <inline-formula><mml:math id="M58"><mml:msubsup><mml:mrow><mml:mover accent="true"><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BA;</mml:mo></mml:mstyle></mml:mrow><mml:mo>^</mml:mo></mml:mover></mml:mrow><mml:mrow><mml:mi>d</mml:mi></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msubsup></mml:math></inline-formula> and <inline-formula><mml:math id="M59"><mml:msubsup><mml:mrow><mml:mover accent="true"><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BD;</mml:mo></mml:mstyle></mml:mrow><mml:mo>^</mml:mo></mml:mover></mml:mrow><mml:mrow><mml:mi>d</mml:mi></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msubsup></mml:math></inline-formula> asymptotically follow normal distributions, and each of the two hypotheses can be tested using a Wald<xref ref-type="fn" rid="fn0004"><sup>4</sup></xref> statistic <italic>T</italic><sub><italic>gls</italic></sub> &#x0003D; <italic>NF</italic><sub><italic>gls</italic></sub> that asymptotically follows a chi-square distribution with degrees of freedom <italic>df</italic><sub>&#x003BA;</sub> &#x0003D; (<italic>m</italic> &#x02212; 1)<italic>k</italic> and <italic>df</italic><sub>&#x003BD;</sub> &#x0003D; (<italic>m</italic> &#x02212; 1)(<italic>p</italic> &#x02212; <italic>k</italic>), respectively. In addition to using the Wald statistics, the two hypotheses in (9) and (10) can also be tested via the bootstrap methodology, especially when the sample sizes are not large enough.</p>
<p>The interest of mean comparison in most studies might be to find a significant difference across groups. If this is the goal, then conventional NHT would be logically sufficient and ET is not needed. However, it is hard to imagine that the population means of different groups are literally identical. A non-significant result might be due to a small sample size and/or a small effect size. Knowing the size of the difference would be more informative even if one cares primarily about significant differences. The framework of ET would not only inform researchers the size of a possible misspecification but also provide a confidence level to it. For ET, the two hypotheses in (9) and (10) need to be reformulated, parallel to Equation (3). That is, the null hypothesis for endorsing the equality of the <bold>&#x003BA;</bold><sup>(<italic>j</italic>)</sup>, <italic>j</italic> &#x0003D; 1, 2, &#x022EF;&#x000A0;, <italic>m</italic>, becomes</p>
<disp-formula id="E12"><label>(11)</label><mml:math id="M60"><mml:mtable columnalign="left"><mml:mtr><mml:mtd><mml:msub><mml:mrow><mml:mi>H</mml:mi></mml:mrow><mml:mrow><mml:mi>e</mml:mi><mml:mi>&#x003BA;</mml:mi></mml:mrow></mml:msub><mml:mo>:</mml:mo><mml:msub><mml:mrow><mml:mi>F</mml:mi></mml:mrow><mml:mrow><mml:mi>g</mml:mi><mml:mi>l</mml:mi><mml:mi>s</mml:mi><mml:mn>0</mml:mn></mml:mrow></mml:msub><mml:mo>&#x0003E;</mml:mo><mml:msub><mml:mrow><mml:mi>&#x003F5;</mml:mi></mml:mrow><mml:mrow><mml:mn>0</mml:mn></mml:mrow></mml:msub><mml:mo>,</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>where <italic>F</italic><sub><italic>gls</italic>0</sub> is the population value of <italic>F</italic><sub><italic>gls</italic></sub> corresponding to the <italic>T</italic><sub><italic>gls</italic></sub> for testing <italic>H</italic><sub>&#x003BA;</sub>. Then the critical value for judging the significance of <italic>T</italic><sub><italic>gls</italic></sub> is the left-tail quantile of <inline-formula><mml:math id="M61"><mml:msubsup><mml:mrow><mml:mi>&#x003C7;</mml:mi></mml:mrow><mml:mrow><mml:mi>d</mml:mi><mml:msub><mml:mrow><mml:mi>f</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x003BA;</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msub><mml:mrow><mml:mi>&#x003B4;</mml:mi></mml:mrow><mml:mrow><mml:mn>0</mml:mn></mml:mrow></mml:msub></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:math></inline-formula> corresponding to level &#x003B1;, where &#x003B4;<sub>0</sub> &#x0003D; <italic>N&#x003F5;</italic><sub>0</sub>. We reject <italic>H</italic><sub><italic>e&#x003BA;</italic></sub> when <italic>T</italic><sub><italic>gls</italic></sub> is smaller than the critical value. Similarly, we can test <italic>H</italic><sub><italic>e&#x003BD;</italic></sub> under ET, although there might be less interest in comparing the means of specific factors. As with the chi-square-difference statistics in the previous subsection, we can specify the value of &#x003F5;<sub>0</sub> via <inline-formula><mml:math id="M62"><mml:msub><mml:mrow><mml:mtext>RMSEA</mml:mtext></mml:mrow><mml:mrow><mml:mn>0</mml:mn></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:msup><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msub><mml:mrow><mml:mi>&#x003F5;</mml:mi></mml:mrow><mml:mrow><mml:mn>0</mml:mn></mml:mrow></mml:msub><mml:mo>/</mml:mo><mml:mi>d</mml:mi><mml:msub><mml:mrow><mml:mi>f</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x003BA;</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow><mml:mrow><mml:mn>1</mml:mn><mml:mo>/</mml:mo><mml:mn>2</mml:mn></mml:mrow></mml:msup></mml:math></inline-formula> as well as by testing <italic>H</italic><sub><italic>e&#x003BA;</italic></sub> using the T-size RMSEA<xref ref-type="fn" rid="fn0005"><sup>5</sup></xref> corresponding to the Wald statistic. In our package <monospace>equaltestMI</monospace>, we compute the T-size RMSEA<sub><italic>t</italic></sub> corresponding to the value of the Wald statistic instead of reporting the critical value <inline-formula><mml:math id="M63"><mml:msubsup><mml:mrow><mml:mi>&#x003C7;</mml:mi></mml:mrow><mml:mrow><mml:mi>d</mml:mi><mml:msub><mml:mrow><mml:mi>f</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x003BA;</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msub><mml:mrow><mml:mi>&#x003B4;</mml:mi></mml:mrow><mml:mrow><mml:mn>0</mml:mn></mml:mrow></mml:msub></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:math></inline-formula>. Researchers can compare the value of RMSEA<sub><italic>t</italic></sub> against the adjusted cutoff values, which are printed out in the output of the R package.</p>
<p>A key feature of the projection method is a validity index. Let <inline-formula><mml:math id="M64"><mml:msubsup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BC;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mi>d</mml:mi><mml:mi>&#x003BA;</mml:mi></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msubsup><mml:mo>=</mml:mo><mml:mo>&#x0039B;</mml:mo><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BA;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup><mml:mo>-</mml:mo><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BA;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:math></inline-formula>, <italic>j</italic> &#x0003D; 2, &#x022EF;&#x000A0;, <italic>m</italic>, and <inline-formula><mml:math id="M65"><mml:msubsup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BC;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mi>&#x003BA;</mml:mi></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>d</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msubsup></mml:math></inline-formula> is the vector of length <italic>p</italic>(<italic>m</italic> &#x02212; 1) formulated by stacking the <inline-formula><mml:math id="M66"><mml:msubsup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BC;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mi>d</mml:mi><mml:mi>&#x003BA;</mml:mi></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msubsup></mml:math></inline-formula>; and <bold>&#x003BD;</bold><sup>(<italic>d</italic>)</sup> is the vector of length <italic>p</italic>(<italic>m</italic> &#x02212; 1) formulated by stacking the <inline-formula><mml:math id="M67"><mml:msubsup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BD;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mi>d</mml:mi></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msubsup></mml:math></inline-formula>, <italic>j</italic> &#x0003D; 2, 3, &#x022EF;&#x000A0;, <italic>m</italic>. Deng and Yuan (<xref ref-type="bibr" rid="B4">2016</xref>) defined a validity index for mean difference as</p>
<disp-formula id="E13"><label>(12)</label><mml:math id="M68"><mml:mtable columnalign="left"><mml:mtr><mml:mtd><mml:msubsup><mml:mrow><mml:mi>&#x003C1;</mml:mi></mml:mrow><mml:mrow><mml:mi>c</mml:mi></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:mo>|</mml:mo><mml:msubsup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BC;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mi>&#x003BA;</mml:mi></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>d</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msubsup><mml:msup><mml:mrow><mml:mo>|</mml:mo></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msup></mml:mrow><mml:mrow><mml:mo>|</mml:mo><mml:msubsup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BC;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mi>&#x003BA;</mml:mi></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>d</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msubsup><mml:msup><mml:mrow><mml:mo>|</mml:mo></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msup><mml:mo>&#x0002B;</mml:mo><mml:mo>|</mml:mo><mml:msup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BD;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>d</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msup><mml:msup><mml:mrow><mml:mo>|</mml:mo></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:mfrac><mml:mo>,</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>where <inline-formula><mml:math id="M69"><mml:mo>|</mml:mo><mml:msubsup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BC;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mi>&#x003BA;</mml:mi></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>d</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msubsup><mml:msup><mml:mrow><mml:mo>|</mml:mo></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msup></mml:math></inline-formula> and |<bold>&#x003BD;</bold><sup>(<italic>d</italic>)</sup>|<sup>2</sup> denote the sums of squares of the elements in <inline-formula><mml:math id="M70"><mml:msubsup><mml:mrow><mml:mstyle mathvariant="bold"><mml:mo>&#x003BC;</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mi>&#x003BA;</mml:mi></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>d</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:msubsup></mml:math></inline-formula> and <bold>&#x003BD;</bold><sup>(<italic>d</italic>)</sup>, respectively. This validity index gives the percentage of the mean differences of the manifest variables that is due to the differences in means of the common scores. If the sample estimate <inline-formula><mml:math id="M71"><mml:msubsup><mml:mrow><mml:mover accent="true"><mml:mrow><mml:mi>&#x003C1;</mml:mi></mml:mrow><mml:mo>^</mml:mo></mml:mover></mml:mrow><mml:mrow><mml:mi>c</mml:mi></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup></mml:math></inline-formula> is not large enough, say less than 0.5, then items in the test might need to be modified or the administration of the data collection process might not be conducted properly. We will call <inline-formula><mml:math id="M72"><mml:msubsup><mml:mrow><mml:mi>&#x003C1;</mml:mi></mml:mrow><mml:mrow><mml:mi>c</mml:mi></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup></mml:math></inline-formula> the validity index for mean differences, because elaboration on the observed mean differences might be off the target when <inline-formula><mml:math id="M73"><mml:msubsup><mml:mrow><mml:mover accent="true"><mml:mrow><mml:mi>&#x003C1;</mml:mi></mml:mrow><mml:mo>^</mml:mo></mml:mover></mml:mrow><mml:mrow><mml:mi>c</mml:mi></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup></mml:math></inline-formula> is not sufficiently large, say greater than 0.70. In particular, when most of the mean differences in the manifest variables are not due to those in the latent traits, the validity of the measurements might be questionable. Then the empirical meaning of the observed differences will be different from the truth, which will create interpretational confounding. The extent to which the observed mean differences reflect the mean differences of the latent variables is not available following the analysis of the mean structures in the conventional setup, where cross-group equality of intercepts is a prerequisite for estimating mean differences of latent variables.</p>
</sec>
</sec>
<sec id="s3">
<title>3. Real data example</title>
<p>In this section, we introduce the R package <monospace>equaltestMI</monospace> and illustrate its use via a real data example. Both ET and the projection method are implemented in the R package, which is available on CRAN and can be used on any R platform with version 3.1.0 or above. The development of <monospace>equaltestMI</monospace> relies on R packages <monospace>lavaan</monospace> (Rosseel, <xref ref-type="bibr" rid="B22">2012</xref>) for obtaining chi-square statistics of invariance tests and <monospace>semTools</monospace> (semTools Contributors, <xref ref-type="bibr" rid="B24">2016</xref>) for computing chi-square-difference tests and fit indices. The function for computing adjusted RMSEA cutoff values for ET is adapted from the R codes available at <ext-link ext-link-type="uri" xlink:href="http://www3.nd.edu/~kyuan/mgroup/Equivalence-testing.R">http://www3.nd.edu/&#x0007E;kyuan/mgroup/Equivalence-testing.R</ext-link>. The input to <monospace>equaltestMI</monospace> can be either raw data sets with group membership indicator or sample means and covariances.</p>
<sec>
<title>3.1. Data set</title>
<p>Literacy-related difficulties for many children are due to lack of exposure to print or instructional resources, and thus socioeconomic status (SES) is an important demographic variable that strongly relates to academic achievement. The data we use for the illustration are from Lee and Al Otaiba (<xref ref-type="bibr" rid="B13">2015</xref>), and their Table 1 contains sample statistics (sample sizes, means, covariances) on early literacy skills from 2 sociodemographic groups of kindergartners, with <italic>N</italic><sub>1</sub> &#x0003D; 78 boys ineligible for free or reduced-price lunch (FRL) and <italic>N</italic><sub>2</sub> &#x0003D; 174 boys eligible for FRL. The interest of Lee and Al Otaiba is whether measurements on literature proficiency are invariant when compared students with lower SES (eligible for FRL) against those with higher SES (ineligible for FRL). There are six manifest variables in measuring literacy constructs: (1) letter-name fluency, (2) letter-sound fluency, (3) blending, (4) elision, (5) real words spelling, and (6) pseudo-words spelling. Following from Snow&#x00027;s (<xref ref-type="bibr" rid="B25">2006</xref>) definition of componential skills and the work of Schatschneider et al. (<xref ref-type="bibr" rid="B23">2004</xref>) on National Early Literacy Panel (NELP), the six variables aim to measure three aspects of literacy constructs: (1) alphabet knowledge, which refers to children&#x00027;s familiarity with letter forms, names, and corresponding sounds; (2) phonological awareness, which encompasses the ability to detect, manipulate, or analyze sounds in spoken language in varying complexities such as words, syllables, and phonemes; and (3) spelling, which measures the ability to spell words with letters (Piasta and Wagner, <xref ref-type="bibr" rid="B21">2010</xref>). As indicated in Figure <xref ref-type="fig" rid="F1">1</xref>, alphabet knowledge, phonological awareness, and spelling are the three latent constructs behind the six variables. Lee and Al Otaiba (<xref ref-type="bibr" rid="B13">2015</xref>) examined the MI issues using the conventional methods. Let the boys who are ineligible for FRL be group one and those eligible for FRL be group two. We will use the six-variable-two-group model to illustrate the application of the new methods via the package <monospace>equaltestMI</monospace>.</p>
<fig id="F1" position="float">
<label>Figure 1</label>
<caption><p>The path diagram for the model of Lee and Al Otaiba (<xref ref-type="bibr" rid="B13">2015</xref>).</p></caption>
<graphic xlink:href="fpsyg-08-01823-g0001.tif"/>
</fig>
</sec>
<sec>
<title>3.2. Package <monospace>equaltestMI</monospace></title>
<p>To use <monospace>equaltestMI</monospace> for the first time, one needs to download the package from CRAN and load it into R environment. This can be done by entering the following commands in R:</p>
<table-wrap position="float">
<table frame="hsides" rules="groups">
<tbody>
<tr>
<td valign="top" align="left"><monospace>install.packages(equaltestMI)</monospace></td>
<td valign="top" align="center"><monospace>1</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>library(equaltestMI)</monospace></td>
<td valign="top" align="center"><monospace>2</monospace></td>
</tr>
</tbody>
</table>
</table-wrap>
<p>The line numbers in the right margin are for convenience of explaining the codes in our illustration, not part of the R commands. After loading the package <monospace>equaltestMI</monospace> into R, there is no need to load <monospace>lavaan</monospace> and <monospace>semTools</monospace> separately since they are listed as dependent packages of <monospace>equaltestMI</monospace>. However, one does need to have the two packages installed before the library command on line 2, otherwise <monospace>equaltestMI</monospace> cannot be successfully loaded.</p>
<p>The package <monospace>equaltestMI</monospace> has multiple R functions. The one that is routinely used is <monospace>eqMI.main()</monospace>. Other functions can be used to test the cross-group equality of population covariance matrices or to obtain adjusted RMSEA cutoff values in a separate analysis. Interested users are referred to supplementary material (<ext-link ext-link-type="uri" xlink:href="http://www3.nd.edu/&#x0007E;kyuan/eqMI/Supplementary_Material_MI.pdf">http://www3.nd.edu/&#x0007E;kyuan/eqMI/Supplementary_Material_MI.pdf</ext-link>) and the page of <monospace>equaltestMI</monospace> on CRAN (<ext-link ext-link-type="uri" xlink:href="https://cran.r-project.org/web/packages/equaltestMI/index.html">https://cran.r-project.org/web/packages/equaltestMI/index.html</ext-link>), where details for using different functions are documented.</p>
<p>Different arguments can be provided to <monospace>eqMI.main()</monospace> for customized analysis. However, data input (raw data or sample means and covariances) has to be in required format. For a raw data set, column represents variables and row represents observations, and an additional column of duplicated numbers for group membership is needed for all the involved samples. For either raw data or sample statistics, the first row needs to be variable names, and including a group-membership indicator. If input data are sample statistics, the sample means must be stored in the format of vectors immediately following the variables names; and sample covariance matrix stored in the format of matrix are next, see <bold>Appendix A</bold> for the format. In particular, the first row of each file must have a space before the first variable name. The label <monospace>&#x00027;mean&#x00027;</monospace> must be included prior to the numerical values of the mean vector. In addition, variable names are also needed in the first column of the covariance matrix as required by <monospace>lavaan</monospace>, these will be further used to in the model syntax, to be presented below.</p>
<p>For conducting the tests of MI, we first need to import the sample means and sample covariance matrices into R. This is done by the following R codes for this example:</p>
<table-wrap position="float">
<table frame="hsides" rules="groups">
<tbody>
<tr>
<td valign="top" align="left"><monospace>setwd(&#x0201C;C:/research/equaltestMI&#x0201D;)</monospace></td>
<td valign="top" align="left"><monospace>3</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>Groupl &#x0003C;- read.table(&#x00027;Group1.txt&#x00027;, header &#x0003D; TRUE)</monospace></td>
<td valign="top" align="left"><monospace>4</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>Group2 &#x0003C;- read.table(&#x00027;Group2.txt&#x00027;, header &#x0003D; TRUE)</monospace></td>
<td valign="top" align="left"><monospace>5</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>Group1 &#x0003C;- as.matrix(Group1)</monospace></td>
<td valign="top" align="left"><monospace>6</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>Group2 &#x0003C;- as.matrix(Group2)</monospace></td>
<td valign="top" align="left"><monospace>7</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>M1 &#x0003C;- Group1[1,]</monospace></td>
<td valign="top" align="left"><monospace>8</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>M2 &#x0003C;- Group2[1,]</monospace></td>
<td valign="top" align="left"><monospace>9</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>Cov1 &#x0003C;- Group1[2:7,]</monospace></td>
<td valign="top" align="left"><monospace>10</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>Cov2 &#x0003C;- Group2[2:7,]</monospace></td>
<td valign="top" align="left"><monospace>11</monospace></td>
</tr>
</tbody>
</table>
</table-wrap>
<p>The code <monospace>setwd(&#x0007E;C:/research/equaltestMI&#x0007E;)</monospace> on Line 3 sets the working directory as the folder where the data files are stored. The <monospace>read.table</monospace> command on Lines 4 and 5 put the sample means and sample covariance matrices of the two groups in <monospace>Group1.txt</monospace> and <monospace>Group2.txt</monospace> into R environment. The format of the two data files <monospace>Group1.txt</monospace> and <monospace>Group2.txt</monospace> are provided in <bold>Appendix A</bold>. The argument <monospace>header</monospace> is set to be <monospace>TRUE</monospace> in order to identify the variable names that are needed to set the model. Lines 6 and 7 then use <monospace>as.matrix</monospace> to convert the formats of <monospace>Group1</monospace> and <monospace>Group2</monospace> to <monospace>matrix</monospace> as required by <monospace>lavaan</monospace>, so that the sample means and covariance matrices extracted from <monospace>Group1</monospace> and <monospace>Group2</monospace> are in the correct formats. Lines 8 to 11 separate the sample means from the sample covariance matrices for each group according to the positions of the values in the data files.</p>
<p>Another argument that is needed by <monospace>eqMI.main()</monospace> is the model statement. Since <monospace>lavaan</monospace> and <monospace>semTools</monospace> are used to compute chi-square and chi-square-difference test statistics, the model syntax is written following the convention of <monospace>lavaan</monospace>:</p>
<table-wrap position="float">
<table frame="hsides" rules="groups">
<tbody>
<tr>
<td valign="top" align="left"><monospace>model &#x0003C;- &#x00027;</monospace></td>
<td valign="top" align="center"><monospace>12</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>AlphabetKnowledge &#x0003D;&#x0007E; Letter_Name &#x0002B; Letter_Sound</monospace></td>
<td valign="top" align="center"><monospace>13</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>PhonologicalAwareness &#x0003D;&#x0007E; Blending &#x0002B; Elision</monospace></td>
<td valign="top" align="center"><monospace>14</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>Spelling &#x0003D;&#x0007E; Real_Words &#x0002B; Pseudo_Words</monospace></td>
<td valign="top" align="center"><monospace>15</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>&#x02032;</monospace></td>
<td valign="top" align="center"><monospace>16</monospace></td>
</tr>
</tbody>
</table>
</table-wrap>
<p>where the single quotation marks (can also be double quotation marks) enclose a model statement. The sign <monospace>=&#x0007E;</monospace> is used to indicate the relationship between a latent factor and its manifest indicators/variables. On the left of each <monospace>=&#x0007E;</monospace> is the label for a latent factor and those following <monospace>=&#x0007E;</monospace> are the corresponding manifest variables that loaded onto the latent factor. The manifest variables that load onto the same latent factor are connected by &#x0201C;&#x0002B;.&#x0201D; The names of the latent factors in the model statement cannot duplicate any of the variable names in <monospace>Group1.txt</monospace> or <monospace>Group2.txt</monospace>.</p>
<p>To perform ET and the projection method for MI with two groups, we supply the following arguments to <monospace>eqMI.main()</monospace>:</p>
<table-wrap position="float">
<table frame="hsides" rules="groups">
<tbody>
<tr>
<td valign="top" align="left"><monospace>test &#x0003C;-</monospace></td>
<td valign="top" align="left"><monospace>eqMI.main(model &#x0003D; model,</monospace></td>
<td valign="top" align="center"><monospace>17</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>&#x000A0;</monospace></td>
<td valign="top" align="left"><monospace>sample.nobs &#x0003D; c(78, 174),</monospace></td>
<td valign="top" align="center"><monospace>18</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>&#x000A0;</monospace></td>
<td valign="top" align="left"><monospace>sample.mean &#x0003D; list(M1, M2),</monospace></td>
<td valign="top" align="center"><monospace>19</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>&#x000A0;</monospace></td>
<td valign="top" align="left"><monospace>sample.cov &#x0003D; list(Cov1, Cov2),</monospace></td>
<td valign="top" align="center"><monospace>20</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>&#x000A0;</monospace></td>
<td valign="top" align="left"><monospace>meanstructure &#x0003D; TRUE,</monospace></td>
<td valign="top" align="center"><monospace>21</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>&#x000A0;</monospace></td>
<td valign="top" align="left"><monospace>output &#x0003D; &#x00027;both&#x00027;,</monospace></td>
<td valign="top" align="center"><monospace>22</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>&#x000A0;</monospace></td>
<td valign="top" align="left"><monospace>quiet &#x0003D; FALSE,</monospace></td>
<td valign="top" align="center"><monospace>23</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>&#x000A0;</monospace></td>
<td valign="top" align="left"><monospace>equivalence.test &#x0003D; TRUE, adjRMSEA &#x0003D; TRUE,</monospace></td>
<td valign="top" align="center"><monospace>24</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>&#x000A0;</monospace></td>
<td valign="top" align="left"><monospace>projection &#x0003D; TRUE, bootstrap &#x0003D; FALSE)</monospace></td>
<td valign="top" align="center"><monospace>25</monospace></td>
</tr>
</tbody>
</table>
</table-wrap>
<p>The <monospace>model</monospace> on Line 17 is the SEM model we defined using the convention of <monospace>lavaan</monospace> on Lines 12 to 16. The <monospace>sample.nobs</monospace> on Line 18 contains the numbers of observations for the two groups, and more numbers are needed with more groups. The <monospace>sample.mean</monospace> on Line 19 is a list of sample means obtained on Lines 8 and 9, and <monospace>sample.cov</monospace> is a list of sample covariance matrices. The <monospace>meanstructure</monospace><monospace> =</monospace><monospace> TRUE</monospace> on Line 21 is needed if mean structures are involved instead of saturated means. The <monospace>output</monospace><monospace> =</monospace><monospace> &#x00027;both&#x00027;</monospace> on Line 22 requires the results of tests of both the mean and covariance structures (steps 1 to 6c in Table <xref ref-type="table" rid="T1">1</xref>) be printed out. One can also output the results of only the mean structure or the covariance structure by specifying <monospace>output</monospace><monospace> =</monospace><monospace> &#x00027;mean&#x00027;</monospace> or <monospace>output</monospace><monospace> =</monospace><monospace> &#x00027;covariance&#x00027;</monospace>. The <monospace>quiet</monospace><monospace> =</monospace><monospace> FALSE</monospace> on Line 23 tells the program to print out a summary to R console that contains test statistics and fit measures of all the involved tests as described in Table <xref ref-type="table" rid="T1">1</xref>. The arguments <monospace>equivalence.test</monospace><monospace> =</monospace><monospace> TRUE</monospace> and <monospace>adjRMSEA</monospace><monospace> =</monospace><monospace> TRUE</monospace> on Line 24 tell the program to conduct ET and print out T-size RMSEA and adjusted cutoff values. The arguments <monospace>projection</monospace><monospace> =</monospace><monospace> TRUE</monospace> and <monospace>bootstrap</monospace><monospace> =</monospace><monospace> FALSE</monospace> on Line 25 tell the program to conduct mean comparison using the projection method. Bootstrap resampling is not invoked in this example due to the absence of raw data. However, bootstrap can be enabled to obtain empirical <italic>p</italic>-values for the tests of equalities of common and specific factors using the projection method once raw data become available, and the details are documented in the online supplementary material.</p>
</sec>
<sec>
<title>3.3. Output</title>
<table-wrap position="float">
<table frame="hsides" rules="groups">
<tbody>
<tr>
<td valign="top" colspan="4"><monospace>---------- Equality of Population Covariance Matrices under NHT ----------</monospace></td>
<td valign="top" colspan="5" align="right"><monospace>26</monospace></td>
</tr>
<tr>
<td valign="top" align="right"><monospace>&#x000A0;</monospace></td>
<td valign="top" align="right"><monospace>Chisq</monospace></td>
<td valign="top" align="right"><monospace>Df</monospace></td>
<td valign="top" align="right"><monospace>pvalue</monospace></td>
<td valign="top" align="right" colspan="5"><monospace>27</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>fit.pop.cov</monospace></td>
<td valign="top" align="right"><monospace>48.85008</monospace></td>
<td valign="top" align="right"><monospace>21</monospace></td>
<td valign="top" align="right"><monospace>0. 0005261139</monospace></td>
<td valign="top" align="right" colspan="5"><monospace>28</monospace></td>
</tr>
<tr>
<td valign="top" align="right" colspan="9"><monospace>29</monospace></td>
</tr>
<tr>
<td valign="top" colspan="8"><monospace>---------- Chi-Square and Chi-Square-Difference Test under NHT ----------</monospace></td>
<td valign="top" align="right"><monospace>30</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>&#x000A0;</monospace></td>
<td valign="top" align="right"><monospace>Chisq</monospace></td>
<td valign="top" align="right"><monospace>Df</monospace></td>
<td valign="top" align="right"><monospace>pvalue</monospace></td>
<td valign="top" align="right"><monospace>Chisq.diff</monospace></td>
<td valign="top" align="right"><monospace>Df.diff</monospace></td>
<td valign="top" align="right"><monospace>pvalue</monospace></td>
<td valign="top" align="right" colspan="2"><monospace>31</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>fit.pop.cov</monospace></td>
<td valign="top" align="right"><monospace>48.850</monospace></td>
<td valign="top" align="right"><monospace>21</monospace></td>
<td valign="top" align="right"><monospace>0.001</monospace></td>
<td valign="top" align="right"><monospace>&#x000A0;</monospace></td>
<td valign="top" align="right"><monospace>&#x000A0;</monospace></td>
<td valign="top" align="right"><monospace>&#x000A0;</monospace></td>
<td valign="top" align="right" colspan="2"><monospace>32</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>fit.configural.g1</monospace></td>
<td valign="top" align="right"><monospace>4.408</monospace></td>
<td valign="top" align="right"><monospace>6</monospace></td>
<td valign="top" align="right"><monospace>0.622</monospace></td>
<td valign="top" align="right"><monospace>&#x000A0;</monospace></td>
<td valign="top" align="right"><monospace>&#x000A0;</monospace></td>
<td valign="top" align="right"><monospace>&#x000A0;</monospace></td>
<td valign="top" align="right" colspan="2"><monospace>33</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>fit.configural.g2</monospace></td>
<td valign="top" align="right"><monospace>10.641</monospace></td>
<td valign="top" align="right"><monospace>6</monospace></td>
<td valign="top" align="right"><monospace>0.100</monospace></td>
<td valign="top" align="right"><monospace>&#x000A0;</monospace></td>
<td valign="top" align="right"><monospace>&#x000A0;</monospace></td>
<td valign="top" align="right"><monospace>&#x000A0;</monospace></td>
<td valign="top" align="right" colspan="2"><monospace>34</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>fit.combine.groups</monospace></td>
<td valign="top" align="right"><monospace>15.049</monospace></td>
<td valign="top" align="right"><monospace>12</monospace></td>
<td valign="top" align="right"><monospace>&#x000A0;</monospace></td>
<td valign="top" align="right"><monospace>&#x000A0;</monospace></td>
<td valign="top" align="right"><monospace>&#x000A0;</monospace></td>
<td valign="top" align="right"><monospace>&#x000A0;</monospace></td>
<td valign="top" align="right" colspan="2"><monospace>35</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>fit.metric</monospace></td>
<td valign="top" align="right"><monospace>20.033</monospace></td>
<td valign="top" align="right"><monospace>15</monospace></td>
<td valign="top" align="right"><monospace>0.171</monospace></td>
<td valign="top" align="right"><monospace>4.984</monospace></td>
<td valign="top" align="right"><monospace>3</monospace></td>
<td valign="top" align="right"><monospace>0.173</monospace></td>
<td valign="top" align="right" colspan="2"><monospace>36</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>fit.residuals</monospace></td>
<td valign="top" align="right"><monospace>42.512</monospace></td>
<td valign="top" align="right"><monospace>21</monospace></td>
<td valign="top" align="right"><monospace>0.004</monospace></td>
<td valign="top" align="right"><monospace>22.479</monospace></td>
<td valign="top" align="right"><monospace>6</monospace></td>
<td valign="top" align="right"><monospace>0.001</monospace></td>
<td valign="top" align="right" colspan="2"><monospace>37</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>fit.varfactor</monospace></td>
<td valign="top" align="right"><monospace>54.175</monospace></td>
<td valign="top" align="right"><monospace>27</monospace></td>
<td valign="top" align="right"><monospace>0.001</monospace></td>
<td valign="top" align="right"><monospace>11.663</monospace></td>
<td valign="top" align="right"><monospace>6</monospace></td>
<td valign="top" align="right"><monospace>0.070</monospace></td>
<td valign="top" align="right" colspan="2"><monospace>38</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>fit.scalar</monospace></td>
<td valign="top" align="right"><monospace>23.732</monospace></td>
<td valign="top" align="right"><monospace>18</monospace></td>
<td valign="top" align="right"><monospace>0.164</monospace></td>
<td valign="top" align="right"><monospace>3.699</monospace></td>
<td valign="top" align="right"><monospace>3</monospace></td>
<td valign="top" align="right"><monospace>0.296</monospace></td>
<td valign="top" align="right" colspan="2"><monospace>39</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>fit.strong.means</monospace></td>
<td valign="top" align="right"><monospace>41.066</monospace></td>
<td valign="top" align="right"><monospace>21</monospace></td>
<td valign="top" align="right"><monospace>0.006</monospace></td>
<td valign="top" align="right"><monospace>17.334</monospace></td>
<td valign="top" align="right"><monospace>3</monospace></td>
<td valign="top" align="right"><monospace>0.001</monospace></td>
<td valign="top" align="right" colspan="2"><monospace>40</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>fit.strict.residuals</monospace></td>
<td valign="top" align="right"><monospace>45.968</monospace></td>
<td valign="top" align="right"><monospace>24</monospace></td>
<td valign="top" align="right"><monospace>0.004</monospace></td>
<td valign="top" align="right"><monospace>22.237</monospace></td>
<td valign="top" align="right"><monospace>6</monospace></td>
<td valign="top" align="right"><monospace>0.001</monospace></td>
<td valign="top" align="right" colspan="2"><monospace>41</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>fit.strict.means</monospace></td>
<td valign="top" align="right"><monospace>63.630</monospace></td>
<td valign="top" align="right"><monospace>27</monospace></td>
<td valign="top" align="right"><monospace>0.000</monospace></td>
<td valign="top" align="right"><monospace>17.662</monospace></td>
<td valign="top" align="right"><monospace>3</monospace></td>
<td valign="top" align="right"><monospace>0.001</monospace></td>
<td valign="top" align="right" colspan="2"><monospace>42</monospace></td>
</tr>
<tr>
<td valign="top" colspan="8"/>
<td valign="top" align="right"><monospace>43</monospace></td>
</tr>
<tr>
<td valign="top" colspan="8"><monospace>-------------- T-size epsilon, RMSEA, and Adjusted Cutoff Values under ET --------------</monospace></td>
<td valign="top" align="right"><monospace>44</monospace></td>
</tr>
<tr>
<td/>
<td valign="top" align="right"><monospace>epsilon_t</monospace></td>
<td valign="top" align="right"><monospace>RMESA_t</monospace></td>
<td valign="top" align="right"><monospace>cut.01</monospace></td>
<td valign="top" align="right"><monospace>cut.05</monospace></td>
<td valign="top" align="right"><monospace>cut.08</monospace></td>
<td valign="top" align="right"><monospace>cut.10</monospace></td>
<td valign="top" align="right"><monospace>goodness-of-fit</monospace></td>
<td valign="top" align="right"><monospace>45</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>fit.pop.cov</monospace></td>
<td valign="top" align="right"><monospace>0.209</monospace></td>
<td valign="top" align="right"><monospace>0.141</monospace></td>
<td valign="top" align="right"><monospace>0.076</monospace></td>
<td valign="top" align="right"><monospace>0.097</monospace></td>
<td valign="top" align="right"><monospace>0.121</monospace></td>
<td valign="top" align="right"><monospace>0.139</monospace></td>
<td valign="top" align="right"><monospace>poor</monospace></td>
<td valign="top" align="right"><monospace>46</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>fit.configural.g1</monospace></td>
<td valign="top" align="right"><monospace>0.028</monospace></td>
<td valign="top" align="right"><monospace>0.097</monospace></td>
<td valign="top" align="right"><monospace>0.116</monospace></td>
<td valign="top" align="right"><monospace>0.133</monospace></td>
<td valign="top" align="right"><monospace>0.157</monospace></td>
<td valign="top" align="right"><monospace>0.175</monospace></td>
<td valign="top" align="right"><monospace>excellent</monospace></td>
<td valign="top" align="right"><monospace>47</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>fit.configural.g2</monospace></td>
<td valign="top" align="right"><monospace>0.071</monospace></td>
<td valign="top" align="right"><monospace>0.154</monospace></td>
<td valign="top" align="right"><monospace>0.116</monospace></td>
<td valign="top" align="right"><monospace>0.133</monospace></td>
<td valign="top" align="right"><monospace>0.157</monospace></td>
<td valign="top" align="right"><monospace>0.175</monospace></td>
<td valign="top" align="right"><monospace>fair</monospace></td>
<td valign="top" align="right"><monospace>48</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>fit.metric</monospace></td>
<td valign="top" align="right"><monospace>0.049</monospace></td>
<td valign="top" align="right"><monospace>0.181</monospace></td>
<td valign="top" align="right"><monospace>0.151</monospace></td>
<td valign="top" align="right"><monospace>0.164</monospace></td>
<td valign="top" align="right"><monospace>0.187</monospace></td>
<td valign="top" align="right"><monospace>0.205</monospace></td>
<td valign="top" align="right"><monospace>fair</monospace></td>
<td valign="top" align="right"><monospace>49</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>fit.residuals</monospace></td>
<td valign="top" align="right"><monospace>0.140</monospace></td>
<td valign="top" align="right"><monospace>0.216</monospace></td>
<td valign="top" align="right"><monospace>0.116</monospace></td>
<td valign="top" align="right"><monospace>0.133</monospace></td>
<td valign="top" align="right"><monospace>0.157</monospace></td>
<td valign="top" align="right"><monospace>0.175</monospace></td>
<td valign="top" align="right"><monospace>poor</monospace></td>
<td valign="top" align="right"><monospace>50</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>fit.varfactor</monospace></td>
<td valign="top" align="right"><monospace>0.078</monospace></td>
<td valign="top" align="right"><monospace>0.161</monospace></td>
<td valign="top" align="right"><monospace>0.116</monospace></td>
<td valign="top" align="right"><monospace>0.133</monospace></td>
<td valign="top" align="right"><monospace>0.157</monospace></td>
<td valign="top" align="right"><monospace>0.175</monospace></td>
<td valign="top" align="right"><monospace>mediocre</monospace></td>
<td valign="top" align="right"><monospace>51</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>fit.scalar</monospace></td>
<td valign="top" align="right"><monospace>0.040</monospace></td>
<td valign="top" align="right"><monospace>0.163</monospace></td>
<td valign="top" align="right"><monospace>0.151</monospace></td>
<td valign="top" align="right"><monospace>0.164</monospace></td>
<td valign="top" align="right"><monospace>0.187</monospace></td>
<td valign="top" align="right"><monospace>0.205</monospace></td>
<td valign="top" align="right"><monospace>close</monospace></td>
<td valign="top" align="right"><monospace>52</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>fit.strong.means</monospace></td>
<td valign="top" align="right"><monospace>0.125</monospace></td>
<td valign="top" align="right"><monospace>0.289</monospace></td>
<td valign="top" align="right"><monospace>0.151</monospace></td>
<td valign="top" align="right"><monospace>0.164</monospace></td>
<td valign="top" align="right"><monospace>0.187</monospace></td>
<td valign="top" align="right"><monospace>0.205</monospace></td>
<td valign="top" align="right"><monospace>poor</monospace></td>
<td valign="top" align="right"><monospace>53</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>fit.strict.residuals</monospace></td>
<td valign="top" align="right"><monospace>0.138</monospace></td>
<td valign="top" align="right"><monospace>0.215</monospace></td>
<td valign="top" align="right"><monospace>0.116</monospace></td>
<td valign="top" align="right"><monospace>0.133</monospace></td>
<td valign="top" align="right"><monospace>0.157</monospace></td>
<td valign="top" align="right"><monospace>0.175</monospace></td>
<td valign="top" align="right"><monospace>poor</monospace></td>
<td valign="top" align="right"><monospace>54</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>fit.strict.means</monospace></td>
<td valign="top" align="right"><monospace>0.127</monospace></td>
<td valign="top" align="right"><monospace>0.291</monospace></td>
<td valign="top" align="right"><monospace>0.151</monospace></td>
<td valign="top" align="right"><monospace>0.164</monospace></td>
<td valign="top" align="right"><monospace>0.187</monospace></td>
<td valign="top" align="right"><monospace>0.205</monospace></td>
<td valign="top" align="right"><monospace>poor</monospace></td>
<td valign="top" align="right"><monospace>55</monospace></td>
</tr>
<tr>
<td valign="top" colspan="8"/>
<td valign="top" align="right"><monospace>56</monospace></td>
</tr>
<tr>
<td valign="top" colspan="8"><monospace>------ Means of Latent and Specific Factors by the Projection Method and under NHT ------</monospace></td>
<td valign="top" align="right"><monospace>57</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>&#x000A0;</monospace></td>
<td valign="top" align="right"><monospace>Chisq</monospace></td>
<td valign="top" align="right"><monospace>Df</monospace></td>
<td valign="top" align="right"><monospace>pvalue</monospace></td>
<td valign="top" align="right" colspan="5"><monospace>58</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>fit.mvmean</monospace></td>
<td valign="top" align="right"><monospace>22.388932</monospace></td>
<td valign="top" align="right"><monospace>6</monospace></td>
<td valign="top" align="right"><monospace>0.0010292280</monospace></td>
<td valign="top" align="right" colspan="5"><monospace>59</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>fit.common</monospace></td>
<td valign="top" align="right"><monospace>19.433779</monospace></td>
<td valign="top" align="right"><monospace>3</monospace></td>
<td valign="top" align="right"><monospace>0.0002223618</monospace></td>
<td valign="top" align="right" colspan="5"><monospace>60</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>fit.specific</monospace></td>
<td valign="top" align="right"><monospace>4.015387</monospace></td>
<td valign="top" align="right"><monospace>3</monospace></td>
<td valign="top" align="right"><monospace>0.2598074102</monospace></td>
<td valign="top" align="right" colspan="5"><monospace>61</monospace></td>
</tr>
<tr>
<td valign="top" colspan="4"><monospace>Validity Index is 0.9885648</monospace></td>
<td valign="top" align="right" colspan="5"><monospace>62</monospace></td>
</tr>
<tr>
<td valign="top" colspan="4"/>
<td valign="top" align="right" colspan="5"><monospace>63</monospace></td>
</tr>
<tr>
<td valign="top" colspan="8"><monospace>------ Means of Latent and Specific Factors by the Projection Method and under ET ------</monospace></td>
<td valign="top" align="right"><monospace>64</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>&#x000A0;</monospace></td>
<td valign="top" align="right"><monospace>epsilon_t</monospace></td>
<td valign="top" align="right"><monospace>RMESA_t</monospace></td>
<td valign="top" align="right"><monospace>cut.01</monospace></td>
<td valign="top" align="right"><monospace>cut.05</monospace></td>
<td valign="top" align="right"><monospace>cut.08</monospace></td>
<td valign="top" align="right"><monospace>cut.10</monospace></td>
<td valign="top" align="right"><monospace>goodness-of-fit</monospace></td>
<td valign="top" align="right"><monospace>65</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>fit.mvmean</monospace></td>
<td valign="top" align="right"><monospace>0.139</monospace></td>
<td valign="top" align="right"><monospace>0.215</monospace></td>
<td valign="top" align="right"><monospace>0.116</monospace></td>
<td valign="top" align="right"><monospace>0.133</monospace></td>
<td valign="top" align="right"><monospace>0.157</monospace></td>
<td valign="top" align="right"><monospace>0.175</monospace></td>
<td valign="top" align="right"><monospace>poor</monospace></td>
<td valign="top" align="right"><monospace>66</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>fit.common</monospace></td>
<td valign="top" align="right"><monospace>0.137</monospace></td>
<td valign="top" align="right"><monospace>0.302</monospace></td>
<td valign="top" align="right"><monospace>0.151</monospace></td>
<td valign="top" align="right"><monospace>0.164</monospace></td>
<td valign="top" align="right"><monospace>0.187</monospace></td>
<td valign="top" align="right"><monospace>0.205</monospace></td>
<td valign="top" align="right"><monospace>poor</monospace></td>
<td valign="top" align="right"><monospace>67</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>fit.specific</monospace></td>
<td valign="top" align="right"><monospace>0.042</monospace></td>
<td valign="top" align="right"><monospace>0.168</monospace></td>
<td valign="top" align="right"><monospace>0.151</monospace></td>
<td valign="top" align="right"><monospace>0.164</monospace></td>
<td valign="top" align="right"><monospace>0.187</monospace></td>
<td valign="top" align="right"><monospace>0.205</monospace></td>
<td valign="top" align="right"><monospace>fair</monospace></td>
<td valign="top" align="right"><monospace>68</monospace></td>
</tr>
<tr>
<td valign="top" colspan="8"/>
<td valign="top" align="right"><monospace>69</monospace></td>
</tr>
<tr>
<td valign="top" colspan="8"><monospace>---------- Cross-group Comparison of Latent Factor Means ----------</monospace></td>
<td valign="top" align="right"><monospace>70</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>&#x000A0;</monospace></td>
<td valign="top" align="right"><monospace>latent_1</monospace></td>
<td valign="top" align="right"><monospace>latent_2</monospace></td>
<td valign="top" align="right"><monospace>latent_d</monospace></td>
<td valign="top" align="right"><monospace>SE_d</monospace></td>
<td valign="top" align="right"><monospace>z_d</monospace></td>
<td valign="top" align="right" colspan="3"><monospace>71</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>AlphabetKnowledge</monospace></td>
<td valign="top" align="right"><monospace>39.20010</monospace></td>
<td valign="top" align="right"><monospace>34.77505</monospace></td>
<td valign="top" align="right"><monospace>&#x02212;4.42505</monospace></td>
<td valign="top" align="right"><monospace>1.87963</monospace></td>
<td valign="top" align="right"><monospace>&#x02212;2.35422</monospace></td>
<td valign="top" align="right" colspan="3"><monospace>72</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>PhonologicalAwareness</monospace></td>
<td valign="top" align="right"><monospace>10.50104</monospace></td>
<td valign="top" align="right"><monospace>8.29014</monospace></td>
<td valign="top" align="right"><monospace>&#x02212;2.21090</monospace></td>
<td valign="top" align="right"><monospace>0.59194</monospace></td>
<td valign="top" align="right"><monospace>&#x02212;3. 73503</monospace></td>
<td valign="top" align="right" colspan="3"><monospace>73</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>Spelling</monospace></td>
<td valign="top" align="right"><monospace>22.14624</monospace></td>
<td valign="top" align="right"><monospace>17.69643</monospace></td>
<td valign="top" align="right"><monospace>&#x02212;4.44981</monospace></td>
<td valign="top" align="right"><monospace>1.11260</monospace></td>
<td valign="top" align="right"><monospace>&#x02212;3. 99946</monospace></td>
<td valign="top" align="right" colspan="3"><monospace>74</monospace></td>
</tr>
<tr>
<td valign="top" colspan="6"/>
<td valign="top" align="right" colspan="3"><monospace>75</monospace></td>
</tr>
<tr>
<td valign="top" colspan="6"><monospace>---------- Cross-group Comparison of Common Scores ----------</monospace></td>
<td valign="top" align="right" colspan="3"><monospace>76</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>&#x000A0;</monospace></td>
<td valign="top" align="right"><monospace>common_1</monospace></td>
<td valign="top" align="right"><monospace>common_2</monospace></td>
<td valign="top" align="right"><monospace>common_d</monospace></td>
<td valign="top" align="right"><monospace>SE_d</monospace></td>
<td valign="top" align="right"><monospace>z_d</monospace></td>
<td valign="top" align="right" colspan="3"><monospace>77</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>Letter_Name</monospace></td>
<td valign="top" align="right"><monospace>39.20010</monospace></td>
<td valign="top" align="right"><monospace>34.77505</monospace></td>
<td valign="top" align="right"><monospace>&#x02212;4.42505</monospace></td>
<td valign="top" align="right"><monospace>1.87963</monospace></td>
<td valign="top" align="right"><monospace>&#x02212;2.35422</monospace></td>
<td valign="top" align="right" colspan="3"><monospace>78</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>Letter_Sound</monospace></td>
<td valign="top" align="right"><monospace>45.65332</monospace></td>
<td valign="top" align="right"><monospace>40.49980</monospace></td>
<td valign="top" align="right"><monospace>&#x02212;5.15351</monospace></td>
<td valign="top" align="right"><monospace>2.18906</monospace></td>
<td valign="top" align="right"><monospace>&#x02212;2.35422</monospace></td>
<td valign="top" align="right" colspan="3"><monospace>79</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>Blending</monospace></td>
<td valign="top" align="right"><monospace>10.50104</monospace></td>
<td valign="top" align="right"><monospace>8.29014</monospace></td>
<td valign="top" align="right"><monospace>&#x02212;2.21090</monospace></td>
<td valign="top" align="right"><monospace>0.59194</monospace></td>
<td valign="top" align="right"><monospace>&#x02212;3.73503</monospace></td>
<td valign="top" align="right" colspan="3"><monospace>80</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>Elision</monospace></td>
<td valign="top" align="right"><monospace>7.11369</monospace></td>
<td valign="top" align="right"><monospace>5.61597</monospace></td>
<td valign="top" align="right"><monospace>&#x02212;1.49772</monospace></td>
<td valign="top" align="right"><monospace>0.40099</monospace></td>
<td valign="top" align="right"><monospace>&#x02212;3.73503</monospace></td>
<td valign="top" align="right" colspan="3"><monospace>81</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>Real_Words</monospace></td>
<td valign="top" align="right"><monospace>22.14624</monospace></td>
<td valign="top" align="right"><monospace>17.69643</monospace></td>
<td valign="top" align="right"><monospace>&#x02212;4.44981</monospace></td>
<td valign="top" align="right"><monospace>1.11260</monospace></td>
<td valign="top" align="right"><monospace>&#x02212;3.99946</monospace></td>
<td valign="top" align="right" colspan="3"><monospace>82</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>Pseudo_Words</monospace></td>
<td valign="top" align="right"><monospace>16.45361</monospace></td>
<td valign="top" align="right"><monospace>13.14762</monospace></td>
<td valign="top" align="right"><monospace>&#x02212;3.30600</monospace></td>
<td valign="top" align="right"><monospace>0.82661</monospace></td>
<td valign="top" align="right"><monospace>&#x02212;3.99946</monospace></td>
<td valign="top" align="right" colspan="3"><monospace>83</monospace></td>
</tr>
<tr>
<td valign="top" colspan="6"/>
<td valign="top" align="right" colspan="3"><monospace>84</monospace></td>
</tr>
<tr>
<td valign="top" colspan="6"><monospace>---------- Cross-group Comparison of Specific Factors ----------</monospace></td>
<td valign="top" align="right" colspan="3"><monospace>85</monospace></td>
</tr>
<tr>
<td/>
<td valign="top" align="right"><monospace>specific_1</monospace></td>
<td valign="top" align="right"><monospace>specific_2</monospace></td>
<td valign="top" align="right"><monospace>specific_d</monospace></td>
<td valign="top" align="right"><monospace>SE_d</monospace></td>
<td valign="top" align="right"><monospace>z_d</monospace></td>
<td valign="top" align="right" colspan="3"><monospace>86</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>Letter_Name</monospace></td>
<td valign="top" align="right"><monospace>6.05990</monospace></td>
<td valign="top" align="right"><monospace>6.54495</monospace></td>
<td valign="top" align="right"><monospace>0.48505</monospace></td>
<td valign="top" align="right"><monospace>0.92562</monospace></td>
<td valign="top" align="right"><monospace>0.52403</monospace></td>
<td valign="top" align="right" colspan="3"><monospace>87</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>Letter_Sound</monospace></td>
<td valign="top" align="right"><monospace>&#x02212;5.20332</monospace></td>
<td valign="top" align="right"><monospace>&#x02212;5.61980</monospace></td>
<td valign="top" align="right"><monospace>&#x02212;0.41649</monospace></td>
<td valign="top" align="right"><monospace>0.79478</monospace></td>
<td valign="top" align="right"><monospace>&#x02212;0.52403</monospace></td>
<td valign="top" align="right" colspan="3"><monospace>88</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>Blending</monospace></td>
<td valign="top" align="right"><monospace>0.40896</monospace></td>
<td valign="top" align="right"><monospace>0.78986</monospace></td>
<td valign="top" align="right"><monospace>0.38090</monospace></td>
<td valign="top" align="right"><monospace>0.21495</monospace></td>
<td valign="top" align="right"><monospace>1.77204</monospace></td>
<td valign="top" align="right" colspan="3"><monospace>89</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>Elision</monospace></td>
<td valign="top" align="right"><monospace>&#x02212;0.60369</monospace></td>
<td valign="top" align="right"><monospace>&#x02212;1.16597</monospace></td>
<td valign="top" align="right"><monospace>&#x02212;0.56228</monospace></td>
<td valign="top" align="right"><monospace>0.31730</monospace></td>
<td valign="top" align="right"><monospace>&#x02212;1.77204</monospace></td>
<td valign="top" align="right" colspan="3"><monospace>90</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>Real_Words</monospace></td>
<td valign="top" align="right"><monospace>1.73376</monospace></td>
<td valign="top" align="right"><monospace>1.54357</monospace></td>
<td valign="top" align="right"><monospace>&#x02212;0.19019</monospace></td>
<td valign="top" align="right"><monospace>0.25533</monospace></td>
<td valign="top" align="right"><monospace>&#x02212;0.74490</monospace></td>
<td valign="top" align="right" colspan="3"><monospace>91</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>Pseudo_Words</monospace></td>
<td valign="top" align="right"><monospace>&#x02212;2.33361</monospace></td>
<td valign="top" align="right"><monospace>&#x02212;2.07762</monospace></td>
<td valign="top" align="right"><monospace>0.25600</monospace></td>
<td valign="top" align="right"><monospace>0.34367</monospace></td>
<td valign="top" align="right"><monospace>0.74490</monospace></td>
<td valign="top" align="right" colspan="3"><monospace>92</monospace></td>
</tr>
</tbody>
</table>
</table-wrap>
<p>Running the R codes on Lines 17 to 25 generates the above output that has eight parts. Part 1 (Lines 26 to 28) contains the results of testing equality of population covariance matrices under NHT. The package <monospace>lavaan</monospace> does not provide such a test so that we developed an R function <monospace>eqMI.covtest()</monospace> to perform this test using the method of Lagrange multiplier. Part 2 (Lines 30 to 42) contains the results of MI under the conventional NHT, including the chi-square and chi-square-difference test statistics along with their degrees of freedom and <italic>p</italic>-values. Part 3 of the output (Lines 44 to 55) are the results of MI under ET, consisting of the T-size &#x003F5;<sub><italic>t</italic></sub>, RMSEA<sub><italic>t</italic></sub>, adjusted cutoff values, and labels of the goodness of fit by comparing RMSEA<sub><italic>t</italic></sub> against the adjusted cutoff values. Note that the results on Line 49 to 55 are based on the chi-square-difference statistics whereas those on Lines 46 to 48 are based on the <italic>T</italic><sub><italic>ml</italic></sub> statistic as reported in Parts 1 and 2.</p>
<p>Part 4 of the output (Lines 57 to 62) contains the results of testing the cross-group equality of means using the projection method and under NHT. The numbers following <monospace>fit.mvmean</monospace> is the results of the Wald test of equality of means of the manifest variables, those following <monospace>fit.common</monospace> and <monospace>fit.specific</monospace> are the results of the Wald tests of the cross-group equality of means of common and specific factors, respectively. Line 62 contains the value of the validity index according to Equation (12). Part 5 (Lines 64 to 68) contains the results of mean comparison by the projection method and under ET, where the T-size &#x003F5;<sub><italic>t</italic></sub> and RMSEA<sub><italic>t</italic></sub> are based on the Wald statistics reported in Part 4. For each of the tests listed in the output, one can extract details such as parameter estimates and standard errors from the resulting R object <monospace>test</monospace> on Line 17.</p>
<p>Parts 6 to 8 (Lines 70 to 92) of the output of <monospace>eqMI.main()</monospace> contain parameter estimates, standard errors and the corresponding <italic>z</italic>-scores under the projection approach. Those corresponding to the differences of the estimates across groups are also included. These are the same under NHT and ET.</p>
</sec>
</sec>
<sec sec-type="results" id="s4">
<title>4. Results</title>
<p>It follows from Line 28 that the equality of population covariance matrices is rejected under NHT at level &#x003B1; &#x0003D; 0.05. According to the results on Line 46, we cannot regard the two population covariance matrices as equal under ET unless we can tolerate a model with RMSEA<sub><italic>t</italic></sub> &#x0003D; 0.141. With the adjusted cutoff value for poor model being at 0.139, the model under equal covariance matrices is worse than poor. Consequently, we reject the hypothesis and conclude that the two population covariance matrices cannot be regarded as equal.</p>
<p>We next turn to the components of the measurement models as represented by Figure <xref ref-type="fig" rid="F1">1</xref>. Under conventional NHT, Lines 33 and 34 indicate that the significance level of the statistic <italic>T</italic><sub><italic>ml</italic></sub> for group 1 (boys ineligible for FRL) is 0.622, and for group 2 (boys eligible for FRL) is 0.100. One would conclude that configural invariance holds in the population under NHT and move to the next step of the analysis. In contrast, under ET, the goodness of fit for group 1 (Line 47) is excellent with RMSEA<sub><italic>t</italic></sub> &#x0003D; 0.097; but that for group 2 (Line 48) is fair with RMSEA<sub><italic>t</italic></sub> &#x0003D; 0.154. Configural invariance is again established under the condition that we are able to tolerate a model with fair fit or RMSEA<sub><italic>t</italic></sub> &#x0003D; 0.154.</p>
<p>Moving to the next analysis of metric invariance (cross-group equality of factor loading matrices <italic>H</italic><sub>&#x003BB;</sub>) under NHT (Line 36), the <italic>p</italic>-value corresponding to the chi-square difference statistic of 4.984 is 0.173, and we conclude that metric invariance holds and move to the next step of the analysis of MI. Under ET, the results on Line 49 indicated that RMSEA<sub><italic>t</italic></sub> &#x0003D; 0.181 and the goodness of fit is fair. Metric invariance is endorsed only we can accept a model of misspecification with RMSEA<sub><italic>t</italic></sub> &#x0003D; 0.181 beyond that in configural invariance.</p>
<p>Following metric invariance, we can next test cross-group equality of variance components (error variances and factor variances-covariances; steps 4a and 5a in Table <xref ref-type="table" rid="T1">1</xref>). Alternatively, we can also move to test scalar invariance and cross-group equality of means of latent constructs (steps 4b&#x02013;6c in Table <xref ref-type="table" rid="T1">1</xref>).</p>
<p>Under conventional NHT, with a <italic>p</italic>-value of 0.001 on Line 37, the chi-square-difference statistic suggests that the hypothesis <italic>H</italic><sub>&#x003C8;</sub> is unlikely to hold. Under ET, results on Line 50 indicate that error variances may not be regarded as equal across the two groups unless we can tolerate a poor model with T-size RMSEA<sub><italic>t</italic></sub> &#x0003D; 0.216.</p>
<p>Move to the mean structure under NHT (Line 39), with a <italic>p</italic>-value of 0.296 for the chi-square-difference statistic, one would conclude that scalar invariance holds in the population. Under ET (Line 52), the T-size RMSEA corresponding to the chi-square-difference statistic for scalar invariance is 0.163, and the model achieved close fit when compared RMSEA<sub><italic>t</italic></sub> against the adjusted cutoff values.</p>
<p>Under NHT, results on Lines 40 to 42 imply that we cannot endorse the cross-group equality of means of the latent constructs (<italic>H</italic><sub>&#x003C4;</sub>) nor that of error variances (<italic>H</italic><sub>&#x003C8;</sub>). Thus, strong invariance is achieved but not strict invariance. Results under ET (Lines 53 to 55) also suggest that strict invariance does not hold unless we can tolerate poor models with RMSEA<sub><italic>t</italic></sub> being above 0.20.</p>
<p>Results on Line 59 is the Wald test for cross-group equality of means of the 6 manifest variables. The results for testing the cross-group equality of means of the common and specific factors by the projection method under NHT (Lines 60 and 61) indicate that the two groups have different means of common factors but their means in specific factors might be equal. Consequently, 98.9% of the squared mean differences for manifest variables is due to mean differences in the three latent constructs: alphabet knowledge, phonological awareness, and spelling, indicating that the six variables are good measures of the literacy skills. The results following the projection method under ET (Lines 67 and 68) indicate that we can endorse <italic>H</italic><sub><italic>e&#x003BD;</italic></sub> and regard the means of the specific factors as being equal across the two groups if a misspecification with RMSEA<sub><italic>t</italic></sub> &#x0003D; 0.168 is tolerable, or be able to accept a fair model. However, we will have to accept a poor model in order to endorse <italic>H</italic><sub><italic>e&#x003BA;</italic></sub> or to tolerate a misspecification with RMSEA<sub><italic>t</italic></sub> &#x0003D; 0.302.</p>
<p>Lines 70 to 92 of the output are the results for the means of the latent, common and specific factors, following the projection approach. Those on Lines 70 to 74 indicate that boys eligible for FRL have significantly smaller means of latent traits. As expected, the two groups are significantly different in the mean of each of the six common scores, with those in the low-SES group being uniformly smaller. In contrast, the two SES groups do not show significant differences on any of the six specific factors, implying that most of the cross-group differences in manifest variables are due to those in latent traits.</p>
<p>For this example, the conventional method of NHT endorses both metric invariance and scalar invariance. However, NHT cannot claim that the two properties hold in the population, since it is designed for rejecting the null hypothesis instead of proving that the null hypothesis holds. In contrast, the method of ET did not conclude cross-group equality of either the factor loadings or intercepts. Instead, ET claims that, with probability of 0.95, the difference between the two factor-loading matrices is less than 0.049 as measured by <italic>F</italic><sub><italic>ml</italic></sub> or less than 0.181 as measured by RMSEA. Similarly, ET claims that, with probability of 0.95, the difference between the two vectors of intercepts is less than 0.040 as measured by <italic>F</italic><sub><italic>ml</italic></sub> or less than 0.163 as measured by RMSEA. With the projection method, ET claims that with probability 0.95 the two vectors of means of specific factors differ by less than 0.042 as measured by <italic>F</italic><sub><italic>gls</italic></sub> or less than 0.168 as measured by the corresponding RMSEA. We are able to endorse metric and scalar invariance only if we can tolerate models with fair fit, and the endorsement is attached with a T-size and a probability.</p>
<p>While the statistic <italic>T</italic><sub><italic>ml</italic></sub> is not significant for the hypothesis of scalar invariance <italic>H</italic><sub>&#x003B3;</sub> in the example, it is rare in practice. The projection method allows us to estimate and compare the means of latent traits as long as metric invariance is endorsed, and a validity index is also provided.</p>
</sec>
<sec sec-type="conclusions" id="s5">
<title>5. Conclusion</title>
<p>In this article, we introduced two recently proposed methods, combined the projection-based method and ET, implemented the new methods in an R package, and illustrated the use of the R package via a real data example. We believe that the development will contribute to the use of the cutting-edge methodology in substantive areas where MI is needed in group comparison. In particular, we recommend that researchers report the results of ET together with those under NHT even if they may not want to abandon the method of NHT in studying MI.</p>
<p>We only illustrated ET in the context of MI in this article. ET is equally applicable in other contexts where NHT has been the dominant methodology, especially in areas where models are needed to account for the relationship among the observed variables (e.g., growth curve modeling, time series analysis, item response models) rather than rejecting the null hypotheses. Recent developments for ET in structural equation modeling include Marcoulides and Yuan (<xref ref-type="bibr" rid="B15">2017</xref>) and Yuan et al. (<xref ref-type="bibr" rid="B34">2016</xref>), where both RMSEA and CFI (Bentler, <xref ref-type="bibr" rid="B1">1990</xref>) can be used for determining the tolerable size of misspecification. ET can also be used for parameter testing, especially when a particular value of the parameter is of special interest (Wellek, <xref ref-type="bibr" rid="B30">2010</xref>).</p>
<p>Throughout the article, we have used RMSEA to quantify the cross-group difference in model parameters. However, Cohen&#x00027;s <italic>d</italic> or standardized mean difference is regularly used in <italic>t</italic>-test and ANOVA. We might adopt Cohen&#x00027;s <italic>d</italic> for ET when quantifying the cross-group differences in the means of latent traits. However, it is not clear how to generalize the standardized mean difference to multiple groups when the covariance matrices of the latent traits are heterogeneous. Correlated latent factors might also cause difficulty with interpretation if we generalize <italic>d</italic> to a multivariate version (Huberty, <xref ref-type="bibr" rid="B7">2002</xref>). Vandenberg and Lance (<xref ref-type="bibr" rid="B29">2000</xref>) discussed the pros and cons of different approaches to mean comparison and recommend using overall model fit indices to assess the appropriateness of imposed invariance constraints.</p>
<p>Like any statistical methodology, ET needs a statistic that approximately follows a central/non-central chi-square or another distribution of known form. When such a distribution is not available, especially when conditions are not met (e.g., non-normally distributed data, missing values), alternative statistics other than <italic>T</italic><sub><italic>ml</italic></sub> might be needed. Bootstrap methodology can also be considered. Further developments are needed in these directions.</p>
</sec>
<sec id="s6">
<title>Author contributions</title>
<p>GJ carried out the project, write the example and the initial draft of the article. YM did the program and coding of the software <monospace>equaltestMI</monospace>. KY directed the project, and finalized the article in writing.</p>
<sec>
<title>Conflict of interest statement</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
</sec>
</body>
<back>
<ack>
<p>The research was supported by the National Science Foundation under Grant No. SES-1461355.</p>
</ack>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bentler</surname> <given-names>P. M.</given-names></name></person-group> (<year>1990</year>). <article-title>Comparative fit indexes in structural models</article-title>. <source>Psychol. Bull.</source> <volume>107</volume>, <fpage>238</fpage>&#x02013;<lpage>246</lpage>. <pub-id pub-id-type="doi">10.1037/0033-2909.107.2.238</pub-id><pub-id pub-id-type="pmid">2320703</pub-id></citation></ref>
<ref id="B2">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Byrne</surname> <given-names>B. M.</given-names></name></person-group> (<year>2010</year>). <source>Structural Equation Modeling with AMOS: Basic Concepts, Applications, and Programming</source>. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Routledge</publisher-name>.</citation></ref>
<ref id="B3">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Byrne</surname> <given-names>B. M.</given-names></name> <name><surname>Shavelson</surname> <given-names>R. J.</given-names></name> <name><surname>Muth&#x000E9;n</surname> <given-names>B.</given-names></name></person-group> (<year>1989</year>). <article-title>Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance</article-title>. <source>Psychol. Bull.</source> <volume>105</volume>, <fpage>456</fpage>&#x02013;<lpage>466</lpage>. <pub-id pub-id-type="doi">10.1037/0033-2909.105.3.456</pub-id></citation></ref>
<ref id="B4">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Deng</surname> <given-names>L.</given-names></name> <name><surname>Yuan</surname> <given-names>K.-H.</given-names></name></person-group> (<year>2016</year>). <article-title>Comparing latent means without mean structure models: a projection-based approach</article-title>. <source>Psychometrika</source> <volume>81</volume>, <fpage>802</fpage>&#x02013;<lpage>829</lpage>. <pub-id pub-id-type="doi">10.1007/s11336-015-9491-8</pub-id><pub-id pub-id-type="pmid">26661857</pub-id></citation></ref>
<ref id="B5">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Gorsuch</surname> <given-names>R. L.</given-names></name></person-group> (<year>1983</year>). <source>Factor Analysis</source>, <edition>2nd Edn</edition>. <publisher-loc>Hillsdale, NJ</publisher-loc>: <publisher-name>Lawrence Erlbaum</publisher-name>.</citation></ref>
<ref id="B6">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Harman</surname> <given-names>H. H.</given-names></name></person-group> (<year>1976</year>). <source>Modern Factor Analysis</source>, <edition>3rd Edn</edition>. <publisher-loc>Chicago, IL</publisher-loc>: <publisher-name>University of Chicago Press</publisher-name>.</citation></ref>
<ref id="B7">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Huberty</surname> <given-names>C. J.</given-names></name></person-group> (<year>2002</year>). <article-title>A history of effect size indices</article-title>. <source>Educ. Psychol. Measur.</source> <volume>62</volume>, <fpage>227</fpage>&#x02013;<lpage>240</lpage>. <pub-id pub-id-type="doi">10.1177/0013164402062002002</pub-id></citation></ref>
<ref id="B8">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Horn</surname> <given-names>J. L.</given-names></name> <name><surname>McArdle</surname> <given-names>J. J.</given-names></name></person-group> (<year>1992</year>). <article-title>A practical and theoretical guide to measurement invariance in aging research</article-title>. <source>Exp. Aging Res.</source> <volume>18</volume>, <fpage>117</fpage>&#x02013;<lpage>144</lpage>. <pub-id pub-id-type="doi">10.1080/03610739208253916</pub-id><pub-id pub-id-type="pmid">1459160</pub-id></citation></ref>
<ref id="B9">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Horn</surname> <given-names>J. L.</given-names></name> <name><surname>McArdle</surname> <given-names>J. J.</given-names></name> <name><surname>Mason</surname> <given-names>R.</given-names></name></person-group> (<year>1983</year>). <article-title>When is invariance not invarient: a practical scientist&#x00027;s look at the ethereal concept of factor invariance</article-title>. <source>South. Psychol.</source> <volume>1</volume>, <fpage>179</fpage>&#x02013;<lpage>188</lpage>. <pub-id pub-id-type="pmid">26828104</pub-id></citation></ref>
<ref id="B10">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>J&#x000F6;reskog</surname> <given-names>K. G.</given-names></name></person-group> (<year>1971</year>). <article-title>Simultaneous factor analysis in several populations</article-title>. <source>Psychometrika</source> <volume>36</volume>, <fpage>409</fpage>&#x02013;<lpage>426</lpage>. <pub-id pub-id-type="doi">10.1007/BF02291366</pub-id></citation></ref>
<ref id="B11">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kim</surname> <given-names>E. S.</given-names></name> <name><surname>Kwok</surname> <given-names>O.-M.</given-names></name> <name><surname>Yoon</surname> <given-names>M.</given-names></name></person-group> (<year>2012</year>). <article-title>Testing factorial invariance in multilevel data: a monte carlo study</article-title>. <source>Struct. Equ. Model. Multidiscipl. J.</source> <volume>19</volume>, <fpage>250</fpage>&#x02013;<lpage>267</lpage>. <pub-id pub-id-type="doi">10.1080/10705511.2012.659623</pub-id></citation></ref>
<ref id="B12">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lai</surname> <given-names>K.</given-names></name> <name><surname>Green</surname> <given-names>S. B.</given-names></name></person-group> (<year>2016</year>). <article-title>The problem with having two watches: assessment of fit when RMSEA and CFI disagree</article-title>. <source>Multivar. Behav. Res.</source> <volume>51</volume>, <fpage>220</fpage>&#x02013;<lpage>239</lpage>. <pub-id pub-id-type="doi">10.1080/00273171.2015.1134306</pub-id><pub-id pub-id-type="pmid">27014948</pub-id></citation></ref>
<ref id="B13">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lee</surname> <given-names>J. A. C.</given-names></name> <name><surname>Al Otaiba</surname> <given-names>S.</given-names></name></person-group> (<year>2015</year>). <article-title>Socioeconomic and gender group differences in early literacy skills: a multiple-group confirmatory factor analysis approach</article-title>. <source>Educ. Res. Eval.</source> <volume>21</volume>, <fpage>40</fpage>&#x02013;<lpage>59</lpage>. <pub-id pub-id-type="doi">10.1080/13803611.2015.1010545</pub-id><pub-id pub-id-type="pmid">25750582</pub-id></citation></ref>
<ref id="B14">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>MacCallum</surname> <given-names>R. C.</given-names></name> <name><surname>Browne</surname> <given-names>M. W.</given-names></name> <name><surname>Sugawara</surname> <given-names>H. M.</given-names></name></person-group> (<year>1996</year>). <article-title>Power analysis and determination of sample size for covariance structure modeling</article-title>. <source>Psychol. Methods</source> <volume>1</volume>, <fpage>130</fpage>&#x02013;<lpage>149</lpage>. <pub-id pub-id-type="doi">10.1037/1082-989X.1.2.130</pub-id></citation></ref>
<ref id="B15">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Marcoulides</surname> <given-names>K. M.</given-names></name> <name><surname>Yuan</surname> <given-names>K.-H.</given-names></name></person-group> (<year>2017</year>). <article-title>New ways to evaluate goodness of fit: a note on using equivalence testing to assess structural equation models</article-title>. <source>Struct. Equ. Model. Multidiscipl. J.</source> <volume>24</volume>, <fpage>148</fpage>&#x02013;<lpage>153</lpage>. <pub-id pub-id-type="doi">10.1080/10705511.2016</pub-id></citation></ref>
<ref id="B16">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Marsh</surname> <given-names>H. W.</given-names></name> <name><surname>Guo</surname> <given-names>J.</given-names></name> <name><surname>Parker</surname> <given-names>P. D.</given-names></name> <name><surname>Nagengast</surname> <given-names>B.</given-names></name> <name><surname>Asparouhov</surname> <given-names>T.</given-names></name> <name><surname>Muth&#x000E9;n</surname> <given-names>B.</given-names></name> <etal/></person-group>. (<year>2017</year>). <article-title>What to do when scalar invariance fails: the extended alignment method for multi-group factor analysis comparison of latent means across many groups</article-title>. <source>Psychol. Methods</source> <volume>21</volume>, <fpage>405</fpage>&#x02013;<lpage>426</lpage>. <pub-id pub-id-type="doi">10.1037/met0000113</pub-id></citation></ref>
<ref id="B17">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mellenbergh</surname> <given-names>G. J.</given-names></name></person-group> (<year>1989</year>). <article-title>Item bias and item response theory</article-title>. <source>Int. J. Educ. Res.</source> <volume>13</volume>, <fpage>127</fpage>&#x02013;<lpage>143</lpage>. <pub-id pub-id-type="doi">10.1016/0883-0355(89)90002-5</pub-id></citation></ref>
<ref id="B18">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Meredith</surname> <given-names>W.</given-names></name></person-group> (<year>1993</year>). <article-title>Measurement invariance, factor analysis and factorial invariance</article-title>. <source>Psychometrika</source> <volume>58</volume>, <fpage>525</fpage>&#x02013;<lpage>543</lpage>. <pub-id pub-id-type="doi">10.1007/BF02294825</pub-id></citation></ref>
<ref id="B19">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Millsap</surname> <given-names>R. E.</given-names></name> <name><surname>Kwok</surname> <given-names>O.-M.</given-names></name></person-group> (<year>2004</year>). <article-title>Evaluating the impact of partial factorial invariance on selection in two populations</article-title>. <source>Psychol. Methods</source> <volume>9</volume>, <fpage>93</fpage>&#x02013;<lpage>115</lpage>. <pub-id pub-id-type="doi">10.1037/1082-989X.9.1.93</pub-id><pub-id pub-id-type="pmid">15053721</pub-id></citation></ref>
<ref id="B20">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Millsap</surname> <given-names>R. E.</given-names></name></person-group> (<year>2011</year>). <source>Statistical Approaches to Measurement Invariance</source>. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Routledge</publisher-name>.</citation></ref>
<ref id="B21">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Piasta</surname> <given-names>S. B.</given-names></name> <name><surname>Wagner</surname> <given-names>R. K.</given-names></name></person-group> (<year>2010</year>). <article-title>Developing early literacy skills: a meta-analysis of alphabet learning and instruction</article-title>. <source>Read. Res. Q.</source> <volume>45</volume>, <fpage>8</fpage>&#x02013;<lpage>38</lpage>. <pub-id pub-id-type="doi">10.1598/RRQ.45.1.2</pub-id><pub-id pub-id-type="pmid">20671801</pub-id></citation></ref>
<ref id="B22">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rosseel</surname> <given-names>Y.</given-names></name></person-group> (<year>2012</year>). <article-title>lavaan: an R package for structural equation modeling</article-title>. <source>J. Statis. Softw.</source> <volume>48</volume>, <fpage>1</fpage>&#x02013;<lpage>36</lpage>. <pub-id pub-id-type="doi">10.18637/jss.v048.i02</pub-id></citation></ref>
<ref id="B23">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schatschneider</surname> <given-names>C.</given-names></name> <name><surname>Fletcher</surname> <given-names>J. M.</given-names></name> <name><surname>Francis</surname> <given-names>D. J.</given-names></name> <name><surname>Carlson</surname> <given-names>C.</given-names></name> <name><surname>Foorman</surname> <given-names>B. R.</given-names></name></person-group> (<year>2004</year>). <article-title>Kindergarten prediction of reading skills: a longitudinal comparative analysis</article-title>. <source>J. Educ. Psychol.</source> <volume>96</volume>, <fpage>265</fpage>&#x02013;<lpage>282</lpage>. <pub-id pub-id-type="doi">10.1037/0022-0663.96.2.265</pub-id></citation></ref>
<ref id="B24">
<citation citation-type="web"><person-group person-group-type="author"><collab>semTools Contributors</collab></person-group> (<year>2016</year>). <source>semTools: Useful Tools for Structural Equation Modeling</source>. R package version 0.4-14. Available online at: <ext-link ext-link-type="uri" xlink:href="https://CRAN.R-project.org/package=semTools">https://CRAN.R-project.org/package=semTools</ext-link></citation></ref>
<ref id="B25">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Snow</surname> <given-names>C. E.</given-names></name></person-group> (<year>2006</year>). <article-title>What counts as early literacy in early childhood?</article-title> in <source>Blackwell Handbook of Early Childhood Development</source>, eds <person-group person-group-type="editor"><name><surname>McCartney</surname> <given-names>K.</given-names></name> <name><surname>Phillips</surname> <given-names>D.</given-names></name></person-group> (<publisher-loc>Malden, MA</publisher-loc>: <publisher-name>Blackwell</publisher-name>), <fpage>274</fpage>&#x02013;<lpage>294</lpage>.</citation></ref>
<ref id="B26">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>S&#x000F6;rbom</surname> <given-names>D.</given-names></name></person-group> (<year>1974</year>). <article-title>A general method for studying differences in factor means and factor structures between groups</article-title>. <source>Br. J. Math. Statist. Psychol.</source> <volume>27</volume>, <fpage>229</fpage>&#x02013;<lpage>239</lpage>. <pub-id pub-id-type="doi">10.1111/j.2044-8317.1974.tb00543.x</pub-id></citation></ref>
<ref id="B27">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Steiger</surname> <given-names>J. H.</given-names></name></person-group> (<year>1998</year>). <article-title>A note on multiple sample extensions of the RMSEA fit index</article-title>. <source>Struct. Equ. Model. Multidiscipl. J.</source> <volume>5</volume>, <fpage>411</fpage>&#x02013;<lpage>419</lpage>. <pub-id pub-id-type="doi">10.1080/10705519809540115</pub-id></citation></ref>
<ref id="B28">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Steiger</surname> <given-names>J. H.</given-names></name> <name><surname>Lind</surname> <given-names>J. C.</given-names></name></person-group> (<year>1980</year>). <article-title>Statistically-based tests for the number of common factors</article-title>, in <source>Paper Presented at the Annual Meeting of the Psychometric Society</source> (<publisher-loc>Iowa City, IA</publisher-loc>).</citation></ref>
<ref id="B29">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Vandenberg</surname> <given-names>R. J.</given-names></name> <name><surname>Lance</surname> <given-names>C. E.</given-names></name></person-group> (<year>2000</year>). <article-title>A review and synthesis of the measurement invariance literature: suggestions, practices, and recommendations for organizational research</article-title>. <source>Organ. Res. Methods</source> <volume>3</volume>, <fpage>4</fpage>&#x02013;<lpage>70</lpage>. <pub-id pub-id-type="doi">10.1177/109442810031002</pub-id></citation></ref>
<ref id="B30">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Wellek</surname> <given-names>S.</given-names></name></person-group> (<year>2010</year>). <source>Testing Statistical Hypotheses of Equivalence and Noninferiority</source>,(<edition>2nd Edn.</edition>,) <publisher-loc>Boca Raton, FL</publisher-loc>: <publisher-name>Chapman &#x00026; Hall/CRC Press LLC</publisher-name>.</citation></ref>
<ref id="B31">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yuan</surname> <given-names>K.-H.</given-names></name> <name><surname>Bentler</surname> <given-names>P. M.</given-names></name></person-group> (<year>2004</year>). <article-title>On chi-square-difference and z tests in mean and covariance structure analysis when the base model is misspecified</article-title>. <source>Educ. Psychol. Measure.</source> <volume>64</volume>, <fpage>737</fpage>&#x02013;<lpage>757</lpage>. <pub-id pub-id-type="doi">10.1177/0013164404264853</pub-id></citation></ref>
<ref id="B32">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yuan</surname> <given-names>K.-H.</given-names></name> <name><surname>Bentler</surname> <given-names>P. M.</given-names></name></person-group> (<year>2006</year>). <article-title>Mean comparison: Manifest variable versus latent variable</article-title>. <source>Psychometrika</source> <volume>71</volume>, <fpage>139</fpage>&#x02013;<lpage>159</lpage>. <pub-id pub-id-type="doi">10.1007/s11336-004-1181-x</pub-id></citation></ref>
<ref id="B33">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yuan</surname> <given-names>K.-H.</given-names></name> <name><surname>Chan</surname> <given-names>W.</given-names></name></person-group> (<year>2016</year>). <article-title>Measurement invariance via multigroup SEM: Issues and solutions with chi-square-difference tests</article-title>. <source>Psychol. Methods</source> <volume>21</volume>, <fpage>405</fpage>&#x02013;<lpage>426</lpage>. <pub-id pub-id-type="doi">10.1037/met0000080</pub-id><pub-id pub-id-type="pmid">27266799</pub-id></citation></ref>
<ref id="B34">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yuan</surname> <given-names>K.-H.</given-names></name> <name><surname>Chan</surname> <given-names>W.</given-names></name> <name><surname>Marcoulides</surname> <given-names>G. A.</given-names></name> <name><surname>Bentler</surname> <given-names>P. M.</given-names></name></person-group> (<year>2016</year>). <article-title>Assessing structural equation models by equivalence testing with adjusted fit Indexes</article-title>. <source>Struct. Equat. Model.</source> <volume>23</volume>, <fpage>319</fpage>&#x02013;<lpage>330</lpage>. <pub-id pub-id-type="doi">10.1080/10705511.2015.1065414</pub-id></citation></ref>
</ref-list>
<app-group>
<app id="A1">
<title>Appendix A</title>
<p>Data files <monospace>Group1.txt</monospace> and <monospace>Group2.txt</monospace> used in the real data example</p>
<p>Group1.txt :</p>
<table-wrap position="float">
<table frame="hsides" rules="groups">
<tbody>
<tr>
<td/>
<td valign="top" align="center"><monospace>LetterName</monospace></td>
<td valign="top" align="center"><monospace>LetterSound</monospace></td>
<td valign="top" align="center"><monospace>Blending</monospace></td>
<td valign="top" align="center"><monospace>Elision</monospace></td>
<td valign="top" align="center"><monospace>Real_Words</monospace></td>
<td valign="top" align="center"><monospace>Pseudo_Words</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>Mean</monospace></td>
<td valign="top" align="center"><monospace>45.26000</monospace></td>
<td valign="top" align="center"><monospace>40.45000</monospace></td>
<td valign="top" align="center"><monospace>10.91000</monospace></td>
<td valign="top" align="center"><monospace>6.51000</monospace></td>
<td valign="top" align="center"><monospace>23.88000</monospace></td>
<td valign="top" align="center"><monospace>14.12000</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>LetterName</monospace></td>
<td valign="top" align="center"><monospace>207.36000</monospace></td>
<td valign="top" align="center"><monospace>159.09696</monospace></td>
<td valign="top" align="center"><monospace>32.58864</monospace></td>
<td valign="top" align="center"><monospace>25.80480</monospace></td>
<td valign="top" align="center"><monospace>61.77600</monospace></td>
<td valign="top" align="center"><monospace>45.07488</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>LetterSound</monospace></td>
<td valign="top" align="center"><monospace>159.0 9696</monospace></td>
<td valign="top" align="center"><monospace>280.22760</monospace></td>
<td valign="top" align="center"><monospace>42.88788</monospace></td>
<td valign="top" align="center"><monospace>36.74765</monospace></td>
<td valign="top" align="center"><monospace>76.12348</monospace></td>
<td valign="top" align="center"><monospace>60.20374</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>Blending</monospace></td>
<td valign="top" align="center"><monospace>32.58864</monospace></td>
<td valign="top" align="center"><monospace>42.88788</monospace></td>
<td valign="top" align="center"><monospace>18.23290</monospace></td>
<td valign="top" align="center"><monospace>10.71258</monospace></td>
<td valign="top" align="center"><monospace>19.05103</monospace></td>
<td valign="top" align="center"><monospace>14.21910</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>Elision</monospace></td>
<td valign="top" align="center"><monospace>25.80480</monospace></td>
<td valign="top" align="center"><monospace>36.74765</monospace></td>
<td valign="top" align="center"><monospace>10.71258</monospace></td>
<td valign="top" align="center"><monospace>20.07040</monospace></td>
<td valign="top" align="center"><monospace>20.37235</monospace></td>
<td valign="top" align="center"><monospace>16.70861</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>Real_Words</monospace></td>
<td valign="top" align="center"><monospace>61.77600</monospace></td>
<td valign="top" align="center"><monospace>76.12348</monospace></td>
<td valign="top" align="center"><monospace>19.05103</monospace></td>
<td valign="top" align="center"><monospace>20.37235</monospace></td>
<td valign="top" align="center"><monospace>73.61640</monospace></td>
<td valign="top" align="center"><monospace>47.42852</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>Pseudo_Words</monospace></td>
<td valign="top" align="center"><monospace>45.07488</monospace></td>
<td valign="top" align="center"><monospace>60.20374</monospace></td>
<td valign="top" align="center"><monospace>14.21910</monospace></td>
<td valign="top" align="center"><monospace>16.70861</monospace></td>
<td valign="top" align="center"><monospace>47.42852</monospace></td>
<td valign="top" align="center"><monospace>44.35560</monospace></td>
</tr>
</tbody>
</table>
</table-wrap>
<p>Group2 . txt :</p>
<table-wrap position="float">
<table frame="hsides" rules="groups">
<tbody>
<tr>
<td/>
<td valign="top" align="center"><monospace>Letter_Name</monospace></td>
<td valign="top" align="center"><monospace>Letter_Sound</monospace></td>
<td valign="top" align="center"><monospace>Blending</monospace></td>
<td valign="top" align="center"><monospace>Elision</monospace></td>
<td valign="top" align="center"><monospace>Real_Words</monospace></td>
<td valign="top" align="center"><monospace>Pseudo_Words</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>Mean</monospace></td>
<td valign="top" align="center"><monospace>41. 32000</monospace></td>
<td valign="top" align="center"><monospace>34.8800</monospace></td>
<td valign="top" align="center"><monospace>9.080000</monospace></td>
<td valign="top" align="center"><monospace>4.450000</monospace></td>
<td valign="top" align="center"><monospace>19.24000</monospace></td>
<td valign="top" align="center"><monospace>11.07000</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>Letter_Name</monospace></td>
<td valign="top" align="center"><monospace>295.84000</monospace></td>
<td valign="top" align="center"><monospace>232.2000</monospace></td>
<td valign="top" align="center"><monospace>38.995840</monospace></td>
<td valign="top" align="center"><monospace>20.173880</monospace></td>
<td valign="top" align="center"><monospace>67.59256</monospace></td>
<td valign="top" align="center"><monospace>57.77136</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>Letter_Sound</monospace></td>
<td valign="top" align="center"><monospace>232.20000</monospace></td>
<td valign="top" align="center"><monospace>324.0000</monospace></td>
<td valign="top" align="center"><monospace>43.164000</monospace></td>
<td valign="top" align="center"><monospace>22.824000</monospace></td>
<td valign="top" align="center"><monospace>77.95440</monospace></td>
<td valign="top" align="center"><monospace>60.45840</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>Blending</monospace></td>
<td valign="top" align="center"><monospace>38.99584</monospace></td>
<td valign="top" align="center"><monospace>43.1640</monospace></td>
<td valign="top" align="center"><monospace>19.009600</monospace></td>
<td valign="top" align="center"><monospace>9.260204</monospace></td>
<td valign="top" align="center"><monospace>23.42802</monospace></td>
<td valign="top" align="center"><monospace>16.27152</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>Elision</monospace></td>
<td valign="top" align="center"><monospace>20.17388</monospace></td>
<td valign="top" align="center"><monospace>22.8240</monospace></td>
<td valign="top" align="center"><monospace>9.260204</monospace></td>
<td valign="top" align="center"><monospace>10.048900</monospace></td>
<td valign="top" align="center"><monospace>15.25404</monospace></td>
<td valign="top" align="center"><monospace>11.04174</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>Real_Words</monospace></td>
<td valign="top" align="center"><monospace>67.59256</monospace></td>
<td valign="top" align="center"><monospace>77.9544</monospace></td>
<td valign="top" align="center"><monospace>23.428024</monospace></td>
<td valign="top" align="center"><monospace>15.254040</monospace></td>
<td valign="top" align="center"><monospace>64.32040</monospace></td>
<td valign="top" align="center"><monospace>38.41099</monospace></td>
</tr>
<tr>
<td valign="top" align="left"><monospace>Pseudo_Words</monospace></td>
<td valign="top" align="center"><monospace>57.77136</monospace></td>
<td valign="top" align="center"><monospace>60.4584</monospace></td>
<td valign="top" align="center"><monospace>16.271520</monospace></td>
<td valign="top" align="center"><monospace>11.041744</monospace></td>
<td valign="top" align="center"><monospace>38.41099</monospace></td>
<td valign="top" align="center"><monospace>38.68840</monospace></td>
</tr>
</tbody>
</table>
</table-wrap>
</app>
</app-group>
<fn-group>
<fn id="fn0001"><p><sup>1</sup>Even if MI does not hold literally, the violation against MI is small enough that we can comfortably ignore it.</p></fn>
<fn id="fn0002"><p><sup>2</sup>The value of the conventional RMSEA is computed according to the value of the observed test statistic <italic>T</italic><sub><italic>ml</italic></sub> whereas RMSEA<sub>0</sub> in Equation (5) is related to the value of &#x003F5;<sub>0</sub> in Equation (3) or &#x003F5;<sub>0<italic>ab</italic></sub> in Equation (4), and is used for the purpose of ET.</p></fn>
<fn id="fn0003"><p><sup>3</sup>These cutoff values are necessary for labeling the goodness of model fit but may be of limited scientific value (see Lai and Green, <xref ref-type="bibr" rid="B12">2016</xref>).</p></fn>
<fn id="fn0004"><p><sup>4</sup>Wald statistics are typically formulated via generalized least squares (GLS), and are commonly called GLS statistics in the psychometric literature.</p></fn>
<fn id="fn0005"><p><sup>5</sup>Note that the ncp &#x003B4;<sub>0</sub>, RMSEA<sub>0</sub> and RMSEA<sub><italic>t</italic></sub> corresponding to the Wald statistic <italic>T</italic><sub><italic>gls</italic></sub> might be different from that corresponding to <italic>T</italic><sub><italic>ml</italic></sub> for a given condition of misspecification. But their difference is tiny unless the model is severely misspecified.</p></fn>
</fn-group>
</back>
</article>
