<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" article-type="research-article" dtd-version="2.3">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Psychol.</journal-id>
<journal-title>Frontiers in Psychology</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Psychol.</abbrev-journal-title>
<issn pub-type="epub">1664-1078</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fpsyg.2022.852995</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Psychology</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Age-Specific Activation Patterns and Inter-Subject Similarity During Verbal Working Memory Maintenance and Cognitive Reserve</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name>
<surname>Habeck</surname>
<given-names>Christian</given-names>
</name>
<xref rid="c001" ref-type="corresp"><sup>&#x002A;</sup></xref>
<uri xlink:href="https://loop.frontiersin.org/people/142009/overview"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Gazes</surname>
<given-names>Yunglin</given-names>
</name>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Stern</surname>
<given-names>Yaakov</given-names>
</name>
<uri xlink:href="https://loop.frontiersin.org/people/13475/overview"/>
</contrib>
</contrib-group>
<aff><institution>Cognitive Neuroscience Division, Department of Neurology, Columbia University Irving Medical Center</institution>, <addr-line>New York, NY</addr-line>, <country>United States</country>
</aff>
<author-notes>
<fn id="fn0001" fn-type="edited-by">
<p>Edited by: Eirini Mavritsaki, Birmingham City University, United Kingdom</p>
</fn>
<fn id="fn0002" fn-type="edited-by">
<p>Reviewed by: Michael Motes, The University of Texas at Dallas, United States; Timothy Michael Ellmore, City College of New York (CUNY), United States</p>
</fn>
<corresp id="c001">&#x002A;Correspondence: Christian Habeck, <email>ch629@columbia.edu</email></corresp>
<fn id="fn0003" fn-type="other">
<p>This article was submitted to Cognition, a section of the journal Frontiers in Psychology</p>
</fn>
</author-notes>
<pub-date pub-type="epub">
<day>09</day>
<month>06</month>
<year>2022</year>
</pub-date>
<pub-date pub-type="collection">
<year>2022</year>
</pub-date>
<volume>13</volume>
<elocation-id>852995</elocation-id>
<history>
<date date-type="received">
<day>11</day>
<month>01</month>
<year>2022</year>
</date>
<date date-type="accepted">
<day>16</day>
<month>05</month>
<year>2022</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x00A9; 2022 Habeck, Gazes and Stern.</copyright-statement>
<copyright-year>2022</copyright-year>
<copyright-holder>Habeck, Gazes and Stern</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p>
</license>
</permissions>
<abstract>
<p>Cognitive Reserve (CR), according to a recent consensus definition of the NIH-funded Reserve and Resilience collaboratory,<xref rid="fn0004" ref-type="fn"><sup>1</sup></xref> is constituted by any mechanism contributing to cognitive performance beyond, or interacting with, brain structure in the widest sense. To identity multivariate activation patterns fulfilling this postulate, we investigated a verbal Sternberg fMRI task and imaged 181 people with age coverage in the ranges 20&#x2013;30 (44 participants) and 55&#x2013;70 (137 participants). Beyond task performance, participants were characterized in terms of demographics, and neuropsychological assessments of vocabulary, episodic memory, perceptual speed, and abstract fluid reasoning. Participants studied an array of either one, three, or six upper-case letters for 3&#x2009;s (=encoding phase), then a blank fixation screen was presented for 7&#x2009;s (=maintenance phase), to be probed with a lower-case letter to which they responded with a differential button press whether the letter was part of the studied array or not (=retrieval phase). We focused on identifying maintenance-related activation patterns showing memory load increases in pattern score on an individual participant level for both age groups. We found such a pattern that increased with memory load for all but one person in the young participants (<italic>p</italic>&#x2009;&#x003C;&#x2009;0.001), and such a pattern for all participants in the older group (<italic>p</italic>&#x2009;&#x003C;&#x2009;0.001). Both patterns showed broad topographic similarities; however, relationships to task performance and neuropsychological characteristics were markedly different and point to individual differences in Cognitive Reserve. Beyond the derivation of group-level activation patterns, we also investigated the inter-subject spatial similarity of individual working memory rehearsal patterns in the older participants&#x2019; group as a function of neuropsychological and task performance, education, and mean cortical thickness. Higher task accuracy and neuropsychological function was reliably associated with higher inter-subject similarity of individual-level activation patterns in older participants.</p>
</abstract>
<kwd-group>
<kwd>cognitive reserve</kwd>
<kwd>fMRI</kwd>
<kwd>multivariate analysis</kwd>
<kwd>verbal working memory</kwd>
<kwd>inter-subject similarity</kwd>
</kwd-group>
<contract-num rid="cn1">R01AG026158</contract-num>
<contract-sponsor id="cn1">NIH</contract-sponsor>
<counts>
<fig-count count="3"/>
<table-count count="3"/>
<equation-count count="3"/>
<ref-count count="59"/>
<page-count count="12"/>
<word-count count="8294"/>
</counts>
</article-meta>
</front>
<body>
<sec id="sec1" sec-type="intro">
<title>Introduction</title>
<p>The objective of the current study was to use the well-studied letter Working-Memory Sternberg task (<xref ref-type="bibr" rid="ref6">Braver et al., 1997</xref>; <xref ref-type="bibr" rid="ref8">Cohen et al., 1997</xref>; <xref ref-type="bibr" rid="ref25">Jonides et al., 1997</xref>; <xref ref-type="bibr" rid="ref28">Manoach et al., 1997</xref>; <xref ref-type="bibr" rid="ref47">Smith and Jonides, 1997</xref>, <xref ref-type="bibr" rid="ref48">1998</xref>; <xref ref-type="bibr" rid="ref49">Smith et al., 1998</xref>; <xref ref-type="bibr" rid="ref9">D'Esposito et al., 1999</xref>, <xref ref-type="bibr" rid="ref10">2000</xref>; <xref ref-type="bibr" rid="ref32">Postle and D&#x2019;Esposito, 1999</xref>; <xref ref-type="bibr" rid="ref45">Rypma et al., 1999</xref>, <xref ref-type="bibr" rid="ref44">2001</xref>, <xref ref-type="bibr" rid="ref40">2002</xref>; <xref ref-type="bibr" rid="ref41">Rypma and D&#x2019;Esposito, 1999</xref>, <xref ref-type="bibr" rid="ref42">2000</xref>, <xref ref-type="bibr" rid="ref43">2003</xref>; <xref ref-type="bibr" rid="ref33">Postle et al., 2000a</xref>,<xref ref-type="bibr" rid="ref34">b</xref>) to investigate the associated activation patterns as possible mechanism of Cognitive Reserve (CR). Cognitive Reserve and its contributions to, and inputs from, working memory has been the focus of numerous investigations to date. When considering this body of work, it is important to keep in mind the conceptual definition of Cognitive Reserve, recently clarified in the framework of the NIH-funded &#x201C;Reserve and Resilience&#x201D; collaboratory.<xref rid="fn0005" ref-type="fn"><sup>2</sup></xref> The framework postulates that CR is a property or mechanism that explains cognitive performance beyond brain developmental changes and pathology, and literally reads &#x201C;CR is a property of the brain that allows for cognitive performance that is better than expected given the degree of life course-related brain changes and brain injury or disease.&#x201D; Cognitive Reserve is thus a <italic>relational</italic> construct, whose ascertainment is impossible without a cognitive endpoint and a measure that captures at least one aspect of brain health or pathology. Colloquially speaking, CR encompasses mechanisms that explain cognitive performance <italic>beyond the influence of brain status</italic>. In the face of this updated definition, most of the Cognitive Reserve studies to date are wanting and present a significant knowledge gap in the extant literature.</p>
<p>There have been numerous studies linking Cognitive Reserve to working memory. In keeping with the definition introduced before, when no brain imaging is present to quantify brain health, such studies necessarily only deal with CR <italic>proxies</italic>, like, for instance, education, leisure activities, occupational attainment, reading ability etc. Such factors, discussed in a recent systematic review (<xref ref-type="bibr" rid="ref50">Song et al., 2022</xref>), <italic>might</italic> indeed constitute Cognitive Reserve in the sense of the framework&#x2019;s stricter definition introduced above, but they cannot isolate the mediating mechanism of Cognitive Reserve conclusively beyond brain structural confounds. Superior brain health resulting in better cognition does not strictly qualify as CR and can happen in an orthogonal manner (<xref ref-type="bibr" rid="ref21">Habeck et al., 2017</xref>). For the proper ascertainment of the presence and nature of CR, the recording of brain structural information is thus crucial but has rarely been undertaken, presenting a large gap in the field (See extensive literature review in the Discussion section.).</p>
<p>Since the most proximate cause of cognitive performance, and thus the obvious implementation of Cognitive Reserve, is the underlying brain activation, we wanted to repeat an age-specific derivation of load-related activation pattern, using the analytic framework in some of our earlier work in fMRI studies of verbal and non-verbal WM (<xref ref-type="bibr" rid="ref18">Habeck et al., 2004</xref>, <xref ref-type="bibr" rid="ref19">2005b</xref>, <xref ref-type="bibr" rid="ref20">2012</xref>). We focused on the spatial activation patterns underlying the maintenance of verbal material. In contrast to our earlier work, age was considered explicitly in the analysis by looking at separate age groups, and relations between pattern scores, age, task performance, and general cognitive functioning were probed after derivation of the load-related maintenance pattern within each group.</p>
<p>We then wanted to test whether these activation patterns fulfilled the postulates of strict tenets of CR(<xref ref-type="bibr" rid="ref52">Stern, 2002</xref>, <xref ref-type="bibr" rid="ref53">2009</xref>; <xref ref-type="bibr" rid="ref55">Stern et al., 2019</xref>, <xref ref-type="bibr" rid="ref54">2020</xref>; <xref ref-type="bibr" rid="ref56">Stern and Barulli, 2019</xref>). Since task performance was not used in the pattern derivation, the relationship of pattern utilization to task performance was likewise unconstrained. Pattern utilization could either display a positive or negative relationship with performance, or none. Significant relationships of the load-related maintenance pattern with task performance, beyond that accounted for by brain structure, would qualify as a manifestation of Cognitive Reserve. A negative sign of the relationship would indicate higher efficiency and indicate that better performing participants increase the load-related utilization of the pattern to a lesser degree than poorer performers. A positive sign, on the other hand, would indicate higher capacity in the better performers. Bivariate relationships with neuropsychological performance with the same sign as the relationship to task performance would likewise strengthen the CR interpretation.</p>
<p>Lastly, we were interested in widening our focus and considered the similarity of subject-level activation maps as a function of age, mean cortical thickness, task, and neuropsychological performance, without conducting any group-level pattern derivation. Beforehand, we had no expectation whether higher similarity (=lower inter-individual variability) of activation maps was associated with poorer or better performance or brain health. If conforming to a group-specific &#x201C;template&#x201D; is beneficial for performance, we might expect that better performing participants show higher inter-subject similarity. On the other hand, it is also conceivable, particularly for crystallized abilities, those individual neural strategies and their corresponding activation maps have been honed over a lifetime by high performers, and that consequently <italic>lesser</italic> inter-subject similarity might be expected. We investigated these possibilities by rigorous comparison of inter-subject similarities as a function of a variety of performance measures, age, education, and mean cortical thickness. Higher similarity can be seen as better robustness and lower variability of the topographic composition of the load-related patterns. <italic>A priori</italic> it was not clear whether such higher similarity would be associated positively or negatively with cognitive performance, brain structure, or younger age.</p>
<p>We summarize the addressable knowledge gap and its motivation for the current study: Cognitive Reserve has not been probed rigorously (i.e., comporting with the requirements of the recently funded NIH collaboratory about Reserve and Resilience) for working memory studies, and many studies have looked at the influence of <italic>proxies</italic>, rather than isolating mechanisms which influence cognitive performance beyond brain structural covariates. One obvious proximate mechanism that fulfills the strict Cognitive Reserve requirements would be task-related activation patterns whose pattern scores account for cognitive performance beyond brain structural variables. We aimed to test for the presence of such patterns and probe their association with traditional CR proxies, like education.</p>
</sec>
<sec id="sec2" sec-type="materials|methods">
<title>Materials and Methods</title>
<sec id="sec3">
<title>Participant Sample and Demographics</title>
<p>Analyses included data from 181 strongly right-handed, native English-speaking healthy adults. Participants were recruited <italic>via</italic> random market mailing and screened for MRI contraindications and hearing or visual impairment that would impede testing. Older adult participants were additionally screened to eliminate those with dementia or mild cognitive impairment. Other exclusion criteria included: myocardial Infarction, congestive heart failure or any other heart disease, and brain disorder, such as stroke, tumor, infection, epilepsy, multiple sclerosis, degenerative diseases, head injury (loss of consciousness&#x2009;&#x003E;&#x2009;5&#x2009;min), intellectual disability, seizure, Parkinson&#x2019;s disease, Huntington&#x2019;s disease, normal pressure hydrocephalus, essential/familial tremor, Down Syndrome, HIV Infection or AIDS diagnosis, learning disability/dyslexia, ADHD or ADD, uncontrolled hypertension, uncontrolled diabetes mellitus, uncontrolled thyroid or other endocrine disease, uncorrectable vision, color blindness, uncorrectable hearing and implant, any medication targeting central nervous system, cancer within last 5&#x2009;years, renal insufficiency, untreated neurosyphilis, any alcohol and drug abuse within last 12&#x2009;month, recent non-skin neoplastic disease or melanoma, active hepatic disease, insulin dependent diabetes, any history of psychosis or ECT, recent (past 5&#x2009;years) major depressive, bipolar, or anxiety disorder, objective cognitive impairment (dementia rating scale of &#x003C;130), and subjective functional impairment (BFAS&#x2009;&#x003E;&#x2009;1). A complete description of the participants in terms of demographics and cortical thickness can be found in <xref rid="tab1" ref-type="table">Table 1</xref>.</p>
<table-wrap position="float" id="tab1">
<label>Table 1</label>
<caption><p>Subject sample characteristics.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th/>
<th align="center" valign="middle">Younger group</th>
<th align="center" valign="middle">Older group</th>
<th align="center" valign="middle">Younger&#x2009;&#x2260;&#x2009;Older group?</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top">Age (mean&#x2009;&#x00B1;&#x2009;STD in years)</td>
<td align="center" valign="top">26.0&#x2009;&#x00B1;&#x2009;2.9</td>
<td align="center" valign="top"><bold>64.8&#x2009;&#x00B1;&#x2009;3.2</bold></td>
<td align="center" valign="top"><italic>p</italic>(<italic>t</italic>-test)&#x2009;&#x003C;&#x2009;0.0001</td>
</tr>
<tr>
<td align="left" valign="top">Education (mean&#x2009;&#x00B1;&#x2009;STD in years)</td>
<td align="center" valign="top">15.7&#x2009;&#x00B1;&#x2009;1.9</td>
<td align="center" valign="top">16.1&#x2009;&#x00B1;&#x2009;2.4</td>
<td align="center" valign="top"><italic>p</italic>(<italic>t</italic>-test)&#x2009;=&#x2009;0.11</td>
</tr>
<tr>
<td align="left" valign="top">NART-IQ (mean&#x2009;&#x00B1;&#x2009;STD)</td>
<td align="center" valign="top">114.3&#x2009;&#x00B1;&#x2009;7.5</td>
<td align="center" valign="top"><bold>118.3&#x2009;&#x00B1;&#x2009;8.7</bold></td>
<td align="center" valign="top"><italic>p</italic>(<italic>t</italic>-test)&#x2009;=&#x2009;0.0058</td>
</tr>
<tr>
<td align="left" valign="top">Mean cortical thickness (mean&#x2009;&#x00B1;&#x2009;STD in mm)</td>
<td align="center" valign="top"><bold>2.64&#x2009;&#x00B1;&#x2009;0.11</bold></td>
<td align="center" valign="top">2.50&#x2009;&#x00B1;&#x2009;0.11</td>
<td align="center" valign="top"><italic>p</italic>(<italic>t</italic>-test)&#x2009;&#x003C;&#x2009;0.0001</td>
</tr>
<tr>
<td align="left" valign="top">Sex (#Women, #Men)</td>
<td align="center" valign="top">31&#x2009;W, 13&#x2009;M</td>
<td align="center" valign="top">77&#x2009;W, 60&#x2009;M</td>
<td align="center" valign="top"><italic>p</italic>(Fisher exact)&#x2009;=&#x2009;0.11</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p>Bold values indicate a statistically significant difference between age groups at <italic>p</italic>&#x2009;&#x003C;&#x2009;0.05.</p>
</table-wrap-foot>
</table-wrap>
</sec>
<sec id="sec4">
<title>Neuropsychological Assessment</title>
<p>All participants completed a standardized battery of neuropsychological assessments, and tasks were administered in the following order: Wechsler Adult Intelligence Scale (WAIS-III; <xref ref-type="bibr" rid="ref57">Wechsler, 1997</xref>), Letter-Number Sequencing, American National Adult Reading Test (AMNART; <xref ref-type="bibr" rid="ref57">Wechsler, 1997</xref>), Selective Reminding Task (SRT) immediate recall (<xref ref-type="bibr" rid="ref7">Buschke and Fuld, 1974</xref>), WAIS-III Matrix Reasoning (<xref ref-type="bibr" rid="ref57">Wechsler, 1997</xref>), SRT delayed recall and delayed recognition (<xref ref-type="bibr" rid="ref7">Buschke and Fuld, 1974</xref>), WAIS-III Digit Symbol (<xref ref-type="bibr" rid="ref57">Wechsler, 1997</xref>), Trail-Making Test versions A and B (TMT-A/B; <xref ref-type="bibr" rid="ref36">Reitan, 1978</xref>), Controlled Word Association (C-F-L) and Category Fluency (animals; <xref ref-type="bibr" rid="ref5">Benton et al., 1983</xref>), Stroop Color Word Test (<xref ref-type="bibr" rid="ref14">Golden, 1975</xref>), Wechsler Test of Adult Reading (WTAR; <xref ref-type="bibr" rid="ref22">Holdnack, 2001</xref>), WAIS-III Vocabulary (<xref ref-type="bibr" rid="ref57">Wechsler, 1997</xref>), and WAIS-III Block Design (<xref ref-type="bibr" rid="ref57">Wechsler, 1997</xref>). Based on a prior analysis in our lab assessing the factor structure of these tasks, four domain scores were generated by <italic>z</italic>-scoring all tests relative to the full baseline sample, and averaging task <italic>z</italic>-scores within each domain: Episodic Memory (all SRT outcomes), Vocabulary (WAIS Vocabulary, WTAR, and AMNART), Processing Speed (WAIS Digit Symbol, Stroop Color, Stroop Color Word, and TMT-A), and Fluid Reasoning (WAIS Matrix Reasoning, WAIS Block Design, and TMT-B). The primary outcome measures used in the present study included the domain <italic>z</italic>-scores for all four cognitive domains. A further average of these four scores was performed to yield a score for total cognition (=G).</p>
</sec>
<sec id="sec5">
<title>MRI Data Acquisition</title>
<p>A high-resolution structural and fMRI BOLD images of the human brain were acquired in an event-related design using a 3.0&#x2009;T Philips Achieva Magnet with standard quadrature head coil.</p>
<sec id="sec6">
<title>Structural MRI Acquisition and Processing</title>
<p>Each participant&#x2019;s structural T1 scans were reconstructed using FreeSurfer v5.1.<xref rid="fn0006" ref-type="fn"><sup>3</sup></xref> The accuracy of FreeSurfer&#x2019;s subcortical segmentation and cortical parcellation (<xref ref-type="bibr" rid="ref12">Fischl et al., 2002</xref>, <xref ref-type="bibr" rid="ref13">2004</xref>) has been reported to be comparable to manual labeling. Each participant&#x2019;s white and gray matter boundaries, as well as gray matter and cerebral spinal fluid boundaries, were visually inspected slice by slice, and manual control points were added in case of any visible discrepancy. Boundary reconstruction was repeated until satisfactory results for every participant were reached. The subcortical structure borders were plotted by TkMedit visualization tools and compared against the actual brain regions. In case of discrepancy, they were corrected manually. We took the mean cortical thickness measures reported for both hemispheres and averaged them, to arrive at one global measure per participant.</p>
</sec>
<sec id="sec7">
<title>fMRI Acquisition of the Sternberg Working Memory Task</title>
<p>Functional data were acquired in three runs, each of which included collection of 314 functional volumes using a T2&#x002A;-weighted gradient-echo echo planar image sequence. About 36 transverse slices per volume with 3.0&#x2009;mm thickness and no gap in between were acquired using a field echo echo planar imaging (FE&#x2013;EPI) sequence with the following parameters: TR 2,000&#x2009;ms, TE 20&#x2009;ms, and flip angle 72; in-plane acquisition matrix 112&#x2009;&#x00D7;&#x2009;112 matrix; which results in a voxel size 2.0&#x2009;mm&#x2009;&#x00D7;&#x2009;2.0&#x2009;mm&#x2009;&#x00D7;&#x2009;3.0&#x2009;mm.</p>
<p>Task stimuli were back-projected onto a screen located at the foot of the MRI bed using an LCD projector. Participants viewed the screen <italic>via</italic> a mirror system located in the head coil and, if needed, had vision corrected to normal using MR compatible glasses (manufactured by SafeVision, LLC. Webster Groves, MO, United States). Task administration and collection of behavioral data were conducted using PsyScope 5X B53 (<xref ref-type="bibr" rid="ref27">Macwhinney et al., 1997</xref>). Task onset was electronically synchronized with the MRI acquisition computer.</p>
</sec>
</sec>
<sec id="sec8">
<title>Letter Sternberg task</title>
<p>Participants studied an array of either one, three, or six upper-case letters for 3&#x2009;s (=encoding phase), then a fixation screen was presented for 7&#x2009;s (=maintenance phase), to be probed with a lower-case letter, presented for 3&#x2009;s. Participants were told to respond as quickly as possible with a differential button press whether the letter was part of the studied array or not (=retrieval phase). The probe letter remained on screen for the full 3&#x2009;s regardless of response time. For the current study, we only focused on the maintenance phase.</p>
</sec>
<sec id="sec9">
<title>Sternberg Task fMRI Data Processing</title>
<sec id="sec10">
<title>Subject-Level Pre-processing</title>
<p>FMRIB Software Library v5.0 (FSL) and custom-written Python code were used to perform the following pre-processing steps for each participant&#x2019;s dataset: All functional images were realigned to the first volume, corrected for the order of slice acquisition, smoothed with a 5&#x2009;mm<sup>3</sup> non-linear kernel followed by intensity normalization, and high-pass filtered using a Gaussian kernel and cutoff frequency of 0.008&#x2009;Hz. For spatial normalization, the accompanying T1-weighted high-resolution anatomic image was co-registered to the first functional volume using the mutual information co-registration algorithm implemented in FLIRT. This co-registered high-resolution image was then registered to MNI standardized space. These obtained transformation parameters were used to transfer the statistical parametric maps of the subject-level analysis to standard space.</p>
<p>The fMRI time series data were pre-whitened to explicitly correct for intrinsic autocorrelations in the data. The FEAT module (<xref ref-type="bibr" rid="ref58">Woolrich et al., 2001</xref>) in FSL was used for first-level analysis. An event-related design was used to model the fMRI data, allowing us to separate timeouts (where no response was made), correct and incorrect trials, task loads (<xref ref-type="bibr" rid="ref6">Braver et al., 1997</xref>; <xref ref-type="bibr" rid="ref25">Jonides et al., 1997</xref>; <xref ref-type="bibr" rid="ref48">Smith and Jonides, 1998</xref>), and task phases (encoding, maintenance, and retrieval). Incorrect responses and timeouts were modeled together. For all participants, a first-level analysis was run on each of their task-based runs with nine regressors: 3 task loads&#x2009;&#x00D7;&#x2009;3 task phases. The regressors were generated by convolving FSL&#x2019;s double gamma canonical HRF with the duration of the respective task phases: encoding&#x2009;=&#x2009;3&#x2009;s, maintenance&#x2009;=&#x2009;7&#x2009;s, and retrieval&#x2009;=&#x2009;RT. A second level analysis was run on each participant by combining the first-level contrasts for each run. Contrasts for the retention phase of the three memory loads, 1, 3, and 6, were used in subsequent analysis.</p>
</sec>
</sec>
<sec id="sec11">
<title>Ordinal Trend Canonical Variates Analysis and Brain-Behavioral Analysis</title>
<p>We first identified a memory load-related activation pattern during the retention (=maintenance) period. We applied Ordinal Trend Canonical Variates (OrT-CVA) analysis (<xref ref-type="bibr" rid="ref18">Habeck et al., 2004</xref>, <xref ref-type="bibr" rid="ref17">2005a</xref>) to derive a group-level activation pattern that shows an increase in pattern expression during the retention period with memory load on an individual subject level. We can write the multivariate decomposition achieved by OrT-CVA as follows. The derived activation pattern will be written as <italic>v</italic>, and participant S&#x2019;s activation map for memory load L can be written as the indexed column vector <italic>y</italic>(S,L). This activation map can be written as the product of the group-level activation pattern with a subject- and load-dependent factor score w(S,L) and some unaccounted residual &#x03B5;:</p>
<disp-formula id="E1">
<mml:math id="M1">
<mml:mi>y</mml:mi>
<mml:mfenced open="(" close=")" separators=",">
<mml:mi mathvariant="normal">S</mml:mi>
<mml:mi mathvariant="normal">L</mml:mi>
</mml:mfenced>
<mml:mo>=</mml:mo>
<mml:mi>w</mml:mi>
<mml:mfenced open="(" close=")" separators=",">
<mml:mi mathvariant="normal">S</mml:mi>
<mml:mi mathvariant="normal">L</mml:mi>
</mml:mfenced>
<mml:mspace width="thickmathspace"/>
<mml:mi>v</mml:mi>
<mml:mo>+</mml:mo>
<mml:mi>&#x03B5;</mml:mi>
</mml:math>
</disp-formula>
<p>Ordinal Trend Canonical Variates puts constraints on the factor score <italic>w</italic>(S,L) and derives an activation pattern whose factor score shows a positive within-person relationship with memory load for as many participants as possible, with an inferential framework for ascertaining significance through a permutation test.</p>
<p>For the estimation of topographic robustness, a bootstrap estimation procedure was conducted which resampled all participants and performed the OrT-CVA point estimate procedure on the resampled data 500 times. A topographic <italic>Z</italic>-map was approximated semi-parametrically by computing the bootstrap variability as a SD around the point estimate, and dividing the point estimate by this SD as.</p>
<disp-formula id="E2">
<mml:math id="M2">
<mml:mi>Z</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mi mathvariant="normal">voxel</mml:mi>
</mml:mfenced>
<mml:mo>=</mml:mo>
<mml:mi mathvariant="normal">point estimate loading</mml:mi>
<mml:mspace width="thickmathspace"/>
<mml:mfenced open="(" close=")">
<mml:mi mathvariant="normal">voxel</mml:mi>
</mml:mfenced>
<mml:mo stretchy="true">/</mml:mo>
<mml:mi mathvariant="normal">S</mml:mi>
<mml:mi mathvariant="normal">T</mml:mi>
<mml:mi mathvariant="normal">D</mml:mi>
<mml:mspace width="thickmathspace"/>
<mml:mfenced open="(" close=")">
<mml:mi mathvariant="normal">voxel</mml:mi>
</mml:mfenced>
</mml:math>
</disp-formula>
<p>A minimum value of |<italic>Z</italic>|&#x2009;&#x003E;&#x2009;2 is required for regions to be highlighted with a consistent loading in a visualization plot. We performed a bootstrap procedure with 500 iterations and resampled the data with replacement, repeating the complete OrT-CVA analytic stream to compute <italic>Z</italic>-maps quantifying the robustness of each voxel&#x2019;s contribution to the covariance pattern. In addition to the group-specific robustness <italic>Z</italic>-maps, we also computed all possible 500&#x2009;&#x00D7;&#x2009;500&#x2009;=&#x2009;250,000 difference maps and looked at the voxels which lay in the 95% tail of the difference distribution, flagging significant differences in the loadings between young and old participants.</p>
</sec>
<sec id="sec12">
<title>Relationship Between Regional Cortical Thickness and Sternberg Task Performance</title>
<p>We performed region-wise univariate analysis and related cortical thickness to Sternberg task performance in both age groups separately and identified a set of regions whose thickness shows a negative association with load-averaged reaction time, and a set of regions whose thickness shows a positive association with load-averaged accuracy. We used a liberal threshold of <italic>p</italic>&#x2009;&#x003C;&#x2009;0.05, and then combined all identified regions with this liberal screen into one linear combination through linear regression analysis. In the end, we thus ended up with four thickness-based estimates of task performance for two outcomes and in two age groups. These thickness-based performance estimates where used in any subsequent brain-behavioral analysis involving the derived load-related activation pattern, to maximize the variance accounted for in the task performance variables by cortical thickness.</p>
</sec>
<sec id="sec13">
<title>Inter-Pattern Similarity in the Older Group as a Function of Performance, Education, and Mean Cortical Thickness</title>
<p>In the next section, we tried to address the question whether age or education causes smaller or larger inter-individual variability, and whether or how good cognitive performance or preserved brain structure can offset any differences of activation patterns between individuals. For age, education, and cortical thickness, we just performed a median split of the older participants. For neuropsychological and task performance, to adjust for confounding factors, we residualized these measures regarding age, education, sex, and cortical thickness performance estimate, and then split the residuals along the respective median. Both procedures resulted in an assignment of each older participant into a &#x201C;high&#x201D; and &#x201C;low&#x201D; group with respect to each variable of interest. Our question was whether inter-individual similarity in activation maps differed between the &#x201C;high&#x201D; and &#x201C;low&#x201D; group, that is, we wanted to test the null-hypothesis:</p>
<disp-formula id="E3">
<mml:math id="M3">
<mml:msub>
<mml:mi>R</mml:mi>
<mml:mi mathvariant="normal">high</mml:mi>
</mml:msub>
<mml:mfenced open="(" close=")" separators=",">
<mml:mi>k</mml:mi>
<mml:mi>j</mml:mi>
</mml:mfenced>
<mml:mo>=</mml:mo>
<mml:msub>
<mml:mi>R</mml:mi>
<mml:mi mathvariant="normal">low</mml:mi>
</mml:msub>
<mml:mfenced open="(" close=")" separators=",">
<mml:mi>m</mml:mi>
<mml:mi>n</mml:mi>
</mml:mfenced>
</mml:math>
</disp-formula>
<p>For all subject pairs, (<italic>k</italic>,<italic>j</italic>) in &#x201C;high&#x201D; and (<italic>m</italic>,<italic>n</italic>) in &#x201C;low&#x201D;</p>
<p>For this test, we computed all possible <italic>N</italic>&#x002A;(<italic>N</italic>-1)/2 pairwise inter-subject spatial correlation coefficients (where <italic>N</italic> is 68 and 69, respectively). These inter-spatial correlation coefficients can be contrasted with a simple <italic>t</italic>-test for a point estimate computation; however, to assess statistical significance, a permutation test is needed that repeats the inter-subject similarity computation for null conditions. That is, we permuted participants randomly between &#x201C;high&#x201D; and &#x201C;low&#x201D; groups, creating null conditions, and repeating the within-group inter-subject similarity computation and the computation of the group comparison T-statistic. This was done 1,000 times to create a null-histogram, and statistical significance was approximated with a two-tailed test as <italic>P</italic>(|<italic>T</italic>(permutation)|&#x2009;&#x003E;&#x2009;|<italic>T</italic>(point estimate)|). This procedure is necessary since a parametric test would overestimate the number of the degrees of freedom and the <italic>T</italic>-statistic itself, and consequently suffer from value of <italic>p</italic> inflation with nominal value of <italic>p</italic> that would be too small.</p>
</sec>
</sec>
<sec id="sec14" sec-type="results">
<title>Results</title>
<p>We identified reliable load-related patterns during the retention phase in both age groups. In the younger participants, a best-fitting load-related pattern was constructed from PCs 1&#x2013;21 and one of the participants did not conform to the majority rule of positive expression slopes (<italic>p</italic>&#x2009;&#x003C;&#x2009;0.001, permutation test). In the older participants, we constructed a pattern from PCs 1&#x2013;45, and nobody deviated from the majority positive-slope rule (<italic>p</italic>&#x2009;&#x003C;&#x2009;0.001, permutation test). <xref rid="fig1" ref-type="fig">Figure 1</xref> shows the task&#x2013;activity curve for every participant in both age groups.</p>
<fig position="float" id="fig1">
<label>Figure 1</label>
<caption><p>Pattern score curves for the Ordinal Trend (OrT) patterns derived for younger and older participants. Exceptions to the positive-slope rule are shown in bold face. There was one exception in the young group, but none in the older group.</p></caption>
<graphic xlink:href="fpsyg-13-852995-g001.tif"/>
</fig>
<p>The OrT-CVA technique imposes no <italic>a priori</italic> relationship between load-related slopes and load averages of pattern scores, and any relationship (negative, positive, or no correlation) is conceivable <italic>a priori</italic>, which we verified the correctness of parametric assumptions with permutation tests. For both groups, the load-related pattern score slope was positively correlated with the mean pattern score (Young: <italic>R</italic>&#x2009;=&#x2009;0.4143, <italic>p</italic>&#x2009;=&#x2009;0.0052; Old: <italic>R</italic>&#x2009;=&#x2009;0.5048, <italic>p</italic>&#x2009;&#x003C;&#x2009;0.0001). Participants manifesting higher pattern score slopes thus also showed higher overall pattern scores. This finding refuted possible ceiling effects, with task&#x2013;activity curves starting at relatively high levels with consequently lesser load increases.</p>
<p>We related the load average and slope of the pattern expression scores to Sternberg task performance (load average and slope of accuracy and reaction time) and four domains of neuropsychological functioning in bivariate correlations and found notably different brain-behavioral correlations as a function of age. We only report significant correlations: in the younger group, the pattern expression slope correlated negatively with mean load-averaged task accuracy in the Sternberg task (<italic>R</italic>&#x2009;=&#x2009;&#x2212;0.32531, <italic>p</italic>&#x2009;=&#x2009;0.031183), fluid reasoning (<italic>R</italic>&#x2009;=&#x2009;&#x2212;0.37756, <italic>p</italic>&#x2009;=&#x2009;0.011516), and vocabulary (<italic>R</italic>&#x2009;=&#x2009;&#x2212;0.39524, <italic>p</italic>&#x2009;=&#x2009;0.0079228). In the older group, pattern slope correlated positively with mean Sternberg task accuracy (<italic>R</italic>&#x2009;=&#x2009;0.17672, <italic>p</italic>&#x2009;=&#x2009;0.038851), and the mean pattern score correlated positively with mean Sternberg task accuracy (<italic>R</italic>&#x2009;=&#x2009;0.28577, <italic>p</italic>&#x2009;=&#x2009;0.00071152), perceptual speed (<italic>R</italic>&#x2009;=&#x2009;0.21227, <italic>p</italic>&#x2009;=&#x2009;0.012767), and vocabulary (<italic>R</italic>&#x2009;=&#x2009;0.21027, <italic>p</italic>&#x2009;=&#x2009;0.013655).</p>
<p>We performed a bootstrap procedure and computed <italic>Z</italic>-maps quantifying the robustness of each voxel&#x2019;s contribution to the covariance pattern, as well as inferential difference maps identifying old&#x2013;young differences with 95% confidence. The results are shown in <xref rid="fig2" ref-type="fig">Figure 2</xref>. Topographic composition of both patterns shared a lot of similarities but involved two stark differences showing additional involvement of areas in the older participants: the involvement of the posterior cingulate for negative loadings and bilateral precuneus for positive loadings (<xref ref-type="supplementary-material" rid="SM3">Supplementary Table 3</xref>).</p>
<fig position="float" id="fig2">
<label>Figure 2</label>
<caption><p>Bootstrap <italic>Z</italic>-maps (top and middle rows) thresholded at |<italic>Z</italic>|&#x2009;&#x003E;&#x2009;2, cluster size&#x2009;&#x003E;&#x2009;50. Bottom row: inferential comparison of old and young patterns, showing areas with the 95% coverage intervals excluding zero values.</p></caption>
<graphic xlink:href="fpsyg-13-852995-g002.tif"/>
</fig>
<p>Super-threshold regions for all three images with anatomical annotation are listed in <xref ref-type="supplementary-material" rid="SM1">Supplementary Tables 1</xref>&#x2013;<xref ref-type="supplementary-material" rid="SM3">3</xref>.</p>
<p>We also related regional cortical thickness to load-averaged reaction time and accuracy in both age groups, see <xref rid="tab2" ref-type="table">Table 2</xref>.</p>
<table-wrap position="float" id="tab2">
<label>Table 2</label>
<caption><p>Relationships between regional cortical thickness and task performance on Sternberg task.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left" valign="top">Endpoint and age group</th>
<th align="left" valign="top">FreeSurfer label of associated regions at <italic>p</italic>&#x2009;&#x003C;&#x2009;0.05</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top">Reaction time in younger group (negative association)</td>
<td align="left" valign="top">lh-isthmuscingulate, rh-medialorbitofrontal</td>
</tr>
<tr>
<td align="left" valign="top">Reaction time in older group (negative association)</td>
<td align="left" valign="top">lh-inferiortemporal, lh-medialorbitofrontal, lh-middletemporal, lh-parahippocampal, lh-precuneus, lh-temporalpole, lh-insula, rh-entorhinal, rh-fusiform, rh-inferiortemporal, rh-lateraloccipital, rh-lateralorbitofrontal, rh-middletemporal, rh-parahippocampal, rh-temporalpole, and rh-insula</td>
</tr>
<tr>
<td align="left" valign="top">Accuracy in younger group (positive association)</td>
<td align="left" valign="top">lh-paracentral, lh-postcentral, lh-precentral, lh-supramarginal, lh-transversetemporal, rh-inferiorparietal, rh-postcentral, and rh-transversetemporal</td>
</tr>
<tr>
<td align="left" valign="top">Accuracy in older group (positive association)</td>
<td align="left" valign="top">lh-isthmuscingulate, lh-posteriorcingulate, and rh-isthmuscingulate</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>Apart from bivariate correlations, we also ran linear regressions to predict load-averaged Sternberg accuracy rates with pattern scores, demographics, and the performance estimate based on cortical thickness as covariates. <xref rid="tab3" ref-type="table">Table 3</xref> below revealed the importance of general intelligence as measured by G since it contributed to task performance above all other measures. Only in the younger group did the mean pattern score of the load-related pattern also contribute to task performance; in the older group, significance of this association was only marginally significant with <italic>p</italic>&#x2009;=&#x2009;0.0665 (We performed corresponding linear regressions to predict mean reaction time in both age groups but did not find any associations with the load-related patterns in either age group and elected to omit the table listing for clarity.).</p>
<table-wrap position="float" id="tab3">
<label>Table 3</label>
<caption><p>Mean load-averaged task accuracy as a function of pattern-score mean levels and slopes, neuropsychological functioning, and demographics.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left" valign="middle" rowspan="2">Outcome: mean task accuracy</th>
<th align="center" valign="middle" colspan="2">Young</th>
<th align="center" valign="middle" colspan="2">Old</th>
</tr>
<tr>
<th align="center" valign="middle"><italic>T</italic>-statistic</th>
<th align="center" valign="middle"><italic>p</italic> value</th>
<th align="center" valign="middle"><italic>T</italic>-statistic</th>
<th align="center" valign="middle"><italic>p</italic> value</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top">Intercept</td>
<td align="left" valign="top">0.7531</td>
<td align="left" valign="top">0.4563</td>
<td align="left" valign="top">0.4838</td>
<td align="left" valign="top">0.6293</td>
</tr>
<tr>
<td align="left" valign="top">Mean pattern score</td>
<td align="left" valign="top"><bold>2.2210</bold></td>
<td align="left" valign="top"><bold>0.0327</bold></td>
<td align="left" valign="top">1.8505</td>
<td align="left" valign="top">0.0665</td>
</tr>
<tr>
<td align="left" valign="top">Pattern score slope</td>
<td align="left" valign="top">&#x2212;1.4905</td>
<td align="left" valign="top">0.1448</td>
<td align="left" valign="top">1.0507</td>
<td align="left" valign="top">0.2954</td>
</tr>
<tr>
<td align="left" valign="top">Thickness-based accuracy estimate</td>
<td align="left" valign="top"><bold>3.1379</bold></td>
<td align="left" valign="top"><bold>0.0034</bold></td>
<td align="left" valign="top"><bold>2.3689</bold></td>
<td align="left" valign="top"><bold>0.0193</bold></td>
</tr>
<tr>
<td align="left" valign="top">Age</td>
<td align="left" valign="top">1.6710</td>
<td align="left" valign="top">0.1034</td>
<td align="left" valign="top">0.8319</td>
<td align="left" valign="top">0.4070</td>
</tr>
<tr>
<td align="left" valign="top">Total G</td>
<td align="left" valign="top"><bold>2.4477</bold></td>
<td align="left" valign="top"><bold>0.0194</bold></td>
<td align="left" valign="top"><bold>3.5071</bold></td>
<td align="left" valign="top"><bold>0.0061</bold></td>
</tr>
<tr>
<td align="left" valign="top">Education</td>
<td align="left" valign="top">&#x2212;1.0555</td>
<td align="left" valign="top">0.2982</td>
<td align="left" valign="top">&#x2212;0.3157</td>
<td align="left" valign="top">0.7527</td>
</tr>
<tr>
<td align="left" valign="top">Sex</td>
<td align="left" valign="top">0.5569</td>
<td align="left" valign="top">0.5810</td>
<td align="left" valign="top">&#x2212;0.1460</td>
<td align="left" valign="top">0.8842</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p>Pattern scores can account for task accuracy beyond the covariates with only marginal <italic>p</italic> value in the older participants. Total cognition (=G) account for performance beyond cortical thickness too.</p>
<p>Bold values indicate a statistically significant difference between age groups at <italic>p</italic>&#x2009;&#x003C;&#x2009;0.05.</p>
</table-wrap-foot>
</table-wrap>
<p>We decided to run an <italic>ad hoc</italic> analysis and project the pattern derived in the younger group into the activation data of the older group to examine the degree that older adults express the younger adults&#x2019; activation pattern. Multivariate patterns possess this convenient feature and enable simple cross-applications to <italic>de novo</italic> data. When computing bivariate correlations between subject variables with the obtained pattern scores like before, we found positive associations between the mean load-averaged pattern score and task performance (<italic>R</italic>&#x2009;=&#x2009;0.20946, <italic>p</italic>&#x2009;=&#x2009;0.014029) as well as perceptual speed (<italic>R</italic>&#x2009;=&#x2009;0.20802, <italic>p</italic>&#x2009;=&#x2009;0.014719).</p>
<p>Next, we turned to the dichotomization of the older group along several median splits based on task performance, neuropsychological functioning, education, and mean cortical thickness and observed the group differences in the inter-subject similarity of mean activation patterns. We found no significant differences between &#x201C;high&#x201D; and &#x201C;low&#x201D; groups for age, education (shown in <xref rid="fig3" ref-type="fig">Figure 3</xref>), mean cortical thickness, or task reaction time (minimum value of <italic>p</italic> for four comparisons from permutation test: 0.227). Significantly higher similarity was found for the &#x201C;high&#x201D; group for mean task accuracy (<italic>T</italic>&#x2009;=&#x2009;11.6054, <italic>p</italic>&#x2009;=&#x2009;0.0070, shown in <xref rid="fig3" ref-type="fig">Figure 3</xref>), memory (<italic>T</italic>&#x2009;=&#x2009;11.8313, <italic>p</italic>&#x2009;=&#x2009;0.0060), fluid reasoning (<italic>T</italic>&#x2009;=&#x2009;12.9849, <italic>p</italic>&#x2009;=&#x2009;0.0008), speed (<italic>T</italic>&#x2009;=&#x2009;9.7044, <italic>p</italic>&#x2009;=&#x2009;0.0300), and vocabulary (<italic>T</italic>&#x2009;=&#x2009;11.9092, <italic>p</italic>&#x2009;=&#x2009;0.0090).</p>
<fig position="float" id="fig3">
<label>Figure 3</label>
<caption><p>Inter-subject pattern similarity as a function of mean task accuracy (top row), and age (bottom row). All inter-subject similarity values are plotted against HIGH and LOW status (left column), with null-histograms for the group contrast from a permutation test of 1,000 iterations (right column). The group with higher task accuracy showed higher inter-subject similarity (<italic>p</italic>&#x2009;=&#x2009;0.0070), whereas age was non-differential (<italic>p</italic>&#x2009;=&#x2009;0.2830).</p></caption>
<graphic xlink:href="fpsyg-13-852995-g003.tif"/>
</fig>
<p>Although it was only of secondary interest, we also performed several comparisons of inter-subject similarity involving the young participants, comparing all young and old participants. We found significantly higher inter-subject similarity for old compared to young adults (<italic>T</italic>&#x2009;=&#x2009;10.1118, <italic>p</italic>&#x2009;=&#x2009;0.034). When we revisited the median splits in the older participants, this difference was only found for the contrast of young adults vs. high-performing older adults. This hinted at inverted u-shaped behavior of inter-subject similarity regarding age-related performance: inter-subject similarity was low for young and low-performing older participants on the two ends, but high for high-performing older participants in the middle.</p>
</sec>
<sec id="sec15" sec-type="discussions">
<title>Discussion</title>
<p>We identified load-related activation patterns during the maintenance phase of a verbal working memory task in two age groups that showed relationships to neuropsychological functioning and task performance, even though these relationships differed starkly as a function of age. In the young-participant group, the load-related increases, that is, the slope of pattern scores, related <italic>negatively</italic> to neuropsychological functioning and mean task accuracy, that is, poor performers increased their pattern score in response to memory load increases to a greater degree. Apparently, the younger participant&#x2019;s rehearsal pattern can be interpreted as <italic>necessary</italic>, but greater engagement of it in response to memory load was <italic>not</italic> conducive to good performance. In the older participant group, on the other hand, the load-related slope of pattern scores related positively to mean accuracy, as did the mean load-averaged pattern scores, which also correlated positively with neuropsychological functioning. Further, when prospectively applying the young-derived activation pattern into the older group&#x2019;s activation maps, the resulting mean load-averaged pattern scores still displayed positive correlations with mean task accuracy neuropsychological functioning (=perceptual speed). If the young-derived activation pattern can be considered as a &#x201C;template,&#x201D; then higher manifestation of this template in the older groups is associated with better task performance and better perceptual speed. The young activation pattern can be considered an implementation of Cognitive Reserve since load-averaged pattern scores accounted for task performance beyond cortical thickness, general cognition, and demographics; the activation pattern from the older group only achieved marginal significance in this regard. One caveat is that cortical thickness is only <italic>one</italic> possible measure of brain health and ideally a more holistic assessment which integrates several modalities, like gray matter volume and thickness, white-matter integrity, and absence of amyloid and tau protein accumulation, should be used.</p>
<p>Our study started to address a significant knowledge gap in the field. While there have been numerous studies invoking the concept of Cognitive Reserve, few of them comported with the strict definition of the recent clarification in the NIH-funded initiative &#x201C;Reserve and Resilience.&#x201D;<xref rid="fn0007" ref-type="fn"><sup>4</sup></xref> Behavioral studies have demonstrated the link between working memory and general cognition in many different forms. Questionnaire-based operationalization of CR has shown correlations with working memory performance in patients with subject memory complaints (<xref ref-type="bibr" rid="ref26">Lojo-Seoane et al., 2020</xref>), education has been shown to predict performance on an N-back task (<xref ref-type="bibr" rid="ref59">Zarantonello et al., 2020</xref>), while vocabulary ability reduced working memory differences between participants with single- and multi-domain Mild Cognitive Impairment (<xref ref-type="bibr" rid="ref11">Facal et al., 2014</xref>). In a community sample, verbal intelligence had stronger associations with working memory than education or socioeconomic status (<xref ref-type="bibr" rid="ref24">Jefferson et al., 2011</xref>). For cognitive interventions, such as training on the N-back task, training-related improvements (<xref ref-type="bibr" rid="ref29">Mi&#x010D;i&#x010D; et al., 2020</xref>) correlated with a measure operationalized through the Cognitive-Reserve Index questionnaire (<xref ref-type="bibr" rid="ref31">Nucci et al., 2012</xref>). Working memory itself could be a form of Cognitive Reserve, as shown in a study (<xref ref-type="bibr" rid="ref46">Sandry and Sumowski, 2014</xref>) that looked at intellectual enrichment and long-term memory outcomes in multiple sclerosis patients and found independent contributions by working memory capacity and, crucially, a moderation of the relationship between intellectual enrichment and long-term memory outcomes.</p>
<p>A different class of studies has related CR proxies to functional brain signals, without simultaneous consideration of brain structure or pathology. These studies often establish robust functional correlates of CR proxies, while still following short of the rigor required by the &#x201C;Reserve and Resilience&#x201D; framework. Event-related potentials (ERPs) recorded with electro-encephalography can link latency and amplitude of the signal to working memory performance or CR proxies with suggestive findings for increased efficiency with, for instance, reading ability (<xref ref-type="bibr" rid="ref16">Guti&#x00E9;rrez-Zamora Velasco et al., 2021</xref>) or verbal intelligence and education (<xref ref-type="bibr" rid="ref51">Speer and Soldan, 2015</xref>). While these studies clearly demonstrate ERP correlates of CR proxies, a rigorous ascertainment of CR cannot be established because of the absence of brain structure or pathology measures. Even when such information is present, the full analyses required to decide about CR mechanisms are not always run. For instance, an fMRI study of a two-back task (<xref ref-type="bibr" rid="ref4">Bartr&#x00E9;s-Faz et al., 2009</xref>) showed correlations between fMRI activation and a composite of education, occupation, verbal ability, and leisure activities, supporting the notion of increased processing efficiency, but did not directly use the structural covariate of regional gray matter volume in a combined analysis. Similarly, in a recent fMRI lifespan study (<xref ref-type="bibr" rid="ref2">Archer et al., 2018</xref>) of a spatial WM task where regional gray matter volume was used as a structural covariate, rigorous tests of Cognitive Reserve conforming to the framework&#x2019;s standards were lacking. The study showed negative associations between task-related activation and age in a monotonic fashion and thus substantiated age-related decreases in processing efficiency, although adjustments for education rendered some of these relationships non-significant. Crucially, the test of any contribution of education to task performance beyond the study&#x2019;s covariate of choice, <italic>gray matter volume</italic>, necessary to verify education&#x2019;s role as a Cognitive Reserve mechanisms, was also not conducted. Education was shown to be associated positively with task performance in bivariate correlations, but without the clarification of the role of gray matter volume, a clear differentiation between brain maintenance versus Cognitive Reserve effects, again, could not be made in the characterization of the education effect.</p>
<p>Other interesting studies that capture the spirit, if not the full operationalization, of the &#x201C;Reserve and Resilience&#x201D; framework can be found when the effect of general health impediments is not explicitly localized in the brain but can be shown to have a detrimental effect on working memory, with a moderation of the health-cognition relationship by CR proxies. In one study (<xref ref-type="bibr" rid="ref23">Ihle et al., 2018</xref>), hypertension lowered working memory performance, but this effect was lessened when education, occupational demands, and leisure activities were considered too.</p>
<p>In conclusion, we can say studies that have investigated working memory and possible CR mechanisms with an adequate account brain structure or pathology are thus quite sparse in the extant literature. A recent study of the effect of bilingualism on performance of a two-back task (<xref ref-type="bibr" rid="ref1">Anderson et al., 2021</xref>) showed structure&#x2013;cognition associations that differed between bilinguals and monolinguals, which constitute a rigorous test of Cognitive Reserve consistent with the NIH-funded &#x201C;Reserve and Resilience&#x201D; framework. Similarly, after matching dyads of participants on hippocampal volume, one study showed that education was positively associated with working memory performance, among several cognitive outcomes (<xref ref-type="bibr" rid="ref39">Rodriguez et al., 2019</xref>). Lastly, verbal intelligence has been shown to lessen the detrimental effect of amyloid deposition on working memory (<xref ref-type="bibr" rid="ref37">Rentz et al., 2010</xref>).</p>
<p>After deriving task-related activation patterns and confirming their fulfillment of the Cognitive Reserve postulates, we also investigated the inter-subject similarity of load-averaged activation patterns underlying the maintenance phase as a function of age, task and neuropsychological performance, education, and mean cortical thickness. Younger adults had lower inter-subject similarity than older adults, hinting at a narrowing of individual neural strategies with age. In the older group however, <italic>higher</italic> inter-subject similarity was associated with <italic>better</italic> performance (but <italic>not</italic> longer education). Both young and low-performing older adults presented with lower inter-subject similarity than high-performing older adults.</p>
<p>This non-monotonic behavior of inter-subject similarity (=topographic robustness) was somewhat surprising. Inter-individual variability has not been researched extensively, and intra-individual variability has received the most of the field&#x2019;s recent attention (<xref ref-type="bibr" rid="ref3">Armbruster-Genc et al., 2016</xref>; <xref ref-type="bibr" rid="ref30">Nomi et al., 2017</xref>; <xref ref-type="bibr" rid="ref15">Grady and Garrett, 2018</xref>; <xref ref-type="bibr" rid="ref35">Pur et al., 2019</xref>; <xref ref-type="bibr" rid="ref38">Roberts et al., 2020</xref>). Within a person and region, these studies broadly suggest that increased task demand and better cognitive performance might cause increased fMRI variability, and age might negatively impact cognitive performance <italic>via</italic> both depressed variability overall and the lower ability to increase variability in response to task demands. The implications of this research for inter-individual variability are not clear: inter-individual variability indicates that different people are employing different neural substrates, leading to lower inter-subject similarity. This reduced inter-subject variability can be seen as a group-level manifestation of a Cognitive Reserve mechanism: high performers seem to involve more similar individual-level activation maps than poorer performs. Since our findings are cross-sectional they can suggest plausibility, while longitudinal lifespan studies can more rigorously disentangle aging from age effects for any neural substrates, including inter-subject variability.</p>
<p>In summary, our study illustrated two facets of Cognitive Reserve and resilience in aging. We identified a memory load-related maintenance pattern that was positively associated with performance and neuropsychological functioning, but not with cortical thickness, in older participants. Interestingly, in younger participants, a topographically similar pattern could be identified, but the performance relations were strikingly different: higher deployment of the pattern in response to memory load was associated with <italic>worse</italic> performance on the task and <italic>worse</italic> neuropsychological functioning, hinting at a possible critical age range at which this change might occur, to be investigated more thoroughly in lifespan data with continuous age coverage. The different relations to performance notwithstanding, the pattern derived from young participants fulfilled the tenets of Cognitive Reserve and its mean load-averaged pattern scores were associated with task performance beyond brain structure, while the pattern derived from older participants achieved marginal significance. High inter-subject similarity of activation maps, which was assessed outside a group-level analytic framework, can be considered a form of (group-level) Cognitive Reserve as well, at least in the older participants, and is associated with more robust group-level activation patterns too. This suggests that better cognitive functioning might converge on <italic>one</italic> optimal neural strategy, deviations from which might be suboptimal in older age. An alternative scenario might be one of <italic>neural flexibility</italic> at the group-level, that is, a scenario where high-performing participants have honed their individual neural strategies and use <italic>different</italic> activation patterns from each other, hampering an effective group-level analysis strategy. Covariance analysis in general can accommodate differences <italic>in degree</italic> along a group-invariant construct (=activation pattern) but cannot accommodate differences <italic>in kind</italic> very effectively. If high performers showed greater inter-subject variation in the topographic composition of their individual-level activation maps, tailoring a group-level pattern would involve an increased numbers of principal components, with correspondingly lower inferential robustness.</p>
<p>Such group-level variability with <italic>positive</italic> association to Cognitive Reserve might be conceivable for other cognitive tasks beyond working memory; investigation of inter-subject similarity and group-level robustness and its association with Cognitive Reserve, age and aging in longitudinal lifespan data will remain on our agenda for the near future.</p>
</sec>
<sec id="sec16" sec-type="data-availability">
<title>Data Availability Statement</title>
<p>The datasets presented in this study can be found in online repositories. The names of the repository/repositories and accession number(s) can be found at: Dryad Repository, final DOI: 10.5061/dryad.bzkh189c3. Preliminary access: <ext-link xlink:href="https://datadryad.org/stash/share/gQSaYyiwz9he9_KI37ufnZpSLZU8VrzKAa8wMnYIdJU" ext-link-type="uri">https://datadryad.org/stash/share/gQSaYyiwz9he9_KI37ufnZpSLZU8VrzKAa8wMnYIdJU</ext-link>.</p>
</sec>
<sec id="sec17">
<title>Ethics Statement</title>
<p>The studies involving human participants were reviewed and approved by Human Research Protection Office and IRB, Columbia University. The patients/participants provided their written informed consent to participate in this study.</p>
</sec>
<sec id="sec18">
<title>Author Contributions</title>
<p>CH: conceptualization, analysis, and manuscript writing. YG: data pre-processing and manuscript writing and editing. YS: manuscript writing and editing and study design. All authors contributed to the article and approved the submitted version.</p>
</sec>
<sec id="sec19" sec-type="funding-information">
<title>Funding</title>
<p>Funding is gratefully acknowledged from grant: NIH R01AG026158.</p>
</sec>
<sec id="conf1" sec-type="COI-statement">
<title>Conflict of Interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec id="sec22" sec-type="disclaimer">
<title>Publisher&#x2019;s Note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
</body>
<back>
<sec id="sec21" sec-type="supplementary-material">
<title>Supplementary Material</title>
<p>The Supplementary Material for this article can be found online at: <ext-link xlink:href="https://www.frontiersin.org/articles/10.3389/fpsyg.2022.852995/full#supplementary-material" ext-link-type="uri">https://www.frontiersin.org/articles/10.3389/fpsyg.2022.852995/full#supplementary-material</ext-link></p>
<supplementary-material xlink:href="Table_1.DOCX" id="SM1" mimetype="application/vnd.openxmlformats-officedocument.wordprocessingml.document" xmlns:xlink="http://www.w3.org/1999/xlink"/>
<supplementary-material xlink:href="Table_2.DOCX" id="SM2" mimetype="application/vnd.openxmlformats-officedocument.wordprocessingml.document" xmlns:xlink="http://www.w3.org/1999/xlink"/>
<supplementary-material xlink:href="Table_3.DOCX" id="SM3" mimetype="application/vnd.openxmlformats-officedocument.wordprocessingml.document" xmlns:xlink="http://www.w3.org/1999/xlink"/>
</sec>
<ref-list>
<title>References</title>
<ref id="ref1"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Anderson</surname> <given-names>J. A. E.</given-names></name> <name><surname>Grundy</surname> <given-names>J. G.</given-names></name> <name><surname>Grady</surname> <given-names>C. L.</given-names></name> <name><surname>Craik</surname> <given-names>F. I. M.</given-names></name> <name><surname>Bialystok</surname> <given-names>E.</given-names></name></person-group> (<year>2021</year>). <article-title>Bilingualism contributes to reserve and working memory efficiency: evidence from structural and functional neuroimaging</article-title>. <source>Neuropsychologia</source> <volume>163</volume>:<fpage>108071</fpage>. doi: <pub-id pub-id-type="doi">10.1016/j.neuropsychologia.2021.108071</pub-id>, PMID: <pub-id pub-id-type="pmid">34715120</pub-id></citation></ref>
<ref id="ref2"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Archer</surname> <given-names>J. A.</given-names></name> <name><surname>Lee</surname> <given-names>A.</given-names></name> <name><surname>Qiu</surname> <given-names>A.</given-names></name> <name><surname>Chen</surname> <given-names>S. A.</given-names></name></person-group> (<year>2018</year>). <article-title>Working memory, age and education: a lifespan fMRI study</article-title>. <source>PLoS One</source> <volume>13</volume>:<fpage>e0194878</fpage>. doi: <pub-id pub-id-type="doi">10.1371/journal.pone.0194878</pub-id>, PMID: <pub-id pub-id-type="pmid">29584781</pub-id></citation></ref>
<ref id="ref3"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Armbruster-Genc</surname> <given-names>D. J.</given-names></name> <name><surname>Ueltzhoffer</surname> <given-names>K.</given-names></name> <name><surname>Fiebach</surname> <given-names>C. J.</given-names></name></person-group> (<year>2016</year>). <article-title>Brain signal variability differentially affects cognitive flexibility and cognitive stability</article-title>. <source>J. Neurosci.</source> <volume>36</volume>, <fpage>3978</fpage>&#x2013;<lpage>3987</lpage>. doi: <pub-id pub-id-type="doi">10.1523/JNEUROSCI.2517-14.2016</pub-id>, PMID: <pub-id pub-id-type="pmid">27053205</pub-id></citation></ref>
<ref id="ref4"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bartr&#x00E9;s-Faz</surname> <given-names>D.</given-names></name> <name><surname>Sol&#x00E9;-Padull&#x00E9;s</surname> <given-names>C.</given-names></name> <name><surname>Junqu&#x00E9;</surname> <given-names>C.</given-names></name> <name><surname>Rami</surname> <given-names>L.</given-names></name> <name><surname>Bosch</surname> <given-names>B.</given-names></name> <name><surname>Bargall&#x00F3;</surname> <given-names>N.</given-names></name> <etal/></person-group>. (<year>2009</year>). <article-title>Interactions of cognitive reserve with regional brain anatomy and brain function during a working memory task in healthy elders</article-title>. <source>Biol. Psychol.</source> <volume>80</volume>, <fpage>256</fpage>&#x2013;<lpage>259</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.biopsycho.2008.10.005</pub-id>, PMID: <pub-id pub-id-type="pmid">19022337</pub-id></citation></ref>
<ref id="ref5"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Benton</surname> <given-names>AL</given-names></name> <name><surname>Hamsher</surname> <given-names>K</given-names></name> <name><surname>Sivan</surname> <given-names>A. B.</given-names></name></person-group> (<year>1983</year>). <source>Multilingual Aphasia Examination.</source> <edition>3rd Edn.</edition> <publisher-loc>Iowa City, IA</publisher-loc>: <publisher-name>AJA Associates</publisher-name></citation></ref>
<ref id="ref6"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Braver</surname> <given-names>T. S.</given-names></name> <name><surname>Cohen</surname> <given-names>J. D.</given-names></name> <name><surname>Nystrom</surname> <given-names>L. E.</given-names></name> <name><surname>Jonides</surname> <given-names>J.</given-names></name> <name><surname>Smith</surname> <given-names>E. E.</given-names></name> <name><surname>Noll</surname> <given-names>D. C.</given-names></name></person-group> (<year>1997</year>). <article-title>A parametric study of prefrontal cortex involvement in human working memory</article-title>. <source>NeuroImage</source> <volume>5</volume>, <fpage>49</fpage>&#x2013;<lpage>62</lpage>. doi: <pub-id pub-id-type="doi">10.1006/nimg.1996.0247</pub-id>, PMID: <pub-id pub-id-type="pmid">9038284</pub-id></citation></ref>
<ref id="ref7"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Buschke</surname> <given-names>H.</given-names></name> <name><surname>Fuld</surname> <given-names>P. A.</given-names></name></person-group> (<year>1974</year>). <article-title>Evaluating storage, retention, and retrieval in disordered memory and learning</article-title>. <source>Neurology</source> <volume>24</volume>, <fpage>1019</fpage>&#x2013;<lpage>1025</lpage>. doi: <pub-id pub-id-type="doi">10.1212/WNL.24.11.1019</pub-id>, PMID: <pub-id pub-id-type="pmid">4473151</pub-id></citation></ref>
<ref id="ref8"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cohen</surname> <given-names>J. D.</given-names></name> <name><surname>Perlstein</surname> <given-names>W. M.</given-names></name> <name><surname>Braver</surname> <given-names>T. S.</given-names></name> <name><surname>Nystrom</surname> <given-names>L. E.</given-names></name> <name><surname>Noll</surname> <given-names>D. C.</given-names></name> <name><surname>Jonides</surname> <given-names>J.</given-names></name> <etal/></person-group>. (<year>1997</year>). <article-title>Temporal dynamics of brain activation during a working memory task</article-title>. <source>Nature</source> <volume>386</volume>, <fpage>604</fpage>&#x2013;<lpage>608</lpage>. doi: <pub-id pub-id-type="doi">10.1038/386604a0</pub-id></citation></ref>
<ref id="ref9"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>D'Esposito</surname> <given-names>M.</given-names></name> <name><surname>Postle</surname> <given-names>B. R.</given-names></name> <name><surname>Ballard</surname> <given-names>D.</given-names></name> <name><surname>Lease</surname> <given-names>J.</given-names></name></person-group> (<year>1999</year>). <article-title>Maintenance versus manipulation of information held in working memory: an event-related fMRI study</article-title>. <source>Brain Cogn.</source> <volume>41</volume>, <fpage>66</fpage>&#x2013;<lpage>86</lpage>. doi: <pub-id pub-id-type="doi">10.1006/brcg.1999.1096</pub-id>, PMID: <pub-id pub-id-type="pmid">10536086</pub-id></citation></ref>
<ref id="ref10"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>D'Esposito</surname> <given-names>M.</given-names></name> <name><surname>Postle</surname> <given-names>B. R.</given-names></name> <name><surname>Rypma</surname> <given-names>B.</given-names></name></person-group> (<year>2000</year>). <article-title>Prefrontal cortical contributions to working memory: evidence from event-related fMRI studies</article-title>. <source>Exp. Brain Res.</source> <volume>133</volume>, <fpage>3</fpage>&#x2013;<lpage>11</lpage>. doi: <pub-id pub-id-type="doi">10.1007/s002210000395</pub-id>, PMID: <pub-id pub-id-type="pmid">10933205</pub-id></citation></ref>
<ref id="ref11"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Facal</surname> <given-names>D.</given-names></name> <name><surname>Juncos-Rabad&#x00E1;n</surname> <given-names>O.</given-names></name> <name><surname>Pereiro</surname> <given-names>A. X.</given-names></name> <name><surname>Lojo-Seoane</surname> <given-names>C.</given-names></name></person-group> (<year>2014</year>). <article-title>Working memory span in mild cognitive impairment. Influence of processing speed and cognitive reserve</article-title>. <source>Int. Psychogeriatr.</source> <volume>26</volume>, <fpage>615</fpage>&#x2013;<lpage>625</lpage>. doi: <pub-id pub-id-type="doi">10.1017/S1041610213002391</pub-id>, PMID: <pub-id pub-id-type="pmid">24331456</pub-id></citation></ref>
<ref id="ref12"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fischl</surname> <given-names>B.</given-names></name> <name><surname>Salat</surname> <given-names>D. H.</given-names></name> <name><surname>Busa</surname> <given-names>E.</given-names></name> <name><surname>Albert</surname> <given-names>M.</given-names></name> <name><surname>Dieterich</surname> <given-names>M.</given-names></name> <name><surname>Haselgrove</surname> <given-names>C.</given-names></name> <etal/></person-group>. (<year>2002</year>). <article-title>Whole brain segmentation: automated labeling of neuroanatomical structures in the human brain</article-title>. <source>Neuron</source> <volume>33</volume>, <fpage>341</fpage>&#x2013;<lpage>355</lpage>. doi: <pub-id pub-id-type="doi">10.1016/S0896-6273(02)00569-X</pub-id></citation></ref>
<ref id="ref13"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fischl</surname> <given-names>B.</given-names></name> <name><surname>van der Kouwe</surname> <given-names>A.</given-names></name> <name><surname>Destrieux</surname> <given-names>C.</given-names></name> <name><surname>Halgren</surname> <given-names>E.</given-names></name> <name><surname>Segonne</surname> <given-names>F.</given-names></name> <name><surname>Salat</surname> <given-names>D. H.</given-names></name> <etal/></person-group>. (<year>2004</year>). <article-title>Automatically parcellating the human cerebral cortex</article-title>. <source>Cereb. Cortex</source> <volume>14</volume>, <fpage>11</fpage>&#x2013;<lpage>22</lpage>. doi: <pub-id pub-id-type="doi">10.1093/cercor/bhg087</pub-id>, PMID: <pub-id pub-id-type="pmid">14654453</pub-id></citation></ref>
<ref id="ref14"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Golden</surname> <given-names>C. J.</given-names></name></person-group> (<year>1975</year>). <article-title>A group version of the Stroop color and word test</article-title>. <source>J. Pers. Assess.</source> <volume>39</volume>, <fpage>386</fpage>&#x2013;<lpage>388</lpage>. doi: <pub-id pub-id-type="doi">10.1207/s15327752jpa3904_10</pub-id></citation></ref>
<ref id="ref15"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Grady</surname> <given-names>C. L.</given-names></name> <name><surname>Garrett</surname> <given-names>D. D.</given-names></name></person-group> (<year>2018</year>). <article-title>Brain signal variability is modulated as a function of internal and external demand in younger and older adults</article-title>. <source>NeuroImage</source> <volume>169</volume>, <fpage>510</fpage>&#x2013;<lpage>523</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.neuroimage.2017.12.031</pub-id>, PMID: <pub-id pub-id-type="pmid">29253658</pub-id></citation></ref>
<ref id="ref16"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Guti&#x00E9;rrez-Zamora Velasco</surname> <given-names>G.</given-names></name> <name><surname>Fern&#x00E1;ndez</surname> <given-names>T.</given-names></name> <name><surname>Silva-Pereyra</surname> <given-names>J.</given-names></name> <name><surname>Reynoso-Alc&#x00E1;ntara</surname> <given-names>V.</given-names></name> <name><surname>Castro-Chavira</surname> <given-names>S. A.</given-names></name></person-group> (<year>2021</year>). <article-title>Higher cognitive reserve is associated with better working memory performance and working-memory-related P300 modulation</article-title>. <source>Brain Sci.</source> <volume>11</volume>:<fpage>308</fpage>. doi: <pub-id pub-id-type="doi">10.3390/brainsci11030308</pub-id>, PMID: <pub-id pub-id-type="pmid">33804457</pub-id></citation></ref>
<ref id="ref17"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Habeck</surname> <given-names>C.</given-names></name> <name><surname>Krakauer</surname> <given-names>J. W.</given-names></name> <name><surname>Ghez</surname> <given-names>C.</given-names></name> <name><surname>Sackeim</surname> <given-names>H. A.</given-names></name> <name><surname>Eidelberg</surname> <given-names>D.</given-names></name> <name><surname>Stern</surname> <given-names>Y.</given-names></name> <etal/></person-group>. (<year>2005a</year>). <article-title>A new approach to spatial covariance modeling of functional brain imaging data: ordinal trend analysis</article-title>. <source>Neural Comput.</source> <volume>17</volume>, <fpage>1602</fpage>&#x2013;<lpage>1645</lpage>. doi: <pub-id pub-id-type="doi">10.1162/0899766053723023</pub-id>, PMID: <pub-id pub-id-type="pmid">15901409</pub-id></citation></ref>
<ref id="ref18"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Habeck</surname> <given-names>C.</given-names></name> <name><surname>Rakitin</surname> <given-names>B. C.</given-names></name> <name><surname>Moeller</surname> <given-names>J.</given-names></name> <name><surname>Scarmeas</surname> <given-names>N.</given-names></name> <name><surname>Zarahn</surname> <given-names>E.</given-names></name> <name><surname>Brown</surname> <given-names>T.</given-names></name> <etal/></person-group>. (<year>2004</year>). <article-title>An event-related fMRI study of the neurobehavioral impact of sleep deprivation on performance of a delayed-match-to-sample task</article-title>. <source>Brain Res. Cogn. Brain Res.</source> <volume>18</volume>, <fpage>306</fpage>&#x2013;<lpage>321</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.cogbrainres.2003.10.019</pub-id>, PMID: <pub-id pub-id-type="pmid">14741317</pub-id></citation></ref>
<ref id="ref19"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Habeck</surname> <given-names>C.</given-names></name> <name><surname>Rakitin</surname> <given-names>B. C.</given-names></name> <name><surname>Moeller</surname> <given-names>J.</given-names></name> <name><surname>Scarmeas</surname> <given-names>N.</given-names></name> <name><surname>Zarahn</surname> <given-names>E.</given-names></name> <name><surname>Brown</surname> <given-names>T.</given-names></name> <etal/></person-group>. (<year>2005b</year>). <article-title>An event-related fMRI study of the neural networks underlying the encoding, maintenance, and retrieval phase in a delayed-match-to-sample task</article-title>. <source>Brain Res. Cogn. Brain Res.</source> <volume>23</volume>, <fpage>207</fpage>&#x2013;<lpage>220</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.cogbrainres.2004.10.010</pub-id>, PMID: <pub-id pub-id-type="pmid">15820629</pub-id></citation></ref>
<ref id="ref20"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Habeck</surname> <given-names>C.</given-names></name> <name><surname>Rakitin</surname> <given-names>B.</given-names></name> <name><surname>Steffener</surname> <given-names>J.</given-names></name> <name><surname>Stern</surname> <given-names>Y.</given-names></name></person-group> (<year>2012</year>). <article-title>Contrasting visual working memory for verbal and non-verbal material with multivariate analysis of fMRI</article-title>. <source>Brain Res.</source> <volume>1467</volume>, <fpage>27</fpage>&#x2013;<lpage>41</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.brainres.2012.05.045</pub-id>, PMID: <pub-id pub-id-type="pmid">22652306</pub-id></citation></ref>
<ref id="ref21"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Habeck</surname> <given-names>C.</given-names></name> <name><surname>Razlighi</surname> <given-names>Q.</given-names></name> <name><surname>Gazes</surname> <given-names>Y.</given-names></name> <name><surname>Barulli</surname> <given-names>D.</given-names></name> <name><surname>Steffener</surname> <given-names>J.</given-names></name> <name><surname>Stern</surname> <given-names>Y.</given-names></name></person-group> (<year>2017</year>). <article-title>Cognitive reserve and brain maintenance: orthogonal concepts in theory and practice</article-title>. <source>Cereb. Cortex</source> <volume>27</volume>, <fpage>3962</fpage>&#x2013;<lpage>3969</lpage>. doi: <pub-id pub-id-type="doi">10.1093/cercor/bhw208</pub-id>, PMID: <pub-id pub-id-type="pmid">27405332</pub-id></citation></ref>
<ref id="ref22"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Holdnack</surname> <given-names>H.A.</given-names></name></person-group> (<year>2001</year>). <source>Wechsler Test of Adult Reading: WTAR.</source> <publisher-loc>San Antonio, TX</publisher-loc>: <publisher-name>The Psychological Corporation</publisher-name></citation></ref>
<ref id="ref23"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ihle</surname> <given-names>A.</given-names></name> <name><surname>Gouveia</surname> <given-names>&#x00C9;. R.</given-names></name> <name><surname>Gouveia</surname> <given-names>B. R.</given-names></name> <name><surname>Freitas</surname> <given-names>D. L.</given-names></name> <name><surname>Jurema</surname> <given-names>J.</given-names></name> <name><surname>Machado</surname> <given-names>F. T.</given-names></name> <etal/></person-group>. (<year>2018</year>). <article-title>The relation of hypertension to performance in immediate and delayed cued recall and working memory in old age: The role of cognitive reserve</article-title>. <source>J. Aging Health</source> <volume>30</volume>, <fpage>1171</fpage>&#x2013;<lpage>1187</lpage>. doi: <pub-id pub-id-type="doi">10.1177/0898264317708883</pub-id>, PMID: <pub-id pub-id-type="pmid">28553824</pub-id></citation></ref>
<ref id="ref24"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jefferson</surname> <given-names>A. L.</given-names></name> <name><surname>Gibbons</surname> <given-names>L. E.</given-names></name> <name><surname>Rentz</surname> <given-names>D. M.</given-names></name> <name><surname>Carvalho</surname> <given-names>J. O.</given-names></name> <name><surname>Manly</surname> <given-names>J.</given-names></name> <name><surname>Bennett</surname> <given-names>D. A.</given-names></name> <etal/></person-group>. (<year>2011</year>). <article-title>A life course model of cognitive activities, socioeconomic status, education, reading ability, and cognition</article-title>. <source>J. Am. Geriatr. Soc.</source> <volume>59</volume>, <fpage>1403</fpage>&#x2013;<lpage>1411</lpage>. doi: <pub-id pub-id-type="doi">10.1111/j.1532-5415.2011.03499.x</pub-id>, PMID: <pub-id pub-id-type="pmid">21797830</pub-id></citation></ref>
<ref id="ref25"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jonides</surname> <given-names>J.</given-names></name> <name><surname>Schumacher</surname> <given-names>E. H.</given-names></name> <name><surname>Smith</surname> <given-names>E. E.</given-names></name> <name><surname>Lauber</surname> <given-names>E. J.</given-names></name> <name><surname>Awh</surname> <given-names>E.</given-names></name> <name><surname>Minoshima</surname> <given-names>S.</given-names></name> <etal/></person-group>. (<year>1997</year>). <article-title>Verbal working memory load affects regional brain activation as measured by PET</article-title>. <source>J. Cogn. Neurosci.</source> <volume>9</volume>, <fpage>462</fpage>&#x2013;<lpage>475</lpage>. doi: <pub-id pub-id-type="doi">10.1162/jocn.1997.9.4.462</pub-id>, PMID: <pub-id pub-id-type="pmid">23968211</pub-id></citation></ref>
<ref id="ref26"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lojo-Seoane</surname> <given-names>C.</given-names></name> <name><surname>Facal</surname> <given-names>D.</given-names></name> <name><surname>Gu&#x00E0;rdia-Olmos</surname> <given-names>J.</given-names></name> <name><surname>Pereiro</surname> <given-names>A. X.</given-names></name> <name><surname>Campos-Magdaleno</surname> <given-names>M.</given-names></name> <name><surname>Mallo</surname> <given-names>S. C.</given-names></name> <etal/></person-group>. (<year>2020</year>). <article-title>Cognitive reserve and working memory in cognitive performance of adults with subjective cognitive complaints: longitudinal structural equation modeling</article-title>. <source>Int. Psychogeriatr.</source> <volume>32</volume>, <fpage>515</fpage>&#x2013;<lpage>524</lpage>. doi: <pub-id pub-id-type="doi">10.1017/S1041610219001248</pub-id>, PMID: <pub-id pub-id-type="pmid">31547899</pub-id></citation></ref>
<ref id="ref27"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Macwhinney</surname> <given-names>B.</given-names></name> <name><surname>Cohen</surname> <given-names>J.</given-names></name> <name><surname>Provost</surname> <given-names>J.</given-names></name></person-group> (<year>1997</year>). <article-title>The PsyScope experiment-building system</article-title>. <source>Spat. Vis.</source> <volume>11</volume>, <fpage>99</fpage>&#x2013;<lpage>101</lpage>. doi: <pub-id pub-id-type="doi">10.1163/156856897X00113</pub-id>, PMID: <pub-id pub-id-type="pmid">9304758</pub-id></citation></ref>
<ref id="ref28"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Manoach</surname> <given-names>D. S.</given-names></name> <name><surname>Schlaug</surname> <given-names>G.</given-names></name> <name><surname>Siewert</surname> <given-names>B.</given-names></name> <name><surname>Darby</surname> <given-names>D. G.</given-names></name> <name><surname>Bly</surname> <given-names>B. M.</given-names></name> <name><surname>Benfield</surname> <given-names>A.</given-names></name> <etal/></person-group>. (<year>1997</year>). <article-title>Prefrontal cortex fMRI signal changes are correlated with working memory load</article-title>. <source>Neuroreport</source> <volume>8</volume>, <fpage>545</fpage>&#x2013;<lpage>549</lpage>. doi: <pub-id pub-id-type="doi">10.1097/00001756-199701200-00033</pub-id>, PMID: <pub-id pub-id-type="pmid">9080445</pub-id></citation></ref>
<ref id="ref29"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mi&#x010D;i&#x010D;</surname> <given-names>S.</given-names></name> <name><surname>Horvat</surname> <given-names>M.</given-names></name> <name><surname>Bakracevic</surname> <given-names>K.</given-names></name></person-group> (<year>2020</year>). <article-title>The impact of working memory training on cognitive abilities in older adults: the role of cognitive reserve</article-title>. <source>Curr. Aging Sci.</source> <volume>13</volume>, <fpage>52</fpage>&#x2013;<lpage>61</lpage>. doi: <pub-id pub-id-type="doi">10.2174/1874609812666190819125542</pub-id>, PMID: <pub-id pub-id-type="pmid">31424375</pub-id></citation></ref>
<ref id="ref30"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nomi</surname> <given-names>J. S.</given-names></name> <name><surname>Bolt</surname> <given-names>T. S.</given-names></name> <name><surname>Ezie</surname> <given-names>C. E. C.</given-names></name> <name><surname>Uddin</surname> <given-names>L. Q.</given-names></name> <name><surname>Heller</surname> <given-names>A. S.</given-names></name></person-group> (<year>2017</year>). <article-title>Moment-to-moment BOLD signal variability reflects regional changes in neural flexibility across the lifespan</article-title>. <source>J. Neurosci.</source> <volume>37</volume>, <fpage>5539</fpage>&#x2013;<lpage>5548</lpage>. doi: <pub-id pub-id-type="doi">10.1523/JNEUROSCI.3408-16.2017</pub-id>, PMID: <pub-id pub-id-type="pmid">28473644</pub-id></citation></ref>
<ref id="ref31"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nucci</surname> <given-names>M.</given-names></name> <name><surname>Mapelli</surname> <given-names>D.</given-names></name> <name><surname>Mondini</surname> <given-names>S.</given-names></name></person-group> (<year>2012</year>). <article-title>Cognitive reserve index questionnaire (CRIq): a new instrument for measuring cognitive reserve</article-title>. <source>Aging Clin. Exp. Res.</source> <volume>24</volume>, <fpage>218</fpage>&#x2013;<lpage>226</lpage>. doi: <pub-id pub-id-type="doi">10.3275/7800</pub-id>, PMID: <pub-id pub-id-type="pmid">21691143</pub-id></citation></ref>
<ref id="ref32"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Postle</surname> <given-names>B. R.</given-names></name> <name><surname>D&#x2019;Esposito</surname> <given-names>M.</given-names></name></person-group> (<year>1999</year>). <article-title>What&#x201C;-then-where&#x201D; in visual working memory: an event-related fMRI study</article-title>. <source>J. Cogn. Neurosci.</source> <volume>11</volume>, <fpage>585</fpage>&#x2013;<lpage>597</lpage>. doi: <pub-id pub-id-type="doi">10.1162/089892999563652</pub-id>, PMID: <pub-id pub-id-type="pmid">10601740</pub-id></citation></ref>
<ref id="ref33"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Postle</surname> <given-names>B. R.</given-names></name> <name><surname>Stern</surname> <given-names>C. E.</given-names></name> <name><surname>Rosen</surname> <given-names>B. R.</given-names></name> <name><surname>Corkin</surname> <given-names>S.</given-names></name></person-group> (<year>2000a</year>). <article-title>An fMRI investigation of cortical contributions to spatial and nonspatial visual working memory</article-title>. <source>NeuroImage</source> <volume>11</volume>, <fpage>409</fpage>&#x2013;<lpage>423</lpage>. doi: <pub-id pub-id-type="doi">10.1006/nimg.2000.0570</pub-id>, PMID: <pub-id pub-id-type="pmid">10806028</pub-id></citation></ref>
<ref id="ref34"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Postle</surname> <given-names>B. R.</given-names></name> <name><surname>Zarahn</surname> <given-names>E.</given-names></name> <name><surname>D&#x2019;Esposito</surname> <given-names>M.</given-names></name></person-group> (<year>2000b</year>). <article-title>Using event-related fMRI to assess delay-period activity during performance of spatial and nonspatial working memory tasks</article-title>. <source>Brain Res. Protoc.</source> <volume>5</volume>, <fpage>57</fpage>&#x2013;<lpage>66</lpage>. doi: <pub-id pub-id-type="doi">10.1016/S1385-299X(99)00053-7</pub-id>, PMID: <pub-id pub-id-type="pmid">10719266</pub-id></citation></ref>
<ref id="ref35"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pur</surname> <given-names>D. R.</given-names></name> <name><surname>Eagleson</surname> <given-names>R. A.</given-names></name> <name><surname>de Ribaupierre</surname> <given-names>A.</given-names></name> <name><surname>Mella</surname> <given-names>N.</given-names></name> <name><surname>de Ribaupierre</surname> <given-names>S.</given-names></name></person-group> (<year>2019</year>). <article-title>Moderating effect of cortical thickness on BOLD signal variability age-related changes</article-title>. <source>Front. Aging Neurosci.</source> <volume>11</volume>:<fpage>46</fpage>. doi: <pub-id pub-id-type="doi">10.3389/fnagi.2019.00046</pub-id>, PMID: <pub-id pub-id-type="pmid">30914944</pub-id></citation></ref>
<ref id="ref36"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Reitan</surname> <given-names>R.</given-names></name></person-group> (<year>1978</year>). <source>Manual for Administration of Neuropsychological Test Batteries for Adults and Children.</source> <publisher-loc>San Antonio, TX</publisher-loc>: <publisher-name>Psychological Corporation</publisher-name></citation></ref>
<ref id="ref37"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rentz</surname> <given-names>D. M.</given-names></name> <name><surname>Locascio</surname> <given-names>J. J.</given-names></name> <name><surname>Becker</surname> <given-names>J. A.</given-names></name> <name><surname>Moran</surname> <given-names>E. K.</given-names></name> <name><surname>Eng</surname> <given-names>E.</given-names></name> <name><surname>Buckner</surname> <given-names>R. L.</given-names></name> <etal/></person-group>. (<year>2010</year>). <article-title>Cognition, reserve, and amyloid deposition in normal aging</article-title>. <source>Ann. Neurol.</source> <volume>67</volume>, <fpage>353</fpage>&#x2013;<lpage>364</lpage>. doi: <pub-id pub-id-type="doi">10.1002/ana.21904</pub-id>, PMID: <pub-id pub-id-type="pmid">20373347</pub-id></citation></ref>
<ref id="ref38"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Roberts</surname> <given-names>R. P.</given-names></name> <name><surname>Grady</surname> <given-names>C. L.</given-names></name> <name><surname>Addis</surname> <given-names>D. R.</given-names></name></person-group> (<year>2020</year>). <article-title>Creative, internally-directed cognition is associated with reduced BOLD variability</article-title>. <source>NeuroImage</source> <volume>219</volume>:<fpage>116758</fpage>. doi: <pub-id pub-id-type="doi">10.1016/j.neuroimage.2020.116758</pub-id>, PMID: <pub-id pub-id-type="pmid">32199956</pub-id></citation></ref>
<ref id="ref39"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rodriguez</surname> <given-names>F. S.</given-names></name> <name><surname>Zheng</surname> <given-names>L.</given-names></name> <name><surname>Chui</surname> <given-names>H. C.</given-names></name></person-group> (<year>2019</year>). <article-title>Psychometric characteristics of cognitive reserve: how high education might improve certain cognitive abilities in aging</article-title>. <source>Dement. Geriatr. Cogn. Disord.</source> <volume>47</volume>, <fpage>335</fpage>&#x2013;<lpage>344</lpage>. doi: <pub-id pub-id-type="doi">10.1159/000501150</pub-id>, PMID: <pub-id pub-id-type="pmid">31466060</pub-id></citation></ref>
<ref id="ref40"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rypma</surname> <given-names>B.</given-names></name> <name><surname>Berger</surname> <given-names>J. S.</given-names></name> <name><surname>D'Esposito</surname> <given-names>M.</given-names></name></person-group> (<year>2002</year>). <article-title>The influence of working-memory demand and subject performance on prefrontal cortical activity</article-title>. <source>J. Cogn. Neurosci.</source> <volume>14</volume>, <fpage>721</fpage>&#x2013;<lpage>731</lpage>. doi: <pub-id pub-id-type="doi">10.1162/08989290260138627</pub-id>, PMID: <pub-id pub-id-type="pmid">12167257</pub-id></citation></ref>
<ref id="ref41"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rypma</surname> <given-names>B.</given-names></name> <name><surname>D'Esposito</surname> <given-names>M.</given-names></name></person-group> (<year>1999</year>). <article-title>The roles of prefrontal brain regions in components of working memory: effects of memory load and individual differences</article-title>. <source>Proc. Natl. Acad. Sci. U. S. A.</source> <volume>96</volume>, <fpage>6558</fpage>&#x2013;<lpage>6563</lpage>. doi: <pub-id pub-id-type="doi">10.1073/pnas.96.11.6558</pub-id>, PMID: <pub-id pub-id-type="pmid">10339627</pub-id></citation></ref>
<ref id="ref42"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rypma</surname> <given-names>B.</given-names></name> <name><surname>D'Esposito</surname> <given-names>M.</given-names></name></person-group> (<year>2000</year>). <article-title>Isolating the neural mechanisms of age-related changes in human working memory</article-title>. <source>Nat. Neurosci.</source> <volume>3</volume>, <fpage>509</fpage>&#x2013;<lpage>515</lpage>. doi: <pub-id pub-id-type="doi">10.1038/74889</pub-id>, PMID: <pub-id pub-id-type="pmid">10769393</pub-id></citation></ref>
<ref id="ref43"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rypma</surname> <given-names>B.</given-names></name> <name><surname>D'Esposito</surname> <given-names>M.</given-names></name></person-group> (<year>2003</year>). <article-title>A subsequent-memory effect in dorsolateral prefrontal cortex</article-title>. <source>Brain Res. Cogn. Brain Res.</source> <volume>16</volume>, <fpage>162</fpage>&#x2013;<lpage>166</lpage>. doi: <pub-id pub-id-type="doi">10.1016/S0926-6410(02)00247-1</pub-id>, PMID: <pub-id pub-id-type="pmid">12668223</pub-id></citation></ref>
<ref id="ref44"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rypma</surname> <given-names>B.</given-names></name> <name><surname>Prabhakaran</surname> <given-names>V.</given-names></name> <name><surname>Desmond</surname> <given-names>J. E.</given-names></name> <name><surname>Gabrieli</surname> <given-names>J. D.</given-names></name></person-group> (<year>2001</year>). <article-title>Age differences in prefrontal cortical activity in working memory</article-title>. <source>Psychol. Aging</source> <volume>16</volume>, <fpage>371</fpage>&#x2013;<lpage>384</lpage>. doi: <pub-id pub-id-type="doi">10.1037/0882-7974.16.3.371</pub-id></citation></ref>
<ref id="ref45"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rypma</surname> <given-names>B.</given-names></name> <name><surname>Prabhakaran</surname> <given-names>V.</given-names></name> <name><surname>Desmond</surname> <given-names>J. E.</given-names></name> <name><surname>Glover</surname> <given-names>G. H.</given-names></name> <name><surname>Gabrieli</surname> <given-names>J. D.</given-names></name></person-group> (<year>1999</year>). <article-title>Load-dependent roles of frontal brain regions in the maintenance of working memory</article-title>. <source>NeuroImage</source> <volume>9</volume>, <fpage>216</fpage>&#x2013;<lpage>226</lpage>. doi: <pub-id pub-id-type="doi">10.1006/nimg.1998.0404</pub-id>, PMID: <pub-id pub-id-type="pmid">9927550</pub-id></citation></ref>
<ref id="ref46"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sandry</surname> <given-names>J.</given-names></name> <name><surname>Sumowski</surname> <given-names>J. F.</given-names></name></person-group> (<year>2014</year>). <article-title>Working memory mediates the relationship between intellectual enrichment and long-term memory in multiple sclerosis: an exploratory analysis of cognitive reserve</article-title>. <source>J. Int. Neuropsychol. Soc.</source> <volume>20</volume>, <fpage>868</fpage>&#x2013;<lpage>872</lpage>. doi: <pub-id pub-id-type="doi">10.1017/S1355617714000630</pub-id>, PMID: <pub-id pub-id-type="pmid">25017699</pub-id></citation></ref>
<ref id="ref47"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Smith</surname> <given-names>E. E.</given-names></name> <name><surname>Jonides</surname> <given-names>J.</given-names></name></person-group> (<year>1997</year>). <article-title>Working memory: a view from neuroimaging</article-title>. <source>Cogn. Psychol.</source> <volume>33</volume>, <fpage>5</fpage>&#x2013;<lpage>42</lpage>. doi: <pub-id pub-id-type="doi">10.1006/cogp.1997.0658</pub-id></citation></ref>
<ref id="ref48"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Smith</surname> <given-names>E. E.</given-names></name> <name><surname>Jonides</surname> <given-names>J.</given-names></name></person-group> (<year>1998</year>). <article-title>Neuroimaging analyses of human working memory</article-title>. <source>Proc. Natl. Acad. Sci. U. S. A.</source> <volume>95</volume>, <fpage>12061</fpage>&#x2013;<lpage>12068</lpage>. doi: <pub-id pub-id-type="doi">10.1073/pnas.95.20.12061</pub-id>, PMID: <pub-id pub-id-type="pmid">9751790</pub-id></citation></ref>
<ref id="ref49"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Smith</surname> <given-names>E. E.</given-names></name> <name><surname>Jonides</surname> <given-names>J.</given-names></name> <name><surname>Marshuetz</surname> <given-names>C.</given-names></name> <name><surname>Koeppe</surname> <given-names>R. A.</given-names></name></person-group> (<year>1998</year>). <article-title>Components of verbal working memory: evidence from neuroimaging</article-title>. <source>Proc. Natl. Acad. Sci. U. S. A.</source> <volume>95</volume>, <fpage>876</fpage>&#x2013;<lpage>882</lpage>. doi: <pub-id pub-id-type="doi">10.1073/pnas.95.3.876</pub-id>, PMID: <pub-id pub-id-type="pmid">9448254</pub-id></citation></ref>
<ref id="ref50"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Song</surname> <given-names>S.</given-names></name> <name><surname>Stern</surname> <given-names>Y.</given-names></name> <name><surname>Gu</surname> <given-names>Y.</given-names></name></person-group> (<year>2022</year>). <article-title>Modifiable lifestyle factors and cognitive reserve: A systematic review of current evidence</article-title>. <source>Ageing Res. Rev.</source> <volume>74</volume>:<fpage>101551</fpage>. doi: <pub-id pub-id-type="doi">10.1016/j.arr.2021.101551</pub-id>, PMID: <pub-id pub-id-type="pmid">34952208</pub-id></citation></ref>
<ref id="ref51"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Speer</surname> <given-names>M. E.</given-names></name> <name><surname>Soldan</surname> <given-names>A.</given-names></name></person-group> (<year>2015</year>). <article-title>Cognitive reserve modulates ERPs associated with verbal working memory in healthy younger and older adults</article-title>. <source>Neurobiol. Aging</source> <volume>36</volume>, <fpage>1424</fpage>&#x2013;<lpage>1434</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.neurobiolaging.2014.12.025</pub-id>, PMID: <pub-id pub-id-type="pmid">25619663</pub-id></citation></ref>
<ref id="ref52"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Stern</surname> <given-names>Y.</given-names></name></person-group> (<year>2002</year>). <article-title>What is cognitive reserve? Theory and research application of the reserve concept</article-title>. <source>J. Int. Neuropsychol. Soc.</source> <volume>8</volume>, <fpage>448</fpage>&#x2013;<lpage>460</lpage>. doi: <pub-id pub-id-type="doi">10.1017/S1355617702813248</pub-id>, PMID: <pub-id pub-id-type="pmid">11939702</pub-id></citation></ref>
<ref id="ref53"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Stern</surname> <given-names>Y.</given-names></name></person-group> (<year>2009</year>). <article-title>Cognitive reserve</article-title>. <source>Neuropsychologia</source> <volume>47</volume>, <fpage>2015</fpage>&#x2013;<lpage>2028</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.neuropsychologia.2009.03.004</pub-id>, PMID: <pub-id pub-id-type="pmid">19467352</pub-id></citation></ref>
<ref id="ref54"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Stern</surname> <given-names>Y.</given-names></name> <name><surname>Arenaza-Urquijo</surname> <given-names>E. M.</given-names></name> <name><surname>Bartres-Faz</surname> <given-names>D.</given-names></name> <name><surname>Belleville</surname> <given-names>S.</given-names></name> <name><surname>Cantilon</surname> <given-names>M.</given-names></name> <name><surname>Chetelat</surname> <given-names>G.</given-names></name> <etal/></person-group>. (<year>2020</year>). <article-title>Whitepaper: defining and investigating cognitive reserve, brain reserve, and brain maintenance</article-title>. <source>Alzheimers Dement.</source> <volume>16</volume>, <fpage>1305</fpage>&#x2013;<lpage>1311</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.jalz.2018.07.219</pub-id>, PMID: <pub-id pub-id-type="pmid">30222945</pub-id></citation></ref>
<ref id="ref55"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Stern</surname> <given-names>Y.</given-names></name> <name><surname>Barnes</surname> <given-names>C. A.</given-names></name> <name><surname>Grady</surname> <given-names>C.</given-names></name> <name><surname>Jones</surname> <given-names>R. N.</given-names></name> <name><surname>Raz</surname> <given-names>N.</given-names></name></person-group> (<year>2019</year>). <article-title>Brain reserve, cognitive reserve, compensation, and maintenance: operationalization, validity, and mechanisms of cognitive resilience</article-title>. <source>Neurobiol. Aging</source> <volume>83</volume>, <fpage>124</fpage>&#x2013;<lpage>129</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.neurobiolaging.2019.03.022</pub-id>, PMID: <pub-id pub-id-type="pmid">31732015</pub-id></citation></ref>
<ref id="ref56"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Stern</surname> <given-names>Y.</given-names></name> <name><surname>Barulli</surname> <given-names>D.</given-names></name></person-group> (<year>2019</year>). <article-title>Cognitive reserve</article-title>. <source>Handb. Clin. Neurol.</source> <volume>167</volume>, <fpage>181</fpage>&#x2013;<lpage>190</lpage>. doi: <pub-id pub-id-type="doi">10.1016/B978-0-12-804766-8.00011-X</pub-id></citation></ref>
<ref id="ref57"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Wechsler</surname> <given-names>D.</given-names></name></person-group> (<year>1997</year>). <source>Wechsler Adult Intelligence Scale.</source> <edition>3rd Edn.</edition> <publisher-loc>San Antonio, TX</publisher-loc>: <publisher-name>Harcourt Assessment</publisher-name>, <fpage>684</fpage>&#x2013;<lpage>690</lpage>.</citation></ref>
<ref id="ref58"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Woolrich</surname> <given-names>M. W.</given-names></name> <name><surname>Ripley</surname> <given-names>B. D.</given-names></name> <name><surname>Brady</surname> <given-names>M.</given-names></name> <name><surname>Smith</surname> <given-names>S. M.</given-names></name></person-group> (<year>2001</year>). <article-title>Temporal autocorrelation in univariate linear modeling of FMRI data</article-title>. <source>NeuroImage</source> <volume>14</volume>, <fpage>1370</fpage>&#x2013;<lpage>1386</lpage>. doi: <pub-id pub-id-type="doi">10.1006/nimg.2001.0931</pub-id>, PMID: <pub-id pub-id-type="pmid">11707093</pub-id></citation></ref>
<ref id="ref59"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zarantonello</surname> <given-names>L.</given-names></name> <name><surname>Schiff</surname> <given-names>S.</given-names></name> <name><surname>Amodio</surname> <given-names>P.</given-names></name> <name><surname>Bisiacchi</surname> <given-names>P.</given-names></name></person-group> (<year>2020</year>). <article-title>The effect of age, educational level, gender and cognitive reserve on visuospatial working memory performance across adult life span</article-title>. <source>Neuropsychol. Dev. Cogn. B Aging Neuropsychol. Cogn.</source> <volume>27</volume>, <fpage>302</fpage>&#x2013;<lpage>319</lpage>. doi: <pub-id pub-id-type="doi">10.1080/13825585.2019.1608900</pub-id>, PMID: <pub-id pub-id-type="pmid">31046560</pub-id></citation></ref>
</ref-list>
<fn-group>
<fn id="fn0004">
<p><sup>1</sup><ext-link xlink:href="https://reserveandresilience.com/" ext-link-type="uri">https://reserveandresilience.com/</ext-link></p>
</fn>
<fn id="fn0005">
<p><sup>2</sup><ext-link xlink:href="https://reserveandresilience.com/framework/" ext-link-type="uri">https://reserveandresilience.com/framework/</ext-link></p>
</fn>
<fn id="fn0006">
<p><sup>3</sup><ext-link xlink:href="http://surfer.nmr.mgh.harvard.edu/" ext-link-type="uri">http://surfer.nmr.mgh.harvard.edu/</ext-link></p>
</fn>
<fn id="fn0007">
<p><sup>4</sup><ext-link xlink:href="https://reserveandresilience.com/" ext-link-type="uri">https://reserveandresilience.com/</ext-link></p>
</fn>
</fn-group>
</back>
</article>