Front. Neurol.Frontiers in NeurologyFront. Neurol.1664-2295Frontiers Media S.A.10.3389/fneur.2016.00215NeuroscienceOriginal ResearchAllocentric Spatial Memory Testing Predicts Conversion from Mild Cognitive Impairment to Dementia: An Initial Proof-of-Concept StudyWoodRuth A.12MoodleyKuven K.1LeverColin3MinatiLudovico45ChanDennis6*1Department of Medicine, Brighton and Sussex Medical School, Falmer, UK2Sainsbury Wellcome Centre for Neural Circuits and Behaviour, University College London, London, UK3Department of Psychology, University of Durham, Durham, UK4U.O. Direzione Scientifica, Fondazione IRCCS, Istituto Neurologico Carlo Besta, Milan, Italy5Centro Interdipartimentale Mente/Cervello (CIMeC), Università di Trento, Trento, Italy6Department of Clinical Neurosciences, University of Cambridge, Cambridge, UK
Edited by: Stefano L. Sensi, University of California, Irvine, USA
Reviewed by: Valerio Frazzini, G. d’Annunzio University, Italy; Nicola Mammarella, University of Chieti-Pescara, Italy; Giorgia Committeri, University of Chieti-Pescara, Italy
*Correspondence: Dennis Chan, dc598@medschl.cam.ac.uk
Specialty section: This article was submitted to Neurodegeneration, a section of the journal Frontiers in Neurology
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
The hippocampus is one of the first regions to exhibit neurodegeneration in Alzheimer’s disease (AD), and knowledge of its role in allocentric spatial memory may therefore aid early diagnosis of AD. The 4 Mountains Test (4MT) is a short and easily administered test of spatial memory based on the cognitive map theory of hippocampal function as derived from rodent single cell and behavioral studies. The 4MT has been shown in previous cross-sectional studies to be sensitive and specific for mild cognitive impairment (MCI) due to AD. This report describes the initial results of a longitudinal study testing the hypothesis that allocentric spatial memory is predictive of conversion from MCI to dementia. Fifteen patients with MCI underwent baseline testing on the 4MT in addition to CSF amyloid/tau biomarker studies, volumetric MRI and neuropsychological assessment including the Rey Auditory Verbal Learning Test (RAVLT) and Trail Making Test “B” (TMT-B). At 24 months, 9/15 patients had converted to AD dementia. The 4MT predicted conversion to AD with 93% accuracy (Cohen’s d = 2.52). The predictive accuracies of the comparator measures were as follows: CSF tau/β-amyloid1–42 ratio 92% (d = 1.81), RAVLT 64% (d = 0.41), TMT-B 78% (d = 1.56), and hippocampal volume 77% (d = 0.65). CSF tau levels were strongly negatively correlated with 4MT scores (r = −0.71). This proof-of-concept study provides initial support for the hypothesis that allocentric spatial memory testing is a predictive cognitive marker of hippocampal neurodegeneration in pre-dementia AD. The 4MT is a brief, non-invasive, straightforward spatial memory test and is therefore ideally suited for use in routine clinical diagnostic practice. This is of particular importance given the current unmet need for simple accurate diagnostic tests for early AD and the ongoing development of potential disease-modifying therapeutic agents, which may be more efficacious when given earlier in the disease course. By applying a test based on studies of hippocampal function in rodents to patient populations, this work represents the first step in the development of translatable biomarkers of hippocampal involvement in early AD for use in both animal models and human subjects.
Alzheimer’s diseasemild cognitive impairmentspatial memoryhippocampusFour Mountains TestdementiaMR/M018067/1BB/M008975/1Medical Research Council10.13039/501100000265National Institute for Health Research10.13039/501100000272Biotechnology and Biological Sciences Research Council10.13039/501100000268Introduction
The anticipated arrival of disease-modifying drugs for the treatment of Alzheimer’s disease (AD) places increased emphasis on the need to identify AD in its earliest stages, when such treatments may have greatest benefit in delaying or preventing the onset of dementia. It is now accepted that AD presents as mild cognitive impairment (MCI) in its prodromal stages (1), but MCI can also be caused by non-AD disorders with lower dementia risk, including non-neurodegenerative conditions such as anxiety. Identification of MCI on clinical grounds alone cannot discriminate between the various differing underlying etiologies (2, 3). The high prevalence of memory impairment in the aging population [in a US study, 27% of people over 65 years reported memory decline (4)] amplifies the difficulty of accurately differentiating MCI due to AD and highlights the need for diagnostic tests that are not only sensitive and specific for pre-dementia AD but are also non-invasive and usable in routine clinical diagnostic practice.
This need is not met by current tests. Screening tests of global cognitive function of the kind typically used in primary care, such as the Mini-Mental State Examination (MMSE), have low diagnostic specificity and are poor predictors of conversion to dementia (5, 6). Tests of specific cognitive domains, such as episodic memory or attention, have higher diagnostic accuracy but require training in administration and scoring and are primarily used in specialist clinics (7–9). Biomarker-based tests, such as MRI measurements of hippocampal atrophy, amyloid-PET scanning, or CSF studies of amyloid/tau, have higher predictive accuracy (10–12), but the high cost, limited availability, and invasive nature of some tests preclude their usage in routine clinical practice.
This need may be met by a hippocampus-dependent test of allocentric spatial memory. Neuropathological studies have shown the hippocampus to be one of the first brain regions affected in AD (13), and there is extensive evidence that the hippocampus is critically involved in spatial memory, with the demonstration in rodents of spatially related firing activity of hippocampal neurons “place cells” (14) and of a correlation between place cell activity and spatial memory (15). Importantly, in an open arena, hippocampal spatial neurons signal location in an allocentric reference frame. Place cells and boundary cells fire in a viewpoint-independent manner such that a given neuron fires at broadly similar rates whether the subject is, for instance, facing north or south as it moves through the neuron’s locational firing field (16, 17). This signaling of viewpoint-independent location is a defining characteristic of hippocampal spatial representation.
A role for the human hippocampus in spatial memory is supported by pre-surgical depth electrode recordings of place-related firing of hippocampal neurons (18), and functional imaging studies showing activation of the hippocampus during spatial memory tasks (19, 20). Patients with focal hippocampal lesions show disproportionate impairment of spatial memory (21), and several studies have shown that spatial memory is impaired in patients with MCI and AD (22–25). However, to date, the ability of spatial memory testing to predict conversion from MCI to AD dementia has not been evaluated.
A variety of differing behavioral paradigms have been used to test spatial memory in humans. These include the Hidden Goal Task (26), which was designed as a human analog of the Morris water maze used for rodent studies (27) and assesses memory for hidden locations within a three meter diameter, circular, velvet arena, as well as a variety of tests of spatial navigation and memory using desktop-based virtual reality (VR) paradigms (22, 28). However, these paradigms have operational limitations that render them unsuitable for use as diagnostic tests for prodromal AD in routine clinical practice. The space requirements of the Hidden Goal Task effectively precludes its usage beyond research labs with dedicated testing arenas, whereas the various VR tests used to date require significant tester input and have been associated with nausea and disorientation when applied to older individuals with early AD (29).
The 4 Mountains Test (4MT) is an easily administered test of allocentric spatial memory, which builds upon the defining characteristic of hippocampal spatial representation mentioned above in discussing rodent spatial neurons: the signaling of viewpoint-independent location. Essentially, the task requires that the participant correctly identifies a previously seen location, though the viewpoint the location is seen from has shifted from sample to test. The 4MT is specifically designed to be resistant to non-spatial strategies (30). The 4MT can be applied in paper form, with or as an iPad app, and requires little in the way of tester training or instructions (a video example of test administration is viewable via the open access article by Chan et al. (31)). The brevity of the test (around 10 minutes for the paper version and around 8 minutes for the app) is comparable to the MMSE (Mini Mental State Examination Test) (5), which is widely used worldwide as a short screening test for cognitive impairment but a poor predictor of progression from MCI to dementia (6). Following the initial use of this test to demonstrate that patients with focal hippocampal damage were selectively impaired on spatial memory testing, with relative preservation of spatial perception and non-spatial memory (30), performance on the 4MT has been found to discriminate between AD and non-AD dementia (29, 32) and between MCI patients with and without CSF biomarker evidence of underlying AD (33).
Following on from these cross-sectional studies, this initial longitudinal study used the 4MT to test the primary hypothesis that allocentric spatial memory test performance is predictive of conversion from MCI to AD dementia. Additionally, the secondary hypothesis that spatial memory is a behavioral marker of hippocampal neurodegeneration in early AD was tested by correlating 4MT scores with levels of CSF total tau, representing a biomarker of neurodegeneration in AD.
Demographic variables and candidate predictors of conversion.
Demographic or predictor variable
MCI – converters (mean ± SE)
MCI – non-converters (mean ± SE)
Difference statistic
p-value*
Cohen’s d (effect size)
Gender
2 F:7 M
2 F:4 M
X21 = 0.227
0.63
–
Age
71.7 ± 3.0
65.2 ± 3.4
T13 = 1.41
0.18
0.75
Years of education
12.1 ± 0.7
11.0 ± 0.5
T13 = 1.19
0.26
0.67
NART estimated IQ
106.6 ± 3.9
114.7 ± 3.4
T10 = 1.50
0.16
0.90
4MT score
5.56 ± 0.71
10.17 ± 0.60
T13 = 4.60
0.0005
2.52
TMT-B (s)
132.55 ± 14.98
80.78 ± 8.36
T12 = 2.74
0.018
1.56
RAVLT score
2.38 ± 0.62
3.33 ± 0.14
T12 = 0.79
0.45
0.41
MMSE score
27.89 ± 0.42
27.33 ± 0.21
T13 = 1.01
0.33
0.58
Total hippocampal volume (% of total intracranial volume)
0.509 ± 0.037
0.577 ± 0.45
T11 = 1.18
0.26
0.65
CSF total tau:β-amyloid1–42
3.57 ± 0.92
0.45 ± 0.09
T11 = 3.12
0.001
1.81
MCI, mild cognitive impairment; 4MT, Four Mountains Test; TMT-B, Trail Making Test B; RAVLT, Rey Auditory Verbal Learning Test; MMSE, Mini Mental State Examination.
*Uncorrected p-values.
Bold font signifies p-values that are statistically significant at the p < 0.05 level.
As part of their diagnostic work-up 13/15 MCI subjects had CSF tested for AD biomarkers (CSF β-amyloid1–42, CSF tau, CSF tau/β-amyloid1–42 ratio) using industry standard ELISA assay kits (Innotest, Innogenetics, Ghent, Belgium) in accordance with the CSF collection protocol of the CSF sub-study of the Alzheimer’s disease Neuroimaging Initiative (ADNI) (37). The 13/15 subjects had MRI scans with T1-weighted volumetric MRI data acquired on a 1.5T Siemens Avanto scanner based at the Clinical Imaging Sciences Centre, Brighton and Sussex Medical School using a magnetization-prepared rapid-acquisition gradient-echo sequence to generate voxels of 1 mm × 1 mm × 1 mm. Total hippocampal volumes, corrected for total intracranial volume, were measured using the FSL(version 5.0)/FIRST tool (FMRIB, Oxford Centre for Functional Magnetic Resonance Imaging of the Brain, Oxford, UK) (38). In those instances where CSF and MRI investigations were not undertaken, this was due to patient preference.
The study was undertaken in accordance with the Declaration of Helsinki and all participants provided written informed consent. Ethical approval was obtained from the UK Research Ethics Committee South East Coast – Brighton and Sussex (references 10/H1107/23 and 13/LO/0277).
The 4 Mountains Test
A full description of the 4MT is provided by Hartley et al. (30). The spatial memory test involves presentation of computer-generated landscapes, each containing images of four mountains arranged around the center of the landscape, in the form of printed color images within an A4-sized booklet. For each test item, a sample image is presented for eight seconds. After a two second delay, this image is re-presented, but from a different viewpoint, alongside three foil images of landscapes with differing topography (Figure 1). Fifteen test items were shown in all, and the total test duration was approximately ten minutes. Participants completed the 4MT alongside additional neuropsychological tests at entry into the study, with all testing undertaken during a single sitting.
The 4 Mountains Test. (A) A landscape containing four mountains is presented for 8 seconds and then removed. (B) After a 2 second delay, this landscape is re-presented, but from a rotated viewpoint, with three additional “foil” landscapes, in a delayed match-to-sample paradigm (the correct response is the bottom right image).
Baseline Neuropsychological Testing
Subjects completed a battery of baseline neuropsychological tests, which included the National Adult Reading Test (NART) (39) to obtain an estimation of premorbid IQ in line with numerous other studies of cognitive function in clinical cohorts, and subtests of the Visual Object and Space Perception battery (40) for assessment of visual perception. The neuropsychological test battery also included two tests considered to be sensitive to early AD (1) and thus effective predictors of progression from MCI to AD dementia (8, 41). These are the Rey Auditory Verbal Learning Test [RAVLT; (42)], a test of episodic memory, and the Trail Making Test “B” (TMT-B) (43), a test probing several cognitive domains including attention, speed of information processing, and executive function. One subject declined to complete the tests outlined above due to anxiety.
Determination of Conversion Status
Conversion status was determined 24 months after study enrollment by a neurologist (Kuven K. Moodley and Dennis Chan) in clinic, blinded to the baseline 4MT score, with the diagnosis of AD dementia made in accordance with the 2011 McKhann criteria (44). In addition to the presence of cognitive or behavioral symptoms involving at least two cognitive domains, conversion to AD dementia from MCI was based on decline in cognitive function on objective testing, new impairment in activities of daily living and loss of functional independence, representing changes from the time of the previously attributed MCI diagnosis.
Comparison of 4MT Performance with Other Measures
The ability of the 4MT to predict conversion from MCI to dementia was compared with five other measures. In addition to the RAVLT (delayed free recall score) and TMT-B (completion time), comparisons were made with the MMSE score, total hippocampal volume, and CSF tau/β-amyloid1–42 ratio.
The rationale for these additional comparisons is as follows. While systematic reviews have shown that the predictive ability of the MMSE is low (6), it is part of the Preclinical Alzheimer Cognitive Composite (45) that is approved by the FDA for use as an outcome measure in trials of treatments aiming to delay progression from MCI to dementia. Furthermore, the MMSE is used widely as a cognitive screening test in UK memory services, notably in primary care, and as such the MMSE score has a bearing on the clinical management of patients presenting with MCI. Total hippocampal volume and CSF tau/β-amyloid1–42 ratio are included as comparators in view of their status as AD biomarkers included within research criteria for the diagnosis of MCI due to AD (1).
These five comparator measures were analyzed as both continuous (Table 1) and binary (Table 2) variables.
Binary classification using candidate predictor variables.
Criterion for positive test (see methods)
Prevalence (of converter positive cases in sample, %)
Sensitivity (%)
Specificity (%)
PPV:NPV (%)
Accuracy (%)
Youden’s J
AUC ± SE
AUC p-value (0.5 AUC = H0)
4MT score
≤8
60 (n = 15)
100
83.3
90.0:100
93.3
0.833
0.981 ± 0.022
<0.0001
TMT-B (s)
>102.6
57.1 (n = 14)
62.5
100
100:66.7
78.6
0.625
0.875 ± 0.094
0.0001
RAVLT score
≤3
57.1 (n = 14)
75.0
50.0
66.7:60.0
64.3
0.250
0.604 ± 0.168
0.54
MMSE score
≤27
60 (n = 15)
44.4
33.3
50.0:28.6
40.0
−0.222
0.370 ± 0.140
>0.5*
Total hippocampal volume (% of TIV)
≤0.570
53.8 (n = 13)
85.7
66.7
75.0:80.0
76.9
0.524
0.714 ± 0.163
0.19
CSF total tau:β-amyloid1–42
>0.821
53.8 (n = 13)
85.7
100
100:85.7
92.3
0.857
0.905 ± 0.100
0.0001
PPV, positive predictive value; NPV, negative predictive value; AUC, area under curve; TIV, total intracranial volume.
*An exact p-value is not given here as the ROC curve for MMSE was below the chance line.
Bold font signifies p-values that are statistically significant at the p < 0.05 level.
Statistical Analysis
Data were analyzed using MedCalc Statistical Software version 15.6.1 (MedCalc Software bvba, Ostend, Belgium, 2015). For all continuous data, normality was assessed using normal probability plots and Shapiro–Wilk testing, and Levene’s test was applied to ensure homogeneity of variances. No corrections were necessary. Cohen’s d provided a measure of effect size, calculated by dividing the difference between the group means by their pooled SD (√[(StDevConverters2 + StDevNon-Converters2)/2]).
The threshold criteria for binary classification (MCI converters vs. MCI non-converters) for each of the comparators were selected by maximizing Youden’s index J (Table 2), where Youden’s J = sensitivity + specificity − 1. The SE of the area under the curve (AUC) and the probability value of the AUC under the null hypothesis of AUC = 0.5 were calculated according to the method of DeLong et al. (46).
ResultsDemographics
There were no statistically significant differences between MCI converters and MCI non-converters in terms of age [71.7 ± 3.0 years (mean ± SE) vs. 65.2 ± 3.4, p = 0.18], years of education (12.1 ± 0.7 vs. 11.0 ± 0.5, p = 0.26), gender (2 F:7 M vs. 2 F:4 M, p = 0.634), or NART estimated IQ (106.6 ± 3.9 vs. 114.7 ± 3.4, p = 0.16). An ANCOVA of the 4MT score vs. converter status, with age and IQ as covariates, showed that their effect on conversion status was non-significant (p = 0.223, p = 0.332, respectively). The effect of 4MT score on conversion status remained significant even after accounting for group differences in age and IQ.
Correlation of 4MT Score with CSF AD Biomarkers
4MT scores were strongly negatively correlated with the levels of CSF total tau (r = −0.71, p = 0.007; Figure 2F) but did not correlate with the levels of CSF Aβ1–42 (r = 0.5, p = 0.08). CSF tau levels were negatively correlated with total hippocampal volume (r = −0.59, p = 0.04) in keeping with previous studies (47, 48), but after controlling for hippocampal volume, CSF tau still robustly predicted 4MT spatial memory score (n = 12, partial r = −0.84, p = 0.001).
(A–E) Threshold plots illustrating the differences in scores/measures between converters and non-converters. (A) 4 Mountains Test (4MT) spatial memory score, (B) Trail Making Test B (TMT-B) time (s), (C) Rey Auditory Verbal Learning Test (RAVLT) score (Delayed Free Recall), (D) total hippocampal volume (as % of total intracranial volume), and (E) CSF tau:β-amyloid1–42. (F) Scatterplot illustrating the relationship between CSF total tau and 4MT score. Gray dashed line indicates line of best fit.
Thirteen subjects were available for the 4MT vs. hippocampal volume correlation. An r value ≥0.56 would be required for significance in a two-tailed test where n = 13. The correlation coefficient obtained in this sample, r = 0.43, is therefore not statistically significant. However, it is worth noting that this value is similar to that observed in a much larger sample of MCI and AD patients (33).
Accuracy of 4MT and Comparator Variables in Predicting Conversion to Dementia
At 24-month follow-up, 9/15 MCI patients converted to AD dementia, with the remaining 6/15 patients having unchanged diagnoses of MCI. MCI converter and non-converter groups differed significantly on 4MT (lower scores in converters, p = 0.0005, Cohen’s d = 2.52), TMT-B (longer completion time in converters, p = 0.018, Cohen’s d = 1.56), and in terms of CSF tau/β-amyloid1–42 ratios (lower ratios in converters, p = 0.001, Cohen’s d = 1.81) (Table 1; Figures 2A,B,E). The two groups did not differ significantly in terms of MMSE score, RAVLT delayed free recall score or total hippocampal volume (all p-values ≥ 0.33, Table 1; Figures 2C,D). ROC curve analysis for the study predictor variables showed that the AUC was significantly above chance for 4MT score (AUC = 0.981, p < 0.0001), CSF tau/β-amyloid1–42 ratio (AUC = 0.905, p = 0.0001), and TMT-B time (AUC = 0.875, p = 0.0001) (Table 2). MMSE, RAVLT, and total hippocampal volume did not predict conversion (all p-values ≥ 0.19, Table 2; Figures 2C,D).
Only two measures were associated with overall classification accuracies and Youden’s J values above 80%, namely the 4MT score (93%, 0.833) and CSF tau/β-amyloid1–42 ratios (93%, 0.857) (Table 2; Figures 2A,E).
Discussion
Spatial memory is impaired in patients with mild dementia due to AD (24, 25, 32, 49), and more recent work has demonstrated that impairment is already evident in the pre-dementia stages of AD (33, 50). Both allocentric and egocentric spatial memory have been observed to be defective in patients with amnestic MCI (22–25), with some evidence that allocentric spatial memory, dependent on hippocampal function, is more impaired in these patients than egocentric spatial memory, which is more dependent on striatal function (51).
No studies to date have demonstrated that performance on a spatial memory task can predict conversion from MCI to AD dementia. Given the prevalence of memory impairment in the aging population and the difficulty of distinguishing MCI due to AD from other causes of memory impairment (such as depression or anxiety) on clinical grounds alone, the identification of a test with high predictive value would have major benefits for clinical practice on a large scale.
The 4 Mountains Test (4MT) of allocentric spatial memory has been shown in a previous cross-sectional study to differentiate MCI due to AD (32, 33). This initial longitudinal study of 15 MCI patients followed up over 24 months provides early support for the hypothesis that allocentric spatial memory testing is an accurate predictor of conversion from MCI to AD dementia. Performance on the 4MT predicted conversion with a classification accuracy of 93%, superior to the predictive accuracy of cognitive tests widely used in clinical and research practice for the diagnosis of MCI, with a 64% accuracy observed with the RAVLT and a 79% accuracy associated with the TMT-B. Given its widespread usage in clinical practice worldwide, a comparison was also made with the MMSE, and the low predictive accuracy (40%) associated with this test in the current study is consistent with the findings of a recent systematic review (6), which concluded that the MMSE was a poor predictor of conversion.
Further comparison with the predictive accuracy of AD biomarkers was undertaken. Total hippocampal volume, widely used as an outcome measure in treatment trials aimed at delaying the progression from MCI to AD dementia, was associated with an accuracy of 77%. The 92% predictive accuracy of the CSF tau/β-amyloid1–42 ratio is similar to the 93% accuracy of the 4MT, while the positive and negative predictive values of the CSF tau/β-amyloid1–42 ratio of 100 and 86%, respectively, bear comparison with figures of 81 and 96% from a previous longitudinal study (52).
CSF total tau, considered to be a measure of tau release from dying or dysfunctional neurons containing neurofibrillary tangles, is used as a biomarker of neurodegeneration in AD and levels of CSF total tau are negatively correlated with performance on the RAVLT and semantic fluency tests (47, 53). While correlations are also observed with hippocampal volume (47), this is the first study to report a correlation between CSF total tau and performance on a hippocampus-dependent spatial memory task. The strength of the correlation (r = −0.71) suggests that testing of allocentric spatial memory may represent a behavioral marker of tau-related hippocampal neurodegeneration. This has increased significance in light of the current practice of using β-amyloid biomarkers for diagnosing AD in its pre-dementia stages or as screening tests for clinical trials, in the form of CSF β-amyloid1–42 or amyloid-PET scanning. The recent observation that a third of cognitively healthy older individuals with positive CSF amyloid biomarkers did not exhibit any cognitive decline over 9-year follow-up (54) illustrates the limitations associated with β-amyloid biomarkers and the importance of markers of neurodegeneration in predicting cognitive decline in individuals at risk of developing dementia.
In addition to the above, these initial findings have further implications for experimental medicine and clinical practice. First of all, the successful application to clinical diagnostic practice of a test based on a theory of hippocampal function derived from single cell and behavioral studies in rodents (55) helps bridge the divide between basic and clinical neuroscience and represents a significant step forward in the development of translatable behavioral markers of early AD. Second, the brief duration of the 4MT, combined with its ease of application and scoring, ensures that this test is ideally suited for use as a diagnostic test for pre-dementia AD not only in specialist clinics but also in non-specialist diagnostic practice, such as primary care clinics and community-based memory assessment services. These typically represent the first points of medical contact for people with memory decline and the potential value of the 4MT in this context is underscored by the observation in this study (and others) that the MMSE, which is the cognitive test most widely used in non-specialist clinics, is a poor predictor of conversion from MCI to dementia.
The usability and potential for widespread clinical application of the 4MT differentiates this test from other behavioral tests of spatial memory. Alternative tests of allocentric spatial memory, such as the virtual radial maze task (28, 49), the Hidden Goal Task (23) and the Virtual Route Learning Test (29), are based on the same underlying theoretical principles as the 4MT and accordingly have identified spatial behavioral deficits in patients with MCI. However, the complexity of test administration (especially with older adults) and problems with tolerability (e.g., nausea experienced during testing) limits the utility of these tasks in routine diagnostic practice. To date, the accuracy of these tasks for predicting conversion from MCI to AD has not been evaluated, and further studies comparing their prognostic value with that of the 4MT would be of considerable interest.
Several further issues are raised by this initial work. One is that of the incremental added value of the 4MT, above and beyond that of “traditional” cognitive tests. The comparisons with the RAVLT and TMT-B outlined above and in our previous cross-sectional study (33) show a superior diagnostic sensitivity of the 4MT for prodromal AD and a greater predictive ability, and therefore provide first evidence of added prognostic value. These data justify further investigation of this critical issue by application of logistic regression statistical methodologies within currently running large sample size studies.
In this study a 30% annual conversion rate from MCI to dementia was observed which exceeds the 20% annual conversion rate previously reported for MCI with positive CSF AD biomarkers (52). This may reflect the recruitment from a tertiary referral memory clinic, typically associated with higher conversion rates than community-based populations, but may also be a consequence of the small sample size.
It is crucial to reiterate the point that these are preliminary observations. While these findings are sufficient to provide initial proof of concept, the small sample size does not permit any definitive conclusions to be drawn. Furthermore, only relatively strong correlations can be detected with this sample size. For instance, while a strong correlation between 4MT score and CSF total tau was identified, the presence of a correlation between 4MT score and hippocampal volume will need to be established in a larger sample.
Nonetheless, this initial dataset has been considered sufficiently robust for the 4MT to be included in the test battery used to evaluate cognitive function in prospective, large scale longitudinal studies of the older population at risk of developing dementia, namely the n = 750 PREVENT study (56) and the n = 6000 EPAD (European Prevention of Alzheimer’s Disease, http://ep-ad.org) initiative. These studies of asymptomatic at-risk individuals will be complemented by further longitudinal studies of MCI patients whose aims are to determine the predictive accuracy of the 4MT in larger cohorts drawn from community- and hospital-based memory clinics as well as the specificity of this test in determining future conversion to AD and non-AD dementia.
Conclusion
This study provides the first evidence supporting the hypothesis that testing of allocentric spatial memory is predictive of conversion from MCI to AD dementia. The correlation between CSF total tau and 4MT score indicates that the latter may represent a behavioral marker of hippocampal neurodegeneration. The brevity, non-invasiveness and ease of application of the 4MT means that this test is capable of fulfilling the current unmet need for an accurate test of pre-dementia AD that can be scaled up to address the high diagnostic demand associated with the prevalence of memory impairment in the aging population.
Author Contributions
DC conceived and designed the study. KM and RW acquired the data and undertook initial data analyses. RW performed the MRI analysis with LM. CL analyzed the remaining data and performed all statistical analyses. RW co-wrote the manuscript with DC, with critical contributions from CL.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
The authors wish to thank the patients who generously gave up their time and consented to participate in this study.
Funding
Dr. RW was funded by the UK National Institute for Health Research (NIHR) at the time this study was undertaken and is now funded by the Medical Research Council (MRC). Dr. DC is funded by the Cambridge NIHR Biomedical Research Centre. Dr. CL is partly funded by a BBSRC Research Grant (BB/M008975/1).
ReferencesAlbertMSDeKoskySTDicksonDDuboisBFeldmanHHFoxNCThe diagnosis of mild cognitive impairment due to Alzheimer’s disease: recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer’s disease. Alzheimers Dement (2011) 7:270–9.10.1016/j.jalz.2011.03.008GanguliMDodgeHHShenCDeKoskyST. Mild cognitive impairment, amnestic type: an epidemiologic study. Neurology (2004) 63:115–21.10.1212/01.WNL.0000132523.27540.8115249620JichaGAParisiJEDicksonDWJohnsonKChaRIvnikRJNeuropathologic outcome of mild cognitive impairment following progression to clinical dementia. Arch Neurol (2006) 63:674–81.10.1001/archneur.63.5.67416682537FritschTMcClendonMJWallendalMSHydeTFLarsenJD. Prevalence and cognitive bases of subjective memory complaints in older adults: evidence from a community sample. J Neurodegen Dis (2014) 2014:9.10.1155/2014/176843FolsteinMFFolsteinSEMcHughPR. “Mini-mental state”. A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res (1975) 12:189–98.10.1016/0022-3956(75)90026-6Arevalo-RodriguezISmailagicNRoqueIFMCiapponiASanchez-PerezEGiannakouAMini-Mental State Examination (MMSE) for the detection of Alzheimer’s disease and other dementias in people with mild cognitive impairment (MCI). Cochrane Database Syst Rev (2015) 3:Cd010783.10.1002/14651858.CD010783.pub225740785ChapmanRMMapstoneMMcCraryJWGardnerMNPorsteinssonASandovalTCPredicting conversion from mild cognitive impairment to Alzheimer’s disease using neuropsychological tests and multivariate methods. J Clin Exp Neuropsychol (2011) 33:187–99.10.1080/13803395.2010.49935620711906EwersMWalshCTrojanowskiJQShawLMPetersenRCJackCRJrPrediction of conversion from mild cognitive impairment to Alzheimer’s disease dementia based upon biomarkers and neuropsychological test performance. Neurobiol Aging (2012) 33:1203–14.10.1016/j.neurobiolaging.2010.10.01921159408GainottiGQuarantaDVitaMGMarraC. Neuropsychological predictors of conversion from mild cognitive impairment to Alzheimer’s disease. J Alzheimers Dis (2014) 38:481–95.10.3233/JAD-13088124002185KarasGSluimerJGoekoopRvan der FlierWRomboutsSAVrenkenHAmnestic mild cognitive impairment: structural MR imaging findings predictive of conversion to Alzheimer disease. AJNR Am J Neuroradiol (2008) 29:944–9.10.3174/ajnr.A094918296551YuanYGuZXWeiWS. Fluorodeoxyglucose-positron-emission tomography, single-photon emission tomography, and structural MR imaging for prediction of rapid conversion to Alzheimer disease in patients with mild cognitive impairment: a meta-analysis. AJNR Am J Neuroradiol (2009) 30:404–10.10.3174/ajnr.A135719001534DinizBSPinto JuniorJAForlenzaOV. Do CSF total tau, phosphorylated tau, and beta-amyloid 42 help to predict progression of mild cognitive impairment to Alzheimer’s disease? A systematic review and meta-analysis of the literature. World J Biol Psychiatry (2008) 9:172–82.10.1080/15622970701535502BraakHBraakEBohlJ. Staging of Alzheimer-related cortical destruction. Eur Neurol (1993) 33:403–8.10.1159/000116984O’KeefeJDostrovskyJ. The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. Brain Res (1971) 34:171–5.10.1016/0006-8993(71)90358-1O’KeefeJSpeakmanA. Single unit activity in the rat hippocampus during a spatial memory task. Exp Brain Res (1987) 68:1–27.3691688MullerRUBostockETaubeJSKubieJL. On the directional firing properties of hippocampal place cells. J Neurosci (1994) 14(12):7235–51.7996172LeverCBurtonSJeewajeeAO’KeefeJBurgessN. Boundary vector cells in the subiculum of the hippocampal formation. J Neurosci (2009) 29(31):9771–7.10.1523/JNEUROSCI.1319-09.200919657030EkstromADKahanaMJCaplanJBFieldsTAIshamEANewmanELCellular networks underlying human spatial navigation. Nature (2003) 425:184–8.10.1038/nature0196412968182MaguireEABurgessNDonnettJGFrackowiakRSFrithCDO’KeefeJ. Knowing where and getting there: a human navigation network. Science (1998) 280:921–4.10.1126/science.280.5365.9219572740IariaGChenJKGuarigliaCPtitoAPetridesM. Retrosplenial and hippocampal brain regions in human navigation: complementary functional contributions to the formation and use of cognitive maps. Eur J Neurosci (2007) 25:890–9.10.1111/j.1460-9568.2007.05371.x17298595HenkeKKrollNEBehnieaHAmaralDGMillerMBRafalRMemory lost and regained following bilateral hippocampal damage. J Cogn Neurosci (1999) 11:682–97.10.1162/08989299956364310601749WenigerGRuhlederMLangeCWolfSIrleE. Egocentric and allocentric memory as assessed by virtual reality in individuals with amnestic mild cognitive impairment. Neuropsychologia (2011) 49(3):518–27.10.1016/j.neuropsychologia.2010.12.03121185847LaczoJVlcekKVyhnalekMVajnerovaOOrtMHolmerovaISpatial navigation testing discriminates two types of amnestic mild cognitive impairment. Behav Brain Res (2009) 202:252–9.10.1016/j.bbr.2009.03.04119463709deIpolyiARRankinKPMuckeLMillerBLGorno-TempiniML. Spatial cognition and the human navigation network in AD and MCI. Neurology (2007) 69(10):986–97.10.1212/01.wnl.0000271376.19515.c617785667LimTSIariaGMoonSY. Topographical disorientation in mild cognitive impairment: a voxel-based morphometry study. J Clin Neurol (2010) 6(4):204–11.10.3988/jcn.2010.6.4.20421264201LaczoJAndelRVyhnalekMVlcekKMagerovaHVarjassyovaAHuman analogue of the morris water maze for testing subjects at risk of Alzheimer’s disease. Neurodegener Dis (2010) 7(1–3):148–52.10.1159/00028922620197695MorrisR. Developments of a water-maze procedure for studying spatial learning in the rat. J Neurosci Methods (1984) 11(1):47–60.10.1016/0165-0270(84)90007-46471907BohbotVDLerchJThorndycraftBIariaGZijdenbosAP. Gray matter differences correlate with spontaneous strategies in a human virtual navigation task. J Neurosci (2007) 27:10078–83.10.1523/JNEUROSCI.1763-07.200717881514PengasGPattersonKArnoldRJBirdCMBurgessNNestorPJ. Lost and found: bespoke memory testing for Alzheimer’s disease and semantic dementia. J Alzheimers Dis (2010) 21:1347–65.21504124HartleyTBirdCMChanDCipolottiLHusainMVargha-KhademFThe hippocampus is required for short-term topographical memory in humans. Hippocampus (2007) 17:34–48.10.1002/hipo.2024017143905ChanDGallaherLMMoodleyKMinatiLBurgessNHartleyT. The 4 mountains test: a short test of spatial memory with high sensitivity for the diagnosis of pre-dementia Alzheimer’s disease. J Vis Exp (2016) (116):e54454.10.3791/54454BirdCMChanDHartleyTPijnenburgYARossorMNBurgessN. Topographical short term memory differentiates Alzheimer’s disease from frontotemporal lobar degeneration. Hippocampus (2010) 20:1154–69.10.1002/hipo.20715MoodleyKMinatiLContarinoVPrioniSWoodRCooperRDiagnostic differentiation of mild cognitive impairment due to Alzheimer’s disease using a hippocampus-dependent test of spatial memory. Hippocampus (2015) 25:939–51.10.1002/hipo.2241725605659PetersenRC. Mild cognitive impairment as a diagnostic entity. J Intern Med (2004) 256:183–94.10.1111/j.1365-2796.2004.01388.x15324362MoroneyJTBagiellaEDesmondDWHachinskiVCMolsaPKGustafsonLMeta-analysis of the Hachinski Ischemic Score in pathologically verified dementias. Neurology (1997) 49:1096–105.10.1212/WNL.49.4.10969339696MioshiEDawsonKMitchellJArnoldRHodgesJR. The Addenbrooke’s Cognitive Examination Revised (ACE-R): a brief cognitive test battery for dementia screening. Int J Geriatr Psychiatry (2006) 21:1078–85.10.1002/gps.161016977673ShawLMVandersticheleHKnapik-CzajkaMFigurskiMCoartEBlennowKQualification of the analytical and clinical performance of CSF biomarker analyses in ADNI. Acta Neuropathol (2011) 121:597–609.10.1007/s00401-011-0808-021311900PatenaudeBSmithSMKennedyDNJenkinsonM. A Bayesian model of shape and appearance for subcortical brain segmentation. Neuroimage (2011) 56:907–22.10.1016/j.neuroimage.2011.02.04621352927NelsonHWillisonJ. National Adult Reading Test Manual (NART). Windsor, UK: NFER-Nelson (1991).WarringtonEKJamesM. A new test of object decision: 2D silhouettes featuring a minimal view. Cortex (1991) 27:370–83.10.1016/S0010-9452(13)80033-01743033GomarJJBobes-BascaranMTConejero-GoldbergCDaviesPGoldbergTEAlzheimer’s Disease Neuroimaging Initiative. Utility of combinations of biomarkers, cognitive markers, and risk factors to predict conversion from mild cognitive impairment to Alzheimer disease in patients in the Alzheimer’s disease neuroimaging initiative. Arch Gen Psychiatry (2011) 68:961–9.10.1001/archgenpsychiatry.2011.9621893661Van der ElstWvan BoxtelMPvan BreukelenGJJollesJ. Rey’s verbal learning test: normative data for 1855 healthy participants aged 24-81 years and the influence of age, sex, education, and mode of presentation. J Int Neuropsychol Soc (2005) 11:290–302.10.1017/S1355617705050344GiovagnoliARDel PesceMMascheroniSSimoncelliMLaiaconaMCapitaniE. Trail making test: normative values from 287 normal adult controls. Ital J Neurol Sci (1996) 17:305–9.10.1007/BF019977928915764McKhannGMKnopmanDSChertkowHHymanBTJackCRJrKawasCHThe diagnosis of dementia due to Alzheimer’s disease: recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer’s disease. Alzheimers Dement (2011) 7:263–9.10.1016/j.jalz.2011.03.005DonohueMCSperlingRASalmonDPRentzDMRamanRThomasRGThe preclinical Alzheimer cognitive composite: measuring amyloid-related decline. JAMA Neurol (2014) 71:961–70.10.1001/jamaneurol.2014.80324886908DeLongERDeLongDMClarke-PearsonDL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics (1988) 44:837–45.10.2307/25315953203132FjellAMWalhovdKBAmlienIBjornerudAReinvangIGjerstadLMorphometric changes in the episodic memory network and tau pathologic features correlate with memory performance in patients with mild cognitive impairment. AJNR Am J Neuroradiol (2008) 29:1183–9.10.3174/ajnr.A105918544670de SouzaLCChupinMLamariFJardelCLeclercqDColliotOCSF tau markers are correlated with hippocampal volume in Alzheimer’s disease. Neurobiol Aging (2012) 33:1253–7.10.1016/j.neurobiolaging.2011.02.02221489655CherrierMMMendezMPerrymanK. Route learning performance in Alzheimer disease patients. Neuropsychiatry Neuropsychol Behav Neurol (2001) 14:159–68.11513099AllisonSLFaganAMMorrisJCHeadD. Spatial navigation in preclinical Alzheimer’s disease. J Alzheimers Dis (2016) 52(1):77–90.10.3233/JAD-15085526967209KalovaEVlcekKJarolimovaEBuresJ. Allothetic orientation and sequential ordering of places is impaired in early stages of Alzheimer’s disease: corresponding results in real space tests and computer tests. Behav Brain Res (2005) 159(2):175–86.10.1016/j.bbr.2004.10.016HanssonOZetterbergHBuchhavePLondosEBlennowKMinthonL. Association between CSF biomarkers and incipient Alzheimer’s disease in patients with mild cognitive impairment: a follow-up study. Lancet Neurol (2006) 5:228–34.10.1016/S1474-4422(06)70355-616488378RamiLSole-PadullesCForteaJBoschBLladoAAntonellAApplying the new research diagnostic criteria: MRI findings and neuropsychological correlations of prodromal AD. Int J Geriatr Psychiatry (2012) 27:127–34.10.1002/gps.269621384432StomrudEMinthonLZetterbergHBlennowKHanssonO. Longitudinal cerebrospinal fluid biomarker measurements in preclinical sporadic Alzheimer’s disease: a prospective 9-year study. Alzheimers Dement (Amst) (2015) 1(4):403–11.10.1016/j.dadm.2015.09.002O’KeefeJNadelL. The hippocampus as a cognitive map. Oxford, UK: Oxford University Press (1978).RitchieCWRitchieK. The PREVENT study: a prospective cohort study to identify mid-life biomarkers of late-onset Alzheimer’s disease. BMJ Open (2012) 2:e001893.10.1136/bmjopen-2012-001893