ArticlePDF Available

Intraindividual Variability Is a Fundamental Phenomenon of Aging: Evidence From an 8-Year Longitudinal Study Across Young, Middle, and Older Adulthood

Authors:

Abstract and Figures

Moment-to-moment intraindividual variability (IIV) in cognitive speed is a sensitive behavioral indicator of the integrity of the aging brain and brain damage, but little information is known about how IIV changes from being relatively low in young adulthood to substantially higher in older adulthood. We evaluated possible age group, sex, and task differences in IIV across adulthood using a large, neurologically normal, population-based sample evaluated thrice over 8 years. Multilevel modeling controlling for education, diabetes, hypertension, and anxiety and depressive symptoms showed expected age group differences in baseline IIV across the adult lifespan. Increase in IIV was not found until older adulthood on simple tasks but was apparent even in the 40s on a more complex task. Females were more variable than males but only at baseline. IIV in cognitive speed is a fundamental behavioral characteristic associated with growing older, even among healthy adults.
Content may be subject to copyright.
1
Appears in Developmental Psychology (Accepted version)
February 11, 2013
Running Head: INTRAINDIVIDUAL VARIABILITY ACROSS ADULTHOOD
Intraindividual variability is a fundamental phenomenon of aging: Evidence from an 8-year
longitudinal study across young, middle, and older adulthood
Allison A. M. Bielak1*, Nicolas Cherbuin2, David Bunce3, & Kaarin J. Anstey2
1 Department of Human Development and Family Studies, Colorado State University, Fort
Collins, USA
2 Centre for Research on Ageing, Health and Wellbeing, The Australian National University,
Canberra, Australia
3Institute of Psychological Sciences, Faculty of Medicine and Health, University of Leeds, Leeds,
UK
Corresponding author – A. Bielak*
Department of Human Development and Family Studies
1570 Campus Delivery
Colorado State University
Fort Collins, Colorado 80523-1570
Ph: (970) 491-7608
Fax: (970) 491-7975
allison.bielak@colostate.edu
2
Abstract
Moment-to-moment intraindividual variability (IIV) in cognitive speed is a sensitive behavioural
indicator of the integrity of the aging brain and brain damage, but little information is known
about how IIV changes from being relatively low in young adulthood to substantially higher in
older adulthood. We evaluated possible age group, sex, and task differences in IIV across
adulthood using a large, neurologically normal, population-based sample evaluated thrice over 8
years. Multilevel modeling controlling for education, diabetes, hypertension, and anxiety and
depressive symptoms showed expected age group differences in baseline IIV across the adult
lifespan. Increase in IIV was not found until older adulthood on simple tasks, but was apparent
even in the 40s on a more complex task. Females were more variable than males, but only at
baseline. IIV in cognitive speed is a fundamental behavioural characteristic associated with
growing older, even among healthy adults.
Key words: Intraindividual variability, inconsistency, adulthood, change, longitudinal
3
The length of time needed to respond to a stimulus, or reaction time (RT), consistently
increases across adulthood (e.g., Fozard, Vercruyssen, Reynolds, Hancock, & Quilter, 1994).
However, individuals not only become slower with older age, they also become more variable in
their responding from one moment to the next, or from one RT trial to another. A number of
cross-sectional studies have demonstrated that intraindividual variability (IIV) in cognitive speed,
or inconsistency, shows a U-shaped curve across the lifespan (6-89 years, Li et al., 2004; 6-81
years, Williams, Hultsch, Strauss, Hunter, & Tannock, 2005; 5-76 years, Williams, Strauss,
Hultsch, & Hunter, 2007), and is greater among older than younger adults (e.g., Hultsch,
MacDonald, & Dixon, 2002) even when controlling for group differences in mean response speed
and practice effects.
Further, inconsistency in cognitive speed appears to be maladaptive in older age. Greater
variability has been associated with poorer levels of performance on a range of cognitive tasks
and intelligence (e.g., Rabbitt, Osman, Moore, & Stollery, 2001), poorer physical performance
(Anstey, 1999; Li, Aggen, Nesselroade, & Baltes, 2001), less activity participation (Bielak,
Hughes, Small, & Dixon, 2007), poorer performance on tests of everyday functioning (Burton,
Strauss, Hultsch, & Hunter, 2009), and poorer mental health (Bunce, Handley, & Gaines, 2008).
Patients with various types of neurological trauma or disease have been found to show greater IIV
than healthy older adults including those with Parkinson’s disease (Burton, Strauss, Hultsch,
Moll, & Hunter, 2006; de Frias, Dixon, Fisher, & Camicioli, 2007), dementia (Hultsch,
MacDonald, Hunter, Levy-Bencheton, & Strauss, 2000; Murtha, Cismaru, Waechter, &
Chertkow, 2002), mild cognitive impairment (MCI) (Christensen et al., 2005; Dixon et al., 2007;
Strauss, Bielak, Bunce, Hunter, & Hultsch, 2007), and traumatic brain injury (Stuss, Murphy,
Binns, & Alexander, 2003).
4
Greater inconsistency in adulthood has also been linked to maladaptive structural,
functional, and neuromodulatory brain characteristics (see MacDonald, Li, & Bäckman, 2009 for
a review). For example, lower white matter integrity, including decreased volume and increased
prevalence of hyperintensities, have been associated with increased IIV across adulthood
(Anstey et al., 2007; Bunce et al., 2010; Bunce et al., 2007; Fjell, Westlye, Amlien, & Walhovd,
2011; Walhovd & Fjell, 2007). Studies using computational models (Li, Lindenberger, &
Sikström, 2001) and positron emission tomography (MacDonald, Karlsson, Rieckmann, &
Nyberg, 2012) also indicate that dysfunctional dopamine modulation is particularly linked to
more behavioural IIV across adulthood. Overall, although the exact determinants of IIV are not
clearly understood, there is considerable evidence demonstrating the neurological basis of IIV in
adulthood.
Longitudinal studies have shown IIV covaries with cognitive performance across time
(Bielak, Hultsch, Strauss, MacDonald, & Hunter, 2010b; Lövdén, Li, Shing, & Lindenberger,
2007; MacDonald, Hultsch, & Dixon, 2003), and baseline inconsistency predicts later attrition,
mild cognitive impairment (Bielak, Hultsch, Strauss, MacDonald, & Hunter, 2010a; Cherbuin,
Sachdev, & Anstey, 2010), and even death (MacDonald, Hultsch, & Dixon, 2008). Therefore,
inconsistency in adulthood is believed to be a behavioural indicator of neurological integrity,
where compromised integrity translates into less consistent responding on measures of cognitive
speed (Hultsch, et al., 2000; Hultsch, Strauss, Hunter, & MacDonald, 2008).
IIV across the lifespan
Due to the possibility that IIV may be a marker of the integrity of the brain, the majority
of studies have focused exclusively on older adulthood. There has therefore been little
information about how inconsistency changes from being relatively low in young adulthood to
substantially higher in older adulthood. Our aim in the present study was to provide a thorough
5
examination of how inconsistency changes across adulthood using a large, population-based
sample evaluated over 8 years. Previous cross-sectional data covering the adult life-span has
shown that IIV on a choice RT task appears to be at its lowest point in the late teens and 20s,
before steadily increasing with age (Williams, et al., 2005; Williams, et al., 2007). A large cross-
sectional study of adults aged 18-94 years found IIV on a simple RT task remained stable until
approximately age 50, while IIV for choice RT increased linearly across age (Der & Deary,
2006). A similar trend was evident in the first wave of the present study under investigation,
where only those between 60-64 years showed greater inconsistency than those between 40-44
years on a simple RT task, but a stepwise increase was found beginning in young adulthood for
choice RT (Anstey, Dear, Christensen, & Jorm, 2005).
However, cross-sectional age differences do not always correspond to actual changes with
age (e.g., cognitive decline, Salthouse, 2009; Sliwinski & Buschke, 1999). Does IIV increase
over time even among those in their 20s, or is it stable until a certain age? Deary and Der (2005)
tested approximately 500 adults aged 16, 36 and 56 years twice across a 8 year period on simple
and choice RT tasks. Although they initially found inconsistency on both tasks increased linearly
with age, after controlling for mean RT the age effects were dramatically reduced and differences
between the cohorts disappeared. Fozard and colleagues (1994) examined a similar number of
adults aged 20 to 90 years and noted a significant age-related increase in variability in responding
to an auditory choice RT task over 4 years, but did not further describe the nature and shape of
the increase. In an investigation over 6 years, MacDonald and colleagues (2003) found only
those between 75 and 89 years showed significant increases in IIV, while those between 55 and
64 years and between 65 and 74 years remained stable or decreased slightly. Results from other
longitudinal studies focusing exclusively on older adults confirm an increased acceleration in old-
old adulthood (i.e., after 75 years of age, Bielak, et al., 2010b; Lövdén, et al., 2007). Overall,
6
given the conflicting findings in older age, and the limited studies focusing on the earlier half of
adulthood, it is unclear what the longitudinal inconsistency relationship looks like in young and
middle adulthood.
Gender effects
Another unknown factor is whether sex plays a role in age-related IIV change. Females
have been reported to be slower in responding to RT tasks than males (Fozard, et al., 1994; Jorm,
Anstey, Christensen, & Rodgers, 2004), and also show more variability in responding to a choice
RT task across adulthood (Der & Deary, 2006). Others have found this sex difference in IIV
might only be present for those in their 30s and mid adulthood, but not among those in their late
teens and 20s (Deary & Der, 2005). However, Reimers and Maylor (2006) have suggested this
difference might actually be an artifact of failing to account for trial effects. They found females
were slower than males only on the initial trials of responding, but became faster than males
across the RT task. When the initial trials were excluded, the sex difference in inconsistency
disappeared. Therefore, it is unknown whether males and females truly differ in their
inconsistency in cognitive speed.
Cognitive load and IIV
Finally, both age and sex differences in IIV might also vary by the complexity of the
reaction time task. In a 3 year longitudinal study of over 300 participants aged 64 to 92 years,
Bielak and colleagues (2010b) found individuals older than 75 years of age showed significantly
greater annual increases in inconsistency for measures derived from choice RT and task-
switching RT tasks, but not for inconsistency from a simple tapping RT task. Other examples of
similar task-related group differences in IIV abound in the literature, where larger effects have
been found for tasks drawing on executive processes such as inhibition, task switching, or
working memory (e.g., Dixon, et al., 2007; MacDonald, et al., 2003; West, Murphy, Armilio,
7
Craik, & Stuss, 2002). Consequently, the pattern of change in inconsistency across time may
differ based on task complexity, and affect the detection of age and sex differences.
In the present study, we evaluated change in IIV across 8 years in a population-based
sample of 3 different age cohorts, who at baseline were between 20-24 years, 40-44 years, and
60-64 years. This unique longitudinal study provided an excellent design through which to
examine possible age group, sex, and task differences in inconsistency throughout the adult
lifespan. We investigated whether there were significant age group, sex, and age group by sex
differences in the starting value of and change in IIV on two different RT tasks over 8 years.
Because past research on both age and sex differences in IIV conflict, we limited our hypotheses
to the predictions that inconsistency would increase with age, and that age differences would be
greater on a more cognitively challenging RT task. Finally, because higher IIV has been linked
to poorer cognitive performance and various medical conditions (Bunce, et al., 2008; Whitehead,
Dixon, Hultsch, & MacDonald, 2011), we controlled for education, diabetes, hypertension, and
anxiety and depressive symptoms.
Method
Data were drawn from the PATH Through Life Project (PATH), a longitudinal study
whereby participants from 3 different age cohorts (i.e., 20s, 40s, and 60s) are repeatedly tested
every 4 years (see Anstey et al., 2011). The current analyses use three waves of testing (i.e., over
8 years).
Participants
PATH participants are community-dwelling adults residing in the city of Canberra or the
neighbouring town of Queanbeyan, Australia. Potential participants included those aged 20-24
years on January 1, 1999, 40-44 years on January 1, 2000, and 60-64 years on January 1, 2001.
Participants were recruited through the electoral rolls, for which registration is compulsory for
8
Australian citizens. The number of participants who returned the survey totaled 7, 485, of whom
2,404 were in the 20s, 2,530 in the 40s, and 2,551 in the oldest cohort. Approximately half of
each age cohort was female.
There was limited sample attrition 4 and 8 years later, as 6,680 and 5,996 participants
completed Waves 2 and 3, respectively. Participants were excluded from the present analyses if
they reported having a history of stroke, significant head injury, epilepsy, Parkinson’s disease, or
brain tumor, and older participants who scored less than 24 on the Mini-Mental State
Examination (MMSE; Folstein, Folstein, & McHugh, 1975) at any time point. Participants had to
have valid data for all covariate measures and sufficient RT data (see intraindividual variability
section), resulting in a final sample of 6562 participants. The mean length of follow-up among
participants was 6.91 years (SD = 2.54). Further descriptive information about the sample is
presented in Table 1.
Measures and procedure
At each wave, participants answered a questionnaire that assessed their sociodemographic
characteristics, and completed measures of well-being, mental and physical health, and cognitive
functioning. The majority of the assessment was administered on a hand-held or laptop
computer, and was completed under the supervision of and with the assistance of a trained
interviewer (for further details see Anstey, et al., 2011).
Intraindividual variability.
Intraindividual variability was calculated from the response latencies on two reaction-time
tasks, each administered once per testing wave. Both tasks were completed using a small box
which served as both the response console and the display area. The box was held with both
hands, with left and right buttons at the top to be depressed by the index fingers. The front of the
box had three lights: two red stimulus lights under the left and right buttons respectively and a
9
green get-ready light in the middle beneath these. The simple reaction-time (SRT) task was
completed first, immediately followed by the choice reaction-time (CRT) task. In SRT,
participants were presented with a green get-ready light, followed by the right red light after
varying amounts of time. Participants were asked to press a button as soon as the red light
appeared. For each CRT trial, participants were presented with the green get-ready light. After
varying amounts of time, one of the two red lights illuminated and participants were asked to
press the corresponding response button as soon as possible. There were 40 trials presented for
CRT, and 80 for SRT.
Covariates.
We chose to control for the effects of education, diabetes, hypertension, and anxiety and
depressive symptoms. Education was assessed by years of formal schooling (M = 14.86, SD =
2.31), and diabetes was based on the self-reported presence of the disease at any wave (5.7% of
sample). Hypertension was determined from blood pressure readings administered by testers at
each wave, and any participant scoring above 140 systolic or 90 diastolic, or reporting taking
blood pressure medication at any wave was coded as having hypertension (48.2% of sample).
Anxiety and depressive symptoms were based on responses to the Goldberg Anxiety and
Depression Scale (Goldberg, Bridges, Duncan-Jones, & Grayson, 1988), and were entered into
the models separately as time-varying anxiety and depression scores.
Data preparation and calculation of intraindividual variability
The data preparation and intraindividual variability procedures were completed separately
for each task at each wave. Individuals who did not complete more than 50% of the trials1 for
each task were removed from the IIV calculation for that wave. First, incorrect CRT responses
1 A significant reduction in the accuracy of imputation has been shown above 50% of item-level missingness (Burns
et al., 2011).
10
were removed to ensure that IIV was not the result of slower wrong responses. The remaining
RT latencies for both tasks were then trimmed for outliers. Lower limit trims included removing
any trials below 50ms for SRT, and below 150ms for CRT. Means and standard deviations were
next calculated for each individual across all trials, and any latencies that exceeded +3SDs for
that individual were deleted2. Missing values were imputed using a regression substitution
procedure, whereby individual regression equations across all trials for each task were formed
and used to predict the missing values (Hultsch, et al., 2000). This approach reduces within-
subject variation and represents a conservative approach to estimating inconsistency.
Approximately 4% of trials were subjected to the imputation procedure.
The calculation of IIV was in accordance with methodology developed by Hultsch and
colleagues (2000). In order to account for potential confounding influences in the RT data (e.g.,
age differences in mean RT, practice effects), the trial RT data was regressed onto categorical age
group, categorical trial, and their interactions (see Hultsch, et al., 2008 for a description of
statistical considerations). This effectively removed mean RT trends from the data. The resulting
residuals were then converted to standardized T-scores and each individual’s SD across all trials
was calculated. The individual standard deviation (ISD) was used as the indicator of
intraindividual variability. ISD values were computed for each task at each wave (see
Supplementary Table 1). As a further evaluation of this calculation strategy, we found the
additional residualization of individual mean RT trends (i.e., within-person linear trial effects),
followed by the removal of the mean age group and trial effects produced essentially identical
2A previous trimming of the Wave 1 SRT and CRT data for the 60s age group accidentally, but permanently, deleted
the trials that exceeded the trim cutoffs. We employed a different trimming procedure and had to apply our method
to the existing data after that event. Thus, the trimming procedure varied slightly for the Wave 1 60s cohort relative
to the other cohorts and waves.
11
ISD values to our initial calculation approach (r = .999; see supplementary Appendix A for the
statistical equations used in this additional calculation).
Statistical analyses
The ISD data were analyzed using multilevel models which allow the estimation of
individual differences rather than only group differences as in multiple regression. These models
also permit the inclusion of cases with incomplete data, and do not require equal spacing between
waves. Because not all participants were tested at precise 4-year intervals, ISD change was
modeled using a time in study metric. ISDs from the two RT tasks were evaluated separately.
Age group, sex, and age group X sex were included as fixed predictors of the intercept. Models
which included sex predicting the slope were not significant and did not significantly add to the
model fit for either task; therefore only age group was a fixed predictor of the slope in the final
model. The covariates education, diabetes, and hypertension were included as time-invariant
predictors of the intercept, and anxiety and depressive symptoms were included as time-varying
predictors. Random effects for the intercept and slope were estimated for both tasks (see
supplementary appendix B for the statistical equations used), but initial models for SRT indicated
a modest random slope variance (Estimate = .007, SE = .002, p<.01). Further models for SRT
failed to converge, and thus the presented results for SRT do not include random slope. The
results from the unconditional and full models with all factors and covariates included are
presented in Table 2.
Results
ISD change - SRT
There were significant age group, sex, and Age group x Sex interaction effects for
baseline ISD on the SRT task. For all three age cohorts, females tended to have higher ISD
intercepts than males (20s, β = .42, SE = .10, p<.001; 40s: β = .33, SE = .10, p<.01; and 60s: β =
12
.72, SE = .10, p<.001). Although the age group differences were also similar across the sexes, it
appeared that the size of these differences varied by sex. In the 60s cohort both males (M = 6.40)
and females (M = 7.12) showed a higher average starting value than their respective 20s cohort
groups (males: M = 5.14; β = -1.26, SE = .12, p<.001; females: M = 5.56; β = -1.56, SE = .12,
p<.001), but this age difference was significantly larger for females (β = .30, SE = .14, p<.05).
Further, the difference between the 40s (M = 6.15) and 60s males, albeit significant (β = -.25, SE
= .11, p<.05), was less pronounced than for the female 40s (M = 6.48) versus 60s comparison (β
= -.64, SE = .11, p<.001; age group x sex comparison: β = -.39, SE = .14, p<.01). Finally, those
in their 40s also showed a higher baseline ISD than those in their 20s (females: β = -.92, SE = .11,
p<.001; males: β = -1.01, SE = .12, p<.001), but this age comparison did not significantly differ
by sex. Initial models showed a significant amount of between-person variance in intercept
(estimate: 3.92, SE = .11, p<.001). When age group was entered into the model, there was a
19.7% reduction in this intercept variance.
Regarding change over time in study, the oldest cohort showed an average increase in
their inconsistency over time (β = .17, SE = .01, p<.001), while the 40s and 20s age groups both
showed slight decreases (20: β = -.06, SE = .01, p<.001; 40: β = -.06, SE = .01, p<.001; see
Figure 1). Although the 60s group was significantly different from the two younger groups
regarding change over time (both p<.001), the 20s and 40s groups did not differ from one
another.
ISD change - CRT
The effects for baseline CRT were similar to those for SRT, but generally lacking sex
differences, and the Age group x Sex interaction. Only the average female in her 20s (M = 5.93)
was more inconsistent at baseline than the average male of the same age (M = 5.68; β = .25, SE =
.07, p<.01). Regarding cohort differences, the pattern was as expected with both sexes in the 60s
13
cohort showing the highest average baseline ISD (females: M = 7.85; males: M = 7.78) compared
to the average person of the same sex in their 40s (females: M = 6.70; β = -1.09, SE = .08,
p<.001; males: M = 6.76; β = -1.07, SE = .08, p<.001), and 20s (females: β = -1.93, SE = .09,
p<.001; males: β = -2.10, SE = .09, p<.001), and females and males in their 40s having a higher
ISD than the 20s group (females: β = -.83, SE = .08, p<.001; males: β = -1.02, SE = .08, p<.001).
Initial models showed a significant amount of between-person variance in intercept (estimate:
2.62, SE = .07, p<.001), and that the entry of age group into the model accounted for 33.6% of
this intercept variance.
Figure 1 shows that the two oldest cohorts both showed average increases in their
inconsistency over time (60s: β = .16, SE = .01, p<.001; 40s: β = .06, SE = .01, p<.001), but the
20s cohort did not significantly change over time. However, all three groups significantly
differed from one another regarding change over time (all p<.001; see Table 2). Initial models
showed there was a significant, yet modest amount of between-person variation in slope (estimate
= .01, SE = .001, p<.001). Progressive model building showed that age group accounted for 85%
of this slope variance.
Discussion
The main finding of the present study is that increases in IIV are a fundamental
behavioural characteristic associated with growing older, even among healthy adults. There is
sufficient evidence to confidently designate IIV in cognitive speed a developmental phenomenon,
where IIV gradually increases across the adulthood lifespan, showing significant change even in
mid adulthood.
Age group effects
We found a stepwise age group difference in baseline IIV on both simple and choice RT,
where those in their 60s were more inconsistent than those in their 40s, and, in turn, those in their
14
40s were more inconsistent than those in their 20s. These results are in line with previous cross-
sectional work (Hultsch, et al., 2002; Li, et al., 2004; Williams, et al., 2005; Williams, et al.,
2007). Although Der and Deary (2006) and Anstey et al. (2005) found the same pattern cross-
sectionally for IIV on choice RT, both found a relatively flat relationship up until age 50 or 60 for
IIV on simple RT. The use of multilevel models in our study allowed the intercepts to vary by
individual, possibly providing further variance and accuracy to our estimates. Overall, it appears
that baseline inconsistency increases across adulthood, regardless of the complexity of the RT
task.
The pattern is slightly different regarding actual change across time. For the simple RT
task, only the oldest cohort showed a positive slope in IIV across the 8 years, with the two
younger groups both slightly decreasing in IIV over time. In contrast, for choice RT the 40s age
group became slightly more inconsistent with age, and the 60s age group showed even larger
increases in variability. However, those in their 20s still did not significantly change over time.
Previous research has shown the increases in IIV on moderately complex RT tasks (i.e., 2- and 4-
choice RT) and highly complex RT tasks (i.e., 4-choice 1-back RT and 2-choice switch RT) to be
greater with each additional year past age 75 (Bielak, et al., 2010b). Together with our present
results, this suggests that on RT tasks that involve some cognitive complexity (i.e., other than a
simple RT task), adults aged 40 and up show significant increases in variability over time, with
the magnitude of the gain also increasing with greater age (i.e., 60s). However, MacDonald et al.
(2003) found 6-year increases in IIVs for only those between 75 and 89 years at baseline, and
slight decreases or stability for those between 55 and 64 years, and between 65 and 74 years, even
for cognitively challenging RT tasks (i.e., lexical and semantic decision). Therefore, further
longitudinal data across the entire range of adulthood is needed.
15
Although the size of the change that occurred over 8 years was relatively small, the
change in CRT IIV was almost entirely accounted for by age group (a random slope parameter
could not be estimated for SRT). The substantial influence of age is precisely what one would
expect to find if increases in IIV are indeed a developmental phenomenon associated with non-
pathological aging. Further, the size of the changes with each additional year would not be
expected to be very large given the size of the differences between the age groups at baseline
(e.g., those in their 40s cannot increase at a rate that would have them reach the baseline level of
the 60s cohort well before their 60th birthday). Therefore, the size of the changes in IIV with age
must be commensurate with the size of the age differences on the task itself amongst healthy
adults. In addition, given demonstrations that IIV change covaries with cognitive change (e.g.,
Lövdén, et al., 2007), any shifts in IIV should correspond with the size of the cognitive change
expected for that age group. This differential change aligns with our findings that IIV changes
were most prominent for the oldest cohort, who experience a greater rate of cognitive change than
younger adults (e.g., Salthouse, 2009). However, it appears that IIV change in simple RT may
not follow the same rules. Rather, purely process-based IIV may operate on a step-wise rather
than constant function in early and middle adulthood (i.e., with jumps eventually showing
individuals performing at levels consistent with their new age group), and not show consistent
developmental increases until older adulthood.
Given that maladaptive IIV is believed to be a sensitive behavioural indicator of
neurological integrity, it is intriguing that increases in CRT inconsistency over 8 years were seen
even among those aged 40-44 years at baseline. On the other hand, the slow decline of various
cognitive abilities across adulthood, particularly processing speed, is well documented
(Salthouse, 2009). In fact, Bunce and colleagues (2010) found an association between IIV and
16
frontal white-matter hyperintensities in a cohort subsample from the same sample, further
demonstrating that neurological integrity may be compromised well before older age.
Sex, and Age group X Sex interaction effects
We also found evidence of sex differences in IIV, but only in relation to the baseline level
and not change over time. For inconsistency on the simple RT task, females had higher intercepts
than males across all three age groups, and age differences were more pronounced among
females. The sex differences were reduced for choice RT, where only females in the youngest
age group were more inconsistent than males of the same age. Our analyses controlled for trial
effects, and thus do not support Reimers and Maylor’s (2006) suggestion that sex differences in
inconsistency are only the result of females’ slower responding on the initial trials. Although the
direction of the sex difference is the same, our findings are in contrast to past work finding the
strongest sex effect for choice RT and no differences for simple RT (Der & Deary, 2006), and
showing only females aged 36 and older had more variability than males, and only on choice RT
(Deary & Der, 2005).
Although the explanation as to why females were more variable at the first wave of testing
is unclear, the fact that this was only found for simple RT and not choice RT is intriguing. The
simple RT task was completed before the choice RT task, and it may be that aspects of the testing
situation influenced females (e.g., test anxiety) more than males during the simple RT task, but
these factors then diminished during the second RT task. Further, because past research has
consistently found larger IIV group differences on RT tasks that pose a greater cognitive
challenge (e.g., West, et al., 2002), the fact that the same was not found in relation to sex suggests
that the sex-related difference is not substantially related to differences in neurological integrity.
For example, it is for groups that are believed to have poorer neurological integrity relative to
their comparison group where task complexity differences have been found, such as those with
17
mild cognitive impairment (Dixon, et al., 2007). Further, because there was no evidence that
males and females show different change in IIV across time, the presence of the intercept
difference is likely not of neurological interest.
Given the interest in comparing IIV to mean RT (Hultsch, et al., 2008) we additionally
evaluated the size of the model-implied change in mean RT for both tasks across the 8 years. The
trials were converted to T-scores before calculating individual mean RT, thus permitting
comparison with the ISD slope parameter estimates. For SRT3, the 60s cohort showed an average
increase in mean RT over time (60s: β = 2.10), but the two younger cohorts showed significant
decreases (20s: β = -1.49; 40s: β = -.43). The results were similar for CRT4, with the 60s cohort
having slower average responding over time (β = .78) and the 20s responding faster (β = -.33),
but the 40s cohort showing no significant change. Therefore, the general pattern of age-related
differences in change is comparable to that observed in IIV. However, the change per year is
greater for mean RT. Thus, although there has been evidence that IIV and mean RT might be
fundamentally distinct phenomena (Burton, et al., 2009; Lövdén, et al., 2007), both appear to
change relatively similarly across adulthood.
Despite the strengths of the present study, including a population-based sample, the large
number of study participants and the longitudinal design, some limitations must be considered.
First, there were only two indicators of IIV, both derived from relatively simple psychomotor
tasks. Analyses on inconsistency computed from higher-order or more cognitive challenging RT
tasks may demonstrate a different pattern of change. However, given past findings regarding task
complexity (Bielak, et al., 2010b), the pattern using such tasks is predicted to be even stronger,
with more pronounced age differences. Next, although the sample represented three distinct age
3 There was sufficient variation in mean RT change to estimate a random slope parameter.
4 There was insufficient variation in mean RT change, and a random slope parameter could not be estimated.
18
cohorts and provided an estimate of change across young, middle, and older adulthood, the spread
in the age groups prevented a continuous estimate across adulthood. Relatedly, we also were
limited to examining relatively early old age, and IIV change has been shown to be even greater
in the later stages of older adulthood (Lövdén, et al., 2007). Further, the greatest change occurred
between wave 1 and wave 2 for all age groups, with slight group-based decreases in IIV from
waves 2 to 3. Although this pattern implies a quadratic function, we were unable to include this
without model saturation. However, proportionally larger increases in IIV with age were still
evident, reiterating the model-implied conclusion that IIV in processing speed change is a
developmental phenomenon that increases in magnitude with age. Our multilevel models also
permitted individual variation in the intercept (and the slope for CRT), and can provide greater
insight than relying on group-based change from descriptive data. The decrease in IIV was likely
the result of practice effects, with the 20s and 40s cohorts showing the greatest benefit. A fourth
wave of data collection will clarify the longitudinal changes by permitting evaluation of IIV
change from 20-36 years, 40-56 years, and 60-76 years of age. Finally, it remains a possibility
that a portion of age-related changes in IIV could be due to age differences in strategic response
behavior (i.e., the diffusion model) (Ratcliff & McKoon, 2008).
The present study aimed to fill a gap in the knowledge base on how moment-to-moment
IIV in cognitive performance changes across adulthood. It appears that increases in IIV are a
fundamental phenomenon associated with growing older, even among healthy adults. The
magnitude of the increase depends on the task, with IIV on simpler tasks not increasing until
older adulthood, and IIV on more complex tasks showing increases as early as middle adulthood.
Given the documented predictive prowess of IIV in forecasting changes in neurological integrity
(e.g., Bielak, et al., 2010a; MacDonald, et al., 2008), a shift towards greater attention to increases
in inconsistency as markers of biological and cognitive aging, even in mid-life, is warranted.
19
Acknowledgements
We thank the study participants, PATH interviewers, Trish Jacomb, Karen Maxwell, Tony Jorm,
Helen Christensen, Bryan Rodgers, Peter Butterworth and Simon Easteal for their contribution to
the research. K. J. Anstey and N. Cherbuin were supported by National Health and Medical
Research Council (NHMRC) Fellowships (No. 1002560 and 471501, respectively). D. Bunce
was supported by a Leverhulme Trust (UK) Research Fellowship. The PATH Through Life
Study was funded by NHMRC Grants (No. 229936 and 179839).
20
References
Anstey, K. J. (1999). Sensorimotor and forced expiratory volume as correlates of speed, accuracy,
and variability in reaction time performance in late adulthood. Aging, Neuropsychology,
and Cognition, 6, 84-95.
Anstey, K. J., Christensen, H., Butterworth, P., Easteal, S., Mackinnon, A., Jacomb, T., . . . Jorm,
A. F. (2011). Cohort profile: The PATH through life project. International Journal of
Epidemiology. doi: doi:10.1093/ije/dyr025
Anstey, K. J., Dear, K., Christensen, H., & Jorm, A. F. (2005). Biomarkers, health, lifestyle, and
demographic variables as correlates of reaction time performance in early, middle, and
late adulthood. The Quarterly Journal of Experimental Psychology, 58A, 5-21.
Anstey, K. J., Mack, H. A., Christensen, H., Li, S-C., Reglade-Meslin, C., Maller, J., . . .
Sachdev, P. (2007). Corpus callosum size, reaction time speed and variability in mild
cognitive disorders and in a normative sample. Neuropsychologia, 45, 1911-1920.
Bielak, A. A. M., Hughes, T. F., Small, B. J., & Dixon, R. A. (2007). It's never too late to engage
in lifestyle activities: Significant concurrent but not change relationships between lifestyle
activities and cognitive speed. Journal of Gerontology: Psychological Sciences, 62B,
P331-P339.
Bielak, A. A. M., Hultsch, D. F., Strauss, E., MacDonald, S. W. S., & Hunter, M. A. (2010a).
Intraindividual variability in reaction time predicts cognitive outcomes 5 years later.
Neuropsychology, 24, 731-741.
Bielak, A. A. M., Hultsch, D. F., Strauss, E., MacDonald, S. W. S., & Hunter, M. A. (2010b).
Intraindividual variability is related to cognitive change in older adults: Evidence for
within-person coupling. Psychology and Aging, 25, 575-586.
21
Bunce, D., Anstey, K. J., Cherbuin, N., Burns, R., Christensen, H., Wen, W., & Sachdev, P.
(2010). Cognitive deficits are associated with frontal and temporal lobe white matter
lesions in middle-aged adults living in the community. PLoS ONE, 5(10), e13567. doi:
10.1371/journal.pone.0013567
Bunce, D., Anstey, K. J., Christensen, H., Dear, K., Wen, W., & Sachdev, P. (2007). White
matter hyperintensities and within-person variability in community-dwelling adults aged
60-64 years. Neuropsychologia, 45, 2009-2015.
Bunce, D., Handley, R., & Gaines, S. O. Jr. (2008). Depression, anxiety, and within-person
variability in adults aged 18 to 85 years. Psychology and Aging, 23, 848-858.
Burns, R. A., Butterworth, P., Kiely, K. M., Bielak, A. A. M., Luszcz, M. A., Mitchell, P., . . .
Anstey, K. J. . (2011). Multiple imputation was an efficient method for harmonizing the Mini-
Mental State Examination with missing item-level data. Journal of Clinical Epidemiology, 64,
787-793.
Burton, C. L., Strauss, E., Hultsch, D. F., & Hunter, M. A. (2009). The relationship between
everyday problem solving and inconsistency in reaction time in older adults. Aging,
Neuropsychology, and Cognition, 16, 607-632.
Burton, C. L., Strauss, E., Hultsch, D. F., Moll, A., & Hunter, M. A. (2006). Intraindividual
variability as a marker of neurological dysfunction: A comparison of Alzheimer’s disease
and Parkinson’s disease. Journal of Clinical and Experimental Neuropsychology, 28, 67-
83.
Cherbuin, N., Sachdev, P., & Anstey, K. J. (2010). Neuropsychological predictors of transition
from healthy cognitive aging to mild cognitive impairment: The PATH Through Life
Study. American Journal of Geriatric Psychiatry, 18(8), 723-733.
22
Christensen, H., Dear, K. B. G., Anstey, K. J., Parslow, R. A., Sachdev, P., & Jorm, A. F. .
(2005). Within-occasion intraindividual variability and preclinical diagnostic status: Is
intraindividual variability an indicator of mild cognitive impairment? . Neuropsychology,
19, 309-317.
de Frias, C. M., Dixon, R. A., Fisher, N., & Camicioli, R. (2007). Intraindividual variability in
neurocognitive speed: A comparison of Parkinson's disease and normal older adults.
Neuropsychologia, 45, 2499-2507.
Deary, I. J., & Der, G. (2005). Reaction time, age, and cognitive ability: Longitudinal findings
from age 16 to 63 years in representative population samples. Aging, Neuropsychology,
and Cognition, 12, 187-215.
Der, G., & Deary, I. J. (2006). Age and sex differences in reaction time in adulthood: Results
from the United Kingdom Health and Lifestyle Survey. Psychology and Aging, 21, 62-73.
Dixon, R. A., Garrett, D. D., Lentz, T. L., MacDonald, S. W. S., Strauss, E., & Hultsch, D. F.
(2007). Neurocognitive markers of cognitive impairment: Exploring the roles of speed
and inconsistency. Neuropsychology, 21, 381-399.
Fjell, A. M., Westlye, L. T., Amlien, I. K., & Walhovd, K. B. (2011). Reduced white matter
integrity is related to cognitive instability. The Journal of Neuroscience, 31, 18060-18072.
Folstein, M., Folstein, S., & McHugh, P. R. (1975). Mini-Mental State: A practical method for
grading the cognitive state of patients for the clinician. Journal of Psychiatric Research,
12, 189-198.
Fozard, J. L., Vercruyssen, M., Reynolds, S. L., Hancock, P. A., & Quilter, R. E. (1994). Age
differences and changes in reaction time: The Baltimore Longitudinal Study of Aging.
Journal of Gerontology: Psychological Sciences, 49, P179-P189.
23
Goldberg, D., Bridges, K., Duncan-Jones, P., & Grayson, D. (1988). Detecting anxiety and
depression in general medical settings. BMJ, 297, 897-899.
Hultsch, D. F., MacDonald, S. W. S., & Dixon, R. A. (2002). Variability in reaction time
performance of younger and older adults. Journal of Gerontology: Psychological
Sciences, 57B, P101-P115.
Hultsch, D. F., MacDonald, S. W. S., Hunter, M. A., Levy-Bencheton, J., & Strauss, E. (2000).
Intraindividual variability in cognitive performance in older adults: Comparison of adults
with mild dementia, adults with arthritis, and healthy adults. Neuropsychology, 14, 588-
598.
Hultsch, D. F., Strauss, E., Hunter, M. A., & MacDonald, S. W. S. . (2008). Intraindividual
variability, cognition, and aging. In F. I. M. Craik & T. A. Salthouse (Eds.), The
handbook of aging and cognition (3rd ed) (pp. 491-556). New York: Psychology Press.
Jorm, A. F., Anstey, K. J., Christensen, H., & Rodgers, B. (2004). Gender differences in
cognitive abilities: The mediating role of health state and health habits. Intelligence, 32, 7-
23.
Li, S-C., Aggen, S. H., Nesselroade, J. R., & Baltes, P. B. (2001). Short-term fluctuations in
elderly people's sensorimotor functioning predict text and spatial memory performance:
The MacArthur Successful Aging Studies. Gerontology, 47, 100-116.
Li, S-C., Lindenberger, U., Hommel, B., Aschersleben, G., Prinz, W., & Baltes, P. B. (2004).
Transformations in the couplings among intellectual abilities and constituent cognitive
processes across the life span. Psychological Science, 15, 155-163.
Li, S-C., Lindenberger, U., & Sikström, S. (2001). Aging cognition: From neuromodulation to
representation. Trends in Cognitive Sciences, 5, 479-486.
24
Lövdén, M., Li, S-C., Shing, Y. L., & Lindenberger, U. (2007). Within-person trial-to-trial
variability precedes and predicts cognitive decline in old and very old age: Longitudinal
data from the Berlin Aging Study. Neuropsychologia, 45, 2827-2838.
MacDonald, S. W. S., Hultsch, D. F., & Dixon, R. A. (2003). Performance variability is related to
change in cognition: Evidence from the Victoria Longitudinal Study. Psychology and
Aging, 18, 510-523.
MacDonald, S. W. S., Hultsch, D. F., & Dixon, R. A. (2008). Predicting impending death:
Inconsistency in speed is a selective and early marker. Psychology and Aging, 23, 595-
607.
MacDonald, S. W. S., Karlsson, S., Rieckmann, A., & Nyberg, L. (2012). Aging-related increases
in behavioral variability: Relations to losses of dopamine D1 receptors. The Journal of
Neuroscience, 32, 8186-8191.
MacDonald, S. W. S., Li, S-C., & Bäckman, L. (2009). Neural underpinnings of within-person
variability in cognitive functioning. Psychology and Aging, 24, 792-808.
Murtha, S., Cismaru, R., Waechter, R., & Chertkow, H. (2002). Increased variability
accompanies frontal lobe damage in dementia. Journal of the International
Neuropsychological Society, 8, 360-372.
Rabbitt, P., Osman, P., Moore, B., & Stollery, B. (2001). There are stable individual differences
in performance variability, both from moment to moment and from day to day. The
Quarterly Journal of Experimental Psychology, 54A, 981-1003.
Ratcliff, R., & McKoon, G. (2008). The diffusion decision model: Theory and data for two-
choice decision tasks. Neural Computation, 20, 873-922.
25
Reimers, S., & Maylor, E. A. (2006). Gender effects on reaction time varaibility and trial-to-trial
performance: Reply to Deary and Der (2005). Aging, Neuropsychology, and Cognition,
13, 479-489.
Salthouse, T. A. (2009). When does age-related cognitive decline begin? Neurobiology of Aging,
30, 507-514.
Sliwinski, M., & Buschke, H. (1999). Cross-sectional and longitudinal relationships among age,
cognition, and processing speed. Psychology and Aging, 14(1), 18-33.
Strauss, E., Bielak, A. A. M., Bunce, D., Hunter, M. A., & Hultsch, D. F. (2007). Within-person
variability in response speed as an indicator of mild cognitive impairment in older adults.
Aging, Neuropsychology, and Cognition, 14, 608-630.
Stuss, D. T., Murphy, K. J., Binns, M. A., & Alexander, M. P. (2003). Staying on the job: The
frontal lobes control individual performance variability. Brain, 126, 2363-2380.
Walhovd, K. B., & Fjell, A. M. (2007). White matter volume predicts reaction time instability.
Neuropsychologia, 45, 2277-2284.
West, R., Murphy, K. J., Armilio, M. L., Craik, F. I. M., & Stuss, D. T. (2002). Lapses of
intention and performance variability reveal age-related increases in fluctuations of
executive control. Brain and Cognition, 49, 402-419.
Whitehead, B. P., Dixon, R. A., Hultsch, D. F., & MacDonald, S. W. S. (2011). Are
neurocognitive speed and inconsistency similarly affected in type 2 diabetes? Journal of
Clinical and Experimental Neuropsychology, 33, 647-657. doi:
10.1080/13803395.2010.547845
Williams, B. R., Hultsch, D. F., Strauss, E. H., Hunter, M. A., & Tannock, R. (2005).
Inconsistency in reaction time across the life span. Neuropsychology, 19, 88-96.
26
Williams, B. R., Strauss, E. H., Hultsch, D. F., & Hunter, M. A. (2007). Reaction time
inconsistency in a spatial stroop task: Age-related differences through childhood and
adulthood. Aging, Neuropsychology, and Cognition, 14, 417-439.
27
Table 1. Descriptive information about the sample covariates.
Age group
20 40 60
Male Female Male Female Male Female
n = 1018 n = 1175 n = 1034 n = 1220 n = 1045 n = 1070
Measure M (SD) M (SD) M (SD) M (SD) M (SD) M (SD)
Years of
education
15.34 (1.73) 15.56 (1.72) 15.19 (2.22) 14.86 (2.29) 14.55 (2.65) 13.63 (2.57)
Anxiety at
baseline
3.13 (2.59) 4.40 (2.68) 3.24 (2.62) 3.67 (2.70) 1.81 (2.12) 2.44 (2.35)
Depressive
symptoms at
baseline
2.55 (2.30) 3.16 (2.42) 2.23 (2.28) 2.51 (2.42) 1.42 (1.71) 1.69 (1.85)
% Diabetic 0.7 1.3 4.6 3.7 14.7 9.9
% Hypertensive 36.1 9.1 55.7 34.6 82.9 76.7
Note. SD = Standard deviation. Hypertension was defined as scoring above 140 systolic or 90 diastolic, or reporting taking blood
pressure medication at any wave.
28
Table 2. Parameter Estimates from Multilevel Models Examining Age Group and Sex
Differences in Intraindividual Standard Deviations (ISD) Across 8 Years.
ISD
SRT CRT
Parameter Estimate SE Estimate SE
Unconditional Model (df = 3)
Fixed effects
Intercept 5.89***
.03 6.82***
0.02
Random effects
Intercept variance 3.91***
.11 2.72***
.07
Residual variance 5.45***
.08 2.53***
.04
-2LL 84132 71126
AIC 84138 71132
Final Model
Fixed effects
Intercept 6.40***
.13 7.78***
.10
Time .17***
.01 .16***
.01
Age Group contrasts
60 vs. 20 -1.26***
.11 -2.10***
.09
60 vs. 40 -.25 * .11 -1.07***
.08
40 vs. 20
a
-1.01***
.11 -1.02***
.08
Sex .72***
.10 .07 .07
Age Group x Sex contrasts
60 vs. 20 x Sex
a
.30* .14 -.17 .10
60 vs. 40 x Sex -.39** .14 -.02 .10
40 vs. 20 x Sex
a
.09 .14 .19 .10
Time x Age Group contrasts
60 vs. 20 -.23***
.01 -.15***
.01
60 vs. 40 -.23***
.01 -.10***
.01
40 vs. 20
a
.00 .01 -.05***
.01
29
Random effects
Intercept variance 2.97***
.10 1.71***
.05
Slope variance - .001 .00
Residual variance 5.38***
.08 2.35***
.04
-2LL 82646 (df = 16) 68349 (df = 17)
AIC 82678 68383
Note. * p < . 05, ** p < . 01, *** p < . 001. SRT = simple reaction time; CRT = choice reaction
time. 60s cohort, male, served as reference group. All estimates are unstandardized. Years of
education, diabetes, hypertension, anxiety, and depressive symptoms were included as covariates
in the final model. aContrast tested in another analysis using same model but different coding for
age group. Due to insufficient variation, random slope was not estimated for SRT in the final
model.
30
Figure 1. Model implied change in ISD across time as a function of age group and task.
Note: ISD = Intraindividual standard deviation; SRT = Simple reaction time; CRT = Choice
reaction time.
4
5
6
7
8
9
10
012345678
ISD
Year
20-SRT
40-SRT
60-SRT
20-CRT
40-CRT
60-CRT
31
... Evidence shows that aging is associated with increases in both inter-and intra-individual differences [17,19,20]. ...
... Inter-individual differences in old age stem from a range of causes, including genetics, age-related diseases, cohort effects, and most importantly -differences in lifestyles, including differences in habitual PA [21]. Yet even more complex for research and practice are the intra-individual variations [20], which are associated with the measuring of a single person in either multiple tasks (dispersion) or in a single task yet on multiple occasions (inconsistency) [17]. Such inter-and intra-individual differences have also been reported in response to PA, yet scientific understanding is still limited with regards to the characteristics that could help identify responders and nonresponders [15,22,23]. ...
Article
Full-text available
Preserving functional health and quality-of-life in old age is a major goal and global challenge in public health. The high rate of sedentary behavior that is characteristic of the older adult population exacerbates impairments of physiological and tructural systems that are typically seen in the aging process. Achieving an understanding of the profound infuence of physical activity on all aspects of health in old age is the driving force behind the emergence of "physical activity in old age" as a growing area of research. Accumulated evidence implies that being physically active and exercising is far superior to other optimal aging facilitators. Yet this area of research faces numerous constraints and obstacles. This commentary addresses some of these challenges, primarily the heterogeneity of the aging process, which induces both inter- and intra-individual diferences among aged individuals, heterogeneity in assessment tools, unjustifed inclusion/exclusion criteria and insufcient recruitment strategies, difculties in imple�menting research results in real-world conditions, and rudimentary exploitation of innovative technology. We explain the importance of establishing a network of multidisciplinary scientists and stakeholders to propose consensus-based goals and scientifcally evidenced wide-ranging plans for dealing with these challenges. In addition, we suggest work directions for this network.
... It should be noted that reliability of some reaction time-based measures, such as Stroop test 1, was relatively low compared to other. This is not surprising, as they are granular scores that are particularly susceptible to intraindividual fluctuations from one assessment to the next, especially in elderly (Bielak et al., 2014). We hypothesize that these scores could be affected by subtle delays in connection during remote assessment, as reaction times at VTC follow-up were somewhat higher compared to face-to-face baseline. ...
Article
Full-text available
Objective Neuropsychological assessment through VideoTeleConferencing (VTC) can help improve access to diagnostic and follow-up care in memory clinics. This study investigated the stability of performance on VTC assessment in relation to in-person assessment using a test-retest design and explored user experiences of VTC assessment. Materials and Methods Thirty-one patients (62 ± 6.7 years, 45% female, 58% Subjective Cognitive Decline, 42% Mild Cognitive Impairment/dementia diagnosis) were included from the Amsterdam Dementia Cohort between August 2020 and February 2021. Patients underwent a face-to-face neuropsychological assessment followed by a VTC assessment using the same test protocol within 4 months. Reliability coefficients were calculated using intraclass correlation coefficients (ICC). For each test, the proportion of clinically relevant differences in performances between assessment modalities was calculated. User experiences of patients and neuropsychologists were assessed with questionnaires (User Satisfaction and Ease of use [USE] questionnaire and System Usability Scale [SUS]). Neuropsychologists also participated in a focus group. Results ICC values were moderate to excellent (0.63-0.93) for all test measures in the total sample. On all tests, most patients did not show clinically relevant performance differences between modalities. Patients and neuropsychologists reported overall positive VTC system usability, although neuropsychologists indicated in the focus group that patients without cognitive impairment required less training for the system and were more independent. Conclusion VTC assessment showed adequate to excellent test-retest reliability for a broad range of neuropsychological tests commonly used in practice. Assessment through VTC may be a user friendly method in the memory clinic, especially to monitor individuals at risk for future cognitive decline.
... Second, sex was not associated with either ISD or CoV. This result replicates prior research, which suggested that initial sex differences in dispersion in middle age were no longer significant in older age (Bielak et al., 2014). Third, our results indicated that lower education was associated with more dispersion as indexed by the ISD, particularly at the low end of the education spectrum. ...
Article
Objective Cognitive dispersion indexes intraindividual variability in performance across a battery of neuropsychological tests. Measures of dispersion show promise as markers of cognitive dyscontrol and everyday functioning difficulties; however, they have limited practical applicability due to a lack of normative data. This study aimed to develop and evaluate normed scores for cognitive dispersion among older adults. Method We analyzed data from 4,283 cognitively normal participants aged ≥50 years from the Uniform Data Set (UDS) 3.0. We describe methods for calculating intraindividual standard deviation (ISD) and coefficient of variation (CoV), as well as associated unadjusted scaled scores and demographically adjusted z-scores. We also examined the ability of ISD and CoV scores to differentiate between cognitively normal individuals (n = 4,283) and those with cognitive impairment due to Lewy body disease (n = 282). Results We generated normative tables to map raw ISD and CoV scores onto a normal distribution of scaled scores. Cognitive dispersion indices were associated with age, education, and race/ethnicity but not sex. Regression equations were used to develop a freely accessible Excel calculator for deriving demographically adjusted normed scores for ISD and CoV. All measures of dispersion demonstrated excellent diagnostic utility when evaluated by the area under the curve produced from receiver operating characteristic curves. Conclusions Results of this study provide evidence for the clinical utility of sample-based and demographically adjusted normative standards for cognitive dispersion on the UDS 3.0. These standards can be used to guide interpretation of intraindividual variability among older adults in clinical and research settings.
... Mild cognitive changes can be observed in the midlife period (Bielak et al., 2013;Park et al., 2013;Wolkorte et al., 2014) but to a much lesser extent than in older people. Moreover, this 40-to 60-year-old population has to deal with cognitive challenges everyday. ...
Article
Full-text available
Cognitive fatigue arises after a long-lasting task, as attested by increases in reaction times (RTs). However, most studies have focused on young adults. Therefore, we investigated cognitive fatigue through changes in RT distributions in three age groups—young, middle-aged, and older adults—during a 160-min Stroop task. Task duration was divided into four blocks and the ex-Gaussian parameters (μ, σ, τ) were extracted from individual RT distributions in each time block for each item type. The results showed a significant Group effect on μ. Young adults had smaller μ values than the other two groups, meaning that middle-aged and older people performed the whole task slower than young adults. By contrast, τ showed no Group effect but increased with Time-on-Task in middle-aged people. Older adults did not show τ increase with Time-on-Task, which echoes studies showing some resistance to task monotony in this population. Globally, our results showed dissociated age and Time-on-Task effect on the ex-Gaussian parameters, confirming the relevance of this approach in the cognitive fatigue domain. We proposed here that cognitive fatigue affects only the decision component of response production, and that midlife may be a life stage with high sensitivity to cognitive fatigue.
... Importantly, even in those cases where there is reason to believe that certain processes or constructs of interest are reasonably stable (at least throughout the timescale studied) [5][6][7] , there is typically far less reason to believe that performance on the tasks used to measure those processes is similarly static [8][9][10] . While full consideration of this issue is rare, insinuated nods in this direction are relatively frequent in many domains. ...
Article
Full-text available
The Implicit Association Test (IAT) is employed in the domain of social psychology as a measure of implicit evaluation. Participants in this task complete blocks of trials where they are asked to respond to categories and attributes (e.g., types of faces and types of words). Reaction times in different blocks sharing certain response combinations are averaged and then subtracted from blocks with other response combinations and then normalized, the result of which is taken as a measure indicating implicit evaluation toward or away from the given categories. One assumption of this approach is stationarity of response time distributions, or at a minimum, that temporal dynamics in response times are not theoretically relevant. Here we test these assumptions, examine the extent to which response times change within the IAT blocks and, if so, how trajectories of change are meaningful in relation to external measures. Using multiple data sets we demonstrate within-session changes in IAT scores. Further, we demonstrate that dissociable components in the trajectories of IAT performance may be linked to theoretically distinct processes of cognitive biases as well as behaviors. The present work presents evidence that IAT performance changes within the task, while future work is needed to fully assess the implications of these temporal dynamics.
... With regard to the association of sex with mean performance, this concurs with the findings of Zaninotto et al. (32), who also found females in the ELSA cohort to have a higher mean memory test score than males, with no moderating effect of age, although less explicit attention has been paid to the estimated effects of sex on IIV in memory-based tasks (cf. reaction-time tasks, where females are typically found to have greater IIV than males throughout adulthood (41)(42)(43)). Similarly, while later cohorts were estimated to have a higher probability of correctly recalling words, their IIV was estimated to be greater as well. ...
Article
Full-text available
Cognitive functioning in older age profoundly impacts quality of life and health. Whilst most research in cognition in older age has focussed on mean levels, intraindividual variability (IIV) around this may have risk factors and outcomes independent of the mean. Investigating risk factors associated with IIV has typically involved deriving a summary statistic for each person from residual error around a fitted mean. However, this ignores uncertainty in the estimates, prohibits exploring associations with time-varying factors, and is biased by floor/ceiling effects. To address this, we propose a mixed-effects location scale beta-binomial model to estimate average probability and IIV in a word recall test in the English Longitudinal Study of Aging. After adjusting for mean performance, an analysis of 9,873 individuals across 7 (mean: 3.4) waves (2002-2015), found IIV greater: at older ages; with lower education; in females; with more difficulties with activities of daily living; in later cohorts; and when interviewers recorded issues potentially affecting the tests. Our study introduces a novel method to identify groups with greater IIV in bounded discrete outcomes. Our findings have implications for daily functioning and care, with further work needed to identify the impact for future health outcomes.
... Slowing of RT/ processing speed, possibly associated with increasing IIV of RT performance over time, has been observed in multiple longitudinal studies in older individuals, including patients with MDD [35]. In a longitudinal study of healthy volunteers, participants in their 40's evidenced small increases in IIV on RT performance on choice reaction time tasks, but not on simple RT, whereas those in their 60's showed more pronounced increases in both IIV and RT on simple and choice RT tasks [36]. ...
Article
Full-text available
Patients with treatment-resistant depression (TRD) have higher rates of relapse and pronounced decreases in daily functioning and health-related quality of life compared to patients with major depressive disorder who are not treatment-resistant, underscoring the need for treatment choices with sustained efficacy and long-term tolerability. Adults with TRD who participated in ≥1 of 6 phase 3 “parent” studies could continue esketamine treatment, combined with an oral antidepressant, by enrolling in phase 3, open-label, long-term extension study, SUSTAIN-3. Based on their status at parent-study end, eligible participants entered a 4-week induction phase followed by an optimization/maintenance phase, or directly entered the optimization/maintenance phase of SUSTAIN-3. Intranasal esketamine dosing was flexible, twice-weekly during induction and individualized to depression severity during optimization/maintenance. At the interim data cutoff (01 December 2020), 1148 participants were enrolled, 458 at induction and 690 at optimization/maintenance. Mean (median) cumulative duration of maintenance esketamine treatment was 31.5 (37.7) months (totaling 2769 cumulative patient-years). Common treatment-emergent adverse events (≥20%) were headache, dizziness, nausea, dissociation, somnolence, and nasopharyngitis. Mean Montgomery–Åsberg Depression Rating Scale (MADRS) total score decreased during induction, and this reduction persisted during optimization/maintenance (mean [SD] change from the baseline to the endpoint of each phase: induction −12.8 [9.73]; optimization/maintenance +1.1 [9.93]), with 35.6% and 46.1% of participants in remission (MADRS total score ≤12) at induction and optimization/maintenance endpoints, respectively. Improvement in depression ratings generally persisted among participants who remained in maintenance treatment, and no new safety signal was identified during long-term treatment (up to 4.5 years) using intermittent-dosed esketamine in conjunction with daily antidepressant.
... Aside from individuals' average processing speed (person-level differences), momentary fluctuations in processing speed may also be useful to assess via EMA survey paradata. For instance, intraindividual cognitive variability increases with age, even among those who remain cognitively healthy [17], and variability is a risk factor for mild cognitive impairment and Alzheimer disease and related dementias [18][19][20][21][22], even after adjusting for average performance [18]. In addition, WP variability in processing speed, as measured by formal cognitive tests, has been shown to be affected by momentary factors, including caffeine consumption [23], social context [24], and fatigue [14]. ...
Article
Full-text available
Background: Various populations with chronic conditions are at risk for decreased cognitive performance, making assessment of their cognition important. Formal mobile cognitive assessments measure cognitive performance with greater ecological validity than traditional laboratory-based testing but add to participant task demands. Given that responding to a survey is considered a cognitively demanding task itself, information that is passively collected as a by-product of ecological momentary assessment (EMA) may be a means through which people's cognitive performance in their natural environment can be estimated when formal ambulatory cognitive assessment is not feasible. We specifically examined whether the item response times (RTs) to EMA questions (eg, mood) can serve as approximations of cognitive processing speed. Objective: This study aims to investigate whether the RTs from noncognitive EMA surveys can serve as approximate indicators of between-person (BP) differences and momentary within-person (WP) variability in cognitive processing speed. Methods: Data from a 2-week EMA study investigating the relationships among glucose, emotion, and functioning in adults with type 1 diabetes were analyzed. Validated mobile cognitive tests assessing processing speed (Symbol Search task) and sustained attention (Go-No Go task) were administered together with noncognitive EMA surveys 5 to 6 times per day via smartphones. Multilevel modeling was used to examine the reliability of EMA RTs, their convergent validity with the Symbol Search task, and their divergent validity with the Go-No Go task. Other tests of the validity of EMA RTs included the examination of their associations with age, depression, fatigue, and the time of day. Results: Overall, in BP analyses, evidence was found supporting the reliability and convergent validity of EMA question RTs from even a single repeatedly administered EMA item as a measure of average processing speed. BP correlations between the Symbol Search task and EMA RTs ranged from 0.43 to 0.58 (P<.001). EMA RTs had significant BP associations with age (P<.001), as expected, but not with depression (P=.20) or average fatigue (P=.18). In WP analyses, the RTs to 16 slider items and all 22 EMA items (including the 16 slider items) had acceptable (>0.70) WP reliability. After correcting for unreliability in multilevel models, EMA RTs from most combinations of items showed moderate WP correlations with the Symbol Search task (ranged from 0.29 to 0.58; P<.001) and demonstrated theoretically expected relationships with momentary fatigue and the time of day. The associations between EMA RTs and the Symbol Search task were greater than those between EMA RTs and the Go-No Go task at both the BP and WP levels, providing evidence of divergent validity. Conclusions: Assessing the RTs to EMA items (eg, mood) may be a method of approximating people's average levels of and momentary fluctuations in processing speed without adding tasks beyond the survey questions.
Article
Full-text available
Background There is increasing evidence for cognitive function to be negatively impacted by COVID-19. There is, however, limited research evaluating cognitive function pre- and post-COVID-19 using objective measures. Methods We examined processing speed, attention, working memory, executive function and memory in adults (≤69 years) with a history of COVID-19 ( n = 129, none acutely unwell), compared to those with no known history of COVID-19 ( n = 93). We also examined cognitive changes in a sub-group of COVID ( n = 30) and non-COVID ( n = 33) participants, compared to their pre-COVID-19 pandemic level. Results Cross-sectionally, the COVID group showed significantly larger intra-individual variability in processing speed, compared to the non-COVID group. The COVID sub-group also showed significantly larger intra-individual variability in processing speed, compared to their pre-COVID level; no significant change occurred in non-COVID participants over the same time scale. Other cognitive indices were not significantly impacted in the cross-sectional or within-subjects investigations, but participants ( n = 20) who had needed hospitalisation due to COVID-19 showed poor attention and executive function relative to those who had not required hospitalisation ( n = 109). Poor health and long-COVID symptoms correlated with poor cognitive function across domains in the COVID group. Conclusions The findings indicate a limited cognitive impact of COVID-19 with only intra-individual variability in processing speed being significantly impacted in an adult UK sample. However, those who required hospitalisation due to COVID-19 severity and/or experience long-COVID symptoms display multifaceted cognitive impairment and may benefit from repeated cognitive assessments and remediation efforts.
Article
Full-text available
Reaction time variables are used widely in studies of human cognitive ageing and in research on the information processing foundations of psychometric intelligence. The research is largely based on biased population samples. In the present study, large (500+), representative samples of the population of the West of Scotland were tested at ages 16, 36 and 56 years on simple and choice reaction time. Participants were re-tested eight years later, at which time they also took the Paced Auditory Serial Addition Test (PASAT). We report simple and choice reaction time means and their variabilities, their stability across 8 years, and their correlations with the PASAT. Simple and choice reaction times become slower and more variable with age. Women from age 36 to 63 show more variability in choice reaction times than men, an effect which remains after controlling for mean reaction time. Reaction time differences largely account for age differences, but not sex differences, in PASAT scores.
Article
Full-text available
Intraindividual variability (IIV) reflects within-person changes in performance, such as trial-by-trial fluctuations on a reaction-time (RT) task. The neural underpinnings of IIV remain largely unknown. The neurotransmitter dopamine (DA) is of particular interest here, as human populations that exhibit DA alterations, such as the elderly, attention deficit hyperactivity disorder children, persons with schizophrenia, and Parkinson patients, also show increased behavioral IIV. We examined links between DA D(1) binding potential (BP) in multiple brain regions and IIV for the control and interference conditions of the Multi-Source Interference Task (MSIT), tapping the cingulo-fronto-parietal attention network. Participants were 18 young and 20 healthy old adults. PET and the radioligand [(11)C]SCH23390 were used to determine D(1) BP. The intraindividual standard deviation (ISD) was computed across successful latency trials of the MSIT conditions, independent of mean RT differences due to age, trial, and condition. Increasing ISDs were associated with increasing age and diminished D(1) binding in several brain regions (anterior cingulate gyrus, dorsolateral prefrontal cortex, and parietal cortex) for the interference, but not control, condition. Analyses of partial associations indicate that the association between age and IIV in the interference condition was linked to D(1) receptor losses in task-relevant brain regions. These findings suggest that dysfunctional DA modulation may contribute to increased variability in cognitive performance among older adults.
Article
Full-text available
Increased performance variability has been demonstrated in several groups and conditions, including aging and cognitive decline. Structural brain characteristics underlying this phenomenon have so far been elusive. However, there is reason to expect that disconnectivity in associative pathways, whether caused by immature or degraded white matter (WM) tracts, will increase performance variability by neural noise. The aim of this study was to test whether the quality of WM, measured by diffusion tensor imaging, is related to performance variability in healthy adults. Intraindividual standard deviation of the reaction time (sdRT) across trials and median reaction time (mRT) from 270 participants were obtained from a speeded continuous performance task (Eriksen flanker task) with two conditions (congruent, incongruent). Tract-based spatial statistics was used to test the relationship with diffusion characteristics [fractional anisotropy (FA), mean diffusion (MD), radial diffusion (RD), axial diffusion (AD)]. Robust relationships between sdRT and all diffusion measures were found in most WM areas, independently of mRT, age, and sex. The effects were anatomically more widespread in the congruent than the incongruent condition, covering almost 50% of the voxels for RD and MD, and >25% of the voxels for FA and AD. Partial betas were in the range 0.45-0.55, and the strength of the relationships increased significantly with age. For mRT, the effects were smaller and unstable across condition. We concluded that performance variability is a likely consequence of individual differences in WM integrity, and that it is a promising behavioral correlate of individual differences in WM microstructure.
Article
The relationship between performance on measures of sensorimotor and physiological function and performance on measures of reaction time (RT) was investigated using an individual differences approach. Older participants showed greater intra-individual variability on the RT measures. They were also slower on measures of four choice visual RT but not on measures of three choice auditory RT. Sensorimotor and physiological variables explained nearly all the age differences in performance on the RT tasks and showed similar patterns of relationships with measures of speed, accuracy, and intra-individual variability. The results support a common factor interpretation of the relationships among these variables in old age.
Article
Our focus in this chapter will be on variability in cognition within persons across occasions, or intraindividual variability. There are different ways to conceptualize intraindividual variability, and therefore it is useful to narrow our focus a bit more. Two key features that have been used to differentiate changes within persons over time include the permanence of the change and the timescale over which the change occurs (Cattell, 1957; Fisk & Rice, 1955; Li, Huxhold, & Schmiedek, 2004a; Nesselroade, 1991; Wohlwill, 1973). There are three major parts to the chapter. First, we begin with an expanded examination of different conceptualizations of intraindividual variability and the potential relevance of the phenomenon for understanding aging and cognition. In the second part, we review several strands of existing research, including work describing between-person differences in intraindividual variability as a function of age and neurological status, and the association of intraindividual variability with cognitive functioning, functional competence, and mortality. In the final part, we examine a number of unresolved issues in this area of research including appropriate statistical indicators of intraindividual variability, whether intraindividual variability provides unique information above and beyond what is carried by measures of central tendency, and potential mechanisms that might cause changes in intraindividual variability over the life course. (PsycINFO Database Record (c) 2012 APA, all rights reserved)
Article
Gender differences were examined in performance on the California Verbal Learning Test (immediate and delayed recall), Digit Span Backwards, Symbol–Digit Modalities Test, Spot-the-Word, and simple and choice reaction time. The data came from a community survey involving 2404 people aged 20–24 years, 2530 aged 40–44 years, and 2551 aged 60–64 years. Males performed better on Digit Span Backwards and on reaction time, while females were better on recall and Symbol–Digit Modalities Test. A range of sociodemographic, health state, and health habit variables were examined as possible mediators of these gender differences. Mediating effects were found for education, non-English speaking background, depressive symptoms, alcohol abstinence or occasional use, low physical activity, heavy cannabis use, and pulmonary function. When mediating variables were controlled, gender differences tended to disappear on tests for which there was a male advantage and to magnify on tests for which there was a female advantage.
Article
An integrative theory relating cognitive aging deficits observed at the behavioral level with age-related deficiency in neuromodulation causing less distinctive cortical representations is tested in a series of neural network simulations. Age-related attenuation of catecholaminergic function is simulated by lowering the mean gain of the processing unit, which subsequently reduces responsivity and raises intra-network activation variability. Age differences in learning rate, asymptotic performance, interference susceptibility, complexity cost, intra- and inter-individual variability, and ability dedifferentiation can all be modeled. Together, the simulations illustrate catecholamine's role in regulating the fidelity of neural information processing and subsequent effects leading to cognitive aging deficits.
Article
To identify neuropsychological predictors of transition from healthy cognitive aging to mild cognitive impairment (MCI) or any mild cognitive disorder (any-MCD) in a community-based longitudinal study of aging. Longitudinal Two thousand eighty-two individuals, aged 60–64 years and participating in a prospective epidemiologic study of mental health, and aging were assessed at two time points 4 years apart for MCI using the International Consensus Criteria, the clinical dementia rating scale (CDR, 0.5), or any of a suite of criteria sets for MCDs (any-MCD). Logistic regression was used to assess the neuropsychological predictors of conversion to diagnosis including the Mini-Mental State Examination, immediate and delayed recall (IR and DR), Digit Backward, Spot-the-Word (STW), Symbol Digits Modalities Test (SDMT), simple and choice reaction time, and reaction time variability. Of the 2,082 participants with no cognitive impairment in the first wave of data collection, 18 participants were diagnosed with MCI, 32 with CDR 0.5, and 64 participants presented with any-MCD 4 years later. The main neuropsychological predictors of conversion identified in multivariate analyses were measures of IR/DR, STW, Symbol Digit Modalities Task, and reaction time variability. Although most measures were significant predictors of conversion to MCI or any-MCD when assessed independently, four tests (IR/DR, STW, SDMT, and simple reaction time variability) accounted for the explained variance in diagnosis when all tests were assessed together. When predictive value, stability across clinical categories, and psychometric characteristics were considered together, the reaction time variability measure was the best predictor of future cognitive disorder.