Quantifying test-retest reliability using the intraclass correlation coefficient and the SEM.

Applied Physiology Laboratory, Division of Physical Therapy, Des Moines University-Osteopathic Medical Center, Des Moines, Iowa 50312, USA.
The Journal of Strength and Conditioning Research (Impact Factor: 1.86). 03/2005; 19(1):231-40. DOI: 10.1519/15184.1
Source: PubMed

ABSTRACT Reliability, the consistency of a test or measurement, is frequently quantified in the movement sciences literature. A common metric is the intraclass correlation coefficient (ICC). In addition, the SEM, which can be calculated from the ICC, is also frequently reported in reliability studies. However, there are several versions of the ICC, and confusion exists in the movement sciences regarding which ICC to use. Further, the utility of the SEM is not fully appreciated. In this review, the basics of classic reliability theory are addressed in the context of choosing and interpreting an ICC. The primary distinction between ICC equations is argued to be one concerning the inclusion (equations 2,1 and 2,k) or exclusion (equations 3,1 and 3,k) of systematic error in the denominator of the ICC equation. Inferential tests of mean differences, which are performed in the process of deriving the necessary variance components for the calculation of ICC values, are useful to determine if systematic error is present. If so, the measurement schedule should be modified (removing trials where learning and/or fatigue effects are present) to remove systematic error, and ICC equations that only consider random error may be safely used. The use of ICC values is discussed in the context of estimating the effects of measurement error on sample size, statistical power, and correlation attenuation. Finally, calculation and application of the SEM are discussed. It is shown how the SEM and its variants can be used to construct confidence intervals for individual scores and to determine the minimal difference needed to be exhibited for one to be confident that a true change in performance of an individual has occurred.

  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Procrastination is a prevalent self-regulatory failure associated with stress and anxiety, decreased well-being, and poorer performance in school as well as work. One-fifth of the adult population and half of the student population describe themselves as chronic and severe procrastinators. However, despite the fact that it can become a debilitating condition, valid and reliable self-report measures for assessing the occurrence and severity of procrastination are lacking, particularly for use in a clinical context. The current study explored the usefulness of the Swedish version of three Internet-administered self-report measures for evaluating procrastination; the Pure Procrastination Scale, the Irrational Procrastination Scale, and the Susceptibility to Temptation Scale, all having good psychometric properties in English. In total, 710 participants were recruited for a clinical trial of Internet-based cognitive behavior therapy for procrastination. All of the participants completed the scales as well as self-report measures of depression, anxiety, and quality of life. Principal Component Analysis was performed to assess the factor validity of the scales, and internal consistency and correlations between the scales were also determined. Intraclass Correlation Coefficient, Minimal Detectable Change, and Standard Error of Measurement were calculated for the Irrational Procrastination Scale. The Swedish version of the scales have a similar factor structure as the English version, generated good internal consistencies, with Cronbach's α ranging between .76 to .87, and were moderately to highly intercorrelated. The Irrational Procrastination Scale had an Intraclass Correlation Coefficient of .83, indicating excellent reliability. Furthermore, Standard Error of Measurement was 1.61, and Minimal Detectable Change was 4.47, suggesting that a change of almost five points on the scale is necessary to determine a reliable change in self-reported procrastination severity. The current study revealed that the Pure Procrastination Scale, the Irrational Procrastination Scale, and the Susceptibility to Temptation Scale are both valid and reliable from a psychometric perspective, and that they might be used for assessing the occurrence and severity of procrastination via the Internet. The current study is part of a clinical trial assessing the efficacy of Internet-based cognitive behavior therapy for procrastination, and was registered 04/22/2013 on (NCT01842945).
    BMC psychology. 12/2014; 2(1):54.
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Upper limb (UL) kinematic assessment protocols are becoming integrated into clinical practice due to their development over the last few years. We propose the ELEPAP UL protocol, a contemporary UL kinematic protocol that can be applied to different pathological conditions. This model is based on ISB modeling recommendations, uses functional joint definitions, and models three joints of the shoulder girdle. The specific aim of this study was to determine the within and between session reliability of the ELEPAP UL model. Ten healthy subjects (mean age: 13.6±4.3 years) performed four reach-to-grasp and five functional tasks, which included a novel throwing task to assess a wide spectrum of motor skills. Three trials of every task in two different sessions were analyzed. The reliability of angular waveforms was evaluated by measurement error (σ) and coefficient of multiple correlation (CMC). Spatiotemporal parameters were assessed by standard error of measurement (SEM). Generally joint kinematics presented low σw and σb errors (<100). A selection of angular waveforms errors was presented to inspect error fluctuation in different phases, which was found to be related to the demands of the different movements. CMCw and CMCb values (>0.60) were found, demonstrating good to excellent reliability especially in joints with larger ranges of motion. The throwing task proved equally reliable, enhancing the universal application of the protocol. Compared to the literature, this study demonstrated higher reliability of the thorax, scapula and wrist joints. This was attributed to the highly standardized procedure and the implementation of recent methodological advancements. In conclusion, ELEPAP protocol was proved a reliable tool to analyze UL kinematics. Copyright © 2014 Elsevier B.V. All rights reserved.
    Gait & Posture 12/2014; · 2.30 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Less optimal sagittal plane movement patterns are believed to increase knee injury risk in female athletes. To facilitate clinical screening with a user-friendly method, the purpose of the present study was to examine the temporal relationships between two-dimensional measured sagittal plane kinematics and three-dimensional joint moments during the double-leg drop vertical jump (DVJ) and single-leg DVJ (SLDVJ).
    The Knee 12/2014; · 2.01 Impact Factor

Full-text (2 Sources)

Available from
May 20, 2014