Investigation and Treatment of Missing Item Scores in Test and Questionnaire Data

Multivariate Behavioral Research (Impact Factor: 2.48). 06/2010; 38(4). DOI: 10.1207/s15327906mbr3804_4


This article first discusses a statistical test for investigating whether or not the pattern of missing scores in a respondent-by-item data matrix is random. Since this is an asymptotic test, we investigate whether it is useful in small but realistic sample sizes. Then, we discuss two known simple imputation methods, person mean (PM) and two-way (TW) imputation, and we propose two new imputation methods, response-function (RF) and mean response-function (MRF) imputation. These methods are based on few assumptions about the data structure. An empirical data example with simulated missing item scores shows that the new method RF was superior to the methods PM, TW, and MRF in recovering from incomplete data several statistical properties of the original complete data. Methods TW and RF are useful both when item score missingness is ignorable and nonignorable.

15 Reads
  • Source
    • "As Roth, Switzer and Switzer (1999) pointed out, up until then, there was scarcely any literature on the problem of missing values at the item level. Since then, there have been numerous studies in this fi eld, though not always dealing directly with psychometric aspects (Bernaards & Sijtsma, 2005; Carpita & Manisera, 2011; Cuesta, Fonseca-Pedrero, Vallejo, & Muñiz, 2013; Enders, 2003, 2004; Fernández-Alonso, Suárez-Alvarez, & Muñiz, 2012; Gmel, 2001; McDonald, Thurston, & Nelson, 2000; Shrive, Stuart, Quan, & Ghali, 2006; Sijtsma & van der Ark, 2003; Van Ginkel, van der Ark, & Sijtsma, 2007a, 2007b). "
    [Show abstract] [Hide abstract]
    ABSTRACT: Background: The problem of missing values at the item level is common in studies using educational and psychological tests. The aim of the present work is to explore how the estimation of reliability is affected by missing values. Method: Using real data, we simulated missing values in accordance with a "missing at random mechanism". Four factors were manipulated with the aim of checking their effect on the estimation of the reliability of the instrument: missing data mechanism, percentage of missing data in the database, sample size, and procedure employed for the treatment of missing values. Results: The results show that the quality of estimations depends on the interaction of various factors. The general tendency is that the estimations are worse when the sample size is small and the percentage of missing values increases. Listwise is the worst procedure for treatment of the missing data in the simulated conditions. Conclusions: It is concluded that with a small percentage of missing values one can obtain estimations that are acceptable from a practical point of view with all the procedures employed, except Listwise.
    Psicothema 11/2014; 26(4):516-523. DOI:10.7334/psicothema2014.98 · 0.96 Impact Factor
  • Source
    • "The P-PDI is used for children ages 11 years and older, whereas parents reported on children's disability for children younger than 11 years of age. Up to 2 missing values (25%) were imputed using the 2-way imputation method [35]. "
    [Show abstract] [Hide abstract]
    ABSTRACT: Pediatric chronic pain, which can result in deleterious effects for the child, bears the risk of aggravation into adulthood. Intensive interdisciplinary pain treatment (IIPT) might be an effective treatment, given the advantage of consulting with multiple professionals on a daily basis. Evidence for the effectiveness of IIPT is scarce. Here, we investigated the efficacy of an IIPT within a randomized controlled trial by comparing an intervention group (IG) (n=52) to a waiting-list control group (WCG) (n=52). We made assessments before (PRE), immediately after treatment (POST), as well as at short-term (POST6MONTHS) and long-term (POST12MONTHS) follow-up. We determined a combined endpoint, "improvement" (pain intensity, disability, school absence) [16,21], and investigated three additional outcome domains (anxiety, depression, catastrophizing). We also investigated changes in economic parameters (healthcare use, parental work absenteeism, subjective financial burden) and their relationship to the child's improvement. Results at POST showed that significantly more children in the IG than in the WCG were assigned to improvement (55% compared to 14%; Fisher p<.001; 95% CI for incidence difference: 0.21%-0.60%). While immediate effects were achieved for disability, school absence, depression and catastrophizing, pain intensity and anxiety did not change until short-term follow-up. More than 60% of the children in both groups were improved long-term. The parents reported significant reductions in all economic parameters. The results from the present study support the efficacy of the IIPT. Future research is warranted to investigate differences in treatment response and to understand the changes in economic parameters in nonimproved children.
    Pain 09/2013; 155(1). DOI:10.1016/j.pain.2013.09.015 · 5.21 Impact Factor
    • "uted errors (TW-E; Bernaards & Sijtsma, 2000) and two-way imputation for separate scales (TW-SS; van Ginkel, van der Ark, & Sijtsma, 2007) were used to impute estimated values for these data points, using the syntax outlined by van Ginkel and van der Ark (2005). TW-E is used for one-factor measures and TW-SS is used for factorially complex measures and both are effective procedures for imputing missing data when there is a relatively small amount (around 5% or less) of missing data points for a study variable (Bernaards & Sijtsma, 2000; Sijtsma & van der Ark, 2003; van Ginkel et al., 2007). Zero-order Pearson correlations were calculated first to investigate the relations among the study variables. "
    [Show abstract] [Hide abstract]
    ABSTRACT: The present study examined utility of the Illness Attitudes Scale (IAS; [Kellner, R. (1986). Somatization and hypochondriasis. New York: Praeger Publishers]) in a non-clinical college sample (N=235). Relationships among five recently identified IAS dimensions (fear of illness and pain, symptom effects, treatment experience, disease conviction, and health habits) and self-report measures of several anxiety-related constructs (health anxiety, body vigilance, intolerance of uncertainty, anxiety sensitivity, and non-specific anxiety symptoms) were examined. In addition, this study investigated the incremental validity of the IAS dimensions in predicting medical utilization. The fear of illness and pain dimension and the symptom effects dimension consistently shared stronger relations with the anxiety-related constructs compared to the other three IAS dimensions. The symptom effects dimension, the disease conviction dimension, and the health habits dimension showed incremental validity over the anxiety-related constructs in predicting medical utilization. Implications for the IAS and future conceptualizations of HC are discussed.
    Journal of anxiety disorders 04/2009; 23(6):760-6. DOI:10.1016/j.janxdis.2009.02.016 · 2.68 Impact Factor
Show more


15 Reads
Available from