How many mailouts? Could attempts to increase the response rate in the Iraq war cohort study be counterproductive?

King's Centre for Military Health, Research, Institute of Psychiatry, King's College London, London, UK.
BMC Medical Research Methodology (Impact Factor: 2.17). 02/2007; 7:51. DOI: 10.1186/1471-2288-7-51
Source: PubMed

ABSTRACT Low response and reporting errors are major concerns for survey epidemiologists. However, while nonresponse is commonly investigated, the effects of misclassification are often ignored, possibly because they are hard to quantify. We investigate both sources of bias in a recent study of the effects of deployment to the 2003 Iraq war on the health of UK military personnel, and attempt to determine whether improving response rates by multiple mailouts was associated with increased misclassification error and hence increased bias in the results.
Data for 17,162 UK military personnel were used to determine factors related to response and inverse probability weights were used to assess nonresponse bias. The percentages of inconsistent and missing answers to health questions from the 10,234 responders were used as measures of misclassification in a simulation of the 'true' relative risks that would have been observed if misclassification had not been present. Simulated and observed relative risks of multiple physical symptoms and post-traumatic stress disorder (PTSD) were compared across response waves (number of contact attempts).
Age, rank, gender, ethnic group, enlistment type (regular/reservist) and contact address (military or civilian), but not fitness, were significantly related to response. Weighting for nonresponse had little effect on the relative risks. Of the respondents, 88% had responded by wave 2. Missing answers (total 3%) increased significantly (p < 0.001) between waves 1 and 4 from 2.4% to 7.3%, and the percentage with discrepant answers (total 14%) increased from 12.8% to 16.3% (p = 0.007). However, the adjusted relative risks decreased only slightly from 1.24 to 1.22 for multiple physical symptoms and from 1.12 to 1.09 for PTSD, and showed a similar pattern to those simulated.
Bias due to nonresponse appears to be small in this study, and increasing the response rates had little effect on the results. Although misclassification is difficult to assess, the results suggest that bias due to reporting errors could be greater than bias caused by nonresponse. Resources might be better spent on improving and validating the data, rather than on increasing the response rate.

Download full-text


Available from: Matthew Hotopf, Jul 03, 2015
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Mild traumatic brain injury (mTBI) is being claimed as the 'signature' injury of the Iraq war, and is believed to be the cause of long-term symptomatic ill health (post-concussional syndrome; PCS) in an unknown proportion of military personnel. We analysed cross-sectional data from a large, randomly selected cohort of UK military personnel deployed to Iraq (n=5869). Two markers of PCS were generated: 'PCS symptoms' (indicating the presence of mTBI-related symptoms: none, 1-2, 3+) and 'PCS symptom severity' (indicating the presence of mTBI-related symptoms at either a moderate or severe level of severity: none, 1-2, 3+). PCS symptoms and PCS symptom severity were associated with self-reported exposure to blast whilst in a combat zone. However, the same symptoms were also associated with other in-theatre exposures such as potential exposure to depleted uranium and aiding the wounded. Strong associations were apparent between having PCS symptoms and other health outcomes, in particular being a post-traumatic stress disorder or General Health Questionnaire case. PCS symptoms are common and some are related to exposures such as blast injury. However, this association is not specific, and the same symptom complex is also related to numerous other risk factors and exposures. Post-deployment screening for PCS and/or mTBI in the absence of contemporaneous recording of exposure is likely to be fraught with hazards.
    Psychological Medicine 11/2008; 39(8):1379-87. DOI:10.1017/S0033291708004595 · 5.43 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: To assess any health consequences of the anthrax vaccination programme in UK Armed Forces deployed to Iraq. Data were collected from two samples simultaneously. The first was 5302 randomly selected UK service personnel. The second was 607 service personnel involved in a longitudinal study, where pre-vaccination health had previously been collected. Both samples were offered the anthrax vaccination before they deployed to Iraq in 2003 and subsequently following their service in Iraq. Participants completed a detailed questionnaire, including a range of health outcomes, receipt of the anthrax vaccination and quality of choice. Seventy-two percent of the combined sample had the anthrax vaccination. Being a member of the Army, a commissioned officer or a reservist was associated with higher uptake. No differences in self-reported health were observed between those who did and did not receive the vaccination. For participants who accepted the vaccination, we found an association between making an uninformed choice and adverse health. After adjustment for baseline health in the longitudinal cohort these associations remained significant. Anthrax vaccination used by the UK Armed Forces in preparation for the Iraq War has not resulted in adverse health outcomes. However, of those who did accept the vaccination, reported side effects were related to whether acceptance of vaccination was perceived to be informed. Improving the quality of choice may improve self-reported ill health.
    Vaccine 12/2007; 25(44):7641-8. DOI:10.1016/j.vaccine.2007.08.065 · 3.49 Impact Factor
  • Source