The Reliability and Validity of the Self-Reported Drinking Measures in the Army???s Health Risk Appraisal Survey

Social Sectors Development Strategies Inc., Eight Nonesuch Drive, Natick, MA 01769-1041, USA.
Alcoholism Clinical and Experimental Research (Impact Factor: 3.21). 06/2003; 27(5):826-34. DOI: 10.1097/01.ALC.0000067978.27660.73
Source: PubMed


The reliability and validity of self-reported drinking behaviors from the Army Health Risk Appraisal (HRA) survey are unknown.
We compared demographics and health experiences of those who completed the HRA with those who did not (1991-1998). We also evaluated the reliability and validity of eight HRA alcohol-related items, including the CAGE, weekly drinking quantity, and drinking and driving measures. We used Cohen's kappa and Pearson's r to assess reliability and convergent validity. To assess criterion (predictive) validity, we used proportional hazards and logistical regression models predicting alcohol-related hospitalizations and alcohol-related separations from the Army, respectively.
A total of 404,966 soldiers completed an HRA. No particular demographic group seems to be over- or underrepresented. Although few respondents skipped alcohol items, those who did tended to be older and of minority race. The alcohol items demonstrate a reasonable degree of reliability, with Cronbach's alpha = 0.69 and test-retest reliability associations in the 0.75-0.80 range for most items over 2- to 30-day interims between surveys. The alcohol measures showed good criterion-related validity: those consuming more than 21 drinks per week were at 6 times the risk for subsequent alcohol-related hospitalization versus those who abstained from drinking (hazard ratio, 6.36; 95% confidence interval=5.79, 6.99). Those who said their friends worried about their drinking were almost 5 times more likely to be discharged due to alcoholism (risk ratio, 4.9; 95% confidence interval=4.00, 6.04) and 6 times more likely to experience an alcohol-related hospitalization (hazard ratio, 6.24; 95% confidence interval=5.74, 6.77).
The Army's HRA alcohol items seem to elicit reliable and valid responses. Because HRAs contain identifiers, alcohol use can be linked with subsequent health and occupational outcomes, making the HRA a useful epidemiological research tool. Associations between perceived peer opinions of drinking and subsequent problems deserve further exploration.

Download full-text


Available from: Nicole S Bell
  • Source
    • "This could result in underreporting of symptoms, given stigma surrounding mental health issues in the military (Hoge et al., 2004). However, participants in the study were assured that their responses were completely confidential and anonymous in an effort to reduce this problem, and other studies have found that self-reported alcohol use has demonstrated good validity in Army samples, even when anonymity was not assured (Bell et al., 2003). "
    [Show abstract] [Hide abstract]
    ABSTRACT: Studies have shown a relationship between combat experiences and alcohol misuse in military personnel; it is not known if there are specific combat experiences that confer a greater risk. The current study examined the association of specific types of combat experiences with a positive screen for alcohol misuse. 1120 U.S. soldiers who were members of brigade combat infantry teams were surveyed anonymously 3-4 months after returning from deployment to Iraq regarding their experiences in combat and their physical and mental health. Combat items were independently rated and placed into the following categories: (1) Fighting; (2) Killing; (3) Threat to oneself; (4) Death/injury of others; (5) Atrocities; and, (6) Positive experiences. Alcohol misuse was measured using a 2-item alcohol screen combined with alcohol-related behavioral items. Of the soldiers sampled, 25% (N=275) screened positive for alcohol misuse 3-4 months post-deployment; 12% (N=125) screened positive and exhibited alcohol-related behavioral problems. Most combat exposure factors were significantly related to alcohol misuse individually. When factors were analyzed simultaneously, soldiers who had higher rates of exposure to the threat of death/injury were significantly more likely to screen positive for alcohol misuse; exposure to atrocities predicted misuse of alcohol with alcohol-related behavioral problems. High exposure to threatening situations and atrocities was associated with a positive screen for alcohol misuse. Clinicians treating combat veterans should be aware of the potential association of alcohol misuse with specific types of experiences and closely follow those soldiers upon their return home.
    Full-text · Article · Apr 2010 · Drug and alcohol dependence
  • Source
    • "The main limitation is the assessment of test-retest characteristics over a range of time (approximately 2 weeks; see Methods), rather than using a fixed, a priori test-retest interval. Interval range approaches have however been used in a number of published test-retest studies of other measures of risk-taking and potentially injurious behavior (e.g., interval of 2 to 30 days for alcohol-related behavior, Bell et al., 2003; interval of 7 to 150 days for self-harm behavior, Fliege et al., 2006; interval of 6 to 11 days for HIV, HBV, and HCV risk behavior, Fry & Lintzeris, 2003; interval of 10 to 14 days for substance use, violent behavior, suicidality, and sexuality, Flisher et al., 2004). Future studies using fixed test-retest intervals, such as fixed 2-week, 3-week, 2-month, and 3-month retest intervals, would be valuable to assess the long-term stability of the behavior. "
    [Show abstract] [Hide abstract]
    ABSTRACT: The Balloon Analogue Risk Task (BART) is a computerized decision-making task that provides a test of behavioral risk taking. The task is increasingly used in laboratory settings and in the field with young adults and adolescents. However, there are currently no published data about the test-retest characteristics of the task when it is administered on separate days. The current paper addresses this gap. Risky behavior on the BART (adjusted average pumps) showed acceptable test-retest reliability across days (r = +.77, p < .001). The data indicate that risk behavior on the BART has adequate test-retest stability and therefore performance on the task on a single occasion is likely to be representative of an individual's performance on other occasions.
    Full-text · Article · Dec 2008 · Experimental and Clinical Psychopharmacology
  • Source
    • "" Responses were grouped into 4 categories based upon published guidelines for safe and unsafe drinking as follows: none ( " abstainers " ), 1 to 7 drinks, 8 to 14 drinks, and 15 or more drinks per week ( " heavy drinkers " ) (Campbell et al., 1999; Gordis, 1992; Sanchez- Craig et al., 1995). Although these self-reported items, as well as the weekly alcohol consumption measures, are susceptible to reporting bias, prior work has shown that they display good internal and external validity and are strong predictors of alcohol-related hospitalizations and early separation from service due to alcoholism (Bell et al., 2003). "
    [Show abstract] [Hide abstract]
    ABSTRACT: Prior studies suggest racial/ethnic differences in the associations between alcohol misuse and spouse abuse. Some studies indicate that drinking patterns are a stronger predictor of spouse abuse for African Americans but not whites or Hispanics, while others report that drinking patterns are a stronger predictor for whites than African Americans or Hispanics. This study extends prior work by exploring associations between heavy drinking, alcohol-related problems, and risk for spouse abuse within racial/ethnic groups as well as variations associated with whether the perpetrator is drinking during the spouse abuse incident. Cases (N=7,996) were all active-duty male, enlisted Army spouse abusers identified in the Army's Central Registry (ACR) who had also completed an Army Health Risk Appraisal (HRA) Survey between 1991 and 1998. Controls (N=17,821) were matched on gender, rank, and marital and HRA status. We found 3 different patterns of association between alcohol use and domestic violence depending upon both the race/ethnicity of the perpetrator and whether or not alcohol was involved in the spouse abuse event. First, after adjusting for demographic and psychosocial factors, weekly heavy drinking (>14 drinks per week) and alcohol-related problems (yes to 2 or more of 6 alcohol-related problem questions, including the CAGE) were significant predictors of domestic violence among whites and Hispanics only. Also for the white soldiers, the presence of family problems mediated the effect of alcohol-related problems on spouse abuse. Second, alcohol-related problems predicted drinking during a spouse abuse incident for all 3 race groups, but this relation was moderated by typical alcohol consumption patterns in Hispanics and whites only. Finally, alcohol-related problems predicted drinking during a spouse abuse incident, but this was a complex association moderated by different psychosocial or behavioral variables within each race/ethnic group. These findings suggest important cultural/social influences that interact with drinking patterns.
    Full-text · Article · Oct 2006 · Alcoholism Clinical and Experimental Research
Show more