The Hawthorne Effect: A Randomised, Controlled Trial

Department of Psychological Medicine, Imperial College London, UK. <>
BMC Medical Research Methodology (Impact Factor: 2.27). 02/2007; 7(1):30. DOI: 10.1186/1471-2288-7-30
Source: PubMed


The 'Hawthorne Effect' may be an important factor affecting the generalisability of clinical research to routine practice, but has been little studied. Hawthorne Effects have been reported in previous clinical trials in dementia but to our knowledge, no attempt has been made to quantify them. Our aim was to compare minimal follow-up to intensive follow-up in participants in a placebo controlled trial of Ginkgo biloba for treating mild-moderate dementia.
Participants in a dementia trial were randomised to intensive follow-up (with comprehensive assessment visits at baseline and two, four and six months post randomisation) or minimal follow-up (with an abbreviated assessment at baseline and a full assessment at six months). Our primary outcomes were cognitive functioning (ADAS-Cog) and participant and carer-rated quality of life (QOL-AD).
We recruited 176 participants, mainly through general practices. The main analysis was based on Intention to treat (ITT), with available data. In the ANCOVA model with baseline score as a co-variate, follow-up group had a significant effect on outcome at six months on the ADAS-Cog score (n = 140; mean difference = -2.018; 95%CI -3.914, -0.121; p = 0.037 favouring the intensive follow-up group), and on participant-rated quality of life score (n = 142; mean difference = -1.382; 95%CI -2.642, -0.122; p = 0.032 favouring minimal follow-up group). There was no significant difference on carer quality of life.
We found that more intensive follow-up of individuals in a placebo-controlled clinical trial of Ginkgo biloba for treating mild-moderate dementia resulted in a better outcome than minimal follow-up, as measured by their cognitive functioning.
Current controlled trials: ISRCTN45577048.

Download full-text


Available from: Steve Iliffe,
  • Source
    • "Assessing RHIS data validity in LMICs is more challenging than completeness, reliability or timeliness. Using independent observers in the clinical encounter or during exit surveys can be prone to the Hawthorne effect (McCarney et al. 2007). RHIS data can be compared with community surveys as the 'gold standard' at provincial or national levels, which has demonstrated high correlation in Mozambique (Gimbel et al. 2011). "
    [Show abstract] [Hide abstract]
    ABSTRACT: Routine health information systems (RHISs) are in place in nearly every country and provide routinely collected full-coverage records on all levels of health system service delivery. However, these rich sources of data are regularly overlooked for evaluating causal effects of health programmes due to concerns regarding completeness, timeliness, representativeness and accuracy. Using Mozambique’s national RHIS (Módulo Básico) as an illustrative example, we urge renewed attention to the use of RHIS data for health evaluations. Interventions to improve data quality exist and have been tested in low-and middle-income countries (LMICs). Intrinsic features of RHIS data (numerous repeated observations over extended periods of time, full coverage of health facilities, and numerous real-time indicators of service coverage and utilization) provide for very robust quasi-experimental designs, such as controlled interrupted time-series (cITS), which are not possible with intermittent community sample surveys. In addition, cITS analyses are well suited for continuously evolving development contexts in LMICs by: (1) allowing for measurement and controlling for trends and other patterns before, during and after intervention implementation; (2) facilitating the use of numerous simultaneous control groups and non-equivalent dependent variables at multiple nested levels to increase validity and strength of causal inference; and (3) allowing the integration of continuous ‘effective dose received’ implementation measures. With expanded use of RHIS data for the evaluation of health programmes, investments in data systems, health worker interest in and utilization of RHIS data, as well as data quality will further increase over time. Because RHIS data are ministry-owned and operated, relying upon these data will contribute to sustainable national capacity over time.
    Health Policy and Planning 04/2015; DOI:10.1093/heapol/czv029 · 3.47 Impact Factor
  • Source
    • "In human immunodeficiency virus (HIV) and sexually transmitted infection (STI) prevention trials reported risk behaviors are often observed to decline over the course of the study, even in the control group [1] [2]. Such declines may be attributed to a number of factors, including counseling messages and services provided by the study, a general increase in feelings of self-worth due to study participation, healthy survivor effects, aging of the participants, and/or the Hawthorne effect [3]. However, an important alternative explanation that should be considered, and can be quantified, is the phenomenon of regression to the mean [4]. "
    [Show abstract] [Hide abstract]
    ABSTRACT: Reductions in risk behaviors are common following enrollment in human immunodeficiency virus (HIV) prevention studies. We develop methods to quantify the proportion of change in risk behaviors that can be attributed to regression to the mean versus study participation and other factors. A novel model that incorporates both regression to the mean and study participation effects is developed for binary measures. The model is used to estimate the proportion of change in the prevalence of "unprotected sex in the past 6 months" that can be attributed to study participation versus regression to the mean in a longitudinal cohort of women at risk for HIV infection who were recruited from ten U.S. communities with high rates of HIV and poverty. HIV risk behaviors were evaluated using audio computer-assisted self-interviews at baseline and every 6 months for up to 12 months. The prevalence of "unprotected sex in the past 6 months" declined from 96% at baseline to 77% at 12 months. However, this change could be almost completely explained by regression to the mean. Analyses that examine changes over time in cohorts selected for high- or low- risk behaviors should account for regression to the mean effects. Copyright © 2015 Elsevier Inc. All rights reserved.
    Annals of epidemiology 03/2015; 25(6). DOI:10.1016/j.annepidem.2015.03.013 · 2.00 Impact Factor
  • Source
    • "While previous studies have indicated a predilection for CAL(Computer assisted learning) by students but the conversion into measurable outcomes in terms of good clinical grades is not always proportional to their preference (Gathy P et al,1991) (Kulik CC et al, 1991)(HandlerTJ et al, 1995). The educational background of students (McCarney et al., 2007), their inclination to learn, along with their manual dexterity are all factors that play a role in the comprehension of clinical teaching and propensity towards good clinical practice. The bias with respect to age have also been explored in previous studies that have reported the response rates with final year students to be less than in first year and second year students (Plasschaert A J et al,1995). "
    [Show abstract] [Hide abstract]
    ABSTRACT: Abstract Introduction: The multi-faceted nature of technology enhanced learning or E learning and its associated teaching methods includes computer-based simulators, digital interactive video, computer-based training, “intelligent tutoring systems”, digital slideshows and video presentations. They may be useful for enriching the versatility of methods imparting education, applicable in dentistry currently but whether they may serve as a replacement for conventional clinical teaching modules is still a dilemma. Objectives: To compare the effectiveness of video-based presentation (VBT) versus conventional “hands on” practical demonstration (HPD) for teaching two different clinical procedures in dentistry. Method: Sample consisted of 45 final year dental students from a government dental institute in Delhi that were divided in 3 groups of 15 students each. Group 1 and 2 were instructed to take impressions of upper and lower arches of patients respectively, after being taught by two different teaching methods: 1. Video-based teaching using a computer based video (VBT). 2. Hands on‟ practical demonstration with instructions (HPD). Group 3 was given a directive to study impression taking from a standard textbook for an hour followed by clinical step of impression taking of patients for both the arches. The data obtained was then analyzed inductively to enable key themes to emerge based on two tools: 1. Single instructor evaluation of impression taking of upper and lower arches by students based on objective grading system (A-very good, B-good, C- average, D- not good). 2. Assessment of learner acceptance and satisfaction where respondents were required to indicate their agreement or disagreement with 10 scale items on a five-point Likert-type scale. The responses for the five-point scale were: strongly agree (5), agree (4), don’t know(3), disagree (2) and strongly disagree (1). Statistical analysis would be performed to evaluate efficacy of either of the two teaching modalities used in group 1 and 2 when compared to a control (group 3) where no teaching instructions were given. Results: Objective assessment revealed grade A seen maximum in HPD(26.67%) while grade D was seen maximum in control group (60%). Amongst the teaching groups, HPD proved to be slightly more effective than VBT. Keywords: Video-based teaching, “hands on” practical demonstration, clinical impression taking
    International education conference, Jamia Miliia Islamia, New Delhi; 02/2015
Show more