Sample size planning for the standardized mean difference: Accuracy in parameter estimation via narrow confidence intervals

Indiana University Bloomington, Bloomington, Indiana, United States
Psychological Methods (Impact Factor: 4.45). 01/2007; 11(4):363-85. DOI: 10.1037/1082-989X.11.4.363
Source: PubMed

ABSTRACT Methods for planning sample size (SS) for the standardized mean difference so that a narrow confidence interval (CI) can be obtained via the accuracy in parameter estimation (AIPE) approach are developed. One method plans SS so that the expected width of the CI is sufficiently narrow. A modification adjusts the SS so that the obtained CI is no wider than desired with some specified degree of certainty (e.g., 99% certain the 95% CI will be no wider than omega). The rationale of the AIPE approach to SS planning is given, as is a discussion of the analytic approach to CI formation for the population standardized mean difference. Tables with values of necessary SS are provided. The freely available Methods for the Behavioral, Educational, and Social Sciences (K. Kelley, 2006a) R (R Development Core Team, 2006) software package easily implements the methods discussed.

  • Source
  • [Show abstract] [Hide abstract]
    ABSTRACT: When planning to conduct a study, not only is it important to select a sample size that will ensure adequate statistical power, often it is important to select a sample size that results in accurate effect size estimates. In cluster-randomized designs (CRD), such planning presents special challenges. In CRD studies, instead of assigning individual objects to treatment conditions, objects are grouped in clusters, and these clusters are then assigned to different treatment conditions. Sample size in CRD studies is a function of 2 components: the number of clusters and the cluster size. Planning to conduct a CRD study is difficult because 2 distinct sample size combinations might be associated with similar costs but can result in dramatically different levels of statistical power and accuracy in effect size estimation. Thus, we present a method that assists researchers in finding the least expensive sample size combination that still results in adequate accuracy in effect size estimation. Alternatively, if researchers have a fixed budget, they can select the sample size combination that results in the most precise estimate of effect size. A free computer program that automates these procedures is available. (PsycINFO Database Record (c) 2014 APA, all rights reserved).
    Psychological Methods 07/2014; 19(3). DOI:10.1037/a0037036 · 4.45 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Recent events have led psychologists to acknowledge that the inherent uncertainty encapsulated in an inductive science is amplified by problematic research practices. This article provides a practical introduction to recently developed statistical tools that can be used to deal with these uncertainties when performing and evaluating research. In part 1, we discuss the importance of accurate and stable effect size estimates, and how to design studies to reach a corridor of stability around effect size estimates. In part 2, we explain how, given uncertain effect size estimates, well-powered studies can be designed using sequential analyses. In part 3, we explain what p-values convey about the likelihood that an effect is true, illustrate how the v statistic can be used to evaluate the accuracy of individual studies, and how the evidential value of multiple studies can be examined using a p-curve analysis. We end by discussing the consequences of incorporating our recommendations in terms of a reduced quantity, but increased quality of the research output. We hope the practical recommendations discussed in this article will provide researchers with the tools to make important steps towards a psychological science that allows us to differentiate between all possible truths based on their likelihood.

Full-text (2 Sources)

Available from
May 15, 2014