ArticlePDF Available

What if there were no significance tests?

Authors:
... Some classic references criticizing standard hypothesis testing include Boring (1919), Berkson (1938Berkson ( , 1942, Rozeboom (1960), Meehl (1967Meehl ( , 1978, and Carver (1978). More recently, some support the continued usage of significance testing (Abelson, 1997;Hagan, 1997Hagan, , 1998Harris, 1997;McLean & Ernest, 1998), while others desire a greater reliance on alternatives such as confidence intervals or effect sizes (Cohen, 1992(Cohen, , 1994Knapp, 1998Knapp, , 2002Meehl, 1997;Serlin, 2002;Thompson, 1998Thompson, , 2001Vacha-Haase, 2001), and still others advocate an outright ban on significance testing (Carver, 1993;Falk, 1998;Nix & Barnette, 1998;Schmidt & Hunter, 1997). ...
Article
Equivalence testing, an alternative to testing for statistical significance, is little used in educational research. Equivalence testing is useful in situations where the researcher wishes to show that two means are not significantly different. A simulation study assessed the relationships between effect size, sample size, statistical significance, and statistical equivalence.
Article
Representational competence is a target of novel learning environments given the assumption that improved representational competence improves learning in science. There exists little evidence, however, that improving representational competence is positively correlated with learning outcomes across science disciplines. In this report, we argue that the previously reported weak relationships between representational competence and science learning outcomes have resulted from designs that do not explicitly analyze the discipline‐specific skills related to the representational competence construct. Here, we demonstrate through a detailed analysis of students' representation use that at least two demonstrated skills comprising representational competence (e.g., construction and selection) are not strongly related to improved conceptual understanding in the domain. We discuss the implications of these results for the design of future learning environments that aim to improve learning through improved representational competence.
Article
Recently, a series of experiments demonstrated that direct stimulation of the olfactory system by means of an odor inhaler targets brain areas associated with stress reduction and pain relief. This paper follows up on these findings and investigates whether such effects can also be found for inhalers specially designed to increase attention and concentration. In a three-armed, randomized, controlled experiment participants' cognitive ability to discriminate between similar visual stimuli was tested either with or without the use of an odor inhaler. Concentration, visual scanning speed, and accuracy were assessed to gauge differential effects. Both odor inhalers outperformed the control condition where no odor was used. The effects were large and showed in all parameters. The direct application of specially designed essential oil compositions enhances attention and concentration when used during short-term breaks in a stressful and attention-demanding cognitive task.
Article
In recent years, aromatherapy has become increasingly popular for clinical treatment and therapeutic management of both acute and chronic stress. It targets distinct and unique neurobiological characteristics of the olfactory system, which is tightly linked to emotions and information processing as well as the autonomous nervous system. Yet, depending on the mode of application, aromatherapeutic interventions show varying degrees of therapeutic effectiveness. In a series of five experiments, the effects of a new mode of aromatherapeutic application (inhaler) was investigated, which is specifically designed to directly stimulate the olfactory system and to reduce the activity of the sympathetic nervous system. Overall, the application of the inhaler showed consistent and large psychological and physiological effects. It also clearly outperformed other stress management techniques, like progressive muscle relaxation, Bach flowers or passive resting periods (natural control). The effects occurred shortly after very few inhalations, drastically reduced stress related biomarkers (i.e. blood pressure, heart rate and cortisol) and considerably enhanced well-being. Copyright © 2015 John Wiley & Sons, Ltd. Copyright © 2015 John Wiley & Sons, Ltd.
Article
Full-text available
Objective According to a series of recent meta‐analyses and systematic reviews, aromatherapy has shown to be effective in treating patients with different medical conditions. However, many of the clinical studies are of rather low methodological quality. Moreover, there is much conceptual ambiguity with regard to what aromatherapy actually constitutes. Method In this paper, we discuss the conditions under which aromatherapy is most likely to be of medical value by outlining the workings of the olfactory system and the necessary requirements of odors to be therapeutic. We then introduce an aromatherapeutic inhaler that was tested in a series of studies involving 465 participants. Results This inhaler (AromaStick®) produced large to very large effects across a variety of physiological target systems (e.g., cardiovascular, endocrine, blood oxygenation, and pain), both short term and long term. Discussion Inhalation of volatile compounds from essential oils yields almost immediate, large, and clinically relevant effects as long as the scents are delivered highly concentrated from an appropriate device. The changes caused in the body seem side effect‐free and can be sustained when inhalation is repeated.
Article
Full-text available
Minority sexual orientation may add additional stresses to the period of adolescence thus affecting mental health and wellbeing. The whole population of year 10 students in 2006, 2010, and 2014 in Iceland were surveyed as part of the Health Behaviour in School-aged Children Survey. Sexual orientation could be identified in 1,994 participants from 2006 (43.8% of population; 988 girls), 3,777 from 2010 (78.6%; 1,863 girls) and 3,526 in 2014 (80.1%; 1,731 girls). About 3.1%, 3.6%, and 4.4% were identified as lesbian, gay, or bisexual (LGB) in 2006, 2010, and 2014, respectively. Given the sampling proportions, the results reflect parameters (population values) rather than statistics (sample values). LGB adolescents were worse off across most of the psychosocial measures across the three surveys as compared with adolescents of unknown sexual orientation (USO). However, the gap between LGB and USO adolescents appears to be closing, at least for the 2010 to 2014 change, suggesting that outcomes for LGB adolescents have improved compared to four years earlier. Social support, liking school and one's classmates, being bullied, and physical and mental health all seem to play an important part in life satisfaction and general wellbeing. While advances have been made for LGB adolescents, gaps between LGB and USO adolescents still exist and need to be closed through evidence-based school and society-wide programs.
Article
The present study used a randomized controlled research design to test an adaptation of the gratitude letter-writing-and-visit intervention, using notes instead of letters and instant communication technology instead of personal visits, for the purposes of improving college students (N = 115) mental health. The gratitude-based intervention condition was tested in comparison to two active control conditions, one using instant communication technology to send notes to others regarding something they learned recently and another that privately journaled about something they learned recently. Participants in all conditions were instructed to engage in the exercise three times a day for two weeks. Results indicated that, compared to the active control conditions, the gratitude-based intervention had greater positive effects on optimism and school connectedness, but that it also had small iatrogenic effects on depression and gratitude. Furthermore, findings indicated that both active control conditions showed positive effects across several subjective wellbeing and psychological distress indicators. Implications for future research and practice for promoting college students’ mental health are discussed.
Article
It has long been assumed that science is self-correcting and that lack of reproducibility or even fraud will be uncovered in subsequent attempts to replicate observations or experiments. Recent studies have cast doubt on that assumption, which is a central tenet of scientific method, even for research that is published in high-impact journals and uses state-of-the-art methodology. Ironically, endodontic research, like most biomedical research, is moving toward highly sophisticated procedures such as gene arrays and proteomics, which are often plagued by false positives and false negatives. This “reproducibility crisis” is thought to arise from many sources including poorly described methodology, inappropriate statistical analysis, the positive bias for article acceptance by journals, the lack of incentives to repeat experiments, and the hypercompetitive research environment that pressures investigators to publish quickly in impact journals. This article outlines the scope of the reproducibility crisis and some of the steps that may be used to ameliorate it. Attention is focused on common statistical errors and pitfalls, the use of confidence intervals in place of the standard Null Hypothesis Statistical Testing (NHST), and the promise of Bayesian statistics in endodontic research.
Article
L’utilisation des intervalles de confiance au lieu des tests de signification est fortement conseillée dans la cinquième édition du manuel de publication de l’ American Psychological Association (2001). Cette possibilité ainsi que d’autres améliorations souhaitables dans les pratiques statistiques sont discutées à la lumière des grandes options théoriques sous-tendant l’inférence statistique et de la manière dont elles ont été traduites dans la pratique de la recherche en psychologie depuis une cinquantaine d’années. La suggestion d’une mise au ban complète de l’approche par les tests de signification est examinée puis rejetée. Ensuite, une démarche consistant à mettre en opposition des interprétations alternatives des données et à évaluer laquelle est la plus plausible par le calcul d’un rapport de vraisemblance est jugée intéressante et recommandable. Enfin, la richesse plus grande de l’approche par les intervalles de confiance par rapport à l’approche par les tests de signification est mise en évidence et illustrée par son application à une recherche visant à déceler l’absence plutôt que la présence d’un effet de la variable indépendante étudiée.
ResearchGate has not been able to resolve any references for this publication.