ArticlePublisher preview available

Perils and pitfalls of reporting sex differences

The Royal Society
Philosophical Transactions B
Authors:
To read the full-text of this research, you can request a copy directly from the author.

Abstract

The idea of sex differences in the brain both fascinates and inflames the public. As a result, the communication and public discussion of new findings is particularly vulnerable to logical leaps and pseudoscience. A new US National Institutes of Health policy to consider both sexes in almost all preclinical research will increase the number of reported sex differences and thus the risk that research in this important area will be misinterpreted and misrepresented. In this article, I consider ways in which we might reduce that risk, for example, by (i) employing statistical tests that reveal the extent to which sex explains variation, rather than whether or not the sexes 'differ', (ii) properly characterizing the frequency distributions of scores or dependent measures, which nearly always overlap, and (iii) avoiding speculative functional or evolutionary explanations for sex-based variation, which usually invoke logical fallacies and perpetuate sex stereotypes. Ultimately, the factor of sex should be viewed as an imperfect, temporary proxy for yet-unknown factors, such as hormones or sex-linked genes, that explain variation better than sex. As scientists, we should be interested in discovering and understanding the true sources of variation, which will be more informative in the development of clinical treatments.
rstb.royalsocietypublishing.org
Opinion piece
Cite this article: Maney DL. 2016 Perils and
pitfalls of reporting sex differences. Phil.
Trans. R. Soc. B 371: 20150119.
http://dx.doi.org/10.1098/rstb.2015.0119
Accepted: 15 November 2015
One contribution of 16 to a theme issue
‘Multifaceted origins of sex differences in the
brain’.
Subject Areas:
behaviour, neuroscience
Keywords:
gender differences, male, female,
sex differences in the brain,
US National Institutes of Health policy
Author for correspondence:
Donna L. Maney
e-mail: dmaney@emory.edu
Electronic supplementary material is available
at http://dx.doi.org/10.1098/rstb.2015.0119 or
via http://rstb.royalsocietypublishing.org.
Perils and pitfalls of reporting
sex differences
Donna L. Maney
Department of Psychology, Emory University, Atlanta, GA 30322, USA
The idea of sex differences in the brain both fascinates and inflames the public.
As a result, the communication and public discussion of new findings is par-
ticularly vulnerable to logical leaps and pseudoscience. A new US National
Institutes of Health policy to consider both sexes in almost all preclinical
research will increase the number of reported sex differences and thus the
risk that research in this important area will be misinterpreted and misrepre-
sented. In this article, I consider ways in which we might reduce that risk,
for example, by (i) employing statistical tests that reveal the extent to which
sex explains variation, rather than whether or not the sexes ‘differ’, (ii) properly
characterizing the frequency distributions of scores or dependent measures,
which nearly always overlap, and (iii) avoiding speculative functional orevol-
utionary explanations for sex-based variation, which usually invoke logical
fallacies and perpetuate sex stereotypes. Ultimately, the factor of sex should
be viewed as an imperfect, temporary proxy for yet-unknown factors, such
as hormones or sex-linked genes, that explain variation better than sex. As
scientists, we should be interested in discovering and understanding the
true sources of variation, which will be more informative in the development
of clinical treatments.
1. Introduction
Sex differences in the brain have made headlines for more than a century. In
1912, James Crichton-Browne, a prominent neuropsychologist and collaborator
of Darwin, explained in a New York Times article why ‘women think quickly’
and ‘men are originators’:
In woman, Sir James said, the posterior region of the brain receives a richer flow of
arterial blood, in men the anterior region. The work of the two regions of the brain
is different. The posterior region is mainly sensory and concerned with seeing and
hearing. The anterior region includes the speech centre, the higher inhibitory centres,
which are concerned with will, and the association centres, concerned with appetites
and desires based upon internal sensations.
There is, Sir James thinks, a correspondence between the richer blood supply of the
posterior region of the brain in women and their delicate powers of sensuous percep-
tion, rapidity of thought and emotional sensibility, and between the richer blood
supply of the anterior region in men and their greater originality on higher levels
of intellectual work, their calmer judgment and their stronger will [1, p. 4].
Although we may find such revelations archaic and even a bit offensive, the same
type of thinking remains prevalent today. News reports and information-based
websites such as Wikipedia, WedMD and HowStuffWorks.com contain an alarm-
ing amount of pseudoscience. It is commonly asserted, for example, that women
listen with both sides of the brain, whereas men use only the left side [2,3] and
that women use white matter to think, whereas men use grey [4,5]. Women alleg-
edly have 10 times as much white matter as do men, whereas men have 6.5 times
as much grey matter as dowomen ([6,7], reviewed in [8]). Whereas women navigate
using cerebral cortex, men use ‘an entirely different area’ that is ‘not activated in
women’s brains’ [6]. Such assertions, although inaccurate, are easy to find on the
Internet and in the popular press.
The misrepresentation of sex differences is likely to become even more com-
monplace. Partly because of increasing availability of imaging technologies, the
percentage of journal articles that refer to sex differences and the brain has more
than doubled in the past two decades ( figure 1a). Over the same period, media
&2016 The Author(s) Published by the Royal Society. All rights reserved.
... The "Welcome to the Quagmire" unit opened the course as a unit designed to expose students to the various tricky aspects and nuances of the field. Specifically, we discussed the nuanced definitions of sex vs. gender, common pitfalls when reporting and interpreting sex differences (Maney, 2016;Garcia-Sifuentes and Maney, 2021), and a case study of science communication gone wrong (Ingalhalikar et al., 2014a(Ingalhalikar et al., , 2014bJoel and Tarrasch, 2014). The next two units focused on the hormonal and genetic influences, respectively, on the sexual differentiation of the brain. ...
... Over the next three weeks we discuss how neuroscience has framed the study of sex. We discuss the differences between sex differences and sexual dimorphisms, the framing of sex as a biological variable, and the entanglement of sex/gender (Maney, 2016;Rippon, 2019). We discuss a short essay by Fine et al. (2013) that uses feminist theory to interrogate why recent breakthroughs in neuroplasticity do not seem to have impacted traditional views and studies of "hardwired" sex differences, and the ensuing impacts on society. ...
... Gender and Our Brains (Rippon, 2019) defines key concepts in gender studies such as gender essentialism and complementarity, used as a lens through which to analyze the stated justification or interpretation of sex/gender differences in published articles. The article "Perils and Pitfalls of Reporting Sex Differences" (Maney, 2016) has been a fantastic source for the audience of this course in thinking about how and why the scientific community studies and reports sex differences, and how to improve this communication. Similar to Dr. Tan's course, we discuss Ingalhalikar et al. (2014a) and follow-up published correspondence (Joel and Tarrasch, 2014;Ingalhalikar et al., 2014b) as a case study of discourses of critique and disagreement in ways to measure and interpret sex differences in the brain. ...
Article
Courses on the neuroscience of sex and gender can support inclusive and integrative neuroscience curricula. However, developing and teaching such courses can be intimidating for educators due to the subject’s complexities and nuances, the increasingly politicized nature of the subject material, and the difficult conversations that the material invites. In this article we discuss how we approached the development of two undergraduate courses on sex, gender and the brain. In describing our thought process we discuss the institutional contexts for our courses and the rationale for the selected course structures, learning objectives, and content. We also describe how we fostered inclusive learning environments – particularly within the context of the COVID-19 pandemic – and implemented course activities and diverse assessments aligned to the course learning objectives. We hope that readers of this article can apply our insights into developing courses on sex/gender in neuroscience at their home institutions.
... Using an electronic tool (sexdifference.org) to estimate the overlap between the normal distributions in males and females, we also observed that the overlap between sexes was ∼46% for SBP and ∼68% for MAP (69). Taken alongside the large effect sizes for SBP (d = 1.58) and MAP (d = 0.87), sex differences in BP are evident. ...
... Again, using an electronic tool detailed above (69), the overlap between sexes for central PWV was ∼86% with a small effect size (r = 0.20), suggesting that while sex differences in central PWV were significant, the magnitude of difference was more subtle than BP. This is in line with some (20-22, 36, 71), but not all (73), studies that have observed sex differences in local (carotid artery) and/or systemic arterial stiffness. ...
... After performing allometric scaling analysis to account for differences in baseline artery diameter, we found that scaled %FMD was elevated in males compared to females. Using an electronic tool detailed above (69), the overlap between sexes for %FMD scaled was ∼80% with a medium effect size (d = 0.45), suggesting that while sex differences in % FMD scaled were significant the magnitude of difference between sexes was only moderately pronounced. These findings are aligned with most prior %FMD (unscaled) research finding greater %FMD in females (12,14,70,82,83), and prior research from our lab finding %FMD (scaled) is greater in males (14). ...
Article
Full-text available
Background Sex differences exist in cardiovascular disease risk factors including elevated blood pressure and arterial stiffness, and decreased endothelial function in males compared to females. Feminine gender expression may be associated with elevated risk of acute coronary syndrome. However, no study has investigated the associations between sex, gender identity, and gender expression and cardiovascular disease risk factors in young adults. Methods One hundred and thirty participants (22 ± 3 years) underwent assessments of hemodynamics, arterial stiffness [pulse wave velocity (PWV)], and brachial artery endothelial function (flow-mediated dilation; %FMD). Participants completed a questionnaire capturing sex category (50 male/80 female), gender identity category (49 men/79 women/2 non-binary), and aspects of gender expression assessed by the Bem Sex Role Inventory-30 (39 androgynous/33 feminine/29 masculine/29 undifferentiated). Sex/gender identity category groups were compared using unpaired t-tests and gender expression groups compared using one-way ANOVAs. Results Resting systolic and mean arterial pressure (p < 0.01) were elevated in males vs. females. Central PWV was elevated in males [median (interquartile range): 6.4 (1.8) vs. 5.8 (2.2) m/s, p = 0.02]; however, leg and arm PWV were not different between sexes. %FMD was elevated in males vs. females, after accounting for a larger baseline artery diameter in males (8.8 ± 3.3% vs. 7.2 ± 3.1%, p = 0.02); since the majority of participants were cisgender, the same results were found examining gender identity (men vs. women). There were no differences across gender expression groups (p > 0.05). Conclusions Sex/gender identity category, but not gender expression, influence cardiovascular risk factors (blood pressure, arterial stiffness, endothelial function) in cisgender adults; further research is needed in gender-diverse populations.
... 2). This critique is especially pertinent to research on sex differences in the brain, where sociocultural influences are often conspicuously ignored and where findings of "biological difference" are easily abused in the public sphere to naturalize social inequalities between men and women (Fine, 2013;Maney, 2016). While sex-based medicine is often represented as a first step toward personalized medicine, it risks reifying the idea(l) of the average or typical woman by suggesting that all women share the same biomedical identity-thus setting up a norm that may prove difficult to move beyond or deconstruct again. ...
... Even though such essentialism might be used for merely strategical reasons-that is, to get women's health on the map with an apparently straightforward, common sense argument about sex differences-it goes against the long-standing recognition within feminist theory that there can be no single inclusive definition or universal experience of womanhood, be it biological or social (e.g., Crenshaw, 1989;Fausto-Sterling, 1993;Spelman, 1988;Stone, 2007). Specifically, popular phrases like "female heart attacks" or "female brains" gloss over within-group variation and between-group overlap which may be clinically just as relevant as between-group differences and tend to use sex as a proxy for other more precise predictors of health outcomes (Maney, 2016;Richardson et al., 2015;Springer et al., 2012). ...
Article
Full-text available
Alzheimer’s disease affects more women than men and has therefore been highlighted as a women’s issue. However, there is much debate regarding the nature of this gap, with some studies pointing to sex/gender differences in longevity to explain the disparity. Against this background of empirical uncertainty, we ask how online women’s brain health campaigns position women as specifically at risk of developing the disease. Using a multimodal approach, we examine how these platforms relate womanhood to risk, prevention, and responsibility. Four main themes emerged: risk quantification, risk management, risk dispersion, and the gendering of risk. We confirm previous studies that identified a dual discourse in which Alzheimer’s is represented as both a catastrophic threat and as a fate that individuals can and must prevent. We find that both constructions are intensified on women-oriented platforms compared with nonspecific websites. Ethical implications of the individualization and gendering of risk and responsibility are discussed.
... Second, for each pair of groups, we ran a random effects meta-analysis to get an estimate of the average effect size for differences between the two groups across all 38 psychological characteristics. Finally, we reported similarities between each of the pairwise comparisons since emphasizing similarities allows to quantify by how much two groups differ (Maney, 2016). We describe these steps in detail below. ...
... We used this overall mean effect size as an indicator of how different the two groups in each pair are (Table 3). Additionally, addressing calls to focus also on similarities between groups (Hanel et al., 2019;Maney, 2016), we reported the Percentage of Common Responses (PCR; Inman & Bradley, 1989) as an effect size which expresses the amount of overlap between two groups and ranges from 0 (no overlap) to 100% (perfect overlap). The PCR is a non-linear transformation of Cohen's d. ...
Article
Full-text available
We examined differences and similarities between groups sampled from the Mediterranean region in social orientation, cognitive style, self-construal, and honor, face, dignity values, and concerns using a large battery of tasks and measures. We did this by conducting secondary data set analyses focusing on comparisons between nine pairs of samples recruited from the Mediterranean region (Spain, Italy, Greece, Turkey, Cyprus [Greek and Turkish Cypriot communities], Lebanon [Muslim Lebanese and Christian Lebanese], Egypt) that have overlapping and divergent features in terms of religious, ethnic, national, and linguistic factors as well as various physical and socioecological characteristics. Across 38 different psychological characteristics, comparisons between Turkish and Turkish Cypriot samples and between Christian and Muslim samples from Lebanon revealed that they were most similar to each other. In contrast, Greek and Turkish samples were the least similar. Our analyses of intercorrelations between variables, variability, and size of differences provide additional insights into the within-region variation in social orientation, cognitive style, self-construal indicators, as well as honor, face, and dignity values and concerns. Our research contributes to the growing literature on regional variation of psychological processes while raising important pointers for the role of background and socioecological characteristics in cultural group similarities and differences.
... At the same time, increased rigor was demanded from research on this matter. However, this coincided with a revolution in scientific communication through powerful publishing platforms, new ways of scientific validation, and the massive use of social media to disseminate science (Maney, 2016). All this has had a significant disruptive effect on the way knowledge is produced and disseminated. ...
Article
Full-text available
The scientific establishment maintains a persistent belief that postulates the existence of sexual difference as an essential quality, that is, as a natural essence. This postulate further asserts that the brain is the most appropriate organ for investigating this essence. The advancement of neuroscience, coupled with the advent of neuroimaging technologies and the significant investment in brain research since the late 20th century, has generated considerable expectations in the scientific community and the general public regarding the prospects for neuroscientific research. Such circumstances may, on occasion, impede the appropriate advancement and consolidation of knowledge. A considerable number of scientific groups, laboratories, universities, research centres, private companies, large publishing groups and publishing platforms are engaged in an endeavour to unravel the great enigma of the human brain. The pursuit of sexual difference is one of the most sought-after objectives in this field of study. A number of scientists from various backgrounds have cautioned against the potential pitfalls of this approach. In this paper, I propose a critical epistemology that employs a vigilant and ongoing dialogue against the essentialism of sexual difference. I refer to this as epistemological guerrilla warfare. In this article, I present the example of neurofeminism as an instance of epistemological guerrilla warfare. The aim of this paper is to undertake a critical examination of a body of scientific research in the field of neuroscience through the use of this specific example.
Article
While the brain continues to develop during adolescence, such development may depend on sex-at-birth. However, the elucidation of such differences may be hindered by analytical decisions (e.g., covariate selection to address brain-size differences) and the typical reporting of cross-sectional data. To further evaluate adolescent cortical development, we analyzed data from the Adolescent Brain Cognitive Development Study, whose cohort of 11,000+ youth participants with biannual neuroimaging data collection can facilitate understanding neuroanatomical change during a critical developmental window. Doubly considering individual differences within the context of group-level effects, we analyzed regional changes in cortical thickness, sulcal depth, surface area, and volume between two timepoints (∼2 years apart) in 9- to 12-year-olds assigned male or female sex-at-birth. First, we conducted linear mixed-effect models to gauge how controlling for intracranial volume, whole-brain volume (WBV), or a summary metric (e.g., mean cortical thickness) influenced interpretations of age-dependent cortical change. Next, we evaluated the relative changes in thickness and surface area as a function of sex-at-birth and age. Here, we showed that WBV (thickness, sulcal depth, volume) and total cortical surface area were more optimal covariates; controlling for different covariates would have substantially altered our interpretations of overall and sex-at-birth-specific neuroanatomical development. Furthermore, we provided evidence to suggest that aggregate change in how cortical thickness is changing relative to surface area is generally comparable across those assigned male or female sex-at-birth, with corresponding change happening at slightly older ages in those assigned male sex-at-birth. Overall, these results help elucidate neuroanatomical developmental trajectories in early adolescence.
Article
Biological sex significantly influences disease presentation, progression, and therapeutic outcomes in chronic kidney disease and acute kidney injury. Sex hormones, including estrogen and testosterone, modulate key renal functions, including renal blood flow, glomerular filtration, and electrolyte transport, thereby affecting disease trajectory in a sex-specific manner. It is critical for researchers to understand why and how to integrate sex as a biological variable in data collection, analysis, and reporting. Integrating a sex-based perspective in kidney research will lead to more personalized and efficacious treatment strategies, optimizing therapeutic interventions for each sex. If addressed properly, the incorporation of sex as a biological variable (SABV) in renal research not only enhances the mechanistic understanding of renal disease, but also paves the way for precision medicine, promising improved clinical outcomes and tailored treatment protocols for all patients. This paper is designed to serve as a guideline for researchers interested in rigorously incorporating sex as a biological variable in their studies.
Article
Full-text available
Scientists must communicate about science with public audiences to promote an understanding of complex issues that we face in our technologically advanced society. Some scientists may be concerned about a social stigma or “Sagan effect” associated with participating in public communication. Recent research in the social sciences indicates that public communication by scientists is not a niche activity but is widely done and can be beneficial to a scientist’s career. There are a variety of approaches that scientists can take to become active in science communication.
Article
In 2014, the National Institutes of Health (NIH) proposed a new policy to promote “sex parity” in research. As an extension to the 1993 NIH Revitalization Act which mandated the inclusion of women and minorities in clinical trials, the new NIH policy will require scientists to include “sex” as a variable in both animal model and in vitro cell line-based research. The end goal is to ensure that NIH funded scientists “balance male and female cells and animals in preclinical studies in all future applications” (Clayton and Collins 2014, 283). The curators of this section asked four interdisciplinary scholars to discuss this proposed policy.
Article
Probably more common than all other forms of primary hormone resistance combined, androgen resistance is now known to cause many disorders. Their phenotypic spectrum ranges from complete testicular feminization in genotypic males to infertility in men who are otherwise normal. These syndromes have helped elucidate mechanisms of sexual development.
Article
Significance Sex/gender differences in the brain are of high social interest because their presence is typically assumed to prove that humans belong to two distinct categories not only in terms of their genitalia, and thus justify differential treatment of males and females. Here we show that, although there are sex/gender differences in brain and behavior, humans and human brains are comprised of unique “mosaics” of features, some more common in females compared with males, some more common in males compared with females, and some common in both females and males. Our results demonstrate that regardless of the cause of observed sex/gender differences in brain and behavior (nature or nurture), human brains cannot be categorized into two distinct classes: male brain/female brain.
Article
Towards the end of the last century, statistical reporting in medical research underwent substantial reform, with null hypothesis significance testing replaced with an estimation approach. Interestingly, this reform may have been largely motivated by the social costs of error within medical research, rather than simply scientific error per se. This chapter briefly reviews the benefits of the estimation statistical approach as a means to producing reliable information about nature and then describes how the current statistical method of null hypothesis significance testing specifically contributes to scientific error in sex/gender neuroscience. The potential social harm that can arise from such errors in this area of research is then highlighted. It is suggested that sex/gender neuroscience may therefore provide a valuable model to motivate, on ethical grounds, statistical reform within the psychological sciences.