Figure - uploaded by Carl B. Gacono
Content may be subject to copyright.
Five methodological criteria analysis for validation studies only (N = 104)

Five methodological criteria analysis for validation studies only (N = 104)

Source publication
Article
Full-text available
Exner’s (1995a) Issues and Methods in Rorschach Research provided a standard of care for conducting Rorschach research; however, the extent to which studies have followed these guidelines has not been examined. Similarly, meta-analytic approaches have been used to comment on the validity of Exner’s Comprehensive System (CS) variables without an eva...

Contexts in source publication

Context 1
... validation studies are more appropriate for meta-analyses, the 104 studies were analyzed with the same criteria used for all 210 articles (see Table 3 and Table 4). After these analyses, the counterintuitive finding operationalization was used with the 104 validation studies. ...
Context 2
... validation studies are more appropriate for meta-analyses, the 104 studies were analyzed with the same criteria used for all 210 articles (see Table 3 and Table 4). After these analyses, the counterintuitive finding operationalization was used with the 104 validation studies. ...

Similar publications

Article
Full-text available
Previous research has questioned the use of mosques as points of entry for research about Muslims in Europe. Part of the background has been a new emphasis on lived religion and a critique of a one-sided focus on religious institutions. We argue that some of this criticism is theoretically ill-founded and we also point out that some trends may make...

Citations

... Therefore, it is not recommended the findings be compared to males in medium-security prisons. 8 Protocols were excluded for PAI scores of INF > 74, ICN > 73, and/or NIM > 76 (Morey, 1991) or on the Rorschach, low IQ (< 80) and/or less than 14 responses (Exner, 2003;Smith, Gacono, Fontan et al., 2018;Smith et al., 2020). One was removed for an extreme number of Rorschach responses (R ¼ 90). ...
Article
Full-text available
Managing the incarcerated population is the primary task within correctional settings. Using psychological assessment to predict institutional behavior, the psychologist has a unique set of skills essential to the management of prisoners. PCL-R, PAI, and Rorschach data were compared with institutional infractions (total, physical, verbal, non-aggressive) among 126 incarcerated women. Multiple binary logistic regression analyses were used which found significant correlations between PCL-R total score, PAI scales (BOR, ANT, VPI), and Rorschach variables (ROD, EGOI, TCI, AgPot, AgPast, SumV, SumC’, MOR) with total, verbal, physical, and nonviolent incident reports. Each of these measures adds incrementally to the assessment and understanding of institutional misbehavior for incarcerated women. Clinical implications of the findings were presented.
... Assessing the current psychopathy literature makes one realize that a plethora of largely unchallenged biases, unsound methodology, and faulty conclusions predominate the landscape Gacono, 2016;Smith et al., 2021). These poorly designed studies become part of meta-analytic ones, which add conflicting findings to an already confusing literature (Cunliffe et al., 2012;Gacono, 2019;Smith, Gacono, Fontan, et al., 2018. Taken together, disparate findings-artifacts of poor research-create "apparent controversies," which lead to "pseudo-debates," and add to the "armchair quality" of the Psychopathy Checklist-Revised (PCL-R; Hare, 2003) literature (Gacono, 2016(Gacono, , 2019(Gacono, , 2021Hare, 1998). ...
... This is especially critical for meta-analytic studies that hide the internal validity issues of individual studies within a group of studies where the flawed designs are glossed over with the glitter of statistical analysis (Gacono, 2019). As we have done for two Rorschach meta-analyses (Mihura et al., 2013;Wood et al., 2010), individual studies must be examined related to potential internal validity issues (Cunliffe et al., 2012;Smith, Gacono, Fontan, et al., 2018. The journal review process is also impacted by a partial understanding of the issues and misinformation created by these studies. ...
... Criterion 3: Were the appropriate statistics used? Though there is no accepted value for sample size, it has been suggested that less than 20 is problematic (Smith, Gacono, Fontan et al., 2018. This study had 16 male offenders with PCL: SV ≥13 (n = 5; 13-17), with only 11 scoring 18 or above (possible psychopaths with PCL-R ≥ 30), compared to a control sample of 35. ...
Article
Full-text available
Recently in Psychoanalytic Psychology, Gullhaugen et al. (2021) proposed a Dynamic Model of Psychopathy (DMP) to better understand psychopathic traits. Several issues with the authors' methodology, including the use of the Psychopathy Checklist: Screening Version (PCL: SV) as an independent measure and a small sample size (N = 16) relative to their conceptual approach and the number of statistical analyses conducted, limit the conclusions that can be drawn from their data. Additionally, the authors discuss their findings as if the data from this study with all males could apply to women. In this article, we use the methodological issues presented in the Gullhaugen study to discuss problems with the broader psychopathy literature. We also provide a psychodynamic model of psychopathy consistent with theory and empirical data.
... Assessing the current psychopathy literature makes one realize that a plethora of largely unchallenged biases, unsound methodology, and faulty conclusions predominate the landscape Gacono, 2016;Smith et al., 2021). These poorly designed studies become part of meta-analytic ones, which add conflicting findings to an already confusing literature (Cunliffe et al., 2012;Gacono, 2019;Smith, Gacono, Fontan, et al., 2018. Taken together, disparate findings-artifacts of poor research-create "apparent controversies," which lead to "pseudo-debates," and add to the "armchair quality" of the Psychopathy Checklist-Revised (PCL-R; Hare, 2003) literature (Gacono, 2016(Gacono, , 2019(Gacono, , 2021Hare, 1998). ...
... This is especially critical for meta-analytic studies that hide the internal validity issues of individual studies within a group of studies where the flawed designs are glossed over with the glitter of statistical analysis (Gacono, 2019). As we have done for two Rorschach meta-analyses (Mihura et al., 2013;Wood et al., 2010), individual studies must be examined related to potential internal validity issues (Cunliffe et al., 2012;Smith, Gacono, Fontan, et al., 2018. The journal review process is also impacted by a partial understanding of the issues and misinformation created by these studies. ...
... Criterion 3: Were the appropriate statistics used? Though there is no accepted value for sample size, it has been suggested that less than 20 is problematic (Smith, Gacono, Fontan et al., 2018. This study had 16 male offenders with PCL: SV ≥13 (n = 5; 13-17), with only 11 scoring 18 or above (possible psychopaths with PCL-R ≥ 30), compared to a control sample of 35. ...
Article
Full-text available
Erratum--please note on page 116, the total score of 34 should be 37. Also, the text should read "might receive" instead of receive, accounting for the potential individual items scoring.
... To overcome these biases and to broaden the somewhat narrowed symptom-focused view of mental disorders, psychological scientists have been trying for decades to assess hidden psychological constructs and personality patterns through indirect projective psycho-diagnostic tools, such as the Rorschach test or the Thematic Apperception Test (TAT) (Groth-Marnat, 2009). However, these tools are often being criticized as having poor inter-rater reliability and poor criterion validity, and their usage in clinical/research settings is controversial (Groth-Marnat, 2009;Lilienfeld et al., 2001;Smith et al., 2018). Moreover, such indirect tools are applied only sparingly, among a small portion of the population because they require large investments of time and money. ...
Article
Full-text available
Suicide, a leading cause of death, is a complex and a hard-to-predict human tragedy. In this article, we introduce a comprehensive outlook on the emerging movement to integrate computational linguistics (CL) in suicide prevention research and practice. Focusing mainly on the state-of-the-art deep neural network models, in this “travel guide” article, we describe, in a relatively plain language, how CL methodologies could facilitate early detection of suicide risk. Major potential contributions of CL methodologies (e.g., word embeddings, interpretational frameworks) for deepening that theoretical understanding of suicide behaviors and promoting the personalized approach in psychological assessment are presented as well. We also discuss principal ethical and methodological obstacles in CL suicide prevention, such as the difficulty to maintain people’s privacy/safety or interpret the “black box” of prediction algorithms. Ethical guidelines and practical methodological recommendations addressing these obstacles are provided for future researchers and clinicians.
... To overcome these biases and to broaden the somewhat narrowed symptom-focused view of mental disorders, psychological scientists have been trying for decades to assess hidden psychological constructs and personality patterns through indirect projective psycho-diagnostic tools, such as the Rorschach test or the Thematic Apperception Test (Groth-Marnat, 2009). However, these tools are often criticized as having poor interrater reliability and poor criterion validity, and their usage in clinical/research settings is controversial (Groth-Marnat, 2009;Lilienfeld et al., 2001;Smith et al., 2018). Moreover, such indirect tools are applied only sparingly, among a small portion of the population, because they require large investments of time and money. ...
Preprint
Suicide, a leading cause of death, is a complex and a hard-to-predict human tragedy. This article introduces a comprehensive outlook on the emerging movement to integrate Computational Linguistics (CL) in suicide prevention research and practice. Focusing mainly on the state-of-the-art Deep Neural Network models, this "travel guide" article describes, in a relatively plain language, how CL methodologies could facilitate early detection of suicide risk (section 1). Major potential contributions of CL methodologies (e.g., word embeddings, interpretational frameworks) for deepening our theoretical understanding of suicide behaviors (section 2) and promoting the personalized approach in psychological assessment (section 3), are presented as well. Importantly, the article also discusses principal ethical (section 4) and methodological (section 5) obstacles in CL-suicide prevention, such as the difficulty to maintain peoples' privacy/safety or interpret the "black box" of prediction algorithms. Ethical guidelines and practical methodological recommendations addressing these obstacles, are provided for future researchers and clinicians.
... The Rorschach Comprehensive System (CS; Exner, 1974Exner, , 2003 can be controversial but is still a frequently used evaluation method in clinical practice (Wright et al., 2017). It also continues to be refined in the research context (Smith et al., 2018). ...
Article
The administration process of the Rorschach test is of utmost importance as it influences both the coding and the interpretative procedures. Performing it appropriately requires complex skills, knowledge, and solid training. The aim of the study is to describe students’ interests in and difficulties with administering the Rorschach (Comprehensive System) for the first time. A two-phase methodology, including an analysis of questionnaire responses followed by a study of students’ written narratives, using Iramuteq textual analysis software, was implemented with two different samples of third-year undergraduates (including 63 and 253 participants, respectively), recruited from a French psychology school. Our results show that students have a strong interest in understanding the test and wish to use it in their future practice. When administering the Rorschach for the first time, students find it difficult to cope with the complexity of the procedures at a technical, emotional, and relational level.
... Besides the problem with including low R studies in this type of analyses it should be noted that R-PAS instructions would preclude these protocols from being produced (push for 2 and pull after 4; Meyer et al., 2011). Smith et al. (2018) also found that of the 210 studies in the Mihura et al. (2013) meta-analyses, only 104 of the 210 (49.5%) studies were research on the Rorschach (validation studies). None met all five Rorschach criteria assessed (appropriate interrater reliability, R, Lambda, sample size, & IQ/educational level). ...
... In the interest of clarifying some of the issues with the R-PAS, we requested that the data from the Mihura et al. (2013) study be shared with us so that we might verify the hypothesized Rorschach predictor-criterion associations database, validity coefficients decisions, and interrater reliability for the predictor-criterion associations . As Mihura noted in her commentary (2019, p. 179), in the spirit of ethical guidelines and scientific cooperation, we provided her with our data from Smith et al. (2018) for her review and analysis. However, we were denied access to her meta-analyses data. ...
Article
Full-text available
It is essential to understand that CS validity research does not translated directly to the R-PAS. In this article we dicuss essential issues to consider prior to using the R-PAS in an applied context.
... (Shipley & Zachary, 1986). It is important to utilize a cognitive measure concurrent to the Rorschach as low IQ and other issues can contribute to the production of constricted Rorschach protocols (Gacono, 2019;Gacono & Gacono, 2008;Smith, Gacono, Fontan, et al., 2018;Smith, et al., 2020). ...
Article
Full-text available
The histories of incarcerated women exhibit a multitude of personality issues including psychopathy, trauma, and interpersonal dependency. Two studies were undertaken to better understand these issues with psychopathic (PCL-R ≥ 30; N = 115) and non-psychopathic (PCL-R ≤ 24; N = 53) women incarcerated for drug, theft, fraud, violence, and sex offenses. In the first study, trauma symptoms were compared on Rorschach variables, TSI-2, and PAI scales. The female psychopathic group experienced more problems related to intrusive experiences and dissociation (TSI-2, Rorschach). In the second study, interpersonal dependency was also examined with the PAI, TSI-2, and Rorschach. The psychopathic females had higher rates of interpersonal dependency (PAI, Rorschach). Based on our findings we discuss the relationship between trauma and interpersonal dependency and the meaning of these testing variables and concepts within the personality functioning of these antisocial women.
... Moreover, the quality of a meta-analysis and the trustworthiness of its conclusions are only as strong as the individual studies used to generate them (Cunliffe et al., 2012;Smith et al., 2018). There is other pertinent literature relevant to the GA's central argument of the PCL-R's predictive validity for institutional violence. ...
... We are concerned that the SoC did not provide a full presentation or accurate description of the evidence from these four meta-analyses, all of which generated similar findings and conclusions. Moreover, the quality of a meta-analysis and the trustworthiness of its conclusions are only as strong as the individual studies used to generate them (Cunliffe et al., 2012;Smith et al., 2018). There is other pertinent literature relevant to the GA's central argument of the PCL-R's predictive validity for institutional violence. ...
Preprint
Full-text available
Comprehensive reply to DeMatteo et al. 2020 in Psychology, Public Policy & Law provides evidence for the reliability and validity of the PCL-R in the assessment of risk for institutional violence.