Validity of Criteria-Based Content Analysis (CBCA) at trial in free-narrative interviews

NESMOS, Department of Neuroscience, Mental Health and Sensory Organs, Sant'Andrea Hospital, "Sapienza" University of Rome, Italy.
Child abuse & neglect (Impact Factor: 2.34). 08/2011; 35(8):613-20. DOI: 10.1016/j.chiabu.2011.04.004
Source: PubMed

ABSTRACT The reliability of child witness testimony in sexual abuse cases is often controversial, and few tools are available. Criteria-Based Content Analysis (CBCA) is a widely used instrument for evaluating psychological credibility in cases of suspected child sexual abuse. Only few studies have evaluated CBCA scores in children suspected of being sexually abused. We designed this study to investigate the reliability of CBCA in discriminating allegations of child sexual abuse during court hearings, by comparing CBCA results with the court's final, unappealable sentence. We then investigated whether CBCA scores correlated with age, and whether some criteria were better than others in distinguishing cases of confirmed and unconfirmed abuse.
From a pool of 487 child sexual abuse cases, confirmed and unconfirmed cases were selected using various criteria including child IQ≥70, agreement between the final trial outcome and the opinion of 3 experts, presence of at least 1 independent validating informative component in cases of confirmed abuse, and absence of suggestive questions during the child's testimonies. This screening yielded a study sample of 60 confirmed and 49 unconfirmed cases. The 14 item version of CBCA was applied to child witness testimony by 2 expert raters.
Of the 14 criteria tested, 12 achieved satisfactory inter-rater agreement (Maxwell's Random Error). Analyses of covariance, with case group (confirmed vs. unconfirmed) and gender as independent variables and age as a covariate, showed no main effect of gender. Analyses of the interaction showed that the simple effects of abuse were significant in both sex. Nine CBCA criteria were satisfied more often among confirmed than unconfirmed cases; seven criteria increased with age.
CBCA scores distinguish between confirmed and unconfirmed cases. The criteria that distinguish best between the 2 groups are Quantity of Details, Interactions, and Subjective Experience. CBCA scores correlate positively with age, and independently from abuse; all the criteria test except 2 (Unusual Details and Misunderstood Details) increase with age. The agreement rate could be increased by merging criteria Unusual and Superfluous details that achieve a low inter-rater agreement when investigated separately.
Given its ability to distinguish between confirmed and unconfirmed cases of suspected child abuse, the CBCA could be a useful tool for expert opinion. Because our strict selection criteria make it difficult to generalize our results, further studies should investigate whether the CBCA is equally useful in the cases we excluded from our study (for example mental retardation).

Download full-text


Available from: Stefano Ferracuti, Feb 18, 2014
355 Reads
  • [Show abstract] [Hide abstract]
    ABSTRACT: The ability to detect deception, in everyday social interactions and psychological evaluations, can literally mean the difference between life and death. Beyond physiological and nonverbal techniques for detecting deception, research has focused on criteria designed to evaluate the content of verbal statements to distinguish between true or actually experienced events versus internally manufactured or fabricated events. Criteria from two techniques that have received empirical support, criteria-based content analysis and reality monitoring, were used to create an 11-item Deception Detection Checklist (DDCL). In this study, 130 college undergraduates used the DDCL to rate the exculpatory statements of two accused child molesters: one truthful, the other untruthful. The 11 items composing the DDCL, as well as a measure of perceived truthfulness, were all scored on 7-point Likert-type scales. Nine of the 11 items on the DDCL significantly differentiated between the true and untrue statements in the predicted direction. Overall scores on the DDCL indicated that the false statement was rated as significantly more deceptive than the true statement. The DDCL possessed good reliability, and a series of factor analyses provided strong support for the construct validity of the measure. The 7 psychometrically strongest items from the DDCL included variables assessing the extent to which statements included clarity of detail, spatial details, temporal details, and contextual details, as well as the relevance, reconstructability, and realism of the statement. These results indicate that subjects were able to use this measure to reliably differentiate between true and false statements made by accused child molesters.
    SAGE Open 07/2014; 4(3). DOI:10.1177/2158244014548849