Vladimir L Cherkassky’s research while affiliated with Carnegie Mellon University and other places

What is this page?


This page lists works of an author who doesn't have a ResearchGate profile or hasn't added the works to their profile yet. It is automatically generated from public (personal) data to further our legitimate goal of comprehensive and accurate scientific recordkeeping. If you are this author and want this page removed, please let us know.

Publications (30)


Retraction Note: Machine learning of neural representations of suicide and emotion concepts identifies suicidal youth
  • Article
  • Publisher preview available

April 2023

·

243 Reads

·

2 Citations

Nature Human Behaviour

·

·

Vladimir L. Cherkassky

·

[...]

·

David Brent
View access options

Distribution of classification accuracies obtained with random permutations of group membership labels
The red lines indicate the 95% confidence interval (0.26–0.69) around the mean (0.47). The green line (0.91) indicates that the group membership classification accuracy reported in our paper is far outside the interval encompassing the randomly obtained mean value.
Discriminating locations produced by varying the number of voxels included from each participant
As the number of voxels included from each participant is increased, the discriminating locations substantially change their position, volume and shape, and the voxels used for the group membership classification become much more scattered. The red rectangle indicates the discriminating locations used in our study. The black voxels indicate the representative voxels (the five most stable voxels of each participant) selected from a discriminating location for 17 participants in the ideator (top) or control group (bottom). The union of grey and black voxels indicates the discriminating locations for the specified parameter value. The activation levels of the black voxels were used for group membership classification. The accuracy values correspond to the accuracies reported in Fig. 1 of Dukart et al.
Reply to: Towards increasing the clinical applicability of machine learning biomarkers in psychiatry

April 2021

·

68 Reads

·

1 Citation

Nature Human Behaviour



Clusters of stable voxels of the suicidal ideator group and the control group
White ellipses indicate the five discriminating locations.
Discriminating brain locations for distinguishing between suicidal ideator and control group membership.
Group separation in the multidimensional scaling of the activation features of the participants used by the classifier
Ideators (n = 17) are indicated by red circles and controls (n = 17) by blue circles. Filled circles indicate misclassifications. The scaled features (activation levels in five brain locations for six discriminating words) were computed in 32 cross-validation folds, averaged across the folds. The dashed line shows the separability of the two groups in this two-dimensional space.
Group separation in the multidimensional scaling of the activation features of the nine ideators who have attempted suicide and the eight ideators without attempts used by the classifier
Attempters (n = 9) are indicated by red circles and non-attempters (n = 8) by green circles. The features (activation levels in three brain locations for three discriminating words) were scaled in two dimensions. The dashed line shows the separability of the two groups in this two-dimensional space.
Machine learning of neural representations of suicide and emotion concepts identifies suicidal youth

October 2017

·

1,123 Reads

·

241 Citations

Nature Human Behaviour

The clinical assessment of suicidal risk would be significantly complemented by a biologically-based measure that assesses alterations in the neural representations of concepts related to death and life in people who engage in suicidal ideation. This study used machine-learning algorithms (Gaussian Naïve Bayes) to identify such individuals (17 suicidal ideators vs 17 controls) with high (91%) accuracy, based on their altered fMRI neural signatures of death and life-related concepts. The most discriminating concepts were death, cruelty, trouble, carefree, good, and praise. A similar classification accurately (94%) discriminated 9 suicidal ideators who had made a suicide attempt from 8 who had not. Moreover, a major facet of the concept alterations was the evoked emotion, whose neural signature served as an alternative basis for accurate (85%) group classification. The study establishes a biological, neurocognitive basis for altered concept representations in participants with suicidal ideation, which enables highly accurate group membership classification.


Predicting the brain activation pattern associated with the propositional content of a sentence: Modeling neural representations of events and states

June 2017

·

140 Reads

·

54 Citations

Even though much has recently been learned about the neural representation of individual concepts and categories, neuroimaging research is only beginning to reveal how more complex thoughts, such as event and state descriptions, are neurally represented. We present a predictive computational theory of the neural representations of individual events and states as they are described in 240 sentences. Regression models were trained to determine the mapping between 42 neurally plausible semantic features (NPSFs) and thematic roles of the concepts of a proposition and the fMRI activation patterns of various cortical regions that process different types of information. Given a semantic characterization of the content of a sentence that is new to the model, the model can reliably predict the resulting neural signature, or, given an observed neural signature of a new sentence, the model can predict its semantic content. The models were also reliably generalizable across participants. This computational model provides an account of the brain representation of a complex yet fundamental unit of thought, namely, the conceptual content of a proposition. In addition to characterizing a sentence representation at the level of the semantic and thematic features of its component concepts, factor analysis was used to develop a higher level characterization of a sentence, specifying the general type of event representation that the sentence evokes (e.g., a social interaction versus a change of physical state) and the voxel locations most strongly associated with each of the factors. Hum Brain Mapp, 2017. © 2017 Wiley Periodicals, Inc.


Figure 2. 
Figure 3. 
Figure 4. 
Neural representations of the concepts in simple sentences: Concept activation prediction and context effects

June 2017

·

234 Reads

·

17 Citations

NeuroImage

Although it has been possible to identify individual concepts from a concept's brain activation pattern, there have been significant obstacles to identifying a proposition from its fMRI signature. Here we demonstrate the ability to decode individual prototype sentences from readers’ brain activation patterns, by using theory-driven regions of interest and semantic properties. It is possible to predict the fMRI brain activation patterns evoked by propositions and words which are entirely new to the model with reliably above-chance rank accuracy. The two core components implemented in the model that reflect the theory were the choice of intermediate semantic features and the brain regions associated with the neurosemantic dimensions. This approach also predicts the neural representation of object nouns across participants, studies, and sentence contexts. Moreover, we find that the neural representation of an agent-verb-object proto-sentence is more accurately characterized by the neural signatures of its components as they occur in a similar context than by the neural signatures of these components as they occur in isolation.


Figure 1. Illustration of stimulus presentation.
Figure 2. Consistently selected brain regions that support cross-participant thematic role decoding. The two regions highlighted with circles are regions or are adjacent to regions that have been previously identified for representing thematic role information. [To view this figure in colour, please see the online version of this Journal.]
Brain regions that support cross-participant thematic role decoding.
Identifying thematic roles from neural representations measured by functional magnetic resonance imaging

June 2016

·

86 Reads

·

32 Citations

Cognitive Neuropsychology

The generativity and complexity of human thought stem in large part from the ability to represent relations among concepts and form propositions. The current study reveals how a given object such as rabbit is neurally encoded differently and identifiably depending on whether it is an agent (“the rabbit punches the monkey”) or a patient (“the monkey punches the rabbit”). Machine-learning classifiers were trained on functional magnetic resonance imaging (fMRI) data evoked by a set of short videos that conveyed agent–verb–patient propositions. When tested on a held-out video, the classifiers were able to reliably identify the thematic role of an object from its associated fMRI activation pattern. Moreover, when trained on one subset of the study participants, classifiers reliably identified the thematic roles in the data of a left-out participant (mean accuracy = .66), indicating that the neural representations of thematic roles were common across individuals.


Modality-independent representations of small quantities based on brain activation patterns

January 2016

·

132 Reads

·

23 Citations

Machine learning or MVPA (Multi Voxel Pattern Analysis) studies have shown that the neural representation of quantities of objects can be decoded from fMRI patterns, in cases where the quantities were visually displayed. Here we apply these techniques to investigate whether neural representations of quantities depicted in one modality (say, visual) can be decoded from brain activation patterns evoked by quantities depicted in the other modality (say, auditory). The main finding demonstrated, for the first time, that quantities of dots were decodable by a classifier that was trained on the neural patterns evoked by quantities of auditory tones, and vice-versa. The representations that were common across modalities were mainly right-lateralized in frontal and parietal regions. A second finding was that the neural patterns in parietal cortex that represent quantities were common across participants. These findings demonstrate a common neuronal foundation for the representation of quantities across sensory modalities and participants and provide insight into the role of parietal cortex in the representation of quantity information. Hum Brain Mapp, 2016. © 2016 Wiley Periodicals, Inc.


Fig. 1 Significant clusters of within-group results for the contrast theory-of-mind vs. random animation (ToM > RD) for the a TD group, b ASD group, and c Human Connectome Project map ( p < 0.05, FWE corr.) 
Fig. 2 Significant clusters of between-group differences (TD > ASD) for the contrast theory-of-mind vs. random (ToM > RD; p < 0.05, FWE corr.), with dot plots showing individual data points for both TD and ASD groups 
Table 2 Group differences in fMRI BOLD activation for ToM vs. random animation and GD vs. random animation (whole-brain analysis)
Fig. 3 a Correlation matrix showing connectivity among frontal, medial, temporal, parietal, and cerebellum networks during ToM condition. Bar graphs for b frontal-medial, c frontal-parietal, and d medial-cerebellum connectivity during ToM, GD, and RD conditions ( error bars represent SEM; * p < 0.1, uncorrected; ** p < .05, uncorrected; *** p < .05, FDR corrected, for the test of the difference in connectivity between groups) 
Abbreviations ADI: Autism Diagnostic Interview; ADOS: Autism Diagnostic Observation Schedule; ANOVA: analysis of variance; ASD: autism spectrum disorder; BOLD: blood-oxygen-level dependent; fcMRI: functional connectivity MRI; FDR: false discovery rate; FMRI: functional magnetic resonance imaging; FWHM: full width at half maximum; GD: goal-directed; GDQ: goal-directed question; GLM: general linear model; HCP: human connectome project; IQ: intelligence quotient; LANG: left angular gyrus; LCEREB: left cerebellum; LIFG: left inferior frontal gyrus; LSTS: left superior temporal sulcus; LTPJ: left temporoparietal junction; MNI: Montreal Neurological Institute; MPFC: medial prefrontal cortex; PCC: posterior cingulate cortex; RANG: right angular gyrus; RCEREB: right cerebellum; RD: random; RDQ: random question; RIFG: right inferior frontal gyrus; RMSD: root mean square of displacement; ROI: region of interest; RSTS: right superior temporal sulcus; RT: reaction time; RTPJ: right temporoparietal junction; TD: typically developing; ToM: theory-of-mind; ToMQ: ToM question.
Aberrant functioning of the theory-of-mind network in children and adolescents with autism

October 2015

·

478 Reads

·

150 Citations

Molecular Autism

Background: Theory-of-mind (ToM), the ability to infer people's thoughts and feelings, is a pivotal skill in effective social interactions. Individuals with autism spectrum disorders (ASD) have been found to have altered ToM skills, which significantly impacts the quality of their social interactions. Neuroimaging studies have reported altered activation of the ToM cortical network, especially in adults with autism, yet little is known about the brain responses underlying ToM in younger individuals with ASD. This functional magnetic resonance imaging (fMRI) study investigated the neural mechanisms underlying ToM in high-functioning children and adolescents with ASD and matched typically developing (TD) peers. Methods: fMRI data were acquired from 13 participants with ASD and 13 TD control participants while they watched animations involving two "interacting" geometrical shapes. Results: Participants with ASD showed significantly reduced activation, relative to TD controls, in regions considered part of the ToM network, the mirror network, and the cerebellum. Functional connectivity analyses revealed underconnectivity between frontal and posterior regions during task performance in the ASD participants. Conclusions: Overall, the findings of this study reveal disruptions in the brain circuitry underlying ToM in ASD at multiple levels, including decreased activation and decreased functional connectivity.


Figure 1.  Schematic diagram of the two-level exploratory factor analysis procedure.
The first level factor analyses are performed separately for participants 1–13. In these analyses, the activation levels of 135 voxels (marked as red, green, and blue circles for the 3 participants) distributed throughout the brain are expressed via 7 factors (Fa-Fg), and some (but not all) of the voxels are linked to these factors. The second, group-level FA in turn expresses the 13×7 first-level factors in terms of 4 group factors (GF1–GF4). For each of these factors, the originating voxels are spatially clustered. A cluster of such voxels (characterized as a sphere) contains voxels that were initially selected from many (typically all) of the participants. The six largest spheres per factor were treated as the factor-associated brain locations.
Table 1.  Age, IQ, handedness, and gender of the participants.
Figure 2.  Posterior midline self factor location.
A. Location of the voxels (circled) derived from the factor analysis of the Control Group that defined the posterior cingulate/precuneus sphere of this group’s self factor. Voxels in this cluster (with MNI x-coordinates extending from 0 to −9) are shown projected on the mid-sagittal plane. (The coordinates and radii of all 6 spheres associated with this factor are shown in Table S1 in File S1). B. Mean activation in midline brain structures for the verb hug (averaged over agent and recipient roles) for the two groups, differing in posterior cingulate/precuneus. The verb hug was chosen for illustration here because of the salience of hugging as a social interaction in autism, where enveloping pressure is sometimes desired but without physical contact between oneself with another person, as in Temple Grandin’s squeeze machine [40]. The depiction of the activation in this slice for all of the other verbs was very similar to hug, for both groups.
Figure 3.  Degree of alteration of self-related activation in autism (estimated by its stability in posterior cingulate/precuneus) and its relation to social processing ability measured by the Benton Facial Recognition Test [30].
Both measures were adjusted for participants’ age and full scale IQ. One participant with autism did not have a Benton Test score.
Figure 4.  Social Interactions-Fixation contrasts for the two groups.
The uncorrected p-threshold is 0.001 and the extent threshold is 5 voxels for both groups.
Identifying Autism from Neural Representations of Social Interactions: Neurocognitive Markers of Autism

December 2014

·

419 Reads

·

95 Citations

Autism is a psychiatric/neurological condition in which alterations in social interaction (among other symptoms) are diagnosed by behavioral psychiatric methods. The main goal of this study was to determine how the neural representations and meanings of social concepts (such as to insult) are altered in autism. A second goal was to determine whether these alterations can serve as neurocognitive markers of autism. The approach is based on previous advances in fMRI analysis methods that permit (a) the identification of a concept, such as the thought of a physical object, from its fMRI pattern, and (b) the ability to assess the semantic content of a concept from its fMRI pattern. These factor analysis and machine learning methods were applied to the fMRI activation patterns of 17 adults with high-functioning autism and matched controls, scanned while thinking about 16 social interactions. One prominent neural representation factor that emerged (manifested mainly in posterior midline regions) was related to self-representation, but this factor was present only for the control participants, and was near-absent in the autism group. Moreover, machine learning algorithms classified individuals as autistic or control with 97% accuracy from their fMRI neurocognitive markers. The findings suggest that psychiatric alterations of thought can begin to be biologically understood by assessing the form and content of the altered thought's underlying brain activation patterns.


Citations (23)


... This likely means that any estimate of the error will be overly optimistic [16]. The threat of data leakage can be exemplified by the case of a recent study that claimed high accuracy (91%) in predicting suicidality in youth using neuroimaging data [31]. Such a model would be of high clinical relevance and could provide valuable insights about underlying brain phenotypes. ...

Reference:

Overview of leakage scenarios in supervised machine learning
Machine learning of neural representations of suicide and emotion concepts identifies suicidal youth

Nature Human Behaviour

... Sentences are the most common unit for human perception of text. The following work treated the sentence-level brain responses as a combination of latent word effects, bridging the relationship of text perception in word and sentence levels [18][19][20]. Following these approaches, the holistic encoding of sentence stimuli was proposed [21,22]. ...

Predicting the brain activation pattern associated with the propositional content of a sentence: Modeling neural representations of events and states
  • Citing Article
  • June 2017

... Our observations that increasing context increases both the evoked SNR and the cortical representation of semantic information at the group level are fully consistent with results from previous neuroimaging studies. Several previous studies found that stimuli with more context evoke larger, more widespread patterns of brain activity (Mazoyer et al., 1993;Xu et al., 2005;Jobard et al., 2007), that brain activity evoked for individual words is modulated by context (Just et al., 2017), and that brain activity evoked by stimuli with more context are more reliable than those evoked by stimuli with less context (Lerner et al., 2011). Furthermore, previous studies that used narrative stimuli . ...

Neural representations of the concepts in simple sentences: Concept activation prediction and context effects

NeuroImage

... Whereas thematic role assignment also recruits a-modal regions located outside the Core Language Network, this recruitment critically relies on task demands beyond role assignment itself: unlike the Core Language Network, these other regions are overall not sensitive to linguistic meaning (Ivanova, 2022; see also Frankland & Greene, 2020;Wang et al., 2016). Thus, understanding "who did what to whom" in a sentence appears to predominately (or, at least, heavily) rely on computations that are linguistic in nature, and thus provides an appropriate test for LLMs. ...

Identifying thematic roles from neural representations measured by functional magnetic resonance imaging

Cognitive Neuropsychology

... These studies found the involvement of the hippocampus (HIPP) or entorhinal cortex in distance decoding through multivariate voxel pattern analysis (MVPA) and neural representational similarity analysis (RSA). A similar method has been used in numerical-related studies to investigate magnitude representation (Damarla et al. 2016;Eger et al. 2015;Wilkey et al. 2020), primarily focusing on the parietal area, yet no research has specifically addressed the precision of distance representation in numerical contexts. Previous approaches to studying magnitude RP have focused on measures such as functional connectivity or neural pattern similarity. ...

Modality-independent representations of small quantities based on brain activation patterns
  • Citing Article
  • January 2016

... It has been found that young children at risk for a diagnosis of autism are under-responsive in the left hemisphere cortex for phonological responses, and that this deficit worsens with age [23]. In another study, it was found that individuals with ASD were found to have significantly reduced activation in areas of the theory of mind network, the mirror network, and a portion of the cerebellum, and insufficient functional connectivity between anterior and posterior areas of the brain during task performance [24]. The study also found a significant reduction in activation of the mental theory network and part of the cerebellum. ...

Aberrant functioning of the theory-of-mind network in children and adolescents with autism

Molecular Autism

... There are a few potential explanations for why ASD cases were less distinguishable from healthy controls than SCZ or BP in general. The ABIDE dataset is approximately ten times larger than any of the disorder-control combined groups in the UCLA CNP cohort [47,48], and prior studies have demonstrated an inverse relationship between sample size and classification performance using ABIDE data [171][172][173][174][175]. Notably, we included ASD and control participants from all ABIDE sites and did not explicitly account for imaging site in our classification analyses. ...

Identifying Autism from Neural Representations of Social Interactions: Neurocognitive Markers of Autism

... Recent advancements in machine learning, including artificial neural networks, deep learning, and biologically inspired algorithms, have greatly expanded our ability to detect and analyze emotional patterns [9,10]. Using multimodal data such as speech, facial expressions, text sentiment, and even neuroimaging data like EEG, affective computing systems can accurately recognize emotions and identify nuanced transitions in emotional states [11,12]. This multimodal approach enriches our understanding of human experience and enables highly accurate emotion recognition in adaptive AI systems. ...

Identifying Emotions on the Basis of Neural Activation

... Activation in the mPFC is consistently observed across nearly all neuroimaging studies on sarcasm (Eviatar and Just 2006;Rapp et al. 2010Rapp et al. , 2013Uchiyama et al. 2006;Wang et al. 2006a;Bosco et al. 2017;Filik et al. 2019;Nakamura et al. 2022;Spotorno et al. 2012;Varga et al. 2013). Moreover, lesion studies associate mPFC atrophy with deficits in sarcasm comprehension and ToM (Rankin et al. 2009;Shamay-Tsoory et al. 2005), and fMRI studies comparing patients that struggle with sarcasm comprehension with controls consistently show reduced mPFC engagement during irony/sarcasm processing in the first group (Rapp et al. 2013;Varga et al. 2013;Herold et al. 2018;Wang et al. 2006a;Williams et al. 2013).The mPFC is highly involved in inferring others' attitudes and intentions in the ToM literature (Abu-Akel and Shamay-Tsoory 2011; Frith and Frith 2006;Schurz et al. 2014). Uchiyama et al. (2006) proposed that mPFC decodes the speaker's attitude in sarcasm, showing a strong connection between sarcasm processing and ToM, even to a greater extent than other types of pragmatic language (Bohrn et al. 2012). ...

Brain Function Differences in Language Processing in Children and Adults with Autism
  • Citing Article
  • August 2013

... Our review of the extant psychological evidence thus strongly militates against the view that we have a brutely retributive Realpsychologie. And yet despite the encouraging tenor of these results, there is real and persisting evidence across a broad range of studies that people are susceptible, both in theory and in practice, to purely retributive impulses (Aharoni and Fridlund 2012;Carpenter et al. 2001;Crockett et al. 2014;Cullen et al. 2000;Hartnagel and Templeton 2012;Hough et al. 1998;Keller et al. 2010;Nadelhoffer et al. 2013). We do not want to underestimate how strong and persistent these impulses may be. ...

Dynamic cortical systems subserving cognition: fMRI studies with typical and atypical individuals