ArticlePDF Available

Abstract

In recent years there has been a growing interest in autism spectrum individuals in the expression and understanding of emotions. The objective of this work is through a literature review: a) to illustrate the emotional development and education of individuals on the spectrum b) to present the findings of investigations c) to present and raise key concerns about the emotional intelligence of children spectrum of autism (d) raise questions about the development of educational methods aimed at enhancing the emotional development of individuals in the autism spectrum and thereby the development of social feelings their maternal skills.
PaperAutism, Expression, and Understanding of Emotions: Literature Review
Autism, Expression, and Understanding of Emotions:
Literature Review
https://doi.org/10.3991/ijoe.v16i02.11991
Irene Chaidi (), Athanasios Drigas
N.C.S.R. ‘Demokritos’, Agia Paraskevi, Athens, Greece
irhaidi@gmail.com
AbstractIn recent years there has been a growing interest in autism
spectrum individuals in the expression and understanding of emotions. The
objective of this work is through a literature review: a) to illustrate the
emotional development and education of individuals on the spectrum b) to
present the findings of investigations c) to present and raise key concerns about
the emotional intelligence of children spectrum of autism (d) raise questions
about the development of educational methods aimed at enhancing the
emotional development of individuals in the autism spectrum and thereby the
development of social feelings their maternal skills.
KeywordsAutism, autism spectrum, emotional intelligence
1 Introduction
Autism Spectrum Disorder (ASD) is a lifelong developmental disorder that
prevents people to understand correctly what they see, hear and generally feel. As a
result, they face serious problems in their social relationships, communication, and
behavior. Children with autism spectrum have significant difficulties in recognition,
in understanding and expressing emotions [1]. They tend to avoid human faces and
are difficult to understand why facial features are "moving", changing, as a result, the
inability to read the emotions in the human face weakens their ability to communicate
with other people [2]. The purpose of this paper is to present a literature overview
research on how people's emotions are expressed and understood in the autism
spectrum, as well as research on investigating the training of autistic people in
recognizing, expressing and understanding emotions.
2 Autistic Spectrum Disorder (ASD)
Autistic Spectrum Disorder is a severe, widespread developmental disorder a
person who has been accompanying the person throughout his or her life, affecting
their perception, thinking and behavior and is characterized by (a) significant
difficulties in developing the person's social and communication skills and mutual
94
http://www.i-joe.org
PaperAutism, Expression, and Understanding of Emotions: Literature Review
interactions with those around him, and (b) limited and recurring stereotypical
interests and behaviors. [3], [4]
ASD is diagnosed by comparing one's behaviors with symptoms that are listed in
the official Diagnostic and Statistical Manual of the American Psychiatric Association
(DSM-V) and the World Health Organization (WTO) ICD-10 (International
Classification of Diseases) lists. Both the current diagnostic criteria and the
descriptions of modern researchers that concerning the Autism follow Wing's "Triple
Disorder of Social Interaction": a) Disruption of social relationships - incomplete
social interaction - interaction, lack of emotional reciprocity, social b)
Communication disruption - inadequate communication and communication) and
fantasy - a lack of social understanding and imagination (Happe, 1998). These three
categories, with the revised version DSM-V, were replaced by 2 groups: a) social
communication and b) stereotyped, repetitive behaviors, activities, and interests.
It should be emphasized that children with ASD are highly heterogeneity in terms
of social disorder. Other children have a lack of motivation for interaction, which in
some cases avoids interaction, that is, they avoid touch and eye contact, while others
actively seek interaction but either lack empathy or interact interactively. People with
ASD also have a disadvantage in their emotional organization, resulting in difficulty
in communicating with those around them, with consequences for socializing and
family problems.
3 Emotional Intelligence
The individual coexists with logic and emotional intelligence. The feelings they
have important in one's life because as a subjective response of the person to the event
that caused the emotion, they have the potential as an internal ethic to guide us in
decision making, changes in behavior, facial expression, and posture. Scientists
pointing out the importance of emotional intelligence in achieving personal and
collective goals emphasize that most of the time, one's general intelligence does not
guarantee success unless it is combined with a high degree of emotional intelligence.
The term intelligence has been given definitions that primarily refer to the
intelligentsia one's achievements and not so much what intelligence is,[5] points out.
Cognitive intelligence defines what we can measure ", while the scientific definition
defines:" intelligence is a complex and complex cognitive function, involving many
factors, including the ability to acquire new experiences, adapt to new situations. and
to build on previous experience in dealing with new difficulties or problems ”[6], [7]
The feeling from ancient times is defined as: "a function of the body, the which
either alone or in collaboration and interaction with mental functions contributes to
the overall development of man and enhances his ability to adapt. [5]. In
Psychology, the term emotion was first used in the mid-18th century by Hume to
describe passion or love [8], while in modern theories: Fredrickson's theory of
positive emotions [9], [10] but also in previous theories[11], [12], [13], the term
emotion expresses the multidimensional forms of the organism's response to
environmental challenges, manifested at various levels, such as expressive, cognitive,
iJOE Vol. 16, No. 2, 2020
95
PaperAutism, Expression, and Understanding of Emotions: Literature Review
neurological, normal or biological, etc. [5] and seems to be accepted today by most
psychologists who study emotions.
The term "emotional intelligence" was recently used by Goleman [14], [15], while
its development as a scientific concept began long ago and has its roots in Thorndike's
social intelligence [16]. "Emotional Intelligence" is a multidimensional concept and
therefore exists several definitions, depending on the aspect of emotional intelligence
that scientists are trying to cover, although most analyze emotional intelligence in
four thematic areas: perception, understanding, control, and the use of emotion. It is
treated "as a complex concept that encompasses a range of dimensions (abilities,
characteristics, skills) and refers to various areas of human nature (cognitive potential,
personality, behavior)" [17].
According to the Greek Dictionary: Emotional Intelligence is defined as "the
ability to control one's emotions, to cope with emotional stress, to develop one's
abilities in areas such as imagination, art and human communication ", while
according to Goleman [15] it is defined as" the ability to know what you are feeling
and to be able to handle these emotions before letting them handle you, to be able to
motivate yourself to accomplish your goals, to be creative, to make the most of your
abilities, to understand what people are feeling others and be able to handle their
relationships effectively. " Finally, Salovey, Mayer, & Caruso [18] define emotional
intelligence as "the ability of a person to identify, accurately evaluate, and distinguish
his or her own, others' emotions, to understand, to" assimilate "them into their minds,
and to regulate both negative and positive emotions in oneself and others. "
In recent years they have been measuring and evaluating emotional intelligence
manufactured various psychometric tools (scales or tests), both scientifically and
popularly. [17].
Researchers support that there is a positive correlation between emotional
intelligence and one's cognitive processes, and this demonstrates the important role
that emotional intelligence plays in emotion and cognition, thereby enhancing
individuals and their personality and benefiting [19], [20]. They also emphasize that
emotional intelligence is a skill that can be "learned" and developed. [21], [22].
Researchers Dringas & Papoutsi [23] support in their research that the development
of emotional intelligence is based on the 9-level model. This model is based on the
concepts of Gardner's interpersonal and interpersonal meanings [24], [25].
The pyramid of emotional intelligence (9-level model).
1. Emotional Unity
2. Exceeding
3. Homogeneity of Emotions, Realization
4. Social Skills, Expertise in Emotions
5. Social Awareness, Empathy, Discrimination of Emotions
6. Self-management
7. Self-knowledge
8. Recognition of emotions, perception-expression of emotions
9. Emotional stimuli
96
http://www.i-joe.org
PaperAutism, Expression, and Understanding of Emotions: Literature Review
Man strives to reach the last level of the pyramid, and at every level cultivates
important emotional, cognitive and metacognitive skills that are important resources.
4 Emotion and DAS: Expression-perception-understanding of
emotions
Feelings are the first way children communicate as well as the first weeks of their
lives are capable of expressing their core feelings of joy, sadness, anger, disgust, and
surprise. [26]
Leppanen & Nelson [27] support that one's ability to discern a person's sense of
facial expressions is considered essential for successful social interaction, and
conversely, social interaction, through increased experience in facial expression, may
be necessary for normal development of facial emotion recognition (Facial Emotion).
Recognition, -FER). Many people with an autism spectrum disorder, who are
characterized by severe difficulties with social interaction, have experienced
impairments in FER. Kanner [28] first described autism as a "disturbance of
emotional contact", emphasizing the social and emotional characteristics of autism
disorder and argued that it is "inherently" inability of children to develop emotional
contact with other persons, weakness they continue to emphasize social and emotional
deficits and the role of emotions in DIA is still under discussion. The taxonomic
systems of the World Health Organization ICD-10 and the American Psychiatric
Society DSM-V in the criteria for diagnosing autism spectrum status related to
deficits in the recognition and processing of emotions emphasize: "Deficits such as
nonverbal behavior manifest; the facial expression "and" lack of social or emotional
reciprocity ". These difficulties in using and responding to emotions correspond to
two components of the processing of emotions [29], [30], [31], the production of an
emotional state and the regulation of emotions. [32].
Researchers agree that in typically developing children the recognition of
Emotional facial expressions are an early development of social skills [32] from the
age of 4 months we distinguish expressions of anger, fear, sadness, happiness and
surprise in infants [33] in a familiar context while between 8 and 10 months infants
begin to use emotional expressions for social reference [34], and are a key source of
information about the sender's current emotional state [35], intentions [36] and the
significant if environment and lessons learned [37], [38]. The failure of these
fundamental emotion recognition skills will have serious consequences for the child's
social development, moving the child away from learning about other people's
emotions and reactions. [32].
In ASD, when we talk about a basic disorder of feeling we do not mean that
children with ASD have no emotions, nor the difficulty of children to read the
feelings of others and to reflect on their own, but this is a disorder of the connection
of emotion with perception and thinking, difficulties in understanding, managing of
emotions and personal meaning in what the child perceives. This is why scientists
argue that children with ASD can express their emotions, but their emotional
expressions differ from those of typical developmental children [1].
iJOE Vol. 16, No. 2, 2020
97
PaperAutism, Expression, and Understanding of Emotions: Literature Review
5 Method
In the present work, reference is made to research on expression, perception and
understanding emotions in DIA. and categorized into two categories: a) research on
the recognition of emotions of people with autism and b) research on the development
of emotionally-empowering people with autism.
Research on the emotional intelligence of people with ASD, in particular, has
increased in the last decade, but the findings on the recognition of facial emotions in
autism are inconsistent: some studies find no deficits in autism, while others report
deep deficits [39], despite numerous studies, there is still no general acceptance as to
whether emotion recognition is a fundamental difficulty for people with autism or not.
Several of these studies have identified difficulties in the recognition of facial
expressions in individuals with autism [40] , [41], [42], [43], some other studies have
not [44], [45], [46], [47], [48], [49], while studies indicate deficits that are limited to
specific negative emotions, such as fear [50], [51], disgust, sadness, and anger [52],
[53].
The literature review refers to the results of 48 surveys, collected by Uljarevic &
Hamilton [32], with 980 participants with ASD of all ages. They focused on the
recognition of emotion from visual stimuli because they have been studied more and
are intended to determine whether recognition dysfunction exists at all ages of autism,
regardless of IQ and severity level, and whether deficits in recognition of visual
impairments and equivalents in size in all different emotions, The criteria set
included: sample number, autistic gender and control group, diagnosis and diagnostic
criteria , the mental age of the participants, the type of project, the research tools and
the emotion study category (basic or complex). The results of the literature review
showed that there was an objective difficulty in identifying emotions from people
with autism and that the age of the participants, their IQ and performance had no
effect on the sample performance.
Finally, issues that need to be addressed in subsequent investigations were
identified such as sample size, sample group, and the projects used [39], [54], [55],
[56].
Also, a new search [57] was limited to 31 articles about serious games, between
January 2001 and April 2014, and they were designed to improve social skills.
Sixteen of these games targeted facial emotion recognition or production. They
support that Although social skills required in real-life involve rich combinations of
perspective-taking, emotional regulation, cognitive flexibility, appropriate use of
language and so on, the literature search conducted here emphasized that a significant
part of the effort devoted to serious game design has been focusing on the basic
ability of emotion recognition, which sustains those more complex forms of social
competencies
5.1 Surveys of expression, recognition, and understanding of emotions
Hobson [58] supports that the cause of autism is the inability of individuals to
create emotional bonds with other people as they do not have the subjectivity of
98
http://www.i-joe.org
PaperAutism, Expression, and Understanding of Emotions: Literature Review
recognizing emotions. The absence of this is the inability of the individual to perceive
emotional states and to understand the minds of others [58], [59], [60], a view
supported by researchers. [61], [45], [62], [63], [64], [65].
Hobson, Ouston & Lee [66], [67], also support that autistic individuals find it
difficult to grasp the emotional expressions in both their reading and their
understanding of the faces of others, because autistic children do not see the person as
a single form (Gestalt) but as a set of elements that are related in a specific way so
they can identify them in the experiment.
Other research reveals the inability of autistic children to interact and express their
feelings in expressions, not verbally. [1]. Yirmiga, Kasari, Sigman, & Mundy [69] by
videotaping the interactions of autistic, mentally retarded, and typically developing
children with an unknown adult and studying their reactions, concluded that autistic
children express abnormal or control, a view supported by Dawnson, Hill, Spencer,
Galpert & Watson [70], while Kasari, Sigman, Mundy, and Yirmiya [71] agree that
autistic children find it difficult to express their emotions when interacting with an
adult. .
Baron-Coen [72] in two studies asked children with ASD to describe their the
emotional state of a heroine and studied the difficulty of autistic children in
understanding emotions, asking whether it is the difficulty of autistic children to
understand primary anomalies [58] or the secondary consequence of Frith & Leslie
[74]. The conclusion was that children with ASD difficulty in understanding beliefs
are a primary deficit, but the difficulty in understanding emotions is a secondary
consequence, that is, autistic children understand certain situations or events that
cause specific emotions.
In addition to research on understanding and expression of basic emotions, research
has been conducted the ability to perceive, understand and express complex emotions
of people with ASD. Researchers Klim, Volkmar, & Sparrow [75] studied the basic
social behaviors of children with ASD, aged about 4 years with control groups of
typical developmental children and children with intellectual disabilities, aiming to
show that social behavior or lack thereof is independent of the kinetic activity of the
individual. Research has shown that autistic individuals cannot develop emotional
bonds with others, reinforcing the view that socialization is one of the three deficits of
autism [76] and their inability to connect emotionally with others. it deprives them of
social experiences.
Baron-Cohen,[77] thinks that children with autism are deficient in autism "Theory
of mind", in understanding others' mental states, resulting in difficulties in
understanding one's beliefs, desires, intentions, feelings and interpreting the behavior
of others. Misailides & Papoudi, [1] report that researches related to “theory of mind”
have shown that children's performance in autism in recognition of complex emotions
in facial expressions in photographs was commensurate with children's performance
in works. theory of mind, while Heerey, Kethner & Capps [78] believe that the
disorder of people with autism in the understanding, perception, and expression of
complex emotions is due to the abnormal development of the "theory of mind" that is
necessary for the development complex emotions, as complex emotions usually
manifest themselves when other people are present.
iJOE Vol. 16, No. 2, 2020
99
PaperAutism, Expression, and Understanding of Emotions: Literature Review
In a study of Rump, Giovannelli, Minshew & Strauss [79] with 2 experiments
investigated the recognition of emotions in typically developing individuals and
people with autism at different ages. The results showed that the performance of the
subjects in the control group was better in the adult group, while the performance of
the individuals with autism was similar in all age groups, that is, the adults with
autism did not seem to reach the level of aptitude recognition about to with
concerning the emotions, typically developing adults.
Harms et al. [39] also refers to the results of optical surveys Coordination (Eye-
Tracking) and Brain-Based Studies pointing out that the results show that people with
ASD exhibit abnormalities in the recognition of emotional facial expressions.
Wallace, et al. [53] exploring the recognition of his emotional expressions facial and
perceptual sensitivity between high-functioning autistic adolescents and typically
developing adolescents (corresponding age, IQ, gender) in six key emotions and
examining the links between recognizing emotional facial expressions and adolescent
symptom / adaptive functioning, people with high functioning autism have difficulty
processing emotional facial expressions, perceptual sensitivity, and sad expressions.
ye not associated with autistic behavior and adaptive functioning, which may be
considered as in-awareness deficits.
In a recent, study Tanaka, et. al. [80] evaluate the expression process participants
with autistic disorders designed and used the computer project “Let's Face It! Emotion
Skills Battery” (LFI!) Consisting of three measures of verbal and perceptual facial
recognition skills. It was administered to groups of participants with ASD and
typically developing individuals of the same age and intelligence (IQ). The results of
the studies showed that people with autism were able to identify basic facial emotions
(except for anger expression) at the same level as typically developing control
subjects, but with a reduced ability to generalize emotions to different identities.
Researchers have made suggestions for designing effective emotion processing
interventions promoting the generalization of emotion recognition in people and
social situations to enhance social day-to-day skills.
Last discussed that responsible for the impairment of emotional ability is the
malfunction of the almond nucleus, the sickle [81]. The almond nucleus plays a key
role in emotional learning, regulates additional cognitive processes, such as memory
or attention [82], while stimulating it produces negative emotions (fear, sadness,
anxiety) or positive emotions (happiness). Researchers Bauman & Kemper [83] in
necrotizing studies of the autopsy of the sickle-cell of the autopsy showed that there
were abnormalities in the size, density and dendritic branches of the autopsy. and
found these findings to be evidence of abnormal development of the autistic almond
kernel [1], a view also supported by research in animals such as Bachevalier, Hagger
& Mishkin [84] rhesus, as well as those of Prather et al. [85] and Emey et al. [86] in
monkeys with localized damage to the tonsils, showed that macaque monkeys with
damage to the tonsils showed a lack of fear in stimuli that typically cause this emotion
[1].
Grossard, et.al [57] mention that many serious games focus on recognizing
emotions in pictures, drawings, audio or video recordings. Although emotion
100
http://www.i-joe.org
PaperAutism, Expression, and Understanding of Emotions: Literature Review
recognition is multimodal [87], visual facial stimuli were the most frequent, audio
stimuli were less frequent and body posture presentations were only proposed once.
5.2 Emotional development and autism spectrum training
Individual and minimal surveys have been conducted to investigate, based on
different intervention models and in a different population of autistic individuals,
whether children with ASD can be trained in understanding and expressing emotions.
Personalized psychoeducational intervention programs specifically aimed at teaching
emotional comprehension skills for children with autism do not exist while integrated
intervention programs have so far been developed and applied to autistic children, e.g.
Lovaas, PECS, TEACCH, etc., aim to improve the behavior of autistic children and to
train them in communication and social skills.
Based on the principles of behavior analysis, Gena, Krantz, Mc Clannahan and
Poulson [88] conducted a study with 4 autistic individuals aged 11-19 years and
aimed at: teaching socially acceptable emotional reactions to autistic individuals using
the combination of: reinforcement, imitation and verbal guidance, to evaluate the
effects of intervention with new therapists and in new situations after the arrival of
one month, and to train autistic people in emotional states related to acceptance by
their peers. The categories used to train autistic people were: 1) talking about favorite
objects, 2) laughing at nonsense, 3) showing sympathy, 4) showing appreciation, and
5) showing dissatisfaction. Indicative socially acceptable emotional responses were
considered: eye contact, as well as socially acceptable verbal response and emotional
expression. Participants were trained in 3 or 4 categories, and the results of the study
showed that all 4 participants benefited by presenting socially acceptable emotional
reactions, not only to the categories they were trained to but also to new situations
with new therapists and after one month.
Hadwin, Baron-Cohen, Howlin, and Hill [89], [90] studied, in the context of
'theory mind how children with autism aged 4-13 years and verbal age 6 years can be
taught to understand emotions, beliefs, and pretensions. The findings of the study
showed that autistic children could be taught and succeeded in tests that assessed the
above while retaining this ability after a 2-month evaluation, but it was observed that
there was no generalization to unstructured activities with a different structure from
the ones originally developed. Children were trained and that this intervention did not
contribute to improved communication in terms of the use of mental states and the
ability to expand into discussions.
In another study, Silver, and Oakes [91] using the program Emotional Computer-
assisted trainers teach people with autism or Asperger's syndrome to recognize and
anticipate others' emotions. The study involved 2 groups of 11 participants each, aged
12-18 years old and verbal aged 7 years and over, with a diagnosis of autism or
Asperger's syndrome. The experimental group used the program for 10 episodes
lasting 30 minutes over for 2-3 weeks while the control group subjects were watching
their class. Participants were assessed before and after the intervention using photos
with the 4 basic facial expressions, photos that refer to a person in a particular
emotional state that triggers the expression of a particular emotion, photos showing
iJOE Vol. 16, No. 2, 2020
101
PaperAutism, Expression, and Understanding of Emotions: Literature Review
what the protagonist wants, what he or she is getting. finally and how it finally feels
and photos referring to a person and a particular situation triggering emotional
reactions The results of the intervention They showed that the experimental group
showed improvement in all parameters compared to the control group and that the
scores on emotion measurements were not correlated with age or verbal ability, and
the more they used the program on the computer, the more positive results there were.
However, it remains to be tested whether these positive effects can be generalized in
real life or contribute to better performance in measurements of mind theory.
Bauminger [92] used the principles of cognitive-behavioral therapy in a sample of
15 autistic individuals aged 8-17 years and Intelligence Score 60-109 on the WISC-R
to evaluate the effectiveness of an intervention on socio-emotional understanding and
social interaction. The intervention lasted 7 months for 3 hours a week at school by
the child's teacher in collaboration with a peer and his parents. Intervention with
emotional comprehension included teaching: basic emotions describing the rules for
each emotion, recognizing emotions in oneself and others through recognizing
emotional expressions, gestures and utterances, and recognizing emotions.
Intervention results showed that people with ASD: recognized and described more
emotions, used more complex emotions taking into account the presence of others,
and reported personal emotional experiences more frequently than using standard
stereotypical responses.
Golan et al [93] used computers to identify and emotion learning educational
software "The Transporters", a digital game for 4-8 -year- olds [94]. This software is a
series of animations with 'live' vehicles, eight characters with real human faces
designed to enhance the learning and understanding of emotions in children with ASD
and plays in a child's bedroom, in a predictable environment. The study sample
included 20 children with autism, aged 4-7 years, who attended the game daily for 4
weeks and were examined before and after intervention in emotional vocabulary and
emotion recognition at three levels of generalization. They were compared with two
child control groups: the first group of 18 children with ASD and the second group of
18 children with formal development. The intervention team showed significant
improvement, and the researchers concluded that using the software improved the
recognition of emotions in children with autism [93].
Researchers Hopkins, et al. [95] used the FaceSay program, one an interactive
avatar computer program designed to teach social skills and improve the social
interactions of children with ASDs in the natural environment, to increase their ability
to observe globally the interpretation of emotions in faces. Faces are one of three
games designed to improve attention skills and is based on the idea that people with
autism are deficient in central cohesion [96]. The study evaluated the efficacy of
FaceSay activities in 49 low- and high-functioning autism spectrum participants and
had the opportunity to practice eye gaze, facial expressions and face recognition and
emotion recognition in the structured environment of FaceSay. Low-functioning
children showed improvements in emotion recognition and social interaction, whereas
high-functioning children showed improvements in face recognition. The findings are
particularly encouraging.
102
http://www.i-joe.org
PaperAutism, Expression, and Understanding of Emotions: Literature Review
The researchers, Machalicek, W.K. Others, [97], in a systematic review of studies,
using computational interventions (CBI) to improve the social and emotional skills
(eg, emotional recognition) of people with autism spectrum disorder (ASD), report
that these results studies have shown that the effect of CBI on social and emotional
skills was mixed, with most studies reporting unacceptable results after intervention
and pointing out that the comparison of CBI training with guidance and personal
social skills training suggests that the CBI can be just as effective as face-to-face
education. In general, this review indicates that the use of CBI to improve the social
and emotional abilities of people with ASD is a promising practice. They caution
professionals that they should carefully consider the preferences and existing
capabilities of people with ASD and adjust the software when deciding to use the CBI
and choosing a software program
Grossard, et.al΄,[57] at his article support that four games of the sixteen, also
trained on producing emotions, often by having individuals mimic a model. Among
them, only Life- IsGame [98] includes emotion production exercises in a social
context with no visual support.
The researchers Tan et al., [99] fixed up the game” CopyMe”. It’s a very simple
game in its architecture and principles and has not been tested in a clinical study.
targets only facial expression production; the game is designed for an iPad. The player
must look at a picture of a facial expression with the name of the expression written
underneath it and then she/he has to reproduce it. There are 3 levels of difficulty: the
easy level includes happy and sad emotions; the intermediate level includes happy,
sad, angry and surprised; and the difficult level includes happy, sad, angry, surprised,
scared and yucky. A facial expression recognizer was built for this game.
Serret et al., [100], fixed up the game. ”Je Stimule" This game is a computer game
that targets expression recognition in context, more complex in its computation and
was tested in an open stratified clinical trial. This game is separated into 2 modes,
training and the game itself. The particularity of this game is that Lf-Asd (Low
Functioning Autism Spectrum Disorders) Individuals can play using color codes that
are associated with specific emotions (yellow for joy, for example). Players learn
these codes in the training mode. During the game, the player moves her/ his avatar in
a 3D environment and is exposed to different scenarios during which she/he has to
recognize emotions. Different levels of recognition exist: (1) recognizing the emotion
expressed by a virtual character due to a specific event (e.g. a child falls); (2) the same
task but the face of the virtual character is hidden; (3) recognising the emotion
conveyed by the non-verbal communicative behaviour of a virtual character speaking
with another virtual character when the verbal exchange is made inaudible.
6 Conclusions Perspectives
The results of the literature review to the results of 48 surveys collected by
Uljarevic & Hamilton [32] showed that there was objective difficulty in identifying
emotions from people with autism and that the age, participants, their IQ, and the task
used had no effect on sample performance.
iJOE Vol. 16, No. 2, 2020
103
PaperAutism, Expression, and Understanding of Emotions: Literature Review
The researchers noted that there are critical issues that need to be addressed. Future
research concerns: sample size, sample group, and projects used [39], [101], [102],
[103]. Based on the evaluation studies, they recommend using larger sample sizes to
increase the reliability and reproducibility of the data, to fully record the results
(tables, graphs) for better documentation. They also raise questions about how
important time is in recognizing emotion, and people with autism may need more time
to recognize an emotion, or they may have difficulty recognizing emotions in moving
dynamic images from still images. The second concern they have is that there is a
greater failure to recognize negative emotions than people with ASD, and they
suggest more research with different emotions with large groups of participants in
combination with brain-imaging and visual resonance methods.
In Grossard’s et al [57] review is presented the presence or absence of the different
attributes of serious games described by Yusoff [104]. Games usually included
several attributes. However, three attributes appeared to be used less frequently:
attention span, reward and accommodating the learner. Each game was very different
with variations based on the authors’ choices.
Also, at the same review is presented the scale scoring from Connolly’s et al. [105]
study regarding clinical validation. Excellent scores were obtained only 6 games from
sixteen games: The Junior Detective Program [106], Emotion Trainer [80] FaceSay2
[47], JeStimule [100] Let's Face It [80] Mind Reading [107] and The Transporters
[93]. Regarding the targeted populations, 6 serious games are available exclusively
for high-functioning (HF) ASD or Asperger syndrome (AS) individuals, with no
adaptation for low functioning (LF) ASD patients. Two other games require that
players have good reading skills. Among the 16 games, 10 were assessed in
populations with ASD, only 7 studies used a control group, including a few with
sample sizes of 30 or more children per group and only 4 studies were randomized.
Also, one study (the serious game Let's Face It!) [80] included both a control group
and an ASD group matched for developmental age and diagnosis (AS or PDD-NOS)
and more than 30 children per group. In terms of efficacy, the individuals who played
Mind Reading [107] The Transporters [93], JeStimule [100] FaceSay2 [47], The
Junior Detective Program [106], and Emotion Trainer [80] showed improvement after
training but their results cannot be extended to the whole spectrum of autism disorders
given the limited representativeness of their samples. Also, no study showed evidence
of clinical relevance meaning that by playing with a serious game that focuses on
social interaction skills, the children were not shown to improve clinical social
interaction scores (like ADOS or Vineland).
7 References
[1] Misailidi, P. & Papoudi, D. (2009). Expression, perception, and understanding of emotions
in autism: Psychological and neurological findings. Step in Social Sciences, 54, 127 - 145.
[2] Chaidi, E. & Papoudi, D. (2010). Educational software for the emotional development of
people with autism spectrum, Proceedings: 2nd Panhellenic Conference on Special
Education "Special Education is the starting point for developments in science and
practice", Athens 2010, Grigoris Publications.
104
http://www.i-joe.org
PaperAutism, Expression, and Understanding of Emotions: Literature Review
[3] World Health Organization (2018): CD-11 for Mortality and
[4] Morbidiry, Geneva: WHO. http://id.who.int/icd/entity/437815624
[5] AMERICAN PSYCHIATRIC ASSOCIATION (2013). Diagnostic and Statistical Manual
of Mental Disorders, 5th edition (DSM_5). Washington, DC: American Psychiatric
ASSOCIATION. https://doi.org/10.1108/rr-10-2013-0256
[6] Maridaki-Kasotaki, Aik. (2011). Emotional Intelligence:
[7] Ennoiologikes declarations, theoretical models, assessment and practical applications,
Educational Sciences, 1, 47-61
[8] Kassotakis, M. & Flouris, G. (2006). Learning and teaching. Vol. Athens: Ed. Authors
[9] Flouris, G. (1996). The Architecture of meaning and teaching: Towards a teaching system.
In Matsagouras, H. (Edited by Ed.) The evolution of teaching. Athens: Gutenberg
[10] Schmitter, Amy M., "17th and 18th Century Theories of Emotions", THE STANFORD
ENCYCLOPEDIA OF PHILOSOPHY (Winter 2016 Edition), Edward N. Zalta (ed.),
URL:=<https://plato.stanford.edu/archives/win2016/entries/emotions-17th18th/>.
[11] Fredrickson BL.(1998) What good are positive emotions? Review of General Psychology.
1998;2:300319. https://doi.org/10.1037/1089-2680.2.3.300
[12] Fredrickson BL. (2001) The role of positive emotions in positive psychology: The
broaden-and-build theory of positive emotions. American Psychologist. 2001;56:218226.
https://doi.org/10.1037/0003-066x.56.3.218
[13] Frijda, N. H. (1986). Studies in emotion and social interaction. The emotions. New York,
NY, US: Cambridge University Press; Paris, France: Editions de la Maison des Sciences de
l'Homme.
[14] Frijda, N. H., Kuipers, P., & Schure, E. (1989). Relations among emotion, appraisal, and
emotional action readiness. Journal of Personality and Social Psychology, 57(2), 212-228.
https://doi.org/10.1037/0022-3514.57.2.212
[15] Lazarus, R. S. (1991). Progress on a cognitive-motivational-relational theory of emotion.
American Psychologist, 46(8), 819-834. https://doi.org/10.1037/0003-066x.46.8.819
[16] Goleman, D. 1995. Emotional intelligence, New York: Bantam.
[17] GOLEMAN, D. (1998a) Working with Emotional Intelligence. New York, Bantam Books.
[18] Thorndike, E.L. (1920) Intelligence and its uses. Harper's Magazine, 140, 227-235.
[19] Platsidou, M. (2004). Emotional intelligence: Contemporary approaches to an old concept.
Education Sciences, 1, 27-39.
[20] Mayer, J. D., Salovey, P., and Caruso, D. 2000a. “Competing models of emotional
intelligence”. In Handbook of intelligence, Edited by Sternberg, R. J. New York:
Cambridge. https://doi.org/10.1017/cbo9780511977244.027
[21] Killgore, W.D.; Yurgelun-Todd, D.A. Neural correlates of emotional intelligence in
adolescent children. Cogn. Affect. Behav. Neurosci. 2007, 7, 140151. [CrossRef]
[PubMed]. https://doi.org/10.3758/cabn.7.2.140
[22] Sevdalis, N.; Petrides, K.V.; Harvey, N. Trait emotional intelligence and decision-related
emotions. Personal. Individ. Differ. 2007, 42, 13471358. [CrossRef] Behav. Sci. 2018, 8,
45 17 of 17. https://doi.org/10.1016/j.paid.2006.10.012
[23] Brackett, M.A.; Rivers, S.E.; Reyes, M.R.; Salovey, P. Using emotional literacy to
improve classroom social-emotional processes. In Proceedings of the William T. Grant
Foundation/Spencer Foundation Grantees Meeting, Washington, DC, USA, 2010.
[24] Nelis, D., Quoidbach, J., Mikolajczak, M., Hansenne, M., Increasing emotional
intelligence: (How) is it possible? Personality and Individual Differences 47(1): 36-41
https://doi.org/10.1016/j.paid.2009.01.046
[25] Drigas, A.S. & C. Papoutsi. (2018). “A New Layered Model on Emotional Intelligence” in
Behavioral Sciences, Volume 8(5).
iJOE Vol. 16, No. 2, 2020
105
PaperAutism, Expression, and Understanding of Emotions: Literature Review
[26] Gardner, H.E.(2000) Intelligence Reframed: Multiple Intelligences for the 21st Century;
Hachette UK: London, UK.
[27] Gardner, H. (2011) Frames of Mind: The Theory of Multiple Intelligences; Basic Books:
New York, NY, USA.
[28] Izard, C. E., Huebner, R. R., Risser, D., McGinnes, G. C., & Dougherty, L. M. (1980). The
young infant's ability to produce discrete emotion expressions. Developmental Psychology,
16, 132-140. https://doi.org/10.1037/0012-1649.16.2.132
[29] Leppänen, J. M., & Nelson, C. A. (2006). The development and neural bases of facial
emotion recognition. In R. V. Kail (Ed.), Advances in child development and behavior:
Vol. 34 (pp. 207-246). San Diego, CA: Academic Press. https://doi.org/10.1016/s0065-
2407(06)80008-x
[30] Kanner, L. (1943). Autistic disturbances of affective contact. Nervous Child, 2, 217-250.
[31] Begeer, S., Koot, H. M., Rieffe, C., Terwogt, M. M., & Stegge, H. (2008). Emotional
competence in children with autism: Diagnostic criteria and empirical evidence.
Developmental Review, 28, 342369. https://doi.org/10.1016/j.dr.2007.09.001
[32] Herba, C., & Phillips, M. (2004). Annotation: Development of facial expression
recognition from childhood to adolescence: behavioral and neurological perspectives.
Journal of Child Psychology and Psychiatry, 45(7), 11851198.
https://doi.org/10.1111/j.1469-7610.2004.00316.x
[33] Phillips, R. A., Freeman, R. E., & Wicks, A. C. (2003). What stakeholder theory is not.
Business Ethics Quarterly, 13(4), 479502. https://doi.org/10.5840/beq200313434
[34] Uljarevic, Μ. & Hamilton, A. (2012). Recognition of Emotions in Autism: A Formal
Meta-Analysis, Springer Science+Business Media New York
[35] Walker-Andrews, A.,(1998) Emotions and Social Development: Infants' Recognition of
Emotions in OthersPediatrics November 1998, VOLUME 102 / ISSUE Supplement E1
SUPPLEMENT
[36] Camras, L., Shutter, J., 2010), Emotional Facial Expressions in Infancy, Emotion Review
2(2) https://doi.org/10.1177/1754073909352529
[37] Ekman, P., & Friesen, W. V. (1971). Constants across cultures in face and emotion.
Journal of Personality and Social Psychology, 17 (2), 124129.
https://doi.org/10.1037/h0030377
[38] Adams, R., Ambady, N., Macrae, C., & Kleck, R. (2006). Emotional expressions forecast
approach-avoidance behavior, motivation and emotion (pp. 177186). The Netherlands:
Springer. https://doi.org/10.1007/s11031-006-9020-2
[39] Moses, L. J., Baldwin, D. A., Rosicky, J. G., & Tidball, G. (2001).Evidence for referential
understanding in the emotions domain at twelve and eighteen months. Child Development,
72, 718735. https://doi.org/10.1111/1467-8624.00311
[40] Olsson, A., Nearing, K. I., & Phelps, E. A. (2007). Learning fears by observing others: The
neural systems of social fear transmission. Social Cognitive and Affective Neuroscience, 2,
311. https://doi.org/10.1093/scan/nsm005
[41] Harms, M. & Martin, A. & Wallace, G. (2010) Facial Emotion Recognition in Autism
Spectrum Disorders: A Review of Behavioral and Neuroimaging Studies Received: 16
March 2010 /Accepted: 7 July 2010 /Published online: 1 September 2010 # US
Government 2010. https://doi.org/10.1007/s11065-010-9138-6
[42] BormannKischkel, C., Vilsmeier, M., & Baude, B. (1995). The development of emotional
concepts in autism. Journal of child psychology and psychiatry, 36(7), 1243-1259. https://
doi.org/10.1111/j.1469-7610.1995.tb01368.x
106
http://www.i-joe.org
PaperAutism, Expression, and Understanding of Emotions: Literature Review
[43] Buitelaar, J. K., & van der Wees, M. (1997). Are deficits in the decoding of affective cues
and in mentalizing abilities independent?. Journal of autism and developmental disorders,
27(5), 539-556. https://doi.org/10.1023/a:1025878026569
[44] Hobson, R. P. (1986). The autistic child's appraisal of expressions of emotion. Journal of
Child Psychology and Psychiatry and Allied Disciplines, 27(3), 321342.
https://doi.org/10.1111/j.1469-7610.1986.tb01836.x
[45] Gross, T. F. (2004). The perception of four basic emotions in human and nonhuman faces
by children with autism and other developmental disabilities. Journal of Abnormal Child
Psychology, 32(5), 469480. https://doi.org/10.1023/b:jacp.0000037777.17698.01
[46] Adolphs, R., Sears, L., & Piven, J. (2001). Abnormal processing of social information
from faces in autism. Journal of Cognitive Neuroscience, 13(2), 232240.
https://doi.org/10.1162/089892901564289
[47] Capps, L., Yirmiya, N., & Sigman, M. (1992). Understanding of simple and complex
emotions in nonrelarted children with autism. Journal of Child Psychology and Psychiatry
and Allied Disciplines, 33(7), 11691182. https://doi.org/10.1111/j.1469-
7610.1992.tb00936.x
[48] Castelli, F. (2005). Understanding emotions from standardized facial expressions in autism
and normal development. Autism, 9(4), 428449. https://doi.org/10.11
77/1362361305056082
[49] Jones, C. R. G., Pickles, A., Falcaro, M., Marsden, A. J. S., Happe, F., Scott, S. K., et al.
(2011). A multimodal approach to emotion recognition ability in autism spectrum
disorders. Journal of Child Psychology and Psychiatry, 52, 275285.
https://doi.org/10.1111/j.1469-7610.2010.02328.x
[50] Prior, M., Dahlstrom, B., & Squires, T. L. (1990). Autistic children's knowledge of
thinking and feeling states in other people. Journal of Child Psychology and Psychiatry,
31(4), 587-601. https://doi.org/10.1111/j.1469-7610.1990.tb00799.x
[51] Robel, L., Ennouri, K., Piana, H., Vaivre-Douret, L., Perier, A., Flament, M. F., &
Mouren-Siméoni, M. C. (2004). Discrimination of face identities and expressions in
children with autism: Same or different?. European child & adolescent psychiatry, 13(4),
227-233. https://doi.org/10.1007/s00787-004-0409-8
[52] Howard, M. A., Cowell, P. E., Boucher, J., Broks, P., Mayes, A., Farrant, A., & Roberts,
N. (2000). Convergent neuroanatomical and behavioral evidence of an amygdala
hypothesis of autism. Neuroreport, 11(13), 2931-2935. https://doi.org/10.1097/00001756-
200009110-00020
[53] Pelphrey, K. A., Sasson, N. J., Reznick, J. S., Paul, G., Goldman, B. D., & Piven, J.
(2002). Visual scanning of faces in autism. Journal of autism and developmental disorders,
32(4), 249-261. https://doi.org/10.1023/a:1016374617369
[54] Ashwin, C., Chapman, E., Colle, L., & Baron-Cohen, S. (2006). Impaired recognition of
negative basic emotions in autism: A test of the amygdala theory.Social Neuroscience, 1(3-
4), 349-363. https://doi.org/10.1080/17470910601040772
[55] Wallace, G. L., Case, L. K., Harms, M. B., Silvers, J. A., Kenworthy, L., & Martin, A.
(2011). Diminished sensitivity to sad facial expressions in high functioning autism
spectrum disorders is associated with symptomatology and adaptive functioning. Journal of
autism and developmental disorders, 41(11), 1475-1486. https://doi.org/10.1007/s10803-
010-1170-0
[56] Burack, J., Iarocci, G., Flanagan, T., & Bowler, D. (2004). On mosaics and melting pots:
Conceptual considerations of comparison and matching strategies. Journal of Autism and
Developmental Disorders, 34, 6573. https://doi.org/10.1023/b:jadd.0000018076.90715.00
iJOE Vol. 16, No. 2, 2020
107
PaperAutism, Expression, and Understanding of Emotions: Literature Review
[57] Jarrold, C., & Brock, J. (2004). To match or not to match? Methodological issues in
autism-related research. Journal of Autism and Developmental Disorders, 34, 8186. https
://doi.org/10.1023/b:jadd.0000018078.82542.ab
[58] Mervis, C. B., & Klein-Tasman, B. P. (2004). Methodological issues in group-matching
designs: Alpha levels for control variable comparisons and measurement characteristics of
control and target variables: Research methodology-matching. Journal of Autism and
Developmental Disorders, 34, 717. https://doi.org/10.1023/b:jadd.0000018069.69562.b8
[59] Grossard, Ch., Grynspan, O., Serret, S., Jouen, A., Bailly, K., Cohen, D. (2017). Serious
games to teach social interactions and emotions to individuals with autism spectrum
disorders (ASD) ELSEVIER, Computers & Education 113, 195-211.
https://doi.org/10.1016/j.compedu.2017.05.002
[60] Hobson, R. P. (1990). On the origins of self and the case of autism. DEVELOPMENT
AND PSYCHOPATHOLOGY, 2(2), 163-181. http://dx.doi.org/10.1017/S0954579400000
687
[61] Hobson, R. P. (1993). Autism and the development of the mind. Hillsdale, NJ: Erlbaum.
[62] Hobson, R. P. (1994). Perceiving attitudes, conceiving minds. In C. Lewis & P. Mitchell
(Eds.), CHILDREN'S EARLY UNDERSTANDING OF MIND: ORIGINS AND
DEVELOPMENT (pp. 71-93). Hillsdale, NJ, US: Lawrence Erlbaum Associates, Inc
[63] Kasari, C., Sigman, M., Baumgartner, P., & Stipek, D. (1993). Pride and mastery in
children with autism. Journal of Psychology and Psychiatry, 34, 353362.
https://doi.org/10.1111/j.1469-7610.1993.tb00997.x
[64] Kasari, C., Chamberlain, B., Paparella, T., & Bauminger, N. (1999). Self-evaluative social
emotions in children with autism. Poster presented at the Society of Research for Child and
Adolescent Psychiatry, Barcelona, Spain.
[65] Kasari, C., Chamberlain, B., & Bauminger, N. (2001). Social emotions and social
relationships: Can children with autism compensate? In J. A. Burack, T. Charman, N.
Yirmiya & P. R. Zelazo (Eds.), The development of autism (pp. 309-323). Mahwah, NJ:
Erlbaum.
[66] Chidambi, G. (2003). Autism and self-conscious emotions. Unpublished Doctoral
Dissertation, University of London: London.
[67] Bauminger, N. (2004). The expression and understanding of jealousy in children with
autism. Development and Psychopathology, 16, 157-177.
[68] Hobson, R. P., Ouston, J., & Lee, A. (1988a). What’s in a face? The case of autism. British
Journal of Psychology, 79, 441-453. https://doi.org/10.1111/j.2044-8295.1988.tb02745.x
[69] Hobson, R. P., Ouston, J., & Lee, A. (1988b). Emotion recognition in autism: Coordinating
faces and voices. Psychological Medicine, 18, 911-923.
https://doi.org/10.1017/s0033291700009843
[70] Hobson, R. P., Ouston, J., & Lee, A. (1989). Naming emotion in faces and voices:
Abilities and disabilities in autism and mental retardation. British Journal of
Developmental Psychology, 7, 237-250. https://doi.org/10.1111/j.2044-
835x.1989.tb00803.x
[71] Yirmiya, N., Kasari, C., Sigman, M., & Mundy, P. (1989). Facial expressions of affect in
autistic, mentally retarded and normal children. Journal of Child Psychology and
Psychiatry, 30, 725- 735. https://doi.org/10.1111/j.1469-7610.1989.tb00785.x
[72] Dawson, G., Hill, D., Spencer, A., Galpert, L., & Watson, L. (1990). Affective exchanges
between young autistic children and their mothers. Journal of Abnormal Child Psychology,
18, 335-345. https://doi.org/10.1007/bf00916569
[73] Kasari, C., Sigman, M., Mundy, P., & Yirimiya, N. (1990). Affective sharing in the
context of joint attention interactions of normal, autistic, and mentally retarded children.
108
http://www.i-joe.org
PaperAutism, Expression, and Understanding of Emotions: Literature Review
Journal of Autism and Developmental Disorders 20, 87-100. https://doi.org/10.
1007/bf02206859
[74] Baron-Cohen, S. (1991). Do people with autism understand what causes emotion? Child
Development, 62, 385395. https://doi.org/10.2307/1131011
[75] Hobson, R. P. (1990). On the origins of self and the case of autism. DEVELOPMENT
AND PSYCHOPATHOLOGY, 2(2), 163-181. http://dx.doi.org/10.1017/S0954579400000
687
[76] Leslie, A. M., & Frith, U. (1988). Autistic children’s understanding of seeing, knowing and
believing. British Journal of Developmental Psychology, 6, 315324. https://doi.org/10.1
111/j.2044-835x.1988.tb01104.x
[77] Klin, A., & Volkmar, F., & Sparrow, S. (2000). Asperger syndrome. London: Guilford
Publications.
[78] Wing, L., & Gould, J. (1979). Severe impairments of social interaction and associated
abnormalities in children: epidemiology and classification. Journal of Autism and
Developmental Disorders, 9, 1129. https://doi.org/10.1007/bf01531288
[79] Baron-Cohen, S. (2001). Theory of mind and autism: A review. In L. M. Glidden (Ed.),
International review of research in mental retardation: Autism (pp. 169184). San Diego,
CA: Academic Press. https://doi.org/10.1016/s0074-7750(00)80010-5
[80] Heerey, E. A., Keltner, D., & Capps, L. M. (2003). Making sense of self-conscious
emotion: Linking theory of mind and emotion in children with autism. Emotion, 3, 394-
400. https://doi.org/10.1037/1528-3542.3.4.394
[81] Rump, K. M., Giovannelli, J. L., Minshew, N. J., & Strauss, M. S. (2009). The
development of emotion recognition in individuals with autism. Child Development, 80(5),
1434-1447. https://doi.org/10.1111/j.1467-8624.2009.01343.x
[82] Tanaka, J. & Wolf, J. & Klaiman, C. & Koenig, K. & Cockburn, J. & Herlihy, L. &
Brown, C. Stahl, S. & South, M. & McPartland, J. & Kaiser, M. & Schultz, R. (2012), The
perception and identification of facial emotions in individuals with autism spectrum
disorders using the Let’s Face It! Emotion Skills Battery, Journal of Child Psychology and
Psychiatry. https://doi.org/10.1111/j.1469-7610.2012.02571.x
[83] Amaral, D. G., Veazey, R. B., & Cowan, W. M. (1982). Some observations on
hypothalamic-amygdaloid connections in the monkey. Brain Research, 252, 13-27. https://
doi.org/10.1016/0006-8993(82)90974-x
[84] Gallagher M, Chiba AA (1996) The amygdala and emotion. Curr Opin Neurobiol 6:221
227.CrossRefPubMed
[85] Bauman, M. L., & Kemper, T. L. (1994). Neuroanatomic observations of the brain in
autism. In M. L. Bauman & T. L. Kemper (Eds.), The Neurobiology of Autism (pp. 119
145). Baltimore, MD: Johns Hopkins University Press.
[86] Bachevalier, J., Hagger, C., & Mishkin, M. (1991). Functional maturation of the
occipitotemporal pathway in infant rhesus monkeys. In N. A. Lassen, D. H. Ingvar, M. E.
Raichle & I. Friberg (Eds.), Brainwork and mental activityAlfred Benzo
[87] Prather, M. D., Lavenex, P., Mauldin-Jourdain, M. L., Mason, W. A., Capitanio, J. P.,
Mendoza, S. P. & Amaral, D. G. (2001). Increased social fear and decreased fear of objects
in monkeys with neonatal amygdala lesions. Neuroscience, 106, 653 658.
https://doi.org/10.1016/s0306-4522(01)00445-6
[88] Emery, N. J., Capitanio, J. P., Mason, W. A., Machado, C. J., Mendoza, S. P. & Amaral,
D. G. (2001) The effects of bilateral lesions of the amygdala on dyadic social interactions
in rhesus monkeys (Macaca mulatta). Behavioral Neuroscience, 115, 515 544. https://doi.
org/10.1037/0735-7044.115.3.515
iJOE Vol. 16, No. 2, 2020
109
PaperAutism, Expression, and Understanding of Emotions: Literature Review
[89] Vannetzel, L., Chaby, L., Cautru, F., Cohen, D., & Plaza, M. (2011). Neutral versus
emotional human stimuli processing in children with pervasive developmental disorders
not otherwise specified. Research in Autism Spectrum Disorders, 5(2), 775e783.
https://doi.org/10.1016/j.rasd.2010.09.005
[90] Gena, A., Krantz, P.J., Mc Clannahan, L.E. & Pawlson, C.L. (1996).Training and
generalization of affective behavior displayed by youth with autism, Journal of Applied
Behavior Analysis, 29, 291-304. https://doi.org/10.1901/jaba.1996.29-291
[91] Hadwin, J., Baron-Cohen, S., Howlin, P., & Hill, K. (1996). Can we teach children with
autism to understand emotions, beliefs, or pretense? Development and Psychopathology, 8,
345-365. https://doi.org/10.1017/s0954579400007136
[92] Hadwin, J., Baron-Cohen, S., Howlin, P. & Hill, K. (1997). Does teaching theory of mind
have an effect on social communication in children with autism? Journal of Autism and
Developmental Disorders, 27, 519-538. https://doi.org/10.1023/a:1025826009731
[93] Silver, M. & Oakes, P. (2001). Evaluation of a new computer intervention to teach people
with autism or Asperger Syndrome to recognize and predict emotions in others, Autism, 5,
299-316. https://doi.org/10.1177/1362361301005003007
[94] Bauminger, N. (2002). The Facilitation of Social-Emotional Understanding and Social
Interaction in high-functioning children with autism: Intervention outcomes. Journal of
Autism and Developmental Disorders, 32, 283-298. https://doi.org/10.1
023/a:1016378718278
[95] Golan, O., Ashwin, E., Granader, Y., McClintock, S., Day, K., Legget, V., et al. (2010).
Enhancing emotion recognition in children with autism spectrum conditions: an
intervention using animated vehicles with real emotional faces. Journal of Autism and
Developmental Disorders, 40, 269279. https://doi.org/10.1007/s10803-009-0862-9
[96] Baron-Cohen, S. Golan, O., Chapman, E. & Granader, Υ. (2007). Transported into a world
of emotion. The Psychologist, 20 (2), 76-77.
[97] Hopkins, I. M., Gower, M. W., Perez, T. A., Smith, D. S., Amthor, F. R., Wimsatt, F. C.,
& Biasini, F. J. (2011). Avatar assistant: Improving social skills in students with an ASC
through a computer-based intervention. Journal of Autism Development Disorder, 41(11),
15431555. https://doi.org/10.1007/s10803-011-1179-z
[98] Frith, U. (1989). Explaining the enigma. Oxford: Blackwell
[99] Machalicek, W., Rispoli, M., Mulloy, A, Lang, R., & O’Reilly, M., (2012). Computer-
based interventions to improve social and emotional skills in individuals with autism
spectrum disorders: A systematic review. Developmental Neurorehabilitation, Volume 15,
Issue 2, 119-135, https://doi.org/10.3109/17518423.2011.651655
[100] Fernandes, T., Alves, S., Miranda, J., Queir_os, C., & Orvalho, V. (2011). LIFEisGAME:
A facial character animation system to help recognize facial expressions. In Enterprise
information systems (pp. 423e432). Berlin Heidelberg: Springer. https://doi.org/10.1007
/978-3-642-24352-3_44
[101] Tan, C. T., Harrold, N., & Rosser, D. (2013, November). Can you CopyMe?: an expression
mimicking serious game. In SIGGRAPH Asia 2013 symposium on mobile graphics and
interactive applications (p. 73). NewYork: ACM. https://doi.org/10.1
145/2543651.2543657
[102] Serret, S., Hun, S., Iakimova, G., Lozada, J., Anastassova, M., Santos, A., et al.Askenazy,
F. (2014). Facing the challenge of teaching emotions to individuals with low-and high-
functioning autism using a new serious game: A pilot study. Molecular Autism, 5(1), 1.
https://doi.org/10.1186/2040-2392-5-37
[103] Burack, J. A., Iarocci, G., Flanagan, T. D., & Bowler, D. M. (2004). On mosaics and
melting pots: Conceptual considerations of comparison and matching strategies. Journal of
110
http://www.i-joe.org
PaperAutism, Expression, and Understanding of Emotions: Literature Review
Autism and Developmental Disorders, 34(1), 6573. https://doi.org/10.1023/b:
jadd.0000018076.90715.00
[104] Jarrold, C., & Brock, J. (2004). To match or not to match? Methodological issues in
autism-related research. Journal of Autism and Developmental Disorders, 34, 8186. https
://doi.org/10.1023/b:jadd.0000018078.82542.ab
[105] Mervis, C. B., & Klein-Tasman, B. P. (2004). Methodological issues in group-matching
designs: Alpha levels for control variable comparisons and measurement characteristics of
control and target variables: Research methodology matching. Journal of Autism and
Developmental Disorders, 34, 717. https://doi.org/10.1023/b:jadd.0000018069.69562.b8
[106] Yusoff, A. (2010). A conceptual framework for serious games and its validation. Doctoral
dissertation. University of Southampton. Available:http://eprints.soton.ac.uk/17166
3/1hasCoversheetVersion/Thesis_017b.pdf.
[107] Connolly, T. M., Boyle, E. A., MacArthur, E., Hainey, T., & Boyle, J. M. (2012). A
systematic literature review of empirical evidence on computer games and serious games.
Computers & Education, 59(2), 661e686. https://doi.org/10.1016/j.compedu.2012.03.004
[108] Beaumont, R., & Sofronoff, K. (2008). A multi-component social skills intervention for
children with Asperger syndrome: The Junior Detective Training Program. Journal of
Child Psychology and Psychiatry, 49(7), 743e753. https://doi.org/10.1111/j.1469-
7610.2008.01920.x
[109] Golan, O., & Baron-Cohen, S. (2006). Systemizing empathy: Teaching adults with
Asperger syndrome or high-functioning autism to recognize complex emotions using
interactive multimedia. Development and Psychopathology, 18(2), 591.
https://doi.org/10.1017/s0954579406060305
8 Authors
Irene Chaidi is currently working as a special education teacher in Athens,
Greece. She is a Ph.D. Candidate in N.C.S.R. ‘Demokritos’, IIT - Net Media Lab, &
Mind-Brain R & D, Agia Paraskevi, 153 10, Athens, Greece (e-mail:
irhaidi@gmail.com).
Athanasios Drigas is a Research Director at N.C.S.R. “Demokritos”, ΙΙΤ - Net
Media Lab & Mind- Brain R&D, Agia Paraskevi, 153 10, Athens, Greece (e-mail:
dr@iit.demokritos.gr).
Article submitted 2019-10-24. Resubmitted 2019-12-01. Final acceptance 2019-12-03. Final version
published as submitted by the authors.
iJOE Vol. 16, No. 2, 2020
111
... Sixteen of these games attempted to identify or create facial emotions, "although the social skills required in real life include rich combinations of perspective taking, emotional regulation, cognitive flexibility, and appropriate use of language". The game design has concentrated on the core capacity of emotion perception, which enables more advanced types of social skills (Chaidi and Drigas 2020). ...
Article
Full-text available
Autism spectrum disorder (ASD) has a significant impact on a person's social, emotional, and communication functioning. According to research, individualized instruction can significantly improve these deficits. One of the most successful methods of achieving this outcome is by gaming platforms that provide serious games (SGs). This article is a systematic review study using the PRISMA diagram that delves into current research on the characteristics and design criteria of serious gaming platforms suitable for people with autism, presenting the benefits of using serious gaming platforms and highlighting the importance of differentiated strategy and planning, as well as disadvantages such as financial cost and complexity. According to the conclusions of this analysis, the bulk of these programs focus on prototyping and strengthening social and emotional abilities. It is also emphasized that platforms aiming at a bigger audience of persons with ASD, as well as a larger sample size, are required.
... It appears that this sex difference persists in autistic populations despite overall reduced TEI among autistic adults. Autistic females seemingly receive conflicting socialization around emotional intelligence such that they are expected to have greater capacity in this area due to their sex while simultaneously being expected to have some level of impairment due to their autism (Chaidi & Drigas, 2020;Garaigordobil, 2020;Sanchez-Nunez et al., 2008). Based on the pattern of results reported herein, it seems that social learning and reinforcement around autism may be more salient or influential than social learning and reinforcement around sex such that autistic females rate their TEI abilities higher than autistic males but lower than non-autistic males. ...
Article
Full-text available
Autism spectrum disorder (ASD) is associated with differences in social communication, and these differences are related to trait emotional intelligence (TEI), alexithymia, and empathy. Autism is known to present differently in males and females, but research on sex differences in TEI, alexithymia, and empathy is largely relegated to non-autistic people. Therefore, the current research sought to explore individual relationships between autistic characteristics and TEI, alexithymia, and empathy, as well as the possible influence of sex in these relationships. In the current study, autistic and non-autistic adults reported on their autistic characteristics, TEI, alexithymia, and empathy. Based on previous research, it was hypothesized that more autistic characteristics would be associated with less TEI, more alexithymia, and less empathy, and that these relationships would be more prominent amongst males. More autistic characteristics were associated with greater challenges across the three areas of interest. However, only the relationship between TEI and autistic characteristics was moderated by sex, such that males demonstrated higher support needs related to TEI than females. Results from this analysis indicate that adults with more autistic characteristics, regardless of diagnostic status, demonstrate differences in TEI, alexithymia, and empathy. The current analysis may offer additional context to the evolving understanding of empathy and autism by suggesting that TEI and alexithymia could account for differences in empathy. Moreover, sex seems to play a role in the relationship between autistic characteristics and TEI such that differences are especially prominent for males.
... Khan et al. propose a neural network approach combined with sequential feed-forward selection for ASD classification, showcasing the advancements in neural network methodologies for this application [9]. Chaidi and Drigas reviewed the application of ML in the context of emotional expression and understanding in individuals with ASD, highlighting the potential of ML to address the social and emotional challenges associated with ASD [10]. Rahman et al. examine various ML methods for feature selection and classification in ASD, providing insights into effective techniques for managing ASD data and improving classification accuracy [11]. ...
... Autistic students are less likely to receive sexual education and report feeling that the sexual education they do receive is inadequate (Barnett & Maticka-Tyndale, 2015;Hancock et al., 2017). Prior literature has also indicated that communication between autistic and non-autistic individuals tends to be more difficult than within-neurotype communication (Chaidi & Drigas, 2020;Crompton et al., 2020;Cummins et al., 2020;Sheppard et al., 2016;Ying Sng et al., 2018). The precise differences in communication style between autistic and non-autistic students have been difficult to determineas findings are often contradictory, and there is significant individual variation (Ying Sng et al., 2018). ...
Article
Full-text available
Adults entering college, especially autistic individuals, may have a higher likelihood of unwanted or distressing sexual experiences. Additionally, autistic adults appear to endorse dissatisfying sexual education experiences and difficulties with consent cues. The current mixed-methods study examined the types of consent cues college students rely on and potential barriers to seeking sexual consent. We combined data from two studies of undergraduate students: 1) an in-person cross-sectional study exploring conceptualizations and interpretations of consent in autistic and non-autistic young adults (n = 30), and 2) an online, short-term longitudinal study examining predictors of mood concerns in neurodiverse students transitioning into their first semester at 4 northeastern United States university systems in Fall 2022 and 2023 (n = 230). In-person participants completed a semi-structured interview asking about consent expression and interpretation. Participants from both studies completed self-report surveys measuring autistic traits, attitudes and perceptions toward sexual consent, and sexual education history. Qualitative analysis suggested students preferred to rely on explicit verbal consent, but felt they were unusual for doing so. In contrast, quantitatively, students across both studies expressed comfort with explicit verbal consent, to a high and similar degree. Further research may benefit from investigating differences between young adults' perceived and actual sexual consent preferences of peers, with attention to neurodivergent individuals.
Article
Deficits in social cognition underlie many of the profound challenges individuals with autism spectrum disorder face interacting with and understanding others. This study aimed to evaluate abilities predicting behavioral, verbal, and emotional responses during simulated social scenarios in 42 autistic children. Additionally, communication patterns were analyzed across solitary, peer, and group settings. A multifaceted assessment battery including the “prognostic stories” technique, expert observational ratings, cultural congruence metrics, and activity mapping provided insights into participants’ capacity forecasting actions, statements, and feelings in interpersonal situations. Results revealed marked variability across skill domains, with greatest impairments anticipating emotions. Communication quality and self-regulation strongly correlated with predictive accuracy. Cluster analysis indicated four distinct functional profiles (“proactive planners”, “regulatory navigators”, “quiet observers”, and “balanced responders”) highlighting heterogeneous strengths warranting support. Despite challenges inferring psychological states, personalized interventions targeting highly correlated skill deficits offer optimal social adaptation. Findings reiterate calls for balanced approaches recognizing autistic diversity while compassionately addressing barriers to inclusion. With acceptance and opportunity, individuals across the spectrum have much to contribute. Limitations include sample size and gender imbalance. Follow-up longitudinal tracking is warranted.
Article
Full-text available
The importance of money in people's lives today is an important and useful skill for individuals in a transactional society. Money management is a communication, transaction, and socialization skill. People with special educational needs and especially people with mental retardation with the right training can develop the skill of recognizing and using money. Differentiated teaching with the help of ICTs is an educational approach to knowledge suitable for teaching people without or with special educational needs.
Preprint
Full-text available
The Complex Emotion Recognition System (CERS) deciphers complex emotional states by examining combinations of basic emotions expressed, their interconnections, and the dynamic variations. Through the utilization of advanced algorithms, CERS provides profound insights into emotional dynamics, facilitating a nuanced understanding and customized responses. The attainment of such a level of emotional recognition in machines necessitates the knowledge distillation and the comprehension of novel concepts akin to human cognition. The development of AI systems for discerning complex emotions poses a substantial challenge with significant implications for affective computing. Furthermore, obtaining a sizable dataset for CERS proves to be a daunting task due to the intricacies involved in capturing subtle emotions, necessitating specialized methods for data collection and processing. Incorporating physiological signals such as Electrocardiogram (ECG) and Electroencephalogram (EEG) can notably enhance CERS by furnishing valuable insights into the user's emotional state, enhancing the quality of datasets, and fortifying system dependability. A comprehensive literature review was conducted in this study to assess the efficacy of machine learning, deep learning, and meta-learning approaches in both basic and complex emotion recognition utilizing EEG, ECG signals, and facial expression datasets. The chosen research papers offer perspectives on potential applications, clinical implications, and results of CERSs, with the objective of promoting their acceptance and integration into clinical decision-making processes. This study highlights research gaps and challenges in understanding CERSs, encouraging further investigation by relevant studies and organizations. Lastly, the significance of meta-learning approaches in improving CERS performance and guiding future research endeavors is underscored.
Article
Full-text available
Autistic people need continuous assistance in order to improve their quality of life, and chatbots are one of the technologies that can provide this today. Chatbots can help with this task by providing assistance while accompanying the autist. The chatbot we plan to develop gives to autistic people an immediate personalized recommendation by determining the autist’s state, intervene with him and build a profil of the individual that will assist medical professionals in getting to know their patients better so they can provide an individualized care. We attempted to identify the emotion from the image's face in order to gain an understanding of emotions. Deep learning methods like Convolutional neural networks and Vision Transformers could be compared using the FER2013. After optimization, CNN achieved 74% accuracy, whereas the VIT achieved 69%. Given that there is not a massive dataset of autistic individuals accessible, we combined a dataset of photos of autistic people from two distinct sources and used the CNN model to identify the relevant emotion. Our accuracy rate for identifying emotions on the face is 65%. The model still has some identification limitations, such as misinterpreting some emotions, particularly "neutral," "surprised," and "angry," because these emotions and facial traits are poorly expressed by autistic people, and because the model is trained with imbalanced emotion categories.
Article
Full-text available
Due to the clear weakness suffered by children with autism spectrum disorder in communication in general and verbal and non-verbal communication in particular, as well as social communication, which results in the emergence of some behavioral problems in these children, the research aimed to discuss the impact of using Picture Exchanging Communication System (PECS) on improving communication skills (verbal, non-verbal and social) for children with autism spectrum disorder, and the research relied on the semi-experimental approach, and the study tools were represented in Picture Exchanging Communication System (PECS) and the scale of communication skills for autism spectrum disorder, using statistical analysis to analyze data using the Wilcoxon test as one of the methods, and the research community reached (184) autistic children enrolled in integration schools and schools of guidance for people with special needs in the State of Qatar, using a random sample of (14) children, and one group was used, where the experimental group underwent the pre-test, and the experimental period was represented in the application of the program to the experimental group for 40 training sessions, and after the application of the program, the two experimental groups underwent the post-test, and the results of the research showed that there were clear and statistically significant differences at the level of significance (0.01) between the average scores of the experimental group on the scale of communication skills for autism spectrum disorder and these results were in favor of the post-test, as the results showed that there were no clear and significant differences at the level of significance (0.05) between the average scores of the experimental group on the scale of communication skills for autism spectrum disorder in post-test and tracking test, and the results confirmed the importance of training nonspeaking children with autism spectrum disorder (PECS) in order to improve their communication skills.
Article
Full-text available
The role of the amygdala in dyadic social interactions of adult rhesus monkeys (Macaca mulatta) was assessed after bilateral ibotenic acid lesions. Social, nonsocial, and spatial behaviors of amygdalectomized and control monkeys were assessed in 3 dyadic experiments: constrained, unconstrained, and round robin. Lesions produced extensive bilateral damage to the amygdala. Across all experiments, the amygdalectomized monkeys demonstrated increased social affiliation, decreased anxiety, and increased confidence compared with control monkeys, particularly during early encounters. Normal subjects also demonstrated increased social affiliation toward the amygdalectomized subjects. These results indicate that amygdala lesions in adult monkeys lead to a decrease in the species-normal reluctance to immediately engage a novel conspecific in social behavior. The altered behavior of the amygdalectomized monkeys may have induced the increased social interactions from their normal companions. This is contrary to the idea that amygdalectomy produces a decrease in social interaction and increased aggression from conspecifics.
Article
Full-text available
Emotional Intelligence (EI) has been an important and controversial topic during the last few decades. Its significance and its correlation with many domains of life has made it the subject of expert study. EI is the rudder for feeling, thinking, learning, problem-solving, and decision-making. In this article, we present an emotional–cognitive based approach to the process of gaining emotional intelligence and thus, we suggest a nine-layer pyramid of emotional intelligence and the gradual development to reach the top of EI.
Article
Full-text available
In this article, the author describes a new theoretical perspective on positive emotions and situates this new perspective within the emerging field of positive psychology. The broaden-and-build theory posits that experiences of positive emotions broaden people's momentary thought-action repertoires, which in turn serves to build their enduring personal resources, ranging from physical and intellectual resources to social and psychological resources. Preliminary empirical evidence supporting the broaden-and-build theory is reviewed, and open empirical questions that remain to be tested are identified. The theory and findings suggest that the capacity to experience positive emotions may be a fundamental human strength central to the study of human flourishing.
Conference Paper
Full-text available
This article presents the LIFEisGAME project, a serious game that will help children with ASDs to recognize and express emotions through facial expressions. The game design tackles one of the main experiential learning cycle of emotion recognition: recognize and mimic (game mode: build a face). We describe the technology behind the game, which focus on a character animation pipeline and a sketching algorithm. We detailed the facial expression analyzer that is used to calculate the score in the game. We also present a study that analyzes what type of characters children prefer when playing a game. Last, we present a pilot study we have performed with kids with ASD.
Thesis
The topic of this thesis is the recognition and expression of pride, guilt, shame and coyness by children with autism. It was hypothesised that these self-conscious emotions develop through a child's ability to identify with others' attitudes towards the self and that children with autism have a limited ability to identify with others this way. Correspondingly, it is expected that they will be limited in their ability to express and perhaps experience these emotions. The series of studies presented in this thesis investigate the recognition and expression of these self- conscious emotions in children with autism, relative to a chronological and verbal age matched group of children without autism. In the first study, parents were asked to describe a range of socio-emotional behaviour of their children with autism. The second study focused on parent reports of the expression of pride, guilt and shame in their children. The third study examined participants' recognition of these emotions in video-clips of enacted scenarios. Participants were then interviewed to explore their own experiences of pride, guilt and shame. Finally situations were designed to elicit pride, guilt and coyness in participants and their responses were recorded and rated. The results from the studies offer substantial but qualified support for the hypothesis. Collectively, they present a complex picture of both spared and impaired aspects of pride, guilt, shame and coyness in children with autism.
Article
The use of information communication technologies (ICTs) in therapy offers new perspectives for treating many domains in individuals with autism spectrum disorders (ASD) because they can be used in many different ways and settings and they are attractive to the patients. We reviewed the available literature on serious games that are used to teach social interactions to individuals with ASD. After screening the Medline, Science Direct and ACM Digital Library databases, we found a total of 31 serious games: 16 that targeted emotion recognition or production and 15 that targeted social skills. There was a significant correlation between the number of reports per year and the year of publication. Serious games appeared promising because they can support training on many different skills and they favour interactions in diverse contexts and situations, some of which may resemble real life. However, the currently available serious games exhibit some limitations: (i) most of them are developed for High-Functioning individuals; (ii) their clinical validation has rarely met the evidence-based medicine standards; (iii) the game design is not usually described; and, (iv) in many cases, the clinical validation and playability/game design are not compatible. Future research agendas should encompass (i) more robust studies in terms of methodology (large samples, control groups, longer treatment periods, follow-up to assess whether changes remain stable, etc.) to assess serious game efficacy; (ii) more collaboration between clinical and computer/game design experts; and (iii) more serious games that are adapted to Low-Functioning ASD individuals.
Article
In this study we establish that autistic children have severe and specific difficulty with understanding mental states. Even with a mental age of 7 years, these children mostly fail in tasks which are normally passed around age 3 and 4. We confirm previous results on the poor understanding of false belief but also find that autistic children's grasp of the notion of limited knowledge is grossly delayed. We rule out various other explanations for these results and further show that the autistic child's performance is not limited by failure to understand the causal notion of seeing. Likewise, memory failure cannot be blamed. Language delay can be ruled out as a cause of failure since a group of children with specific language impairment, matched for verbal mental age, performed at ceiling. We propose that autistic children are specifically impaired in their meta-representational capacity and that this impedes their construction of a ‘theory of mind’.