Alessandro Vinciarelli

Alessandro Vinciarelli
University of Glasgow | UofG · School of Computing Science

PhD (University of Bern)

About

279
Publications
69,207
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
7,459
Citations
Introduction
Skills and Expertise
Additional affiliations
August 2017 - present
University of Glasgow
Position
  • Professor (Full)
January 2010 - present
University of Glasgow
Position
  • Professor (Associate)
September 1999 - December 2009
Idiap Research Institute
Position
  • Senior Researcher

Publications

Publications (279)
Article
This paper investigates effects of participants’ gender and age (adolescents, young adults, and seniors), robots’ gender (male and female robots) and appearance (humanoid vs android) on robots’ acceptance dimensions. The study involved 6 differently aged groups of participants (two adolescents, two young adults and two seniors’ groups, for a total...
Chapter
Full-text available
This work aims to suggest a research agenda for dementia, connecting the latest clinical understanding of such neurodegenerative disorders, with social behavioral changes and social cognitive impairments. The proposed framework considers the manual and automatized analysis of behavioral and biometric data involving caregivers, patients, and healthc...
Article
Full-text available
Considered the increasing use of assistive technologies in the shape of virtual agents, it is necessary to investigate those factors which characterize and affect the interaction between the user and the agent, among these emerges the way in which people interpret and decode synthetic emotions, i.e., emotional expressions conveyed by virtual agents...
Conference Paper
Full-text available
The question at the core of this work is whether it is possible to infer self-assessed personality traits from keystroke dynamics (the way people type on a keyboard). The experiments were performed over a corpus of 30 dyadic chats, 60 participants in total, collected through a text-based chat interface similar to those available in popular products...
Article
Full-text available
Currently, the diagnosis of major depressive disorder (MDD) and its subtypes is mainly based on subjective assessments and self-reported measures. However, objective criteria as Electroencephalography (EEG) features would be helpful in detecting depressive states at early stages to prevent the worsening of the symptoms. Scientific community has wid...
Article
Background: Attachment research has been limited by the lack of quick and easy measures. We report development and validation of the School Attachment Monitor (SAM), a novel measure for largescale assessment of attachment in children aged 5-9, in the general population. SAM offers automatic presentation, on computer, of story-stems based on the Ma...
Chapter
Gender plays a fundamental role in human–human interaction. The availability of nonverbal behavioural cues such as facial expressions, eye gaze, and gestures in face-to-face interaction allows one to recognise the gender of others easily. In addition, all cultures provide further cues to distinguish between genders, like different clothes, hairstyl...
Article
Full-text available
Depression is one of the most common mental health issues. (It affects more than 4% of the world’s population, according to recent estimates.) This article shows that the joint analysis of linguistic and acoustic aspects of speech allows one to discriminate between depressed and nondepressed speakers with an accuracy above 80%. The approach used in...
Preprint
Full-text available
Background Attachment research has been limited by the lack of quick and easy measures. We report development and validation of the School Attachment Monitor (SAM), a novel measure for largescale assessment of attachment in children aged 5-9, in the general population. SAM offers automatic presentation, on computer, of story-stems based on the Manc...
Article
Full-text available
We propose a filtering feature selection framework that considers subsets of features as paths in a graph, where a node is a feature and an edge indicates pairwise (customizable) relations among features, dealing with relevance and redundancy principles. By two different interpretations (exploiting properties of power series of matrices and relying...
Chapter
In this chapter we are presenting an overview on how adaptation of movement and behaviour can favour communication in Human-Robot Interaction (HRI). A model of a communication space based on a action-reaction classification is presented. Past research in HRI is presented for verbal, non-verbal and adaptation of communication. Further, the influence...
Article
Full-text available
One of the main and most effective measures to contain the recent viral outbreak is the maintenance of the so-called Social Distancing (SD). To comply with this constraint, governments are adopting restrictions over the minimum inter-personal distance between people. Given this actual scenario, it is crucial to massively measure the compliance to s...
Preprint
Full-text available
We propose a filtering feature selection framework that considers subsets of features as paths in a graph, where a node is a feature and an edge indicates pairwise (customizable) relations among features, dealing with relevance and redundancy principles. By two different interpretations (exploiting properties of power series of matrices and relying...
Preprint
One of the main and most effective measures to contain the recent viral outbreak is the maintenance of the so-called Social Distancing (SD). To comply with this constraint, workplaces, public institutions, transports and schools will likely adopt restrictions over the minimum inter-personal distance between people. Given this actual scenario, it is...
Conference Paper
Full-text available
Humans are used to express their feelings of self-confidence/powerfulness or their distress/sadness through either expansive postures that occupy as much space as possible or closing postures occupying as less space as possible to avoid contact. This conduct suggests that feelings of self-confidence/powerfulness or distress/sadness change our body...
Article
Full-text available
This article analyzes the interplay between gender and keystroke dynamics, i.e., the way people type as opposed to what they type. In particular, the experiments show that people of different gender tend to type differently when they interact through live-chat interfaces like those available in popular products such as Whatsapp or Skype. The analys...
Article
This work shows that fillers - short utterances like "ehm" and "uhm" - allow one to predict whether someone is above median along the Big-Five personality traits. The experiments have been performed over a corpus of 2,988 fillers uttered by 120 different speakers in spontaneous conversations. The results show that the prediction accuracies range be...
Chapter
This article presents an observational study about the choice of Higher Education of 4,885 prospective students attending an Open Day organised by the University of Glasgow. In particular, this work analyses the distribution of the preferences across the 109 subjects (e.g., Mechanical Engineering, English Literature, etc.) that have been presented...
Conference Paper
This article presents the School Attachment Monitor, a novel interactive system that can reliably administer the Manchester Child Attachment Story Task (a standard psychiatric test for the assessment of attachment in children) without the supervision of trained professionals. Attachment problems in children cause significant mental health issues an...
Conference Paper
Designing technology for problem-free operation is vital, but equally important is considering how a user may understand or act upon errors and various other 'stuck' situations if and when they occur. Little is currently known about what children think and want for overcoming errors. In this paper we report on design-for-error workshops with childr...
Conference Paper
This work analyses the relationship between the way robots gesture and the way those gestures are perceived by human users. In particular, this work shows how modifying the amplitude and speed of a gesture affect the Godspeed scores given to those gestures, by means of an experiment involving 45 stimuli and 30 observers. The results suggest that sh...
Conference Paper
Full-text available
Humans are used to express their feelings of self-confidence/powerfulness or their distress/sadness through either expansive postures that occupy as much space as possible or closing postures occupying as less space as possible to avoid contact. This conduct suggests that feelings of self-confidence/powerfulness or distress/sadness change our body...
Chapter
Full-text available
This paper investigates the acoustical and perceptual speech features that differentiate a depressed individual from a healthy one. The speech data gathered was a collection from both healthy and depressed subjects in the Italian language, each comprising of a read and spontaneous narrative. The pre-processing of this dataset was done using Mel Fre...
Preprint
Full-text available
This article proposes an automatic approach-based on non-verbal speech features-aimed at the automatic discrimination between depressed and non-depressed speakers. The experiments have been performed over one of the largest corpora collected for such a task in the literature (62 patients diagnosed with depression and 54 healthy control subjects), e...
Poster
Full-text available
Difficulties in decoding emotions have been widely studied for Major Depressive Disorder patients. The reason is that incorrect decoding of other’s emotions causes inappropriate behavioral and emotional responses. However, to the best of our knowledge, no major studies are available for patients affected by Adjustment Disorder (AD) with Depressed M...
Article
In this article, we review the INTERSPEECH 2013 Computational Paralinguistics ChallengE (ComParE) – the first of its kind – in light of the recent developments in affective and behavioural computing. The impact of the first ComParE instalment is manifold: first, it featured various new recognition tasks including social signals such as laughter and...
Conference Paper
Cognitive and psychological processes underlying social interaction are built around face-to-face interactions, the only possible and available communication setting during the long evolutionary process that has resulted into Homo Sapiens. As the fraction of interactions that take place in technology mediated settings keeps increasing, it is import...
Conference Paper
Full-text available
Secure Attachment relationships have been shown to minimise social and behavioural problems in children and boosts resilience to risks such as antisocial behaviour, heart pathologies, and suicide later in life. Attachment assessment is an expensive and time-consuming process that is not often performed. The School Attachment Monitor (SAM) automates...
Conference Paper
Full-text available
This paper outlines a demonstration of the work carried out in the SoCoRo project investigating how far a neuro-typical population recognises facial expressions on a non-naturalistic robot face that are designed to show approval and disapproval. RFID-tagged objects are presented to an Emys robot head (called Alyx) and Alyx reacts to each with a fac...
Conference Paper
In this demonstration we present a repertoire of social signals generated by the humanoid robot Pepper in the context of the EU-funded project MuMMER. The aim of this research is to provide the robot with the expressive capabilities required to interact with people in real-world public spaces such as shopping malls-and being able to control the non...
Conference Paper
Humans are wired for face-to-face interaction because this was the only possible and available setting during the long evolutionary process that has led to Homo Sapiens. At the moment an increasingly significant fraction of our interactions take place in technology mediated settings, it is important to investigate how such a wiring - mainly corresp...
Conference Paper
Full-text available
Feature selection is playing an increasingly significant role with respect to many computer vision applications spanning from object recognition to visual object tracking. However, most of the recent solutions in feature selection are not robust across different and heterogeneous set of data. In this paper, we address this issue proposing a robust...
Article
A synthetic voice personifies the system using it. In this work we examine the impact text content, voice quality and synthesis system have on the perceived personality of two synthetic voices. Subjects rated synthetic utterances based on the Big-Five personality traits and naturalness. The naturalness rating of synthesis output did not correlate s...
Article
This special section focuses on the introduction, presentation, and discussion of novel techniques that further develop and apply affective reasoning tools and techniques for big social data analysis. A key motivation for this special section, in particular, is to explore the adoption of novel affective reasoning frameworks and cognitive learning s...
Conference Paper
Full-text available
Secure Attachment relationships have been shown to minimise social and behavioural problems in children and boosts resilience to risks later on such as antisocial behaviour, heart pathologies, and suicide. Attachment assessment is an expensive and time-consuming process that is not often performed. The School Attachment Monitor (SAM) automates Atta...
Conference Paper
Full-text available
This paper presents Perceptual Control Theory-a model that explains behaviour as an attempt to keep sensory inputs in a desired range and demonstrates that it can be used to develop an approach designed to make robots capable of human interaction. In particular, we present an approach that embodies the most salient features of the theory through a...
Chapter
Introduction According to the Oxford Dictionary of Sociology, “Role is a key concept in sociological theory. It highlights the social expectations attached to particular social positions and analyses the workings of such expectations” (Scott & Marshall, 2005). Furthermore, “Role theory concerns one of the most important features of social life, cha...
Conference Paper
Flickr allows its users to generate galleries of "faves", i.e., pictures that they have tagged as favourite. According to recent studies, the faves are predictive of the personality traits that people attribute to Flickr users. This article investigates the phenomenon and shows that faves allow one to predict whether a Flickr user is perceived to b...
Article
Full-text available
Most studies investigating the processing of emotions in depressed patients reported impairments in the decoding of negative emotions. However, these studies adopted static stimuli (mostly stereotypical facial expressions corresponding to basic emotions) which do not reflect the way people experience emotions in everyday life. For this reason, this...
Conference Paper
Full-text available
In the last decade, new ways of shopping online have increased the possibility of buying products and services more easily and faster than ever. In this new context, personality is a key determinant in the decision making of the consumer when shopping. A per-son's buying choices are influenced by psychological factors like impulsiveness; indeed som...
Chapter
Social signal processing is the domain aimed at modelling, analysis and synthesis of nonverbal communication in human–human and human–machine interactions. The core idea of the field is that common nonverbal behavioural cues—facial expressions, vocalizations, gestures, postures, etc—are the physical, machine-detectable evidence of social phenomena...
Chapter
Research agendas aimed at the development of socially believable behaving systems often indicate automatic social perception as one of the steps. However, the exact meaning of the word “perception” seems still to be unclear in the computing community, in particular when it applies to social and psychological phenomena that are not accessible to dir...
Chapter
This paper investigates whether and how depressive disorders affect speech and in particular timing strategies for speech pauses (empty and filled pauses, as well as, phoneme lengthening). The investigation is made exploiting read and spontaneous narratives . The collected data are from 24 subjects, divided into two groups (depressed and control) a...
Chapter
The computing community shows significant interest for the detection of mimicry , one of the names designating the tendency of interacting people to converge towards common behavioural patterns. This work shows experiments where speaker verification techniques, originally designed to detect fraudulent attempts to imitate others, are used to automat...
Article
Flickr allows its users to tag the pictures they like as “favorite”. As a result, many users of the popular photo-sharing platform produce galleries of favorite pictures. This article proposes new approaches, based on Computational Aesthetics, capable to infer the personality traits of Flickr users from the galleries above. In particular, the appro...
Chapter
Full-text available
Studies investigating on the ability of depressed patients to decode emotional expressions have mostly exploited static stimuli (i.e., static facial expressions of basic emotions) showing that (even though this was not always the case) depressed patients are less accurate (in literature this is reported as a bias) in decoding negative emotions (fea...
Article
Full-text available
The main motivations behind the webcasting company, Klewel, were to go beyond text-based conference proceedings to offer a user-friendly way to browse and replay presentations, access slides, and search for specific information within a recording. As the project got under way, the team came together, and eventually an innovative webcasting solution...
Conference Paper
Full-text available
The tendency to unconsciously imitate others in conversations has been referred to as mimicry, accommodation, interpersonal adaptation, etc. During the last few years, the computing community has made significant efforts towards the automatic detection of the phenomenon, but a widely accepted approach is still missing. Given that mimicry is the unc...
Conference Paper
Full-text available
The work presented here suggests a method for assessing speech accommodation in a holistic acoustic manner by utilising Hidden Markov Models (HMMs). The rationale for implementation of this method is presented along with an explanation of how HMMs work. Here, a heavily simplified HMM is used (single state; mixture of gaussians) in order to assess t...
Chapter
What the reader should know to understand this chapter • Notions of calculus. • Chapters 5, 6, and 7. • Although the reading of Appendix D is not mandatory, it represents an advantage for the chapter understanding.
Chapter
What the reader should know to understand this chapter · Basic notions of image processing (Chap. 3). · Support vectors machines and kernel methods (Chap. 9). · Principal component analysis (Chap. 11).
Chapter
What the reader should know after reading in this chapter \(\bullet \) Supervised learning, \(\bullet \) Unsupervised learning, \(\bullet \) Semi-supervised learning, \(\bullet \) Reinforcement learning.
Chapter
What the reader should know to understand this chapter • Bayes decision theory (Chap. 5). • Lagrange multipliers and conditional optimization problems (Chap. 9). • Probability and statistics (Appendix A).
Chapter
What the reader should know to understand this chapter · Basic notions of speech processing (Chap. 2). · Classification techniques (Chap. 8).
Chapter
What the reader needs to understand this chapter • Notions of calculus. • The fourth chapter.
Chapter
What the reader should know to understand this chapter \(\bullet \) Basic notions of machine learning. \(\bullet \) Notions of calculus. \(\bullet \) Chapter 5.
Chapter
What the reader should know to understand this chapter \(\bullet \) Basic notions of statistics and probability theory (see Appendix A). \(\bullet \) Calculus notions are an advantage.
Chapter
What the reader should know to understand this chapter Basic notions of calculus and linear algebra. Basic notions of machine learning. Programming skills to implement some computer projects proposed in the Problems section.
Chapter
What the reader should know to understand this chapter Elementary notions of optics and physics. Basic notions of mathematics.
Chapter
What the reader should know to understand this chapter \(\bullet \) Basic notions of image processing (Chap. 3). \(\bullet \) Clustering techniques (Chap. 6).
Chapter
What the reader should know to understand this chapter · Color Models (Chap. 3). · Learning Vector Quantization (Chap. 8).
Chapter
What the reader should know to understand this chapter• Fundamentals of machine learning (Chap. 4).
Chapter
What the reader should know to understand this chapter Basic notions of physics. Basic notions of calculus (trigonometry, logarithms, exponentials, etc.)
Chapter
What the reader should know to understand this chapter Hidden Markov models (Chap. 10). Language models (Chap. 10). Bayes decision theory (Chap. 3).
Article
Full-text available
Modelling, analysis and synthesis of behaviour are the subject of major efforts in computing science, especially when it comes to technologies that make sense of human-human and human-machine interactions. This article outlines some of the most important issues that still need to be addressed to ensure substantial progress in the field, namely (1)...
Article
Social signal processing (SSP) is the domain aimed at the modeling, analysis, and synthesis of social behavior, particularly the nonverbal aspects. So far, the field has focused on face-to-face interactions, where it is possible to use the whole range of nonverbal cues that people have at their disposal to communicate (i.e., gestures, facial expres...