Pattie Maes

Pattie Maes
Massachusetts Institute of Technology | MIT · School of Architecture and Planning

Professor

About

465
Publications
104,369
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
29,104
Citations

Publications

Publications (465)
Preprint
Full-text available
Chills are a peak emotional experience induced by stimuli such as music, films, and speeches. The emotional consequences of chills in terms of valence and arousal are still debated and the existing empirical data is conflicting. In this study, we tested the effects of ChillsDB, an open-source repository of chills-inducing stimuli, on the emotional...
Preprint
Full-text available
We introduce ChillsDB, the first validated database of audiovisual stimuli eliciting aesthetic chills (goosebumps, psychogenic shivers) in a US population. To discover chills stimuli “in the wild”, we devised a bottom-up, ecologically-valid method consisting in searching for mentions of the emotion's somatic markers in user comments throughout soci...
Preprint
Full-text available
Our surrounding environment impacts our cognitive-emotional processes on a daily basis and shapes our physical, psychological and social wellbeing. Although the effects of the built environment on our psycho-physiological processes are well studied, virtual environment design with a potentially similar impact on the user, has received limited atten...
Article
Full-text available
Headworn Virtual Reality technologies which engage the eyes and ears to transport the user to a new reality are, by definition, disembodied: They take the mind somewhere the body cannot follow. This creates two schisms simultaneously: first, the head is separated from the body; second, the senses of sight and hearing are incongruent with touch, int...
Article
The vision of extended reality (XR) systems is living in a world where real and virtual elements seamlessly and contextually augment experiences of ourselves and the worlds we inhabit. While this integration promises exciting opportunities for the future of XR, it comes with the risk of experiential distortions and feelings of dissociation, especia...
Conference Paper
We are now entering the new space age! In 2021, for the first time in history that there is civilian crew in space, demonstrating the next frontier of human space exploration that will not be restricted to highly trained astronauts but will be open to a more general public. However, keeping a human healthy, happy and productive in space is one of t...
Article
Full-text available
Ezzence is the first smartphone-controlled olfactometer designed for both day and night conditions. We discuss the design and technical implementation of Ezzence and report on a study to evaluate the feasibility of using the device in home-based sleep environments. The study results (N = 40) show that participants were satisfied with the device and...
Preprint
Full-text available
Technology based screentime, the time an individual spends engaging with their computer or cell phone, has increased exponentially over the past decade, but perhaps most alarmingly amidst the COVID-19 pandemic. Although many software based interventions exist to reduce screentime, users report a variety of issues relating to the timing of the inter...
Article
Nonverbal vocalizations from non- and minimally speaking individuals (mv*) convey important communicative and affective information. While nonverbal vocalizations that occur amidst typical speech and infant vocalizations have been studied extensively in the literature, there is limited prior work on vocalizations by mv* individuals. Our work is amo...
Article
Advancements in machine learning have recently enabled the hyper-realistic synthesis of prose, images, audio and video data, in what is referred to as artificial intelligence (AI)-generated media. These techniques offer novel opportunities for creating interactions with digital portrayals of individuals that can inspire and intrigue us. AI-generate...
Article
Full-text available
Neurotechnologies combine neuroscience and engineering to create tools for studying, repairing, and enhancing brain function. Traditionally, researchers have used neurotechnologies, such as Brain-Computer Interfaces (BCIs), as assistive devices, for example to allow locked-in patients to communicate. In the last few decades, non-invasive brain imag...
Preprint
Full-text available
Video represents the majority of internet traffic today leading to a continuous technological arms race between generating higher quality content, transmitting larger file sizes and supporting network infrastructure. Adding to this is the recent COVID-19 pandemic fueled surge in the use of video conferencing tools. Since videos take up substantial...
Chapter
Behavior change research usually takes a theory-driven or application-specific approach. We took a user-centered view of real-world user needs and conducted a survey with 53 participants to investigate the overall behavior change goals and support preferences of everyday users. Our survey revealed three key themes. First, individual users have mult...
Chapter
Full-text available
Habits are automatic actions in stable contexts and can help sustain behavior change. State-of-the-art context-aware habit-support interventions are, however, in predominantly non-visual contexts (time, geolocation, and physical activity), and not in egocentric visual contexts, e.g., eating, meeting people, etc. Using a survey, N = 51 participants,...
Preprint
Data-efficiency and generalization are key challenges in deep learning and deep reinforcement learning as many models are trained on large-scale, domain-specific, and expensive-to-label datasets. Self-supervised models trained on large-scale uncurated datasets have shown successful transfer to diverse settings. We investigate using pretrained image...
Preprint
Self-supervised or weakly supervised models trained on large-scale datasets have shown sample-efficient transfer to diverse datasets in few-shot settings. We consider how upstream pretrained models can be leveraged for downstream few-shot, multilabel, and continual learning tasks. Our model CLIPPER (CLIP PERsonalized) uses image representations fro...
Preprint
Full-text available
Egocentric visual context detection can support intelligence augmentation applications. We created a wearable system, called PAL, for wearable, personalized, and privacy-preserving egocentric visual context detection. PAL has a wearable device with a camera, heart-rate sensor, on-device deep learning, and audio input/output. PAL also has a mobile/w...
Article
The problem of missing data has been persistent for a long time and poses a major obstacle in machine learning and statistical data analysis. Past works in this field have tried using various data imputation techniques to fill in the missing data, or training neural networks (NNs) with the missing data. In this work, we propose a simple yet effecti...
Conference Paper
Full-text available
Microbe-HCI is a community whose works implicate micro-organisms in HCI. This special interest group is a venue for the first gathering of the community, offering an opportunity for networking and structured discussions. It encourages participation from both active and new researchers to microbe-HCI, with the objective of acquiring an overview of p...
Conference Paper
Space travel and becoming an interplanetary species have always been part of human's greatest imagination. Research in space exploration helps us advance our knowledge in fundamental sciences, and challenges us to design new technology and create new industries for space. However, keeping a human healthy, happy and productive in space is one of the...
Conference Paper
Full-text available
The home is a place of shelter, a place for family, and for separation from other parts of life, such as work. Global challenges, the most pressing of which are currently the COVID-19 pandemic and climate change have forced extra roles into many homes and will continue to do so in the future. Biodesign integrates living organisms into designed solu...
Preprint
Full-text available
Reliability of machine learning (ML) systems is crucial in safety-critical applications such as healthcare, and uncertainty estimation is a widely researched method to highlight the confidence of ML systems in deployment. Sequential and parallel ensemble techniques have shown improved performance of ML systems in multi-modal settings by leveraging...
Article
Full-text available
Accessibility, adaptability, and transparency of Brain-Computer Interface (BCI) tools and the data they collect will likely impact how we collectively navigate a new digital age. This discussion reviews some of the diverse and transdisciplinary applications of BCI technology and draws speculative inferences about the ways in which BCI tools, combin...
Article
Hand-to-Face transmission has been estimated to be a minority, yet non-negligible, vector of COVID-19 transmission and a major vector for multiple other pathogens. At the same time, as it cannot be effectively addressed with mainstream protection measures, such as wearing masks or tracing contacts, it remains largely untackled. To help address this...
Article
Full-text available
Previous studies on aesthetic chills (i.e., psychogenic shivers) demonstrate their positive effects on stress, pleasure, and social cognition. We tested whether we could artificially enhance this emotion and its downstream effects by intervening on its somatic markers using wearable technology. We built a device generating cold and vibrotactile sen...
Preprint
Full-text available
The problem of missing data has been persistent for a long time and poses a major obstacle in machine learning and statistical data analysis. Past works in this field have tried using various data imputation techniques to fill in the missing data, or training neural networks (NNs) with the missing data. In this work, we propose a simple yet effecti...
Preprint
Full-text available
Reliability in Neural Networks (NNs) is crucial in safety-critical applications like healthcare, and uncertainty estimation is a widely researched method to highlight the confidence of NNs in deployment. In this work, we propose an uncertainty-aware boosting technique for multi-modal ensembling to predict Alzheimer's Dementia Severity. The propagat...
Article
Copyright © 2020 ISCA Alzheimer's disease is estimated to affect around 50 million people worldwide and is rising rapidly, with a global economic burden of nearly a trillion dollars. This calls for scalable, cost-effective, and robust methods for detection of Alzheimer's dementia (AD). We present a novel architecture that leverages acoustic, cognit...
Preprint
Full-text available
Understanding and quantifying uncertainty in black box Neural Networks (NNs) is critical when deployed in real-world settings such as healthcare. Recent works using Bayesian and non-Bayesian methods have shown how a unified predictive uncertainty can be modelled for NNs. Decomposing this uncertainty to disentangle the granular sources of heterosced...
Article
Recent research in psychology distinguishes levels of consciousness into a tripartite model-conscious, unconscious and metaconscious. HCI technologies largely focus on the conscious pathway for computer-to-human interaction, requiring explicit user attention and action. In contrast, the other two pathways provide opportunities to create new interfa...
Preprint
Full-text available
Alzheimer's disease is estimated to affect around 50 million people worldwide and is rising rapidly, with a global economic burden of nearly a trillion dollars. This calls for scalable, cost-effective, and robust methods for detection of Alzheimer's dementia (AD). We present a novel architecture that leverages acoustic, cognitive, and linguistic fe...
Article
Information processing during sleep is active, ongoing and accessible to engineering. Protocols such as targeted memory reactivation use sensory stimuli during sleep to reactivate memories and demonstrate subsequent, specific enhancement of their consolidation. These protocols rely on physiological, as opposed to phenomenological, evidence of their...
Article
Full-text available
We explore the application of a wide range of sensory stimulation technologies to the area of sleep and dream engineering. We begin by emphasizing the causal role of the body in dream generation, and describe a circuitry between the sleeping body and the dreaming mind. We suggest that nearly any sensory stimuli has potential for modulating experien...
Conference Paper
Augmentative and alternative communication devices (AAC) can help support communication for millions of people who have differences in speech and language abilities. Existing commercial devices do not meet all the diverse needs of some individuals. Interviews and surveys were conducted with individuals who have speech or language challenges (n=4 in...
Article
2020 Owner/Author. Enhancing the empathy of our human interactions has been the object of intensive psychological studies for decades. The emergence of affective computing has opened the door towards technologically-enabled solutions. Yet, existing techniques struggle to attain their desired impact, often being difficult and expensive to deliver, a...
Conference Paper
Full-text available
Human-Computer Integration (HInt) is an emerging paradigm in which computational and human systems are closely interwoven. Integrating computers with the human body is not new. however, we believe that with rapid technological advancements, increasing real-world deployments, and growing ethical and societal implications, it is critical to identify...
Article
2020 Owner/Author. Nonverbal vocalizations contain important affective and communicative information, especially for those who do not use traditional speech, including individuals who have autism and are non- or minimally verbal (nv/mv). Although these vocalizations are often understood by those who know them well, they can be challenging to unders...
Article
2020 Owner/Author. Current augmentative communication technology has had limited success conveying the needs of some individuals with minimally verbal autism spectrum disorder (mvASD). Primary caregivers report being able to better understand these individuals' non-traditional utterances than those less familiar with the individual such as teachers...
Article
2020 Owner/Author. Having good mentors and role models is important for personal growth. However, they are not always available at the time of need. Some of our personal heroes have passed a