• Home
  • Microsoft
  • Visualization and Interaction for Business and Entertainment Research Group (VIBE)
  • Mary Czerwinski
Mary Czerwinski

Mary Czerwinski
Microsoft · Visualization and Interaction for Business and Entertainment Research Group (VIBE)

Ph.D.

About

279
Publications
71,070
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
13,230
Citations
Additional affiliations
May 1995 - present
Microsoft
Position
  • Project Manager

Publications

Publications (279)
Conference Paper
Full-text available
Workplace stress has been increasing in recent decades and has worsened by the unique demands imposed by COVID-19 and the new remote/hybrid work settings. High-stress working conditions can be detrimental to the health and wellness of workers and can lead to significant business costs in terms of productivity loss and medical expenses. An essential...
Article
Emotion dysregulation frequently co-occurs with chronic pain, which in turn leads to heightened emotional and physical suffering. This cycle of association has prompted a recommendation for psychological treatment of chronic pain to target mechanisms for emotion regulation. The current trial addressed this need by investigating a new internet-deliv...
Conference Paper
Artificial agents’ smiling behaviour is likely to influence their likeability and the quality of user experience. While studies of human interaction highlight the importance of smile dynamics, this feature is often lacking in artificial agents, presenting a design opportunity. We developed a virtual motivational therapist with four smiling behaviou...
Article
How might computing support us in becoming our better, more emotionally resilient selves? We explore this in an interview with the team from Microsoft Research's Human Understanding and Empathy group.
Article
Full-text available
The Future Conversations workshop at CHIIR'21 looked to the future of search, recommendation, and information interaction to ask: where are the opportunities for conversational interactions? What do we need to do to get there? Furthermore, who stands to benefit? The workshop was hands-on and interactive. Rather than a series of technical talks, we...
Article
Full-text available
Introduction Difficulties in emotional regulation are key to the development and maintenance of chronic pain. Recent evidence shows internet-delivered dialectic behaviour therapy (iDBT) skills training can reduce emotional dysregulation and pain intensity. However, further studies are needed to provide more definitive evidence regarding the efficac...
Preprint
Facial action unit recognition has many applications from market research to psychotherapy and from image captioning to entertainment. Despite its recent progress, deployment of these models has been impeded due to their limited generalization to unseen people and demographics. This work conducts an in-depth analysis of performance across several d...
Preprint
We now turn to understanding the impact that COVID-19 had on the personal productivity and well-being of information workers as their work practices were impacted by remote work. This chapter overviews people's productivity, satisfaction, and work patterns, and shows that the challenges and benefits of remote work are closely linked. Looking forwar...
Preprint
Full-text available
Virtual meetings are critical for remote work because of the need for synchronous collaboration in the absence of in-person interactions. In-meeting multitasking is closely linked to people's productivity and wellbeing. However, we currently have limited understanding of multitasking in remote meetings and its potential impact. In this paper, we pr...
Preprint
The ability to monitor audience reactions is critical when delivering presentations. However, current videoconferencing platforms offer limited solutions to support this. This work leverages recent advances in affect sensing to capture and facilitate communication of relevant audience signals. Using an exploratory survey (N = 175), we assessed the...
Conference Paper
Mobile mental health interventions have the potential to reduce barriers and increase engagement in psychotherapy. However, most current tools fail to meet evidence-based principles. In this paper, we describe data-driven design implications for translating evidence-based interventions into mobile apps. To develop these design implications, we anal...
Article
The ability to regulate our emotions plays an important role in our psychological and physical health. Regulating emotions influences how and when emotions are expressed. We performed a large, longitudinal observational study to investigate the effect of emotion regulation ability on expressed affect. We found that expression of negative affect inc...
Article
Circadian rhythms determine daily sleep cycles, mood, and cognition. Depending on an individual's circadian preference, or chronotype (i.e.,"early birds" and "night owls"), the rhythms shift earlier or later in the day. Early birds experience circadian arousal peaks earlier in the morning than night owls. Prior work has shown that individuals are m...
Preprint
Advances in machine intelligence have enabled conversational interfaces that have the potential to radically change the way humans interact with machines. However, even with the progress in the abilities of these agents, there remain critical gaps in their capacity for natural interactions. One limitation is that the agents are often monotonic in b...
Preprint
A natural conversational interface that allows longitudinal symptom tracking would be extremely valuable in health/wellness applications. However, the task of designing emotionally-aware agents for behavior change is still poorly understood. In this paper, we present the design and evaluation of an emotion-aware chatbot that conducts experience sam...
Conference Paper
We present an end-to-end voice-based conversational agent that is able to engage in naturalistic multi-turn dialogue and align with the interlocutor's conversational style. The system uses a series of deep neural network components for speech recognition, dialogue generation, prosodic analysis and speech synthesis to generate language and prosodic...
Preprint
Full-text available
We present an end-to-end voice-based conversational agent that is able to engage in naturalistic multi-turn dialogue and align with the interlocutor's conversational style. The system uses a series of deep neural network components for speech recognition, dialogue generation, prosodic analysis and speech synthesis to generate language and prosodic...
Preprint
Humans use a host of signals to infer the emotional state of others. In general, computer systems that leverage signals from multiple modalities will be more robust and accurate in the same task. We present a multimodal affect and context sensing platform. The system is composed of video, audio and application analysis pipelines that leverage ubiqu...
Preprint
The delivery of mental health interventions via ubiquitous devices has shown much promise. A natural conversational interface that allows longitudinal symptom tracking and appropriate just-in-time interventions would be extremely valuable. However, the task of designing emotionally-aware agents is still poorly understood. Furthermore, the feasibili...
Article
TODAY, PEOPLE INCREASINGLY rely on computer agents in their lives, from searching for information, to chatting with a bot, to performing everyday tasks. These agent-based systems are our first forays into a world in which machines will assist, teach, counsel, care for, and entertain us. While one could imagine purely rational agents in these roles,...
Conference Paper
How can we create technologies to help us reflect on and change our behavior, improving our health and overall wellbeing? In this talk, I will briefly describe the last several years of work our research team has been doing in this area. We have developed wearable technology to help families manage tense situations with their children, mobile phone...
Conference Paper
Information workers are experiencing ever-increasing online distractions in the workplace, and software to block distractions is becoming more popular. We conducted an exploratory field study with 32 information workers in their workplace using software to block online distractions for one week. We discovered that with online distractions blocked,...
Conference Paper
Mental health disorders are a leading cause of disability worldwide. Although evidence-based psychotherapy is effective, engagement from such programs can be low. Mobile apps have the potential to help engage and support people in their therapy. We developed Pocket Skills, a mobile web app based on Dialectical Behavior Therapy (DBT). Pocket Skills...
Conference Paper
Full-text available
Emotions play a major role in how interpersonal conflicts unfold. Although several strategies and technological approaches have been proposed for emotion regulation, they often require conscious attention and effort. This often limits their efficacy in practice. In this paper, we propose a different approach inspired by self-perception theory: noti...
Conference Paper
The World Health Organization predicts that by the year 2030, mental illnesses will be the leading disease burden globally. Advances in technology create opportunities for close collaboration between computation and mental health researchers. The intersection between ubiquitous computing and sensing, social media, data analytics and emerging techno...
Conference Paper
Analysis of casual chit-chat indicates that differences in conversational style---the way things are said---can significantly impact a participants» impressions of the conversation and of each other. However, prior work has not systematically analyzed how important style is in task-oriented, information-seeking exchanges of the sort we might have w...
Conference Paper
Full-text available
Information workers are faced with ever-increasing online distractions in the workplace. Website blockers are one solution toward preventing unwanted distractions. We conducted an in situ field study with 32 information workers in their workplace to test if the use of blocking software can increase focus and productivity by preventing non-work-rela...
Conference Paper
Full-text available
A formative study of a mobile application for introducing skills related to Dialectical Behavior Therapy (DBT) is reviewed with an eye toward next iteration design. DBT is considered the gold standard for the treatment of suicide and borderline personality disorder, among other complex behavioral disorders. A multidisciplinary design team took lice...
Conference Paper
Full-text available
Designing virtual personal assistants that are able to engage users in an interaction have been a challenge for HCI researchers for the past 20 years. In this work we investigated how a set of vocal characteristics known as “conversational style” could play role in engaging users in an interaction with a virtual agent. We also examined whether the...
Conference Paper
Full-text available
Given the importance of creativity for both personal and societal achievements, there have been consistent efforts to stimulate creative ability. But an important environmental factor --- blue (i.e., short wavelength) light --- has been relatively unexplored to date. Blue light improves a number of cognitive processes (e.g., attention, working memo...
Conference Paper
Affective computing systems blend technical and social elements and present challenges for designing notifications. As the number of applications expand that utilize notifications, we need to consider that competing for attention is a concern. With respect to promoting positive health behaviors, notifications need to be adapted to times when a user...
Article
Interactivity is a unique forum of the ACM CHI conference that showcases more than 50 cutting-edge demonstrations and inspirational interactive installations from the diverse group of researchers, designers, and artists that make up the CHI community. These works were chosen to engage audiences intellectually, imaginatively, and physically to creat...
Conference Paper
Full-text available
In HCI research, attention has focused on understanding external influences on workplace multitasking. We explore instead how multitasking might be influenced by individual factors: personality, stress, and sleep. Forty information workers' online activity was tracked over two work weeks. The median duration of online screen focus was 40 seconds. T...
Conference Paper
Full-text available
While email provides numerous benefits in the workplace, it is unclear how patterns of email use might affect key workplace indicators of productivity and stress. We investigate how three email use patterns: duration, interruption habit, and batching, relate to perceived workplace productivity and stress. We tracked email usage with computer loggin...
Conference Paper
We present Tattio, a fabrication process that draws from current body decoration processes (i.e., jewelry-like metallic temporary tattoos) for the creation of on-skin technology. The fabrication process generates functional components such as NFC tags, circuitry, to Thermochromic tattoos, while maintaining the aesthetics and user experience of exis...
Conference Paper
Various wearable sensors capturing body vibration, jaw movement, hand gesture, etc., have shown promise in detecting when one is currently eating. However, based on existing literature and user surveys conducted in this study, we argue that a Just-in-Time eating intervention, triggered upon detecting a current eating event, is sub-optimal. An eatin...
Conference Paper
Positive wellbeing in the workplace is tied to better health. However, lack of wellbeing in the workplace is a serious problem in the U.S, is rising continually, and can lead to poor health conditions. In this study we investigate factors that might be associated with workplace wellbeing. We report on an in situ study in the workplace of 40 informa...
Article
In this paper the authors present the BioCrystal – a biofeedback device that uses physiological data to evaluate user's affective states in real-time and signals the states via an ambient display. The authors evaluated the BioCrystal during a 2-week, in situ multi-method study during which ten users collected over 115 hours of usable data. Users' c...
Conference Paper
Full-text available
A common assumption in studies of interruptions is that one is focused in an activity and then distracted by other stimuli. We take the reverse perspective and examine whether one might first be in an attentional state that makes one susceptible to communications typically associated with distraction. We explore the confluence of multitasking and w...
Conference Paper
We present “Lightwear”, a series of garment-based, lightweight, light-emitting wearables designed to administer light therapy for on-the-go treatment of Seasonal Affective Disorder (SAD). Bright Light Therapy (BLT) has been used to treat SAD for more than 25 years. While light boxes continue to serve as the predominant method of treatment, it often...
Article
We present SWARM, a wearable affective technology designed to help a user to reflect on their own emotional state, modify their affect, and interpret the emotional states of others. SWARM aims for a universal design (inclusive of people with various disabilities), with a focus on modular actuation components to accommodate users' sensory capabiliti...
Patent
Full-text available
Recording of various events in a video format that facilitates viewing and selective editing are provided. The video can be presented in a wiki-format that allows a multitude of subsequent users to add, modify and/or delete content to the original recorded event or a revision of that event. As edits and annotations are applied, either automatically...
Patent
A single device that receives communications intended for a user having multiple contact addresses associated with different user roles is provided. The single device can receive communications intended for multiple telephone numbers, email aliases, screen names, aliases, other means of contact, or combinations thereof. Since a user engaged in a pa...
Article
This special issue turns the spotlight on business intelligence (BI) as an area of inquiry and explores beyond the current standard practices. The articles in the issue describe the processes that practitioners currently follow in this area and how new BI techniques and capabilities will help users understand and act on widely disparate types of da...
Article
Parenting is always demanding, but families coping with neurodevelopmental disorders, such as ADHD, experience unique challenges. To address these challenges, research in the area of Parental Behavioral Therapy is accelerating. This type of therapy focuses on behavioral strategies that, if practiced regularly, can have a positive impact on the chil...
Patent
Full-text available
A collaborative phone-based file exchange technique that wirelessly synchronizes a user's work context with his or her mobile phone and makes this context readily available and sharable in collaborative situations. When the user is away from their desk, collaboration with others is possible by sharing/downloading between the mobile phone and a pair...
Article
Introduction: This article is part of the focus theme of Methods of Information in Medicine on "Pervasive Intelligent Technologies for Health". Background: Effective nonverbal communication between patients and clinicians fosters both the delivery of empathic patient-centered care and positive patient outcomes. Although nonverbal skill training...
Conference Paper
Full-text available
Stress is considered to be a modern day " global epidemic"; so given the widespread nature of this problem, it would be beneficial if solutions that help people to learn how to cope better with stress were scalable beyond what individual or group therapies can provide today. Therefore, in this work, we study the potential of smart-phones as a perva...
Patent
Full-text available
A user entering information in an application might desire functionality not supported by that application. Based on an input or a subset of the input, a functionality associated with a different application can be automatically applied within a current application. Sometimes, a particular application or mode of communication can be used to send in...
Article
Full-text available
While distractions using digital media have received attention in HCI, understanding engagement in workplace activities has been little explored. We logged digital activity and continually probed perspectives of 32 information workers for five days in situ to understand how attentional states change with context. We present a framework of how engag...
Article
Full-text available
Recognizing when computer users are stressed can help reduce their frustration and prevent a large variety of negative health conditions associated with chronic stress. However, measuring stress non-invasively and continuously at work remains an open challenge. This work explores the possibility of using a pressure-sensitive keyboard and a capaciti...
Conference Paper
Full-text available
What makes people feel happy, engaged and challenged at work? We conducted an in situ study of Facebook and face-to-face interactions examining how they influence people's mood in the workplace. Thirty-two participants in an organization were each observed for five days in their natural work environment using automated data capture and experience s...
Patent
Described are systems and user interfaces for facilitating asynchronous communication with video threads. Implementations may enable members of a team to have threaded view of video messages, from which they can capture video, record their screen, and send, receive, and reply to a video message. The screen recording feature enables team members to...
Patent
Full-text available
Techniques for visualizing sets are described. Arbitrary subsets of data elements are represented by corresponding graphic lines. The data elements in a set are connected up sequentially by a corresponding graphic line, the graphic line passing through each data element once with minimal or no self-overlapping. The graphic lines may be curved, for...
Conference Paper
Over-eating is often the result of consuming food for reasons other than needing fuel and nutrients: we eat for pleasure, from habit, for emotional support. Such non-homeostatic eating is an established contributor to overeating towards overweight or obese weight gain that in turn is correlated with numerous non-communicable diseases such as Type I...