PreprintPDF Available

Smartwatch-based ecological momentary assessments for occupant wellness and privacy in buildings

Authors:
  • International WELL Building Institute
Preprints and early-stage research may not have been peer reviewed yet.

Abstract and Figures

This paper describes the adaptation of an open-source ecological momentary assessment smart-watch platform with three sets of micro-survey wellness-related questions focused on i) infectious disease (COVID-19) risk perception, ii) privacy and distraction in an office context, and iii) triggers of various movement-related behaviors in buildings. This platform was previously used to collect data for thermal comfort, and this work extends its use to other domains. Several research participants took part in a proof-of-concept experiment by wearing a smartwatch to collect their micro-survey question preferences and perception responses for two of the question sets. Participants were also asked to install an indoor localization app on their phone to detect where precisely in the building they completed the survey. The experiment identified occupant information such as the tendencies for the research participants to prefer privacy in certain spaces and the difference between infectious disease risk perception in naturally versus mechanically ventilated spaces.
Content may be subject to copyright.
Smartwatch-based ecological momentary assessments for occupant wellness
and privacy in buildings
Clayton Miller1,, Renee Christensen2, Jin Kai Leong1, Mahmoud Abdelrahman1, Federico
Tartarini3, Matias Quintana1, Andre Matthias Müller4, Mario Frei1
1 College of Design and Engineering, National University of Singapore (NUS), Singapore
2 International Well Building Institute (IWBI), New York, NY, USA
3 Berkeley Education Alliance for Research in Singapore (BEARS), Singapore
4 Saw Swee Hock School of Public Health, National University of Singapore (NUS), National
University Health System, Singapore
*Corresponding email: clayton@nus.edu.sg
SUMMARY
This paper describes the adaptation of an open-source ecological momentary assessment smart-
watch platform with three sets of micro-survey wellness-related questions focused on i)
infectious disease (COVID-19) risk perception, ii) privacy and distraction in an office context,
and iii) triggers of various movement-related behaviors in buildings. This platform was
previously used to collect data for thermal comfort, and this work extends its use to other
domains. Several research participants took part in a proof-of-concept experiment by wearing
a smartwatch to collect their micro-survey question preferences and perception responses for
two of the question sets. Participants were also asked to install an indoor localization app on
their phone to detect where precisely in the building they completed the survey. The experiment
identified occupant information such as the tendencies for the research participants to prefer
privacy in certain spaces and the difference between infectious disease risk perception in
naturally versus mechanically ventilated spaces.
KEYWORDS
Field-based survey, Wearables, Longitudinal data, Wellness, Privacy
1 INTRODUCTION
When rethinking urban planning and building designs, practitioners need to evaluate what
features of the current built environment context contribute to the health and well-being of its
occupants (O’Brien et al. 2020; Altomonte et al. 2020; Stazi et al. 2017). One example of this
challenge is the mitigation of airborne infectious diseases such as COVID-19. Designers or
operators would want to understand, for example, which building features could be intersection
zones that cause congestion or to determine which high-touch building features occupants
perceive as a risk of transmission (Kim and Kang, 2021). Another often overlooked aspect is
understanding what building features relate to the feeling of privacy and distraction. It has been
established that the conventional open plan office space provides many opportunities for people
to feel a lack of privacy in addition to visual and noise-based distractions from those around
them (Kim and de Dear, 2013). Finally, with the emerging emphasis on wellness in the built
environment, buildings are designed with indirect encouragements to nudge occupants to make
decisions that will improve their health (Timm et al. 2018). An example is when staircases are
made more prominent and visually appealing to encourage occupants to use them rather than
elevators or lifts (Potrč et al. 2019). Post-occupancy evaluations can help collect data from
occupants to understand better how they perceive their environment; however, they are limited
in the amount and frequency of data they can collect. Wearable technologies can be used to fill
this gap by capturing feedback at high spatial and temporal resolutions that can improve these
design-related efforts (Li et al., 2018).
The Cozie platform was developed to facilitate repeated right-here-right-now surveys across
extended periods of time using micro-ecological momentary assessments (Jayathissa et al.
2019). The platform proved to be an efficient way to collect subjective feedback as compared
to other post-occupancy feedback methods such as smartphone-based surveys. Subsequent field
studies evaluated the platform’s ability to capture a large number of thermal, aural, and visual
comfort feedback to create personalized comfort models (Jayathissa et al. 2020), the ability to
create personal comfort models using spatial proximity (Abdelrahman et al. 2022) and
understand the thermal comfort transition behavior of occupants between different spaces (Sae-
Zhang et al. 2020). Cozie is open source and can be easily modified to include different sets of
questions beyond thermal comfort. Two versions of Cozie have been developed for both the
Fitbit and Apple Watch platforms. This paper outlines three survey flows for Cozie Fitbit
developed to capture occupant preference information related to the perceived risk of infectious
diseases, privacy and distraction in an office context, and the potential triggers of various
movement-related behaviors in the built environment.
2 METHODS
This paper outlines the deployment of three micro-survey question sets, of which, two are used
in a pilot longitudinal study. These sets include 2-7 multiple-choice questions that are answered
using the Cozie watch-face installed on a Fitbit smartwatch. The surveys have a built-in logic
that determines which follow-up question is presented to a user based on their previous answers.
The following subsections outline the three question flows tested in this study. These surveys
were implemented in the open-source Cozie Fitbit project hosted on a public repository on
GitHub (https://github.com/cozie-app/cozie).
Infectious disease risk perception
The first question set relates to an occupant’s perception that their surroundings impact their
risk of acquiring an infectious disease, as shown in Figure 1. This perception is essential in
evaluating whether there are perceived risks to occupants that could be mitigated by changing
some building features. It also identifies occupant risk perception that may not align with the
science of disease spread. These off-target concerns could then be assuaged through occupant
education. The user first starts from the home screen on the upper left and answers the core
question related to their perception of infection risk at that moment and location. Two follow-
up questions evaluate what aspect of risk is specifically concerning for them. Finally, there is a
question to request the number of people within a 5-m radius.
Figure 1. Infectious disease risk perception micro-survey flow overview. The arrows indicate
the flow of questions with a black arrow indicating a single path and a blue arrow indicating
multiple paths based on the option selected.
Privacy and distraction perception
The next question set, seen in Figure 2, focuses on capturing whether occupants feel like they
need more privacy and whether they find their surroundings distracting. The survey begins with
a question about whether someone is in a group or alone and what category of activity they are
undertaking at that point in time. These foundational questions establish the context for the
subsequent ones about distractions. A person working alone has different focus, sound, and
visual privacy needs than a group of people. The following questions focus on whether the
person feels as if they need more privacy, and if so, what are the specific concerns and what are
they worried about in terms of others around them. These follow-up questions dive into whether
the person needs privacy because they worry about others seeing and/or hearing their
appearance, work, or behavior.
Triggers related to movement in buildings
The last set of questions, shown in Figure 3, captures the effectiveness of nudging occupants to
be more active in buildings, i.e., the use of stairways instead of elevators/lifts and adjustable
height workstations. These activities are design-driven, and evaluation of users’ actual behavior
in buildings with these features informs about the adoption and need for education, signage,
and placement. This flow begins with a question asking whether the occupant has used the stairs
or lift in the building in the last one hour and, based on the response, seeks to determine the
reason for that decision. The flow then moves to a question about if and how the occupant is
using an adjustable-height workstation. This question set is included for schematic purposes,
but data from this flow are not included in this paper.
Figure 2. Privacy, distraction, and surroundings impact micro-survey question flow overview.
Figure 3. Evaluation of movement-related decisions micro-survey question flow overview.
Deployment in a university building context
The proof-of-concept test deployment for this paper included six participants who were asked
to wear a Fitbit smartwatch and use the Cozie application. Only data for the first two question
sets are included in this study. The watch generated a vibration-based prompt for feedback
every 1, 2, or 3 hours between 9 am and 9 pm. Each question set was expected to take between
3-9 seconds to complete, and only one set was deployed at a time. Participants were able to
provide feedback outside of the prompts, provided that two consecutive responses were more
than 15 minutes apart. They were required to install an indoor localization app that uses
Bluetooth signals from beacons to track their movements within the case study buildings. The
methodology for the first two question sets was approved by the NUS Institutional Review
Board (IRB) (NUS-IRB-2020-135), and participants were incentivized with an SG$50 voucher.
3 RESULTS AND DISCUSSION
The data collection for this experiment resulted in subjective feedback from six participants
over the span of 30 days. Figure 4 illustrates aggregations of this feedback from the Privacy
and Distraction question flows. For this data set, most of the activity of the test subjects was
solitary, with a strong emphasis on the occupant focusing. Less than half the time, there were
distractions nearby, with the most significant reason being noise. Despite the distraction, the
subjects felt as if they needed more privacy only 6% of the time, and the primary source of that
feeling was requiring more protection from people seeing their work. Figure 5 shows the
aggregated results and Infectious Disease Risk Perception question flow. For this data set,
participants felt for a slim majority of the time that there was an increase of risk of infection,
with ventilation being the most prominent concern followed by surfaces and then people
density.
Figure 4. Aggregated data from the pilot deployment of the Privacy and Distraction flow
Figure 5. Aggregated data from the pilot deployment of the Infection Risk Perception flow
4 CONCLUSION
This paper outlines the development of micro-ecological momentary assessments on a
smartwatch to characterize occupant preference in wellness and privacy topics that have been
previously unexplored. An experiment was conducted that collected spatially and temporally
diverse preference data from real-world occupants of a case study building. The results gave
insight into whether privacy and distraction were issues and how much perceived risk of
infectious diseases was present. In future work, larger case study deployments across different
buildings with a diversity of design objectives could be used to compare design features in the
context of these three wellness and satisfaction objectives. In addition, there are opportunities
to further analyze which spatial regions are better or worse for the objective of each question
flow and why. The anonymized data set and example code for this paper can be found in a
GitHub repository (https://github.com/buds-lab/ema-for-occupant-wellness-and-privacy). The
Cozie platform is available for both Fitbit smartwatches (https://cozie.app/) and Apple Watches
(https://www.cozie-apple.app/) and is designed to be an open-source, community-driven effort
for others to collaborate.
ACKNOWLEDGEMENT
The author team would like to thank several student researchers who contributed to the data
collection process for this publication including Charis Boey Shand Yin, Chua Yun Xuan, Ang
Si Hui Pearlyn, and Tan Jing En Charlene. This research was funded by the Singapore Ministry
of Education (MOE) through the Tier 1 Grants: Ecological Momentary Assessment (EMA) for
Built Environment Research (A-0008301-00-00) and The Internet-of-Buildings (IoB) Platform
Visual Analytics for AI Technologies towards a Well and Green Built Environment (A-
0008305-00-00). The Republic of Singapore’s National Research Foundation (NRF) through
the SinBerBEST program provided partial support for manpower for this project.
5 REFERENCES
Abdelrahman, Mahmoud M., Adrian Chong, and Clayton Miller. 2022. “Personal Thermal
Comfort Models Using Digital Twins: Preference Prediction with BIM-Extracted Spatial–
temporal Proximity Data from Build2Vec.” Building and Environment 207 (January):
108532. https://doi.org/10.1016/j.buildenv.2021.108532.
Altomonte, Sergio, Joseph Allen, Philomena M. Bluyssen, Gail Brager, Lisa Heschong, Angela
Loder, Stefano Schiavon, Jennifer A. Veitch, Lily Wang, and Pawel Wargocki. 2020. “Ten
Questions Concerning Well-Being in the Built Environment.” Building and Environment
180 (August): 106949. https://doi.org/10.1016/j.buildenv.2020.106949.
Jayathissa, Prageeth, Matias Quintana, Mahmoud Abdelrahman, and Clayton Miller. 2020.
“Humans-as-a-Sensor for Buildings—Intensive Longitudinal Indoor Comfort Models.”
Buildings 10 (10): 174. https://doi.org/10.3390/buildings10100174.
Jayathissa, Prageeth, Matias Quintana, Tapeesh Sood, Negin Nazarian, and Clayton Miller.
2019. “Is Your Clock-Face Cozie? A Smartwatch Methodology for the in-Situ Collection
of Occupant Comfort Data.” Journal of Physics. Conference Series 1343 (1): 012145.
https://doi.org/10.1088/1742-6596/1343/1/012145.
Kim, Jungsoo, and Richard de Dear. 2013. “Workspace Satisfaction: The Privacy-
Communication Trade-off in Open-Plan Offices.” Journal of Environmental Psychology
36 (December): 18–26. https://doi.org/10.1016/j.jenvp.2013.06.007.
Kim, Young-Jae, and Seung-Woo Kang. 2021. “Perceived Crowding and Risk Perception
According to Leisure Activity Type during COVID-19 Using Spatial Proximity.”
International Journal of Environmental Research and Public Health 18 (2).
https://doi.org/10.3390/ijerph18020457.
Li, Peixian, Thomas M. Froese, and Gail Brager. 2018. “Post-Occupancy Evaluation: State-of-
the-Art Analysis and State-of-the-Practice Review.” Building and Environment 133
(April): 187–202. https://doi.org/10.1016/j.buildenv.2018.02.024.
O’Brien, William, Andreas Wagner, Marcel Schweiker, Ardeshir Mahdavi, Julia Day, Mikkel
Baun Kjærgaard, Salvatore Carlucci, et al. 2020. “Introducing IEA EBC Annex 79: Key
Challenges and Opportunities in the Field of Occupant-Centric Building Design and
Operation.” Building and Environment 178 (July): 106738.
https://doi.org/10.1016/j.buildenv.2020.106738.
Potrč Obrecht, Tajda, Roman Kunič, Sabina Jordan, and Mateja Dovjak. 2019. “Comparison of
Health and Well-Being Aspects in Building Certification Schemes.” Sustainability:
Science Practice and Policy 11 (9): 2616. https://doi.org/10.3390/su11092616.
Sae-Zhang, Pimpatsohn, Matia Quintana, and Clayton Miller. 2020. “Differences in Thermal
Comfort State Transitional Time among Comfort Preference Groups.” In 16th Conference
of the International Society of Indoor Air Quality and Climate: Creative and Smart
Solutions for Better Built Environments, Indoor Air 2020, 166587.
Stazi, Francesca, Federica Naspi, and Marco D’Orazio. 2017. “A Literature Review on Driving
Factors and Contextual Events Influencing Occupants’ Behaviours in Buildings.”
Building and Environment 118 (June): 40–66.
https://doi.org/10.1016/j.buildenv.2017.03.021.
Timm, Stephanie, Whitney Austin Gray, Trey Curtis, and Susan Sung Eun Chung. 2018.
“Designing for Health: How the Physical Environment Plays a Role in Workplace
Wellness.” American Journal of Health Promotion: AJHP 32 (6): 1468–73.
https://doi.org/10.1177/0890117118779463b.
ResearchGate has not been able to resolve any citations for this publication.
Article
Full-text available
Conventional thermal preference prediction in buildings has limitations due to the difficulty in capturing all environmental and personal factors. New model features can improve the ability of a machine learning model to classify a person’s thermal preference. The spatial context of a building can provide information to models about the windows, walls, heating and cooling sources, air diffusers, and other factors that create micro-environments that influence thermal comfort. Due to spatial heterogeneity, it is impractical to position sensors at a high enough resolution to capture all conditions. This research aims to build upon an existing vector-based spatial model, called Build2Vec, for predicting spatial–temporal occupants’ indoor environmental preferences. Build2Vec utilizes the spatial data from the Building Information Model (BIM) and indoor localization in a real-world setting. This framework uses longitudinal intensive thermal comfort subjective feedback from smart watch-based ecological momentary assessments (EMA). The aggregation of these data is combined into a graph network structure (i.e., objects and relations) and used as input for a classification model to predict occupant thermal preference. The results of a test implementation show 14%–28% accuracy improvement over a set of baselines that use conventional thermal preference prediction input variables.
Article
Full-text available
This study aimed to investigate the difference in people’s perceived crowding and risk perception during leisure activities using the criteria of spatial proximity during the COVID-19 pandemic. COVID-19 is a viral respiratory tract disease that poses an increasing risk of infection through person-to-person transmission in a confined space or close proximity to an infected person. It is thus crucial to maintain a sufficiently safe distance from others during leisure activities. In this study, measures concerning leisure activity spaces and the current status of leisure activities were investigated. Data were gathered from a total of 1078 participants via an online survey conducted from 26 to 29 October 2020. Frequency analysis was performed to investigate the sample characteristics and exploratory factor analysis was performed to analyze the validity of the measurement tools. Results revealed that people’s perceived crowding of leisure activity spaces directly influenced their participation in leisure activities. Regarding age, those in their 20s were more aware of congestion and their risk perception was higher than those in their 40s and 50s. It was found that people perceived cultural and artistic activities to be dangerous as they often take place as part of tourism and leisure activities and amidst crowds. However, their high-risk perception indirectly influenced their participation patterns, making it difficult to enjoy leisure activities. To lower the risk perception of leisure activity spaces, it was necessary to secure more safe distancing than current regulations require. Future research must conduct a longitudinal investigation by objectively stratifying the degree of perceived crowding.
Conference Paper
Full-text available
As the individual difference in thermal comfort transition time is yet to be thoroughly explored, this paper studies time adaptability amongst individuals by collecting high frequency subjective comfort feedback using micro ecological momentary assessments on a smart-watch. The individuals were grouped based on their thermal preference responses and had their transition times analyzed. Each group has various transition time from arriving at and leaving from their comfort state. On average people who are more sensitive to cold temperatures, Group 1, take 8.9 minutes from being uncomfortably cold and 25.0 minutes from being uncomfortably hot to reach comfort zones. On the other hand, people who are generally comfortable, Group 2, take 22.4 minutes from uncomfortably cold and 27.1 minutes from uncomfortably hot to be thermally comfortable. The average transition time within a cluster matches the thermal comfort trend of said cluster. Ultimately, the transient time of preference groups raises the possibility to improve individualized thermal comfort models and machine learning in the future.
Article
Full-text available
Evaluating and optimising human comfort within the built environment is challenging due to the large number of physiological, psychological and environmental variables that affect occupant comfort preference. Human perception could be helpful to capture these disparate phenomena and interpreting their impact; the challenge is collecting spatially and temporally diverse subjective feedback in a scalable way. This paper presents a methodology to collect intensive longitudinal subjective feedback of comfort-based preference using micro ecological momentary assessments on a smartwatch platform. An experiment with 30 occupants over two weeks produced 4378 field-based surveys for thermal, noise, and acoustic preference. The occupants and the spaces in which they left feedback were then clustered according to these preference tendencies. These groups were used to create different feature sets with combinations of environmental and physiological variables, for use in a multi-class classification task. These classification models were trained on a feature set that was developed from time-series attributes, environmental and near-body sensors, heart rate, and the historical preferences of both the individual and the comfort group assigned. The most accurate model had multi-class classification F1 micro scores of 64%, 80% and 86% for thermal, light, and noise preference, respectively. The discussion outlines how these models can enhance comfort preference prediction when supplementing data from installed sensors. The approach presented prompts reflection on how the building analysis community evaluates, controls, and designs indoor environments through balancing the measurement of variables with occupant preferences in an intensive longitudinal way.
Article
Full-text available
Well-being in the built environment is a topic that features frequently in building standards and certification schemes, in scholarly articles and in the general press. However, despite this surge in attention, there are still many questions on how to effectively design, measure, and nurture well-being in the built environment. Bringing together experts from academia and the building industry, this paper aims to demonstrate that the promotion of well-being requires a departure from conventional agendas. The ten questions and answers have been arranged to offer a range of perspectives on the principles and strategies that can better sustain the consideration of well-being in the design and operation of the built environment. Placing a specific focus on some of the key physical factors (e.g., light, temperature, sound, and air quality) of indoor environmental quality (IEQ) that strongly influence occupant perception of built spaces, attention is also given to the value of multi-sensory variability, to how to monitor and communicate well-being outcomes in support of organizational and operational strategies, and to future research needs and their translation into building practice and standards. Seen as a whole, a new framework emerges, accentuating the integration of diverse new competencies required to support the design and operation of built environments that respond to the multifaceted physical, physiological, and psychological needs of their occupants.
Article
Full-text available
Labelled human comfort data can be a valuable resource in optimising the built environment, and improving the wellbeing of individual occupants. The acquisition of labelled data however remains a challenge. This paper presents a methodology for the collection of in-situ occupant feedback data using a Fitbit smartwatch. The clock-face application cozie can be downloaded free-of-charge on the Fitbit store and tailored to fit a range of occupant comfort related experiments. In the initial trial of the app, fifteen users were given a smartwatch for one month and were prompted to give feedback on their thermal preferences. In one month, with minimal administrative overhead, 1460 labelled responses were collected. This paper demonstrates how these large data sets of human feedback can be analysed to reveal a range of results from building anomalies, occupant behaviour, occupant personality clustering, and general feedback related to the building. The paper also discusses limitations in the approach and the next phase of design of the platform.
Article
Full-text available
The quality of the indoor environment is becoming increasingly important because people are spending the majority of their time indoors. This has led to an increased interest in the field of health and well-being of users of buildings and to the development of various assessment schemes dealing with this issue. In this study, LEED O+M Building Operations and Maintenance (hereinafter LEED O+M), BREEAM In-Use and DGNB Buildings In-Use were compared with a specialized BCS WELL that is focused on the health and well-being of building occupants. The aim of the comparison was to evaluate to what extent the selected building certification schemes (BCSs) cover the aspects of health and well-being in buildings. Based on the analysis, it was found that the observed BCSs mostly pay attention to indoor air quality, light and thermal comfort. In other areas, only certain topics are covered or the topics have a different focus. Another important finding of the study was that certain aspects that are important for the health and well-being of the occupants are not dependent only on the building design but also on the management of the building and the services provided within the building. This kind of information is especially valuable for building developers, managers and owners so they know how to improve health and well-being in a building. The present study provides them with a comprehensive overview of the certification schemes that are widely used in current practice.
Article
Full-text available
Post-occupancy evaluation (POE) is a process of evaluating the performance of a building after it has been occupied for at least several years. The authors conducted a comprehensive and critical review to provide a both qualitative and quantitative introduction of POE, including a brief introduction of the history, definition and benefits of POE, a statistical analysis of 146 POE projects since 2010, a comparison of 16 existing POE protocols, a summary of emerging research focuses, and potential future research areas. The 146 POE projects were analyzed in terms of building types, countries, purposes, methods used, and key findings. The review of 16 POE protocols show the state-of-the-practice POE techniques. Apart from POE projects, the authors present emerging research topics related to the visualization of POE results, analyses of occupant survey database, and measurement of occupancy. Finally, the discussion summarizes the current condition of POE research and proposes five transitions that POE efforts should pursue: from one-off to continuing, from high-level to detailed, from researchers-oriented to owners/occupants-oriented, from academia to industry, and from independent to integrated. This paper provides a thorough introduction of POE to the beginners in this area, as well as informing more seasoned investigators about the trends, gaps, and potential future directions in POE research.
Article
Despite the fact that buildings are designed for occupants in principle, evidence suggests buildings are often uncomfortable compared to the requirements of standards; difficult to control by occupants; and, operated inefficiently with regards to occupants’ preferences and presence. Meanwhile, practitioners –architects, engineers, technology companies, building managers and operators, and policymakers – lack the knowledge, tools, and precedent to design and operate buildings optimally considering the complex and diverse nature of occupants. Building on the success of IEA EBC Annex 66 (“Definition and simulation of occupant behavior in buildings”; 2013-2017), a follow-up IEA EBC Annex 79 (“Occupant-centric building design and operation”; 2018-2023) has been developed to address gaps in knowledge, practice, and technology. Annex 79 involves international researchers from diverse disciplines like engineering, architecture, computer science, psychology, and sociology. Annex 79 and this review paper have four main areas of focus: (1) multi-domain environmental exposure, building interfaces, and human behavior; (2) data-driven occupant modeling strategies and digital tools; (3) occupant-centric building design; and (4) occupant-centric building operation. The objective of this paper is to succinctly report on the leading research of the above topics and articulate the most pressing research needs – planned to be addressed by Annex 79 and beyond.