ArticlePDF Available

Abstract and Figures

Human-Building Interaction (HBI) is a convergent field that represents the growing complexities of the dynamic interplay between human experience and intelligence within built environments. This paper provides core definitions, research dimensions, and an overall vision for the future of HBI as developed through consensus among 25 interdisciplinary experts in a series of facilitated workshops. Three primary areas contribute to and require attention in HBI research: humans (human experiences, performance, and well-being), buildings (building design and operations), and technologies (sensing, inference, and awareness). Three critical interdisciplinary research domains intersect these areas: control systems and decision making, trust and collaboration, and modeling and simulation. Finally, at the core, it is vital for HBI research to center on and support equity, privacy, and sustainability. Compelling research questions are posed for each primary area, research domain, and core principle. State-of-the-art methods used in HBI studies are discussed, and examples of original research are offered to illustrate opportunities for the advancement of HBI research.
This content is subject to copyright. Terms and conditions apply.
1
Vol.:(0123456789)
Scientic Reports | (2022) 12:22092 | https://doi.org/10.1038/s41598-022-25047-y
www.nature.com/scientificreports
The eld of human building
interaction for convergent research
and innovation for intelligent built
environments
Burcin Becerik‑Gerber
1,24*, Gale Lucas
2,24, Ashrant Aryal
3, Mohamad Awada
1,
Mario Bergés 4, Sarah Billington
5, Olga Boric‑Lubecke
6, Ali Ghahramani
7,
Arsalan Heydarian
8, Christoph Höelscher
9,10, Farrokh Jazizadeh
11, Azam Khan
12,13,
Jared Langevin 14, Ruying Liu
1, Frederick Marks
15, Matthew Louis Mauriello
16,
Elizabeth Murnane
17, Haeyoung Noh
5, Marco Pritoni
18, Shawn Roll
19, Davide Schaumann
20,
Mirmahdi Seyedrezaei
1, John E. Taylor
21, Jie Zhao
22,23 & Runhe Zhu
1
Human‑Building Interaction (HBI) is a convergent eld that represents the growing complexities of
the dynamic interplay between human experience and intelligence within built environments. This
paper provides core denitions, research dimensions, and an overall vision for the future of HBI as
developed through consensus among 25 interdisciplinary experts in a series of facilitated workshops.
Three primary areas contribute to and require attention in HBI research: humans (human experiences,
performance, and well‑being), buildings (building design and operations), and technologies (sensing,
inference, and awareness). Three critical interdisciplinary research domains intersect these areas:
control systems and decision making, trust and collaboration, and modeling and simulation. Finally,
at the core, it is vital for HBI research to center on and support equity, privacy, and sustainability.
Compelling research questions are posed for each primary area, research domain, and core principle.
State‑of‑the‑art methods used in HBI studies are discussed, and examples of original research are
oered to illustrate opportunities for the advancement of HBI research.
Technology is rapidly advancing and, in doing so, is changing not only virtual realms but also our everyday
physical environments. Smart connected devices and advancements in sensing, actuation, and communication
are converging to bring new modes of interaction and experience within our built environment. is transforma-
tion is leading our society towards a dierent way of engaging with the spaces in which we live, work, play, and
OPEN
1Sonny Astani Department of Civil and Environmental Engineering, University of Southern California, Los Angeles,
USA. 2Institute for Creative Technologies, University of Southern California, Los Angeles, USA. 3Department
of Construction Science, Texas A&M University, College Station, USA. 4Department of Civil and Environmental
Engineering, Carnegie Mellon University, Pittsburgh, USA. 5Department of Civil and Environmental Engineering,
Stanford University, Stanford, USA. 6Department of Electrical and Computer Engineering, University of Hawaii
at Manoa, Honolulu, USA. 7Department of the Built Environment, National University of Singapore, Singapore,
Singapore. 8Department of Engineering Systems and Environment, Link Lab, University of Virginia, Charlottesville,
USA. 9Department of Humanities, Social and Political Sciences, ETH Zurich, Zurich, Switzerland. 10Future Cities
Laboratory Global, Singapore ETH Centre, Singapore, Singapore. 11Department of Civil and Environmental
Engineering, Virginia Tech, Blacksburg, USA. 12Trax.Co, Toronto, Canada. 13University of Toronto, Toronto,
Canada. 14Lawrence Berkeley National Laboratory, Berkeley, USA. 15Salk Institute for Biological Studies, La Jolla,
USA. 16Department of Computer and Information Sciences, University of Delaware, Newark, USA. 17Thayer School
of Engineering, Dartmouth College, Hanover, USA. 18Building Technology and Urban Systems Division, Lawrence
Berkeley National Laboratory, Berkeley, USA. 19Chan Division of Occupational Science and Occupational Therapy,
University of Southern California, Los Angeles, USA. 20Faculty of Architecture and Town Planning, Technion
Israel Institute of Technology, Haifa, Israel. 21School of Civil and Environmental Engineering, Georgia Institute of
Technology, Atlanta, USA. 22Delos Labs, Delos, USA. 23Weitzman School of Design, University of Pennsylvania,
Philadelphia, USA. 24These authors contributed equally: Burcin Becerik-Gerber and Gale Lucas. *email: becerik@
usc.edu
Content courtesy of Springer Nature, terms of use apply. Rights reserved
2
Vol:.(1234567890)
Scientic Reports | (2022) 12:22092 | https://doi.org/10.1038/s41598-022-25047-y
www.nature.com/scientificreports/
learn. Built environments of all shapes, sizes, and manifestations are becoming intelligent partners that handle
operational and repetitive tasks to support basic human needs, promote human health and well-being, and facili-
tate creative, intellectual, social, and emotional pursuits. Human-Building Interaction (HBI) represents the next
frontier in convergent research and innovation to enable the dynamic interplay of humans and intelligence within
a built environment. In this context, we dene a building’s intelligence as the overall awareness and respect for
the needs and preferences of humans and other stakeholders combined with the capabilities necessary to adapt
and respond in an environmentally conscious manner that enhances human health, well-being, and performance.
e HBI eld studies how humans perceive, interact with, navigate through, and spend time within built envi-
ronments and how reciprocating actions of humans and buildings can positively inuence each other’s behavior.
In this paper, we provide a vision for the convergent eld of HBI, intending to formalize critical principles,
methods, and outcomes. is paper builds on prior eorts to characterize the eld. Many authors have attempted
to dene HBI through the lens of Human–Computer Interaction (HCI)13 or by focusing solely on the temporal
constraints of HBI4. In a more concerted eort5, researchers in human factors engineering, HCI, and architecture
developed denitions, identied research directions, and established sub-agendas meant to guide the work of
the individual disciplines6 toward a shared mission and scope of work for HBI7. We were inspired to expand on
this previous work by establishing an even broader perspective that can promote both individual disciplinary
eorts and meaningful interdisciplinary research to advance eective HBI. is broad group of experts not only
included engineering, human factors, architecture, and computer scientists (within HCI and beyond) but also
involved perspectives from social, behavioral, health, cognitive and occupational scientists. Together, we provide
a shared mission and vision for HBI by establishing universal terminology, dening core dimensions, identifying
key research questions, and outlining approaches and methods. Using a broad interdisciplinary perspective to
shape the convergent eld of HBI can result in a more signicant impact by cultivating collaboration and coor-
dination among the scientic community that closes gaps in current disciplinary-specic research. is shared
language and collective vision set the groundwork for valuable disciplinary, interdisciplinary, and transdiscipli-
nary advancements in HBI that contribute to an improved fundamental understanding of and applications that
maximize how intelligent built environments interact with, adapt to, and support humans.
Consensus methods. A diverse group of 25 industry-based and academic scholars from various disci-
plines convened in a writing workshop meant to minimize isolation (which can be an issue in interdisciplinary
elds) and maximize cooperation (eliminating duplicate eorts across dierent domains) among individuals
interested in HBI. Research elds represented in the workshops included: built environment design, construc-
tion, and operations (including architecture and various engineering disciplines such as civil, mechanical, elec-
trical, environmental, and industrial engineering), energy, transportation, applied sciences, computer science,
articial intelligence and computer vision, communication and textual studies, information and communication
technologies, human factors, HCI, human-centered design (HCD), humanities and social sciences, cognitive
science, psychology, medical informatics, public health, environmental and occupational health, occupational
science, orthopedics, and rehabilitation.
e workshop was composed of four professionally facilitated online sessions, each 4-h long, held biweekly
from January 2022 to March 2022. Before and during the sessions, participants’ perspectives and ideas were
solicited using virtual “sticky notes” in the workshop-facilitation platform8 related to the denition of HBI, the
vision and scope of HBI, the research areas of HBI, and the development of this paper, including sections, title,
and appropriate publication venues. Participants interacted in several ways to share their perspectives, ideas,
and concerns, including verbal discussions in plenary sessions with all participants, oral discussions during
breakout sessions, post-hoc online meetings, and through Slack channels or email messages. Participants voted
on the various outputs generated by the group to identify, prioritize, and come to a consensus on each component
of this paper. All participants contributed to writing, editing, or commenting on this paper, primarily occur-
ring asynchronously between and aer the four workshop sessions. Participants contributed content specic
to their expertise and reviewed all content to ensure that the perspectives of their disciplines were represented
throughout.
In the following sections, we present the consensus outcomes of this HBI workshop, including a shared
interdisciplinary denition, vision, and impact for the eld; descriptions of the overarching areas and associ-
ated transversal dimensions of HBI research; and examples of research studies and methods within HBI. All
experimental protocols were approved by the respective universities’ ethic committees (University of Southern
California, Carnegie Mellon University, Rensselaer Polytechnic Institute, Technion—Israel Institute of Technol-
ogy). All methods were carried out in accordance with relevant guidelines and regulations and informed consents
were obtained from all participants.
HBI denition
Human-Building Interaction (HBI) is an interdisciplinary eld that aims to understand how built environments
aect human outcomes and experiences and how humans interact with, adapt to, and aect the built environ-
ment and its systems. At its core, HBI focuses on enabling built environments that can learn, adapt, and evolve at
dierent scales (individual building, community level, city level) to improve the quality of life of its users while
optimizing resource usage and service availability. As a result, HBI researchers and practitioners explore the
mutual impact between buildings and humans, observe how users interact with built environments, and design
technologies to support novel interactions in such spaces. Figure1 shows the critical elements of this denition.
Within HBI, we describe buildings as built environments created by humans to service our needs, such as
to ensure safety and comfort, improve the quality of life, and accomplish personal goals (e.g., work, play, relax,
sleep) and societal-driven goals (e.g., reducing energy consumption, recycling). e considered built environment
Content courtesy of Springer Nature, terms of use apply. Rights reserved
3
Vol.:(0123456789)
Scientic Reports | (2022) 12:22092 | https://doi.org/10.1038/s41598-022-25047-y
www.nature.com/scientificreports/
may refer to a single building or numerous, interconnected, physically adjacent buildings that might create a
community, campus, city, or network of buildings. Here, we focus on buildings and their immediate external
surroundings but acknowledge that some work in HBI is more expansive in scopes, such as smart cities and
infrastructure. We also consider buildings to be complex systems that consist of, among other things, the building
envelope, heating, ventilation, and air conditioning (HVAC) systems, electrical systems, energy generation and
management, water and plumbing, lighting and daylighting, intelligent controls, entertainment, interior design,
furniture, and modes of movement in, out, and around the building. ese sub-systems actively and passively
interact with humans and, as a result, impact human experiences, interactions, activities, and other outcomes.
Interactions among humans and the built environment range from passive to active, with various direct
and indirect interfaces. Passive interactions aecting human users include adjustments to the building system’s
operations to accommodate the needs of the humans or minimize impacts on the environment. For example,
HVAC systems regulate the indoor environments temperature, humidity, and airow, impacting a human’s ther-
mal experience. Lighting/shading systems adjust light color and intensity, which could aect humans’ physical
and psychological well-being due to their impact on circadian rhythms9. Similarly, spatial conguration and
indoor environments are oen designed to meet the needs of activity, mobility, or other participation that can
aect building operation systems. For example, open-plan workplaces can encourage collaboration while walled
oces and meeting rooms provide privacy. Yet, each of these congurations can lead to inecient use of space
or ineectual operations by building systems. On the other hand, active interaction includes human action to
change building systems or the built environment. Operating windows and controlling heating setpoints via an
interface represent well-known forms of active interaction with building systems. Smoking cigarettes and cooking
represent indirect but active interaction with the built environment that can, in turn, impact human outcomes
and experiences and trigger reactions from building systems, such as safety sensors triggering an alarm when
detecting smoke. In the context of HBI, such passive and active interactions are facilitated through intelligent
interfaces10 and sensing11 and the building becomes aware of human attitudes, needs, habits, norms, motivations12
and chooses to learn, adapt, and evolve for best human outcomes and experiences1315.
Individual and collective human interactions with buildings can take many dynamic forms across the passive-
active interaction spectrum. Humans and buildings can interact with one another through new and adaptive
multimodal interfaces enriched by sensing and computing16, 17, including the use of motor functions, such as
speech, gesture, and navigation18. Yet, these interactions are inherently dierent than the ones in the eld of
HCI, where there is a dened mode of interaction (a computer), oen through hardware explicitly created for
the interactive purpose. In buildings, this interaction is facilitated through embodied and built-in intelligence
within building elements2, 5 that may not be initially designed for intelligent interaction, as well as other tech-
nologies added to the environment (e.g., windows, doors, building furniture like desks or chairs, light switches,
thermostats, smart paint19, 20). Not only is the signicant range of available features relevant to HBI widely varied
in design, but these features are also typically multifaceted in function and application. For example, interactions
Figure1. Primary HBI research areas, intersecting interdisciplinary research domains, and core principles of all
HBI research. Image credit: Basma Altaf.
Content courtesy of Springer Nature, terms of use apply. Rights reserved
4
Vol:.(1234567890)
Scientic Reports | (2022) 12:22092 | https://doi.org/10.1038/s41598-022-25047-y
www.nature.com/scientificreports/
can target many physical and sensory outcomes (e.g., thermal, and visual comfort2125, satisfaction2632, health33),
and one persons interaction with a building can easily inuence many others34.
HBI vision
We envision that the eld of HBI will enable a future where widespread synergistic relationships between humans
and built environments exist to support individuals and advance broader societal goals. is vision involves the
study of humans not solely as occupants, end-users, or homogenous actors within a built space but as individu-
als with unique lived experiences, personalities, capabilities, and goals. HBI research aims to support positive
engagements as these diverse individuals participate in activities within and around the built environments in
which they live, work, and play. By understanding human attitudes, motivations, habits, and norms and account-
ing for occupants’ safety, security, and privacy, HBI seeks to engage buildings with occupants to produce better
personal and societal outcomes. Similarly, HBI involves studying built environments not only as physical spaces
and operational systems but as the foundation for technologies that can sense and infer the needs of, provide
support to, and interact with humans. As such, the eld of HBI is interested in enhancing both new and existing
physical spaces and being deeply engaged in supporting the future of intelligent built environments.
HBI research dimensions
As the foundation, HBI scholarship merges three primary research areas related to humans, buildings, and
technology, each rooted in the scholarship of individual disciplines across social, behavioral, health, building,
and computer sciences: Human Experiences, Performance, and Well-being; Building Design and Operations; and
Sensing, Inference, and Awareness. Intersecting interests between pairs of these research areas give rise to three
interdisciplinary research domains: Trust and Collaboration, Decision-making and Control, and Modeling and
Simulation. At the center of all HBI research are core principles such as Equity, Privacy, and Sustainability that
should be incorporated or considered in every aspect of HBI scholarship. In this section, we provide descriptions
of these research dimensions to establish a shared language for the interdisciplinary eld of HBI.
Primary research areas in HBI. Human experiences, performance, and well-being. Research on technol-
ogy integration into buildings has focused chiey on top-down technology developments that largely neglect
the dynamics of dierent building users with diverse preferences and needs35. Human aspects of HBI research
should consider the impact of an environment and its constituent elements on human’s physiological and psy-
chological experiences, activities, and performance across a spectrum of short and long-term horizons. Most
of our daily activities take place inside buildings used as homes, workplaces, schools, retail stores, healthcare
facilities, and other social or business spaces. Signicant opportunities exist to employ HBI approaches that en-
able a seamless connection between users and buildings to support positive human experiences. Buildings that
produce an ongoing sense of fulllment5, 36, even during mundane activities37, will require an ambitious human-
centered focus to dene the goals of engineered systems that promote a wide variety of human experiences,
such as comfort, satisfaction, convenience, health, well-being, safety, lifelong learning, communication, social
engagement, and productivity. Within our HBI infrastructure, we imagine a future in which buildings become
perceptual and cognitive environments, encompassing both users and the physical infrastructure that shapes
and supports human intent, perception, and behavior. In such a cognitive environment, humans are integral to
the system rather than a variable to work around3841.
ere are signicant opportunities for the built environment to aect humans and for humans to impact built
environments, represented by research focused on human experiences and responses. Such studies have quanti-
ed and modeled the impact of comfort on human satisfaction and performance2632 or have investigated con-
tributors to the physical, mental, social, and spiritual health and well-being of building occupants33. In addition
to examining occupant or building-focused outcomes, HBI research can also investigate complex intersections
between human behavior and these individual or shared outcomes. In a well-studied HBI example problem,
behavioral scientists have pointed to an energy eciency gap between the design intent of technologies and their
realized performance in actual built environments42, primarily due to human behavior. Research in this area
investigated, among others, the drivers of human behavior (e.g., norms, attitudes)12, social practices that impact
energy use4345 and interventions to produce behavioral change4648. is example highlights the importance of
understanding the complex intersections among diverse, individualized human experiences and human behavior
throughout daily activities as these complexities inform, shape, and inuence the built environment.
Interdisciplinary collaboration among social, health, and behavioral scientists with architects, engineers, and
computer scientists is critical to advancing the theoretical and practical impacts of HBI research49. A primary
example of such collaborations is the study of energy feedback50 and user interfaces for energy devices51, which
stemmed from the interface between social science and HCI. ese interdisciplinary collaborations are further
facilitated by developing more granular and human-centric sensing technologies. Technologies that can iden-
tify occupant activities, emotional states, and needs can be used by intelligent built environments to support
engagement, well-being, and performance. Moreover, these technologies can provide the means for a synergistic
or cooperative approach between the building and occupants to inuence synergistic behaviors by both sides
that can achieve individual and shared goals. It is vital that future research leverage this synergistic perspective
to understand how humans and building technologies ascribe shared value. Synergistic approaches are critical
as AI begins to automate tasks previously under the occupants control (e.g., opening blinds, preparing coee,
updating thermostat schedules). Although such actions by the built environments are oen meant to support
the user or address a broader human-dened objective (e.g., reducing energy), some humans may value personal
control over other benets49, 52. As such, interdisciplinary approaches that investigate the distributed interaction
and agency across all the human users and building technologies are vital.
Content courtesy of Springer Nature, terms of use apply. Rights reserved
5
Vol.:(0123456789)
Scientic Reports | (2022) 12:22092 | https://doi.org/10.1038/s41598-022-25047-y
www.nature.com/scientificreports/
Building design and operations. Whether it is designed to be a smart built environment from the outset or may
be augmented/retrotted to include technology aspects, the physical building and its operations are critical com-
ponents of HBI. Disciplinary knowledge within architecture and various engineering elds such as mechanical
engineering, electrical engineering, architectural engineering, civil engineering, and building science provide
a strong foundation for HBI research. Research on building processes and practices over the last decade has
led to innovations in design methods5355, engineering systems such as HVAC equipment and appliances56, 57,
lighting58, 59, building materials like glazing systems60, 61, construction processes62, 63, and building management
and controls64, 65. In HBI, it is important to move beyond these building-centric foci to leverage sensed aware-
ness of the needs and behaviors of their occupants so that user experiences and outcomes are optimized against
oen-competing external variables such as energy availability, extreme events (e.g., wildres and public health
concerns), weather events, schedules, or the needs of other users.
Incorporating social, behavioral, health, and computer scientists in HBI research will ensure that the dynamic
behavior of building occupants is accounted for in the design process and day-to-day operations of physical
buildings. Human-centered design approaches enable the creation of environments that support evolving needs
of their occupants. One such approach is cognitive-grounded design, which is based on human perception and
cognition research. Using this approach, one study examined how people process and respond to spatial and
social stimuli to inform design decisions related to waynding scenarios66. Another example is biophilic design,
which includes the design of spaces that reect the innate anity humans have for nature to support human
well-being that incorporates considerations such as access to natural light, views of nature, and use of natural
materials67. Similar approaches in HBI research could explore how to best connect built environments to com-
munities, cultures, and contexts, including considerations for designing the space where the building meets the
external urban or rural area68.
From an operations perspective, AI-driven adaptations of built environments include changes in building
operations or features in response to occupants’ short- or long-term needs. ese operations include physical
environmental components such as adequate lighting, optimal indoor air quality, and thermal comfort, as well
as human performance considerations such as promoting social engagement, productivity, and safety13. In the
eld of HBI, building operations should consider incorporating technology and human performance in day-
to-day resource management, such as for the improvement of HVAC and other physical building operations, as
well as improving waynding activities to manage eciency in human mobility within busy environments18. It
is also vital that HBI research consider support for building operations for extreme scenario responses such as
re accidents69 or violent attacks70.
Sensing, inference, and awareness. Technology aspects of HBI research incorporate the primary areas of sens-
ing, inference, and awareness that underpin actuation, communication, and other interfaces with human and
building components of the HBI research infrastructure. Interdisciplinary research in these areas falls at the
intersection of computer science and other areas of computing and engineering, including civil engineering,
mechanical engineering, electrical engineering, and industrial and system engineering.
Sensing technologies include various physical environmental devices, personal or portable wearable devices,
and sensor deployment strategies. HBI research has examined numerous environmental sensors that can
quantify human activities, experiences, and performance, and monitor changes within the physical or social
environment16, 7173. Internet of ings (IoT) provides a way to connect building operations such as security
and access control, predictive maintenance, structural health, re detection and so on74. Similarly, wearable
sensors that measure physiological variables, such as skin temperature, perspiration rate, and heart rate, can
assist in understanding human health and well-being related to engagement within built environments31, 75.
ese methods rely on sensing technologies that provide robust data throughout daily activities that require the
direct engagement of the human or building. On the other hand, non-intrusive technologies including infrared
thermography32, 76, optical imaging30, 77, 78, ambient sensing17, and real-time visual perception using human eye
pupil size measurements79 have been proposed as alternative non-contact methods to evaluate human experi-
ence within built environments.
Regardless of the sensing method, data from these systems can be used to infer higher-level knowledge, such
as recognizing human presence, activities, and interactions, as has been done in activity recognition research8086.
Reasoning out broader constructs can be achieved through direct inference from data gathered by the sensing
hardware or through virtual sensing supported by inference algorithms87. Using these methods, intelligent build-
ings can develop, calibrate, and rene models of human occupants to infer the emotional state, physical abilities,
or social dynamics of individual occupants or groups to create opportunities for buildings to interact with people
more appropriately. For example, if an intelligent building infers that someone is operating a wheelchair, it could
recommend alternative paths that accommodate their needs. In an emergency, when inferring relationships,
such as a mother holding the hands of young children, a more appropriate egress path may be presented to the
mother that accommodates the childrens abilities. Alternatively, a building could infer the emotional state of its
occupants and operate the systems accordingly.
When captured over time or across a network of buildings, sensing and related inference data can be aggre-
gated to develop activity patterns, thus giving the building occupant-awareness. Broad awareness of human needs,
environmental needs, or other aspects of social context can allow the building to leverage predictive functions to
maximize support required in the environment while minimizing disruptions to building operations or human
engagement. Given this awareness, when an intelligent environment is aware that it currently is not supporting
and cannot fully support the needs of occupants, it can recommend optimal changes or improvements to the
owner/operator of the building to better meet social needs and environmental goals.
Content courtesy of Springer Nature, terms of use apply. Rights reserved
6
Vol:.(1234567890)
Scientic Reports | (2022) 12:22092 | https://doi.org/10.1038/s41598-022-25047-y
www.nature.com/scientificreports/
Overarching research opportunities. Current studies mainly consider built environments as static containers
rather than proactive partners. New HBI research opportunities involve analyzing the collaborative interactions
between humans and intelligent buildings equipped with sensing, inferring, and communication abilities. More
human-aware and cognizant building design and control systems could inform dynamic building adaptations in
response to and anticipation of people’s emerging needs14. For example, intelligent environments equipped with
sensing and awareness technologies could potentially consider the dynamic state of the building and its occu-
pants at a given time to recommend optimal resource allocation scenarios, including spaces, people, equipment,
and energy services. Research can support such involvement in day-to-day operations, in response to unfolding
situations, and in predicting and preventing undesired situations. ese approaches can simultaneously improve
human engagement while considering the building’s impact on its occupants and broader impact on the natural
environment. Table1 summarizes research needs across these three primary research areas in the form of sample
research questions.
Interdisciplinary research domains in HBI. ree interdisciplinary research domains sit at the intersec-
tions of the primary research areas in HBI (see Fig.1). Trust and collaboration at the intersection of human and
building aspects of HBI include human-building teaming, synergistic human behavior and building operation
changes, and other actions that require trust and collaboration to support shared goals between the building and
its occupants. e domain of decision-making and control includes topics at the intersection of the technology
and human aspects of HBI, such as occupant-centric controls, context-aware operations, intelligent automa-
tion, bidirectional adaptation, articial intelligence, machine learning, and data analytics. Finally, the interdis-
ciplinary research domain of modeling and simulation includes topics at the intersection of the building and
technology aspects of HBI, such as physical and digital system adaptations, design intent, design intervention,
computational modeling, and predictive maintenance. Table2 summarizes research needs pertaining to these
interdisciplinary research domains within HBI.
Table 1. Sample research questions related to human, building, and technology aspects of HBI.
Human experiences, performance, and well-being
How can built environments augment user performance (such as productivity or safety)?
What are the eects of HBI on joint human-automation performance?
How do built environments’ design and operations passively and/or actively impact occupants’ health and well-being?
How can interfaces in the built environment actively “nudge” occupants towards adopting changes for healthier behavior, and how can
“nudging” be converted to active awareness and participation in positive actions among the occupants?
How can psychological, social, and economic theories help building systems and AI to enhance occupant experience, performance, and
well-being?
What role does AI play in addition to humans in making decisions about building operations (e.g., should the AI system be in charge based
on predetermined human requirements or should the human be in charge based on AI suggestions?)
How might built environments help humans, families, and organizations achieve their goals?
Building design and operations
What is the dierence between designing non-intelligent buildings vs. intelligent ones that are aware and proactively cater to the needs of
their occupants?
What approaches could be used to perform cognitive-grounded analyses of the collaborative interactions between humans and intelligent
buildings equipped with sensing, inferring, and communication abilities?
How might we design spaces that are intuitive to navigate for humans with dierent physical and cognitive abilities both in the day-to-day
and emergency scenarios (e.g., to help their occupants to shelter during an active shooter incident)?
How could natural elements be seamlessly integrated into the building design process to enhance the well-being of dierent populations over
time?
How can AI-driven adaptations of built features be programmed to respond to and anticipate occupants’ short- or long-term needs?
What are the opportunities and challenges for incorporating automated operational adaptations in existing buildings vs. building intelligent
adaptation methods into new designs?
To what degree does enabling occupant awareness and interactivity in built environments promote low-energy and low-carbon building
operations?
Sensing, inference, and awareness
What are optimal modalities and congurations of sensors that result in high accuracy and robust data collection and inference in a privacy-
preserving and unbiased manner?
What sensor modalities are needed to be added to the mix of Internet of ings (IoT) devices to facilitate more ambitious goals in the HBI
eld?
Given the combination of xed and dynamic sensors within the built environment, with a varying set of IoT devices used by occupants, how
can a sensor fusion system best normalize the data features to support higher-level functionality such as activity recognition?
How could buildings infer and quantify each specic occupant’s habits, experiences, and social interactions through the emerging sensing
technologies?
How could a general graph of human activities be generated and populated given myriads of sensor fusion results from various building
types? How could the social, temporal, and semi-hierarchical nature of the relations between human activities be represented?
What representations could be used to develop an awareness of human needs, social contexts, and environmental needs so that levels of
compliance to those goals can be estimated? How can recommender systems be developed to automate the suggestion of optimal modica-
tions to increase compliance?
Content courtesy of Springer Nature, terms of use apply. Rights reserved
7
Vol.:(0123456789)
Scientic Reports | (2022) 12:22092 | https://doi.org/10.1038/s41598-022-25047-y
www.nature.com/scientificreports/
Trust and collaboration. When the built environments become infused with intelligence, there will be new
opportunities for human-building teamwork that calls for collaboration and trust. Prior interdisciplinary work
has considered factors that encourage trust in and collaboration with automation for various tasks (e.g., in man-
ufacturing, aviation88, 89). ere is a developing empirical body of research for trust in automation for intelligent
built environments, which requires collaborations among many disciplines, including architecture, cognitive sci-
ence, engineering, computer science, and human factors and industrial-organizational psychology experts. With
more intelligent buildings1, there will be an increased level of automation based on the type and function of the
environment88. In addition, new modes and types of interaction will be needed to fulll the goals of both humans
and the built environment. For built environments to develop the intelligence required for collaboration, users
need to trust the environment with data acquisition, processing, storage, and decision-making. Ambitious HBI
goals also require user trust in accepting the actions, decisions, and recommendations from the built environ-
ments’ features. Research on trust could be built on similar research eorts involving the privacy and security
of intelligent systems and environments, resulting in a better understanding of how users and communities
perceive the role and functionalities of such systems. Additionally, it is necessary to consider the implications of
trust based on how the sensing, inference, and awareness solutions support goals and objectives that align with
those of dierent stakeholders. For example, the goals of building occupants may be counter to those of building
managers/owners, who could lead reduce trust among various stakeholders. Finally, building design and opera-
tions might have an impact on trust and collaboration. According to the literature, layout design and nature
stimuli can provide a sense of trust for occupants. For instance, physical proximity promotes collaboration,
bonding and trust89, and trust bond among residents of a place can be associated with the sense of satisfaction
about sharing environments90. In this regard, open-plan oce environments with assigned work spaces help
participants foster trust and respect among each other91. On the other hand, shared work environments, and in
particular hot-desking, are associated with distrust in work environments92. As another example in regard to the
biophilic design of buildings, exposure to more beautiful images of nature led participants to be more generous
and trusting in comparison to exposure to less beautiful images of nature93.
Decision-making and control. As a classical HBI framework, occupant-centered controls in buildings aim at
improving occupant satisfaction and perceived service quality (e.g., thermal and visual comfort) while account-
ing for sustainable practices (e.g., minimizing energy consumption94 or integration of renewable resources68). A
wide range of approaches have been explored, from simple presence-responsive systems (e.g., lighting triggered
by an occupancy sensor) to complex predictive techniques (e.g., model predictive controls) based on human
activity and preferences95. Challenges remain in the development of decision-making and control models that
Table 2. Sample research questions related to interdisciplinary research areas of HBI.
Trust and collaboration
How might we better design novel interactions that increase trust and collaboration between built environments and their users?
How will these interactions change the behavior of humans and built environments?
How do, and what type of, interactions with building structures, systems, and operations inuence how humans perceive, experience, and
use spaces?
What types of user interfaces and modes of communication promote eective collaboration and trust to advance shared goals between the
building and human occupants?
How does the level of automation aect trust in technology?
How does trust in technology change based on users’ tasks in built environments?
How will novel HBIs change people’s expectations of the built environment?
How will the type of collaboration aect the way that humans use the built environments?
Decision-making and control
How will control systems respond to a diversity of human needs?
Should a bottom-up approach (intelligence growing from individual smart devices) or a top-down approach (a smart central building
manager) be taken? Or is it this goal dependent, and for some goals, the system should consider a top-down approach, and for other goals, a
bottom-up approach might be a better option
How do users react to intelligent and aware spaces or building (e.g., buildings that dynamically adjust the color temperature according to
user activities or building geometry support users)?
How could smart systems be developed to be scalable and transferable?
Modeling and simulation
How can we generalize and incorporate well-being considerations into design tools (e.g., Building Information Modeling)?
Which physical and digital adaptations are most eective for specic populations/cultures/building styles?
How can the physical layout be designed to reect the organizational structure, levels of sharing, and visibility (physically and conceptually)?
What are the tradeos between physical materials and digital representations?
How can computational models of human behavior account for the building occupants’ cultural, physical, and psychological traits?
How can generative design approaches account for designers’ tacit knowledge?
How can Machine Learning (ML) and Deep Learning (DL) approaches replace or integrate traditional Multi Agent Systems (MAS), which
oen require long computational times?
What is the role of digital twins in HBI research? How can future building digital twins preserve building occupant privacy?
Content courtesy of Springer Nature, terms of use apply. Rights reserved
8
Vol:.(1234567890)
Scientic Reports | (2022) 12:22092 | https://doi.org/10.1038/s41598-022-25047-y
www.nature.com/scientificreports/
can identify user routines and patterns, predict shiing or dynamic behaviors, and infer preferences to support
user-adaptive building operations. Interdisciplinary HBI research is necessary to identify more granular and
accurate inference across routine and dynamic human behaviors, diverse human preferences, and various emo-
tional and physical states across all human occupants. Improved inference, informed by algorithmic frameworks
and enabled by new sensing modalities, will lead to better decision-making and control to optimize building
operations, improve the experiences among diverse users within individual buildings, and balance such needs
against external variables. Building-level decision-making, control, and awareness can provide a foundation
for broader system-level operations, such as interconnections among buildings and the surrounding neighbor-
hoods across communities or within more extensive infrastructures. To this end, future interdisciplinary HBI
research is necessary to identify human-centered AI solutions that are scalable, sample ecient, and safe. It will
be essential to develop studies of building-level intelligent agents that are informed not only by local objectives
and constraints but also by the intelligent systems role in larger-scale coordination. System-level operations
might include community-based energy management for demand-response and renewable energy integrations
or smart building-city coordination to inform and enhance rst responders’ response to emergencies.
Modeling and simulation. Architects and engineers have long used digital representation tools to model
building features, evaluate features relative to design intentions, and enhance communication across design
stakeholders96 such as Building Information Modeling (BIM)97. BIM, however, lacks information about the
behaviors of building occupants as well as their interactions with the built environment98. Since these aspects are
at the core of HBI, it is thus imperative to extend existing modeling tools and practices with this new emphasis.
To this end, a new research area involves the computational simulation of human behavior in buildings using
multi-agent systems (MAS). In MAS, prospective building occupants are modeled as agents that interact among
them as well as with the surrounding built environments to goals related to the type of organization that occu-
pies the building99. ese approaches have been applied to model operational performance in process-driven
facilities like hospitals100, waynding in multi-level buildings101, occupancy patterns in university campuses102,
thermal and acoustic comfort in oce spaces103, and emergency evacuation scenarios104. Generative design
approaches also show promise in coupling human-centered evaluation metrics with parametric models of build-
ings to automatically generate, sort through, and evaluate several design options and recommend the ones that
balance tradeos between building and human performance metrics105. is approach requires interdisciplinary
research eorts that bring together architects, engineers, social scientists and building scientists. BIM models
have also been coupled with real-time sensing technologies to dynamically update a digital representation (oen
called a Digital Twin) of a building or its parts/systems106. Digital twins of the built environment provide a foun-
dation for real-time evaluation of building systems and data-driven forecasting of future performance. Compu-
tational simulation of building performance could also be incorporated into digital twins to inform real-time
decision-making in day-to-day and emergency scenarios. Interdisciplinary HBI research could use the existing
approaches as a starting point to develop more comprehensive tools and techniques that better inform the design
and operational adaptations at dierent time scales while also accounting for more detailed occupant proles,
which include cultural, geographical, psychological, physical, and economic traits, as well as passive and active
interactions with intelligent control systems.
Core principles in HBI. Leveraging interdisciplinary perspectives, the eld of HBI emphasizes greater
understanding and enabling of positive two-way interactions between humans and built environments that
include passive solutions while promoting active engagements. By supporting bi-directional human-building
synergies and promoting responsible innovation (similar to calls in HCI107), successful HBI eorts can result
in meaningful changes to the design, operation, use, and assessment of built environments that have profound
eects on our lives, our society, and our environment. Among many areas of broad impact, thoughtful HBI
research should be conducted with consideration of core principles that reect contemporary societal goals: (1)
promoting equity and inclusion of individuals who engage within and around buildings, (2) addressing evolving
concerns of privacy and security related to the increased use of technologies within buildings, and (3) support-
ing sustainability and resilience in the face of environmental, social, or other hardships (e.g., disaster response,
homelessness). Table3 summarizes the research questions pertaining to the core principles of HBI.
Equity and inclusion. HBI research must consider diversity across the many types of individuals who occupy
or use buildings to promote accessibility, inclusion, and equity in applying technological supports. ere is a
long-standing underrepresentation and consideration of user diversity in building-related research that includes
many marginalized groups and minorities108, 109. In the study and development of HBI, there is a need to under-
stand dierences in engagement and support required across dierent genders, age ranges (i.e., including chil-
dren, youth, and older adults), and socioeconomic statuses110. Moreover, HBI solutions and technologies should
determine how support is equitable and inclusive for individuals from communities of color and people with
varied physical abilities or mental health conditions111, 112. Finally, there is an opportunity to expand HBI eorts
to support the needs of displaced groups, migrants, and unsheltered individuals113. HBI professionals can lead
standards that encourage inclusive behavior and recognize ongoing exclusions and societal biases to ensure that
diverse populations are represented in user studies and in testbed or real-world deployments. Applying a diver-
sity lens within research practices is a signicant consideration to avoid bias inherent to humans, which can be
inadvertently carried forward into the resulting technology109. Universal and accessible design is necessary to
support an inclusive culture and is key to ensuring that built environments support diverse human needs and
eective activity engagement108. HBI technology has the potential to maximize the adaptability of design for
individuals with diering physical, social, and sensory abilities114. Although many HBI innovations will be tech-
Content courtesy of Springer Nature, terms of use apply. Rights reserved
9
Vol.:(0123456789)
Scientic Reports | (2022) 12:22092 | https://doi.org/10.1038/s41598-022-25047-y
www.nature.com/scientificreports/
nologically advanced, HBI eorts should also consider applications for economically disadvantaged regions and
low-tech spaces. In fact, because low-tech or no-tech built environments constitute most of the current building
stock, the extrapolation and adaptation of innovations from high-tech built environments is an opportunity for
the eld of HBI. Across all opportunities, it is vital for HBI researchers to carefully consider the source of data
that informs automated decision-support systems to reect the knowledge, opinions, and needs of broad, diverse
communities to ensure that outcomes promote equity and inclusion.
Privacy and security. Privacy is a core component of any socio-technical system that collects personal data
from its users, and the security of that information is vital, particularly when simultaneously incorporating
and sharing information across multiple data sources. Physical spaces in which humans engage have inherent
privacy and security concerns related to exchanging information (e.g., meetings) and other sensitive activities
(e.g., physical examinations in healthcare settings). As we move towards more intelligent, aware, and adaptive
buildings, it is critical to responsibly manage captured data, especially highly personal and potentially sensi-
tive, stigmatic, and exploitable health-associated data. One current example is the rapidly expanding number of
distributed IoT devices monitoring building applications (e.g., indoor environmental quality23, 29, 78, 115) that are
connected to cloud services. is increase in cloud computing is paralleled by an increase in security vulner-
abilities and concerns of inappropriate use of data obtained by sensing devices. For example, managers gaining
access to cloud-sourced behavioral data of their employees as a means for monitoring performance could lead
to employment termination. HBI research should seek to unify and extend current research on security- and
privacy-related issues such as smart grid security116 and IoT security117. Dierential privacy118 and federated
learning119 are technical solutions that may be viable solutions to accessing aggregated individual data that pre-
vent access by entities with power over the individuals. Furthermore, increased use of human-centered, par-
ticipatory design, and generative techniques120 are promising ways to advance the security and privacy aspects
of HBI by identifying user concerns and accounting for individual preferences. HBI research should consider
providing personal user control over privacy settings, identifying policy solutions, and developing new instru-
ments for appropriate data stewardship, such as data trusts121. Timely incorporation of privacy and security as
considerations in HBI research can ensure eective sharing of data across third-party building applications and
between buildings on dierent networks while maintaining the trust, safety, and security of occupants.
Sustainability and resilience. HBI research has an opportunity to move beyond satisfying basic requirements
of shelter, safety, and security toward serving broader societal needs such as environmental sustainability, cli-
mate resilience, and societal well-being. Building operations are one of the largest sources of global greenhouse
gas emissions, with heating, cooling, and water heating comprising most energy-related emissions, particu-
larly in existing built environments. Resource consumption and emissions from built environments are strongly
determined by occupant service requirements (temperature, lighting, etc.) and usage patterns. erefore, HBI
research must leverage a deep understanding of these service needs and usage patterns to develop fundamentally
sustainable and adaptive design and operation solutions for the built environment that substantially mitigate the
risks of catastrophic climate change. e built environment also serves as a primary means of adaptation to the
climate crisis and its potential eects on personal comfort, health, and happiness. Even as we work to prevent
the disastrous eects of climate change, resilience to these unavoidable events is a must. ese impacts oen
unequally aect communities of color and low-income, emphasizing the necessity for equitable and proactive
Table 3. Sample research questions related to core principles of HBI.
Equity and inclusion
How could universal and inclusive design concepts be integrated with the theoretical disciplines and practical applications of HBI?
How can the dynamicity of interactions between occupants and buildings enable us to consider the specic needs of some groups of societies
that are more susceptible to features of physical environments?
How can we include and adapt to the needs of dierent groups in the design and implementation of HBI-based solutions?
How can we rethink making low-cost HBI solutions to extend the usability of these solutions among the public?
Privacy and security
What new security and privacy concerns do device-human-building interactions raise?
Can we develop new adaptive and exible control schemes to secure an expanded dynamic, diverse, and heterogeneous environment with
good user experience and application performance?
How do we address the issues raised by more sub-systems being added into buildings or conicts between dierent application require-
ments?
What are the tradeos between security/privacy and application performance or user experiences?
How can building systems respond to personalized privacy proles?
Sustainability and resilience
How might we balance conicting objectives and tradeos of comfort, well-being, energy and CO2 reductions, and resilience?
How do we move beyond individual buildings and coordinate buildings at a neighborhoods or city scale?
How do we plan for the inevitable need to renovate, retrot, and retire buildings?
How could HBI technologies and solutions lead to increased resilience and operational exibility of buildings and communities?
How could HBI research assist with resilience towards extreme events due to climate change such as wildres, heat waves, ooding, etc.?
Content courtesy of Springer Nature, terms of use apply. Rights reserved
10
Vol:.(1234567890)
Scientic Reports | (2022) 12:22092 | https://doi.org/10.1038/s41598-022-25047-y
www.nature.com/scientificreports/
resilience planning and resource allocation122. For instance, the city of Phoenix in Arizona, has developed a
heat action plan that relies on natural cooling techniques to cool the neighborhoods most in need123. In another
example, the city of New Orleans is prone to severe storm events that include hurricanes and ood waters.
erefore, the local authorities issued guidelines for storm preparedness and resilience that include regular
maintenance and basic structural improvements strategies124. To that end, proponents of the eld of HBI should
be not only the stewards of our environment but also human health and well-being. Technology’s harmful and
unintended impacts on human psychology should be carefully considered. is is even more important with the
blurring lines of work and home life with the increase in hybrid work125, 126; thus, there needs to be accountability
for human well-being, safety, comfort, and productivity in HBI-enabled spaces, and HBI innovations should
start with a human-centered purpose to inuence the development of technology that leads to sustainable and
resilient societies.
Research and practice in HBI
HBI researchers conduct studies in several high-level areas, including (1) discovering and quantifying the pas-
sive interaction that impacts users’ personal experiences and outcomes from the built environment and building
systems, (2) observing and learning human behaviors in built environments to quantify the active actions and
their impact on the built environment and building systems, as well as potentials for technology adoption and
success, and (3) designing, building, and evaluating new technology that allows built environments to become
more exible and more responsive to human needs over their operational lifetime. is section provides an
overview of methods and practical applications for HBI research. We then present examples of original research
in HBI that reect the dierent transversal themes outlined above.
HBI research methods. Research approaches are adopted or adapted from the multiple disciplines and
research elds that compose the interdisciplinary eld of HBI. Design, development, testing, and user experi-
ence research within HBI employs both qualitative (e.g., focus groups, interviews, ethnographies, narratives)127
and quantitative (e.g., randomized control trials, experimental studies, observational measurement, surveys)
research methods. A variety of AI techniques, optimization methods, including supervised learning (regres-
sion, classication, deep learning), unsupervised learning (dimensionality reduction, clustering, anomaly/event
detection), and reinforcement learning techniques, are used for predictive modeling, inference, and control. HBI
research is conducted in lab-controlled environments30, through eld studies in existing built environments15
and systems128, and by the use of immersive virtual reality environments (virtual prototyping)129. Simulation
is frequently used to understand the impact of HBI technologies and evaluate algorithmic frameworks when
human data is unavailable or to develop mathematical models that can be tested against human data/observa-
tions65, 94.
Examples of existing HBI applications. Multiple examples of robust HBI applications exist. For exam-
ple, the Cortellucci Vaughan Hospital in Ontario, Canada, opened in 2021, uses real-time locating systems to
track assets and monitor patients’ locations and movements. e hospital also relies on an integrated smart tech-
nology grid to maximize information exchange, allowing for ecient logistics management, medical sta work-
ow, and a pleasant patient experience130. e EDGE building in Amsterdam, Holland, is considered one of the
most intelligent buildings in the world according to the British rating agency BREEAM131. e commercial oce
building was established to make its users’ work experience as smooth as possible. e building knows workers’
schedules, assigns the most convenient parking spot upon arrival, and customizes the light and temperature
of their workstations according to personal preferences132. Some Target retail stores in the United States have
advanced LED light xtures with visible light communication (VLC) capabilities. When partnered with Visible
Light Positioning (VLP)133 of image sensors on smartphones, these LEDs allow customers to use the Target app
to navigate around the store to a specic product location134, 135. Smart residential buildings equipped with vari-
ous smart home gadgets (e.g., smart video doorbells, stove controller, smart pillbox, automated emergency call
system) provide a comfortable, safe, and secure space, allowing seniors to remain in their homes136. Recently, big
tech companies have created smart home hubs (e.g., Amazon Echo, Google Home, and Samsung Smartings),
which act as a central house monitor controlling all devices at home and creating a more comfortable living
environment for seniors137. Finally, during the recent COVID-19 pandemic, the Dubai airport installed smart
gates that use the traveler’s face and iris biometrics to reduce passport control procedures and increase security.
Airport ocers were not required anymore to scan, examine, and check the passports of every traveler, which
reduced the human–human interaction during the pandemic and promoted eortless travel138.
Examples of novel applications, proof‑of‑concepts, and test cases of HBI. As the examples above
demonstrate, HBI-centered applications have achieved a maturity level that supports the implementation of
automation and service delivery through increasingly available commercial products. State-of-the-art research
is being conducted to push the envelope and contribute to more advanced use cases. Examples of research across
selected areas of the HBI framework follow.
Research example in human experiences, performance, and well-being. With the outbreak of the SARS-CoV-2
virus, stress levels have increased across the globe, to the extent that building professionals consider stress among
the most important mental well-being issues that need to be the focus of design, construction, and operation of
buildings139. While there are many reasons for stress, one of the top stressors is work pressure. Research suggests
that when workers have low control over their job demands (e.g., unfamiliarity with task, limited resources,
degraded workspace conditions, etc.) they develop negative stress named distress, which have detrimental
Content courtesy of Springer Nature, terms of use apply. Rights reserved
11
Vol.:(0123456789)
Scientic Reports | (2022) 12:22092 | https://doi.org/10.1038/s41598-022-25047-y
www.nature.com/scientificreports/
psychological and physical health consequences and leads to degraded productivity. On the other hand, when
workers feel condent about handling their work stressors, they develop a feeling of eustress known as the posi-
tive stress, responsible for motivating people to pursue their goals and to face challenges. us, dierentiating
between eustress and distress is a necessity for work organizations to promote eustress and limit distress among
their workers. HBI plays a key role in this innovative research; for example, integrating the appropriate sensors
(e.g., wearable sensors, cameras, etc.) into an oce workstation sets the foundation for automated systems that
rely on physiological and behavioral data to identify whether a worker is witnessing eustress or distress. is
helps work mangers shape a strategic plan to assign workers with the appropriate tasks thus sustaining eustress
and proactively eliminating distress. In a recent research eort, physiological, behavioral, and human–computer
interaction data from 50 oce workers have been collected and used to dierentiate distress from eustress using
machine learning methods (Fig.2). Furthermore, nature contact has been shown to reduce distress among oce
workers, therefore the HBI research about stress must investigate the appropriate approaches to deliver nature
related interventions to restore distressed oce workers to a relaxed state. Finally, unpleasant indoor environ-
mental quality and oce interior design have been found to increase workers’ physiological stress, therefore
HBI researchers should study the means to create personalized responsive oce conditions that can change its
ambiance driven by the physiological state of workers.
Research example in building design and operations. Building design can impact the behaviors of building
occupants. For example, security countermeasures in a building have inuenced participants’ response time
and decisions in an active shooter incident where participants responded to the emergency in virtual oces
and schools70 (Fig.3). e study also revealed the importance of building and social context such that teachers
concerned more for others’ safety than oce workers70. ese explorations reveal the necessity of customizing
building design and operations to provide resilient solutions to extreme events for dierent users, which can be
accomplished using virtual reality. Given its sucient ecological validity and exibility, virtual reality can also
be an ideal platform to train building occupants on emergency safety, where trainees immerse into the scenarios
Figure2. (a) Openface application for real-time facial features extraction, (b) Human–computer interaction
monitoring application, (c) real-time physiological data monitoring.
Figure3. Empirical assessment of the impact of security countermeasures on human behavior during active
shooter incidents. e images are from the participants’ perspective in a virtual reality-based experiment.
Frosted glasses and access control are implemented in the right image. Non-player characters are included to
represent social inuence during building emergencies.
Content courtesy of Springer Nature, terms of use apply. Rights reserved
12
Vol:.(1234567890)
Scientic Reports | (2022) 12:22092 | https://doi.org/10.1038/s41598-022-25047-y
www.nature.com/scientificreports/
and interact with the environment that can be customized per needs (e.g., oce, school, hospitals). Similarly, the
training outcomes will then be tested in a virtual emergency scenario where peoples performance in the envi-
ronment is evaluated by customizable systematic metrics developed based on training contents (e.g., evacuation
time and execution of safety actions).
Research example in sensing, inference, and awareness. Doppler radar physiological sensing using dedicated
radar systems and wireless infrastructure-based systems has been shown to be eective in sensing physiological
parameters from several meters to several tens of meters with a high degree of accuracy in controlled settings32.
Physiological parameters include heart and respiratory rates, respiratory tidal volume, heart rate variability
(HRV), pulse pressure, diagnostic patterns, activity level, and body orientation. ese parameters can be used to
assess user response to environmental conditions. One example is True Presence Occupancy Detection Sensor
(TruePODS™), which was developed by a start-up company Adnoviv, Inc. in collaboration with the University
of Hawaii. TruePODS™ is a Doppler radar-based occupancy sensor that detects breathing to accurately indicate
whether a space is occupied, even when the occupant is sedentary. TruePODS™ modules have been tested at
Rensselaer Polytechnic Institute LESA (Light Enabled Systems & Applications) Center, focused on using light
eciently in built environments, and healthcare, among others. e LESA smart conference room (Fig.4) senses
occupancy, pose (sitting, falling, standing), and has a mesh network of color sensors for coarse occupancy sens-
ing and measuring reected sunlight and solar heat ux for improved HVAC control. e TruePODS™ module
has been validated for occupancy/vacancy detection and occupant count and can successfully measure respira-
tory and heart rate when used in certain positions and orientations (Fig.4). is is the rst demonstration of an
occupancy/vacancy sensor that also provides occupant count and physiological parameters. e sensor output
may enable more energy-ecient building control while ensuring that occupant comfort is not compromised.
Research example in trust and collaboration. Centralized environmental controls in built environments are fre-
quently unable to meet the needs of most occupants140. Alternatively, automated control of local environmental
factors (e.g., thermal, lighting) and equipment positioning (e.g., a motorized sit/stand desk141) shows promise in
supporting worker health and well-being. In one study, multiple examples of trust and collaboration are emerg-
ing in the development of an intelligent oce workstation to address these concerns19. Facilitated by learning
from interactions between an intelligent workstation (Fig.5) and the occupant, an intelligent oce workstation
would understand and adapt to the worker’s changing needs in terms of thermal, lighting, and posture comfort,
share control with the user to build trust, and will coevolve with its user to promote healthier workplace behavior
(A short video describing this research can be found at: https:// youtu. be/ psfzI DTgK5g). at is, the smart desk
and user collaborate to nd and use the best settings for important outcomes in addition to comfort, including
health and productivity. A real-world evaluation showed that sharing the control between the smart desk and the
user to control the thermal environment led to higher satisfaction than in manually controlled environments20,
opening an avenue for collaborative control and trust between a building and its occupants. In addition to col-
laboration in making changes, a user-centered approach using focus groups has highlighted numerous trust
considerations linked to the privacy and security of the data collected by the workstation142.
Research example in modeling and simulation. Pre-occupancy analyses are a valuable tool for architects and
other stakeholders to forecast how a proposed design will aect the behavior of a building’s future inhabitants.
eir goal is to augment the knowledge and intuition of architects to reduce the gap between the expected
and actual performance of a built environment. Among them, multi-agent simulation approaches represent the
dynamic interactions between occupants and a physical environment. A recent study used a narrative-based
Figure4. e 3.4m × 8.5m LESA Smart Conference Room with the TruePODS™ sensor mounted on the
ceiling (le), and locations of successful physiological detection (right). Heart rates were detected at all the seats
around the table, and in 3 of the 4 corners. In all locations, respiratory rate was detected.
Content courtesy of Springer Nature, terms of use apply. Rights reserved
13
Vol.:(0123456789)
Scientic Reports | (2022) 12:22092 | https://doi.org/10.1038/s41598-022-25047-y
www.nature.com/scientificreports/
approach to predict and evaluate the impact of two alternative design congurations for an internal medicine
ward on the day-to-day behavior of the occupants (e.g., doctors, nurses, patients, visitors)143. A combination of
eld observations and expert interviews informed the modeling of a digital ‘place,’ composed of spaces, actors,
activities, and narrative models where synthetic people (modeled as agents) inhabit a virtual space and perform
a set of individual or collaborative activities consistent with the function of the organization that occupies the
built environment. e space model includes physical and non-physical attributes, which determine the range
of behaviors that can be hosted at a given time contingent upon physical (e.g., geometry) and social (e.g., pres-
ence and activities of other occupants in the same space) contingencies. Actor models include specic occu-
pant roles and dynamic attributes (e.g., walked distances, time spent in specic activities). e activity model
determines interactions between spaces and occupants (e.g., moving, queuing, interacting), while the narrative
model assigns actors to one or more spaces to achieve a goal-oriented task. is simulation approach distributes
intelligence not only in agents but also in spaces, activity, and narrative models to ease the process of modeling
complex and collaborative behaviors. e simulation results shown in Fig.6 reveal the implications of two alter-
native designs for an outpatient clinic on peoples travel paths, occupancy density, and frequency of sta-visitor
interactions. Specically, the presence of a dayroom reduces visitors’ density in corridors, which could cause
spatial bottlenecks, and it diminishes the number of unplanned sta–visitor interactions that can delay the per-
formance of routine medical procedures.
Research example in equity and inclusion. A new class of occupancy estimation sensing based on active infra-
red stereo technologies obtains a depth image from a sensor located in a doorway and uses this image to detect
entrance and exit events11. ough much more accurate than traditional passive-infrared (PIR) sensors at
detecting and estimating occupancy, the conguration of the sensing solution is such that the entrance and exit
events of certain occupants are misrepresented in the output. In particular, the depth-imaging system relies on
Figure5. Intelligent workstation with embedded sensors to learn and adapt indoor environment based on user
preferences.
Figure6. Comparative evaluation of the impact of two design strategies on the inhabitants’ behavior. e
design dierence relates to the presence (Design A) or absence (Design B) of a dayroom (marked with a white
dotted line on the oorplan) where patients and visitors can gather to engage in social interactions. Results
indicate that the presence of a dayroom reduces people density in corridors and leads to fewer interruptions for
the medical sta involved in patient care activities. Figure adapted from143.
Content courtesy of Springer Nature, terms of use apply. Rights reserved
14
Vol:.(1234567890)
Scientic Reports | (2022) 12:22092 | https://doi.org/10.1038/s41598-022-25047-y
www.nature.com/scientificreports/
infrared light, which is absorbed dierently by dierent hair types. Since the soware processing the images is
tracking heads as they move through the doorway, some hair types create a pattern that confuses the algorithm
that oversees detecting and tracking heads leading to a misestimation of the occupancy in the room. Figure7
shows a sample depth map obtained from the sensor with two subjects with dierent hair types. is example
shows the importance of developing and selecting sensors that do not result in biased results. Similarly, algo-
rithm bias is a well-acknowledged issue due to erroneous assumptions in machine learning process and training
on biased data sets.
A path forward
As an emerging eld that incorporates the dynamic interplay of human experience and building intelligence,
the primary aim of this paper was to specify the denition, vision, and research dimensions of HBI. Toward that
goal, this paper unpacked three primary areas that contribute to and require attention in HBI research: humans
(human experiences, performance, and well-being), buildings (building design and operations), and technology
(sensing, inference, and awareness). We have presented the critical interdisciplinary research domains at the
intersections of these three primary areas: trust and collaboration, decision-making and control, and modeling
and simulation. Finally, we have described core principles for all HBI research to consider and address, including
equity, privacy, and sustainability. Across the framework, we provide questions meant to stimulate collaborative
and widespread HBI research eorts. Similarly, we have presented examples of existing HBI applications and
emerging original research to inspire individuals interested in advancing HBI research and application. Taken
together, this information is meant to support HBI researchers, designers, and practitioners in considering the
wide range of symbiotic and interactive possibilities for humans and the built environment. Ultimately, promot-
ing thoughtful interdisciplinary approaches to HBI research will encourage the development of systems sensitive
to the needs of occupants while maximizing the operational goals of built environments, resulting in inclusive,
safe, and exciting places for people to live, work, and play.
Data availability
e data that support the ndings of this study are available from the authors, but restrictions apply to the
availability of these data, which were used under license for the current study, and so are not publicly available.
Data are however available from the corresponding author upon reasonable request and with permission of the
respective universities (USC, CMU, University of Technion, University of Hawaii).
Received: 29 August 2022; Accepted: 23 November 2022
References
1. Nembrini, J. & Lalanne, D. Human-building interaction: When the machine becomes a building. Hum. Comput. Interact. 2017,
348–369. https:// doi. org/ 10. 1007/ 978-3- 319- 67684-5_ 21 (2017).
2. Alavi, H. S. et al. Introduction to human-building interaction (HBI): Interfacing HCI with architecture and urban design. AMS
Trans. Comput. Hum. Interact. 26(2), 61–610. https:// doi. org/ 10. 1145/ 33097 14 (2019).
3. Alavi, H. S. et al. (eds) e Evolution of Human-Building Interaction: An HCI Perspective PREFACE (Interaction Design And
Architectures, 2017).
4. Johansen, S. S., Kjeldskov, J. & Skov, M. B. Temporal constraints in human–building interaction. AMS Trans. Comput. Hum.
Interact. 26(2), 81–829. https:// doi. org/ 10. 1145/ 33014 24 (2019).
5. Alavi, H. S. et al. Future of human–building interaction. in Proceedings of the 2016 CHI Conference Extended Abstracts on Human
Factors in Computing Systems, 3408–3414. (2016). https:// doi. org/ 10. 1145/ 28515 81. 28565 02.
Figure7. Color (top) and depth (bottom) image of two human subjects with dierent hair types as measured
by an active infrared stereo camera. e depth map is color-coded such that darker (more black) is farther away
from the camera while lighter (more red) is closer.
Content courtesy of Springer Nature, terms of use apply. Rights reserved
15
Vol.:(0123456789)
Scientic Reports | (2022) 12:22092 | https://doi.org/10.1038/s41598-022-25047-y
www.nature.com/scientificreports/
6. Alavi, H. S., Churchill, E., Kirk, D., Nembrini, J. & Lalanne, D. Deconstructing human–building interaction. Interactions 23(6),
60–62. https:// doi. org/ 10. 1145/ 29918 97 (2016).
7. Human-building interaction: Sketches and grounds for a research program. ACM Interactions. https:// inter actio ns. acm. org/
archi ve/ view/ july- august- 2019/ human- build ing- inter action. Accessed 7 Mar 2022.
8. KIStorm. Knowinnovation Inc. https:// kisto rm. com/.
9. Huisman, E. R. C. M., Morales, E., van Hoof, J. & Kort, H. S. M. Healing environment: A review of the impact of physical envi-
ronmental factors on users. Build. Environ. 58, 70–80. https:// doi. org/ 10. 1016/j. build env. 2012. 06. 016 (2012).
10. Day, J. K. et al. A review of select human-building interfaces and their relationship to human behavior, energy use and occupant
comfort. Build. Environ. 178, 106920. https:// doi. org/ 10. 1016/j. build env. 2020. 106920 (2020).
11. Munir, S. et al. Real-time ne grained occupancy estimation using depth sensors on arm embedded platforms. IEEE Real-Time
Embed. Technol. Appl. Symp. 2017, 295–306. https:// doi. org/ 10. 1109/ RTAS. 2017.8 (2017).
12. Heydarian, A. et al. What drives our behaviors in buildings? A review on occupant interactions with building systems from the
lens of behavioral theories. Build. Environ. 179, 106928. https:// doi. org/ 10. 1016/j. build env. 2020. 106928 (2020).
13. K lein, L. et al. Coordinating occupant behavior for building energy and comfort management using multi-agent systems. Autom.
Constr. 22, 525–536. https:// doi. org/ 10. 1016/j. autcon. 2011. 11. 012 (2012).
14. Kalay, Y., Schaumann, D., Pai, R., Wang, A. & Chen, G. Dynamic Building Activities Management in Healthcare Facilities: A
Simulation Study in a Catheterization Lab (Springer, 2021).
15. Jazizadeh, F. & Becerik-Gerber, B. Toward adaptive comfort management in oce buildings using participatory sensing for end
user driven control. in: Proceedings of the Fourth ACM Workshop on Embedded Sensing Systems for Energy-Eciency in Buildings,
1–8 (2012). https:// doi. org/ 10. 1145/ 24225 31. 24225 33.
16. Frei, M., Deb, C., Stadler, R., Nagy, Z. & Schlueter, A. Wireless sensor network for estimating building performance. Autom.
Constr. 111, 103043. https:// doi. org/ 10. 1016/j. autcon. 2019. 103043 (2020).
17. Haque, A., Milstein, A. & Fei-Fei, L. Illuminating the dark spaces of healthcare with ambient intelligence. Nature 585, 7824.
https:// doi. org/ 10. 1038/ s41586- 020- 2669-y (2020).
18. Dasler, P., Malik, S. & Mauriello, M. L. ‘Just Follow the Lights’: A ubiquitous framework for low-cost, mixed delity navigation
in indoor built environments. Int. J. Hum. Comput. Stud. 155, 102692. https:// doi. org/ 10. 1016/j. ijhcs. 2021. 102692 (2021).
19. Aryal, A., Becerik-Gerber, B., Anselmo, F., Roll, S. C. & Lucas, G. M. Smart desks to promote comfort, health, and productivity
in oces: A vision for future workplaces. Front. Built Environ. https:// doi. org/ 10. 3389/ uil. 2019. 00076 (2019).
20. Ar yal, A., Becerik-Gerber, B., Lucas, G. M. & Roll, S. C. Intelligent agents to improve thermal satisfaction by controlling personal
comfort systems under dierent levels of automation. IEEE Internet ings J. 8(8), 7089–7100. https:// doi. org/ 10. 1109/ JIOT.
2020. 30383 78 (2021).
21. Sadeghi, S. A., Karava, P., Konstantzos, I. & Tzempelikos, A. Occupant interactions with shading and lighting systems using dif-
ferent control interfaces: A pilot eld study. Build. Environ. 97, 177–195. https:// doi. org/ 10. 1016/j. build env. 2015. 12. 008 (2016).
22. Park, J. Y., Dougherty, T., Fritz, H. & Nagy, Z. LightLearn: An adaptive and occupant centered controller for lighting based on
reinforcement learning. Build. Environ. 147, 397–414. https:// doi. org/ 10. 1016/j. build env. 2018. 10. 028 (2019).
23. Jazizadeh, F., Ghahramani, A., Becerik-Gerber, B., Kichkaylo, T. & Orosz, M. Human-building interaction framework for per-
sonalized thermal comfort-driven systems in oce buildings. J. Comput. Civ. Eng. 28(1), 2–16. h ttps:// doi. org/ 10. 1061/ (ASCE)
CP. 1943- 5487. 00003 00 (2014).
24. Ghahramani, A., Tang, C. & Becerik-Gerber, B. An online learning approach for quantifying personalized thermal comfort via
adaptive stochastic modeling. Build. Environ. 92, 86–96. https:// doi. org/ 10. 1016/j. build env. 2015. 04. 017 (2015).
25. Ghahramani, A., Castro, G., Karvigh, S. A. & Becerik-Gerber, B. Towards unsupervised learning of thermal comfort using
infrared thermography. Appl. Energy 211, 41–49. https:// doi. org/ 10. 1016/j. apene rgy. 2017. 11. 021 (2018).
26. Lan, L., Tang, J., Wargocki, P., Wyon, D. P. & Lian, Z. Cognitive performance was reduced by higher air temperature even when
thermal comfort was maintained over the 24–28°C range. Indoor Air 32(1), e12916. https:// doi. org/ 10. 1111/ ina. 12916 (2022).
27. Ko, W. H. et al. e impact of a view from a window on thermal comfort, emotion, and cognitive performance. Build. Environ.
175, 106779. https:// doi. org/ 10. 1016/j. build env. 2020. 106779 (2020).
28. Yeganeh, A. J., Reichard, G., McCoy, A. P., Bulbul, T. & Jazizadeh, F. Correlation of ambient air temperature and cognitive per-
formance: A systematic review and meta-analysis. Build. Environ. 143, 701–716. https:// doi. org/ 10. 1016/j. build env. 2018. 07. 002
(2018).
29. Jazizadeh, F., Kavulya, G., Klein, L. & Becerik-Gerber, B. Continuous sensing of occupant perception of indoor ambient factors.
Build. Environ. https:// doi. org/ 10. 1061/ 41182 (416) 20 (2012).
30. Jazizadeh, F. & Jung, W. Personalized thermal comfort inference using RGB video images for distributed HVAC control. Appl.
Energy 220, 829–841. https:// doi. org/ 10. 1016/j. apene rgy. 2018. 02. 049 (2018).
31. Jung, W. & Jazizadeh, F. Human-in-the-loop HVAC operations: A quantitative review on occupancy, comfort, and energy-
eciency dimensions. Appl. Energy 239, 1471–1508. https:// doi. org/ 10. 1016/j. apene rgy. 2019. 01. 070 (2019).
32. Jung, W. & Jazizadeh, F. Towards integration of doppler radar sensors into personalized thermoregulation-based control of
HVAC, 1–4 (2017). https:// doi. org/ 10. 1145/ 31371 33. 31371 66.
33. Hui, F. K. P. & Aye, L. Occupational stress and workplace design. Buildings 8(10), 10. https:// doi. org/ 10. 3390/ build ings8 100133
(2018).
34. Stazi, F., Naspi, F. & D’Orazio, M. A literature review on driving factors and contextual events inuencing occupants’ behaviours
in buildings. Build. Environ. 118, 40–66. https:// doi. org/ 10. 1016/j. build env. 2017. 03. 021 (2017).
35. Ahmadi-Karvigh, S., Ghahramani, A., Becerik-Gerber, B. & Soibelman, L. One size does not t all: Understanding user prefer-
ences for building automation systems. Energy and Building s 145, 163–173. https:// doi. org/ 10. 1016/j. enbui ld. 2017. 04. 015 (2017).
36. Schirner, G., Erdogmus, D., Chowdhury, K. & Padir, T. e future of human-in-the-loop cyber-physical systems. Computer
46(1), 36–45. https:// doi. org/ 10. 1109/ MC. 2013. 31 (2013).
37. Balta-Ozkan, N., Davidson, R., Bicket, M. & Whitmarsh, L. Social barriers to the adoption of smart homes. Energy Policy 63,
363–374. https:// doi. org/ 10. 1016/j. enpol. 2013. 08. 043 (2013).
38. Nunes, D. S., Zhang, P. & SáSilva, J. A survey on human-in-the-loop applications towards an internet of all. IEEE Commun. Surv.
Tutor. 17(2), 944–965. https:// doi. org/ 10. 1109/ COMST. 2015. 23988 16 (2015).
39. Hutchins, E. Cognition in the Wild (A Bradford Book, 1995).
40. Hutchins, E. e social organization of distributed cognition. in Perspectives on socially shared cognition, 283–307 (American
Psychological Association, 1991). https:// doi. org/ 10. 1037/ 10096- 012.
41. Hutchins, E. & Klausen, T. Distributed cognition in an airline cockpit. In Cognition and Communication at Work 1st edn (eds
Engeström, Y. & Middleton, D.) 15–34 (Cambridge University Press, 1996). https:// doi. org/ 10. 1017/ CBO97 81139 174077. 002.
42. Dunlop, T. Mind the gap: A social sciences review of energy eciency. Energy Res. Soc. Sci. 56, 101216. https:// doi. org/ 10. 1016/j .
erss. 2019. 05. 026 (2019).
43. Shove, E. & Walker, G. What is energy for? Social practice and energy demand. eory Cult. Soc. 31(5), 41–58. https:// doi. org/
10. 1177/ 02632 76414 536746 (2014).
44. Labanca, N. & Bertoldi, P. Beyond energy eciency and individual behaviours: policy insights from social practice theories.
Energy Policy 115, 494–502. https:// doi. org/ 10. 1016/j. enpol. 2018. 01. 027 (2018).
Content courtesy of Springer Nature, terms of use apply. Rights reserved
16
Vol:.(1234567890)
Scientic Reports | (2022) 12:22092 | https://doi.org/10.1038/s41598-022-25047-y
www.nature.com/scientificreports/
45. Nash, N. et al. Climate-relevant behavioral spillover and the potential contribution of social practice theory. WIREs Clim. Change
8(6), e481. https:// doi. org/ 10. 1002/ wcc. 481 (2017).
46. Heydarian, A., Pantazis, E., Carneiro, J. P., Gerber, D. & Becerik-Gerber, B. Lights, building, action: Impact of default lighting
settings on occupant behaviour. J. Environ. Psychol. 48, 212–223 (2016).
47. Jazizadeh, F. et al. Human-building interaction for energy conservation in oce buildings. J. Environ. Psychol. 1, 1830–1839.
https:// doi. org/ 10. 1061/ 97807 84412 329. 184 (2012).
48. He, T., Jazizadeh, F. & Arpan, L. AI-powered virtual assistants nudging occupants for energy saving: proactive smart speakers
for HVAC control. Build. Res. Inf. 50(4), 394–409. https:// doi. org/ 10. 1080/ 09613 218. 2021. 20121 19 (2022).
49. McIlvennie, C., Sanguinetti, A. & Pritoni, M. Of impacts, agents, and functions: An interdisciplinary meta-review of smart home
energy management systems research. Energy Res. Soc. Sci. 68, 101555. https:// doi. org/ 10. 1016/j. erss. 2020. 101555 (2020).
50. Sanguinetti, A., Dombrovski, K. & Sikand, S. Information, timing, and display: A design-behavior framework for improving
the eectiveness of eco-feedback. Energy Res. Soc. Sci. 39, 55–68. https:// doi. org/ 10. 1016/j. erss. 2017. 10. 001 (2018).
51. Peer, T., Pritoni, M., Meier, A., Aragon, C. & Perry, D. How people use thermostats in homes: A review. Build. Environ. 46(12),
2529–2541. https:// doi. org/ 10. 1016/j. build env. 2011. 06. 002 (2011).
52. Hargreaves, T., Wilson, C. & Hauxwell-Baldwin, R. Learning to live in a smart home. Build. Res. Inf. 46(1), 127–139. https:// doi.
org/ 10. 1080/ 09613 218. 2017. 12868 82 (2018).
53. Kalay, Y. E. e impact of information technology on design methods, products and practices. Des. Stud. 27(3), 357–380. https://
doi. org/ 10. 1016/j. destud. 2005. 11. 001 (2006).
54. Schønheyder, J. F. & Nordby, K. e use and evolution of design methods in professional design practice. Des. Stud. 58, 36–62.
https:// doi. org/ 10. 1016/j. destud. 2018. 04. 001 (2018).
55. Liu, W. et al. A proposed radicality evaluation method for design ideas at conceptual design stage. Comput. Ind. Eng. 132,
141–152. https:// doi. org/ 10. 1016/j. cie. 2019. 04. 027 (2019).
56. Alves, O., Monteiro, E., Brito, P. & Romano, P. Measurement and classication of energy eciency in HVAC systems. Energy
Build. 130, 408–419. https:// doi. org/ 10. 1016/j. enbui ld. 2016. 08. 070 (2016).
57. Teke, A. & Timur, O. Assessing the energy eciency improvement potentials of HVAC systems considering economic and envi-
ronmental aspects at the hospitals. Renew. Sustain. Energy Rev. 33, 224–235. https:// doi. org/ 10. 1016/j. rser. 2014. 02. 002 (2014).
58. Kralikova, R., Andrejiova, M. & Wessely, E. Energy saving techniques and strategies for illumination in industry. Procedia Eng.
100, 187–195. https:// doi. org/ 10. 1016/j. proeng. 2015. 01. 357 (2015).
59. Lv, Y., Xia, L., Yan, J. & Bi, J. Design of a hybrid ber optic daylighting and PV solar lighting system. Energy Procedia 145,
586–591. https:// doi. org/ 10. 1016/j. egypro. 2018. 04. 087 (2018).
60. Ryms, M. & Klugmann-Radziemska, E. Possibilities and benets of a new method of modifying conventional building materials
with phase-change materials (PCMs). Constr. Build. Mater. 211, 1013–1024. https:// doi. org/ 10. 1016/j. conbu ildmat. 2019. 03. 277
(2019).
61. Zinzi, M. et al. Optical and visual experimental characterization of a glazing system with monolithic silica aerogel. Sol. Energy
183, 30–39. https:// doi. org/ 10. 1016/j. solen er. 2019. 03. 013 (2019).
62. Goh, M. & Goh, Y. M. Lean production theory-based simulation of modular construction processes. Autom. Constr. 101,
227–244. https:// doi. org/ 10. 1016/j. autcon. 2018. 12. 017 (2019).
63. Abanda, F. H., Tah, J. H. M. & Cheung, F. K. T. BIM in o-site manufacturing for buildings. J. Build. Eng. 14, 89–102. https://
doi. org/ 10. 1016/j. jobe. 2017. 10. 002 (2017).
64. Jia, R., Jin, M., Sun, K., Hong, T. & Spanos, C. Advanced building control via deep reinforcement learning. Energy Procedia 158,
6158–6163. https:// doi. org/ 10. 1016/j. egypro. 2019. 01. 494 (2019).
65. Jung, W. & Jazizadeh, F. Comparative assessment of comfort-driven HVAC operational strategies using personalized thermal
comfort proling and sensitivity. Build. Environ. 158, 104–119. https:// doi. org/ 10. 1016/j. build env. 2019. 04. 043 (2019).
66. Gath-Morad, M. et al. Visibility matters during waynding in the vertical. Sci. Rep. 11(1), 1. https:// doi. org/ 10. 1038/ s41598-
021- 98439-1 (2021).
67. Gillis, K. & Gatersleben, B. A review of psychological literature on the health and wellbeing benets of biophilic design. Buildings
5(3), 3. https:// doi. org/ 10. 3390/ build ings5 030948 (2015).
68. Afzalan, M. & Jazizadeh, F. Quantication of demand-supply balancing capacity among prosumers and consumers: community
self-suciency assessment for energy trading. Energies 14(14), 14. https:// doi. org/ 10. 3390/ en141 44318 (2021).
69. Chou, J.-S., Cheng, M.-Y., Hsieh, Y.-M., Yang, I.-T. & Hsu, H.-T. Optimal path planning in real time for dynamic building re
rescue operations using wireless sensors and visual guidance. Autom. Constr. 99, 1–17. https:// doi. org/ 10. 1016/j. autcon. 2018.
11. 020 (2019).
70. Zhu, R., Lucas, G. M., Becerik-Gerber, B., Southers, E. G. & Landicho, E. e impact of security countermeasures on human
behavior during active shooter incidents. Sci. Rep. 12(1), 1. https:// doi. org/ 10. 1038/ s41598- 022- 04922-8 (2022).
71. Paige, F., Agee, P. & Jazizadeh, F. EECe, an energy use and occupant behavior dataset for net-zero energy aordable senior
residential buildings. Sci Data 6(1), 1. https:// doi. org/ 10. 1038/ s41597- 019- 0275-3 (2019).
72. Jazizadeh, F., Afzalan, M., Becerik-Gerber, B. & Soibelman, L. EMBED: A dataset for energy monitoring through building elec-
tricity disaggregation. in Proceedings of the Ninth International Conference on Future Energy Systems, 230–235 (2018). https://
doi. org/ 10. 1145/ 32089 03. 32089 39.
73. Anderson, K. et al . BLUED: A fully labeled public dataset for event-based non-intrusive load monitoring research. in Proceedings
of the 2nd KDD Workshop on Data Mining Applications in Sustainability (SustKDD), 1–5 (2012).
74. Dong, B., Prakash, V., Feng, F. & O’Neill, Z. A review of smart building sensing system for better indoor environment control.
Energy Build. 199, 29–46 (2019).
75. Jung, W., Jazizadeh, F. & Diller, T. E. Heat ux sensing for machine-learning-based personal thermal comfort modeling. Sensors
19(17), 17. https:// doi. org/ 10. 3390/ s1917 3691 (2019).
76. Jung, W. & Jazizadeh, F. Non-Intrusive Detection of Respiration for Smart Control of HVAC System, 310–317 (2017). https:// doi.
org/ 10. 1061/ 97807 84480 847. 039.
77. Jung, W. & Jazizadeh, F. Vision-based thermal comfort quantication for HVAC control. Build. Environ. 142, 513–523. https://
doi. org/ 10. 1016/j. build env. 2018. 05. 018 (2018).
78. Dabiri, S. & Jazizadeh, F. Exploring video based thermal perception identication. in Proceedings of the 16th International
Conference on Computing in Civil and Building Engineering, 6–8.
79. Choi, J.-H. Investigation of human eye pupil sizes as a measure of visual sensation in the workplace environment with a high
lighting colour temperature. Indoor Built Environ. https:// doi. org/ 10. 1177/ 14203 26X15 626585 (2016).
80. Ahmadi-Karvigh, S., Ghahramani, A., Becerik-Gerber, B. & Soibelman, L. Real-time activity recognition for energy eciency
in buildings. Appl. Energy 211, 146–160. https:// doi. org/ 10. 1016/j. apene rgy. 2017. 11. 055 (2018).
81. Abedi, M. & Jazizadeh, F. Deep-learning for occupancy detection using doppler radar and infrared thermal array sensors. in
ISARC Proceedings, 1098–1105 (2019).
82. Afzalan, M., Jazizadeh, F. & Wang, J. Self-conguring event detection in electricity monitoring for human-building interaction.
Energy Build. 187, 95–109. https:// doi. org/ 10. 1016/j. enbui ld. 2019. 01. 036 (2019).
83. Jazizadeh, F., Ahmadi-Karvigh, S., Becerik-Gerber, B. & Soibelman, L. Spatiotemporal lighting load disaggregation using light
intensity signal. Energy Build. 69, 572–583. https:// doi. org/ 10. 1016/j. enbui ld. 2013. 11. 040 (2014).
Content courtesy of Springer Nature, terms of use apply. Rights reserved
17
Vol.:(0123456789)
Scientic Reports | (2022) 12:22092 | https://doi.org/10.1038/s41598-022-25047-y
www.nature.com/scientificreports/
84. Afzalan, M. & Jazizadeh, F. Residential loads exibility potential for demand response using energy consumption patterns and
user segments. Appl. Energy 254, 113693. https:// doi. org/ 10. 1016/j. apene rgy. 2019. 113693 (2019).
85. Afzalan, M. & Jazizadeh, F. A machine learning framework to infer time-of-use of exible loads: Resident behavior learning for
demand response. IEEE Access 8, 111718–111730. https:// doi. org/ 10. 1109/ ACCESS. 2020. 30021 55 (2020).
86. Afzalan, M. & Jazizadeh, F. Semantic search in household energy consumption segmentation through descriptive characteriza-
tion. IEEE Access 1, 263–266. https:// doi. org/ 10. 1145/ 33603 22. 33608 65 (2019).
87. Martin, D., Kühl, N. & Satzger, G. Virtual sensors. Bus. Inf. Syst. Eng. 63(3), 315–323. https:// doi. or g/ 10. 1007/ s12599- 021- 00 689-
w (2021).
88. Farzaneh, H. et al. Articial intelligence evolution in smart buildings for energy eciency. Appl. Sci. 11(2), 763. https:// doi. org/
10. 3390/ app11 020763 (2021).
89. Ayoko, O. B. & Ashkanasy, N. M. e physical environment of oce work: Future open plan oces. Aust. J. Manag. 45(3),
488–506. https:// doi. org/ 10. 1177/ 03128 96220 921913 (2020).
90. Molana, H. H. & Adams, R. E. Evaluating sense of community in the residential environment from the perspectives of symbolic
interactionism and architectural design. J. Community Psychol. 47(7), 1591–1602. https:// doi. org/ 10. 1002/ jcop. 22214 (2019).
91. Alsarraj, H. A. T. Open-plan Oce and Its Impact on Interpersonal Relationships (Auckland University of Technology, 2019).
92. Morrison, R. L. & Macky, K. A. e demands and resources arising from shared oce spaces. Appl. Ergon. 60, 103–115. https://
doi. org/ 10. 1016/j. apergo. 2016. 11. 007 (2017).
93. Zhang, J. W., Pi, P. K., Iyer, R., Koleva, S. & Keltner, D. An occasion for unselng: Beautiful nature leads to prosociality. J.
Environ. Psychol. 37, 61–72. https:// doi. org/ 10. 1016/j. jenvp. 2013. 11. 008 (2014).
94. Jung, W. & Jazizadeh, F. Energy saving potentials of integrating personal thermal comfort models for control of building systems:
Comprehensive quantication through combinatorial consideration of inuential parameters. Appl. Energy 268, 114882. https://
doi. org/ 10. 1016/j. apene rgy. 2020. 114882 (2020).
95. Naylor, S., Gillott, M. & Lau, T. A review of occupant-centric building control strategies to reduce building energy use. Renew.
Sustain. Energy Rev. 96, 1–10. https:// doi. org/ 10. 1016/j. rser. 2018. 07. 019 (2018).
96. Kalay, Y. E. Architecture’s New Media: Principles, eories, and Methods of Computer-aided Design (MIT Press, 2004).
97. Eastman, C., Teicholz, P., Sacks, R., Liston, K. & Handbook, B. I. M. A Guide to Building Information Modeling for Owners,
Managers, Designers, Engineers and Contractors 2nd edn. (Wiley, 2011).
98. Schaumann, D., Kalay, Y. E., Hong, S. W. & Simeone, D. Simulating human behavior in not-yet built environments by means of
event-based narratives. in Proceedings of the Symposium on Simulation for Architecture & Urban Design, 5–12 (2015).
99. Wooldridge, M. An Introduction to MultiAgent Systems (Wiley, 2009).
100. Schaumann, D., PutievskyPilosof, N., Sopher, H., Yahav, J. & Kalay, Y. E. Simulating multi-agent narratives for pre-occupancy
evaluation of architectural designs. Autom. Constr. 106, 102896. https:// doi. org/ 10. 1016/j. autcon. 2019. 102896 (2019).
101. Gath-Morad, M., Aguilar Melgar, L. E., Conroy-Dalton, R. & Hölscher, C. Beyond the shortest-path: Towards cognitive occu-
pancy modeling in BIM. Autom. Constr. 135, 104131. https:// doi. org/ 10. 1016/j. autcon. 2022. 104131 (2022).
102. Shen, W., Zhang, X., Qiping Shen, G. & Fernando, T. e User Pre-Occupancy Evaluation Method in designer–client commu-
nication in early design stage: A case study. Autom. Constr. 32, 112–124. https:// doi. org/ 10. 1016/j. autcon. 2013. 01. 014 (2013).
103. Schaumann, D. et al. JOIN: an integrated platform for joint simulation of occupant-building interactions. Archit. Sci. Rev. 63(3–4),
339–350. https:// doi. org/ 10. 1080/ 00038 628. 2019. 16627 67 (2020).
104. Chu, M. L. & Law, K. Computational framework incorporating human behaviors for egress simulations. J. Comput. Civ. Eng.
27(6), 699–707. https:// doi. org/ 10. 1061/ (ASCE) CP. 1943- 5487. 00003 13 (2013).
105. Nagy, D. et al. Project discover: an application of generative design for architectural space planning. in Proceedings of the Sym-
posium on Simulation for Architecture and Urban Design, 1–8 (2017).
106. Miller, C. et al. e Internet-of-Buildings (IoB): Digital twin convergence of wearable and IoT data with GIS/BIM. J. Phys. Conf.
Ser. 2042(1), 012041. https:// doi. org/ 10. 1088/ 1742- 6596/ 2042/1/ 012041 (2021).
107. Bates, O. et al. Towards a responsible innovation agenda for HCI. in Extended Abstracts of the 2019 CHI Conference on Human
Factors in Computing Systems, 1–8 (2019). https:// doi. org/ 10. 1145/ 32906 07. 32990 17.
108. Heylighen, A., Van der Linden, V. & Van Steenwinkel, I. Ten questions concerning inclusive design of the built environment.
Build. Environ. 114, 507–517. https:// doi. org/ 10. 1016/j. build env. 2016. 12. 008 (2017).
109. Zallio, M. & Clarkson, P. J. Inclusion, diversity, equity and accessibility in the built environment: A study of architectural design
practice. Build. Environ. 206, 108352. https:// doi. org/ 10. 1016/j. build env. 2021. 108352 (2021).
110. Rebernik, N., GoličnikMarušić, B., Bahillo, A. & Osaba, E. A 4-dimensional model and combined methodological approach to
inclusive Urban planning and design for ALL. Sustain. Cities Soc. 44, 195–214. https:// doi. org/ 10. 1016/j . scs. 2018. 10. 001 (2019).
111. Prandi, C., Delnevo, G., Salomoni, P. & Mirri, S. On supporting university communities in indoor waynding: An inclusive
design approach. Sensors 21(9), 1–23. https:// doi. org/ 10. 3390/ s2109 3134 (2021).
112. Hoisington, A. J. et al. Ten questions concerning the built environment and mental health. Build. Environ. 155, 58–69. https://
doi. org/ 10. 1016/j. build env. 2019. 03. 036 (2019).
113. Rollings, K. A. & Bollo, C. S. Permanent supportive housing design characteristics associated with the mental health of formerly
homeless adults in the U.S. and Canada: An integrative review. Int. J. Environ. Res. Public Health 18(18), 9588. https:// doi. org/
10. 3390/ ijerp h1818 9588 (2021).
114. Hong, T., FeiChen, C., Wang, Z. & Xu, X. Linking human-building interactions in shared oces with personality traits. Build.
Environ. 170(2019), 106602. https:// doi. org/ 10. 1016/j. build env. 2019. 106602 (2020).
115. Mauriello, M., McNally, B. & Froehlich, J. ermporal: An easy-to-deploy temporal thermographic sensor system to support
residential energy audits. CHI https:// doi. org/ 10. 1145/ 32906 05. 33003 43 (2019).
116. Liu, G., Jiang, T., Ollis, T. B., Zhang, X. & Tomsovic, K. Distributed energy management for community microgrids considering
network operational constraints and building thermal dynamics. Appl. Energy 239, 83–95 (2019).
117. Binti Mohamad Noor, M. & Hassan, W. H. Current research on Internet of ings (IoT) security: A survey. Comput. Netw. 148,
283–294. https:// doi. org/ 10. 1016/j. comnet. 2018. 11. 025 (2019).
118. Hong, J. e privacy landscape of pervasive computing. IEEE Pervas. Comput. 16(3), 40–48. https:// doi. org/ 10. 1109/ MPRV.
2017. 29409 57 (2017).
119. Truex, S. et al. A Hybrid Approach to Privacy-Preserving Federated Learning. in Proceedings of the 12th ACM Workshop on
Articial Intelligence and Security, 1–11 (2019). https:// doi. org/ 10. 1145/ 33385 01. 33573 70.
120. Sanders, E.B.-N. & Stappers, P. J. Probes, toolkits and prototypes: ree approaches to making in codesigning. CoDesign 10(1),
5–14. https:// doi. org/ 10. 1080/ 15710 882. 2014. 888183 (2014).
121. Sadowski, J., Viljoen, S. & Whittaker, M. Everyone should decide how their digital data are used: Not just tech companies. Nature
595(7866), 169–171. https:// doi. org/ 10. 1038/ d41586- 021- 01812-3 (2021).
122. Awada, M. et al. Ten questions concerning occupant health in buildings during normal operations and extreme events including
the COVID-19 pandemic. Build. Environ. 188, 107480. https:// doi. org/ 10. 1016/j. build env. 2020. 107480 (2021).
123. Araiza, C. How America’s hottest city will survive climate change. in Washington Post. https:// www. washi ngton post. com/ graph
ics/ 2020/ clima te- solut ions/ phoen ix- clima te- change- heat/. Accessed 1 Aug 2022.
124. City of New Orleans. Historic District Landmarks Commission, Guidelines for Storm Preparedness and Resilience. https:// www.
nola. gov/ nola/ media/ HDLC/ Guide line% 20Upd ate/ 20190 111/ 2019- 01- 11_ 13- Storm- Prepa redne ss. pdf.
Content courtesy of Springer Nature, terms of use apply. Rights reserved
18
Vol:.(1234567890)
Scientic Reports | (2022) 12:22092 | https://doi.org/10.1038/s41598-022-25047-y
www.nature.com/scientificreports/
125. Xiao, Y., Becerik-Gerber, B., Lucas, G. & Roll, S. C. Impacts of working from home during COVID-19 pandemic on physical
and mental well-being of oce workstation users. J. Occup. Environ. Med. 63(3), 181–190. https:// doi. org/ 10. 1097/ JOM. 00000
00000 002097 (2021).
126. Fukumura, Y. E., Schott, J. M., Lucas, G. M., Becerik-Gerber, B. & Roll, S. C. Negotiating time and space when working from
home: Experiences during COVID-19. Occup. Articip. Health 41(4), 223–231. https:// doi. org/ 10. 1177/ 15394 49221 10338 30
(2021).
127. Butler, K., Kuligowski, E., Furman, S. & Peacock, R. Perspectives of occupants with mobility impairments on evacuation methods
for use during re emergencies. Fire Saf. J. 91, 955–963. https:// doi. org/ 10. 1016/j. res af. 2017. 04. 025 (2017).
128. A Primer on Organizational Use of Energy Management and Information Systems (EMIS)|Better Buildings Initiative https://
bette rbuil dings solut ionce nter. energy. gov/ resou rces/a- primer- organ izati onal- use- energy- manag ement- and- infor mation- syste
ms- emis. Aaccessed 17 May 2022.
129. Heydarian, A., Carneiro, J. P., Gerber, D. & Becerik-Gerber, B. Immersive virtual environments, understanding the impact of
design features and occupant choice upon lighting for building performance. Build. Environ. 89, 217–228. https:// doi. org/ 10.
1016/j. build env. 2015. 02. 038 (2015).
130. Kwon, H. et al. Review of smart hospital services in real healthcare environments. Healthc. Inform. Res. 28(1), 3–15. https:// doi.
org/ 10. 4258/ hir. 2022. 28.1.3 (2022).
131. BREEAM: BRE Group. 2022. https:// bregr oup. com/ produ cts/ breeam/. Accessed 29 Jul 2022.
132. Qiu, R. G., Qiu, L. & Badr, Y. Integrating physical and social sensing to enable smart city mobility services. in 2016 IEEE 14th
International Conference on Industrial Informatics (INDIN), 909–915 (2016). https:// doi. org/ 10. 1109/ INDIN. 2016. 78192 91.
133. Afzalan, M. & Jazizadeh, F. Indoor positioning based on visible light communication: A performance-based survey of real-world
prototypes. ACM Comput. Surv. 52(2), 1–36. https:// doi. org/ 10. 1145/ 32997 69 (2019).
134. Acuity Brands Helps Target Boost Energy Savings. https:// insig hts. acuit ybran ds. com/ retail/ acuity- brands- helps- target- boost-
energy- savin gs. Accessed 17 May 2022.
135. Target nally conrms that Acuity provides the IoT lighting|LEDs Magazine. https:// www. ledsm agazi ne. com/ leds- ssl- design/
netwo rks- contr ols/ artic le/ 16699 076/ target- nal ly- con rms- that- acuity- provi des- the- iot- light ing. Accessed 17 May 2022.
136. Choi, Y. K., Lazar, A., Demiris, G. & ompson, H. J. Emerging smart home technologies to facilitate engaging with aging. J.
Gerontol. Nurs. 45(12), 41–48. https:// doi. org/ 10. 3928/ 00989 134- 20191 105- 06 (2019).
137. Miller, M. My Smart Home for Seniors. (QUE, 2017).
138. Dubai Airport Show unveils latest hands-free travel systems. https:// www. thena tiona lnews. com/ uae/ trans port/ dubai- airpo
rt- show- unvei ls- latest- hands- free- travel- syste ms-1. 12307 00. Accessed 17 May 2022.
139. Awada, M. et al. Occupant health in buildings: Impact of the COVID-19 pandemic on the opinions of building professionals
and implications on research. Build. Environ. 207, 108440. https:// doi. org/ 10. 1016/j. build env. 2021. 108440 (2022).
140. Huizenga, C., Abbaszadeh, S., Zagreus, L. & Arens, E. A. Air quality and thermal comfort in oce buildings: Results of a large
indoor environmental quality survey. (2006) https:// escho larsh ip. org/ uc/ item/ 7897g 2f8. Accessed 17 May 2022.
141. Kim, L. H. et al.e haunted desk: Exploring non-volitional behavior change with everyday robotics. in Companion of the 2021
ACM/IEEE International Conference on Human-Robot Interaction, 71–75 (2021). https:// doi. org/ 10. 1145/ 34340 74. 34471 31.
142. Fukumura, Y. E., Gray, J. M., Lucas, G. M., Becerik-Gerber, B. & Roll, S. C. Worker perspectives on incorporating articial intel-
ligence into oce workspaces: Implications for the future of oce work. Int. J. Environ. Res. Public Health 18(4), 1690. https://
doi. org/ 10. 3390/ ijerp h1804 1690 (2021).
143. Schaumann, D., PutievskyPilosof, N., Gath-Morad, M. & Kalay, Y. E. Simulating the impact of facility design on operations: A
study in an internal medicine ward. Facilities 38(7/8), 501–522. https:// doi. org/ 10. 1108/F- 10- 2018- 0132 (2020).
Acknowledgements
is research was supported by National Science Foundation [Grant #CMMI-2001742 and Grant #IIP-1831303].
Any opinions, ndings, and conclusions, or recommendations expressed in this material are those of the authors
and do not necessarily reect the views of the National Science Foundation.Dr. Boric-Lubecke holds equity and
serves as president of Adnoviv, Inc, the company that is the prime awardee of that NSF STTR grant. e Univer-
sity of Hawaii has granted a license to Adnoviv, Inc, to commercialize Doppler radar technology for occupancy
sensing purposes, and owns equity in Adnoviv, Inc.Portions of the material presented here are based upon work
supported by the U.S. Department of Energy’s Oce of Energy Eciency and Renewable Energy (EERE) under
the Building Technologies Oce Award Number DE- EE0007682.e views expressed in the article do not
necessarily represent the views of the U.S. Department of Energy or the United States Government.
Author contributions
B.B.G. and G.L. managed the overall process of manuscript preparations, organized the workshops through which
this manuscript was developed and they provided oversight. All authors draed the manuscript in a collabora-
tive fashion. All authors provided comments and approved the nal version of the manuscript for submission.
Competing interests
e authors have no competing interests as dened by Nature Research, or other interests that might be perceived
to inuence the results and/or discussion reported in this paper.
Additional information
Correspondence and requests for materials should be addressed to B.B.-G.
Reprints and permissions information is available at www.nature.com/reprints.
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and
institutional aliations.
Content courtesy of Springer Nature, terms of use apply. Rights reserved
19
Vol.:(0123456789)
Scientic Reports | (2022) 12:22092 | https://doi.org/10.1038/s41598-022-25047-y
www.nature.com/scientificreports/
Open Access is article is licensed under a Creative Commons Attribution 4.0 International
License, which permits use, sharing, adaptation, distribution and reproduction in any medium or
format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the
Creative Commons licence, and indicate if changes were made. e images or other third party material in this
article are included in the articles Creative Commons licence, unless indicated otherwise in a credit line to the
material. If material is not included in the article’s Creative Commons licence and your intended use is not
permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from
the copyright holder. To view a copy of this licence, visit http:// creat iveco mmons. org/ licen ses/ by/4. 0/.
© e Author(s) 2022
Content courtesy of Springer Nature, terms of use apply. Rights reserved
1.
2.
3.
4.
5.
6.
Terms and Conditions
Springer Nature journal content, brought to you courtesy of Springer Nature Customer Service Center GmbH (“Springer Nature”).
Springer Nature supports a reasonable amount of sharing of research papers by authors, subscribers and authorised users (“Users”), for small-
scale personal, non-commercial use provided that all copyright, trade and service marks and other proprietary notices are maintained. By
accessing, sharing, receiving or otherwise using the Springer Nature journal content you agree to these terms of use (“Terms”). For these
purposes, Springer Nature considers academic use (by researchers and students) to be non-commercial.
These Terms are supplementary and will apply in addition to any applicable website terms and conditions, a relevant site licence or a personal
subscription. These Terms will prevail over any conflict or ambiguity with regards to the relevant terms, a site licence or a personal subscription
(to the extent of the conflict or ambiguity only). For Creative Commons-licensed articles, the terms of the Creative Commons license used will
apply.
We collect and use personal data to provide access to the Springer Nature journal content. We may also use these personal data internally within
ResearchGate and Springer Nature and as agreed share it, in an anonymised way, for purposes of tracking, analysis and reporting. We will not
otherwise disclose your personal data outside the ResearchGate or the Springer Nature group of companies unless we have your permission as
detailed in the Privacy Policy.
While Users may use the Springer Nature journal content for small scale, personal non-commercial use, it is important to note that Users may
not:
use such content for the purpose of providing other users with access on a regular or large scale basis or as a means to circumvent access
control;
use such content where to do so would be considered a criminal or statutory offence in any jurisdiction, or gives rise to civil liability, or is
otherwise unlawful;
falsely or misleadingly imply or suggest endorsement, approval , sponsorship, or association unless explicitly agreed to by Springer Nature in
writing;
use bots or other automated methods to access the content or redirect messages
override any security feature or exclusionary protocol; or
share the content in order to create substitute for Springer Nature products or services or a systematic database of Springer Nature journal
content.
In line with the restriction against commercial use, Springer Nature does not permit the creation of a product or service that creates revenue,
royalties, rent or income from our content or its inclusion as part of a paid for service or for other commercial gain. Springer Nature journal
content cannot be used for inter-library loans and librarians may not upload Springer Nature journal content on a large scale into their, or any
other, institutional repository.
These terms of use are reviewed regularly and may be amended at any time. Springer Nature is not obligated to publish any information or
content on this website and may remove it or features or functionality at our sole discretion, at any time with or without notice. Springer Nature
may revoke this licence to you at any time and remove access to any copies of the Springer Nature journal content which have been saved.
To the fullest extent permitted by law, Springer Nature makes no warranties, representations or guarantees to Users, either express or implied
with respect to the Springer nature journal content and all parties disclaim and waive any implied warranties or warranties imposed by law,
including merchantability or fitness for any particular purpose.
Please note that these rights do not automatically extend to content, data or other material published by Springer Nature that may be licensed
from third parties.
If you would like to use or distribute our Springer Nature journal content to a wider audience or on a regular basis or in any other manner not
expressly permitted by these Terms, please contact Springer Nature at
onlineservice@springernature.com
... Within this group, only three participants received a total of fewer personalized JITAI messages than threshold-based messages, demonstrating the sensitivity of personalization. In addition, there are numerous opportunities for improvement of the use of interventions as combined with building controls (Lorenz et al., 2023), personal comfort models (Arakawa Martins et al., 2022), and other humanbuilding interaction strategies (Becerik-Gerber et al., 2022). ...
Preprint
Full-text available
Humans can play a more active role in improving their comfort in the built environment if given the right information at the right place and time. This paper outlines the use of Just-in-Time Adaptive Interventions (JITAI) implemented in the context of the built environment to provide information that helps humans minimize the impact of heat and noise on their daily lives. This framework builds upon the open-source Cozie iOS smartwatch platform. It includes data collection through micro-surveys and intervention messages triggered by environmental, contextual, and personal history conditions. An eight-month deployment of the method was completed in Singapore with 103 participants who submitted over 12,000 micro-surveys and delivered over 3,600 JITAI intervention messages. A weekly survey conducted during two deployment phases revealed an overall increase in perceived usefulness ranging from 8-19% over the first three weeks of data collection. For noise-related interventions, participants showed an overall increase in location changes ranging from 4-11% and a 2-17% increase in earphone use to mitigate noise distractions. For thermal comfort-related interventions, participants demonstrated a 3-13% increase in adjustments to their location or thermostat to feel more comfortable. The analysis found evidence that personality traits (such as conscientiousness), gender, and environmental preferences could be factors in determining the perceived helpfulness of JITAIs and influencing behavior change. These findings underscore the importance of tailoring intervention strategies to individual traits and environmental conditions, setting the stage for future research to refine the delivery, timing, and content of intervention messages.
... The advent of VR training has been shown to be more effective in engaging the attention of people (6), and it is successfully used in many scientific fields, such as in the military (7), education, mining, medical therapy and sports. In the field of construction (8), the outstanding advantage of VR training is to visualize complex construction environment, enabling CWs to actively explore this virtual environment (9). It not only enhances their immersion, but also provide them with a deeper understanding and appreciation of safety training. ...
Article
Full-text available
Virtual Reality Training System (VRTS) has been verified effective in safety training in the construction field. However, in China, it is not widely used as a regular training tool. Among all the reasons, the acceptance level of construction workers (CWs) has the decisive impact on the promotion of VRTS. In view of this, this study is devoted to constructing a training model of CWs’ acceptance level of VRTS training that integrates the technology acceptance level model with the theory of planned behavior. What’s more, this paper innovatively introduces three crucial elements of external influences, namely, risk perception (RP), safety climate (SC) and self-efficacy (SE). In order to more accurately figure out the linear and nonlinear relationship between every structure and the factors of CWs’ acceptance level, 528 participating CWs in this study filled in structured questionnaires, through the data of which the analyzing process uses structural equation model and artificial neural network two-stage analysis method. Based on the analyzing results of the study, this paper put forward a series of specific strategies and suggestions to significantly promote the acceptance level of CWs to VRTS training considering the designment, the enterprises and the government.
... At the same time, the use of wearable technologies in research to measure physiological and behavioral data to help understand the health and well-being of building occupants throughout their daily activities is gaining interest (Becerik-Gerber et al. 2022). Environmental data combined with occupant feedback and physiological information can be used to train personalized comfort models to support optimal building system controls, post-occupancy evaluation, and spatial recommendations in activity-based workspaces (Jayathissa et al. 2020). ...
Conference Paper
Full-text available
The increasing availability of urban-scale, open-access datasets can support decision-making in urban planning, in particular in relation to climate resilience and climate change mitigation. Such data-driven initiatives however often neglect the central role of urban dwellers, whose activities create the demand for energy and mobility in urban areas. This is due in large part due to the difficulty of data collection at this scale, along with privacy concerns arising from any such data collection effort. The use of wearable technologies for self-reported comfort feedback from urban dwellers provides a promising opportunity for citizens to actively participate in the adaptation of urban areas to better support outdoor comfort and climate resilience. In this work, subjective feedback data from 22 participants in a longitudinal test in Seoul, South Korea was collected through a smartwatch application. Participants were required to wear a smartwatch for 4-6 weeks, during which time their location as well as environmental and physiological data were collected. Participants were also requested to complete hourly micro-surveys, in which they were asked about their activities, location, thermal preference, clothing level, comfort adaptations, and mood. This information was complemented by an urban scale dataset comprising building geometries and data from 1000+ weather stations over the same period. This cross-scale dataset was then used to investigate the relationship between urban form and environmental parameters with occupants' survey responses. The relationship between indoor comfort and environmental parameters in the case study is discussed, with recommendations for further research into this topic. The use of machine learning to leverage the combination of spatial, temporal, and subjective preference data to predict occupants' outdoor comfort as a function of their urban environment is also explored.
Article
Full-text available
This research proposes a novel conceptual framework that combines the concepts of Human-Computer Interaction (HCI) and Ambient Intelligence (AmI). The proposed framework aims to shed light on the importance of considering the needs and the social interactions of various building occupants in different types of buildings and designing HBI strategies accordingly. Specifically, we take educational buildings as a case that is less explored in the HBI research and apply the proposed framework, investigating how HBI strategies and interactions should be designed to address the needs of students, as primary occupants. Focus groups and semi-structured interviews were conducted among students in a flagship smart engineering building at Virginia Tech. Qualitative coding and concept mapping were used to analyze the qualitative data and determine the impact of occupant-specific needs on the learning experience of students. “Finding study space” was found to have the highest direct impact on the learning experience of students, and “Indoor Environment Quality (IEQ)” was found to have the highest indirect impact. The results show a clear need to integrate occupant needs in designing HBI strategies in different types of buildings. Finally, we discuss new ideas for designing potential Intelligent User Interfaces (IUI) to address the identified needs.
Article
Smart dynamic building technologies can help to significantly reduce operational energy and carbon emissions. However, human acceptance remains a significant barrier, particularly for switchable glazing used in smart windows. This study examines how users are affected by the speed and direction of transitions in the transparency of fast switchable glazing, specifically dynamic liquid crystal technology under overcast sky. Perceptual and behavioural data including facial action units, were collected through an experimental campaign in a semi-controlled environment where the glazing transparency was transitioned at two rates (1 and 10 seconds). It was found that user perception remained consistent regardless of transition speed or direction, but override behaviour was influenced by both factors. In the absence of glare, user overrides were primarily driven by the transition direction, with more users reacting to transitions from dark to clear. Faster transition rates led to an increase in user overrides for both transition directions. Unlike those who did not override, users who overrode the automated glazing control strategy had a negative perception of the visual environment and the window control system. Users directed their gaze more towards the glazing when this was transitioning, suggesting possible distractions. Users were clustered based on their background knowledge and reported preferences. These clusters showed a good correlation with the override delay times. However, the agreement with actual behaviour was low, indicating that a larger number of variables and clusters should be tested to predict user behaviour. Nevertheless, clustering users highlighted the importance of considering individual differences for interaction strategies.
Article
Full-text available
Most studies on smart residential environments have focused on adopting cutting-edge technologies rather than on user factors. There is little research on interaction with building technologies to support residents’ experiences in smart residential environments. This paper explores the current status of smart residential environment research from the human–building interaction perspective through a critical review of articles published in Q1 journals during 2013 to 2022. For our critical review, we developed an evaluation framework based on our definition of human–building interaction. Our results identified there are limitations in smart residential environments research: a lack of consideration of human-building interaction in the field of the built environment, an excessive focus on the user–technology interaction for performance, and less consideration of urban and architectural design issues regarding human–building interaction. To bridge the gap in the research, the three key points are discussed. Last, we propose a conceptual framework for designing and delivering improved smart residential environments, emphasizing the role of stakeholders in each smart residential environment lifecycle stage to achieve a balanced interaction between the three key elements: users, the built environment, and technologies.
Article
Full-text available
Objective: Smart hospitals involve the application of recent information and communications technology (ICT) innovations to medical services; however, the concept of a smart hospital has not been rigorously defined. In this study, we aimed to derive the definition and service types of smart hospitals and investigate cases of each type. Methods: A literature review was conducted regarding the background and technical characteristics of smart hospitals. On this basis, we conducted a focus group interview with experts in hospital information systems, and ultimately derived eight smart hospital service types. Results: Smart hospital services can be classified into the following types: services based on location recognition and tracking technology that measures and monitors the location information of an object based on short-range communication technology; high-speed communication network-based services based on new wireless communication technology; Internet of Things-based services that connect objects embedded with sensors and communication functions to the internet; mobile health services such as mobile phones, tablets, and wearables; artificial intelligence-based services for the diagnosis and prediction of diseases; robot services provided on behalf of humans in various medical fields; extended reality services that apply hyper-realistic immersive technology to medical practice; and telehealth using ICT. Conclusions: Smart hospitals can influence health and medical policies and create new medical value by defining and quantitatively measuring detailed indicators based on data collected from existing hospitals. Simultaneously, appropriate government incentives, consolidated interdisciplinary research, and active participation by industry are required to foster and facilitate smart hospitals.
Article
Full-text available
Current approaches to simulate occupants' wayfinding in AEC mostly employ direct routing algorithms that assume global knowledge of the navigation environment to compute a shortest path between two locations. This simplification overlooks evidence concerning the role of perception and cognition during wayfinding in complex buildings, leading to potentially erroneous predictions that may hinder architects' ability to design wayfinding by architecture. To bridge this gap, we present a novel simulation paradigm entitled Cognitive Occupancy Modeling in BIM to simulate wayfinding by means of a vision-based cognitive agent and a semantically-enriched navigation space extracted from BIM (Building Information Modeling). To evaluate the predictive power of the proposed paradigm against human behavior, we conducted a wayfinding experiment in Virtual Reality (VR) with 149 participants, followed by a series of simulation experiments with cognitive and direct routing agents. Results highlight a significant correspondence between human participants' and cognitive agents' wayfinding behavior that was not observed with direct routing agents, demonstrating the potential of cognitive modeling to inform building performance simulations in AEC.
Article
Full-text available
Active shooter incidents represent an increasing threat to American society, especially in commercial and educational buildings. In recent years, a wide variety of security countermeasures have been recommended by public and governmental agencies. Many of these countermeasures are aimed to increase building security, yet their impact on human behavior when an active shooter incident occurs remains underexplored. To fill this research gap, we conducted virtual experiments to evaluate the impact of countermeasures on human behavior during active shooter incidents. A total of 162 office workers and middle/high school teachers were recruited to respond to an active shooter incident in virtual office and school buildings with or without the implementation of multiple countermeasures. The experiment results showed countermeasures significantly influenced participants’ response time and decisions (e.g., run, hide, fight). Participants’ responses and perceptions of the active shooter incident were also contingent on their daily roles, as well as building and social contexts. Teachers had more concerns for occupants’ safety than office workers. Moreover, teachers had more positive perceptions of occupants in the school, whereas office workers had more positive perceptions of occupants in the office.
Article
Full-text available
Internet-of-Things (IoT) devices in buildings and wearable technologies for occupants are quickly becoming widespread. These technologies provide copious amounts of high-quality temporal data pertaining to indoor and outdoor environmental quality, comfort, and energy consumption. However, a barrier to their use in many applications is the lack of spatial context in the built environment. Adding Building Information Models (BIM) and Geographic Information Systems (GIS) to these temporal sources unleashes potential. We call this data convergence the Internet-of-Buildings or IoB. In this paper, a digital twin case study of data intersection from various systems is outlined. Initial insights are discussed for an experiment with 17 participants that focused on the collection of occupant subjective feedback to characterize indoor comfort. The results illustrate the ability to capture data from wearables in the context of a BIM data environment.
Article
Full-text available
Visibility is the degree to which different parts of the environment can be observed from a given vantage point. In the absence of previous familiarity or signage, the visibility of key elements in a multilevel environment (e.g., the entrance, exit, or the destination itself) becomes a primary input to make wayfinding decisions and avoid getting lost. Previous research has focused on memory-based wayfinding and mental representation of 3D space, but few studies have investigated the direct effects of visibility on wayfinding. Moreover, to our knowledge, there are no studies that have explicitly observed the interaction between visibility and wayfinding under uncertainty in a multilevel environment. To bridge this gap, we studied how the visibility of destinations, as well as the continuity of sight-lines along the vertical dimension, affects unaided and goal-directed wayfinding behavior in a multilevel desktop Virtual Reality (VR) study. We obtained results from a total of 69 participants. Each participant performed a total of 24 wayfinding trials in a multilevel environment. Results showcase a significant and nonlinear correlation between the visibility of destinations and wayfinding behavioral characteristics. Specifically, once the destination was in sight, regardless of whether it was highly or barely visible, participants made an instantaneous decision to switch floors and move up towards the destination. In contrast, if the destination was out-of-sight, participants performed ‘visual exploration’, indicated by an increase in vertical head movements and greater time taken to switch floors. To demonstrate the direct applicability of this fundamental wayfinding behavioral pattern, we formalize these results by modeling a visibility-based cognitive agent. Our results show that by modeling the transition between exploration and exploitation as a function of visibility, cognitive agents were able to replicate human wayfinding patterns observed in the desktop VR study. This simple demonstration shows the potential of extending our main findings concerning the nonlinear relationship between visibility and wayfinding to inform the modeling of human cognition.
Article
Full-text available
Accessibility is generally recognised as an important element of architectural design practice. However, studies suggest that the adoption of Inclusive Design by the architectural design community is still quite limited. Inclusive Design embraces the principles of accessibility and its extended definition considers key sociological and behavioural aspects such as physical, sensory and cognitive needs. This paper presents the results of an ethnographic study, conducted amongst 26 professionals from the building industry, on the adoption of Inclusive Design. This research aims to explore the challenges and limitations that professionals experience in their daily working practice and to identify strategies to expand the use of Inclusive Design and its extended definition. The findings emphasise how education and awareness are essential factors to encourage an inclusive mindset amongst architectural design professionals and other stakeholders. In particular, holistically mapping the user journey during the design phase and collecting and evaluating post-occupancy user feedback are complementary strategies that can foster a design process based on inclusion, diversity, equity and accessibility principles for the built environment.
Article
Full-text available
The built environment directly and indirectly affects mental health, especially for people transitioning from long-term homelessness to permanent supportive housing (PSH) who often experience co-occurring behavioral health challenges. Despite a rapid increase in PSH availability, little research examines influences of architecture and design within this context. This integrative review synthesized limited research on PSH design in the U.S. and Canada to identify built environment characteristics associated with PSH residents’ mental health, highlight gaps in the literature, and prioritize future research directions. A systematic search for peer-reviewed articles was conducted using nine databases drawing from multiple disciplines including architecture, environmental psychology, interior design, psychology, psychiatry, medicine, and nursing. Seventeen articles met inclusion criteria. Study design, methodology, built environment properties, place attributes, and relevant findings were extracted and iteratively analyzed. Three domains relevant to architecture and design were identified related to home, ontological security, and trauma sensitivity; dwelling unit type, privacy, control, safety, housing quality and location, and access to amenities; and shared common space. Integrative review results emphasize the potential of architecture and design to contribute to improved built environment quality and mental health outcomes among PSH residents. Methodological limitations and directions for future research are also discussed.
Article
Virtual assistants powered by Artificial Intelligence (AI) and integrated into the smart home ecosystems facilitate human–building interactions. We have envisioned that the proactive virtual assistant capabilities could be designed to encourage energy conservation behaviours by relying on their nudging effect through conversational interactions, autonomous actuation and guiding users’ decision-making. To this end, we investigated how proactive virtual assistants, in a simulated smart home ecosystem, influence occupants to take energy-saving, adaptive actions for Heating, Ventilation and Air Conditioning (HVAC) operations and how participants’ personal characteristics affect their responses. Through an interactive online experiment, we collected data from 307 participants from diverse backgrounds across the United States. It was found that proactive communications with follow-up conversations can significantly increase the likelihood of accepting virtual assistance recommendations. This improvement was reflected in an increased number of participants (by 16%) who accepted energy-saving suggestions by comparing initial versus final responses during proactive conversations. Characterizing groups of participants based on their personal features and individual differences showed that user experience (with ∼30% increase), pro-environmental values/beliefs (with ∼24% to 35% increase) and forgiving thermal preferences (with ∼12% increase) had a significant influence on participants’ stated likelihood to accept virtual assistants’ recommendations and their evaluation of the general concept of proactive communication from virtual assistants.
Article
The objectives of this study are to investigate building professionals' experience, awareness, and interest in occupant health in buildings, and to assess the impact of the COVID-19 pandemic on their opinions, as well as to compare the research on occupant health in buildings to professionals' opinions. To address these objectives, a mixed research methodology, including a thorough review of the literature (NL = 190) and an online survey (NS = 274), was utilized. In general, there is an increasing research interest in occupant health and a heightened interest in health-related projects, among professionals, following the COVID-19 pandemic. Specifically, among the nine different building attributes examined, indoor air quality was the most researched building attribute with a focus on occupant health and was also presumed to be the most important by the professionals. Professionals considered fatigue and musculoskeletal pain to be the most important physical well-being issues, and stress, anxiety, and depression to be the most important mental well-being issues that need to be the focus of design, construction, and operation of buildings to support and promote occupant health, while eye-related symptoms and loss of concentration were the most researched physical and mental well-being symptoms in the literature, respectively. Finally, professionals indicated that COVID-19 pandemic had significant effect on their perspectives regarding buildings’ impact on occupant health and they believed future building design, construction and operation will focus more on occupant health because of the pandemic experience.