ArticlePDF Available

Abstract and Figures

Unlabelled: Thermostats control heating and cooling in homes - representing a major part of domestic energy use - yet, poor ergonomics of these devices has thwarted efforts to reduce energy consumption. Theoretically, programmable thermostats can reduce energy by 5-15%, but in practice little to no savings compared to manual thermostats are found. Several studies have found that programmable thermostats are not installed properly, are generally misunderstood and have poor usability. After conducting a usability study of programmable thermostats, we reviewed several guidelines from ergonomics, general device usability, computer-human interfaces and building control sources. We analysed the characteristics of thermostats that enabled or hindered successfully completing tasks and in a timely manner. Subjects had higher success rates with thermostat displays with positive examples of guidelines, such as visibility of possible actions, consistency and standards, and feedback. We suggested other guidelines that seemed missing, such as navigation cues, clear hierarchy and simple decision paths. Practitioner summary: Our evaluation of a usability test of five residential programmable thermostats led to the development of a comprehensive set of specific guidelines for thermostat design including visibility of possible actions, consistency, standards, simple decision paths and clear hierarchy. Improving the usability of thermostats may facilitate energy savings.
Content may be subject to copyright.
This article was downloaded by: [University of California, Berkeley]
On: 26 September 2012, At: 08:32
Publisher: Taylor & Francis
Informa Ltd Registered in England and Wales Registered Number: 1072954 Registered office: Mortimer House,
37-41 Mortimer Street, London W1T 3JH, UK
Ergonomics
Publication details, including instructions for authors and subscription information:
http://www.tandfonline.com/loi/terg20
Facilitating energy savings with programmable
thermostats: evaluation and guidelines for the
thermostat user interface
Therese Peffer a , Daniel Perry b , Marco Pritoni c , Cecilia Aragon b & Alan Meier d
a California Institute for Energy and Environment, University of California Berkeley, 2087
Addison Street, Berkeley, California, USA
b Department of Human Centered Design & Engineering, University of Washington, 407A Sieg
Hall, Seattle, WA, 98195, USA
c Department of Mechanical & Aeronautical Engineering, University of California Davis,
Davis, CA, 95616, USA
d Lawrence Berkeley National Laboratory, 1 Cyclotron Road, Berkeley, CA, 94720, USA
Version of record first published: 25 Sep 2012.
To cite this article: Therese Peffer, Daniel Perry, Marco Pritoni, Cecilia Aragon & Alan Meier (2012): Facilitating energy
savings with programmable thermostats: evaluation and guidelines for the thermostat user interface, Ergonomics,
DOI:10.1080/00140139.2012.718370
To link to this article: http://dx.doi.org/10.1080/00140139.2012.718370
PLEASE SCROLL DOWN FOR ARTICLE
Full terms and conditions of use: http://www.tandfonline.com/page/terms-and-conditions
This article may be used for research, teaching, and private study purposes. Any substantial or systematic
reproduction, redistribution, reselling, loan, sub-licensing, systematic supply, or distribution in any form to
anyone is expressly forbidden.
The publisher does not give any warranty express or implied or make any representation that the contents
will be complete or accurate or up to date. The accuracy of any instructions, formulae, and drug doses should
be independently verified with primary sources. The publisher shall not be liable for any loss, actions, claims,
proceedings, demand, or costs or damages whatsoever or howsoever caused arising directly or indirectly in
connection with or arising out of the use of this material.
Facilitating energy savings with programmable thermostats: evaluation and guidelines for the
thermostat user interface
Therese Peffer
a
*, Daniel Perry
b
, Marco Pritoni
c
, Cecilia Aragon
b
and Alan Meier
d
a
California Institute for Energy and Environment, University of California Berkeley, 2087 Addison Street, Berkeley, California,
USA;
b
Department of Human Centered Design & Engineering, University of Washington, 407A Sieg Hall, Seattle, WA 98195,
USA;
c
Department of Mechanical & Aeronautical Engineering, University of California Davis, Davis, CA 95616, USA;
d
Lawrence
Berkeley National Laboratory, 1 Cyclotron Road, Berkeley, CA 94720, USA
(Received 30 September 2011; final version received 1 August 2012)
Thermostats control heating and cooling in homes – representing a major part of domestic energy use – yet,
poor ergonomics of these devices has thwarted efforts to reduce energy consumption. Theoretically,
programmable thermostats can reduce energy by 5–15%, but in practice little to no savings compared to
manual thermostats are found. Several studies have found that programmable thermostats are not installed
properly, are generally misunderstood and have poor usability. After conducting a usability study of
programmable thermostats, we reviewed several guidelines from ergonomics, general device usability, computer–
human interfaces and building control sources. We analysed the characteristics of thermostats that enabled or
hindered successfully completing tasks and in a timely manner. Subjects had higher success rates with thermostat
displays with positive examples of guidelines, such as visibility of possible actions, consistency and standards,
and feedback. We suggested other guidelines that seemed missing, such as navigation cues, clear hierarchy and
simple decision paths.
Practitioner Summary: Our evaluation of a usability test of five residential programmable thermostats led to the
development of a comprehensive set of specific guidelines for thermostat design including visibility of possible
actions, consistency, standards, simple decision paths and clear hierarchy. Improving the usability of thermostats
may facilitate energy savings.
Keywords: thermostat; user interface; energy; usability; heuristic evaluation; residential
1. Introduction
Many energy efficient items of equipment or energy reduction measures save energy from the time they are installed,
such as efficient refrigerators or building insulation; however, others require the active participation of an informed
human. Programmable thermostats (that can automatically relax temperatures at night or during unoccupied
periods) have been promoted all over the world to save energy used to heat and/or cool people’s homes. In the US,
where nearly two-thirds (64%) of the residential heating systems use central air, energy for residential heating and
cooling amounts to 9% of the total primary energy use (Energy Information Administration (EIA) 2010, US
Department of Energy (DOE) 2011a,b). A widely used rule of thumb is a savings of 1.8% per degree C (1% per
degree F) for an eight-hour adjustment (Nelson and MacArthur 1978). Yet, programmable thermostats have largely
failed to save energy due to poor ergonomics. A recent literature review (Peffer et al. 2011) uncovered many reasons:
improper installation (e.g. mounted sideways, in dimly lit corridors, too high/too low), poor interface (e.g. buttons
too small, icons/terms not understood) and misunderstanding of how thermostats work in particular and how
heating/cooling systems work in general.
The ergonomics of a thermostat involves understanding its context to analyse the demands placed on the user’s
capabilities during its use. A typical residential thermostat controls the heating and/or cooling equipment, provides
a user interface for the occupant to read current status and adjust the control, and contains at minimum a
temperature sensor to provide control feedback. The thermostat is typically mounted on a wall and wired to the
heating, cooling and/or ventilation system; ideally, this wall is an interior wall insulated from outdoor conditions
and centrally located in the house. The de facto standard in the US for placement of the thermostat on the wall is
1.524 m (60 inches) from the floor. The physical location alone not only affects the functionality of the device (due
*Corresponding author. Email: therese.peffer@uc-ciee.org
Ergonomics
2012, 1–17, iFirst article
ISSN 0014-0139 print/ISSN 1366-5847 online
Ó2012 Taylor & Francis
http://dx.doi.org/10.1080/00140139.2012.718370
http://www.tandfonline.com
Downloaded by [University of California, Berkeley] at 08:32 26 September 2012
to the temperature sensor) but several user capabilities, such as reach and vision. In our literature review, we found
examples of programmable thermostats located in inaccessible places (e.g. behind furniture), turned sideways (i.e. to
accommodate the aspect dimensions of the previous thermostat so the users did not have to repaint the wall), too
high or too low to read/access easily, and in dimly lit corridors, precluding visibility.
The human factors of the thermostat also include the user interface, which impacts human vision,
communication, cognition and dexterity. The basic thermostat interface needs to: allow the user to provide a
comfortable temperature (whether heating or cooling), set a schedule for convenience (e.g. heat before getting out of
bed in the morning) and for energy savings (e.g. turn off heat/cool systems when no one is at home or when one is
going out for a few hours or several days; adjust temperatures at night to reduce heating and cooling).
Modern programmable thermostats are following two other consumer electronic trends: from using an analogue
display to digital (and often from graphic to numeric display) and from mechanical operation (e.g. knobs, sliders) to
electronic (e.g. push buttons, touchscreen). In addition, programmable thermostats are increasingly complex,
beyond the base features of setting start and end times for desired temperatures for the day, and days of the week.
Today’s programmable thermostats have more control features and display parameters (e.g. status of filter and
battery, amount of energy consumed).
In general, programmable thermostats do not have much market penetration in the US and have not
conclusively demonstrated energy savings. Although programmable thermostats have been available for more
than 30 years, only 30% of US households have installed them (Energy Information Administration (EIA)
2005c). Several studies indicate that many people do not use programmable thermostats as designed. Only 55–
60% are used to adjust temperatures at night for cooling and heating seasons, respectively (Energy Information
Administration (EIA) 2005b) (Energy Information Administration (EIA) 2005a). Approximately half are in
‘hold’ mode, effectively disabling the programming features (personal correspondence from Raymond Archacki
to Gaymond Yee on the Carrier thermostat mode summary, Summer 2003). Several studies have indicated no
significant savings with programmable thermostats (Cross and Judd 1997, Nevius and Pigg 2000, Haiad et al.
2004).
The US Environmental Protection Agency reviewed many field studies and concluded that consumers were not
using programmable thermostats effectively due to programming difficulties and lack of understanding of terms
such as set point (Harris 2008). As a result, the EPA discontinued the EnergyStar programmable thermostat
program in December 2009. Indeed, several recent usability tests with thermostats indicate continued problems
(Karjalainen 2009, Sauer et al. 2009, Combe et al. 2011, Perry et al. 2011), suggesting that the industry in general has
not responded to improve these interfaces nor outlined means of testing them with users. (We note that Consumer
Reports test thermostats in well-lighted rooms with users sitting down.)
While the study of ergonomics specific to thermostats is not new, thermostat manufacturers in general do not
seem to have applied this in their design of thermostats. Thirty years ago, Moore and Dartnall (1982) described
issues such as setting the time on programmable thermostats and Dale and Crawshaw (1983) observed the effect of
font size and controls. A quick review of modern programmable thermostats indicates that not only have the
findings in these early studies been ignored, but also technology has changed dramatically and the functions have
increased in complexity. One hypothesis is that in general, industries have grown from product-driven and
consumer-focused to financially-driven (Foroohar 2011); we can only guess that manufacturers typically balk at the
cost of design of such a mundane device as a thermostat.
We did not find any existing guidelines or heuristics specific to guiding better ergonomics design of residential
programmable thermostats. However, many ergonomics textbooks (e.g. Sanders and McCormick 1993) provide the
basics for visual display, cognition and basic controls. More domain-specific are guidelines on human–computer
interfaces. These are applicable to this study because current programmable thermostats may be described as
embedded devices – having computer systems that are limited in scope and designed to do dedicated functions. The
human–computer interface design realm provides many guidelines, such as on Internet or web interfaces, and even
regarding smart phone interfaces and touchscreens (Nielsen and Molich 1990, Nielsen 1994b, Cooper et al. 2007,
Shneiderman and Plaisant 2009). Two guidelines target commercial building controls (Wyon 1997, Bordass et al.
2007), and one recent guideline was specifically developed for thermostats for offices (Karjalainen 2008). Many of
these latter principles are specific to office buildings and not residential settings.
This study examines several guidelines and uses them to evaluate user mistakes and success performing tasks
on several programmable thermostats in a usability test. We use the guidelines in our analysis of the parameters
of the thermostats that led to errors and confusion as well as those that led to successful completion. In
evaluating what worked and what was missing, we then developed a new set of guidelines for residential
thermostat interface design.
2T. Peffer et al.
Downloaded by [University of California, Berkeley] at 08:32 26 September 2012
2. Methods of evaluating interfaces
We reviewed several guidelines for user interfaces to assess their potential for evaluating programmable thermostats.
The first list (Table 1) suggests potentially relevant parameters from a basic ergonomics textbook. These principles
are grouped into those applicable to location, vision, controls and cognitive abilities. While these guidelines may be
generally applied, they are fairly detailed and specific. Many of these guidelines were developed through
measurements, testing and observations of humans.
Table 2 provides guidelines from general device interface usability (Polson and Lewis 1990, Norman 2002), the
computer–human interface realm (Nielsen and Molich 1990, Nielsen 1994b, Shneiderman and Plaisant 2009),
commercial building controls (Bordass et al. 2007) and commercial building thermostats (Karjalainen 2008). These
are grouped horizontally as best as possible to see overlap among the guidelines. These guidelines are fairly
generally applied, and without much detail. The next few paragraphs describe the various guidelines.
The ergonomics guidelines have more specifics regarding the ‘how’ of interface design – where located for best
reach and vision, what kind of display is best for the type of task and the size and type of font. The other guidelines
are more heuristic in nature in providing general design guidance.
Norman, Polson and Lewis provide general device usability guidelines. Norman discusses natural mappings
between the real world and how users think. Polson and Lewis describe attributes of ‘walk-up-and-use’ applications,
which we find particularly appropriate to residential thermostats (Polson and Lewis 1990).
The Shneiderman and Plaisant (2009) and Nielsen and Molich (1990) user interface design guidelines seem
applicable to embedded devices (e.g. visible system status, use of conventions and standards, and minimising errors).
Limitations of embedded devices such as programmable thermostats as compared to general-purpose computers
include limited screen size and dedicated functions (to reach a certain state). This limits the ability of the user to fully
explore or gather data more freely. For example, many programmable thermostats would not be able to support the
help function and wizards typical of most computer software programs.
Bordass et al. (2007) describe end use requirements for more usable controls commonly found in commercial
buildings (such as lighting, fans, windows and thermostats). The Bordass et al. (2007) list provides criteria that are
specific to controls (need for fine control, amount of use), but does not take into account the potential of an
embedded device as a control.
Karjalainen reviewed six different usability guidelines in developing his own guideline for office thermostats
(Karjalainen 2008). He noted in general that the guidelines available do not take into consideration thermal inertia
(e.g. the time delay in reaching the desired temperature), psychological, behavioural and physiological components
of human thermal comfort, the occupant’s lack of knowledge of how the heating/cooling system works, the
occupant’s false idea of comfortable temperatures (e.g. in practice one’s thermal comfort range is much wider than
an occupant often thinks) and the characteristics of heating and cooling systems. Karjalainen provides several
specific guidelines for temperature controls, detailing the type of feedback (both controls and room); he also
suggests providing advice on comfortable room temperatures. Finally, he suggests usability testing as part of the
design process.
Table 1. Relevant parameters from an ergonomics textbook (Sanders and McCormick 1993).
Location Within reach for control and within sight on display, sufficiently lighted.
Visual display Illumination on screen, contrast between content and background, glare, font size and type (segmented
font vs. dot matrix (fewer errors)). Button and switch size and position. Symbol size.
Control interface Fixed scale with moving pointer provides rapid clue of approximate quantity (and relative rate of change)
and set-in quantity (natural relationship between control and display motions).
Compatible/consistent with human expectations (faster learning and reaction time, fewer errors)
Spatial compatibility: physical similarity of displays and controls.
Movement compatibility: (e.g. up arrow or move to right or clockwise indicates increase)
Hierarchy of control (rate/first order vs. higher order control)
Push button for discrete information vs. sliding lever or turning knob for transmitting continuous
information
Coding controls: shape, texture, size, location, operational method, colour, labels
Push vs. hold down: feel of resistance
Cognitive Alpha-numeric display good for identification and small space, also superior to analogue when a precise
numeric value is required and values are not continually changing.
Symbolic signs preferable if the code symbol has an already fairly universally established association (no
recoding from symbol to words to concept).
Easiest to read straight line scale (vs. curved) with moving pointer and control moves the pointer (Heglin
1973).
Ergonomics 3
Downloaded by [University of California, Berkeley] at 08:32 26 September 2012
Table 2. A compilation of guidelines for more usable interfaces.
Karjalainen (2008)
Shneiderman and
Plaisant (2009)
Nielsen and Molich
(1990), Nielsen 1994b Norman (1990)
Polson and Lewis
(1990) Bordass et al. (2007)
Thermostats in offices Web user interface
design
Web user interface
design
General design Walk up and use
interfaces
Commercial building
control design
Clear and sufficient
feedback after
adjustment
Offer informative
feedback
Give rapid feedback
of intended effect
Visibility, identification
and reachability of
temperature controls
Visibility of system
status
Make mappings
visible.
Make the available
repertoire of
available actions
salient
Give instant, tangible
feedback to
indicate device
operation
Make it easy to see
possible actions
Match between
system and the real
world
Use both knowledge
in the world and
head
Keep occupants in the
loop
Make users feel they
are in control
User control and
freedom
Be located close to
point of need.
Strive for consistency Consistency and
standards
When all else fails,
standardise.
Clear way to adjust
room temp.
Tolerate at most one
hard-to-
understand action.
Easy to understand
Acceptable default
settings
Easy to use
Minimise short-term
memory load
Recognition rather
than recall
Get the mappings
right
Use identity cues
between actions
and user goals.
Not need to be used
too often. Take
into account
occasional use
Adequate and fast effect
on room temperature.
Shared temperature
controls with heating
and cooling systems
Cater to universal
usability
Flexibility and
efficiency of use
Make available
actions easy to
discriminate.
Work effectively
Aesthetic design Design task flow to
yield closure
Aesthetic and
minimalist design
Simplify task
structure.
Offer few alternatives. Not require users to
intervene too much
Simplicity of interface Exploit the power of
constraints
Require as few
choices as possible.
Prevent errors Error prevention Design for error
Permit easy reversal
of actions
Help recognise,
diagnose, and
recover from
errors
Provide an obvious
way to undo
actions
Informative help Provide help and
documentation
Advice on comfortable
room temperatures
Females as test users in
real-life situations
4T. Peffer et al.
Downloaded by [University of California, Berkeley] at 08:32 26 September 2012
There is much overlap in these guidelines: easy to use and understand, visibility, need for feedback, aesthetics,
simplicity and not relying on people’s memory in using the device. The latter two guidelines were designed for
commercial buildings, and thus do not consider context and motivation for using the controls from a residential
perspective (e.g. comfort for guests, saving money).
We developed a number of research questions: What can we learn from these guidelines to help evaluate the
usability of programmable thermostats – what is useful and what is missing? Specifically, what element(s) of the
interface renders it easier for the subject to complete the task? What features create frustration and prevent task
completion?
3. Research design
In 2010, we conducted a usability study on five commercially-available residential programmable thermostats (three
touchscreen, one web and one button-based – see Table 3), with 31 participants, involving five tasks to evaluate
device usability and effectiveness. Each subject interacted with two thermostats (one at a time) installed at a height
in the lab typically seen in most US houses. The details of the test and usability metrics developed to evaluate the
devices’ usability and the users’ effectiveness at performing common thermostat tasks are described in Perry et al.
(2011). A video recording of each session was used to input numerous categories of data including task completion,
time on task, function path (buttons and function interactions), interaction motions (press, slide, hold, etc.),
interaction errors and experimenter observations regarding users’ confusion during the task.
This study looked at each trial, defined as a subject attempting one of five tasks on a given thermostat, to
determine what parameters led to good versus poor usability. We used the guidelines to categorise these parameters.
We analysed each subject’s actions during successfully completed tasks compared with non-completed tasks
(included tasks not completed or not successfully completed). In addition, we observed the path length to complete
each task and the total time on task, either to complete the task or ending time when the task was not successfully
completed.
We developed tasks reflecting the typical functions of programmable thermostats. The most important were:
ability to turn on/off heating or cooling, temporarily turning up or down heating or cooling, checking the current
and target temperatures, setting time (and changing time at the beginning and end of Daylight Savings Time) and
adjusting systems to use less energy when one is away. These tasks were also chosen in consideration of their effect
on residential energy consumption. The five tasks finally selected for this study are in Table 4.
Table 3. Description of thermostats tested.
Device Type Description
BTN Buttons/ Button-based programming; full cover over device; user instructions on cover; 7-day
programming.Switches
HYB Buttons with
touchscreen
Hybrid of touchscreen (primary programming), switches under a cover (heating and cooling
controls), and button for lighting; 7-day programming; ability to view past energy usage.
TCH Touchscreen Touchscreen with black/white display; 7-day programming.
SMT Smart with
touchscreen
Smart WiFi enabled device; full-colour LCD touchscreen; 7-day programming; quick save
function.
WEB Web portal Web platform; 7-day programming; synched with wall device.
Table 4. Description of tasks.
Tasks Description
Set heat Set the thermostat to HEAT mode. (Setting was OFF at the start of the task).
Set time and day*# Set the thermostat to the current day and time. (The time settings were programmed to Monday at
12:00 am for the start of the task.)
Current setting Identify and read aloud the temperature that the thermostat was set to reach at that current time.
Future setting Identify and read aloud the temperature that the thermostat was set to reach at a future period
(Thursday at 9 pm). (No need to change any settings).
Vacation/away/hold Set the thermostat to maintain the same temperature during a five-day period when one is away.
Note: *not performed on the WEB because time settings could not be modified. #setting the day not performed for the TCH because this required
a code from the manual.
Ergonomics 5
Downloaded by [University of California, Berkeley] at 08:32 26 September 2012
4. Analysis of existing designs
This section describes the success rate and time on task for subjects for each thermostat per task. Success refers to
accomplishing the stated goals of the task; time on task marked the ending time for each task, when the subject
stated that he/she was finished (whether successful or not). We note here that there were cases where the subject felt
he/she had completed the task correctly, but in fact were unsuccessful, cases where the subject was not sure whether
he/she had completed the task correctly or not, and cases where the subject clearly gave up, not knowing what else
to do to complete the task. The development of the time and success metric is outlined in Perry et al. (2011); another
complementary study looked at optimal path length – the minimum number of button pushes and other actions
required to complete the task (Pritoni et al. 2011). We also show time for incomplete tasks; this includes subjects
verbally stating he/she was finished with the task (whether or not he/she had completed it) and incorrectly
completing the task. For each task we describe various elements of the interfaces that seem to contribute to success
and timely task completion as well as those that created confusion and difficulties. Figures 1–5 show annotated
pictures of the thermostats.
Figure 1. Button thermostat (BTN).
Figure 2. Hybrid thermostat (both touchscreen and buttons/switches) (HYB).
6T. Peffer et al.
Downloaded by [University of California, Berkeley] at 08:32 26 September 2012
4.1. Task 1: Set thermostat to HEAT mode
This was considered to be the easiest task; the optimal path length – the shortest series of actions necessary to
complete the task – ranged from 1 to 4 (see Figure 6). In general, the best performing thermostat interface was the
web interface – 100% of the subjects completed this task, and all under 30 s. However, the worst performing
thermostat only had a 46% success rate.
The two thermostats with the highest success rate had the ‘switch’ visible at the home screen/default level. With
the worst performing interface (HYB), the switch was hidden by a small cover, with no affordance or design features
that hint that it was in fact openable. The BTN interface also had a cover; perhaps because the cover was larger led
Figure 3. Touchscreen thermostat (TCH).
Figure 4. Smart thermostat (touchscreen with Home button) (SMT).
Figure 5. Web portal as a thermostat interface (WEB).
Ergonomics 7
Downloaded by [University of California, Berkeley] at 08:32 26 September 2012
to better recognition by subjects. For the SMT thermostat, one had to go into the Details menu. Besides not being
able to find the switch, other problems included confusion over the correct switch (between fan (ON-AUTO) switch
and heat switch (OFF-HEAT)
1
, and confusion over what is the current setting (e.g. the thermostat is currently in
heat mode or off) versus whether system is on (e.g. furnace is currently producing heat).
4.2. Task 2: Set time and day
For task 2, the WEB interface was exempt, since its time and day stamp came from a networked computer. The
Touchscreen (TCH) interface performed the best, with 100% of subjects completing the task, however a few subjects
took more than two minutes to complete the task (see Figure 7).
One major problem was not finding the place (whether button or menu) to change the day/time. The
TCH model had a Clock button at the home/default level. For the HYB, one could either press on the
current time and day display to change or go through the Menu to Set Time/Day; both used up or down
arrows on the touchscreen to change, but the Menu editor required saving by pressing ‘Yes’. However, for the
SMT interface, one had to press the More button, then Settings, then Preferences to get to the clock function,
then eight more button presses to finish the task. The BTN interface had the day/time button under a cover. In
addition, subjects were confused whether they were setting universal time or time/day for a programmed
temperature schedule. In general, subjects found it tedious to set time because each button push only
incremented the time by one minute; if one held the button down, the time would scroll faster, but this was not
obvious.
4.3. Task 3: Identify current target or ‘set to’ temperature
This task showed a wide disparity among the thermostats with subjects performing well on three thermostats and
poorly on the other two (Figure 8). Three devices showed the current temperature and the target temperature
setpoint in the main screen. The information was presented clearly, with labels indicating ‘set to’ or ‘set temperature’
for the temperature setpoint compared to ‘current’, ‘inside’, ‘room’, or ‘current temperature,’ but some of the labels
used were quite small.
Figure 6. Time on task, success rate, and ideal path length for Task 1: Set to heat.
8T. Peffer et al.
Downloaded by [University of California, Berkeley] at 08:32 26 September 2012
Figure 7. Time on task, success rate, and ideal path length for Task 2: Set time and day.
Figure 8. Time on task, success rate, and ideal path length for Task 3: Identify current target temperature.
Ergonomics 9
Downloaded by [University of California, Berkeley] at 08:32 26 September 2012
A common problem was in navigation: subjects were confused how to get to the temperature setpoint. For the
Button (BTN) thermostat interface, one either immediately grasped the procedure or not at all; the target
temperature was accessed from pressing either one of the up/down arrow push buttons that one would use to change
the setpoint – not an obvious means of control. The Hybrid thermostat allowed one to press the screen where the
current temperature was displayed to access the target temperature – again, not an obvious or natural connection.
One common error was the subject providing the current temperature instead of the set or target temperature,
especially for the devices where only one temperature was shown (BTN and HYB). Another common error was the
subject providing the set or target temperature for the wrong time of day.
4.4. Task 4: Identify future target or ‘set to’ temperature
This task required the subject to identify a target temperature for a time in the future, and thus subjects had to look
at the programmed schedule. The best performance came from using the web interface with a 71% completion rate.
However, subjects had difficulties completing the task with the other thermostat interfaces (Figure 9).
The main problem was that subjects did not know how to access the schedule of time and temperatures. Three of
the five interfaces tested had a means of viewing the schedule; for the others, it was necessary to enter the ‘Edit
Program’ mode. The WEB interface had the schedule on the home screen, so this was the most accessible; the SMT
had a button labelled ‘program’ on the home screen and the TCH had a button labelled ‘Sched’ for Schedule. The
thermostat on which subject performed the worst (BTN) had a panel covering the program button and had serial
access to this data, meaning that one had to scroll through all days of week and all time modes; one couldn’t skip to
the desired time. In addition, only the start time for each period was indicated, and if one passed the setting for the
desired time, one could not go backwards. Access using the HYB thermostat required several steps pressing areas on
the touchscreen: first pressing Menu, and then pressing the Scroll button to find Set/review heat programs and then
selecting Yes, and then pressing the Next button to go through each day’s four time modes (MORN, DAY, EVE,
NITE) until one reached the desired day/time. The best performing thermostats (WEB and SMT) had a two-
dimensional graphic depicting day/time and temperature in a tabular form; the web interface provided information
on single schedules just by hovering with the cursor over the calendar.
Figure 9. Time on task, success rate, and ideal path length for Task 4: Identify future target temperature.
10 T. Peffer et al.
Downloaded by [University of California, Berkeley] at 08:32 26 September 2012
4.5. Task 5: Set for away/vacation
The final task asked subjects to set the thermostat for the condition that the house would be unoccupied for several
days. Subjects using the WEB interface performed reasonably well, with 75% completion. Subjects using the
Touchscreen (TCH) and Smart (SMT) interfaces were less successful. Less than half of those using the Button
(BTN) interface were able to complete the task, and only one subject using the Hybrid (HYB) interface completed
the task – taking 5 min to do so (Figure 10).
For each thermostat, there were a few different ways of completing this task. Three thermostats (WEB, SMT
and BTN) had a ‘vacation’ or ‘away’ or ‘energy savings’ mode; all five had Hold modes, in which one could change
the temperature setting and ‘hold’ it. Ironically, the thermostat with one of the shortest path lengths (HYB) posed
the most challenge; one had to press on the word Hold on the screen and then the current temperature display to
change the setpoint, but there is no affordance to suggest that Hold is in fact a button and is touch sensitive. Many
subjects tediously changed the setpoints for all days and all time modes in the day. A common error was not saving
properly, so the changes were lost. In general, subjects were confused regarding the terms/functions temporary
override, timed hold, permanent hold, permanent override, away and vacation.
4.6. Application of the guidelines
Some guidelines are meant to be applied in the field, and did not apply to our lab test of the programmable
thermostats, such as location and feedback from the effect of the equipment. Other guidelines we did not
explicitly test, such as glare, font and icon size. As was shown in Table 2, many guidelines were similar. We
attempted to group and summarise the most pertinent and applicable guidelines. Table 5 shows this reduced set
of guidelines and shows how each thermostat fared accordingly. We evaluated the parameters of each
thermostat that seemed to correspond with successful and timely completion or incomplete and longer time on
task. We categorised them according to each guideline. Positive examples of each guideline are labelled with a
plus sign (þ) and shaded in grey; examples that violate the guideline are labelled with a minus sign (7). Blank
cells merely indicate that the thermostat did not clearly provide a positive example nor a violation of the
guideline.
Figure 10. Time on task, success rate, and ideal path length for Task 5: Set for away/vacation.
Ergonomics 11
Downloaded by [University of California, Berkeley] at 08:32 26 September 2012
Table 5. Application of the guidelines to each thermostat.
Guidelines
Programmable thermostats
WEB TCH SMT BTN HYB
Ergonomics of visual
display and controls
(Sanders and
McCormick 1993)
þþ Slide pointer across
fixed scale to adjust
temp
Touchscreen arrow
‘button’ to adjust time
and temp
þþ Slide pointer across
fixed scale for temp7
Fixed pointer/ moving
scale for time
Push arrow buttons to
adjust temperature or
time
Touchscreen arrow
‘button’ to adjust
temperature or time.
Visibility of available
options
(Polson and Lewis 1990)
Norman 2002,
Consider occasional use
(Polson and Lewis
1990, Nielsen 1994,
Norman 2002,
Bordass et al. 2007,
Shneiderman and
Plaisant 2009)
þmultiple windows,
menus
þlarge screen 7Many actions not
available on home
screen
7cover hides system
switches and
programming buttons
7cover
7too many modes of
operation
7serial programming
Feedback from controls
(Karjalainen 2008,
2009, Bordass et al.
2007, Shneiderman
and Plaisant 2009)
7Touchscreen not
always responsive
þActual buttons
(responsive feel)
þresponsive
touchscreen
þaudible beep when
touched
Match between system &
real world (Nielsen
1994)
Use of natural
mappings. (Norman
2002)
Consistency and
standards (Nielsen
1994, Norman 2002,
Shneiderman and
Plaisant 2009)
þDe facto switch standard: heat-cool-off and auto-on for fan.
þþ drag setpoint on
analogue scale
þUp/down arrow
‘buttons’
þþ drag pointer to
change setpoint on
analogue scale
þUp/down arrow
buttons
Up/down arrow
‘buttons’ only on
selected screens
þtabular format for
visualising day/time/
temp setpoint
7Menu labels not
descriptive
þtabular format for
visualising day/time/
temp
7Use of abbreviated
words (VACA for
Vacation) and terms
(SPAN)
7Scroll ‘button’—scroll
bars more typical
7menu button (not
drop down)
7Not clear what is the
‘button’ on the
touchscreen and
what is merely text.
7Inconsistent: Press
current time to
change but press
current temperature
to see set temp
User control and
freedom
(Shneiderman et al.
1988, Nielsen 1994,
Karjalainen; 2008,
2009)
þok button 7‘hold/return’ button
is exit and next, no
way to cancel
vacation
7yes instead of ok
þexit
(continued)
12 T. Peffer et al.
Downloaded by [University of California, Berkeley] at 08:32 26 September 2012
Table 5. (Continued).
Guidelines
Programmable thermostats
WEB TCH SMT BTN HYB
Error prevention,
recognition, recovery
(Polson and Lewis
1990, Nielsen 1994,
Norman 2002,
Shneiderman and
Plaisant 2009)
7no confirmation 7if one didn’t press yes
to save, the
programming was
lost, with no
confirmation.
Flexibility and efficiency
of use (Norman 2002)
Work effectively
(Bordass et al. 2007)
þpop-up balloons to see
temp
þHold down button to scroll faster (although not
obvious)
þone touch buttons for
energy use/comfort
mode during day
þTwo means of setting
day/time
7some settings require
removing from wall
Aesthetic and minimalist
design (Polson and
Lewis 1990, Nielsen
1994, Norman 2002,
Bordass et al. 2007,
Karjalainen 2008,
2009, Shneiderman
and Plaisant 2009)
þcolour, graphics þcolour, graphics 7switches, a button
and touch screen
7three font types
(segmented, dot
matrix, stroke)
þlarge touch screen
þdifferent sized fonts,
larger for oft-used
tasks
þbacklight for easier
reading
Help and documentation
(Nielsen 1994,
Karjalainen, 2008,
2009)
þwizard þ/7instructions on
inside cover (but
cryptic)
7none
Ergonomics 13
Downloaded by [University of California, Berkeley] at 08:32 26 September 2012
5. Discussion
Several of the interfaces were complicated and difficult for users to understand, leading to frustrations and major
barriers for completing the tasks. The data from the usability test (successful completion, time to complete and
ending time for incomplete tests) provided a means of evaluating the devices as well as probing the causes of
problems and keys to success. Another measure that combines efficiency, ease of use, and few errors was actual path
length compared to the ideal path length. In general, we assumed that a successful completion of a task meant the
subject found the interface usable from a strictly functional point of view – in the case of this lab test, perhaps easy
to learn was the key usability attribute.
Subjects performed better with some displays than others, and this varied by task. For example, subjects using
the WEB display in general performed well. However, the WEB display is a special case in that it is not an
embedded device, and has more capability (e.g. larger screen, familiar menu driven display). While more and more
thermostats include control by smart phone and tablets, we anticipate that some sectors of the population will
always require a stand-alone, simple, non-networked device. Some of the elements of the WEB display can be
developed in embedded devices, such as the tabular display of temperature, time and day. We found all thermostats
provided attributes that supported guidelines; even the least usable device had positive qualities, such as a
responsive touchscreen that provided feedback and hierarchy of display. The variability in performance in general
across thermostats and tasks indicates a variety of solutions for usability; we do not develop these guidelines
towards a ‘one size fits all’ solution.
Many of the guidelines were quite useful in understanding the ease or difficulty with which subject completed
each task. One of the most important guidelines appeared to be the visibility of available options, associated with
walk-up-and-use applications. For example, the cover or door on two thermostats seemed to reduce performance in
hiding a few of the available options. Users got lost when the action choice was not available on the home screen,
and the terminology of the choices was not clear (e.g. setting the time on the Smart thermostat). Arguably, a cover
may make the thermostat more aesthetically pleasing with a more simplified appearance; however, in this case, the
manufacturers could certainly provide better affordances to indicate that a panel or door is openable and how to
open it.
Another pertinent guideline was consistency and standards. Both the Touchscreen and Hybrid thermostats had
touchscreens; however, with the Hybrid thermostat, the ‘buttons’ did not look like buttons. For example, only one
subject was able to figure out the Hold function with the Hybrid; this may also reflect the lack of familiarity with
this term. This also seemed to affect setting the day and time using the Hybrid (73% completion vs. 100% for the
Touchscreen). In general, the terminology was neither standardised across thermostats nor natural or familiar;
terms such as settings or setpoint, current, and hold seemed to create confusion. The Hybrid also was inconsistent in
operation. For example, one could press on the time or day to set the time or day, but pressing on the current
temperature provided the target temperature. It was difficult to know which words were touch-sensitive or not.
Lack of feedback was another common issue. Many users made errors when they failed to save changes. There
was no confirmation prompt (e.g. do you want to save?) as is so common in computer interfaces. Previous studies
have shown feedback on user behaviour is vital to performance as well as satisfaction (Sauer et al. 2007).
Several issues were not addressed by the guidelines. More important than the path length (i.e. number of total
actions) was a broad and shallow decision tree (Shneiderman 1988), that is, having many options available at first
glance, and not very many ‘layers’ or levels of choices (e.g. a menu (level 1) with xchoices, each of which (level 2)
have ychoices, each of which (level 3) have zchoices and so on). Each decision point represented a chance to get
lost. Of course, the ‘width’ of the decision tree at the first level is not infinite; further studies may suggest a practical
limit of the number of choices to keep the interfaces simple. For example, many web designers state that it takes
longer to make a decision when presented the option within a large set of options versus a smaller set (attributed
erroneously as Hick’s Law) (Seow 2005, Johnson 2010).
One issue not fully addressed by the guidelines was in navigation, or knowing where one was. A common
example was when the subject was confused between whether he was in edit mode and actually making changes to
the scheduled program, or just viewing the scheduled program.
With respect to improving visual aesthetics and reducing cognitive load, another issue is the development of a
clear hierarchy, so that the most often used functions are the most prominently displayed, such as having the largest
font; less often used or perhaps functions for expert use might be buried but accessible down a level or two.
Both navigation cues and a clear hierarchy would complement the wide and shallow decision tree. These
attributes would help prevent the user from getting lost, and thus develop more confidence about the interface.
The unique challenge of embedded devices such as programmable thermostats is that they are not full-fledged
computers (with all the attention given to human–computer interfaces), but they have more functions than ‘dumb’
14 T. Peffer et al.
Downloaded by [University of California, Berkeley] at 08:32 26 September 2012
controls. As programmable thermostats evolve, we see larger screens and touchscreens, but this study shows that
these do not ensure usability. Compounding the issue is that the number of functions seems to be increasing (an
example of feature creep), which aggravates usability issues.
However, a positive development one author notes is the return of the moving pointer-fixed analogue display as
a more intuitive mode of understanding the difference between the setpoint and current temperature (Peffer 2009).
Thermal comfort is subjective and relative (de Dear and Brager 1998, American Society for Heating Refrigerating
and Air-Conditioning Engineers (ASHRAE) 2004), so an analogue display output suits this purpose; a temperature
setpoint is a discrete number, which suggests a digital input.
The categorisation of thermostat attributes according to each guideline was qualitative and arguably subjective;
a related analysis showed that the combined quantitative measure of time to complete and success rate was a good
proxy for usability of the thermostat per task (Perry et al. 2011). While a usability test and single metric can provide
feedback to manufacturers on existing and prototyped thermostat designs, a new set of guidelines specifically for
residential thermostat interfaces can inform these designs to begin with, as a proactive approach rather than
reactive.
6. Recommendations
Our general recommendations include visibility of available options on the home screen, a wide and shallow
decision tree, navigation cues, clear hierarchy of display, consistency and standards, natural mappings, error
prevention and recovery, and feedback. We recommend that usability testing be part of the design process. More
specific recommendations include the following:
.Include all important and often used actions at the home level; consider no covers or clearly provide
affordances.
.Use a graphic tabular form to view the temperature setpoints for the time of day and day of week.
.When possible, include confirmation prompts (e.g. do you want to save?), or some other means of confirming
when something is edited or changed.
.Use plain English wherever possible (no abbreviations) and standard icons.
.Use clear affordances
For touchscreens, buttons should look like and act like buttons
If required, covers should be clearly marked so they look ‘openable’.
Specific recommendations by Karjalainen include providing a clear way to adjust room temperature and
detailing the type of feedback: there should be an adequate and fast effect on room temperature, and clear and
sufficient feedback to the user after the temperature adjustment. He suggests acceptable default settings and
providing advice on comfortable room temperatures. Finally, he suggests usability testing as part of the design
process, especially including females.
7. Conclusion
While programmable thermostats are theoretically capable of saving 5–15% of energy to supply heating and cooling
for residences, in practice, they save little to no energy due primarily to human factors issues. We reviewed several
design guidelines intended to improve ergonomics and usability from various fields. Many of the guidelines
converged, promoting visibility, feedback, consistency and standards, natural mappings, and recovery from errors.
After conducting a usability study with 31 subjects with five programmable thermostats in a lab setting, we used
the converged guidelines to analyse the usability attributes of the thermostats. We answered several research
questions. Some guidelines seemed more important to task completion than others. Both positive examples and
violations of guidelines were critical to examine with respect to thermostat display usability. Finally, we developed
guidelines to describe some issues not covered by the set of guidelines we used. Several guidelines proved vital to
usability such as visibility of available actions, feedback, and consistency and standards; subjects had the highest
success rate of task completion with the thermostats that embraced these guidelines. Missing guidelines included
navigation cues, clear hierarchy, and wide and shallow decision trees; these are useful in completing desired actions
with confidence and preventing users from getting ‘lost.’
Improving the usability of thermostats must draw upon traditional proven ergonomics principles, with emphasis
on quantitative measurements, detailed specifics on types of suitable controls and analysis in developing a more
Ergonomics 15
Downloaded by [University of California, Berkeley] at 08:32 26 September 2012
holistic and quantifiable approach to design heuristics. As such, we embrace both qualitative proactive approaches,
such as developing specific heuristic guidelines for residential programmable thermostats, as well as quantitative
approaches, such as our previous work in developing usability metrics to provide a single quantitative measure of
usability. At the same time, new techniques are needed to both assess and solve the unique problems related to
embedded controls. We recognise that improving the usability of programmable thermostats may only represent one
step towards facilitating energy savings, but it is a vital one. Finally, we anticipate these heuristic guidelines may be
applied to other devices to facilitate energy savings, such as dishwashers, audio–visual equipment and water heaters.
Acknowledgement
We wish to thank Jessica Granderson, Dhawal Mujumdar, Becky Hurwitz and Margarita Kloss for their contributions.
Note
1. Forced air systems in the US commonly have a fan switch (ON-AUTO), which controls the blower fan inside the house; ON
recirculates air when no heating or cooling is taking place and AUTO allows the system to turn on blower fan as necessary.
The system switch can be as complicated as OFF-HEAT-COOL-AUTO to control which system is running (furnace or air
conditioning) or AUTO whether the system should decide depending on the interior conditions.
References
American Society for Heating Refrigerating and Air-Conditioning Engineers (ASHRAE), 2004. Standard 55-2004: thermal
environmental conditions for human occupancy. Atlanta: American Society for Heating Refrigerating and Air-Conditioning
Engineers Inc.
Bordass, B., Leaman, A., and Bunn, R., 2007. Controls for end users a guide for good design and implementation. Reading,
Berkshire, UK: Building Controls Industry Association.
Combe, N., Harrison, D., Craig, S., and Young, M.S., 2011. An investigation into usability and exclusivity issues of digital
programmable thermostats. Journal of Engineering Design, 23, 401–417.
Cooper, A., Reimann, R., and Cronin, D., 2007. About face 3: the essentials of interaction design. San Francisco: Wiley.
Cross, D. and Judd, D., 1997. Automatic setback thermostats: measure persistence and customer behaviored. In:International
energy program evaluation conference (IEPEC), 27–29 August, Chicago.
Dale, H.C.A. and Crawshaw, C.M., 1983. Ergonomic aspects of heating controls. Building Services Engineering Research and
Technology, 4 (1), 22–25.
De Dear, R.J. and Brager, G.S., 1998. Developing an adaptive model of thermal comfort and preference. ASHRAE Transactions,
104 (1a), 145–167.
Energy Information Administration (EIA), 2005a. Residential energy consumption survey. Detailed tables, 2005 Housing
Characteristics Tables, Space Heating Usage Indicators, Table HC14.5 [online]. Available from: http://www.eia.gov/emeu/
recs/recs2005/hc2005_tables/detailed_tables2005.html [Accessed 20 August 2012].
Energy Information Administration (EIA), 2005b. Residential energy consumption survey. Detailed tables, 2005 Housing
Characteristics Tables, Air-conditioning Usage Indicators, Table HC15.7 [online]. Available from: http://www.eia.gov/emeu/
recs/recs2005/hc2005_tables/detailed_tables2005.html [Accessed 20 August 2012].
Energy Information Administration (EIA), 2005c. Residential energy consumption survey. Detailed tables, 2005 Housing
Characteristics Tables, Space Heating Usage Indicators, Table HC 2.5 [online]. Available from: http://www.eia.gov/emeu/
recs/recs2005/hc2005_tables/detailed_tables2005.html [Accessed 20 August 2012].
Energy Information Administration (EIA), 2010. Total Energy, Annual Energy Review, Table 1.1 primary energy overview,
1949–2009 [online]. Available from: http://www.eia.gov/totalenergy/data/annual/index.cfm [Accessed August 20, 2012].
Foroohar, R., 2011. Driven off the road by M.B.A.s: the rise of business schools coincided with the fall of American industry.
Time, 18 July, p. 22.
Haiad, C., Peterson, J., Reeves, P., and Hirsch, J., 2004. Programmable thermostats installed into residential buildings: predicting
energy savings using occupant behavior & simulation [online]. Southern California Edison. Available from: http://doe2.com/
download/DEER/SEER%2BProgThermostats/SCE%20ProgrammableThermostats%20EEM%202004-Nov-26c.pdf [Ac-
cessed 21 June 2010.
Harris, A.D., 2008. Energystar is examining thermostat approach. Air Conditioning, Heating and Refrigeration News, [online].
Oct 15, 2008, Available from: http://www.achrnews.com/articles/energystar-is-examining-thermostat-approach [Accessed 3
October 2011].
Heglin, H., 1973. NAVSHIPS display illumination design guide. Vol. 2: Human Factors (NELC-TD223). San Diego, CA: Naval
Electronics Laboratory Center.
Johnson, R., 2010. Ten laws to design by [online]. DesignþStrategy. Available from: http://3.7designs.co/blog/2010/07/ten-laws-
to-design-by/ [Accessed 29 May 2012].
Karjalainen, S., 2008. The characteristic of usable room temperature control [online]. Helsinki University of Technology. Available
from: http://lib.tkk.fi/Diss/2008/isbn9789513870607/ [Accessed 21 June 2010].
Karjalainen, S., 2009. Thermal comfort and use of thermostats in Finnish homes and offices. Building and Environment, 44 (6),
1237–1245.
16 T. Peffer et al.
Downloaded by [University of California, Berkeley] at 08:32 26 September 2012
Moore, T.G. and Dartnall, A., 1982. Human factors of a microelectronic product: the central heating timer/programmer. Applied
Ergonomics [online], 13 (1), 15–23. Available from: http://www.sciencedirect.com/science/article/B6V1W-47YN42S-1T1/2/
2f3f837ec75990d73af1ab39b02cca2a [Accessed 7 August 2012].
Nelson, L.W. and Macarthur, J.W., 1978. Energy savings through thermostat setbacks. ASHRAE Transactions, 83 (AL-78-1 (1)),
319–333.
Nevius, M. and Pigg, S., 2000. Programmable thermostats that go berserk: taking a social perspective on space heating in
Wisconsin. In:Proceedings of the 2000 ACEEE summer study on energy efficiency in buildings [online], 8.233-8.244. Available
from: http://72.36.212.11/prod/berserk.pdf.
Nielsen, J., 1994b. Heuristic evaluation. In: J. Nielsen and R.L. Mack, eds. Usability inspection methods [online]. New York: John
Wiley & Sons. Section 2.1. Available from: http://www.useit.com/papers/heuristic/heuristic_list.html [Accessed 20 August
2012].
Nielsen, J. and Molich, R., 1990. Heuristic evaluation of user interfaces. In:CHI’90 conference, 1–5 April.Seattle, WA.
New York: ACM, 249–256.
Norman, D., 2002. The design of everyday things. New York: Basic Books.
Peffer, T., Pritoni, M., Meier, A.K., Aragon, C., and Perry, D., 2011. How people use thermostats: a review. Building and
Environment, 46 (12), 2529–2541.
Peffer, T.E., 2009. California dreaming: the design of residential demand responsive technology with people in mind. Thesis (PhD).
University of California Berkeley. Available from: http://escholarship.org/uc/item/8rk0g6mh [Accessed 24 August 2012].
Perry, D., Aragon, C., Meier, A., Peffer, T., and Pritoni, M., 2011. Making energy savings easier: usability metrics for
thermostats. Journal of Usability Studies, 6 (4), 226–244.
Polson, P.G. and Lewis, C.H., 1990. Theory-based design for easily learned interfaces. Human–Computer Interaction, 5, 191–220.
Pritoni, M., Meier, A., and Perry, D., 2011. Human factors in climate controls for small commercial buildings. Washington, DC:
Institute for Building Efficiency, Johnson Controls, Technology Brief.
Sanders, M.S. and Mccormick, E.J., 1993. Human factors in engineering and design. 7th ed. San Francisco: McGraw-Hill.
Sauer, J., Schmeink, C., and Wastell, D.G., 2007. Feedback quality and environmentally friendly use of domestic central heating
systems. Ergonomics, 50 (6), 795–813.
Sauer, J., Wastell, D.G., and Schmeink, C., 2009. Designing for the home: a comparative study of support aids for central
heating systems. Applied Ergonomics, 40 (2), 165–174.
Seow, S.C., 2005. Information theoretic models of HCI: comparison of the hick-hyman law and fitt’s law. Human–Computer
Interaction, 20 (3), 315–352.
Shneiderman, B., 1988. We can design better user interfaces: a review of human–computer interaction styles. Ergonomics, 31 (5),
699–710.
Shneiderman, B. and Plaisant, C., 2009. Designing the user interface: strategies for effective human–computer interaction, 5th ed.
Reading, MA: Addison Wesley.
U.S. Department of Energy (DOE), 2011a. 2008 residential energy end-use splits by fuel type (quadrillion btu) [online]. Available
from: http://buildingsdatabook.eren.doe.gov/ChapterIntro2.aspx?2#1 [Accessed April 6 2011, Table 2.1.5].
U.S. Department of Energy (DOE), 2011b. Thermostats and control systems [online]. Available from: http://www.energysa-
vers.gov/your_home/space_heating_cooling/index.cfm/mytopic=12720 [Accessed 2 Aug 2011].
Wyon, D.P., 1997. Individual control at each workplace for health, comfort, and productivity. In:Creating the Productive
Workplace Conference, 29–30 October, London.
Ergonomics 17
Downloaded by [University of California, Berkeley] at 08:32 26 September 2012
... Climate and building characteristics alone have been proven to be insufficient as determinants of energy optimization, and the roles of occupants' behaviors and socioeconomic factors have resulted in being important components (Steemers and Yun, 2009;Vale and Vale, 2010), also in terms of energy demand (Haldi and Robinson, 2011). The challenging area of investigation for building performance and evaluation has been focused on human behavior, in order to assess and improve design affordance and provide comprehensive feedback for empowering users' environment control and reduced energy use (Peffer et al., 2013); to develop maintenance and operations as dimensions to be integrated in building performance and postoccupancy evaluations (Stevenson and Leaman, 2010;Monfared and Sharples, 2011), looking at the complete life cycle of the building from initial procurement through build management process to eventual demolition (Preiser and Vischer, 2005); to better address diversities of inhabitants both in energy regulations and standards both in evaluation methods and design strategies, since the relationships between users and buildings changes over time and each situation must be studied and assessed on its own merit (Gupta and Chandiwala, 2010). To reach these goals a better understanding of users' expectations, attitudes, perceptions, and behavior by interrelated human factors directly with the physical performance of the building is required (Stevenson and Leaman, 2010). ...
... In green occupational buildings the main occupants' comfort dissatisfactions have been reported about temperature (Heerwagen and Zagreus, 2005;Leaman and Bordass, 2007), light and noise conditions (Abbaszadeh et al., 2006;Leaman and Bordass, 2007), frequently in association to the open-plan layout of offices, which characteristics have been also considered as factors inducing distractions, interruptions, and lack of concentration negatively influencing occupants working ability (Heerwagen and Zagreus, 2005). Moreover the perception of thermal comfort has often resulted in being linked to the occupants' ability and possibility to control the indoor climate, by the effective use of a manual thermostat (Peffer, 2013), opening windows (Goins, 2013), and controlling solar glare (Nicol and Roaf, 2005;Barlow and Fiala, 2007;Wagner, 2007). Occupants are more comfortable in buildings in which the amount of perceived control over temperature, ventilation, and noise is high (Boerstra et al., 2013).Therefore the question of usability of a building's controls, in terms of easiness of use and feedback, has been reported as crucial (Nicol and Roaf, 2005;Leaman and Bordass, 2007;Hauge et al., 2011). ...
... Especially in homes and in occupational buildings, individuals' behaviors can be assumed as crucial starting data to collect in the sustainable design of building, in order to identify, from those actual behaviors and elements, features and components, how the energy design of a building can be improved. Moreover, user centered principles for design of energy devices are important to increase building and installation usability, considering that the most effective way to improve thermal comfort and satisfaction is by using individual controls (Peffer, 2013). ...
... Although consumers are often advised that a programmable thermostat could bring a range of 10% to 30% reduction to their energy bills [11], unfortunately, the current supporting evidence from simulations [12], emerging studies, surveys, and reviews held a pessimistic view. Pritoni et al. [13] reviewed nine case studies investigating the energy savings of programmable thermostats; it turned out that only one-third of them indicated a small energy savings ratio compared with the manual thermostats, and some even observed an increase in energy consumptions. ...
... Pritoni et al. [13] reviewed nine case studies investigating the energy savings of programmable thermostats; it turned out that only one-third of them indicated a small energy savings ratio compared with the manual thermostats, and some even observed an increase in energy consumptions. Meier et al. [14] and Peffer et al. [12] conducted a comprehensive literature review on programmable thermostat associated complaints and issues, and found that many uncertainties from the design and the installation could contribute to its misuse, e.g., the complicated programming interface, the small buttons, the inaccessible installation location, the poor feedbacks, etc. These misuse behaviors could significantly affect the users' willingness to use the thermostat's programmable feature and thus lower its energy-saving potential as a consequence. ...
Article
Thermostat management plays a significant role in household energy conservation. This study aims to conduct a systematic and comprehensive analysis to quantify the energy savings potential of the occupant-centric smart thermostat based on a large-scale nationwide simulation infrastructure. The single-family Residential Prototype Building Model was used to represent a typical single-family detached house in the U.S. A generalized random occupancy presence schedule was created based on an occupancy probability schedule and k-means clustering algorithm. A total of 16,000 simulations, which were composed of four building foundation types, four heating source types, 40 American cities, five building energy code versions, and five thermostat control strategies, were conducted to evaluate the performances of the smart home thermostat in terms of saving building energy usage and maintaining occupant thermal comfort. The nationwide simulation results suggested that the temperature setback control during the unoccupied period could achieve some energy savings in the U.S. households. However, only very few of the 40 cities could see an annual Heating, Ventilation, and Air-conditioning energy savings ratio of over 30%. Besides, the implementation of the occupied standby temperature reset could greatly increase the peak load of the HVAC system and contribute to the grid load imbalance issue. It’s also worth noting that the smart recovery feature is proved to be able to bring additional benefits for a smart home thermostat. It could decrease the temperature setpoint not met time by about 30 min, and relieve the thermal discomfort due to the temperature setback control.
... Thus, changing user behavior through real-time feedback, historical feedback, financial information, social influences, gamification, and goal-setting strategies can decrease energy consumption by 18% [20]. However, to succeed in those reductions, it is relevant to focus on the end-users' behavior and usability problems, for instance, when using a thermostat [14,[21][22][23][24][25][26]. Hence, Ponce et al. [14,27] classified the householders based on their personality traits Ponce et al. [14,27,28], SG user [14,[29][30][31], and energy endhttps://doi.org/10.1016/j.enbuild.2022.112026 ...
Article
The residential Heating Ventilation and Air-Conditioning (HVAC) system use around 3/5 of the total energy consumption. Connected thermostats optimize the HVAC operation; however, householders have personality traits that lead into behavioral and usability problems toward the thermostat’s interface usage. Thus, a serious game applied in the thermostat interface can balance entertainment and education. Therefore, thermostat interfaces must address strategies that reduce energy without losing thermal comfort. This paper proposed an interactive interface type and a predicted interface type based on an HVAC strategy and a Natural Ventilation strategy. These strategies measured the impact of adaptive thermal comfort, energy consumption, and costs. Hence, twelve energy models located in California (Concord, Riverside, Los Angeles, and San Diego) were simulated using EnergyPlusTM through LadybugTools. The first interactive interface included Serious Game elements, so the householder interacted with the date, location, and setpoint. The second interface predicted the energy consumption and thermal comfort during winter and summer in Concord by a two-layer feed-forward Artificial Neural Network structure. The proposed structure decreases the energy consumption by at least 62% without losing thermal comfort.
... Research suggests that the usability of thermostats, in general, has been a long-standing issue for realizing the possible levels of energy efficiency (Hargreaves et al. 2018;Peffer et al. 2013). Earlier studies of smart thermostats (e.g., de Oliveira et al. 2015;Hargreaves et al. 2018;Ponce et al. 2017) expressed concerns regarding the usability of the devices for the "average" user. ...
Article
Rental properties make up approximately 37% of the US residential building stock and are responsible for 23% of the total energy consumption in this sector. Although this market has great potential for energy efficiency, the implementation of energy savings measures in this market faces numerous challenges. In particular, one of the main challenges cited is the split incentive, limiting the potential motivation of rental property owners and tenants to invest in energy-efficient technologies. Smart thermostats have gained substantial interest and adoption in the past decade and have been the subject of numerous studies. However, their adoption and use in the context of the rental housing market has not been considered. In this study, reviews posted on an online retailer's website (Amazon) were used as an unstructured source of information to evaluate the attitudes of landlords and tenants toward smart thermostats. In total, 31,790 reviews were collected for 14 commercially available smart thermostats; from these, 173 reviews were identified as directly associated with rental units. These selected reviews were then analyzed and categorized based on the unique opportunities and challenges that were expressed. The majority of reviewers focused on usability aspects and expressed an interest in the advanced remote-control functions of their purchased devices. Furthermore, our findings indicated that occupancy pattern learning capabilities were not of particular interest among this user group. These findings can inform product manufacturers and policy makers in their future interactions with stakeholders in the rental housing market and potentially increase adoption and hence energy efficiency.
... Perceived ease of access to building control features considers physical drivers of access to environmental control features, such as lights, windows, and thermostats. Building physical factors include proximity to control features [26], difficulty in operating the features [45,46], system responsiveness [47], etc. Improving occupant control over building features can enhance energy-saving attempts, such as by adjusting HVAC system more efficiently [48,49], utilizing natural ventilation and lighting [50,51], and turning appliances off when not in use [52]. ...
Article
Full-text available
Developing and maintaining efficient energy-saving behaviors in the workplace is an important factor in reducing energy consumption and greenhouse gas emissions. Building on integrated theories, including a recently developed theoretical approach to studying the dynamics of social norms and decision-making, the theory of planned behavior, the norm activation model, and the motivation-opportunity-ability model, this study analyzes the influence of normative values, office design, and perceived benefits and costs on energy-saving behaviors in different office settings. Based on a survey from 555 U.S. employees, this study found that occupants in single-person offices were influenced by a combination of descriptive, injunctive, and personal norms, while those in shared offices tended to align their actions with injunctive norms and ascription of responsibility. Descriptive norms had a stronger effect on energy-saving behaviors in single-person offices than in shared offices. Ascription of responsibility, however, had a stronger effect on energy-saving behaviors in shared offices. The perceived ease of access to building control features significantly influenced energy-saving behaviors of shared-office occupants only. Time availability had no significant effect on energy-saving behaviors of occupants in both single-person and shared offices. This study provides policy recommendations for building architects, engineers, managers, and policymakers to enhance energy-saving behaviors.
... Installation of connected thermostats can reduce energy consumption up to 35% of the peak load and raise overall energy efficiency by 5% through small changes in behavior [3]. Although it is possible to achieve such reductions by interactions between the end-user and the connected thermostat, successful reduction infrequently occurs because users do not entirely accept the connected device, leading to insufficient energy behavior [5][6][7][8][9][10][11][12][13]. ...
Chapter
The most effective strategy for homes to save energy is by decreasing their electricity consumption. Home Energy Management Systems connect appliances that improve households' energy performance to thermal comfort. These systems need to take into account human behavior regarding saving energy and thermal comfort. This paper proposes a three-step framework that integrates the Smart Residential Load Simulator (SRLS), Adaptive-Network based on Fuzzy Inference System (ANFIS), and a gamification structure to develop an interface designed to reduce energy consumption without losing thermal comfort. Finally, a gamified mock-up for mobile devices is displayed for a household with high energy consumption levels and a temperature setpoint of 23°C. This proposal integrates the concept of social products to empower the interaction between devices and end-users.
... Thermostat usage and setpoint choices are often used in the literature to reflect occupants' thermal preferences (Kim et al., 2018;Wyon and Ridenour, 2018). Although many factors can influence occupant-thermostat interaction and may reduce the validity of this approach (Peffer et al., 2013;Wagner et al., 2018), it nonetheless provides a suitable approximation in the absence of thermal sensation ratings. One can infer the set of acceptable temperatures in a household as the range of temperatures that were experienced in the dwelling while occupants were present and the HVAC system was not running. ...
Article
In the context of increasing renewable energy penetration in energy systems, demand response is acknowledged as a solution to guarantee grid stability and security of supply. Direct control of appliances by utilities, however, may lead to user dissatisfaction and disengagement via overrides. The present study, based on data from 6,389 connected thermostats in North America in the summer of 2019, investigates users' thermostat overriding behavior during demand response events targeting their air conditioners. An average event in this dataset was triggered around 3 p.m. and lasted three hours. The overall override rate was 12.9%. Overrides critically affected power usage during an event, with the share of the expected power demand reduction missed due to overrides being of the same order of magnitude as the override rate. In a decision tree analysis, the override rate showed to be particularly affected by occupants' habitual setpoint change frequency, outdoor temperature, event duration, and occupants’ previous experience with demand response. Even though the dataset is not representative of all types of demand response events, this study highlights the potential lying in connected thermostat data for utilities to design tailored demand response events with an increased success rate and a smaller impact on occupant comfort.
Article
Smart plugs are attracting attention as smart devices that enable energy savings by providing functions such as standby power cut-off, energy usage monitoring, and remote power control. The majority of research on smart plugs has applied a technology-focused approach to improve efficiency and performance, but a user-centered approach is also required. Regardless of the method used to apply advanced technologies, energy savings cannot be expected if users are reluctant to use smart plugs owing to difficulties in use. Therefore, it is essential to improve the usability of smart plugs through the application of user-friendly design to promote energy-saving behaviors. This study aims to suggest methods to improve the usability by facilitating affordance perception and actualization of smart plugs. To achieve this, we first examined the concept of affordance and presented the role of informational and physical elements in perceiving and actualizing affordances. Thereafter, we constructed a checklist for facilitating affordance perception and actualization of smart plugs after reviewing several guidelines and design principles for usability improvement. Subsequently, we conducted in-depth interviews with 26 smart plug users to explore user experience (UX) for the checklist items. Finally, based on the interview results, we suggested a design direction for smart plugs that facilitates the perception and actualization of affordances.
Article
Residential thermostats were originally very simple devices. Any energy saving practices, such as nighttime setbacks, were entirely dependent on the occupants and required diligent setpoint adjustment. Programmable thermostats were endorsed by Energy Star in the 1990s, but later studies showed they failed to realize expected savings due to a lack of usability. New, ‘smart’ thermostats promise to address the downfalls, while offering increasingly complex features. This study examines the relationship between thermostat usability and interface characteristics in Ottawa, Canada, with a focus on devices currently installed in homes. To compare manual, programmable, and smart interfaces, human computer interaction methods, including participant interviews and think-aloud analysis, were employed. A sample of 51 participants were interviewed in their homes and attempted six usability tasks on their thermostat interface(s). Interviews were recorded and each thermostat type (manual, programmable and smart) was evaluated based on the time to complete, required interactions and qualitative observations. An averaged time and success usability metric was assigned to each category and contrasted with previous literature. In general, smart thermostats were found to be significantly more useable than their programmable counterparts. Participants expressed a desire for more feedback regarding energy consumption and half (51%) noted they either wanted or enjoyed thermostat control through a smartphone application.
Article
Full-text available
Purpose This article provides an in-depth understanding of customer experience with smart services, examines customer perceptual responses to smart and connected service environments and enriches this understanding by outlining how contextual factors (in terms of goals, activities, actors and artifacts) influence the customer experience. Design/methodology/approach This study adopts a qualitative approach in order to understand customer experience in the smart energy service setting. Semi-structured interviews and focus groups were conducted with 31 participants forming three groups of energy service customers: advanced smart energy (ASE) customers, electric mobility (EM) customers and high-consumption (HC) customers. Findings The findings show that customer experience with smart services involves a multidimensional set of perceptual responses, comprising specific smart service dimensions (e.g. controllability, visibility, autonomy); relationship dimensions (relationships with the service provider and with the community); and traditional technology-enabled service dimensions (e.g. ease of use, accessibility). The analysis of contextual factors such as goals, activities, actors and artifacts shows that smart services enable a more autonomous experience, wherein customers can integrate a myriad of actors and artifacts and expect the main service provider to support them in taking the lead. Originality/value Smart technologies have profoundly changed the service environment, but research on customer experience with smart services is scarce. This study characterizes smart services, provides an in-depth understanding of customer experience in this new context, and discusses relevant implications for management and service research.
Article
Full-text available
U.S. residential thermostats control approximately 9% of the nation's energy use. Many building codes now require programmable thermostats (PTs) because of their assumed energy savings. However, several recent field studies have shown no significant savings or even higher energy use in households using PTs compared to those using non-PTs. These studies point to usability problems that lead to incorrect use and wasted energy. However, the lack of clear, consistent metrics has hampered the acceptance of usability concerns by thermostat manufacturers. Thus there is a need for metrics specific to PTs that manufacturers can use to evaluate their products. In this paper, we report on the results of a usability study conducted on five commercially available PTs and the development of four new metrics suitable for use in evaluating thermostat usability. Our study confirmed usability deficits in the current generation of PTs and showed the metrics are correlated with each other as well as agreeing with the qualitative results of the study.
Technical Report
Full-text available
The adaptive hypothesis predicts that contextual factors and past thermal history modify building occupants' thermal expectations and preferences. One of the predictions of the adaptive hypothesis is that people in warm climate zones prefer warmer indoor temperatures than people living in cold climate zones. This is contrary to the static assumptions underlying the current ASHRAE comfort standard 55-92. To examine the adaptive hypothesis and its implications for Standard 55-92, the ASHRAE RP-884 project assembled a quality-controlled database from thermal comfort field experiments worldwide (circa 21,000 observations from 160 buildings). Our statistical analysis examined the semantics of thermal comfort in terms of thermal sensation, acceptability, and preference, as a function of both indoor and outdoor temperature. Optimum indoor temperatures tracked both prevailing indoor and outdoor temperatures, as predicted by the adaptive hypothesis. The static predicted mean vote (PMV) model was shown to be partially adaptive by accounting for behavioral adjustments, and fully explained adaptation occurring in HVAC buildings. Occupants in naturally ventilated buildings were tolerant of a significantly wider range of temperatures, explained by a combination of both behavioral adjustment and psychological adaptation. These results formed the basis of a proposal for a variable indoor temperature standard.
Article
Full-text available
Electrical utilities worldwide are exploring "demand response" programs to reduce electricity consumption during peak periods. Californian electrical utilities would like to pass the higher cost of peak demand to customers to offset costs, increase reliability, and reduce peak consumption. Variable pricing strategies require technology to communicate a dynamic price to customers and respond to that price. However, evidence from thermostat and energy display studies as well as research regarding energy-saving behaviors suggests that devices cannot effect residential demand response without the sanction and participation of people. This study developed several technologies to promote or enable residential demand response. First, along with a team of students and professors, I designed and tested the Demand Response Electrical Appliance Manager (DREAM). This wireless network of sensors, actuators, and controller with a user interface provides information to intelligently control a residential heating and cooling system and to inform people of their energy usage. We tested the system with computer simulation and in the laboratory and field. Secondly, as part of my contribution to the team, I evaluated machine-learning to predict a person's seasonal temperature preferences by analyzing existing data from office workers. The third part of the research involved developing an algorithm that generated temperature setpoints based on outdoor temperature. My study compared the simulated energy use using these setpoints to that using the setpoints of a programmable thermostat. Finally, I developed and tested a user interface for a thermostat and in-home energy display. This research tested the effects of both energy versus price information and the context of sponsorship on the behavior of subjects. I also surveyed subjects on the usefulness of various displays. The wireless network succeeded in providing detailed data to enable an intelligent controller and provide feedback to the users. The learning algorithm showed mixed results. The adaptive temperature setpoints saved energy in both annual and summertime simulations. The context in which I introduced the DREAM interface affected behavior, but the type of information displayed did not. The subjects responded that appliance-level feedback and tools that provided choices would be useful in a dynamic tariff environment.
Article
Overview of Energy Production and Consumption Energy can be defined as primary energy or secondary energy depending on the intensity of use and type of fuel source. Primary energy includes forms obtained from four types of conventional energy resources: (1) crude oil and natural gas; (2) coal; (3) nuclear energy (from fission of radioactive elements); and (4) hydropower.
Article
This paper describes the results related to space heating and thermostat use from a study of owner-occupied, single-family residential housing in Wisconsin conducted by the Energy Center of Wisconsin in 1999. We find that the average self-reported winter thermostat setting does not vary substantially by type of thermostat used, is predictive of heating energy intensity in a way that is consistent with expectations, and appears to be a good indicator of actual thermostat-setting behavior, assuming that the goal is to compare the behavior of households rather than to gather an accurate report of their actual thermostat settings. We also find that attitude toward energy conservation appears to have an indirect effect on household heating energy intensity by way of thermostat-setting behavior. The results offer further evidence in support of including social and behavioral variables in traditional engineering-based studies.