ArticlePDF Available

A tool for rapid assessment of product usability and universal design: Development and preliminary psychometric testing

Authors:
  • National Institute for Occupational Safety and Health, Center for Disease Control,

Abstract and Figures

While there are many available tools and methods to evaluate product usability, few have been tested on user groups with disabilities and even fewer systematically consider universal design principles. This paper describes the development and preliminary psychometric testing of the Rapid Assessment of Product Usability & Universal Design (RAPUUD), a 12-item user-report tool based on the seven principles of universal design. A preliminary set of items was created to elicit ratings of diverse product characteristics (e.g., physical effort, cognitive effort, assistance required, safety). Data were gathered from 61 participants who rated the usability of products they use in their own environments. Each item elicited a full range of responses, with no apparent floor or ceiling effects. Collectively, the 12 items achieved a high internal consistency (Cronbach's α=0.80). The data indicate that the tool was sensitive to differences in functional abilities, as well as differences in product characteristics. The instrument was usable for a range of consumer products, though not all items were appropriate for each and every product. The results suggest that the instrument could become a pragmatic tool for designers to identify usability problems experienced by a diversity of user populations.
Content may be subject to copyright.
Work 39 (2011) 141–150 141
DOI 10.3233/WOR-2011-1160
IOS Press
A tool for rapid assessment of product
usability and universal design: Development
and preliminary psychometric testing
James A. Lenkera,, Mahiyar Nasarwanjib, Victor Paquetband David Feathersc
aDepartment of Rehabilitation Science, School of Public Health & Health Professions, University at Buffalo,
Buffalo, NY, USA
bDepartment of Industrial & Systems Engineering, School of Engineering and Applied Sciences, University at
Buffalo, Buffalo, NY, USA
cDepartment of Design and Environmental Access, College of Human Ecology, Cornell University, Ithaca, NY, USA
Received 30 October 2009
Accepted 19 December 2009
Abstract.Background: While there are many available tools and methods to evaluate product usability, few have been tested on
user groups with disabilities and even fewer systematically consider universal design principles.
Objective: This paper describes the development and preliminary psychometric testing of the Rapid Assessment of Product
Usability & Universal Design (RAPUUD), a 12-item user-report tool based on the seven principles of universal design.
Method: A preliminary set of items was created to elicit ratings of diverse product characteristics (e.g., physical effort, cognitive
effort, assistance required, safety). Data were gathered from 61 participants who rated the usability of products they use in their
own environments.
Results: Each item elicited a full range of responses, with no apparent oor or ceiling effects. Collectively, the 12 items achieved
a high internal consistency (Cronbach’s α=0.80). The data indicate that the tool was sensitive to differences in functional
abilities, as well as differences in product characteristics. The instrument was usable for a range of consumer products, though
not all items were appropriate for each and every product.
Conclusion: The results suggest that the instrument could become a pragmatic tool for designers to identify usability problems
experienced by a diversity of user populations.
Keywords: Universal design, usability, consumer products, measurement, special populations, disability
1. Introduction
The prevalence of disability is expected to increase
as the U.S. population ages. Although nearly 75% of
those over age 75 have a functionallimitation affecting
their ability to use products [12], product designers
Address for correspondence: Jim Lenker, 515 Kimball Tower,
3435 Main Street, University at Buffalo, Buffalo, NY 14214, USA.
Tel.: +1 716 829 6726; Fax: +1 716 829 3217; E-mail: lenker@
buffalo.edu.
do not routinely consider the impacts of disability and
aging on the usability of their products [18,23]. Older
adults and wheelchair users report numerous usability
challenges with products in their kitchens, bathrooms,
and home ofces [15,16]. Thus, there is a need to
improve the usability of the products that are being
created and sold in the marketplace.
Universal design (UD) is one approach that has been
proposed to address this need. It has been dened as,
...an approach to design that incorporates products as
well as building features which, to the greatest extent
feasible, can be used by everyone”[17]. Its seven prin-
1051-9815/11/$27.50 2011 – IOS Press and the authors. All rights reserved
142 J.A. Lenker et al. / A tool for rapid assessment of product usability and universal design
ciples [5] and overarching philosophy have been en-
thusiastically received by academics and advocates in
the rehabilitation technology and environmental design
communities. Accessibility considerations are relevant
at each step in the product development process, includ-
ing conceptualization, design, evaluation, and manu-
facture [9]. Universal design is intended to improve the
lives of people with disabilities by providing guidelines
for product developers [4].
Unfortunately, current UD resources are insufcient
to meet the needs of product designers and develop-
ers. Law et al. [14] reviewed eight UD and accessi-
bility resources and identied ve common problems:
(a) UD resources do not consistently dene their tar-
get audience or its needs; (b) the terminology used for
accessible and universal design is imprecise; (c) there
are no accepted standards for measurement and com-
pliance; (d) standards and guidelines are not enforce-
able because of their ambiguity; and (e) the usability
of the UD resources is compromised. In effect, most
UD resources are not made to support the cognitive
processes of designers [3]. These shortcomings cre-
ate confusion, frustration, and misinterpretation among
product developers who are attempting to implement
such guidelines. Thus, the UD philosophy is perceived
by product developers as a special interest that slows
down the time-to-market and increases costs [11,18,
23].
One approach for achieving more inclusive designs
is disability simulation. Disability simulation is a dis-
count method for evaluating the usability aws in a
product [12]. The tests are inexpensive and easy to im-
plement. They are not intended to replicate the expe-
rience of living with a disability, but may help identify
difculties that those with disabilities experience when
using products. Although many descriptions of simula-
tion tests have appeared in the literature, there has been
only one published validation study, involving partici-
pants who were college students [13]. Therefore, the
effectiveness of this method remains unproven.
Another option is for product developers to conduct
usability tests using older adults and people with dis-
abilities [6]. While this approach yields valuable in-
formation, it can become time intensive and nancially
expensive. While there are many available tools and
methods to evaluate usability, few have been tested on
user groups with disabilities and even fewer system-
atically consider universal design principles [2,24,25].
Collectively, these factors are a disincentive for design-
ers who might otherwise embrace the universal design
philosophy [11,18]. There remains a clear need for
efcient usability testing methods that support those
who want to consider UD principles in their product
designs.
This paper describes the development and prelimi-
nary testing of the Rapid Assessment of Product Us-
ability & Universal Design (RAPUUD), a 1 2-item user-
report tool based on the seven principles of universal
design. The goal was to create a succinct, psychometri-
cally sound tool that (a) embodies traditional usability
principles, as well as UD principles, (b)lends itself to a
continuum of consumer products, (c) is amenable to a
diversity of user populations, including older adults and
persons with disability, (d) differentiates products hav-
ing different usability strengths and weaknesses, and
(e) reveals product features requiring re-design.
2. Method
2.1. Study design
The validity of product usability research conducted
in controlled laboratory settings is often threatened by
several factors: (a) the product types and models being
tested are typically identied by the investigator and
may have little relevance and meaning for some par-
ticipants; (b) products are often tested using contrived
tasks chosen by the investigator to exemplify ‘typical
product usage’, which may or may not reect the task
cycles that participants enact in their daily lives; (c)
products are tested in settings that are unfamiliar to
participants and lack the affordances present in partici-
pants’ everyday environments; and (d) participants are
asked to provide usability ratings based on a relatively
short interval of product exposure. To circumvent these
potential threats to validity, the current study employed
a cross-sectional design in which participants provid-
ed one-time usability ratings on products that they had
been using regularly in their everyday living environ-
ments. These ratings were gathered during nine focus
groups that were conducted for a related study.
2.2. Participants
It was hoped that the RAPUUD could distin-
guish persons having demonstrable impairments from
those having no ostensible limitations. Thus, par-
ticipants were sought from four demographic groups:
healthy young adults, adults with vision impairment,
wheelchair users, and older adults. The young adult
group was chosen as a control group. The vision im-
J.A. Lenker et al. / A tool for rapid assessment of product usability and universal design 143
pairment and wheelchair user groups were chosen be-
cause they are among the largest groups having sensory
limitations and physical disabilities. The older adults
group was chosen because it was hoped that the RA-
PUUD would be responsive to the declines in phys-
ical, sensory, and cognitive function that are natural
components of the aging process.
A convenience sample of each was recruited using
yers distributed to multiple locations, including: uni-
versity programs in occupational therapy and human
factors engineering, two ofces of state vocational reha-
bilitation, a university-based assistive technology cen-
ter, an assisted living facility, and two senior centers.
Participants received a $50 honorarium in consideration
of their time, which involved participation in a three-
hour focus group, during which data for the current
study were also collected.
The recruitment methods and experimental proce-
dures were approved by the University at Buffalo’s
Social and Behavioral Sciences Institutional Review
Board. Informed consent was obtained from all partic-
ipants.
2.3. Instrument
The tool was developed by a four-person team of
experts, all having doctoral preparation in human fac-
tors engineering. One team member is also a licensed
occupational therapist, and another has a background
in anthropology. Collectively, the team has extensive
experience conducting research involving persons with
disabilities.
2.3.1. Item development and response scaling
Item creation was based on the Principles of Uni-
versal Design [5], factors identied in a related study
by Beecher and Paquet [2], usability heuristics from
the human factors literature [19], and the clinical and
research experiences of the co-authors. The goal was
to produce a parsimonious appraisal of usability that
captures product usability characteristics (e.g., physi-
cal effort, cognitive effort, visible information, safety)
and elements of the task cycle (e.g., set-up, ease of use,
clean-up and storage). The team followed principles
of survey development suggested by DeVellis [7] and
Fink [8].
For six items, the usability term was worded in a
negative sense (e.g., poses a safety risk,draws unwant-
ed attention). This was done for two reasons. First,
surveys having a preponderance of positively worded
items can convey the false impression that the survey-
or is interested in receiving only positive feedback [7].
In addition, a mix of negatively and positively word-
ed items can also help researchers identify respondents
who provide categorically positive or negative respons-
es.
The team considered a range of response options
(e.g., visual analog, semantic differential, categorical),
ultimately settling on 5-point Likert scale of endorse-
ment (e.g., strongly agree, somewhat agree, etc.) in
order to lessen respondent burden and enhance reliabil-
ity. The response options also included a “not applica-
ble” choice, since it was anticipated that not all items
would be relevant for all products. The preliminary
item set was iteratively rened and informally pilot test-
ed within the development group. Ultimately, the team
arrived at a 12-item version of the Rapid Assessment
of Product Usability and Universal Design (RAPUUD;
see Fig. 1). The content validity of RAPUUD was
assessed by comparing the instrument’s items to three
other tools intended to aid the usability or universal
design of consumer products [2,5,19].
2.4. Procedure
Each focus group included participants representing
one of the target demographic groups. One moderator
and one observer were present for each group. Within
each group, the moderator used a four-step procedure
to facilitate an ordered discussion of products used in
the kitchen, home ofce and bathroom environments:
(1) The participants were asked to list the three prod-
ucts that were most challenging for them in the
environment being discussed;
(2) Participants independently completed the RA-
PUUD tool for the product in that environment
that was most challenging for them to use. The
moderator and observer were available as need-
ed to answer participant questions regarding the
meaning of individual items and response op-
tions;
(3) The focus group discussion commenced, empha-
sizing the most frequently identied products;
(4) Participants were asked to provide comments re-
garding products that had not been covered dur-
ing the main discussion.
The analysis discussed in this paper reects the us-
ability data collected during Step 2 of the above proce-
dure. Each participant was asked to rate the usability
of three products (one each for the kitchen, home of-
ce, bathroom environments) that were challenging to
144 J.A. Lenker et al. / A tool for rapid assessment of product usability and universal design
Fig. 1. Rapid assessment of product usability and universal design (RAPUUD).
J.A. Lenker et al. / A tool for rapid assessment of product usability and universal design 145
use in everyday routines at home. The self-selection of
products was a deliberate choice intended to minimize
the potentially biasing inuence of investigator-chosen
products and task cycles.
2.5. Analysis
A number of psychometric and administrative prop-
erties of the tool were evaluated, including: (a) content
validity, (b) item acceptability, (c) completion time, (d)
internal consistency, (e) the measurement model, in-
cluding item dispersion and missing data, (f) ability to
distinguish user populations, and (g) ability to distin-
guish product types. These reect conventional cri-
teria for evaluating measurement tools [1,10,21]. To
facilitate statistical analysis, the ordinal scale response
for each item was numerically coded on a 1-to-5 scale,
with higher values denoting ‘better’ usability than low-
er values. For the positively worded items (i.e., #1–
3, 7, 9, and 10), “strongly disagree” was assigned a
value of 1, and “strongly agree” assigned a value of
5. For the six negatively worded items (i.e., 4–6, 8,
11, 12), “strongly disagree” was assigned a value of
5, and “strongly disagree” assigned a value of 1. The
internal consistency of the tool was evaluated using the
Cronbach’s αstatistic. Differences among user groups
were evaluated using Kruskal-Wallis non-parametric
analysis of variance. Post-hoc multiple comparison
tests were performed to determine between-group dif-
ferences once statistical signicance across all groups
was found. Readability statistics were calculated us-
ing a standard utility within Microsoft Word 2007 (Mi-
crosoft Corp., 2009). All other statistical analyses were
completed using Minitab, v. 15.1.3.
3. Results
A total of 61 adults were recruited, representing four
demographic groups: young adults (n=17), older
adults (n=22), persons with vision impairment (n=
12) and wheelchair users (n=10). Participant de-
mographics (sex, age, and self-reported impairments)
are summarized in Table 1. All participants rated three
products, with two exceptions. One participant rated
all items “not applicable” for all three products, and
one participant submitted a blank rating form for the
home ofce product. Thus, usable data were obtained
on 179 products.
3.1. Content validity
An instrument is considered to have content validity
to the extent that its items represent the construct be-
ing measured [20,22]. Table 2 compares the RAPUUD
items to the principles articulated in three related con-
ceptual frameworks: the Principles of Universal De-
sign [5], Nielsen’s usability heuristics [19], and factors
identied by Beecher and Paquet [2]. The RAPUUD’s
items appear to embody the core concepts articulated in
all three frameworks. In terms of clarity, the RAPUUD
items are succinct (9.5 words per item), worded in the
active voice (0 passive sentences), and written using
plain language (4.5 characters per word; reading grade
level =6.1).
3.2. Item acceptability and completion time
Most participants completed the tool independently
in 3 to 5 minutes. Participants occasionally requested
clarication about the intent of individual items, most
frequently item # 7 (I get the information I need to use
the product efciently).
3.3. Internal consistency
Collectively, the RAPUUD items achieved high in-
ternal consistency (Cronbach’s α=0.80), which is
well within the 0.70–0.90 range that is considered ac-
ceptable [22].
3.4. Measurement model
All 12 items elicited a full range of responses, with
no apparent oor or ceiling effects. Figure 2 depicts
the dispersion of responses for items 2, 3, 4, and 12.
Several items elicited greater than 10% Not Applicable
responses, including: set-up,clean-up and storage,in-
formation,safety,draws unwanted attention,andem-
barrassment. These responses are somewhat explained
by the products being rated. Several product types (e.g.,
kitchen cabinets, desks, ling cabinets, grab bars) are
typically anchored to one location and have no asso-
ciated set-up or clean-up tasks. Many of these same
products do not have written information or pictorial
icons, in which case labeling information is also irrel-
evant as a usability consideration. Given that partici-
pants rated consumer products that they were regularly
using at home, it is unsurprising that many participants
indicated that embarrassment and unwanted attention
were not applicable to their product rating.
146 J.A. Lenker et al. / A tool for rapid assessment of product usability and universal design
Tab le 1
Participant demographics
Demographic Gender Self-reported impairments (n) Mean age
group (Males / Females) Vision Hearing Physical (Years, SD)
Young adults 7 / 10 4 0 1 26.7 (3.8)
Older adults 5 / 17 10 5 8 73.4 (5.9)
Wheelchair users 5 / 5 2 0 10 48.3 (9.9)
Visually impaired 7 / 5 12 0 4 48.4 (10.4)
Tab le 2
Comparison of RAPUUD items to related conceptual frameworks
RAPUUD, v.1 7 Principles of universal design Nielsen [19] Beecher and Paquet [2]
Set-up Size and space for approach and use. Reach and access for use
Ease of use Simple and intuitive use Flexibility and efciency of use. Adaptability to user pace
Clean up & storage
Safety Tolerance for error Secure, safe and private use
Tolerance for error.
Assistance Flexibility in use User control & freedom
Flexibility and efciency of use
Flexibility in use
Mistakes and errors Tolerance for error Error prevention Tolerance for error
Information Perceptible information Visibility of system status
Help users recognize, diagnose, and
recover from errors.
Help and documentation
Perceptible information
Time Flexibility and efciency of use.
Physical effort Flexibility in use
Low physical effort
Low physical effort
Size for use
Mental effort Simple and intuitive use Match between system & real world.
Consistency and standards;
Recognition rather than recall;
Intuitive use
Simple use
Unwanted attention Equitable use Esthetic and minimalist design Equitable use
Secure, safe and private use
Embarrassment Equitable use Esthetic and minimalist design Equitable use
3.5. Ability to distinguish user populations
Among the four participant groups, RAPUUD scores
were compared in order to assess the tool’s ability to
distinguish differences in usability that reect user abil-
ities and limitations, irrespective of product. Figure 3
summarizes the median scores on each of the RAPU-
UD’s 12 items for the four participant groups. The
shaded area of each polar graph is indicative of over-
all product usability. Thus, the smaller shaded areas
for the wheelchair user and vision impairment groups
indicate diminished usability for the assorted products
rated by each of these groups.
Closer inspection reveals that individual items were
also sensitive to group differences (Fig. 4). For item
#5 (need for assistance) wheelchair users reported sig-
nicantly lower scores then the young and older adults
groups. For item #9 (physical effort) wheelchair users
reported signicantly lower (p<0.001) scores than
the other three groups. These ndings would seem
to reect impairments in physical capacity that affect
product usability. For item #10 (mental effort), the
vision impairment group reported signicantly lower
scores than older adults (p=0.002) and young adults
(p=0.018). The latter perhaps reects the increased
demands on memory, spatial awareness, and concen-
tration that are needed to compensate for diminished
visual capacity. The ratings for item #2 (ease of use)
were signicantly lower for the vision impairment and
wheelchair user groups than for young adults (p<
0.001). Again, this suggests that substantial physical
or sensory impairments can cause diminished product
usability. The scores for item #8 (takes more time than
it should) were equivalently low across the four groups,
suggesting that this factor is common to sub-optimal
product usability.
3.6. Ability to distinguish product types
Although participants were free to rate products of
their own choosing, a number of them rated products
that could be grouped into common product types (e.g.,
J.A. Lenker et al. / A tool for rapid assessment of product usability and universal design 147
Fig. 2. Dispersion of responses for four RAPUUD items.
can openers, microwave ovens, ling cabinets, medi-
cation bottles). The four most frequently rated product
types were: cabinets, showers/tubs, stoves/ovens, and
computers/laptops. For each product type, the RAPU-
UD data were aggregated. Items having high (median
score 4) and low (median score 2) usability ratings
were identied in order to evaluate the RAPUUD’s sen-
sitivity to different product types. As summarized in
Table 3, the RAPUUD scores appear to vary in accord
with the demands of contrasting product types. For ex-
ample, cabinets received low ratings (i.e., lower scores)
for the required physical effort, safety, and amount of
assistance required, which is consistent with anecdotal
comments made during the focus groups. In contrast,
laptop and desktop computers received high ratings in
the same three areas, which is consistent with the low
physical demands and risks inherent in these products.
Stoves/ovens and computers/laptops received low rat-
ings for mental effort and mistakes & errors, which
is in accord with the high cognitive demands experi-
enced by everyday users of these products. Stove/oven
and shower/tub products received low ratings for safe-
ty, which is consistent with risks that are commonly
acknowledged for these product types.
4. Discussion
The promising ndings suggest that the RAPUUD
could become a pragmatic, informative tool for re-
searchers and designers. The data indicate that the tool
was sensitive to differences in functional abilities of
respondents, as well as differences in characteristics
of product usability. The instrument was usable for a
range of consumer products, though, as expected, not
all items were appropriate for each and every product.
There were four principal limitations to this study:
1. Assessment of content validity did not include
review by outside experts, which may have re-
sulted in differences among the 12 items and
response options. Nonetheless, the tool clearly
148 J.A. Lenker et al. / A tool for rapid assessment of product usability and universal design
Fig. 3. Median item ratings across the four participant groups.
Fig. 4. Median item scores for each item and group (indicates signicant differences between groups at α=0.05).
J.A. Lenker et al. / A tool for rapid assessment of product usability and universal design 149
Tab le 3
Low- and high-rated RAPUUD items across different product types
Product type Most problematic usability areas
(RAPUUD items with median scores 2)
Least problematic usability areas
(RAPUUD items with median scores 4)
Cabinets
(n=22)
Assistance
Mistakes & errors
Physical effort
Safety
Set-up
Time
Embarrassment
Mental Effort
Shower & tub
(n=19)
Ease of use
Safety
Set-up
Time
Assistance
Information
Stove & oven
(n=14)
Mental effort
Mistakes & errors
Safety
Embarrassment
Set-up
Computers & laptop
(n=12)
Mental effort
Mistakes & errors
Set-up
Time
Assistance
Embarrassment
Physical effort
Safety
embodies traditional usability heuristics and the
principles of universal design.
2. The test-retest reliability of the RAPUUD was
not evaluated. The circumstances of data col-
lection made it infeasible to collect a second set
of usability ratings from each participant. Al-
though it is sometimes suggested that evaluation
of reliability should precede evaluation of va-
lidity, the order is not essential as long as both
properties are ultimately demonstrated [10].
3. The small sample size for each of the four par-
ticipant groups constrains the statistical power,
limiting the strength of our conclusions and mut-
ing effect sizes that might have emerged with a
larger sample.
The data comparing product types and disability pop-
ulations were potentially confounded by participant
self-selection of products from each of the three envi-
ronment categories. However, self-selection of prod-
ucts circumvented the potentially biasing inuences of
investigator-determined products and task cycles, en-
hancing the validity of the data in at least three ways:
(a) participants rated products that had relevance in
their daily lives; (b) their usability ratings reected
real-world task cycles completed in familiar environ-
ments; and (c) usability ratings reected multiple task
cycles occurring over an extended period of time. Self-
selection of products also fostered a diversity of ratings,
which enabled identication of potential oor and ceil-
ing effects. Lastly, self-selection of products helped
assure that the RAPUUD is, in fact, a viable tool for a
variety of consumer product types.
4.1. Future research
Additional studies are needed in order to substan-
tiate the reliability and validity of the RAPUUD, in-
cluding evaluations of: (a) test-retest reliability, (b)
responsiveness for additional user groups (e.g., those
with hearing impairment) and populationswith specic
disabling conditions (e.g., persons with arthritis, stroke
survivors), and (c) ability to discriminate usability con-
cerns for novice product users. The RAPUUD must
also be tested by product design teams to determine
if it helps identify usability problems during product
development.
Some items and response options may also benet
from modest renement. A number of items (e.g.,
items 1, 4–6, and 8–10) may not truly need a “not
applicable” option, since these indicatorsare applicable
to virtually all products. In addition, some items (e.g.,
items 4, 6, and 12) may only require a 3-point ordinal
response since safety risk, mistakes and errors, and
embarrassment are factors that are either present to
varying degrees or absent entirely.
5. Conclusion
This research is based on the premise that product
developers already possess the technical and creative
skills needed to produce accessible, usable consumer
products. What they lack is insight and perspective –
not for lack of caring or commitment, but for lack of ex-
posure to the impact of functional limitations on prod-
uct usage and usability. The RAPUUD tool described
150 J.A. Lenker et al. / A tool for rapid assessment of product usability and universal design
here offers a practical, cost-effective technique for eval-
uating product usability in a manner that is consistent
with the tenets of universal design and traditional us-
ability heuristics. The RAPUUD will hopefully sup-
port product designers and developers to identify prod-
ucts and product features that are problematic for those
with physical, sensory, and/or cognitive impairments
due to aging and/or disability.
Acknowledgments
This work was conducted at the Center for Inclu-
sive Design and Environmental Access, University at
Buffalo. The research was supported in part by Grant
#H133E050004-07 from the U.S. Department of Ed-
ucation, National Institute on Disability and Rehabil-
itation Research (NIDRR). The contents of this paper
reect the views of the authors and do not necessarily
reect the views of the U.S. Department of Education
or NIDRR.
References
[1] E.M. Andresen, Criteria for assessing the tools of disability
outcomes research, Archives of Physical Medicine and Reha-
bilitation 81(Supplement 2) (2000), S15–S20.
[2] V. Beecher and V.L. Paquet, Survey instrument for the uni-
versal design of consumer products, Applied Ergonomics 36
(2005), 363–372.
[3] Y.S. Choi, J.S. Yi, C.M. Law and J.A. Jacko, Are Universal
Design Resources designed for designers? Paper presented at
the ASSETS Conference ’06, Portland, OR, 2006.
[4] J. Clarkson, R. Coleman, S. Keates and C. Lebbon, (eds),
Inclusive design: Design for the whole population, London:
Springer, 2003.
[5] B.R. Connell, M. Jones, R. Mace, J. Mueller, A. Mullick, E.
Ostroff et al., The Principles of Universal Design,(Version
2.0 4/1/97 ed.). Raleigh, NC: NC State University, The Center
for Universal Design, 1997.
[6] K.P. Coyne, Conducting Simple Usability Stdies with Users
with Disabilities, Paper presented at the HCI International
Conference, 2005.
[7] R.F. DeVellis, Scale development – Theory and applications,
Newbury Park, CA: Sage, 1991.
[8] A. Fink, How to ask survey questions, Thousand Oaks, CA:
Sage, 1995.
[9] A. Henry, C.M. Law and K. Barnicle, Adapting the design
process to address more customers in more situations, 2001.
[10] M.V. Johnston, R.A. Keith and S.R. Hinderer, Measure-
ment standards for interdisciplinary medical rehabilitation,
Archives of Physical Medicine and Rehabilitation 73(Supple-
ment) (1992), 3–23.
[11] S. Keates, C. Lebbon and J. Clarkson, Investigating industry
attitudes to Universal Design, Paper presented at the RESNA
2000 Annual Conference, Orlando, FL, 2000.
[12] C.M. Law, K. Barnicle and K. Henry, Usability screening
techniques: Evaluating for a wider range of environments,
circumstances and abilities, Paper presented at the UPA 2000:
the Usability Professionals’ Association Annual Conference,
2000.
[13] C.M. Law and G.C. Vanderheiden, Tests for screening product
designs prior to user testing by people with functional limita-
tions, Paper presented at the Human Factors and Ergonomics
Society 43rd Annual Meeting, 1999.
[14] C.M. Law, J.S. Yi, Y.S. Choi and J. Jacko, Unresolved prob-
lems in accessibility and universal design guidelines, Er-
gonomics in Design (2007), 7–11.
[15] J.A. Lenker, D.J. Feathers, M.F. Nasawanji and V. Paquet,
Usability problems of products in the home reported by older
adults, Paper presented at the 2008 International Conference
on Aging, Disability, and Indendence (ICADI), 2008.
[16] J.A. Lenker, D.J. Feathers, M.F. Nasawanji and V. Paquet,
Usability problems of products in the home reported by
wheelchair users, Paper presented at the 2008 Applied Human
Factors and Ergonomics International (AHFEI) Conference,
2008.
[17] V. Mace, Universal design, barrier free environments for ev-
eryone, Los Angeles, CA: Designers West, 1985.
[18] M.F. Nasarwanji, J.A. Lenker, V. Paquet and D.J. Feathers, A
survey of the disability and universal design considerations
among corporate designers, Paper presented at the Interna-
tional Conference on Aging, Disability, and Indendence (ICA-
DI), 2008.
[19] D.J. Nielsen, Enhancing the explanatory power of usability
heuristics, CHI ’94 Conference Proceedings (1994), (152–
158). New York: ACM Press.
[20] J.C. Nunnally and I.H. Bernstein, Psychometric Theory (3rd
ed.), New York: McGraw-Hill, 1994.
[21] K. Pesudovs, J.M. Burr, C. Harley and D.B. Elliott, The de-
velopment, assessment, and selection of questionnaires, Op-
tometry and Vision Science 84(8) (2007), 663–674.
[22] L.G. Portney and M.P. Watkins, Foundations of clinical re-
search: A pplications to practice (3rd ed.), Upper Saddle River,
NJ: Pearson Prentice Hall, 2008.
[23] G.C. Vanderheiden and J. Tobias, Universal design of con-
sumer products: Current industry practice and perceptions,
Paper presented at the IEA 2000/HFES 2000 Congress, San
Diego, CA, 2000.
[24] M.F. Story, J.L. Mueller and M. Montoya-Weiss, Progress in
the development of universal design performance measures.
Paper presented at the RESNA Annual Conference, Orlando,
FL, 2000.
[25] M.F. Story, J.L. Mueller and M. Montoya-Weiss, Completion
of universal design performance measures. Paper presented at
the RESNA Annual Conference, Reno, NV, 2001.
... Where instructions accompanied the product (e.g., on the packaging or a leaflet insert), these were provided to the participant with the product. After using each crusher, the participants completed the Rapid Assessment of Product Usability and Universal Design (RAPUUD) questionnaire [21]. The RAPUUD contained 12 questions on a 5-point Likert scale, ranging from 'strongly disagree' to 'strongly agree' (Supplementary Materials). ...
... Two questions were altered slightly in their wording to make them more appropriate for Australian consumers: the word 'repeat' replaced 'do over' in question 5, and the word 'have' replaced 'get' in question 6. A usability score was calculated for each tablet-crushing device from the twelve questions coded on a one-to-five scale, where five indicated a better usability and one indicated a poorer usability [21]. For positively worded questions (questions 1-3, 7, 9, and 10), 'strongly agree' was assigned a score of five and 'strongly disagree' was assigned a score of one. ...
... The VitaCarry electronic grinder was viewed as being difficult to clean after use and not appropriate to share between users. . Scores were obtained from the responses to 12 questions from the RAPUUD questionnaire, normalised to lie in the range of 0 to 100 with a higher score indicating better usability [21]. The box extends from the 25th to the 75th percentiles, the vertical line in the box is the median, the whiskers indicate the 10th and 90th percentiles, and open circles are outliers. ...
Article
Full-text available
Tablet crushing is a common practice used by patients and their carers, mainly to facilitate swallowing. Various tablet-crushing devices with different designs are currently available on the market. This study aimed to compare the usability of different tablet-crushing devices in people with and without limited hand functions. The hand function of 100 adults recruited from the general community (40 of whom self-reported a limited hand function) was assessed using the hand and finger function subscale of the Arthritis Impact Measurement Scale version 2. The hand strength was measured using a dynamometer. Participants crushed tablets using 11 crushing devices and completed a Rapid Assessment of Product Usability and Universal Design questionnaire for each device. Hand-held twist-action crushers with an ergonomic grip received the highest usability scores among both groups, irrespective of the cost (p < 0.05). Crushers with bags were scored lower by those with limited hand functions, although the score improved if the device was automatic. Preferences regarding electronic crushers significantly changed once the cost was revealed. Economical twist-action crushers with ergonomic grips and without bags or cups were the most favoured crushers.
... Usability was measured with the rapid assessment of product usability and universal design (RAPUUD; Cronbach's α = 0.80) (Lenker et al. 2011). The RAPUUD consists of 12 items (see Table 1) which were merged into the total usability score via the arithmetic mean. ...
... The RAPUUD consists of 12 items (see Table 1) which were merged into the total usability score via the arithmetic mean. Therefore, negative questions were recoded preliminary as recommended by Lenker et al. (2011). For a better comparability, a uniform 7-point scale was used for the construct's usability, positive emotions and self-efficacy. ...
Article
Full-text available
Raising the user’s self-confidence is a promising strategy to reduce product-related user stigma. In the context of product usage, the commonly used term self-confidence refers to the psychological construct of self-efficacy. To strengthen a user’s self-efficacy through product design, providing both good usability and emotionality in a product seems to be a reasonable starting point. However, their suitability and validity for this purpose has not yet been sufficiently assessed. This paper examines whether self-efficacy would be associated with perceptions of a product’s usability and emotionality. By conducting an online survey (n = 105; stigma-sensitive product demonstrator: walker), it was confirmed that the perception of good usability and emotionality of walkers were positively associated with the user’s perceived self-efficacy. Moreover, a negative interaction effect was identified showing that the association between emotionality and self-efficacy increased with lower levels of perceived usability and vice versa. This may indicate that emotions can compensate the importance of usability at least to some extent.
... Ultimately, after verification through field observations and interviews with 4 SMEs, a total of 44 design indicators were selected. Numerous AT design guideline indicators were gathered from previous articles [8,[16][17][18][19][24][25][26][27][28][29][30][31][32]]. ...
Article
Full-text available
The utilization of appropriate technology (AT) has become the Indonesian government strategy to increase productivity of agricultural commodities due to its simplicity and cost-effectiveness. However, the current utilization of AT remains suboptimal mostly due to design deficiencies that insufficiently account for human factors and user experience. In response, the aim of this study is to establish comprehensive AT design guidelines for sustainable AT utilization, focused on agricultural processing machines. An intensive observation was initially conducted in a rural community in Indonesia, to summarize difficulties faced by AT users. Supported by an exhaustive review of literature, a total of 44 human factors related design criteria were defined. Subsequently, these criteria underwent rigorous validation through a questionnaire administered to 197 respondents, consisting of AT designers, experts, and users. Employing the framework of principal component analysis (PCA), novel dimensions of AT design criteria were suggested, encompassing safety and error prevention, functionality and economics, user-friendly, low physical effort, physical workspace compatibility, and perceptible information. To augment the insights gleaned from the PCA, a matrix of importance-performance analysis was created, affording a map of the relative significance and concurrent performance of the defined criteria. The implications of this study are further discussed.
... Minimize drawing attention to and/or stigmatizing users-Unnecessary attention drawn to users with impairment can be stigmatizing, increases social stress and discomfort in travel and impede usability (Lenker et. al, 2011;Perez et. al., 2019). Even though the modified SAV could be used by a passenger in a wheelchair, other ambulatory passengers on-board had to temporarily exit prior to the wheelchair user boarding. If there is more than one passenger on-board, the passenger in the wheelchair cannot board. Further, the attendant must maneuver on-board and/ ...
Article
Full-text available
Driverless shared automated vehicles (SAVs) have the potential to substantially improve independent mobility for the growing number of older adults and people with disabilities who are unable or ineligible to drive. However, early designs and deployments of SAVs have lacked accommodations for people with disabilities. This article describes a case study where post-production modifications were performed on a commercial electric SAV in an attempt to comply with US accessibility guidelines for conventional vehicles. Findings emphasize the key human factors considerations for physical accessibility and some lessons learned in order to inform the broader conversation about the accessible design of emerging SAVs. The case study highlights the need for considering accessibility and usability early in the design of complex technological systems such as automated vehicles.
... Stephanidis, Akoumianakis et al. (1998) proposed guidelines that were subsequently translated into key development requirements which were preserved in user interface development tools for them to provide the required support for building user interface software for different users and contexts of use. Lenker, Nasarwanji et al. (2011) developed the Rapid Assessment of Product Usability & Universal Design (RAPUUD), a 12-item user-report tool based on the principles of universal design. Oh (2015) developed the design evaluation tool and guidelines of universal design for applying to the design of different spaces, including residential space, educational space, working space, and cultural space. ...
Article
Full-text available
While there are people with disability live in Kurdish parts of Iraq, a very limited number of buildings are properly designed to serve these people. Considering the challenges that people with disability face in public buildings, the United Nations has recommended the implementation of the Universal Design (UD) principles in public buildings in Iraq to ensure that all people could have access to the public buildings regardless of their abilities and backgrounds. Hence, there is a need to gather pertinent data by assessing the adherence of shopping malls in this part of Iraq to the Universal Design (UD) principles given the role of the facilities to the locals. The present study aims to develop a tool for assessing whether the shopping malls in Sulaymaniyah city adhere to Universal Design principles. An analytical tool, which was abbreviated as SM-UD, was developed using a wide range of shopping mall design elements. The tool was tested for reliability and validity through several statistical tests. Besides, the tool was tested for practicality and communicability in six different shopping malls of Sulaymaniyah. The reliability and validity test indicate that the majority of items showed good to excellent reliability and fair to excellent validity. The results of using the tool show that it is capable of identifying the drawbacks of shopping malls in terms of their universality of design. The proposed tool appears ready to be used by shopping malls’ managers and researchers.
Article
Purpose: The aim of this study was to explore the feasibility of using electrodermal activity (EDA) to detect changes in physiological arousal linked to perceptions of accommodations, focusing on universal design (UD) features. In environments like hotels, designers must consider wellness, social integration, and cultural appropriateness to effectively implement UD. Challenges exist with implementing and evaluating UD to accommodate diverse user needs due to conflicting definitions and application issues. To meet the need for post-design evaluation discerning accommodations by features and user groups, EDA measures offer a way to capture individual reactions to external stimuli. Materials and Methods: In this study, 22 adults (14 young, 8 older) completed an independent hotel walkthrough while expressing their perceptions. EDA was measured using a wristband, and participants' perceived stress and usability were assessed through questionnaires. Phasic EDA was extracted to represent discrete event-evoked changes in arousal. Results: Findings demonstrated the potential of EDA to identify physiological response variations based on age and location within the hotel. Older adults displayed significantly higher levels of arousal and more favorable usability ratings (4.61 out of 5) compared to young adults, with peak arousal in the corridor and public restroom. Younger adults showed the highest arousal in the bathroom, often with negative associations. The groups differed in their reactions to the bathroom and reception areas. Conclusions: Divergences between physiological responses and subjective outcomes highlighted the complexity of translating arousal measures into meaningful insights. EDA, combined with commentary, enhanced our understanding of user reactions to design elements to fill gaps left by subjective methods.
Article
This study was designed to evaluate the effects of hotel features on perceptions of stress and usability across groups of healthy adults, older adults, and wheelchair users. Participants completed a guided walkthrough of a hotel that included tasks in the room, bathroom, and lobby. The older adults had the lowest level of perceived stress, whereas the wheelchair users had the lowest rating of usability. The healthy group had generally positive perspectives on the hotel features, while the wheelchair users had predominantly negative comments. Subjects’ concerns ranged from more leisure concerns, such as not having access to preferred television shows (healthy group), to difficulty with accessibility of basic room features such as stepping into the shower area (older adults) and opening the room door (wheelchair users). Although inclusive design may pose a challenge to hotel managers and designers, it is necessary to ensure all guests have access to basic features.
Conference Paper
Taking the academic papers related to universal design research from 2010 to 2020 in the Web of Science core collection database as the research object, using the scientific metrology software Citespace to review the development context of this field, it is found that the research in the field of universal design in the past ten years has been concentrated in The following five aspects (1) urban environment (2) product design (3) education and teaching (4) human-computer interaction (5) society and policy. Research and application in these fields directly reflect the diversified application value of universal design. This research also combines the literature content analysis method to make prospects for the emerging development trends in this field to provide ideas for related research at home and abroad.
Article
Full-text available
The Indonesian government has considered appropriate technology (AT) as a cost-effective strategy to increase productivity, including for farmers in processing agricultural commodities. However, its acceptance and effectiveness still need to be improved so that AT can be used for the general population. The existing AT designs seem to fail in considering the characteristics and capabilities of their users. This paper proposed expanding universal design principles for AT in small and medium enterprises (SMEs). After conducted random observation and interviews with SMEs in Subang Area, this study refers to relevant literature studies from various previous studies. This study’s results are new universal design principles: flexibility in use, practicability, ease of service, perceptible information, tolerance for error, low physical effort, low energy, adjustability, mobility, and modular and straightforward and intuitive use. A conceptual model proposed in this study describes the relationship among user characteristics, the concept of universal design, and the effectiveness of using appropriate technology.
Article
Wheelchair securement designs for fixed route, large accessible transit vehicles (LATVs) often create difficulties for passengers who use wheelchairs and operational inefficiencies for public transit agencies. Recent innovations in wheelchair securement technology for LATVs may reduce these challenges. This field study builds on a recent lab study that used a full-scale LATV simulation apparatus to address similar knowledge gaps. The current study used a mixed-methods approach to explore the usability of two newer wheelchair securement systems currently installed in LATVs in Buffalo, NY: a 3-point, forward-facing (3P-FF) securement system and a semi-automated, rear-facing (SA-RF) securement system. Three groups of wheelchair users (manual wheelchair [MWC], power wheelchair [PWC], and scooter [SC] users; n = 40) completed a pre-study interview, four trips on the LATVs and accompanying surveys, and a final interview. Using multiple usability rating scales, findings indicated clear differences in ratings of difficulty and acceptability between securement systems by wheelchair user group, with the SA-RF outperforming the 3P-FF on most usability measures for MWC and PWC users. SC users consistently rated both securement systems as more difficult to use and the SA-RF securement as less acceptable than MWC and PWC users.
Article
Full-text available
How and why do some companies successfully practice universal design of their products? Why do other companies not practice universal design, and what might motivate them to adopt it? What are the most effective things that can be done by those on the outside to increase the number of companies successfully practicing universal design? This paper reports results from a three-year study of the practice of universal design in companies providing consumer products and services, which was undertaken to discover the answers to these questions. The study included extensive interviews, a comprehensive survey, and the monitoring of the effects of many of the key facilitation strategies. The key external strategy, although controversial, is that of government regulation requiring the accessibility of products and services. Other important strategies include training and educational programs in universal design and development of market data.
Article
A set of inexpensive to implement usability ?screening tests? are proposed which would be administered by designers on their colleagues or acquaintances. Test subjects, who have no prior knowledge of a product, conduct every day use tasks while having their sensory, physical and cognitive capabilities limited through various techniques. The tests have been assembled to provide minimum set which cover a wide range of functional limitation experiences. For each test the concept, usability questions, and suggested procedure and materials are given. A hierarchy of test priorities is suggested. The tests should be conducted by experts who are aware of the safety and ethics issues concerning inducing sensory, physical, and cognitive limitations. The set of tests incorporate new, existing, and exploratory ideas A number of outstanding research issues are introduced, which are discussed briefly.
Conference Paper
Several published sets of usability heuristics were compared with a database of existing usability problems drawn from a variety of projects in order to determine what heuristics best explain actual usability problems. Based on a factor analysis of the explanations as well as an analysis of the heuristics providing the broadest explanatory coverage of the problems, a new set of nine heuristics were derived: visibility of system status, match between system and the real world, user control and freedom, consistency and standards, error prevention, recognition rather than recall, flexibility and efficiency of use, aesthetic and minimalist design, and helping users recognize, diagnose, and recover from errors.
Article
FEATURE AT A GLANCE: There are numerous standards, design guidelines, and other resources that relate to the use of technology by people with disabilities. We examined whether such resources met the needs of designers based on typical design processes and design psychology. We conducted a heuristic evaluation of eight resources and then surveyed and interviewed the people who created those resources. Based on our research, we identified five unresolved problems in the creation of guidance: (1) neither the audience nor its needs are clearly defined; (2) the terminology of accessible and universal design is imprecise; (3) there is no universally accepted standard of measurement; (4) enforcement of standards is lax because of their ambiguous nature; and, finally, (5) usability of the guidance is compromised. We provide recommendations for resolving each problem.
Article
The nine-volume Survey Kit is designed to help readers prepare and conduct surveys and become better users of survey results. All the books in the series contain instructional objectives, exercises and answers, examples of surveys in use, illustrations of survey questions, guidelines for action, checklists of "dos and don'ts," and annotated references. This volume, second in the series, is designed to guide the reader to prepare and use reliable and valid survey questions. The first objective is to help the user understand a survey's cultural, psychological, economic, and political contexts. The survey developer is encouraged to ask valid questions that make sense to the respondent, and are concrete, with well-constructed sentences and careful word choice. The user is led to ask questions correctly through the use of meaningful response categories, appropriately grouped. Also discussed is applying special questioning techniques as needed. The following chapters are included: (1) "Asking Questions: A Matter of Context"; (2) "Keep Questions Closed or Open Them Up?"; (3) "Responses: Choices and Measurement"; and (4) "Knowledge, Attitudes, and Behavior: Additional Tips When Creating Survey Questions." A list of 15 annotated additional readings is attached. (Contains 32 examples and 4 tables.) (SLD)