Conference PaperPDF Available

Technology-mediated engagement of people with visual impairments with nature


Abstract and Figures

Spending time in outdoor nature is beneficial for improving physical and mental wellbeing. However, despite the advancements in mobile technologies and the rise in physical health tracking apps and devices, people with visual impairments (VIPs) spend less time outdoors. This thesis explores the use of technology in mediating engagement of VIPs with outdoor nature. Through the use of qualitative research methods, an in-depth understanding of the experiences of VIPs in open natural spaces will be developed. These will inform the framing of the design of prototypes of technologies to encourage exploration and engagement with nature for VIPs to be developed through participatory design methods to develop.
Content may be subject to copyright.
Technology-mediated engagement of people with visual
impairments with nature
Maryam Bandukda
UCL Interaction Centre
London, UK
Spending time in outdoor nature is beneficial for improving
physical and mental wellbeing. However, despite the
advancements in mobile technologies and the rise in physical
health tracking apps and devices, people with visual
impairments (VIPs) spend less time outdoors. This thesis
explores the use of technology in mediating engagement of
VIPs with outdoor nature. Through the use of qualitative
research methods, an in-depth understanding of the
experiences of VIPs in open natural spaces will be
developed. These will inform the framing of the design of
prototypes of technologies to encourage exploration and
engagement with nature for VIPs to be developed through
participatory design methods to develop.
Author Keywords
Assistive technologies; visual impairment; nature
ACM Classification Keywords
• Human-centered computing → Accessibility technologies;
Accessibility systems and tools; •Applied computing →
There is growing evidence that spending time in outdoor
natural environments such as parks and woodlands can have
a positive impact on peoples’ mental and physical wellbeing
and improve symptoms of stress, anxiety, and depression [7,
25]. Recent research also suggests that the digital
augmentation of natural environments can encourage
exploration and learning [6, 8, 18] about plant and animal
wildlife. However, the majority of existing HCI research on
interaction with nature has focused on people without visual
impairments. There is a need to understand how VIPs
experience nature and how existing technologies and
infrastructure facilitate navigation, exploration, and overall
experience of VIPs in nature.
My research explores the experiences of VIPs in outdoor
natural environments including parks, woodlands, meadows,
forests, and other open green spaces. I intend to use
qualitative research methods to develop an in-depth
understanding of the needs and experiences of VIPs in
nature. I will focus on mapping the barriers that limit how
VIPs learn about places to visit, plan their trip, and explore
the natural environment. I will then use participatory design
methods for co-creating high-fidelity prototypes of
technological interventions to encourage exploration and
engagement with nature.
In recent years, there has been a shift in HCI research
towards the design of assistive technologies (AT) catering to
the needs of people with disabilities. This has been evident
in the growing number of submissions to leading conferences
such as the ACM Computer-Human Interaction (CHI). For
example, with a growing number of submissions related to
accessibility and design of assistive technologies. According
to the ACM digital library search, the number of submissions
has more than doubled since 2010. Moreover, the steady
growth in number of submissions to ASSETS in the past 5
years is indicative of the growing research in the accessibility
A vast majority of these papers focused on visual
impairment, which is an area of growing interest in HCI. This
has led to the development of various technologies to assist
VIPs in activities of daily living (ADL) including accessing
online content [19, 27], reading books [11, 21], and
navigation [1214]. However, little attention has been given
to hedonic experiences and motivations of VIPs in the
context of outdoor nature. This narrow focus of technology
for VIPs calls for a better understanding of what VIPs need,
their motivations, and experiences where exploration and
enjoyment of the surrounding is the aim.
An estimated 285 million people live with visual impairment
worldwide, of which 39 million are blind [26]. In the UK,
there are 2 million people living with visual impairment of
which approx. 330,000 are registered blind [9]. The rate of
prevalence of visual impairment and blindness is increasing.
In the last two decades, the number of blind people has
increased 17.6% from 30.6 million in 1990 to 46 million in
2015 [4]. It is estimated that the number of people living with
Paste the appropriate copyright/license statement here. ACM now supports
three different publication options:
ACM copyright: ACM holds the copyright on the work. This is the
historical approach.
License: The author(s) retain copyright, but ACM receives an
exclusive publication license.
Open Access: The author(s) wish to pay for the work to be open
access. The additional fee must be paid to ACM.
This text field is large enough to hold the appropriate release statement
assuming it is single-spaced in Times New Roman 8-point font. Please do
not change or modify the size of this text box.
Each submission will be assigned a DOI string to be included here.
sight loss worldwide will triple due to population growth and
aging. [10, 23].
Loss of vision affects people’s quality of life by limiting their
ability to manage their daily activities. The impact of sight
loss on people’s lives varies based on the severity of sight
loss and the age of onset but mostly impacts the individual’s
independence. The older blind population have the highest
risk of losing independence and suffering from loneliness
and depression as a result of sight loss [16, 22].
The absence of vision also limits a blind person’s ability to
participate in leisure activities and affects quality of life. For
many people who lose sight later in life, sight loss means
being unable to continue enjoying participation in leisure
activities. Open spaces such as parks are great for
exploration, relaxation, socialising, and physical activity [2,
3, 15] but most of these places are not accessible for blind
people due to lack of appropriate wayfinding signage,
landmarks and cues to enable blind people to explore and in
general lack of facilities to support the blind visitors in
exploring open spaces [20, 24]. Research on exploration and
participation of people with disabilities in leisure activities is
limited and does not investigate exploration and open space
experiences of blind people.
This research seeks to answer the main research question:
How can technology encourage exploration and mediate
engagement of VIPs with nature?
The research follows an exploratory approach to
understanding the needs of VIPs and an inclusive and
participatory approach to design and evaluation of
prototypes to enhance VIPspark going experience. A
summary of the research approach and the methods is given
in Table 1.
Table 1: Research approach and methods
Exploring the use of
technology by VIPs and
opportunities for leisure
Online survey
In-depth exploration of the
experiences of VIPs in
outdoor nature, their needs,
barriers and strategies for
overcoming these barriers
Focus group
Exploring and comparing the
needs of VIP and non-VIPs
when interacting with nature
Design of technologies to
encourage interaction and
engagement with nature
I am currently approaching the end of my second year in a
four-year doctoral program. Currently, I am conducting a
focus group study with VIPs and habilitation specialists, and
support workers. Next, I aim to conduct in-situ observations
with VIPs and non-VIPs people in parks around London
following which will lead to the end of phase one of my
research. In phase two, I aim to use participatory design
methods such as co-design workshops for generating ideas
and co-creation of prototypes with VIPs and habilitation
specialists. At the doctoral consortium I am particularly keen
to gain insight into participatory design approaches which
are applicable to and can be adapted to include VIPs.
The preliminary results from the interviews [1] and focus
group [in preparation] are consistent with the existing reports
in that VIPs experience a number of barriers [5, 17] when
visiting parks. Specifically, access to information prior to
visiting a park and safely whilst exploring the parks are not
met with the existing services provided. Many of the VIPs
interviewed use technology to navigate the built environment
but find the technology to be limited in parks. Moreover, the
results also suggest that there is a desire to explore nature in
open spaces and that a need for contextual information about
the plants and animal wildlife in the park, the historical
context, and wayfinding information to enable exploration is
This research intends to make two main academic
1. An in-depth understanding of the experiences of VIPs in
nature including the needs, barriers and affective
interaction (emotional and sensory experiences) with the
environment. This will be valuable contribution to HCI
research and useful for the design of AT for VIPs.
2. The design of prototypes to encourage park exploration
and engagement with nature. As there are currently no
technologies that facilitate park going experience for VIPs,
the design of technology as part of this thesis will be a
novel contribution to HCI research.
The outcomes of my research will also include evaluation of
the prototypes in parks around London which will be used by
park visitors. It is my hope that my research will make a
positive impact on the wellbeing of the VIP community in
London and will encourage people to engage with nature.
This work is supported/funded by ESPRC Doctoral Training
Program. I thank all the participants for sharing their
experiences and valuable insights to this research. I am also
thankful to Dr. Catherine Holloway and Prof. Nadia
Berthouze for their continued support as doctoral
[1] Bandukda, M. et al. 2019. Understanding
Experiences of Blind Individuals in Outdoor Nature.
Extended Abstracts of the 2019 CHI Conference on
Human Factors in Computing Systems - CHI EA ’19
(New York, New York, USA, 2019), 16.
[2] Bedimo-Rung, A.L. et al. 2005. The significance of
parks to physical activity and public health: A
conceptual model. American Journal of Preventive
Medicine (Feb. 2005), 159168.
[3] de Bell, S. et al. 2017. The importance of nature in
mediating social and psychological benefits
associated with visits to freshwater blue space.
Landscape and Urban Planning. 167, (Nov. 2017),
[4] Bourne, R.R.A. et al. 2017. Magnitude, temporal
trends, and projections of the global prevalence of
blindness and distance and near vision impairment:
a systematic review and meta-analysis. The Lancet
Global Health. 5, 9 (Sep. 2017), e888e897.
[5] George, A.L. and Duquette, C. 2006. The
Psychosocial Experiences of a Student with Low
Vision. Jvib. 100, March (2006), 112.
[6] Heitlinger, S. et al. The Talking Plants: An
Interactive System for Grassroots Urban Food-
Growing Communities.
[7] Houlden, V. et al. 2017. A cross-sectional analysis
of green space prevalence and mental wellbeing in
England. BMC Public Health. 17, 1 (Dec. 2017),
460. DOI:
[8] Kaninsky, M. et al. 2018. Confronting people’s fears
about bats: combining multi- modal and
environmentally sensed data to promote curiosity
and discovery. Proceedings of the 2018 Designing
Interactive Systems Conference (New York, New
York, USA, 2018), 931943.
[9] Key Information and Statistics: 2012. .
[10] Key Information and Statistics: 2012.
[11] Li, M. et al. 2010. BrailleSketch : A Gesture-based
Text Input Method for People with Visual
Impairments. Assets ’17 (New York, New York,
USA, 2010), 1221.
[12] Lingwood, J. et al. 2018. Using virtual environments
to investigate wayfinding in 8- to 12-year-olds and
adults. Journal of Experimental Child Psychology.
166, (Feb. 2018), 178189.
[13] Microsoft’s new iPhone app narrates the world for
blind people - The Verge:
rosoft-ai-seeing-app-blind-ios. Accessed: 2017-09-
[14] Morrison, C. et al. 2017. Imagining Artificial
Intelligence Applications with People with Visual
Disabilities using Tactile Ideation. Proceedings of
the 19th International ACM SIGACCESS
Conference on Computers and Accessibility -
ASSETS ’17. (2017), 8190.
[15] Paluska, S.A. and Schwenk, T.L. 2000. Physical
aActivity and mental health. Sports Medicine. 29, 3
(Mar. 2000), 167180.
[16] Rantakokko, M. et al. 2014. Perceived
Environmental Barriers to Outdoor Mobility and
Feelings of Loneliness Among Community-
Dwelling Older People. The Journals of
Gerontology Series A: Biological Sciences and
Medical Sciences. 69, 12 (Dec. 2014), 15621568.
[17] RNIB “Who Put That There” The barriers to blind
and partially sighted people getting out and about.
[18] Rogers, Y. et al. 2004. Ambient wood. Proceeding
of the 2004 conference on Interaction design and
children building a community - IDC ’04 (New
York, New York, USA, 2004), 310.
[19] da Silva, C.F. et al. 2016. WhatsApp accessibility
from the perspective of visually impaired people.
Proceedings of the 15th Brazilian Symposium on
Human Factors in Computer Systems - IHC ’16
(New York, New York, USA, 2016), 110.
[20] Siu, K.W.M. 2013. Accessible park environments
and facilities for the visually impaired. Facilities.
Emerald Group Publishing Limited.
[21] Stearns, L. et al. 2017. Augmented Reality
Magnification for Low Vision Users with the
Microsoft Hololens and a Finger-Worn Camera.
Proceedings of the 19th International ACM
SIGACCESS Conference on Computers and
Accessibility - ASSETS ’17 (New York, New York,
USA, 2017), 361362.
[22] Thomas Pocklington Trust 2014. Loneliness , social
isolation and sight loss.
[23] WHO 2016. WHO | Visual impairment and
blindness. WHO. (2016).
[24] Williams, M.A. et al. 2014. “just let the cane hit it.”
Proceedings of the 16th international ACM
SIGACCESS conference on Computers &
accessibility - ASSETS ’14 (New York, New York,
USA, 2014), 217224.
[25] Wood, L. et al. 2017. Public green spaces and
positive mental health investigating the
relationship between access, quantity and types of
parks and mental wellbeing. Health and Place. 48,
(Nov. 2017), 6371.
[26] World Health Organization 2017. WHO | World
Health Organization. WHO. (2017).
[27] Wu, S. et al. 2014. Visually impaired users on an
online social network. Proceedings of the 32nd
annual ACM conference on Human factors in
computing systems - CHI ’14 (New York, New York,
USA, 2014), 31333142.
ResearchGate has not been able to resolve any citations for this publication.
Conference Paper
Full-text available
Research shows that exposure to nature has benefits for people's mental and physical health and that ubiquitous and mobile technologies encourage engagement with nature. However, existing research in this area is primarily focused on people without visual impairments and is not inclusive of blind and partially sighted individuals. To address this gap in research, we interviewed seven blind people (without remaining vision) about their experiences when exploring and experiencing the outdoor natural environment to gain an understanding of their needs and barriers and how these needs can be addressed by technology. In this paper, we present the three themes identified from the interview data; independence, knowledge of the environment, and sensory experiences.
Conference Paper
Full-text available
There has been a surge in artificial intelligence (AI) technologies co-opted by or designed for people with visual disabilities. Researchers and engineers have pushed technical boundaries in areas such as computer vision, natural language processing, location inference, and wearable computing. But what do people with visual disabilities imagine as their own technological future? To explore this question, we developed and carried out tactile ideation workshops with participants in the UK and India. Our participants generated a large and diverse set of ideas, most focusing on ways to meet needs related to social interaction. In some cases, this was a matter of recognizing people. In other cases, they wanted to be able to participate in social situations without foregrounding their disability. It was striking that this finding was consistent across UK and India despite substantial cultural and infrastructural differences. In this paper, we describe a new technique for working with people with visual disabilities to imagine new technologies that are tuned to their needs and aspirations. Based on our experience with these workshops, we provide a set of social dimensions to consider in the design of new AI technologies: social participation, social navigation, social maintenance, and social independence. We offer these social dimensions as a starting point to forefront users' social needs and desires as a more deliberate consideration for assistive technology design.
Full-text available
Wayfinding is the ability to learn and recall a route through an environment. Theories of wayfinding suggest that for children to learn a route successfully, they must have repeated experience of it, but in this experiment we investigated whether children could learn a route after only a single experience of the route. A total of 80 participants from the United Kingdom in four groups of 20 8-year-olds, 10-year-olds, 12-year-olds, and adults were shown a route through a 12-turn maze in a virtual environment. At each junction, there was a unique object that could be used as a landmark. Participants were "walked" along the route just once (without any verbal prompts) and then were asked to retrace the route from the start without any help. Nearly three quarters of the 12-year-olds, half of the 10-year-olds, and a third of the 8-year-olds retraced the route without any errors the first time they traveled it on their own. This finding suggests that many young children can learn routes, even with as many as 12 turns, very quickly and without the need for repeated experience. The implications for theories of wayfinding that emphasize the need for extensive experience are discussed.
Full-text available
Background: Global and regional prevalence estimates for blindness and vision impairment are important for the development of public health policies. We aimed to provide global estimates, trends, and projections of global blindness and vision impairment. Methods: We did a systematic review and meta-analysis of population-based datasets relevant to global vision impairment and blindness that were published between 1980 and 2015. We fitted hierarchical models to estimate the prevalence (by age, country, and sex), in 2015, of mild visual impairment (presenting visual acuity worse than 6/12 to 6/18 inclusive), moderate to severe visual impairment (presenting visual acuity worse than 6/18 to 3/60 inclusive), blindness (presenting visual acuity worse than 3/60), and functional presbyopia (defined as presenting near vision worse than N6 or N8 at 40 cm when best-corrected distance visual acuity was better than 6/12). Findings: Globally, of the 7·33 billion people alive in 2015, an estimated 36·0 million (80% uncertainty interval [UI] 12·9–65·4) were blind (crude prevalence 0·48%; 80% UI 0·17–0·87; 56% female), 216·6 million (80% UI 98·5–359·1) people had moderate to severe visual impairment (2·95%, 80% UI 1·34–4·89; 55% female), and 188·5 million (80% UI 64·5–350·2) had mild visual impairment (2·57%, 80% UI 0·88–4·77; 54% female). Functional presbyopia affected an estimated 1094·7 million (80% UI 581·1–1686·5) people aged 35 years and older, with 666·7 million (80% UI 364·9–997·6) being aged 50 years or older. The estimated number of blind people increased by 17·6%, from 30·6 million (80% UI 9·9–57·3) in 1990 to 36·0 million (80% UI 12·9–65·4) in 2015. This change was attributable to three factors, namely an increase because of population growth (38·4%), population ageing after accounting for population growth (34·6%), and reduction in age-specific prevalence (−36·7%). The number of people with moderate and severe visual impairment also increased, from 159·9 million (80% UI 68·3–270·0) in 1990 to 216·6 million (80% UI 98·5–359·1) in 2015. Interpretation: There is an ongoing reduction in the age-stan dardised prevalence of blindness and visual impairment, yet the growth and ageing of the world's population is causing a substantial increase in number of people affected. These observations, plus a very large contribution from uncorrected presbyopia, highlight the need to scale up vision impairment alleviation efforts at all levels.
Full-text available
There is increasing appreciation of the benefits associated with exposure to natural environments. However, most of the evidence relates to green space with much less on blue space. Drawing on data from a British survey of adults, we describe the characteristics of visits to blue space and investigate whether the benefits reported in studies of green space – physical activity, social interaction, and psychological benefits – are evident with respect to blue space. We also examine the importance of nature to people’s visits to blue space and investigate the sociodemographic predictors of visit frequency and location, the benefits received, and the importance of nature to the visit. Social interaction and psychological benefits were the most important benefits obtained from visiting blue space. Socioeconomic status was a predictor of both frequency and location of visits and was also associated with identifying social interaction as the most important benefit. Respondents who reported psychological benefits as the most important benefit were more likely to find nature very important to their visit. The importance of nature in underpinning these benefits was relatively greater for older people compared with younger people. These findings highlight the social and psychological benefits obtained from visits to blue space, and provide new evidence on the importance of the natural environment in underpinning these benefits and enriching people’s lives.
Full-text available
Background With urbanisation increasing, it is important to understand how to design changing environments to promote mental wellbeing. Evidence suggests that local-area proportions of green space may be associated with happiness and life satisfaction; however, the available evidence on such associations with more broadly defined mental wellbeing in still very scarce. This study aimed to establish whether the amount of neighbourhood green space was associated with mental wellbeing. Methods Data were drawn from Understanding Society, a national survey of 30,900 individuals across 11,096 Census Lower-Layer Super Output Areas (LSOAs) in England, over the period 2009–2010. Measures included the multi-dimensional Warwick-Edinburgh Mental Well-Being Scale (SWEMWBS) and LSOA proportion of green space, which was derived from the General Land Use Database (GLUD), and were analysed using linear regression, while controlling for individual, household and area-level factors. ResultsThose living in areas with greater proportions of green space had significantly higher mental wellbeing scores in unadjusted analyses (an expected increase of 0.17 points (95% CI 0.11, 0.23) in the SWEMWBS score for a standard deviation increase of green space). However, after adjustment for confounding by respondent sociodemographic characteristics and urban/rural location, the association was attenuated to the null (regression coefficient B = − 0.01, 95% CI -0.08, 0.05, p = 0.712). Conclusions While the green space in an individual’s local area has been shown through other research to be related to aspects of mental health such as happiness and life satisfaction, the association with multidimensional mental wellbeing is much less clear from our results. While we did not find a statistically significant association between the amount of green space in residents’ local areas and mental wellbeing, further research is needed to understand whether other features of green space, such as accessibility, aesthetics or use, are important for mental wellbeing.
Conference Paper
Bats are often disliked and feared by people. How might we enable the general public to learn more about the true nature of these creatures, and even to like them? In this paper, we introduce PlayBat, a physical public display, which combines a multi-modal interface, a constrained narrative structure and real-time IoT environmentally sensed bat call data. The aim of our research is to investigate whether promoting curiosity and discovery through enabling people to explore real-life data, answer quiz-like questions and engage with a multi-modal interface, is effective at engaging people and confronting their fears. We report on the design process and implementation of PlayBat, and the findings from an in-the-wild study. We discuss how tapping into multiple senses can draw people in, evoke curiosity and even change their views.
Conference Paper
Recent technical advances have enabled new wearable augmented reality (AR) solutions that can aid people with visual impairments (VI) in their everyday lives. Here, we investigate an AR-based magnification solution that combines a small finger-worn camera with a transparent augmented reality display (the Microsoft Hololens). The image from the camera is processed and projected on the Hololens to magnify visible content below the user's finger such as text and images. Our approach offers: (i) a close-up camera view (similar to a CCTV system) with the portability and processing power of a smartphone magnifier app, (ii) access to content through direct touch, and (iii) flexible placement of the magnified image within the wearer's field of view. We present three proof-of-concept interfaces and plans for a user evaluation.
Associations between parks and mental health have typically been investigated in relation to the presence or absence of mental illness. This study uses a validated measure of positive mental health and data from RESIDential Environments (RESIDE) Project to investigate the association between the presence, amount and attributes of public green space in new greenfield neighbourhood developments and the mental health of local residents (n = 492). Both the overall number and total area of public green spaces were significantly associated with greater mental wellbeing, and findings support a dose-response relationship. Positive mental health was not only associated with parks with a nature focus, but also with green spaces characterised by recreational and sporting activity. The study demonstrates that adequate provision of public green space in local neighbourhoods and within walking distance is important for positive mental health.
Conference Paper
The value of online social networks has been widely recognized. Although extensive researches focused on web accessibility in order to make content accessible to a wider range of people with disabilities, there are many barriers that might prevent visually impaired users from fully engaging with online social networks. This article describes an evaluation of the web accessibility of the social networking services WhatsApp by the perspective of five blind users using a mobile device, applying the WCAG 2.0 success criteria. As a result, we observed some issues to be addressed to improve web accessibility for visually impaired in this domain.