ArticlePDF Available

Multisensory virtual environment for supporting blind persons' acquisition of spatial cognitive mapping, orientation, and mobility skills

Authors:

Abstract and Figures

Mental mapping of spaces, and of the possible paths for navigating through these spaces, is essential for the development of efficient orientation and mobility skills. The work reported here is based on the assumption that the supply of appropriate spatial information through compensatory channels (conceptual and perceptual), may contribute to the blind people's spatial performance. We developed a multi-sensory virtual environment simulating real-life spaces. This virtual environment comprises developer / teacher mode and learning mode.
Content may be subject to copyright.
Multi-sensory virtual environment for supporting blind persons’
acquisition of spatial cognitive mapping, orientation, and mobility skills
O Lahav and D Mioduser
School of Education, Tel Aviv University, Ramat Aviv, Tel Aviv, ISRAEL
lahavo@post.tau.ac.il
ABSTRACT
Mental mapping of spaces, and of the possible paths for navigating through these spaces, is
essential for the development of efficient orientation and mobility skills. The work reported
here is based on the assumption that the supply of appropriate spatial information through
compensatory channels (conceptual and perceptual), may contribute to the blind people’s
spatial performance. We developed a multi-sensory virtual environment simulating real-life
spaces. This virtual environment comprises developer / teacher mode and learning mode.
1. RATIONALE
The ability to navigate space independently, safely and efficiently is a combined product of motor, sensory
and cognitive skills. This ability has direct influence in the individuals’ quality of life.
Mental mapping of spaces, and of the possible paths for navigating through these spaces, is essential for
the development of efficient orientation and mobility skills. Most of the information required for this mental
mapping is visual information (Lynch, 1960). Blind people lack this crucial information, thus facing great
difficulties (a) in generating efficient mental maps of spaces, and therefore (b) in navigating efficiently
within these spaces. A result of this deficit in navigational capability is that many blind people become
passive persons, depending on others for continuous aid (Foulke, 1971). More then 30% of the blind do not
mobilize independently outdoors (Clark-Carter, Heyes & Howarth, 1986).
The work reported here is based on the assumption that the supply of appropriate spatial information
through compensatory sensorial channels, as an alternative to the (impaired) visual channel, may contribute
to the mental mapping of spaces and consequently, to blind people’s spatial performance.
Research on blind people’s mobility in known and unknown spaces (Dodds, Armstrong & Shingledecker,
1981; Golledge, Klatzky & Loomis, 1996; Ungar, Blades & Spencer, 1996), indicates that support for the
acquisition of spatial mapping and orientation skills should be supplied at two main levels: perceptual and
conceptual levels.
At the perceptual level, the deficiency in the visual channel should be compensated with information
perceived via other senses. Touch and hearing become powerful information suppliers about known as well
as unknown environments. In addition, haptic information appears to be essential for appropriate spatial
performance. Haptics is defined in the Webster dictionary (1993), as “of, or relating to the sense of touch”.
Fritz, Way & Barner (1996) define haptics as “ tactile refers to the sense of touch, while the broader haptics
encompasses touch as well as kinaesthetic information, or a sense of position, motion and force.” Haptic
information is commonly supplied by the cane for low-resolution scanning of the immediate surroundings, by
palms and fingers for fine recognition of objects’ form, textures, and location, and by the legs regarding
surface information. The auditory channel supplies complementary information about events, the presence of
other people (or machines or animals) in the environment, materials which objects are made of, or estimates
of distances within a space (Hill, Rieser, Hill, Halpin & Halpin, 1993).
At the conceptual level, the focus is on appropriate strategies for an efficient mapping of the space and
the generation of navigation paths. Research indicates two main scanning strategies used by people: route
and map strategies. Route strategies are based in linear (therefore sequential) recognition of spatial features.
Map strategies, considered to be more efficient than the former, are holistic in nature, comprising multiple
perspectives of the target space (Fletcher, 1980; Kitchin & Jacobson, 1997). Research shows that blind
people use mainly route strategies while recognizing and navigating new spaces (Fletcher, 1980).
Proc. 3rd Intl Conf. Disability, Virtual Reality & Assoc. Tech., Alghero, Italy 2000
2000 ICDVRAT/University of Reading, UK; ISBN 0 7049 11 42 6 53
2. THE PROPOSED STUDY
Advanced computer technology offers new possibilities for supporting visually impaired people’s acquisition
of orientation and mobility skills, by compensating the deficiencies of the impaired channel.
Research on the implementation of haptic technologies within virtual navigation environments reports on
its potential for initial training as well as for support and rehabilitation training with sighted people (Giess,
Evers & Meinzer, 1998; Gorman, Lieser, Murray, Haluck & Krummel, 1998), as well as with blind people
(Jansson, Fanger, Konig & Billberger, 1998; Colwell, Petrie & Kornbrot, 1998).
In light of these promising results, the main goals of this study are:
(a) The development of a multi-sensory virtual environment enabling blind people to learn about
different (real life) spaces which they are required to navigate (e.g., school, work place, public
buildings).
(b) The systematic study of blind people’s acquisition of spatial navigation skills by means of the virtual
environment.
In the following sections a brief description of the learning environment will be presented, as well as
preliminary results of the pre-pilot evaluation of it.
3. THE ENVIRONMENT
For the research project reported here, we developed a multi-sensory virtual environment simulating real-life
spaces. This virtual environment comprises two modes of operation:
(a) Developer / Teacher mode.
(b) Learning mode.
3.1 Developer / Teacher mode
The core component of the developer mode is the virtual environment editor. This module includes three
tools: (a) 3D environment builder; (b) Force feedback output editor; (c) Audio feedback editor.
3.1.1 3D environment builder. By using the 3D-environment editor, the developer can define the
environment characteristics. These characteristics are:
- Determine the size and the form of the room.
- Determine the ground texture.
- Selected the objects in the environment (doors, windows, walls, rectangle, cylinder etc.)
3.1.2 Force feedback output editor. By this editor the developer is able to attach Force-Feedback effects
(FFE) to all objects in the environment. Examples of FFE’s are vibrations produced by ground textures (e.g.,
stones, parquet, grass etc); force fields surrounding objects; friction sensation.
3.1.3 Audio feedback editor. This editor allows the attachment of appropriate audio-feedback to the objects,
for example: “facing a window”, “turn right” etc.
Figure 1 shows the environment-building editor screen. The interface allows the developer to determine
the different features of the target space, e.g., size, objects, FFE’s and audio effects attached to the objects,
ground texture.
By using the developer mode, the environment developer can built new navigation environments,
accordingly to the need of the users, and to progressive levels of complexity.
3.2 Learning mode
The learning mode includes two interfaces: User interface and Teacher interface.
3.2.1 The user interface. The user interface consists of a 3D virtual environment, which simulates real rooms
and objects. The user navigates this environment using the Microsoft Force Feedback Joystick (F.F.J).
During this navigation varied interactions occur between the user and the environment components. As a
result of this interactions the user get haptic feedback through the F.F.J. This feedback includes sensations
such as friction, force fields and vibrations.
Proc. 3rd Intl Conf. Disability, Virtual Reality & Assoc. Tech., Alghero, Italy 2000
2000 ICDVRAT/University of Reading, UK; ISBN 0 7049 11 42 6
54
Figure 1. 3D environment builder
By using the F.F.J the user can get information at two levels:
- Foot level – this mode provides information that is equivalent to the information that the user gets by
his feet, as he walks in the real space.
- Hand level – this mode provide information that is parallel to the information that the user gets by his
hand in the real space.
In addition the user receives auditory information generated by a “guiding computer agent”,
contextualized for the particular simulated environment. This audio feedback aims to provide appropriate
references whenever the user gets lost in the virtual space. Figure 2 shows the user-interface screen.
Figure 2. The user interface
Proc. 3rd Intl Conf. Disability, Virtual Reality & Assoc. Tech., Alghero, Italy 2000
2000 ICDVRAT/University of Reading, UK; ISBN 0 7049 11 42 6 55
Figure 3. The teacher interface
3.2.2 The teacher interface. This interface comprises series of features serving teachers during and after the
learning session. Several monitors on the screen present updated information on the user’s navigation, e.g.,
position, objects reached. In addition, other functions allow the teacher to record the user’s navigation path
and replay it aftermath to analyze and evaluate the user’s performance (Figure 3).
4. PRE-PILOT FORMATIVE EVALUATION OF THE FORCE FEEDBACK
VIRTUAL ENVIRONMENT
The pre-pilot formative evaluation stage aimed to analyze the user’s performance within the environment
regarding three main aspects:
(a) User’s response to F.F.J, and the type of FFE’s that were of high effect on the user.
(b) Users ability to identify the environment’s components. Two issues were addressed:
- User identification or recognition of the space and the objects.
- User’s difficulties in the identification of the objects’ shape and size.
(c) User navigation within the environment. Two issues were addressed:
- Environment characteristics that lead the user to high immersion-feeling.
- User’s movement in the environment.
5. METHOD
5.1 Subject
The subject, A., is a forty nine years old, a congenital blind. He is a computer user for more than eleven
years. A. using a cane for mobility in outdoor.
5.2 Procedure
The study consisted of two stages: F.F. evaluation stage, and navigation in virtual environment stage.
5.2.1 Force feedback evaluation stage. A series of probes were administered, at which different FFE’s were
tested by the subject. Data on the subject’s reports was collected by direct observation of his performance,
and by interview questions. As a result of this stage, a characterization of the potential value of the different
Proc. 3rd Intl Conf. Disability, Virtual Reality & Assoc. Tech., Alghero, Italy 2000
2000 ICDVRAT/University of Reading, UK; ISBN 0 7049 11 42 6
56
effects for the builders of navigational environment was obtained. The F.F. evaluation stage lasted about half
an hour.
5.2.2 Navigation in virtual environment stage. At the beginning of the stage the subject received a short
explanation about the features of the environment and how to operate the F.F.J. The series of tasks included:
(a) free navigation; (b) directed navigation; (c) tasks focussing on emerging difficulties; and (d) task aimed to
probe auditory support (human feedback in this preliminary version), referring to direction, turns, and
proximity to objects. As a result of this stage, a characterisation of appropriate and required features of the
environment and the navigation tools was generated. This stage lasted about forty-five minutes. At the end of
this session an open interview was conducted.
5.2.3 Data collection. Three data-collection instruments were used in this study. The first was a log
mechanism built-in in the computer system which stored the subject’s movements within the environment. In
addition the whole session was video recorded. The third data collector instrument was an open interview.
Figure 4. Subject’s navigation in the environment
6. RESULTS
6.1 Force feedback joystick features
A. Learned to work freely with the force feedback joystick within a short period of time. During the first
session A. recommended to define a magnetic force field around the objects and in front of the walls. By this
magnetic force field the user can feel an attraction or repulsion whenever he approaches an object or an
obstacle. The force feedback characterizations that were effective to the user were high resistance force,
bumps vibrations and high frictions.
6.2 Identification of environmental components
A. could identify when he bumped into an object, or arrived to one of the room’s corners. The subject could
not identify the objects. As a result of the size of the objects and without a magnetic force, the subject was
lost in the space.
6.3 Navigation
A. moved within the environment in a rapid response, the rapid walking cause him to get lost in the haptic
space. Another reason that made him to lose is way in the space, was the walking at the environment without
references.
Proc. 3rd Intl Conf. Disability, Virtual Reality & Assoc. Tech., Alghero, Italy 2000
2000 ICDVRAT/University of Reading, UK; ISBN 0 7049 11 42 6 57
Proc. 3rd Intl Conf. Disability, Virtual Reality & Assoc. Tech., Alghero, Italy 2000
2000 ICDVRAT/University of Reading, UK; ISBN 0 7049 11 42 6
58
Figure 4 shows the intricate paths in one navigation task. The paths unveils situations at which the user
got trapped in corners, lost referential landmarks in the space, or in contrast, his attempts to grasp the object
from all angles.
The pre-pilot probes resulted in the devise of several required improvements:
- Enlargement of the objects.
- Improvement of the resolution of correspondence between the movement and the force feedback.
- Introduction of friction effects for walking along the walls.
- Reduction of allowed navigation velocity in the environment.
At the time of the conference, detailed results from the actual study as well as preliminary conclusions
will be presented.
Acknowledgements. The study presented here is partially supported by Grant Microsoft Research Ltd.
7. REFERENCES
Clark-Carter, D.D., Heyes A.D. and Howarth C.I. (1986). The effect of non-visual preview upon the walking
speed of visually impaired people. Ergonomics, 29 (12), 1575-1581.
Colwell, C., Petrie, H. and Kornbrot, D. (1998). Haptic Virtual Reality for Blind Computer Users. Assets ‘98
Conference.
Dodds, A.G., Armstrong, J.D. and Shingledecker C.A., (1981). The nottingham obstacle detector:
development and evaluation. Journal of Visual Impairment and Blindness, 75 (5), 203-209.
Fletcher, J.F. (1980). Spatial representation in blind children 1: development compared to sighted children.
Journal of Visual Impairment and Blindness, 74 (10), 318-385.
Foulke, E. (1971). The perceptul basis for mobility. Research Bulletin of the American Foundation for the
Blind, 23, 1-8.
Fritz, J. P., Way, T. P. & Barner, K. E. (1996). haptic representation of scientific data for visually impaired or
blind persons. In Technology and Persons With Disabilities Conference.
Giess, C., Evers, H. and Meinzer, H.P. (1998). Hptic volume rendering in different scenarios of surgical
planning. Proceedings of the Third PHANToM Users Group Workshop, M.I.T.
Golledge, R. G., Klatzky , R. L., and Loomis, J. M. (1996). Cognitive Mapping and Wayfinding by Adults
Without Vision. In J. Portugali (Ed.). The Construction of Cognitive Maps (pp. 215-246). Netherland,
Kluwer Academic Publishers.
Gorman, P.J, Lieser, J.D., Murray, W.B., Haluck, R.S, and Krummel, T.M. (1998). Assessment and
validation of force feedback virtual reality based surgical simulator. Proceedings of the Third PHANToM
Users Group Workshop, M.I.T.
Hill, E.W., Rieser, J.J., Hill, M.M., Hill, M., Halpin, J. and Halpin R. (1993). How persons with visual
impairments explore noval spaces: Strategies of good and poor performers. Journal of Visual Impairment
and Blindness, October, 295-301.
Jansson, G., Fanger, J., Konig, H. and Billberger, K. (1998). Visually impaired persons’ use of the
PHANToM for information about texture and 3D form of virtual objects. Proceedings of the Third
PHANToM Users Group Workshop, M.I.T.
Kitchin, R.M. and Jacobson, R.D. (1997). Techniques to Collect and Analyze the Cognitive Map Knowledge
of Persons with Visual Impairment or Blindness:Issues of Validity. Journal of Visual Impairment and
Blindness, 91 (4).
Lynch, K. (1960). The image of the city. Cambridge, Ma., MIT Press.
Merria - Webster (1993). Webster’s third new international dictionary’ of the english language.
Encyclopaedia Britannica, Inc. U.S.A.
Ungar, S., Blades, M and Spencer, S. (1996), The construction of cognitive maps by children with visual
impairments. In J. Portugali (Ed.). The Consruction of Cognitive Maps (pp.247-273). Netherlands,
Kluwer Academic Publishers.
... Nevertheless, literature agrees with the fact that blind and VI people compensate for the lack of sight developing the capabilities of other senses [11,28]. Tact, hearing, and olfaction are used in an efficient way to perceive spaces and orient themselves [13,22]. Obviously, another strategy useful for this consumer group is taking advantage of guide dogs, canes, or people who accompany and guide them inside the store to navigate avoiding possible obstacles between the aisles [39]. ...
... According to research by Herman and colleagues, in fact, the spatial maps' creation of unfamiliar place is affected by the past visual experience and the accuracy of them also depends on the way in which spatial information are coded and stored in memory [15]. In this perspective, VI persons orientate themselves and create spatial maps through the use of two types of information: the points of reference, which are the environment's sensory information (tactile, acoustic or olfactory) perceived or remembered, and the reference lines, based on a continuous environmental knowledge [22]. ...
... Self-report measures were collected by semi-structured interviews, that were composed by open, open-ended and Likert scale questions and were administered in the last phase of the experimental protocol, with the aim of deepening the purchasing experience and the user sense experience of the participants, as well as their mental representation of the supermarket in terms of orientation ability, spatial representation, pleasure, and most used sensory modality. The interview consisted of 27 items, which can be divided into four areas: (i) demographic variables (items 1-7); (ii) consumer experience (items 8-10); (iii) use of senses (items [11][12][13][14][15][16][17][18][19][20][21][22]; (iv) orientation ability and spatial representation (items [23][24][25][26][27]. ...
Article
Full-text available
The literature on the consumption patterns of specific categories of consumers, such as people with disability, remains limited to date. This study explored the explicit consumer experience of a group of visually impaired (VI) consumers in-store using behavioural and self-report measures. A VI and a control group explored three different product shelves and manipulated target products inside the supermarket. Behavioural and self-report data were collected in relation to three main different phases of the in-store shopping experience: (i) the identification of a product; (ii) the style of product purchase; (iii) the consumers experience. Results showed that in the VI group, accuracy and reaction time vary by product category. Touch was the sense that most guided VI group’s product recognition, but it was also found to be significantly used by the controls across product categories. Higher levels of disorientation, difficulty in finding products, and repeating the route independently were found for VI. The results could encourage the use of tactile touchpoints, braille maps or an initial guided exploration of the supermarket, to allow the VI to memorize the internal layout of the different product categories and allow them to shop independently. This paper extends the literature on the consumption patterns of specific categories of consumers, such as people with disability, that remains limited to date. It also represents the first in-store consumer research took place in Italy comparing Italian VI people with sighted consumers behaviour.
... This is in line with some studies which stated that there are two ideas of learning strategies in the education of children with visual impairment: (1) efforts to modify the environment to fit visual impairment conditions and (2) efforts to optimally utilise the senses which still serve to compensate the weakness caused by loss of vision function. Utilising the senses that are still functioning optimally is a learning strategy that is appropriate and easy to apply in learning because optimal and integrated utilisation can determine success in learning (Friend, 2005;Kingsley, 1999;Lahav & Mioduser, 2002). ...
... In mobility orientation, the concepts of direction and distance are two important things that must be understood by a visually impaired person. By understanding this, they will be able to move around precisely and effectively, exactly in the sense that students can reach their destination in accordance with what they want, while effective means that they can get to the desired destination safely and within a short period of time (Lahav & Mioduser, 2002). ...
... The practicality of the orientation model of social mobility and communication based on mobile applications for problem-solving learning in understanding environmental concepts has been obtained through several factors (Friend, 2005;Kingsley, 1999;Lahav & Mioduser, 2002) as follows: a) The model has been developed in accordance with the practical aspects. b) The model is arranged according to the needs of visually impaired students who can solve the problem of learning to understand the campus environment. ...
Article
Full-text available
This study aims to test the results of mobile applications, namely social mobility and communication orientation models that can be used on android mobiles. This application is applied for problem-solving learning in understanding the concept of a campus environment for undergraduate visually impaired students majoring in special education, Universitas Negeri Surabaya. This research was conducted to measure the feasibility of a mobile application implemented through a questionnaire; then it was reviewed by a validation expert. Furthermore, performance test was conducted in order to be tested by the users. The application was deliberately created so that it can be operated via a cell phone. Based on the process of validity testing and practicality evaluation of the mobile application by the validator (electrical engineer) of all assessment items, the score obtained was 3.3 (good results). Meanwhile, the assessment to test application users as practitioners obtained a score of 3.2 (good results). Thus, it can be concluded that the application of the social mobility orientation model and mobile application-based communication to solve the problem of understanding the campus environment concept in the Special Education Department of undergraduate students for visually impaired students proved its worthiness. Keywords: Social mobility and communication, mobile apps.
... Android applications form mobile learning devices as one of the social communication tools developed for people with visual impairments, Mason & McCAll. (2013) ;Lahav, O and Mioduser, D. (2002); J. Ismaili, (2017). ...
Article
Full-text available
This study aims to test the effectiveness of the social mobility and communication orientation model based on internet mobile application technology (IT-SMCOM) for problem-based learning in Universitas Negeri Surabaya (Unesa) campus environment. This research method measures the effectiveness of internet mobile application technology for problem-based learning in Unesa campus environment. The results of expert validation test data and performance tests were analyzed using a descriptive form of percentage assessment of the observer team. The test results of media product experts and practitioners scored 100% excellently, and Special Education experts scored 87%. Then the effectiveness test through main field testing five visually impaired students affected by the Covid 19 pandemic scored 93% excellent (1 person), a score of 75% good (2 people), and a score of 62% adequate (2 people). Operational field testing, ten people from the Indonesian visual impairment association group and the Surabaya and Sidoarjo inclusive high school groups scored 100% excellent (one person), score 94% very good (three people), score 81% good (one person) and score 81%-84% very good (three people), score 65%- 70% adequate (two people), The conclusion of the results of data analysis of expert validation tests, practitioners suggest that the product is feasible to be tested in the field. The product effectiveness test shows that the product trial results depend on the development of the behavior and characteristics of each individual with visual impairment. Keywords: visual impairment, social, mobility, orientation, communication
... According to Lahav & Mioduser, (2002), orientation is the ability to understand the relationship between one object and another; the formation of a mental pattern from the environment. Meanwhile, mobility is intended to include the acquisition of skills and techniques that allow visually impaired people to travel more easily in their environment. ...
Article
Full-text available
UNESA is a national leader in education development. This is consistent with UNESA’s vision of achieving educational excellence. This realization is consistent with UNESA’s primary competency and capacity as a disabled-friendly campus, with one visually-impaired student. The goal of this research is to describe the outcomes of creating an Android application with a social mobility and communication focus to help students with visual impairments understand the UNESA campus environment. The product of this development research takes the form of an android application with a focus on social mobility and communication. Realization of product design, namely: 1) android application program packaged in mobile phones, 2) practical guide to access the outdoor environment on the way to various places in the UNESA Lidah Wetan and Ketintang campus environment with braille writing and writing alert, 2) cooperative form of think pair share type, 3) authentic assessment tool as a successful use of android applications in social orientation and communication mobility. The products created will be used by all visually impaired students who wish to visit the UNESA campuses in Lidah Wetan and Ketintang. UNESA’s inclusive campus is a place for all disabled people who want to continue their education, including the visually impaired who require environmental mobility facilities.
... illustrate the need for O&M skills and the importance of systematic instructional activities. The literature on people with visual impairment has shown that "mobility is an important part of daily life and its impairment greatly affects the quality of life" (Lahav & Mioduser, 2002). ...
Article
Full-text available
: This research aims to identify the main problems experienced by adults with visual impairments regarding the use and accessibility of orientation and mobility skills and offer solutions for these problems. For this purpose, the knowledge of individuals with visual impairment on orientation and mobility skills and the problems they experience while using these skills and using public transport were discussed. Additionally, the skills they most need and want to learn, and the environment, people, and teaching style they want when being taught these skills were examined in detail according to the participants’ opinions. In the study, phenomenology design, one of the qualitative research methods, was used. 17 adults participated in the research, which would provide the most diversity for demographic information such as age, gender, and educational status. The research data were collected with the interview form tool consisting of semi-structured questions. The interviews were deciphered and transferred to the MAXQDA program, which is a computer-aided qualitative data analysis program for analysis. The descriptive analysis method was used in the analysis of the obtained data. As a result of the study, it was found that the level of education in orientation and mobility is quite low and they need to be trained. They suffer accidents due to lack of education, architectural/environmental precautions, inadequacy of measures taken for transportation, lack of assistive technology, attitude of people and lack of training of sighted guides. O&M programs can be developed for adults that include various indoor and outdoor routes and using transport.
... Visually impaired Visually impaired players pose a great challenge, since (unlike the loss of smell or taste) the loss of vision strips the subject off a sense with enormous information processing capabilities [6]. We humans use a combined product of motor, sensory and cognitive skills to effectively navigate through space and most of the information used for this is gathered via our vision [7]. Hence it is logical, that by losing such a powerful source of information and the ability to efficiently process them, we have to compensate for it. ...
Chapter
The exclusion of impaired people from various areas of life is undeniable, leisure and entertainment (including games) being definitely among them. The paper focuses on the research of the current state of accessibility in gaming, non-mental disabilities (grouped into visual, auditory and physical) and the ways of compensating for them in real life and gaming. It results in the development of a game prototype with assisstive AI for physically challenged players, which is then subsequently tested in field on a mixed school with both challenged and unchallenged children and aims to breach the barrier of impaired players feeling “left out”, bringing both groups of players together through making them realize their similarities, rather than their differences. The aim was to help and empower the player, not replace him.
Chapter
Games have become increasingly used by people with visual disabilities. Some studies introduce videogames or game-type applications for entertainment purposes in this population. Others have focused on the use of games to develop and enhance cognitive skills to help people with disabilities to learn and understand to get more independence and autonomy, thus becoming better integrated and included in society. This chapter presents and discusses the design and use of multimodal videogames to enhance learning and cognition in learners who are blind. We designed, implemented, and evaluated the cognitive impact of three audio- and haptic-based videogames. The purpose of these videogames was to develop and improve orientation and mobility skills (O&M) in learners who are blind, supporting the construction of mental maps of the virtual space navigated through the integration of audio and haptic components. The results showed that playing and training with the videogames improved the navigation skills performance in learners who are blind. The contribution of this work is that multimodal interfaces through videogaming can help to develop O&M skills and thus make the playful aspects of the game and their associated technologies positively influence the motivation of end users. The audio, haptics, and a combined audio-haptics stimuli aided in creating an increased understanding of the learners’ senses. It was observed that for orientation purposes, users preferred the use of hearing rather than touch because audio maps more appropriately the surrounded space.
Article
Full-text available
his article is an assessment of a variety of techniques used by researchers in the fields of geography, psychology, urban planning, and cognitive science to col- lect and analyze data on how people with visual impairment or blindness learn, understand, and think about geographic space. The authors concluded that these tech- niques and their results need to be used cautiously. They also made recommendations for increasing the validity of future studies, including the use of multiple, mutually supportive tests; larger sample sizes, and movement from the laboratory to real- world environments. Golledge (1993) suggested that the inability to travel independently and interact with the wider world is one of the most significant handicaps that can be caused by visual impairment or blindness, second only to the inability to communicate by reading and writing. Clark-Carter, Heyes, and Howarth (1986) reported that at least 30 percent of persons with visual impairment or blindness make no indepen- dent journeys outside their homes. The majority of those who do venture out adhere to known routes because exploration can lead to disorientation; chaos; and the fear,. stress, and panic associated with being lost (Golledge, 1993; Hill, et al., 1993). Such entrapment reduces the independence and 'quality of life for many persons with visual impairment or blindness. Cognitive map- ping rese&ch focuses on how individuals acquire, learn, develop, think about, and store data relating to the everyday geo-
Article
The Nottingham Obstacle Detector (NOD) is an ultrasonic handheld aid designed to help visually handicapped people detect obstacles as they travel. NOD emits pulses of high-frequency sound up to 7 1/2 feet ahead of the user. The pocket-sized secondary device requires little training and is intended to be used with a primary aid (long cane, dog guide). This article describes the development of the NOD and the results of two evaluation studies that tested the efficacy of the device.
Article
The article describes the development of the Nottingham Obstacle Detector (NOD), an ultrasonic handheld aid designed to help visually handicapped persons detect obstacles as they travel. Results of six mobility tasks are explained to point out definite advantages of NOD. (Author/CL)
Article
Studies of the development of spatial representation have led to blind children being characterized as deficient, inefficient, or different when compared to sighted children. The study described in this article involved 68 blind and blindfolded sighted students who explored a real or model room, either freely or guided along a predetermined route. The subjects then were questioned about the position of furniture in the room. Some questions could be answered from memory of the route traversed; others required the formation of a cognitive map for their solution. Data were analyzed in terms of the proportion of each type of question correctly answered by each age group. As a group, sighted students performed better than blind students. However, some blind students performed as well as the sighted students. The results of the study show the deficiency theory to be untenable, but do not provide conclusive support for either the inefficiency or difference theories.
Article
Compares the tasks of a blind and of a sighted person in maneuvering in the environment. Based on an analysis of the probability task, it is concluded that such an understanding of the mobility process would result in more efficient training methods and better mobility aids. A large number of specific research questions are posed. (PsycINFO Database Record (c) 2012 APA, all rights reserved)
Article
Examined the videotaped search patterns and strategies that 65 persons (aged 16–63 yrs) with visual impairments used to learn the arrangement of 5 objects in a novel space. Videotapes of the 15 best-performing and 15 worst-performing Ss' explorations were then compared to the Ss' verbal self-reports of the strategies they used. The best-performing Ss used search patterns and strategies that were effective in locating objects quickly and that facilitated the development of object-to-object relationships. They seemed to implement systematic perimeter and/or gridline patterns and to utilize their canes efficiently to locate the target objects. The self-reported strategies and mapped search patterns of 3 of the cases are presented. (PsycINFO Database Record (c) 2012 APA, all rights reserved)