Conference Paper

Direct observation of tactile geometric drawing by visually impaired and blind students

Authors:
To read the full-text of this research, you can request a copy directly from the authors.

Abstract

Reading and drawing geometric shapes are challenging tasks for visually impaired and blind users. The development of a human-centered design solution to address these issues and simulate the techniques of tactile drawing requires a detailed understanding of the process. The objective of this study is to understand the method of reading compound shapes and drawing primitive shapes (triangle and rectangle) to help design digital drawing tool. We conducted a direct observational study of tactile reading and drawing tasks along with semi-structured interviews of 10 visually impaired and blind students. We analyzed the data through affinity analysis and identified a set of validation strategies for drawing and shape identification techniques for reading used by the participants for error prevention and recovery. We present the findings in detail and discuss them in this paper. We believe that the findings will help designers, developers, and researchers to design technology-based interventions for non-visual drawing.

No full-text available

Request Full-text Paper PDF

To read the full-text of this research,
you can request a copy directly from the authors.

Article
Full-text available
The blind student's interpretation of two-dimensional shapes represents the blind student's mental image of two-dimensional shapes that they can't visualize directly, which is related to illustration of the characteristics and number of edges and angles. The objective of this research is to identify the blind student's interpretation of two-dimensional shapes. This research was an exploratory study with qualitative approach. A subject of this research is a sixth-grade student who experiencing total blind from the fifth grade of elementary school. Researchers interviewed the subject about his interpretation of two-dimensional shapes according to his thinking.The findings of this study show the uniqueness of blind students, who have been totally blind since school age, in knowing and illustrating the characteristics of edges and angles of two-dimensional shapes by utilizing visual experiences that were previously obtained before the blind. The result can inspire teachers to design further learning for development of blind student geometry concepts.
Article
Full-text available
The paper investigates the formal characteristics of drawings made by congenitally blind children and teenagers as well as the possibility and level of accuracy in the recognition of these drawings by sighted individuals. The study involved children and students aged seven to fifteen years. The formal features predominant in the drawings analyzed were typical for the failed realism stage. As an additional goal of the study, we investigated the usefulness of the transfograph as an educational resource supporting the introduction of tactile graphics to congenitally blind persons. Drawings made by blind subjects before and after training with a transfograph revealed a similar level of difficulty with their identification. However, following a prompt about the subject of each drawing, those made after the training were described by judges as more easily identifiable. In addition, the drawings made after training showed fewer features of failed realism.
Conference Paper
Full-text available
It can be very difficult and sometimes impossible for people who are blind to create visual diagrams on their own. Even with sighted assistance, it can be difficult to verbally convey the visual image in one's mind. We conducted a survey to determine the need of people who are blind to create their own diagrams. Based on this survey, we created a preliminary design probe app on a tablet and revised the prototype through preliminary user feedback. Then, using this second app, we conducted a design probe study with 8 participants who are visually impaired and interviewed them about the potential of using touchscreens to create diagrams. Our results show that most participants were enthusiastic about the possibility of creating their own diagrams via a touchscreen and felt that this also makes touchscreens more accessible to them, creating more inclusion for them in the use of touchscreens.
Article
Full-text available
This article presents initial experiences using vibratory touchscreens and audible sounds to communicate graphical concepts in mathematics education to students with visual impairments. These studies are motivated by the prospect of displaying graphical and mathematical concepts typically taught in a highly visual manner through nonvisual channels. First, a touchscreen-based teaching paradigm for math education of individuals with visual impairments is introduced and hardware and software employing commercially available and open source components are presented. Then, pilot studies on user comprehension of grids and points—graphical entities students encounter early in K–12 mathematics education and that can serve as building blocks for more complex lessons—are presented. These studies, conducted with students with visual impairments, explore perception of objects through haptic feedback alone, auditory feedback alone, and combinations of the two. The results show that each student could successfully find and locate 100% of displayed points on a grid. These results, complemented with the positive qualitative feedback received from students and their teachers, suggest that vibratory touchscreens have the potential to be beneficial in the classroom for conveying graphical math concepts.
Conference Paper
Full-text available
In this paper, we investigate tools to support blind children’s learning geometry, a topic traditionally difficult to teach to visually impaired subjects. We created an accessible android application designed to allow children to make freehand drawings and play with geometry, recognizing common geometric shapes or topological configurations. An initial usability test on the application was performed by a blind researcher and revealed some limitations of this approach. We discuss them, proposing possible improvements, thanks to the promise of technological innovation in a mobile world.
Conference Paper
Full-text available
The problem of blindness and other eye disabilities is highly important as it affects millions of people on the globe. In the same time, the number of modern touchscreen devices is increasing fast. They are widely spread and becoming accessible for education purposes. For those who suffer from congenital visual disabilities is very difficult to imagine the world as it is and the struggle begins from the early school stages and continues for the rest of their lives. Modern touchscreen devices, also called smart devices, represent a viable solution for people with sight problems due to their rich multimedia experience. Thus, they can be used as assistive devices. This paper describes how learning basic geometric shapes using a smartphone or a tablet can improve several important aspects like: general feeling of using touchscreen devices, perception of a basic figure’s shape by simply touching the screen, intuition on how to follow a GPS map. This methodology represents only the initial stage from a long-term learning process that aims to help visually impaired people to understand and use the power of smart devices in order to perceive the world around them as normal people do.
Article
Full-text available
Uma das críticas feitas a estudos empíricos de base qualitativa diz respeito ao uso inadequado de metodologias de pesquisa, fruto de uma relação pouco criteriosa entre objeto/problema de pesquisa e procedimentos de produção de dados. Muitas vezes, deixa-se de levar em conta que a adoção de determinada metodologia é orientada pelo que é necessário fazer para obter material empírico cuja densidade e riqueza permitam uma melhor apreensão dos diferentes aspectos que envolvem o problema acerca do qual se empreende uma investigação, para que seja possível formular hipóteses bem fundamentadas. Cabe ao pesquisador escolher o método que melhor se adéqua à obtenção dos dados e aos pressupostos teóricos que a orientam, e, para tanto, ele precisa ter conhecimento de diferentes possibilidades de escolha. O presente artigo apresenta reflexões e orientações acerca do uso, cada vez mais frequente, de videogravações na realização de pesquisas qualitativas, discutindo especificidades da produção e da análise de materiais audiovisuais articulados a procedimentos de investigação em ciências sociais e humanas. As considerações apresentadas aqui foram construídas a partir da experiência com o uso desse recurso em pesquisas realizadas pelas autoras ao longo dos últimos cinco anos, em diálogo com publicações de outros pesquisadores que, tendo também trabalhado com esse recurso, relatam, em seus textos, dificuldades e soluções relacionadas à sua adoção. Espera-se, assim, contribuir para o debate acerca da necessária e estreita correlação entre objeto e método em estudos empíricos.
Article
Full-text available
Resumo Uma das críticas feitas a estudos empíricos de base qualitativa diz respeito ao uso inadequado de metodologias de pesquisa, fruto de uma relação pouco criteriosa entre objeto/problema de pesquisa e procedimentos de produção de dados. Muitas vezes, deixa-se de levar em conta que a adoção de determinada meto-dologia é orientada pelo que é necessário fazer para obter ma-terial empírico cuja densidade e riqueza permitam uma melhor apreensão dos diferentes aspectos que envolvem o problema acerca do qual se empreende uma investigação, para que seja possível formular hipóteses bem fundamentadas. Cabe ao pes-quisador escolher o método que melhor se adéqua à obtenção dos dados e aos pressupostos teóricos que a orientam, e, para tanto, ele precisa ter conhecimento de diferentes possibilidades de escolha. O presente artigo apresenta reflexões e orientações acerca do uso, cada vez mais frequente, de videogravações na realização de pesquisas qualitativas, discutindo especificidades da produção e da análise de materiais audiovisuais articulados a procedimentos de investigação em ciências sociais e huma-nas. As considerações apresentadas aqui foram construídas a partir da experiência com o uso desse recurso em pesquisas realizadas pelas autoras ao longo dos últimos cinco anos, em diálogo com publicações de outros pesquisadores que, tendo também trabalhado com esse recurso, relatam, em seus textos, dificuldades e soluções relacionadas à sua adoção. Espera-se, assim, contribuir para o debate acerca da necessária e estrei-ta correlação entre objeto e método em estudos empíricos.
Article
Full-text available
This paper addresses the problem of computer-aided drawing for the visually impaired without using special purpose external devices. We introduce the Integrated Communication 2 Draw (IC2D) system, which has a user interface that enables navigation and drawing on the screen using audio feedback. Navigation and point selection are done via a new recursive scheme based on the layout of the telephone keypad.
Conference Paper
Full-text available
We propose the use of a haptic touchscreen to convey graphical and mathematical concepts through aural and/or vibratory tactile feedback. We hypothesize that an important application of such a display will be in teaching visually impaired students concepts that are traditionally learned almost entirely visually. This paper describes initial feasibility studies using a commercially available haptic touchscreen to display grids, points, lines, and shapes - some of the first visual graphical entities students encounter in K-12 mathematics education, and from which more complex lessons can be constructed. We conducted user studies designed to evaluate perception of these objects through haptic feedback alone, auditory feedback alone, and combinations of the two. Our results indicate that both sensory channels can be valuable in user perception.
Conference Paper
Full-text available
Considerations about blind p eople's relation to p ictures of real world ob jects lead to the c onclusion that blind and sighted people have very similar mental models of the 3D world. Because perception works completely differently, the mapping of the 3D world to a 2D picture differs s ignificantly. A tool has been developed to allow blind people to draw pictures and at the same time study their drawing process. A first evaluation shows interesting results. These will eventually lead to a design o f a rendering tool for (tactile) pictures for blind people.
Conference Paper
Full-text available
In technical reports and papers interrelations are often represented as diagrams. With the aid of a touch panel and auditory display AudioGraf enables blind and visually impaired people to read such diagrams. The diagram is displayed on the touch panel where a part can be selected with a finger. The selected part will be auditorally displayed. If the finger is moved, another part is selected and auditorally displayed. This way the whole diagram can be explored in an audio-tactile way. A model of this audio-tactile exploration is presented. Based on this model it is explained how AudioGraf supports the user. Usability tests have shown that simple diagrams can be. read by blind users within relative short time.
Conference Paper
Full-text available
Existing drawing tools for blind users give inadequate contextual feedback on the state of the drawing, leaving blind users unable to comprehend and successfully produce graphical information. We have investigated a tactile method of drawing used by blind users that mimics drawing with a pencil and a paper. Our study revealed a set of properties that must be incorporated into drawing tools for blind users, including giving feedback for relocating important points, determining angles, and communicating the overall structure of the drawing. We describe a gridbased model that provides these properties in a primitivebased 2D graphics environment, and we introduce its use in drawing and other graphical interactions. KEYWORDS Non-visual drawing tools, GUIs for blind users, contextual inquiry, feedback, grid
Conference Paper
Full-text available
In this paper we describe one method of transforming a mouse-based graphical user interface into a navigable, grid-based auditory interface. We also report the results of an experiment that tested the effectiveness of a drawing tool for the blind called IC2D that uses this interaction style. The experiment included eight visually impaired participants and eight blindfolded sighted participants. The results show that auditory interpretation of graphics is an effective interface technique for visually impaired users. Further, the experiment demonstrates that visually impaired users can develop meaningful drawings when given adequate technological support.
Conference Paper
Full-text available
This paper illustrates work undertaken on the MultiVis project to allow visually impaired users both to construct and browse mathematical graphs effectively. We start by discussing the need for such work, before discussing some of the problems of current technology. We then discuss Graph Builder, a novel tool to allow interactive graph construction, and Sound Bar which provides quick overview access to bar graphs.
Conference Paper
Full-text available
In this paper we discuss why access to mathematical gra- phs is problematic for visually impaired people. By a review of graph understanding theory and interviews with visually impaired users, we explain why current non-visual represen- tations are unlikely to provide effective access to graphs. We propose the use of multiple views of the graph, each pro- viding quick access to specific information as a way to im- prove graph usability. We then introduce a specific multiple view system to improve access to bar graphs called Sound- Bar which provides an additional quick audio overview of the graph. An evaluation of SoundBar revealed that additio- nal views significantly increased accuracy and reduced time taken in a question answering task.
Article
Full-text available
Drawing is an important vehicle for communication that can express visual information more precisely than only words. Although it is intrinsically a visual activity, people who are blind can make and understand drawings through the sense of touch. In many cases, they have been using raised-line drawing kits to make tactile drawings. Also, an experimental system called TDraw, which uses swell paper and a digitizer, enables them not only to draw, but to record the drawings electronically (Kurze, 1996). However, none of these tools allows users to erase raised lines once they are drawn, whereas sighted persons can erase unwanted lines with an eraser. The goal of the project reported here was, therefore, to develop a device that enables blind users not only to draw but to erase raised lines as freely as they want to. The indelibility problem of tactile drawings could be solved by using refreshable tactile displays instead of plastic or swell paper. One technical challenge in using them, however, is how to track the motion of the stylus above the tactile display. The authorstextquoteright solution was to connect the drawing stylus and the display device with a two-axis arm that outputs angular positions. With this system setup, users can move the stylus above the tactile surface so as to draw freely and erase tactile drawings.
Conference Paper
Full-text available
We present a tangible user interface (TUI) called Tangible Graph Builder, that has been designed to allow visually impaired users to access graph and chart-based data. We describe the current paper-based materials used to allow independent graph construction and browsing, before discussing how researchers have applied virtual haptic and non-speech audio techniques to provide more flexible access. We discuss why, although these technologies overcome many of the problems of non-visual graph access, they also introduce new issues and why the application of TUIs is important. An evaluation of Tangible Graph Builder with 12 participants (8 sight deprived, 4 blind) revealed key design requirements for non-visual TUIs, including phicon design and handling marker detection failure. We finish by presenting future work and improvements to our system.
Article
Full-text available
We compared the abilities of blind and sighted humans to distinguish grooved from smooth surfaces pressed against the stationary index fingertip. Ranging in age from 20 to 72 years, 37 blind and 47 sighted subjects participated in an automated two-alternative forced-choice tactile grating detection task. The tactile acuity of blind and sighted subjects declined with age at equivalent rates (0.011-mm threshold increase per year), but the blind subjects were able to perceive significantly thinner grooves than were their sighted peers (the average difference between blind and sighted subjects of the same age and gender was 0.267 mm). The blind Braille readers performed no better than the blind nonreaders, and the congenitally blind subjects performed equivalently to those with adult-onset blindness. The superior tactile acuity of blind persons may result from the involvement of normally visually responsive cerebrocortical areas in tactile processing, as shown by functional-imaging studies.
Conference Paper
Full-text available
Haptic technology has great potentials in many applications. This paper introduces our work on delivery haptic information via the Web. A multimodal tool has been developed to allow blind people to create virtual graphs independently. Multimodal interactions in the process of graph creation and exploration are provided by using a low-cost haptic device, the Logitech WingMan Force Feedback Mouse, and Web audio. The Web-based tool also provides blind people with the convenience of receiving information at home. In this paper, we present the development of the tool and evaluation results. Discussions on the issues related to the design of similar Web-based haptic applications are also given.
Article
Basic arithmetic operations are essential skills needed in our life, and this is no different for the visually impaired. However, working arithmetic out on paper is always a challenge for visually impaired people. This situation is exacerbated by low-resource settings due to a paucity of low-cost and easy-to-use solutions. As a remedy to this situation, we propose a low-cost and easy-to-use arithmetic learning framework and draw a contrast between the conventional means of solving arithmetic problems and our proposed framework. Our proposal is engendered from comprehensive studies, both qualitative and quantitative, over the challenges faced by visually impaired children from two low-income countries. These studies are conducted in three phases—exploratory, descriptive, and explanatory—involving six visually impaired children and sixteen visually impaired grownups. User evaluation of our framework, in disguise of a tutorial session, confirms its acceptability and adaptability, along with its effectiveness in evoking interest in arithmetic. We believe that our study and proposed framework will help in breaking barriers to similar challenges in other developing regions across the border.
Conference Paper
In this paper, we present a drawing workstation for blind people using a two-dimensional tactile pin-matrix display for in- and output. Four different input modalities, namely menu-based, gesture-based, freehand-stylus and a Time-of-Flight (ToF) depth segmentation of real-world object silhouettes, are utilized to create graphical shapes. Users can freely manipulate shapes after creation. Twelve blind users evaluated and compared the four image creation modalities. During evaluation, participants had to copy four different images. The results show that all modalities are highly appropriate for non-visual drawing tasks. There is no generally preferred drawing modality, but most participants rated the robust and well-known menu-based interaction as very good. Furthermore, menu was second in performance and the most accurate drawing modality. Our evaluation demonstrated direct manipulation works well for blind users at the position of the reading hand. In general, our drawing tool allows blind users to create appealing images.
Article
This paper describes the evaluation of software, software designed to allow visually impaired users to explore the structures of chemical molecules using a speech based presentation. Molecular structures are typically presented as two dimensional schematics, and are an important example of a widely used form of diagram -- the graph. software is designed for exploring this specific class of graph. Among its features is the ability to recognise and make explicit features of the graph that would otherwise need to be inferred. The evaluation compared software with a simpler version without this facility, and found that participants were able to explore molecular structures more easily. We discuss the software, evaluation and results, particularly comparing them with theoretical considerations about how sighted readers use diagrams. Finally, we extract the important issues for non-visual graph presentation: making implicit features explicit; enabling hierarchical and connection-based browsing; allowing annotation; and helping users keep their orientation.
Conference Paper
Geometry is a traditionally difficult subject to teach to visually impaired subjects. This paper investigates tools to help blind children learn geometry. An accessible vibro-tactile-based android application has been designed to allow children to make freehand drawings and play with geometry, recognizing common geometric shapes or topological configurations. An initial usability test of the application, performed by a blind researcher, has revealed some limitations of the proposed approach that could soon be overcome thanks to current technological innovation in the mobile world.
Conference Paper
Combinatorial graphs, often conveyed as node-link diagrams, figure prominently in Computer Science and other Science, Technology, Engineering, and Mathematics (STEM) disciplines. Unfortunately, they are most often inaccessible to blind students and professionals. This paper introduces GSK, a self-contained Graph SKetching tool that allows blind and sighted people to easily create, edit, and share graphs in real-time using interaction mechanisms (mouse, keyboard, monitor, screen reader) that are standard for them. GSK was successfully used by a blind Computer Science student and his sighted instructors to create and access graphs specific to his automata theory and operating systems courses. Our hope is that GSK will enable more blind STEM students and professionals to actively participate in their disciplines by providing them and their sighted colleagues with a cross-collaboration tool that allows them to share graphs just as easily as they share text and word processing documents.
Conference Paper
While sighted users may learn to perform touchscreen gestures through observation (e.g., of other users or video tutorials), such mechanisms are inaccessible for users with visual impairments. As a result, learning to perform gestures can be challenging. We propose and evaluate two techniques to teach touchscreen gestures to users with visual impairments: (1) corrective verbal feedback using text-to-speech and automatic analysis of the user's drawn gesture; (2) gesture sonification to generate sound based on finger touches, creating an audio representation of a gesture. To refine and evaluate the techniques, we conducted two controlled lab studies. The first study, with 12 sighted participants, compared parameters for sonifying gestures in an eyes-free scenario and identified pitch + stereo panning as the best combination. In the second study, 6 blind and low-vision participants completed gesture replication tasks with the two feedback techniques. Subjective data and preliminary performance findings indicate that the techniques offer complementary advantages.
Article
A novel approach for enabling blind people to interact with computer-generated graphical information is presented. The paper discusses how computer-generated, text-based information is presented to blind people and then identifies the difficulties in providing similar access to the range of graphical information presented by computer systems. A computer-based system that allows blind users to read, create and edit one type of schematic diagram, namely data flow diagrams used in software engineering, is presented, together with the mapping from the original diagram to a suitable generic, tactile diagram. Results of the evaluation of the approach are given, as are suggested adaptations of the approach that can present tabular information and time-ordered schematic diagrams to a user.
Article
In their specialized schooling, blind children are now frequently presented with raised line figures and maps. However, there is still much to do in evaluating the cognitive effects of training using these displays. The purpose of this research is to determine if the level of expertise in the haptic exploration, and the perception of the raised line materials, may enhance blind people’s spatial imagery. We have observed that in all the tasks in this study (mental rotation, mental spatial displacement and estimation of length tasks) the congenitally blind experts performed better than the early and late blind non‐experts, and that the early blind experts performed even better than the late blind non‐experts. These observations suggest that a high level of expertise in congenitally and early blind people may compensate for the impairment in spatial representation often resulting from lack of visual experience.
Article
We studied the development of spontaneous tactile drawing in three 12-year-old children with congenital total blindness and with no previous drawing tuition. In a period of 9 months, from an initial phase in which they were taught to draw tangible straight and curve raised lines, the three blind children went on making spontaneous raised outlines representing edges, surfaces of objects, vantage point, and motion. The corpus of drawings produced by these children shows that several aspects of outline pictures can be implemented through touch. The perceptual principles represented in these drawings are comparable to those commonly found in sighted children. On the one hand, this convergence indicates similarities in the way vision and touch mediate the acquisition and the conceptualisation of spatial information from objects and the environment. On the other hand, it reflects the influence of cross-modal plasticity typically associated with early or congenital blindness. This study suggests that drawing development in general does not depend on learning pictorial conventions. Rather it seems driven by natural generativity based on children’s knowledge of space and perceptual principles.
Conference Paper
We demonstrate the most recent version of our system to communicate graphs and relational information to blind users. We have developed a system called exPLoring graphs at UMB (PLUMB) that displays a drawn graph on a tablet PC and uses auditory cues to help a blind user navigate the graph. This work has applications to assist blind individuals in Computer Science and other educational disciplines, navigation and map manipulation.
Conference Paper
Historically, the development of computer systems has been primarily a technology-driven phenomenon, with technologists believing that "users can adapt" to whatever they build. Human- centered design advocates that a more promising and enduring approach is to model users' natural behavior to begin with so that interfaces can be designed that are more intuitive, easier to learn, and freer of performance errors. In this paper, we illustrate different user-centered design principles and specific strategies, as well as their advantages and the manner in which they enhance users' performance. We also summarize recent research findings from our lab comparing the performance characteristics of different educational interfaces that were based on user-centered design principles. One theme throughout our discussion is human- centered design that minimizes users' cognitive load, which effectively frees up mental resources for performing better while also remaining more attuned to the world around them. Categories and Subject Descriptors
Conference Paper
This paper presents the ongoing design and evaluation of an audio-haptic drawing program that allows visually impaired users to create and access graphical images. The application is developed in close collaboration with a user reference group of five blind/low vision school children. The objective of the application is twofold. It is used as a research vehicle to investigate user interaction techniques and do basic research on navigation strategies and help tools, including e.g. sound fields, shape creation tools and beacons with pulling forces in the context of drawing. In the progress of the development, the preferred features have been implemented as standard tools in the application. The final aim of the application in its current form is to aid school work in different subjects, and part of the application development is also to create tasks relevant in a school setting.
Conference Paper
Many individuals who are blind or visually impaired are interested in drawing tactile pictures, and some have already done so with static raised-line drawing kits. However, static raised-line drawing kits are problematic as they are non-erasable. Various computer systems, with or without accompanying device interfaces, have been designed to allow these individuals the ability to both perceive and construct their own drawings on a computer, but each with various drawbacks. A focus group was conducted to gain input from blind and visually impaired computer users on a new design. Based on these results, a new multimodal device design concept has been generated which will improve upon previous solutions and give graphic editing and viewing to blind and visually impaired individuals at a low cost.
Article
This paper describes "From Dots to Shapes" (FDTS), an auditory platform composed by three classic games ("Simon", "Point Connecting" and "concentration game") for blind and visually impaired pupils. Each game was adapted to work on a concept of the Euclidean geometry (e.g. ) The tool, , is based on sonic and haptic interaction, and therefore could be used by special educators as a help for teaching basic planar geometry.
American Foundation for the Blind
  • P Edman
American Foundation for the Blind
  • P Edman
  • Tactile
  • Graphics
Edman, P. Tactile graphics. American Foundation for the Blind, 1992.
From dots to shapes: an auditory haptic game platform for teaching geometry to blind pupils
  • Roth P Petrucci
  • L S Assimacopoulos
  • A Pun
Development of drawing abilities in a distinct population: Depiction of perceptual principles by three children with congenital total blindness
  • A D'angiulli
  • S D'angiulli
  • D'Angiulli A.
American Foundation for the Blind , 1992 . Edman, P. Tactile graphics. American Foundation for the Blind
  • P Edman
  • Edman P.