Lori Petrucci’s research while affiliated with University of Geneva and other places

What is this page?


This page lists works of an author who doesn't have a ResearchGate profile or hasn't added the works to their profile yet. It is automatically generated from public (personal) data to further our legitimate goal of comprehensive and accurate scientific recordkeeping. If you are this author and want this page removed, please let us know.

Publications (15)


A Comparison of Three Nonvisual Methods for Presenting Scientific Graphs
  • Article

June 2002

·

32 Reads

·

26 Citations

Journal of Visual Impairment & Blindness

·

·

Lori Petrucci

·

This study implemented three different methods for presenting scientific graphs to visually impaired people: audition, kinesthetics, or a combination of the two. The results indicate that the combination of both audio and kinesthetic modalities can be a promising representation medium of common scientific graphs for people who are visually impaired.


"From Dots To Shapes": an auditory haptic game platform for teaching geometry to blind pupils

May 2001

·

125 Reads

·

28 Citations

This paper describes "From Dots to Shapes" (FDTS), an auditory platform composed by three classic games ("Simon", "Point Connecting" and "concentration game") for blind and visually impaired pupils. Each game was adapted to work on a concept of the Euclidean geometry (e.g. ) The tool, , is based on sonic and haptic interaction, and therefore could be used by special educators as a help for teaching basic planar geometry.


An audio-haptic tool for non-visual image representation

February 2001

·

21 Reads

·

15 Citations

This paper reports on the design of an audio-haptic tool that enables blind computer users to explore a picture by the hearing and feeling modalities. The tool is divided in two entities: a description tool and an exploration tool. The description tool allows moderators (sighted person) to describe a scene. Therefore, the scene is firstly segmented manually or automatically into a set of objects (car, tree, house, etc.). For. every object, the moderator can define a behavior which correspond either to an auditory (i.e., using speech or non-speech sound) or to a kinesthetic rendering. The blind person uses the exploration tool in order to obtain the audio-haptic rendering of the segmented image previously defined by the moderator. Depending on the nature of the feedback defined (audio, kinesthetic), the blind user interacts either with a graphic tablet and/or a force feedback device



Figure 1. WebSound global architecture. The WebSound components shown in figure 1 have been developed in order to furnish a set of functionalities that will permit programmers to easily add new behavioral model onto the application. This set of functionalities primarily consists of: @BULLET the Internet Explorer ActiveX component that will be responsible for the Internet browsing;  
Figure 2a. WebSound interface displaying Internet Explorer. Figure 2b. WebSound interface displaying the Workspace.  
Figure 3. A HTML document and its hierarchical representation  
Figure 4. An example of a dynamic sonic model.  
WebSound: a generic Web sonification tool, and its application to an auditory Web browser for blind and visually impaired users
  • Article
  • Full-text available

July 2000

·

101 Reads

·

16 Citations

The inherent visual nature of Internet browsers makes the Web inaccessible to the visually impaired. Although several nonvisual browsers have been developed, they usually transform the visual content of HTML documents into textual information only, that can be rendered by a text-to-speech converter or a Braille device. The loss of spatial layout and of textual attributes should be avoided since they often bear visually important information. Moreover, typical non-visual Internet browsers do not allow visually impaired and sighted individuals to easily work together using the same environment. This paper presents WebSound, a new generic Web sonification tool and its application to a 3D audio augmented Internet browser (Internet Explorer 5.0) developed by the Computer Vision Group at the University of Geneva.

Download

Audio-Haptic Internet Browser And Associated Tools For Blind And Visually Impaired Computer Users

March 2000

·

83 Reads

·

29 Citations

In the Internet world, the widespread use of graphical user interfaces (GUIs) increasingly bars visually handicapped people from accessing digital information. In this context our project aims at providing sight handicapped people with alternative access modalities to various types of GUIs and graphic intensive programs, in order for instance to facilitate usage of Web services. We describe in this paper ABWeb [1], a 3D-audio Web browser that allows blind computer users to explore Web pages, fill in forms, etc., using a 3D sonic rendering. We also present WebSound [2], a generic tool that permits to associate with each HTML tag a given sonic object (earcon or auditory icon). Finally, we describe a series of associated programs composed of the family of sonic games From Dots to Shapes [3], as well as of IDEA, a tool that lets users comprehend simple drawings, as well as to create graphics. Keywords: WWW, blind users, 3D virtual sound space, multimodal interface, sound and image proces...



Figure 1. Snapshot of the WebSound interface <HTML> <HEAD> <TITLE>home page</TITLE> </HEAD> <BODY> <P> <IMG SRC= " images/logo.gif " > </P> </BODY> </HTML> Figure 2. hierarchical (a) and textual representation (b)  
WebSound: a generic Web sonification tool allowing HCI researchers to dynamically create new access modalities

December 1999

·

44 Reads

·

4 Citations

The World Wide Web (WWW) has recently become the main source of digital information accessible everywhere and by everyone. Nevertheless, the inherent visual nature of Internet browsers makes the Web inaccessible to the visually impaired. To solve this problem, non-visual browsers have been developed. One of the new problems, however, with those non-visual browsers is that they often transform the visual content of HTML documents into textual information only, that can be restituted by a text-tospeech converter or a Braille device. The loss of spatial layout, and textual attributes such as boldface, italic, underline, color or even size should be avoided since they often bear visually important information. Moreover, typical non-visual Internet browsers do not allow visually impaired and sighted individuals to easily work together using the same environment. These new problems have to be solved with new alternative non-visual display techniques. This paper presents WebSound, a new gener...


Auditory Browser for Blind and Visually Impaired Users

April 1999

·

23 Reads

·

31 Citations

This paper presents our work on the development of a multimodal auditory interface which permits blind users to work more easily and efficiently with GUI browsers. A macro-analysis phase, which can be either passive or active, informs on the global layout of HTML documents. A subsequent active micro-analysis phase allows to explore particular elements of the document. The interface is based on : (1) a mapping of the graphical HTML document into a 3D virtual sound space environment, where non-speech auditory cues differentiate HTML elements; (2) the transcription into sound not only of text, but also of images; (3) the use of a touch-sensitive screen to facilitate user interaction. Moreover, in order to validate the sonification model of the images, we have created an audio "memory game", that can be used as a pedagogical tool to help blind pupils learn spatial exploration cues.



Citations (15)


... If an audio document is designed straight from the author's intentions, it may correspond to the author making an explicit recording the user study presenting voice based html structure in audio: user satisfaction with audio hypertext of the document or pieces of the document. Patrick Roth [19] and his group project aims at providing sight handicapped people with alternative access modalities to pictorial documents. More precisely, our goal is to develop an augmented Internet browser to facilitate blind users access to the World Wide Web. ...

Reference:

Development of an Agent Based Specialized Multi-Lingual Web Browser for Visually Handicapped
AB – Web : Active audio browser for visually impaired and blind users

... Methods include computer vision, ultrasonic sensors, tactile substitution via skin receptors, auditory substitution via the ears, vibro-tactile substitution, electrical stimulations (e.g. of the visual cortex [31], of the forehead [57], of the tongue [3]), medical or surgical approaches, etc. Applications include wearable assistive devices, mobility aids and electronic travel aids, visual prosthetic devices, brain implants, bionic eyes; for e.g. computer vision-based cortical implants for bionic vision [70,71] and retinal implants, etc. 2. Accessible Content Processing (Purple)-A community which attempts to cover urgent areas such as human computer interaction (HCI), Braille-related technologies, printed information access (such as textbooks, street signs, product information, bar codes), optical character recognition (OCR) technology, speech synthesis technology, sign detection and recognition, web accessibility, etc; Methods include tactile access, sonification of data (e.g. use of nonspeech sound for accessing georeferenced data [115]), audio transcriptions of printed information, audio browsers to access web sites and web content [93]; Applications include reading devices, smartphone apps (e.g. the Trinetra project [65], or the bar code reading app for the blind from the Smith-Kettlewell Eye Research Institute [108]), low vision aids, screen readers, tactile touchscreens and tactile maps. 3. Accessible User Interface Design (Blue)-We interpret this small community in the co-occurrence graph as an active community involved in areas such as human-computer interaction (HCI), interface design, user interface modelling, Braille technology, ubiquitous computing, human factors and ergonomics research, etc; Methods include user-centered design, auditory interactions and feedbacks, multiple accessibility features, design and usability evaluations; Applications include accessible user interface designs, frameworks for dual interfaces, non-visual interfaces to ubiquitous services (such as ATM machines, kiosks, home appliances), accessible games for the visually impaired [39], etc. ...

Auditory browser for blind and visually impaired users
  • Citing Conference Paper
  • January 1999

... There have been some efforts to make CAPTCHA more accessible for users who are blind, using integration of sonification and sound with CAPTCHA (Lazar et al., 2012;Shirali-Shahreza & Shirali-Shahreza, 2011). Similar attempts have been made to improve users' browser interaction through use of sonification techniques (Morley, Petrie, O'Neill, & McNally, 1999;Petrucci et al., 2000). However, these efforts are far below the expectations to meet the actual needs of individuals with visual impairments. ...

Websound: a generic web sonification tool allowing HCI researchers to dynamically create new access modalities
  • Citing Conference Paper
  • January 2000

... New techniques supporting cross-modal coordination and audio-kinesthetic perceptual integration in the absence of visual information have been developed to support an intuitive non-visual interaction with scientific data. Taking an example, Roth et al. [16] have designed three methods to provide congenitally blind and visually impaired users with non-visual representation of the three different scientific graphs-linear function, parabolic curve and periodic sine wave, making use of two different modalities. The first rendering technique employed auditory feedback cues (non-speech sounds) to convey information regarding the graph shape. ...

Do You Feel What I Hear?
  • Citing Article

... Furthermore, because many digital libraries rely on pointers to documents on the Web, it is important that these mechanisms work on Web pages. While these limitations have been recognized for over a decade [1, 3], assistive technology is still challenged by two-dimensional Web page layout designs. For the past 2 years, we have worked on devising better assistive technologies to allow blind people to access the information implicit in document layouts, and to provide them with a user experience closer to that of sighted people. ...

An Image-Capable Audio Internet Browser for Facilitating Blind User Access to Digital Libraries.
  • Citing Conference Paper
  • January 1998

... The studies of Lumbreras and al. [6] and our earlier work [8,9] validated the hypothesis that a 3D immersive virtual sound environment combined with haptic manipulation and audio feedback, can enable blind users to construct a mental representation of the spatial environment. Therefore, we use as the haptic device, a graphical tablet that provides a direct positioning of the finger in the auditory plane. ...

An audio browser for increasing access to world wide web sites for blind and visually impaired computer users.
  • Citing Conference Paper
  • January 1999

... The works of Ina (1996), Ladner et al. (2005), Miele and Marston (2005) and Watanabe et al. (2014) are some examples. Finally, other authors opt for multimodality, combining haptic solutions with data sonification and other stimuli (Kennel, 1996;Fritz and Barner, 1999;Yu et al., 2000;Roth et al., 2002;Yu and Brewster, 2003;Iglesias et al., 2004;McGookin and Brewster, 2006;Wall and Brewster, 2006;Doush et al., 2009;Goncu et al., 2010). ...

A Comparison of Three Nonvisual Methods for Presenting Scientific Graphs
  • Citing Article
  • June 2002

Journal of Visual Impairment & Blindness

... Previous work in the field is summarized in [9], [10]. Previous approaches have allowed users to actively explore an image, using both audio and tactile methods [11], [12]. BATS (Blind Audio Tactile Mapping System) presents maps via speech synthesis, auditory icons, and tactile feedback [13]. ...

An audio-haptic tool for non-visual image representation
  • Citing Conference Paper
  • February 2001

... Au-dioFunctions is an iPad app that adopts three sonification techniques to convey information about the function graph. Indeed, early research studies have been carried out, implementing Web tool prototypes to allow blind users to comprehend simple drawings, as well as to create graphics (Roth et al., 2000;Yu et al., 2003). ...

Audio-Haptic Internet Browser And Associated Tools For Blind And Visually Impaired Computer Users
  • Citing Article
  • March 2000