Article

Using speech recognition to enhance the Tongue Drive System functionality in computer access

GT-Bionics Lab, School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, USA.
Conference proceedings: ... Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Conference 08/2011; 2011:6393-6. DOI: 10.1109/IEMBS.2011.6091578
Source: PubMed

ABSTRACT

Tongue Drive System (TDS) is a wireless tongue operated assistive technology (AT), which can enable people with severe physical disabilities to access computers and drive powered wheelchairs using their volitional tongue movements. TDS offers six discrete commands, simultaneously available to the users, for pointing and typing as a substitute for mouse and keyboard in computer access, respectively. To enhance the TDS performance in typing, we have added a microphone, an audio codec, and a wireless audio link to its readily available 3-axial magnetic sensor array, and combined it with a commercially available speech recognition software, the Dragon Naturally Speaking, which is regarded as one of the most efficient ways for text entry. Our preliminary evaluations indicate that the combined TDS and speech recognition technologies can provide end users with significantly higher performance than using each technology alone, particularly in completing tasks that require both pointing and text entry, such as web surfing.

2 Followers
 · 
50 Reads
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Tongue Drive System (TDS) is a wireless tongue-operated assistive technology (AT), developed for people with severe physical disabilities to control their environment using their tongue motion. We have developed a new ergonomic headset for the TDS with a user-friendly smartphone interface, through which users will be able to wirelessly control various devices, access computers, and drive wheelchairs. This headset design is expected to act as a flexible and multifunctional communication interface for the TDS and improve its usability, accessibility, aesthetics, and convenience for the end users.
    Full-text · Conference Paper · Aug 2011
  • [Show abstract] [Hide abstract]
    ABSTRACT: Assistive technologies (ATs) can enable individuals with severe disabilities to communicate their intentions to other devices or individuals, particularly allowing them to control their environments via computers. In this article, we have introduced the basic concept and development of a new wireless tongue-operated AT, called Tongue Drive System (TDS), that can wirelessly detect users' tongue movements using an array of magnetic sensors and a small magnetic tracer secured on the tongue, and translate them into a set of user-defined commands in real time, which can then be used to communicate with target devices in the users' environments. Our goal is to provide users with an unobtrusive, minimally invasive, low-power, high-bandwidth, wireless, wearable, easy-to-use, and aesthetically appealing solution that is superior to other existing ATs for people with the most severe physical disabilities. The performance of the latest TDS prototype has been evaluated by both able-bodied subjects and patients with high-level spinal cord injuries. Results have demonstrated that the TDS can indeed offer its users much higher communication bandwidth compared to EEGbased brain computer interfaces
    No preview · Article · Oct 2012 · IEEE Communications Magazine
  • [Show abstract] [Hide abstract]
    ABSTRACT: In this paper, we are presenting a new wireless and wearable assistive technology called dual-mode Tongue Drive System (dTDS), which is designed to allow people with severe disabilities use computers more effectively with increased speed, flexibility, usability, and independence through their tongue motion and speech. The dTDS detects users' tongue motion using a magnetic tracer and an array of magnetic sensors embedded in a compact, ergonomic, and stylish wireless headset. It also captures users' voice wirelessly using a small microphone on the same headset in a highly integrated fashion. Preliminary evaluation results based on 14 able-bodied subjects indicate that the dTDS headset combined with a commercially available speech recognition software can provide end users with significantly higher performance than either unimodal forms based on tongue motion or speech alone, particularly in completing tasks that require both pointing and text entry.
    No preview · Conference Paper · Oct 2012
Show more