Using speech recognition to enhance the Tongue Drive System functionality in computer access.

GT-Bionics Lab, School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, USA.
Conference proceedings: ... Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Conference 08/2011; 2011:6393-6. DOI:10.1109/IEMBS.2011.6091578 In proceeding of: Engineering in Medicine and Biology Society,EMBC, 2011 Annual International Conference of the IEEE
Source: PubMed

ABSTRACT Tongue Drive System (TDS) is a wireless tongue operated assistive technology (AT), which can enable people with severe physical disabilities to access computers and drive powered wheelchairs using their volitional tongue movements. TDS offers six discrete commands, simultaneously available to the users, for pointing and typing as a substitute for mouse and keyboard in computer access, respectively. To enhance the TDS performance in typing, we have added a microphone, an audio codec, and a wireless audio link to its readily available 3-axial magnetic sensor array, and combined it with a commercially available speech recognition software, the Dragon Naturally Speaking, which is regarded as one of the most efficient ways for text entry. Our preliminary evaluations indicate that the combined TDS and speech recognition technologies can provide end users with significantly higher performance than using each technology alone, particularly in completing tasks that require both pointing and text entry, such as web surfing.

0 0
1 Bookmark
  • [show abstract] [hide abstract]
    ABSTRACT: We have developed a noninvasive, unobtrusive magnetic wireless tongue-computer interface, called ldquoTongue Drive,rdquo to provide people with severe disabilities with flexible and effective computer access and environment control. A small permanent magnet secured on the tongue by implantation, piercing, or tissue adhesives, is utilized as a tracer to track the tongue movements. The magnetic field variations inside and around the mouth due to the tongue movements are detected by a pair of three-axial linear magneto-inductive sensor modules mounted bilaterally on a headset near the user's cheeks. After being wirelessly transmitted to a portable computer, the sensor output signals are processed by a differential field cancellation algorithm to eliminate the external magnetic field interference, and translated into user control commands, which could then be used to access a desktop computer, maneuver a powered wheelchair, or control other devices in the user's environment. The system has been successfully tested on six able-bodied subjects for computer access by defining six individual commands to resemble mouse functions. Results show that the Tongue Drive system response time for 87% correctly completed commands is 0.8 s, which yields to an information transfer rate of ~ 130 b/min.
    IEEE Transactions on Neural Systems and Rehabilitation Engineering 11/2008; · 3.26 Impact Factor
  • Source
    [show abstract] [hide abstract]
    ABSTRACT: Tongue drive system (TDS) is a tongue-operated, minimally invasive, unobtrusive, noncontact, and wireless assistive technology that infers users' intentions by detecting and classifying their voluntary tongue motions, and translating them to user-defined commands. We have developed customized interface circuitry between an external TDS (eTDS) prototype and a commercial powered wheelchair (PWC) as well as three control strategies to evaluate the tongue motion as an alternative control input for wheeled mobility. We tested the eTDS performance in driving PWCs on 12 able-bodied human subjects, of which 11 were novice. The results showed that all subjects could complete navigation tasks by operating the PWC using their tongue motions. Despite little prior experience, the average time using the eTDS and the tongue was only approximately three times longer than using a joystick and the fingers. Navigation time was strongly dependant on the number of issued commands, which reduced by gaining experience. Particularly, the unintended issued commands (the Midas touch problem) were rare, demonstrating the effectiveness of the tongue tracking and external magnetic field cancellation algorithms as well as the safety of the TDS for wheeled mobility.
    IEEE transactions on bio-medical engineering 05/2009; 56(6):1719-26. · 2.15 Impact Factor
  • Source
    [show abstract] [hide abstract]
    ABSTRACT: Tongue drive system (TDS) is a wireless, wearable assistive technology that enables individuals with severe motor impairments to access computers, drive wheelchairs, and control their environments using tongue motion. In this paper, we have evaluated the TDS performance as a computer input device in four tasks, commonly known as horizontal, vertical, center-out, and multidirectional rapid tapping, based on Fitts' law and ISO9241-9 Standard. Nine able-bodied subjects, who already had tongue piercing, participated in this trial over five sessions during 5 weeks, allowing us to study the TDS learning process and its current limiting factors. Subjects wore tongue rings made of titanium in the form of a barbell with a small rare-earth magnetic tracer hermetically sealed inside the upper ball. Participants performed the same tasks with a mouse (only in the first session) as a reference as well as a standard keypad for benchmarking. Six performance measures were considered, including throughput, error rate, and reaction time, all of these improved significantly from the first to the last session, and some of these plateaued over the course of the experiment. The comparison between tongue-TDS versus index-finger-keypad provides valuable insights into tongue human factors, which can lead the way in improving the usability of the TDS and similar tongue-operated assistive technologies.
    IEEE transactions on information technology in biomedicine: a publication of the IEEE Engineering in Medicine and Biology Society 06/2011; 15(5):747-57. · 1.69 Impact Factor