Article

Using speech recognition to enhance the Tongue Drive System functionality in computer access.

GT-Bionics Lab, School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, USA.
Conference proceedings: ... Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Conference 08/2011; 2011:6393-6. DOI: 10.1109/IEMBS.2011.6091578
Source: PubMed

ABSTRACT Tongue Drive System (TDS) is a wireless tongue operated assistive technology (AT), which can enable people with severe physical disabilities to access computers and drive powered wheelchairs using their volitional tongue movements. TDS offers six discrete commands, simultaneously available to the users, for pointing and typing as a substitute for mouse and keyboard in computer access, respectively. To enhance the TDS performance in typing, we have added a microphone, an audio codec, and a wireless audio link to its readily available 3-axial magnetic sensor array, and combined it with a commercially available speech recognition software, the Dragon Naturally Speaking, which is regarded as one of the most efficient ways for text entry. Our preliminary evaluations indicate that the combined TDS and speech recognition technologies can provide end users with significantly higher performance than using each technology alone, particularly in completing tasks that require both pointing and text entry, such as web surfing.

1 Bookmark
 · 
158 Views
  • [Show abstract] [Hide abstract]
    ABSTRACT: We are presenting a new wireless and wearable human computer interface called the dual-mode Tongue Drive System (dTDS), which is designed to allow people with severe disabilities to use computers more effectively with increased speed, flexibility, usability, and independence through their tongue motion and speech. The dTDS detects users tongue motion using a magnetic tracer and an array of magnetic sensors embedded in a compact and ergonomic wireless headset. It also captures the users voice wirelessly using a small microphone embedded in the same headset. Preliminary evaluation results based on 14 able-bodied subjects and 3 individuals with high level spinal cord injuries at level C3-C5 indicated that the dTDS headset, combined with a commercially available speech recognition (SR) software, can provide end users with significantly higher performance than either unimodal forms based on the tongue motion or speech alone, particularly in completing tasks that require both pointing and text entry.
    IEEE transactions on neural systems and rehabilitation engineering: a publication of the IEEE Engineering in Medicine and Biology Society 03/2013; 21(6). DOI:10.1109/TNSRE.2013.2248748 · 2.42 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: Abstract Purpose: To evaluate typing and pointing performance and improvement over time of four able-bodied participants using an intra-oral tongue-computer interface for computer control. Background: A physically disabled individual may lack the ability to efficiently control standard computer input devices. There have been several efforts to produce and evaluate interfaces that provide individuals with physical disabilities the possibility to control personal computers. Method: Training with the intra-oral tongue-computer interface was performed by playing games over 18 sessions. Skill improvement was measured through typing and pointing exercises at the end of each training session. Results: Typing throughput improved from averages of 2.36 to 5.43 correct words per minute. Pointing throughput improved from averages of 0.47 to 0.85 bits/s. Target tracking performance, measured as relative time on target, improved from averages of 36% to 47%. Path following throughput improved from averages of 0.31 to 0.83 bits/s and decreased to 0.53 bits/s with more difficult tasks. Conclusions: Learning curves support the notion that the tongue can rapidly learn novel motor tasks. Typing and pointing performance of the tongue-computer interface is comparable to performances of other proficient assistive devices, which makes the tongue a feasible input organ for computer control. Implications for Rehabilitation Intra-oral computer interfaces could provide individuals with severe upper-limb mobility impairments the opportunity to control computers and automatic equipment. Typing and pointing performance of the tongue-computer interface is comparable to performances of other proficient assistive devices, but does not cause fatigue easily and might be invisible to other people, which is highly prioritized by assistive device users. Combination of visual and auditory feedback is vital for a good performance of an intra-oral computer interface and helps to reduce involuntary or erroneous activations.
    Disability and rehabilitation. Assistive technology 08/2013; DOI:10.3109/17483107.2013.823629
  • [Show abstract] [Hide abstract]
    ABSTRACT: Assistive technologies (ATs) can enable individuals with severe disabilities to communicate their intentions to other devices or individuals, particularly allowing them to control their environments via computers. In this article, we have introduced the basic concept and development of a new wireless tongue-operated AT, called Tongue Drive System (TDS), that can wirelessly detect users' tongue movements using an array of magnetic sensors and a small magnetic tracer secured on the tongue, and translate them into a set of user-defined commands in real time, which can then be used to communicate with target devices in the users' environments. Our goal is to provide users with an unobtrusive, minimally invasive, low-power, high-bandwidth, wireless, wearable, easy-to-use, and aesthetically appealing solution that is superior to other existing ATs for people with the most severe physical disabilities. The performance of the latest TDS prototype has been evaluated by both able-bodied subjects and patients with high-level spinal cord injuries. Results have demonstrated that the TDS can indeed offer its users much higher communication bandwidth compared to EEGbased brain computer interfaces
    IEEE Communications Magazine 10/2012; 50(10):128 - 135. DOI:10.1109/MCOM.2012.6316786 · 4.46 Impact Factor