Using speech recognition to enhance the Tongue Drive System functionality in computer access.
ABSTRACT Tongue Drive System (TDS) is a wireless tongue operated assistive technology (AT), which can enable people with severe physical disabilities to access computers and drive powered wheelchairs using their volitional tongue movements. TDS offers six discrete commands, simultaneously available to the users, for pointing and typing as a substitute for mouse and keyboard in computer access, respectively. To enhance the TDS performance in typing, we have added a microphone, an audio codec, and a wireless audio link to its readily available 3-axial magnetic sensor array, and combined it with a commercially available speech recognition software, the Dragon Naturally Speaking, which is regarded as one of the most efficient ways for text entry. Our preliminary evaluations indicate that the combined TDS and speech recognition technologies can provide end users with significantly higher performance than using each technology alone, particularly in completing tasks that require both pointing and text entry, such as web surfing.
- SourceAvailable from: Maysam Ghovanloo[Show abstract] [Hide abstract]
ABSTRACT: Tongue Drive System (TDS) is a wireless tongue-operated assistive technology (AT), developed for people with severe physical disabilities to control their environment using their tongue motion. We have developed a new ergonomic headset for the TDS with a user-friendly smartphone interface, through which users will be able to wirelessly control various devices, access computers, and drive wheelchairs. This headset design is expected to act as a flexible and multifunctional communication interface for the TDS and improve its usability, accessibility, aesthetics, and convenience for the end users.Engineering in Medicine and Biology Society,EMBC, 2011 Annual International Conference of the IEEE; 08/2011
- [Show abstract] [Hide abstract]
ABSTRACT: Assistive technologies (ATs) can enable individuals with severe disabilities to communicate their intentions to other devices or individuals, particularly allowing them to control their environments via computers. In this article, we have introduced the basic concept and development of a new wireless tongue-operated AT, called Tongue Drive System (TDS), that can wirelessly detect users' tongue movements using an array of magnetic sensors and a small magnetic tracer secured on the tongue, and translate them into a set of user-defined commands in real time, which can then be used to communicate with target devices in the users' environments. Our goal is to provide users with an unobtrusive, minimally invasive, low-power, high-bandwidth, wireless, wearable, easy-to-use, and aesthetically appealing solution that is superior to other existing ATs for people with the most severe physical disabilities. The performance of the latest TDS prototype has been evaluated by both able-bodied subjects and patients with high-level spinal cord injuries. Results have demonstrated that the TDS can indeed offer its users much higher communication bandwidth compared to EEGbased brain computer interfacesIEEE Communications Magazine 10/2012; 50(10):128 - 135. DOI:10.1109/MCOM.2012.6316786 · 4.46 Impact Factor
- [Show abstract] [Hide abstract]
ABSTRACT: We are presenting a new wireless and wearable human computer interface called the dual-mode Tongue Drive System (dTDS), which is designed to allow people with severe disabilities to use computers more effectively with increased speed, flexibility, usability, and independence through their tongue motion and speech. The dTDS detects users tongue motion using a magnetic tracer and an array of magnetic sensors embedded in a compact and ergonomic wireless headset. It also captures the users voice wirelessly using a small microphone embedded in the same headset. Preliminary evaluation results based on 14 able-bodied subjects and 3 individuals with high level spinal cord injuries at level C3-C5 indicated that the dTDS headset, combined with a commercially available speech recognition (SR) software, can provide end users with significantly higher performance than either unimodal forms based on the tongue motion or speech alone, particularly in completing tasks that require both pointing and text entry.IEEE transactions on neural systems and rehabilitation engineering: a publication of the IEEE Engineering in Medicine and Biology Society 03/2013; 21(6). DOI:10.1109/TNSRE.2013.2248748 · 2.82 Impact Factor