Gesture Therapy: A Vision-Based System for Upper Extremity Stroke Rehabilitation

Instituto Nacional de Astrofísica, Óptica y Electrónica, Luis Enrique Erro #1, Tonantzintla, Puebla, Mexico.
Conference proceedings: ... Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Conference 01/2010; 2010:3690-3. DOI: 10.1109/IEMBS.2010.5627458
Source: IEEE Xplore

ABSTRACT Stroke is the main cause of motor and cognitive disabilities requiring therapy in the world. Therefor it is important to develop rehabilitation technology that allows individuals who had suffered a stroke to practice intensive movement training without the expense of an always-present therapist. We have developed a low-cost vision-based system that allows stroke survivors to practice arm movement exercises at home or at the clinic, with periodic interactions with a therapist. The system integrates a virtual environment for facilitating repetitive movement training, with computer vision algorithms that track the hand of a patient, using an inexpensive camera and a personal computer. This system, called Gesture Therapy, includes a gripper with a pressure sensor to include hand and finger rehabilitation; and it tracks the head of the patient to detect and avoid trunk compensation. It has been evaluated in a controlled clinical trial at the National Institute for Neurology and Neurosurgery in Mexico City, comparing it with conventional occupational therapy. In this paper we describe the latest version of the Gesture Therapy System and summarize the results of the clinical trail.

  • [Show abstract] [Hide abstract]
    ABSTRACT: The use of serious games, those not intended for leisure, out of their intended context may have consequences for evoked engagement and for the facilitation of transversal reutilization of developed games. However, the effectiveness and usability of serious games out of their intended context must be questioned. Here, we present two case studies in virtual rehabilitation. In a first experiment, a classical leisure game (i.e. pong) is compared in its ability to propose a valid alternative to games specifically developed for virtual rehabilitation use in terms of compliance with principles required in motor rehabilitation such as movement repetition, feedback, task significance and motivation. The second experiment explores the complementary situation in which a virtual rehabilitation game set is exported as a plausible tool for the cognitive stimulation of elders. Not unexpectedly, our results suggest that transfer of games across realms is, in some cases, a feasible enterprise but their effectiveness and usability may be compromised. In particular, we found that importing pong to a virtual rehabilitation environment is not a valid alternative in the sense that it does not obey rehabilitation principles. However, exporting serious games across related domains, i.e. from virtual rehabilitation to cognitive stimulation, has encountered a high degree of acceptance by the receiving community of users, being perceived as useful and easy to use, and we further establish that this acceptance cannot be explained by expertise in using technology. Qualitative assessment of usersÕ responses points to the interaction interface as a co-responsible factor for this acceptance of the serious virtual environment. These findings may have consequences for the future development of serious games both in terms of reusing ideas and alerting about possible difficulties during the migration process.
    Computer Systems Science and Engineering 01/2015; 30(1):43-55. · 0.24 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: Abstract Staging of colorectal cancer constitutes an important part of its diagnosis and prognosis. However, both invasive and non-invasive techniques prevail with their own advantages and disadvantages. The present review focuses on the existence of complementarity between the information obtained from computerized tomography and radioimmunoscintigraphy in the study of hepatic and extra-hepatic lesions of significance and relevant to colorectal cancer. The latter technique utilizes different monoclonal antibodies which are tagged with radioisotopes and imaging done by gamma-camera. For complete diagnosis of recurrent carcinoma or metastases, knowledge form both the pre-surgical procedures is an absolute necessity to choose the correct therapeutic modality.
    Lecture Notes in Bioengineering-Advancements of Medical Electronics-Proceedings of the First International Conference , published by Springer India, 2015; 01/2015
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Vision-based hand gesture interactions are natural and intuitive when interacting with computers, since we naturally exploit gestures to communicate with other people. However, it is agreed that users suffer from discomfort and fatigue when using gesture-controlled interfaces, due to the lack of physical feedback. To solve the problem, we propose a novel complete solution of a hand gesture control system employing immersive tactile feedback to the user's hand. For this goal, we first developed a fast and accurate hand-tracking algorithm with a Kinect sensor using the proposed MLBP (modified local binary pattern) that can efficiently analyze 3D shapes in depth images. The superiority of our tracking method was verified in terms of tracking accuracy and speed by comparing with existing methods, Natural Interaction Technology for End-user (NITE), 3D Hand Tracker and CamShift. As the second step, a new tactile feedback technology with a piezoelectric actuator has been developed and integrated into the developed hand tracking algorithm, including the DTW (dynamic time warping) gesture recognition algorithm for a complete solution of an immersive gesture control system. The quantitative and qualitative evaluations of the integrated system were conducted with human subjects, and the results demonstrate that our gesture control with tactile feedback is a promising technology compared to a vision-based gesture control system that has typically no feedback for the user's gesture inputs. Our study provides researchers and designers with informative guidelines to develop more natural gesture control systems or immersive user interfaces with haptic feedback.
    Sensors 01/2015; 15(1):1022-46. DOI:10.3390/s150101022 · 2.05 Impact Factor