Conference Paper

3D Haptic modeling system using ungrounded pen-shaped kinesthetic display

Univ. of Tokyo, Tokyo, Japan
DOI: 10.1109/VR.2011.5759476 Conference: Virtual Reality Conference (VR), 2011 IEEE
Source: IEEE Xplore

ABSTRACT We propose a three-dimensional (3D) haptic modeling system that enables a user to create 3D models as though he/she is drawing pictures in mid-air and touch the created models. In the proposed system, we use our ungrounded pen-shaped kinesthetic display as the interface. The kinesthetic display device can generate kinesthetic sensations on the user's fingers. Because our system does not use mechanical linkages, the user can freely move his/her hand and feel the sensation of touching virtual objects. In the proposed system, the user can easily and intuitively create various 3D shapes by drawing closed curves in air using the device. The created shapes are generated in a physics-based simulation environment and are displayed as 3D images. Therefore, the user can touch and see the drawn shapes as though they exist in reality.

1 Follower
32 Reads
  • Source
    • "Nvidia 3D Vision R is widely used in various applications since it preserves color compared with anaglyph-based stereoscopic image. There are many applications that utilize Nvidia 3D Vision R , including 3D haptic-based modeling system [4], augmented reality with freehand interaction [5], navigation for visually impaired people [6], digital exhibition of archaeological structure [7], This research is supported by AUN/Seed-Net, JICA, and Tokai University under long-term research grant ID J1110112 * Sunu Wibirama and Kazuhiko Hamamoto are with Graduate School of Science and Technology, Tokai University, Tokyo, Japan 108-8619. Email:, "
    [Show abstract] [Hide abstract]
    ABSTRACT: The usage of Nvidia 3D Vision® is increasing rapidly, ranging from gaming to research purposes. However, researchers in human computer interaction and virtual reality are constrained by hardware configuration since current com-mercial gaze tracking systems are not specifically designed to be used with Nvidia 3D Vision®. In this paper, we present a novel prototype of gaze tracking headgear which can be used appropriately with Nvidia 3D Vision® . We explain design consideration and detail implementation of our gaze tracking headgear. We also evaluate our gaze tracking system by measuring gaze accuracy on stereoscopic display. Experimental result shows that the average gaze estimation error is less than one degree visual angle.
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Inappropriate parallax setting in stereoscopic content generally causes visual fatigue and visual discomfort. To optimize three dimensional (3D) effects in stereoscopic content by taking into account health issue, understanding how user gazes at 3D direction in virtual space is currently an important research topic. In this paper, we report the study of developing a novel 3D gaze tracking system for Nvidia 3D Vision® to be used in desktop stereoscopic display. We suggest an optimized geometric method to accurately measure the position of virtual 3D object. Our experimental result shows that the proposed system achieved better accuracy compared to conventional geometric method by average errors 0.83 cm, 0.87 cm, and 1.06 cm in X, Y, and Z dimensions, respectively.
    Conference proceedings: ... Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Conference 07/2013; 2013:3194-3197. DOI:10.1109/EMBC.2013.6610220
  • [Show abstract] [Hide abstract]
    ABSTRACT: Our project is based on our proposed haptic primary color theory, and our aim is to construct an intelligent information environment that is both visible and tangible, and integrates real-space communication, a humanmachine interface, and media processing. We have succeeded in transmitting fine haptic sensations such as material texture and temperature from an avatar robot's fingers to a human user's fingers. The avatar robot is a telexistence anthropomorphic robot dubbed TELESAR V with body and limbs having 53 degrees of freedom. This robot can transmit visual and auditory sensations of presence to human users, in addition to haptic sensations. Other results of this research project include RePro3D a full-parallax, autostereoscopic 3D (three-dimensional) display with haptic feedback using RPT (retroreflective projection technology); TECHTILE Toolkit, a prototyping tool for the design and education of haptic media; and Haptic Editor, an interactive editing system for creating haptic-enabled 3D content.
    2013 23rd International Conference on Artificial Reality and Telexistence (ICAT); 12/2013