Jun Rekimoto

Jun Rekimoto
The University of Tokyo | Todai · Department of Interdisciplinary Information Studies

Ph.D

About

218
Publications
54,397
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
9,194
Citations
Citations since 2016
75 Research Items
2843 Citations
20162017201820192020202120220100200300400
20162017201820192020202120220100200300400
20162017201820192020202120220100200300400
20162017201820192020202120220100200300400
Additional affiliations
July 2007 - present
April 1994 - present
Sony Computer Science Laboratories, Inc.
Position
  • Managing Director
Description
  • Conducting Fundamental yet Applicable Research in the fields of computer science, human-computer interaction, brain science, systems biology, and sustainability
January 1994 - present

Publications

Publications (218)
Preprint
Interactions based on automatic speech recognition (ASR) have become widely used, with speech input being increasingly utilized to create documents. However, as there is no easy way to distinguish between commands being issued and text required to be input in speech, misrecognitions are difficult to identify and correct, meaning that documents need...
Article
Galvanic taste stimulation (GTS) is a non-invasive electrical stimulation of sensory nerves that induces, inhibits, and enhances taste sensation. It has been shown that the cathodal GTS taste enhancement effect occurs when only cathodal electrodes are attached in or near the mouth, while anodal GTS, whose anodal electrodes are attached in or near t...
Article
Conversational agents are widely used in many situations, especially for speech tutoring. However, their contents and functions are often pre-defined and not customizable for people without technical backgrounds, thus significantly limiting their flexibility and usability. Besides, conventional agents often cannot provide feedback in the middle of...
Preprint
Full-text available
This paper illustrates design work carried out to develop an interactive theater performance. HCI has started to address the challenges of designing interactive performances, as both audience and performers' experiences are considered and a variety of professional expertise involved. Nevertheless, research has overlooked how such design unfolds in...
Conference Paper
Providing an experience that includes high-speed objects, such as tennis balls, with a virtual reality (VR) training environment might provide efficient training for trainers but is challenging to achieve. Because of the drawing performance of the display, high-speed objects are perceived as poor visual information more than in reality, such as ima...
Conference Paper
We present Extramission, a method to a large scale interactive virtual environment. It consists of dual head mounted pico projectors and retro-reflective materials. With high-accuracy retro-reflective materials, laser beams scanned on user’s retina makes clear and free-focus vision. In this retinal scanning configuration, even if the luminance of t...
Conference Paper
Digital musical instruments are essential technologies in modern musical composition and performance. However, the interface of the synthesizer is not intuitive enough and require extra knowledge because of the parameters. To address this problem, we propose pseudo-intention learning: a novel data collection method for supervised learning in musica...
Conference Paper
We propose a potential fluid-measurement technology aimed at supporting biomechanics research of water sports using fluid simulation and motion analysis. Cellulose nanofibers introduced into the water as tracer particles to visualize the movement of water. An optical property of nanofibers, called flow birefringence, makes water flows brighter than...
Conference Paper
Full-text available
Immersion is an important factor in video experiences. Therefore, various methods and video viewing systems have been proposed. Head-mounted displays (HMDs) are home-friendly pervasive devices, which can provide an immersive video experience owing to their wide field-of-view (FoV) and separation of users from the outside environment. They are often...
Conference Paper
Understanding water flow around a swimmer is key to reducing the water resistance when swimming and improving propulsive force, since swimmers who produce less turbulent flows around their bodies can, for example, swim faster. However, existing water flow measurement technologies are not suitable for measuring human swimmers because they can only m...
Conference Paper
" We present Bubble, a pneumatically actuated wearable device that enables people with hand disabilities to use their own hands to grasp objects without fully bending their fingers. Bubble offers a novel approach to grasping, where slim, ultra-lightweight silicone actuators are attached to the fingers. When the user wishes to grasp an object, the s...
Conference Paper
Full-text available
The availability of digital devices operated by voice is expanding rapidly. However, the applications of voice interfaces are still restricted. For example, speaking in public places becomes an annoyance to the surrounding people, and secret information should not be uttered. Environmental noise may reduce the accuracy of speech recognition. To add...
Conference Paper
Resistive force (e.g., due to object elasticity) and impact (e.g., due to recoil) are common effects in our daily life. However, resistive force continuously changes due to users' movements while impact instantly occurs when an event triggers it. These feedback are still not realistically provided by current VR haptic methods. In this paper, a wear...
Conference Paper
Bouldering is an urban form of rock climbing that requires precise and complex movement. Similarly to other sports, the simplest way to learn bouldering skill is to mimic professional's motion. However, ordinary beginner boulders cannot learn to coaches, so that they learn by themselves or tutorial videos. Even if they managed, bouldering has a com...
Conference Paper
The development of personal fabrication technologies has enabled end users to model and prototype desired objects. 3D printing technologies have eased our access to solid models, however, it is still a challenge to develop thin fibers rapidly at personal levels that may help enriching textures of models. We propose a system and method inspired by c...
Conference Paper
Understanding the correct self-posture is known to improve the performance of motor skills in sports, dance, ballet, walking, and running. However, it is difficult to understand the accurate self-posture and move one's body as intended for imitation or learning, especially in-situation. Based on previous physiological research, we herein propose th...
Conference Paper
Water flow is strongly related to swimming speed; thus, technologies for measuring the three-dimensional movement of water are highly desired in the water sports industry. However, existing fluid measurement methods are not suitable for use with humans because they introduce tiny plastic particles (known as tracer particles) that contain fluorescen...
Conference Paper
Owing to the improvement in accuracy of eye tracking devices, eye gaze movements occurring while conducting tasks are now a part of physical activities that can be monitored just like other life-logging data. Analyzing eye gaze movement data to predict reading comprehension has been widely explored and researchers have proven the potential of utili...
Preprint
Contributions of recent deep-neural-network (DNN) based techniques have been playing a significant role in human-computer interaction (HCI) and user interface (UI) domains. One of the commonly used DNNs is human pose estimation. This kind of technique is widely used for motion capturing of humans, and to generate or modify virtual avatars. However,...
Preprint
Full-text available
There has been a long history in electrical muscle stimulation (EMS), which has been used for medical and interaction purposes. Human-computer interaction (HCI) researchers are now working on various applications, including virtual reality (VR), notification, and learning. For the electric signals applied to the human body, various types of wavefor...
Conference Paper
This paper introduces a telepresence system called OmniGaze, which displays a remote user's presence using a spherical display on an omnidirectional camera. In a telepresence system, gaze has a variety of important functions such as presenting the direction of attention and making simple eye gestures. An omnidirectional camera is an effective tool...
Conference Paper
Full-text available
Researchers have attempted to increase the realism of virtual reality (VR) applications in many ways. Combinations of the visual, auditory and haptic feedback have successfully simulated experiences in VR, however, multimedia contents may also stimulate emotions. In this paper, we especially paid attention to negative emotions that may be perceived...
Conference Paper
Full-text available
Immersion is an important factor in video experiences. Therefore, various methods and video viewing systems have been proposed so far. Although head-mounted displays (HMDs) are home-friendly and more available among these devices, they can provide an immersive video experience owing to their wide field-of-view (FoV) and separation of users from the...
Conference Paper
This paper introduces Augmented Jump, a backpack multirotor system for jumping ability augmentation. Augmented Jump hovers and supports users' weight by a constant upward power of thrust. Users can jump higher and stay in the air for a longer time than usual with Augmented Jump. We designed and developed our first proof-of-concept prototype that ca...
Conference Paper
Occurrences of unknown words in a conversation can be challenging and often prevent people from engaging in fluent communication with each other. Even worse, currently very little is known about possible bodily responses when a listener comes across unknown words, especially when context information is not available in the conversation to facilitat...
Article
Full-text available
The human body has unique electrical characteristics. These characteristics have been investigated in various studies in human-computer interaction (HCI) and related research fields. Such studies include applications for using the body as a conductive lead for transmission or electric field sensing and activating human muscles or organs. However, e...
Conference Paper
A head-mounted display (HMD), which is common in virtual reality (VR) systems, normally hides the user's face. This feature prohibits to realize a face-to-face communication, in which two or more users share the same virtual space, or show a participant's face on a surrogate-robot's face when the user remotely connects to the robot through an HMD f...
Conference Paper
We propose a system, called ExtVision, to augment visual experiences by generating and projecting context-images onto the periphery of the television or computer screen. A peripheral projection of the context-image is one of the most effective techniques to enhance visual experiences. However, the projection is not commonly used at present, because...
Conference Paper
We propose a light-weight, wearable device ElasticVR to provide various force feedback in multi-level in virtual reality (VR) for more immersive and realistic VR experiences. Force feedback is generally categorized into passive and active force feedback. Passive force is produced passively and continuously against the body part movement, e.g., elas...
Conference Paper
Full-text available
Low-Fab (low-fidelity fabrication) has allowed designers to speed up the initial prototyping of 3D objects. However, the method is used to quickly verify the key aspects of the model, and are not the final desired object. Therefore, the object generated by Low-Fab are temporal objects in which the disposability and/or reusability of the material sh...
Conference Paper
We propose a system that detects the scene, where a specific speaker is speaking in the video, and displays the site as a heat map in the video's timeline. This system enables users to skip to the timeline they want to hear by detecting scenes in a drama, talk show, or discussion TV program, where a specific speaker is speaking. To detect a specifi...
Conference Paper
Full-text available
Previous studies have revealed that understanding the 3D movement of water contributes to improving propulsion in the water when swimming. Fluid measurements are made by scattering tracer particles into a liquid, and cameras track the movement of these particles to measure the fluid's flow. Strong lasers illuminate tracer particles to make them vis...
Conference Paper
The engagement of students in a classroom is an important factor in education. Teachers are not only expected to possess strong teaching skills but also be simultaneously attentive to their students. Researchers have found that the most effective teaching happens when students in the room are in sync with one another.[1] However, assessing the clas...
Conference Paper
Full-text available
Electrical Muscle Stimulation (EMS) has attracted many users and researchers to apply the technique for various usages. However, EMS products for research purpose are limited and open source hardware still has limitations. We present a multi-channel EMS toolkit for researchers and designers to develop their original ideas. The toolkit was designed...
Conference Paper
All innovative ideas are said to be pairings of existing ideas. In collaborative ideation, various methods are used to suggest words for stimulating ideation based on the theory that suggesting strongly related words to the ideation topic will activate and enhance the ideation. However, the relationship between the words suggested by the system and...
Conference Paper
Full-text available
We propose an augmented aquarium that dynamically alters the color of translucent aquatic animals without injury. This technology produces colored aquatic animals that glow in the dark in a standard fish tank at home. For regulating the color, a monitor displaying colors is installed behind the fish tank. The fish tank becomes dark owing to light-s...
Conference Paper
Full-text available
We present JackIn Airsoft, a system for generating maps for multi-player sport activities and sharing their first-person views (FPVs). In first-person shooting (FPS) games, maps are generated for the visualization of the player's location; these maps are used for strategic play and discussions. FPS games are a virtual experience of shooting or of m...
Conference Paper
Although doing sports and games together is effective to create good social connections, a large skill gap among players reduces the enjoyment in such activities. In this research, we technologically enhance sports and gaming activities in the real world. The gaming environment is aimed at mitigating the differences in ability without reducing the...
Conference Paper
Traditional telepresence systems only supported first person view and users had difficulty in recognizing the surrounding situation of their remote workspace. JackIn Space is a telepresence system that solves this problem by seamlessly integrating first person view with third person view. With a head-mounted first person camera and multiple depth s...
Conference Paper
A surround-screen swimming pool can realize various forms of underwater entertainment and enable enhanced swimming training with supplemental visual information during underwater activities. However, one of the big challenges for such an augmented swimming pool is user interaction because the surround screen and water can make existing position-tra...
Conference Paper
Seeing one's partner's face during remote conversation is one of the most important factors for effective communication. When using a telepresence robot, matching face positions with one's partner is sometimes difficult, because face position varies in different situations (e.g., standing or sitting). However, existing telepresence robots cannot ch...
Conference Paper
Speech shadowing, in which the subject listens to native narration sound and tries to repeat it immediately while listening, is a proven way of practicing speaking skills when learning foreign languages. However, since the narration is independent of user's speech, the playback cannot make an adjustment when the learner fails to catch up, and this...
Conference Paper
AquaCAVE is a system for enhancing the swimming experience. Although swimming is considered to be one of the best exercises to maintain our health, swimming in a pool is normally monotonous; thus, maintaining its motivation is sometimes difficult. AquaCAVE is a computer-augmented swimming pool with rear-projection acrylic walls that surround a swim...
Conference Paper
In mediated communications, the social presence is said to be enhanced not only by eye contact and body gestures but also by remote haptics. To realize remote haptics, we present a mask telepresence system worn by a surrogate that displays the face of a remote user through a livestream. This system allows someone to shake the hand of a remote user...
Conference Paper
This paper introduces a method to reprogram reality by substituting visual perception. According to several studies in psychology, our construction of reality is only a subjective experience, and we have an ability to adapt the modified perception unconsciously. As we use a Light Detection And Ranging (LiDAR) sensor to provide altered vision, the s...
Article
We present a method of rendering aerial and volumetric graphics using femtosecond lasers. A high-intensity laser excites physical matter to emit light at an arbitrary three-dimensional position. Popular applications can thus be explored, especially because plasma induced by a femtosecond laser is less harmful than that generated by a nanosecond las...
Conference Paper
"Shepherd Pass" is a method of tuning sport abilities that focuses on passing a ball. The method can be used to overcome skill gaps between the players for design novel sport games. Sports have been changed by technological innovations. Professional players are improving their skills using updated tools, clothing, and training methods. These innova...
Conference Paper
Fine motor skills like finger/hand manipulations are essential for playing musical instruments and these skills require a great amount of time and effort to acquire. Researchers have been introducing haptic feedback systems in order to facilitate the process of learning motor skills but little research has expanded the possibility of applying to th...
Conference Paper
Chameleonmask is a telepresence system that shows a remote user's face on the other user's face. While most telepresence systems have been designed to provide a remote user's existence with a teleoperated robot, the system uses a real human as a surrogate for another remote user. To do this, a surrogate user wears a mask-shaped display that shows a...
Conference Paper
ChameleonMask is a telepresence system that displays a remote user's face on another user's face. Whereas most telepresence systems are designed to provide the remote user with an existence via a teleoperated robot, the system uses a real human as a surrogate for the remote user. This is accomplished by the surrogate user wearing a mask-shaped disp...
Chapter
In this study, we developed a portable driving system for Diminished Haptics that transforms the haptic textures of real materials by ultrasonic vibration based on a squeeze film effect. A real material is attached on the display area (a square area with 30-mm sides), and its haptic texture is reduced. However, the vibration amplitude is decreased...
Conference Paper
Chameleonmask is a telepresence system that shows a remote user's face on the other user's face. While most telepresence systems have been designed to provide a remote user's existence with a teleoperated robot, the system uses a real human as a surrogate for another remote user. To do this, a surrogate user wears a mask-shaped display that shows a...
Conference Paper
Capturing and reconstructing real world environments in 3D has broad areas of application including virtual reality, entertainment, archiving, simulation, and training. Geometry-based methods typically estimate the geometry of the environment based on multiple 2D cameras or depth cameras. These methods are applicable when the environment consists o...