Yoshifumi Kitamura

Tohoku University | Tohokudai · Research Institute of Electrical Communication

Room-scale VR has been considered an alternative to physical office workspaces. For office activities, users frequently require planar input methods, such as typing or handwriting, to quickly record annotations to virtual content. However, current off-the-shelf VR HMD setups rely on mid-air interactions, which can cause arm fatigue and decrease inp...

We present a framework that captures sparse Lagrangian flow information from a volume of real liquid and reconstructs its detailed kinematic information in real time. Our framework can perform flow reconstruction even when the liquid is disturbed by an object of unknown movement and shape. Through a large dataset of liquid moving under external dis...

We examine the effect of auditory cues occurring in reality on redirection. Specifically, we set two hypotheses: the auditory cues emanating from fixed positions in reality (Fixed sound, FS) increase the noticeability of redirection, while the auditory cues whose positions are manipulated consistently with the visual manipulation (Redirected sound,...

Research efforts have previously explored various components of physical/virtual workspaces that adaptively interact with knowledge workers in order to support them in their work. In this paper, we propose an encompassing framework for these efforts, which we refer to as Human-Workspace Interaction (HWI), with the goal of increasing awareness and u...

We propose BirdViewAR, a surroundings-aware remote drone-operation system that provides significant spatial awareness to pilots through an augmented third-person view (TPV) from an autopiloted secondary follower drone. The follower drone responds to the main drone’s motions and directions using our optimization-based autopilot, allowing the pilots...

We propose HandyGaze, a 6-DoF gaze tracking technique for room-scale environments that can be carried out by simply holding a smartphone naturally without installing any sensors or markers in the environment. Our technique simultaneously employs the smartphone’s front and rear cameras: The front camera estimates the user’s gaze vector relative to t...

We propose a novel phone-case-shaped interface named TetraForce, which enables four types of force input consisting of two force directions (i.e., pressure force and shear force) and two force-applied surfaces (i.e., touch surface and back surface) in a single device. Force detection is achieved using the smartphone's built-in magnetometer (and sup...

We propose WaddleWalls, a room-scale interactive partitioning system using a swarm of robotic partitions that allows occupants to interactively reconfigure workspace partitions to satisfy their privacy and interaction needs. The system can automatically arrange the partitions’ layout designed by the user on demand. The user specifies the target par...

Magnetic tracking is useful in many motion tracking applications and free from the line-of-sight (occlusion) limitations from which most popular optical tracking systems suffer. Previously, multi-axis magnetic markers relied on time multiplex or frequency multiplex methods to separately sense inductor-capacitor (LC) coils in different axes, which i...

Not available

Musical chords and chord relations can be described through mathematics. Abstract permutations can be visualized through the Rubik’s cube, born as a pedagogical device [7, 21]. Permutations of notes can also be heard through the CubeHarmonic, a novel musical instrument. Here, we summarize the basic ideas and the state of the art of the physical imp...

Head-mounted displays (HMDs) increase immersion into virtual worlds. The problem is that this limits headset users' awareness of bystanders: headset users cannot attend to bystanders' presence and activities. We call this the HMD boundary. We explore how to make the HMD boundary permeable by comparing different ways of providing informal awareness...

The configuration of office environments is related to worker satisfaction and can improve work efficiency. Although open offices promote communication among co-workers, privacy issues surface as well as increased risks from such health concerns as viral infections and pandemics. On the other hand, territorial offices protect worker privacy and red...

The Japanese concept/character MA (間), commonly translated as “gap, interval, or the in between,” partakes in many forms of Japanese arts and daily‐life practices. In this article, we report the results of a qualitative research on the meaning or experience of MA and its relation with the feeling of togetherness in the context of contemporary dance...

We explore BouncyScreen, an actuated 1D display system that enriches indirect interaction with a virtual object by pseudo-haptic feedback mechanics enhanced through the screen’s physical movements. We configured a proof-of-concept prototype of BouncyScreen with a flat-screen mounted on a mobile robot. When the user manipulates a virtual object usin...

The Japanese MA (間), referred to gap, interval, or the in between, partakes in many forms of JP arts and daily life practices. We studied an inter-personal dimension of MA with qualitative interview and quantitative methods here. We invited spectators to watch a videotaped 3 min dance improvisations created in a motion capture laboratory. Participa...

We propose a novel approach to reconstructing 3D motion data from a flexible magnetic flux sensor array using deep learning and a structure-aware temporal bilateral filter. Computing the 3D configuration of markers (inductor-capacitor (LC) coils) from flux sensor data is difficult because the existing numerical approaches suffer from system noise,...

Natural disasters cause long-lasting mental health problems such as PTSD in children. Following the 2011 Earthquake and Tsunami in Japan, we witnessed a shift of toy block play behavior in young children who suffered from stress after the disaster. The behavior reflected their emotional responses to the traumatic event. In this paper, we explore th...

As the range of handheld, mobile and desktop devices expands and worldwide demand for collaborative application tools increases, there is a growing need for higher speed impromptu cross-device application sharing to keep up with workplace requirements for on-site or remote collaborations. To address this, we have developed CamCutter, a cross-device...

We propose PinpointFly, an egocentric drone interface that allows users to arbitrarily position and rotate a flying drone using position control interactions on a see-through mobile AR where the position and direction of the drone are visually enhanced with a virtual cast shadow. Unlike traditional speed control methods, users hold a smartphone and...

We introduce a short virtual reality experience highlighting a use-case scenario of distance relocation technique in Redirected Jumping to reduce the size requirements for tracked working space of spatial applications. In our demo, the player traverses a virtual factory by jumping between moving platforms with jump distance scaled by gain.

Camera-based hand tracking technologies can enable unprecedented interactive contents with gripping impressions of embodiment and immersion. However, current systems are often restricted by the tracking volume of their sensors which results in limited experiences and content creation possibilities. We present two demonstrations of FreeMo, a hand tr...

We propose ShearSheet, a low-cost, feasible, and simple DIY method that enables tangential (shear) force input on a touchscreen using a rubber-mounted slim transparent sheet. The sheet has tiny conductive material(s) attached to specific positions on the underside so that displacement of the sheet is recognized as touch input(s). This allows the sy...

Field of view limitations are one of the major persisting setbacks for camera-based motion tracking systems and the need for flexible ways to improve capture volumes remains. We present Pursuit Sensing, a technique to considerably extend the tracking volume of a camera sensor through self-actuated reorientation using a customized gimbal, thus enabl...

We propose Third-Person Piloting, a novel drone manipulation interface that increases situational awareness using an interactive third-person perspective from a second, spatially coupled drone. The pilot uses a controller with a manipulatable miniature drone. Our algorithm understands the relationship between the pilot's eye position and the miniat...

A simple way to prototype touch interaction is to extend electrodes from a capacitive touch screen to off-screen areas. With that we aim to develop a toolkit that transforms a user-designed layout into a layout of screen-extension electrodes that realizes touch for rapid prototyping. Nevertheless, this kind of extension cannot detect touch if the p...

Living Wall Display is an autonomous interactive display that augments the representation of 2D content spatially by physically moving the screen in concert with the animation presented on the screen. To demonstrate its potential, we design three application scenarios, a first-person shooting game, a baseball pitching game and a driving simulator....

A contemporary challenge involves scientific education and the connection between new technologies and the heritage of the past. CubeHarmonic (CH) joins novelty and tradition, creativity and education, science and art. It takes shape as a novel musical instrument where magnetic 3D motion tracking technology meets musical performance and composition...

This symposium showcases the latest work from Asia on interactive systems and user interfaces that address under-explored problems and demonstrate unique approaches. In addition to circulating ideas and sharing a vision of future research in human-computer interaction, this symposium aims to foster social networks among academics (researchers and s...

The Living Wall Display displays interactive content on a mobile wall screen that moves in concert with content animation. To augment the interaction experience, the display dynamically changes its position and orientation, responding to the content animation triggered by user interactions. We implement three proof of concept prototypes that repres...

We present a concept-based world building approach, realized in a system called VR Safari Park, which allows users to rapidly create and manipulate a world simulation. Conventional world building tools focus on the manipulation and arrangement of entities to set up the simulation, which is time consuming as it requires frequent view and entity mani...

We are pursuing a vision of reactive interior spaces that are aware of people's actions and transform according to changing needs. We envision furniture and walls that act as interactive displays and that shapeshift to the correct physical form, and the appropriate interactive visual content and modality. This paper briefly describes our proposal b...

Digital photos and their metadata get explosively growth, requiring better support to browsing them. We propose a dynamic and flexible visualization of digital photos and their metadata. A prototype is designed and implemented based on the algorithm of D-FLIP, our previous work for flexibly displaying a large photo collection. We design various dyn...

Large interactive tabletops are beneficial for various tasks involving exploration and visualization, but regions of the screen far from users can be difficult to reach. We propose AdapTable; a concept and prototype of a flexible multi-display tabletop that can physically reconfigure its layout, allowing for interaction with difficult-to-reach regi...

Augmented Reality (AR) on consumer devices is now commonplace and it finds application in areas like online retail and gaming. Among which, school education can especially benefit from the interactivity and expressiveness provided by AR technology, facilitating the learning process of students. Although AR-enabled hardware and applications are beco...

We developed a new musical interface, CubeHarmonic, with the magnetic 3D motion tracking system IM3D. This system precisely tracks positions of tiny, wireless, battery-less, and identifiable markers (LC coils) in real time. The CubeHarmonic is a musical application of the Rubik’s cube, with notes on each little piece. Scrambling the cube, we get di...

We give an overview of some applications of combinatorics and permutations in music through the centuries. Concepts of permutation and tonnetz (spatial representation of voice leading and modulation) can be joined together in a physical device, the CubeHarmonic, a musical version of the Rubik’s cube. We finally describe a prototype of the CubeHarmo...

Playing with toy blocks reveals patterns in children's play that are valuable for therapy and assessment. Following the 2011 Tohoku Earthquake and Tsunami in Japan, we witnessed young survivors expressing post-trauma stress in block play. Motivated by the limitations in assessing this behavior using traditional methods, our paper describes the desi...

This symposium showcases the latest work from Asia on interactive systems and user interfaces that address under-explored problems and demonstrate unique approaches. In addition to circulating ideas and sharing a vision of future research in human-computer interaction, this symposium aims to foster social networks among academics (researchers and s...

Establishing user-friendly character control has been a challenge for virtual reality since its recent explosion. Several methods of character navigation have been presented to the general VR audience, however, each have unique and particular problems that have constrained developers, forcing them for instance to work within a limited play area or...

We present a concept of dynamically adaptive workspace using MovemenTable, autonomously moving interactive digital table. In this demo, we introduce two interaction scenarios, arranging workspace anywhere and floating interactive surface on large floor screen. In the first scenario, the interactive digital table is automatically arranged anywhere i...

This paper presents an automatic 3D gesture collection concept and architecture based on a rhythm game for public displays. The system was implemented using an off-the-shelf gesture controller, was deployed on a public vertical screen, and was used to study the effects of alternative gesture guidance conditions. In the evaluation presented, we exam...

Cadaveric dissection has been the gold standard in the teaching of anatomy in medical schools around the world. Cadaveric dissection allows a medical student to understand the spatial relationships of different parts in the body in ways that a typical 2D representation cannot, due to its ability to provide an authentic learning experience which eng...

This symposium showcases the latest work from Japan and Southeast Asia on interactive systems and user interfaces that address under-explored problems and demonstrate unique approaches. In addition to circulating ideas and sharing a vision of future research in human-computer interaction, this symposium aims to foster social networks among young re...

We conducted a user study evaluating five selection techniques for augmented reality in optical see-through head-mounted displays (OST-HMDs). The techniques we studied aim at supporting mobile usage scenarios where the devices do not need external tracking tools or special environments, and therefore we selected techniques that rely solely on track...

VR is increasingly becoming an interaction platform that allows users to display and manipulate various digital content such as text, computer graphic, 3D model, amination, and sound in a 3D space. In this work, we seek an enjoyable interface to manage a large set of digital content. We propose ViBlock (Virtual Interactive Block) (Figure 1), a nove...

We describe our approach that derives reliable 6-DOF information including the translation and the rotation of a rigid marker in a 3D space from a set of insufficient 5-DOF measurements. As a practical example, we carefully constructed a prototype and its design and evaluated it in our 3D dexterous motion-tracking system, IM6D, which is our novel r...

Wall displays almost universally assume a mostly flat and static shape. We ask two questions: Would people choose a flat display for a given interaction scenario and, if not, what are the display shapes they actually prefer? We conducted a design study around these two questions. Our results show that participants designed different screen shapes t...

This symposium showcases the latest work from Japan on interactive systems and user interfaces that address under-explored problems and demonstrate unique approaches. In addition to circulating ideas and sharing a vision of future research in human-computer interaction, this symposium aims to foster social networks among young researchers and stude...

Optical see-through head-mounted displays enable augmented reality (AR) applications that display virtual objects overlaid on the real world. At the core of this new generation of devices are low-cost tracking technologies that allow us to interpret users' motion in the real world in relation to the virtual content for the purposes of navigation an...

Interactive tabletop is fundamentally a social entity that allows people to gather around it and to engage in various tasks, individually or in a group. Typically, every table is anchored in an environment and has a single shaped surface, which limits its usage to specific goals and needs. In fact, people will sometime replace tables and move them...

We propose D-FLIP Paintings, a dynamic, flexible, and interactive display method of paintings aimed at education of art appreciation. This system dynamically makes a flexible layout of hundreds of paintings in real time according to the variety of interactions among the users. It is expected to provide proactive learning and new insights through di...

We propose IM6D, a novel real-time magnetic motion-tracking system using multiple identifiable, tiny, lightweight, wireless and occlusion-free markers. It provides reasonable accuracy and update rates and an appropriate working space for dexterous 3D interaction. Our system follows a novel electromagnetic induction principle to externally excite wi...

MovemenTable (MT) is an exploration of moving interactive tabletops which can physically move, gather together or depart according to people’s dynamically varying interaction tasks and collaborative needs. We present the design and implementation of a set of MT prototypes and discuss a technique that allows MT to augment its visual content in order...

This paper explores the Boundless Scroll interface that extends the motor space for finger drag motions into the off-screen space using a tracking system around the screen. Seamlessly extended motor spaces enable continuous scroll actions across the on- and off-screens, reducing the chance of clutching and preserving content visibility during long-...

We present GyroWand, a raycasting technique for 3D interactions in self-contained augmented reality (AR) head-mounted displays. Unlike traditional raycasting which requires absolute spatial and rotational tracking of a user's hand or controller to direct the ray, GyroWand relies on the relative rotation values captured by an inertial measurement un...

This symposium showcases the latest work from Japan on interactive systems and user interfaces that address under-explored problems and demonstrate unique approaches. In addition to circulating ideas and sharing a vision of future research in human-computer interaction, this symposium aims to foster social networks among young researchers and stude...

We propose A-Blocks, a novel building block device that enables detection and recognition of children's actions and interactions when building with blocks. Quantitative data received from constructing and breaking A-Blocks can be valuable for various assessment applications (e.g., play therapy, cognitive testing, and education). In our prototype sy...

We present our study of Calamaro: a robotic platform designed to investigate the impact of emotive motion on people, and its deployment in an extensive field study in a busy public space at the University of Calgary campus. Our paper details the design of the Calamaro robot, the field study conducted with it, including hundreds of observers and 88...

We propose a novel building-block interface called StackBlock that allows users to precisely construct 3D shapes by stacking blocks at arbitrary positions and angles. Infrared LEDs and phototransistors are laid in a matrix on each surface of a block to detect the areas contacted by other blocks. Contact-area information is transmitted to the bottom...