Jun'ichi Hoshino

• University of Tsukuba

Furoshiki is a traditional culture of Japan which has prevailed in its everyday life and is widely used even today. In this paper, we propose a system through which users can be, while getting interested, exposed including to Japanese wrapping culture and attitude of dealing with things with care by augmenting an act to “wrap” with a piece of Japan...

When novice composers create a combination of melodies and accompaniments in the early stages of composition, they require a high easiness and good flexibility. We define music sketches as a “combination of an accompaniment and a melody. ” Novices need assistance in making music sketches, however, automation approach increases easiness but decrease...

We propose a system to construct Mixed Reality (MR) environments based on actual environments. Our goal is to develop MR content in which users and characters can coexist in an actual room and experience a story. This study represents a preliminary step in the development of such an MR experience. We proposed a method to construct an MR environment...

While home-use HMD including Oculus Rift has been widely spread in the market today, simulator sickness mainly caused by difference between visual information and body sensation has taken up as a problem. Even though it has been proved that simulator sickness is reduced by reflecting actual physical movement to a VR space, many of approaches ever p...

Reading aloud during childhood is fundamental to develop the necessary power of expression and imagination needed in society, and is adopted by many elementary schools in language classes. Teaching reading aloud focuses on the ability to adjust the way one reads to improve the understanding of the listener. However, it is difficult for children not...

We implemented the input interface named 'Novest' which can estimate the finger position and classify the finger state (out-of-range/hovering/touching) on the back of a hand with a small ranging sensor array attached on the side of a smartwatch, each of the small ranging sensors gets distance data and strength of signal data. With a prototype of No...

This article suggests a technique to make back of the hand (BOH) a track pad by attaching a distance ranging sensor on the side of a smart watch. It does not only estimate the position of a finger on BoH but also distinguishes the presence or absence of distance between the operating finger and BoH, which functions as an operating surface. Distance...

In this paper, we propose a system “AirMeet” that supports temporary communication within the venue of the social gathering by limiting personal information to be shared at the time of the social gathering according to its purposes. As a result of carrying out the experiment at the social gatherings, we confirmed that we can promote sharing within...

The animatoronics is used for the expression of the character with many picture works which includes movies. As for the animatronics mask that the person wears of the lively character, the expression of lively character is truly possible because the actor’s performance is reflected directly. In this research, I suggest using an animatronics mask in...

In order to produce a music sketch (a combination of melody and accompaniment) in the beginning of musical composition, it is effective to use a composition means with high portability capable of inputting a melody in real time. In this paper, we propose a system that enables a beginner of musical composition or instrument easily and readily to cre...

It is difficult to choose the right combination of make-up to reflect each individual taste since there are many products for each part of your face such as your cheek and mouth. Here we propose a make-up support system based on your choice of facial color. This system will present a make-up simulation image based on your favorite facial image and...

Reading aloud is an important study method of acquiring information and building knowledge from text. This article proposes an objective and automatable method that evaluates fluency of children’s reading by reflecting the evaluation by those who are experienced in book reading (to children), and presents the outcomes of building an automatic evalu...

The diversification of personal tastes and the rapid increase in choices makes it difficult to select things that suits them. For service providers it is fixedly segmented like a conventional mass media It is becoming more difficult to provide advertisements and services to individuals. Because of these circumstances, it is requested that we can ac...

Nowadays, we often plan our travels by using tourism-related information abundantly available on the web. However, it is not simple to find useful information for your travel plans from enormous amount of information. This study, therefore, proposes a system that can make recommendations to you based on your preferences without you having to search...

With the change in our diet, importance was placed on dietary education, and various systems for dietary education have been proposed. However, there has been no system that deals cooking tools. This article, therefore, proposes a peeler-type device, ‘TamaPeeler’, in the hypothesis that touching the food directly and being involved in cooking would...

In recent years, research on CG technology has advanced. However, the current CG character can only perform deterministic behavior; there is a problem that interaction cannot be real. Therefore, it is necessary to change the facial expression and gaze in real time to the user by the CG character to select a specific user in the space where there ar...

In a flexible society where individual diversification and individualization are advancing, due to the change of roles in the society and job content, areas that require individual judgment are increasing in daily life. In this chapter, I would like to overview the real-world game platform that can conduct systematic selection supports of various l...

It is difficult to reflect personal preferences in one's make-up because there are many make-up products for each part of the face such as cheeks and mouth. This paper proposes a make-up support system based on the colors of favorite facial image. It generates make-up simulation images based on the colors of user's favorite facial image and user's...

We propose a unified motion planner that reproduces variations in swimming styles based on the differences in the fish skeletal structures or the variations in the swimming styles based on changes in environmental conditions. The key idea in our method, based on biology, is the following. We considered the common decision-making mechanism in fish t...

Reading aloud during childhood is fundamental to develop the necessary power of expression and imagination needed in our society, and is adopted by many elementary schools in language classes. Teaching reading aloud focuses on the ability to adjust the way one reads to improve the understanding of the listener. However, it is difficult for children...

In a flexible society where individual diversification and individualization are advancing, due to the change of roles in the society and job content, areas that require individual judgment are increasing in daily life. In this chapter, I would like to overview the real-world game platform that can conduct systematic selection supports of various l...

Recently, online shopping continues to thrive in modern societies, especially via tablets and smartphones; however, in current online shopping environments, there is insufficient support for shopping with several people, which is often what shoppers do together in the nonvirtual world. In this paper, we propose a novel system that provides a new on...

In this paper, we propose the method for creating multi-view movable fogscreen, and then implement it in our system called “HANASUI”. “HANASUI” displays handheld-like fireworks through a fog screen instead of sparkles. Our method generates projection data dynamically from a virtual space and then casts it with multiple projectors, tracking the mark...

We propose a new communication system by which niche people can obtain cross-cutting information and communicate with other people based on each personality. The system graphically displays the degree and direction of other people’s hobbies who are interested in the keyword niche people input, and relation between the knowledge e.g. movies, music,...

In this paper, we propose a computational model to generate life-like motion for firefly-like creatures. By using a two-stage stochastic process and simple operational elements, we could generate various life-like motion patterns. Then, we incorporated these patterns in our animation system, where virtual fireflies move and emit light dynamically....

Quantitative evaluation of mental stress is important to prevent stress-related disorders. Finger plethysmography (FPG) is a simple noninvasive method to monitor peripheral circulation, and provides many physiological indices. Our purpose is to investigate how FPG-derived indices reflect on mental stress, and to clarify any association between thes...

Electric Vehicles (EV) and charging stations at large commercial centers with solar power generation are focused as a new energy infrastructure. However when many drivers visit to there, the demand of power for charging will be increased and they have to wait in queue until the power recovers. We propose a method to distribute the concentration of...

We present a new game system that provides both general knowledge and regionally specific disaster risks in a fun and interesting way. Users can experience disaster simulations on the go, as the game system detects the user’s position and movement using available GPS and acceleration sensors found in most current Smartphones. This application is in...

Imagine being able to approach any object in the real world and instantly learn how to read and pronounce the name of the object in any other language. This paper proposes the use of a system that simulates this idea by utilizing the video game medium in a way that makes learning a new language simple and fun. The system was designed specifically f...

According to data from Statistical Research on Shopping Centers (SC), the number of SC in January 2012 was 3050, which is 1.41 times that of Y2000. Despite gathering the impact on the custom absorbency power, there are some spaces with a negative atmosphere where crowds of people gather together at the same time in what could be considered as inact...

We propose the massive action control system (MACS) for interactive narrative entertainment. MACS determines the action priorities for characters based in part on their own internal states, such as the motivation behind the action, feeling, and personality. MACS selects a behavior control module, called an episode tree, of about 1000 events, which...

We propose the Narrative Entertainment System with Tabletop Interface. This system is using a miniature-shaped interface called Physical Character. By recognizing the operation of Physical Character, virtual actor’s behavior is under control, and that offers a method to create a story while playing with miniatures in a familiar way since our childh...

Breathing is the most basic requirement for having good health. However, unhealthy breathing like overbreathing and hyperventilation will happened easily without any awareness. We propose an experimental breathing movement exercise system - Virtual Blowgun System (VBS), offering an easy way of breathing exercise, for people of different physical st...

YOTARO is a baby-type robot developed to create a new communication perspective between robots and humans through interaction experience based on the reproduction of a baby’s behaviors and user actions. YOTARO exhibits different emotions and reactions, such as smiling, crying, sleeping, sneezing, and expressing anger. It is controlled by an emotion...

Trampobics is known as a kind of an aerobics training method with a mini trampoline. This method can reduce damage on the joint of legs than the aerobics with the floor aspect. In addition, trampobics promotes the consumption of the fat cell and takes a balance of the internal organs. Thus, trampobics promotes a healthy posture. In late years peopl...

Currently interactive entertainment characters have their conversation topics prepared beforehand by the creator. In this paper, we propose the automatic chat generation engine for emotional entertainment characters using real-time news information. The character emotionally reacts to the news contents based on their interest and feelings so that t...

In traditional English learning as a second language, learners rarely have the opportunity to practice oral communication, so the acquisition of oral proficiency is a slow process. In this paper, we propose a task-based second language learning game system. The task-based learning method enables learners to obtain communicative skills through the p...

One of the limitations of computer opponents in action games is that the character AI is constructed in advance, and players One of the limitations of computer opponents in action games is that the character AI is constructed in advance, and players may become bored quickly. We have built an online action game system in which a non-player character...

We propose the massive action control system (MACS) for interactive narrative entertainment. MACS determines the action priorities for characters based in part on their own internal states, such as the motivation behind the action, feeling, and personality. MACS selects a behavior control module, called an episode tree, of about 1000 events, which...

We propose the wellness entertainment system Versatile Training Field (VTF). In this system, we use the flexible foot interface as the input device. The system enables the user to move and jump freely in VR space by exaggerated movement corresponding to walking or jumping on the mini trampoline of the flexible foot interface. Improvements in exerci...

In recent years, many entertainment systems have relied on the progress of interaction technology to create characters that act autonomously. To show these lifelike characters, it is important for them to perform various actions, such as daily actions, reflex actions that require reacting to input from a user, perceiving actions where the character...

Everyone had experienced meet a baby in the train or elevator and unconsciously smiles, waves hands or tries to outstare him. The kindness feeling to babies is inherent in human's natural emotion. When we interact with a baby, while they still not have capacity to do things by themselves, we will need to do anything and everything to them. The huma...

We propose the wellness entertainment system Versatile Training Field (VTF). In this system, we use a mini trampoline as the input device. The system enables the user to move and jump freely in VR space by exaggerated movement corresponding to walking or jumping on the mini trampoline. Improvements in exercise motivation and support for continuous...

Massive Action Control System concurrently controls thousands of actions of multiple characters with various motivations, feelings, and personalities.

In games and movies that use characters, utterances are important expressions of action. However, currently, interactive characters have their conversation topics prepared beforehand by the creator. If the topics are few, they repeat the same content with fixed variations, resulting in the user losing interest. In this paper, we propose the concept...

Trampobics is an aerobics training method using a mini trampoline. It substantially decreases damage to the joints compared with aerobics on the floor. The benefits of trampobics include an improvement in balance, more active internal organs, and burning of fat. Thus, trampobics promotes a healthy posture[1][2]. Today some people engage in trampobi...

Automatic generation of gestures linked to conversation is required in CG animation and game creation. When multiple gestures are combined in the conventional method, continuity or matching at the motion level is not considered. As a result, a machinelike impression is produced, such as a return to the upright position each time a gesture is perfor...

Abstract CG character animations, in which CG characters engage in conversations, are widely used in multimedia contents such as videos and games. In constructing such an animation, we should consider about many factors, such as the content of the utterance and the state of conversation, which necessitates a large amount of time and labor. To deal...

Constructing a narrative ecosystem is one of the important technologies for many computer games. This paper presents a reactive episode control system that allows for dynamic creation of a long-term story in response to the active interaction between multiple characters and the user's actions. This system makes possible a story world where the user...

In this paper, we propose a model of 'negotiation of meaning' for a task-based language training online game. In the process of acquiring language skill through task-based learning, it is important for learners to try to convey information to one another and reach mutual comprehension through restating, clarifying, and confirming information via th...

Generating composite human motion such as locomotion and gestures is important for interactive applications, such as interactive storytelling and computer games. In interactive story environments, CG characters do not merely stand in one position. Rather, they should be able to compose gestures and locomotion based on the discourse of the story and...

運動が不足すると健康が阻害されることが知られ，室内で手軽に利用できる運動器具が普及している．しかし，どのような運動をどれくらいの時間行えばよいかといった運動処方を知るためには専門的知識が必要であり，過度な運動による事故や十分な運動効果を得ることが困難であった．そのため，運動効果が得られるように運動器具の負荷を自動制御するフィットネスマシンや，運動にゲーム性をもたせることで継続的な運動を促すことが提案されている．しかし，運動が単調であるために運動の達成感が得られず運動を継続できないことや，あらかじめ設定されたゲームの難易度が個人の運動習慣や心肺能力によって異なる有効心拍数を考慮していないために，ユーザによっては十分な運動を行うことができず運動効果が得られないといった問題があった．そこで本研究で...

Multimedia content such as videos and games often includes animation, in which virtual actors engage in conversations. In constructing such an animation, there are many factors to be considered, such as the content of the utterance and the state of conversation, which necessitates a large amount of time and labor. To deal with this problem, this pa...

This paper proposes Social Landscapes, a visual interface which supports exploring by visually displaying histories of user and interrelations between users in a social networking site. Social Landscapes visualizes the activities of each user through diary postings and the access status to online services, and the number of comments to the diary as...

The Embossed Touch Display is a novel tactile display that can present any given width of objects. When we touch objects in space, we actively move our hands and fingers. Due to this active touch movement, we can perceive the shape of an object, even ...

In this paper, we propose the soap bubble display method that the image can be projected to the real soap bubbles that white smoke entered. The position and the size of soap bubbles tossed in the air are detected with the camera. By projecting the image only to the position with the projector, the soap bubble display is realized. And the image and...

Mental communication with characters is important for many entertainment applications. Human's mental statuses are complex, and mental behaviors typically consist of multiple components, such as poses and various unconscious movements. In this paper, we propose the layered behavior synthesis technique for integrating mental behavior and conversatio...

The character creation that creates the player's characters has been adopted in various online games. It has an important role of creating unique characters. Although the creation of the body shape, the skin color and the hairstyle has been achieved, motion creation hasn't. In this paper, we propose the motion creation technique using the composite...

Lack of exercise is known to be detrimental to health, and various exercise machines that can be used indoors in a convenient manner are available. However, because expertise is required to ascertain which exercise to do and for how long, people sometimes sustain injuries by exercising excessively and find it difficult to sufficiently benefit from...

In action games, the computer’s behavior lacks diversity and human players are able to learn how the computer behaves by playing the same game over and over again. As a result, human players eventually grow tired of the game. Therefore, this paper proposes a method of imitating the behavior of human players by creating profiles of players from thei...

Mental communication with characters is important for many entertainment applications. Human's mental statuses are complex, and mental behaviors typically consist of multiple components such as poses and many unconscious movements. In this paper, we propose the layered behavior synthesis technique for integrating mental behavior and conversational...

In this paper, we propose the soap bubble display method that the image can be projected to the real soap bubbles that white smoke entered. The position and the size of soap bubbles tossed in the air are detected with the camera. By projecting the image only to the position with the projector, the soap bubble display is realized. And the image and...

Building story-based interactive systems are important for entertainment and education. In the storytelling system, a user can change the discourse of the story by talking with the character. The problem is that the scene goals in the realistic situations are complex and often multiple goals make effects to decide the current action. When a user as...

Generating composite human motion such as locomotion and gesture is important for interactive applications, such as interactive storytelling and computer games. In interactive story environments, characters do not merely stand in one position, they should be able to compose gestures and locomotion based on the discourse of the story and other objec...

This research paper describes a new method in which the discovery and construction of man-made structures, specifically medieval castles, in a three dimensional environment can be intelligently constructed given only a random terrain and simple user-defined ...

Video motion capture is useful for computer animation because we do not need expensive sensing systems to capture complex motion. However the conventional motion analysis techniques can be failed due to the partial occlusions. In this paper, we propose a robust tracking method by minimizing both intensity change and joint torque applying to the bod...

Story-based VR systems are important for many applications, such as entertainment and education. To increase the reality of CG characters, character's attentional behaviors are important to guess what the character is interested in. In this paper, we propose a composite body-head-eye motion model for attentional behaviors. Attentional direction is...

Storyboard is a classical animation tool to help the creators to organize scenes. However, in order to make animation from storyboard, we need many procedures. If producing animation is automati-cally from storyboard, it has the advantages of increased speed and reduced costs. In this paper, we pro-pose a new method for producing animation from sto...

Story-based VR system is important for many applications such as entertainment and education. In this paper, we propose the key action control of multiple human characters. Key actions are important actions that define the structure of story. Improvisational actions can be considered as variations that satisfy key actions. We applied the key action...

Building story-based interactive systems are important for entertainment and education. In the storytelling system, a user can change the discourse of the story by talking with the character. The problem is that the scene goals in the realistic situations are complex and often multiple goals make effects to decide the current action. When a user as...

An abstract is not available.

Hako-ne is an augmented reality hybrid art/technology project. Users will be able to see characters of 3D musical notes moving on each side of the augmented musical dollhouse by using a handheld Optical See-Through Information Viewer (OSTV), which consists ...

Automatic dance generation from music is useful for various entertainment applications including computer games. In this paper, we propose the automatic dance generation technique from music annotation.

Building realistic story environment is important for many entertainment and edutainment applications such as virtual trip and history learning. In this paper, we propose panorama-based immersive story environment. Virtual characters can walk and talk in photorealistic environment by using locomotion network and object annotations.

In this paper, we propose the immersive 3D movie system using contextual constraint action model. Important actions that define the structure of the story are called key-actions. Structure of key-action network represents story patterns. Spontaneous actions between key actions are interpolated using action networks. By integrating attention behavio...

Generating realistic human motions from sparse pose descriptions are important for computer animation and virtual human applications. In this paper, we propose an example-based motion interpolation technique using independent component analysis (ICA). We extract a few independent motion signals from multi-dimensional human movement. The result of t...

Generating realistic human motions from sparse pose descriptions are important for computer animation and virtual human applications. In this sketch, we propose an example-based motion interpolation technique using independent component analysis (ICA). The proposed method is also useful for human motion conversion, motion blending, and converting s...

Editing human motion signals are difficult because of its multi-dimensional nature. In this paper, we propose a new method for analysis and synthesis of human motion using ICA. We extract several independent motion signals from human movement. The result of the extracted motion signal corresponds to the perceptually meaningful motion features that...

Editing human motion signals are difficult because of its multi-dimensional nature. We propose a new method for analysis and synthesis of human motion using ICA. We extract several independent motion signals from human movement. The result of the extracted motion signal corresponds to the perceptually meaningful motion features that characterize th...

Tracking human body from video is important for many applications such as creating digital actors. However, when the intensity information is partly missing due to the occlusions, the parameter estimation can be easily failed. In this paper, we propose a human motion estimation method by minimizing both intensity change and torque applying to the b...

Not Available

We propose a new method for extracting personal characteristics from 3D body movement for intelligent virtual agent. We introduce the eigen action space to represent and reconstruct the personal characteristics.