Kazuya Murao

Ritsumeikan University · Information Science and Technology

Many interaction methods between users and wearable devices have been proposed until now. In previous works, an interaction method to input commands by controlling the photoelectric pulse wave sensor value is proposed. In this paper, we propose a new interaction method using pulse wave control, a video game played using pulse wave control as a game...

The electromyogram (EMG) is a waveform representation of the action potential generated by muscle cells using electrodes. EMG acquired using surface electrodes is called surface EMG (sEMG), and it is the acquisition of muscle action potentials transmitted by volume conduction from the skin. Surface electrodes require disposable conductive gel or ad...

The extensive research on wearable devices has led to devices with various shapes and mounting locations.Wearable devices are often used to record the user’s biometric information, and methods have been proposed to detect physical abnormalities from the acquired data. Among various kinds of biometric data, pulse data has been used in methods such a...

Artificial Intelligence (AI) for human emotion estimation, such as facial emotion estimation, has been actively studied. On the other hand, there has been little research on unconscious phenomena in cognition and psychology (i.e., cognitive biases) caused by viewing AI emotion estimation information. Therefore, this study verifies RQ “Do people hav...

Research on hands-free input methods has been actively conducted. However, most of the previous methods are difficult to use at any time in daily life due to using speech sounds or body movements. In this study, to realize a hands-free input method based on nasal breath using wearable devices, we propose a method for recognizing nasal breath gestur...

Systems of presenting myoelectricity sensor information allow users to understand the body's load for various purposes, such as medical rehabilitation and sports training. If there is a method to create the psychological phenomenon of unconsciously increasing or decreasing a user's load perception simply by changing how to present the myoelectricit...

There are situations where manipulating subjective time would be desirable, such as reducing waiting time, and there are many studies to manipulate subjective time. However, it is not easy to use previous methods in various situations because most of them use visual and auditory information. This study proposes a method to manipulate the subjective...

Memorization is necessary for various fields, such as language learning in the field of education. While memorization learning is often tedious and demotivating due to requiring conscious effort, few support approaches improve memorization unconsciously with low conscious effort. In this study, we propose a method, Mindless Memorization Booster, wh...

With the spread of eyewear devices, people are increasingly using information devices in various everyday situations. In these situations, it is important for eyewear devices to have eye-based interaction functions for simple hands-free input at a low cost. This paper proposes a gaze movement recognition method for simple hands-free interaction tha...

Simple hands-free input methods using ear accessories have been proposed to broaden the range of scenarios in which information devices can be operated without hands. Although many previous studies use canal-type earphones, few studies focused on the following two points: (1) A method applicable to ear accessories other than canal-type earphones. (...

This paper reports Bento Packaging Activity Recognition Challenge by team “RitsBen” held in the International Conference on Activity and Behavior Computing (ABC 2021). Our approach used an autocorrelation function in the preprocessing to isolate the data since the dataset was given with repetitive activity. We then use a model that implements convo...

Delays (waiting time) often occur in computer use, and an illusion of changing subjective elapsed time occurs unintentionally due to perceptual stimuli from computer interfaces. Since these can adversely affect users’ experiences and minds, investigating and manipulating the illusion of changing the subjective elapsed time on computer interfaces ha...

The Sussex-Huawei Locomotion-Transportation (SHL) Recognition Challenges aim to advance and capture the state-of-the-art in locomotion and transportation mode recognition from smartphone motion (inertial) sensors. The goal of this series of machine learning and data science challenges was to recognize eight locomotion and transportation activities...

In this paper we summarize the contributions of participants to the fourth Sussex-Huawei Locomotion-Transportation (SHL) Recognition Challenge organized at the HASCA Workshop of UbiComp/ISWC 2021. The goal of this machine learning/data science challenge is to recognize eight locomotion and transportation activities (Still, Walk, Run, Bike, Bus, Car...

With the spread of devices equipped with touch panels, such as smartphones, tablets, and laptops, the opportunity for users to perform touch interaction has increased. In this paper, we constructed a device that generates multi-touch interactions to realize high-speed, continuous, or hands-free touch input on a touch panel. The proposed device cons...

Wearable devices with motion sensors, such as accelerometers and gyroscopes, are expected to become popular. There is a lot of research on recognizing gestures using data obtained from motion sensors. A gesture is a one-off motion and its trajectory, i.e., the waveform of the gesture part, is considered to be important. After segmenting the data, g...

This paper reports the Cooking Activity Recognition Challenge by team Rit’s cooking held at International Conference on Activity and Behavior Computing (ABC 2020). Our approach leverages the convolutional layer and LSTM to recognize macro activities (recipe), and micro activities (body motion). For micro activities consisting of multiple labels in...

Various types of helmets exist, including industrial protective helmets, motorcycle helmets, sports helmets, and military/police helmets. By identifying individuals wearing a helmet, their name, affiliation, and qualification can be presented on a display mounted on the helmet, and sensor data collected through the helmet, such as acceleration, vid...

In this paper we summarize the contributions of participants to the third Sussex-Huawei Locomotion-Transportation (SHL) Recognition Challenge organized at the HASCA Workshop of UbiComp/ISWC 2020. The goal of this machine learning/data science challenge is to recognize eight locomotion and transportation activities (Still, Walk, Run, Bike, Bus, Car,...

With the increasing spread of smartphones and wearable devices equipped with various sensors, human activities, biometric information, and surrounding situations can be recognized. The process of human activity recognition must construct a model that has learned annotated sensor data, i.e., ground truth, labels, or answer activity, in advance. Ther...

The importance of location information is increasing more and more. Therefore, research on indoor positioning technology is actively conducted. Among them, Wi-Fi positioning is attracting attention because of its low introduction cost. However, since the Wi-Fi is blocked by the human body, the RSSI decreases. Therefore, we investigated radio wave a...

The recognition of complex and subtle human behaviors from wearable sensors will enable next-generation human-oriented computing in scenarios of high societal value (e.g., dementia care). This will require large-scale human activity corpuses and much improved methods to recognize activities and the context in which they occur. This workshop deals w...

The process of human activity recognition needs to construct a model that has learned sensor data with annotations, i.e., groundtruth, label, or answer activity, in advance. Therefore, a large and diverse set of annotated data are needed to improve and evaluate model performance. Since it is difficult to judge the user's situation even after seeing...

In this paper, we propose a gesture recognition method with acceleration data weighted by sEMG. Acceleration and sEMG are collected as training data, and gestures are recognized using only acceleration as input data. The dynamic time warping (DTW) algorithm is used for the distance calculation. Three axis acceleration data and sEMG were collected f...

In this paper we summarize the contributions of participants to the Sussex-Huawei Transportation-Locomotion (SHL) Recognition Challenge organized at the HASCA Workshop of Ubi-Comp 2019. The goal of this machine learning/data science challenge is to recognize eight locomotion and transportation activities (Still, Walk, Run, Bike, Bus, Car, Train, Su...

We propose and implement data transmission method for capacitive touch panel using physical interface and micro-computer that can generate touch to capacitive touch panel. The proposed device consists of one-board microcomputer, an external power supply, and multiple touch control devices that can be individually controlled. One touch control devic...

In our daily lives, we use places shared by multiple people such as homes and offices. Although many methods for individual recognition have been proposed, when they are used in such places, they have some problems in terms of psychological and physical burden. Therefore, in this research, we propose a method to recognize a person who entered or le...

This paper proposes a device that automatically generates various touch interactions including multi-touch to realize touch interactions at high speed, continuously, and hands free. The proposed device does not require additional software installations to the touch panel, and it can be expected to improve efficiency and realize automation of work u...

We propose a system that structures a meeting log by detecting and tagging the partici- pants’ actions in the meeting using acceleration sensors. The proposed system detects head movement such as nodding of each participant or motion during utterances by using ac- celeration sensors attached to the heads of all participants in a meeting. As an eval...

We propose a system that structures a meeting log by detecting and tagging the participants’ actions in the meeting using acceleration sensors. The proposed system detects head movement such as nodding of each participant or motion during utterances by using acceleration sensors attached to the heads of all participants in a meeting. In addition, w...

Along with the downsizing of computers and sensors, user situation and state can be recognized by sensing, signal processing, and machine learning technologies in many places. In home environments, it is reported that the number of drowned people in a bathtub has increased to 4,886 in 2004, which is 1.7 times from 2004. In order to prevent the occu...

The recognition of complex and subtle human behaviors from wearable sensors will enable next-generation human-oriented computing in scenarios of high societal value (e.g., dementia care). This will require large-scale human activity corpuses and much improved methods to recognize activities and the context in which they occur. This workshop deals w...

As it is generally difficult to utilize GPS positioning indoors, methods such as Wi-Fi positioning and PDR positioning are proposed. In particular, in addition to being able to estimate the absolute position, the Wi-Fi positioning has attracted attention due to the low introduction cost due to already installed Wi-Fi base stations in various facili...

In this paper we summarize the contributions of participants to the Sussex-Huawei Transportation-Locomotion (SHL) Recognition Challenge organized at the HASCA Workshop of UbiComp 2018. The SHL challenge is a machine learning and data science competition, which aims to recognize eight transportation activities (Still, Walk, Run, Bike, Bus, Car, Trai...

Gesture-based recognition is one of the most intuitive methods for inputting information and is not subject to cumbersome operations. Recognition is performed on human's consecutive motion without reference to retrial or alternation by user. We propose a gesture recognition model with a mechanism for correcting recognition errors that operates inte...

Technologies for grasping the distribution and flow of people are required for urban planning, traffic planning, evacuation, rescue activities in case of disaster, and marketing. In order to grasp what kind of attribute the distribution and flow of people are formed, this paper proposes a method that estimates the attributes of users. As a method o...

Gesture-based recognition is one of the most intuitive methods for inputting information and is not subject to cumbersome operations. Recognition is performed on human’s consecutive motion without reference to retrial or alternation by user. We propose a gesture recognition model with a mechanism for correcting recognition errors that operates inte...

Competitive karuta is an official Japanese card game and is described as “martial art on the tatami.” Recently, competitive karuta has attracted a great deal of attention among young people. One of characteristic rules of competitive karuta is that there is no referee; therefore players must judge themselves even if the difficult situation arises....

Currently GPS is utilized for localization but is not reliable indoors or underground where its signals cannot reach. Instead, localization using Wi-Fi is investigated in the field of indoor positioning. Wi-Fi localization is performed using a radio model created by observed information collected beforehand; however, the model deteriorates over-tim...

Location-based services and context-aware services of smartphones have been paid much attentions. For these services, location information is important. Therefore, several positioning methods have been developed. This research focuses on unnecessary operation of GPS in seamless Indoor/Outdoor positioning. In order to reduce unnecessary behavior of...

There have been several studies on object detection and activity recognition on a table conducted thus far. Most of these studies use image processing with cameras or a specially configured table with electrodes and an RFID reader. In private homes, methods using cameras are not preferable since cameras might invade the privacy of inhabitants and g...

Along with the progress of miniaturization and energy saving technologies of sensors, biological information in our daily life can be monitored by installing the sensors to a lavatory bowl. Lavatory is usually shared among several people, therefore biological information need to be identified. Using camera, microphone, or scales is not appropriate...

In this paper, we propose a screen unlocking system using an accelerometer and pressure sensor arrays mounted on a mobile phone as casual identification. The proposed system focuses on the user's behavioral characteristics when taking their mobile phone from their pocket and the pressure distribution when gripping the mobile phone during this motio...

PDR (Pedestrian Dead Reckoning) is a very promising technology for indoor positioning. We held a technical challenge, entitled the UbiComp/ISWC 2015 PDR Challenge, consisting of the following three categories: a PDR algorithm category; a PDR Evaluation method category; and an exhibition. In this paper, we especially focus on several systems for the...

Competitive karuta is a Japanese card game. It is played without a referee. Therefore, the players sometimes get into an argument over their judgement. We propose a system that judges the player who took a card first in a competitive karuta match by using a wrist-worn accelerometer and gyroscope. From the experiments, 69.2% of rounds were estimated...

Along with the spread of smart phones and wearable devices, systems that recognizes gestures such as punch and chop using an accelerometer have recently been attracting a great deal of attention. However, these systems do not consider the situation that gestures are performed continuously from/to other gestures or untrained movements and can not re...

Many activity recognition systems using accelerometers have been proposed. Activities that have been recognized are single activities which can be expressed with one verb, such as sitting, walking, holding a mobile phone, and throwing a ball. In fact, combined activities that include more than two kinds of state and movement are often taking place....

There have been several studies on object detection and activity recognition on a table conducted thus far. Most of these studies use image processing with cameras or a specially configured table with electrodes and an RFID reader. In private homes, methods using cameras are not preferable since cameras might invade the privacy of inhabitants and g...

An accelerometer is installed in most current mobile phones, such as iPhones, Android-powered devices, and video game controllers for the Wii or PS3, which enables easy and intuitive operations. Therefore, many gesture-based user interfaces that use accelerom-eters are expected to appear in the future. Gesture recognition systems with an accelerome...

Recently, bicycling as a sport has attracted a great deal of attention. Previous research on bicycles suggests that pedaling at high frequency at a constant speed is most effective. However, it is hard for beginners to acquire such pedaling skills since expert cyclists develop the skills through long-term training. We propose a bicycle pedaling tra...

Mobile phones and video game controllers using gesture recognition technologies enable easy and intuitive operations, such as those in drawing objects. Gesture recognition systems generally require several samples of training data before recognition takes place. However, recognition accuracy deteriorates as time passes since the trajectory of the g...

Pedestrian ow analysis using Wi-Fi packet sensors can easily collect the movement trajectories of individuals, has a high-resolution sensing ability, and is well suited to indoor operations. Thus it is regarded as one of the promising sensing technologies for Smart Cities targeting a variety of applications such as disaster prevention, the planning...

Hybrid indoor positioning researches, which aim improving the positioning accuracy by applying multiple positioning techniques, are the focus of many researchers in these days. However, the current approaches do not consider the positioning accuracy, and tend to combine the positioning techniques together without further caring about the accuracy o...

Pedestrian Dead Reckoning (PDR) has recently attracted attention of researchers. PDR refers to indoor positioning technology that uses the acceleration sensor and gyroscope from a smartphone for relative positioning. However, the positioning results are often degraded, owing to the accumulation of errors such as estimation errors and those incurred...

A lot of systems and devices for text input in wearable computing environment have been proposed and released thus far, while these are not commonly used due to drawbacks such as slow input speed, long training period, low usability, and low wearability. This paper proposes a wearable text input device using touch typing skills that would have been...

Purpose – User authentication is generally used to protect personal information such as phone numbers, photos and account information stored in a mobile device by limiting the user to a specific person, e.g. the owner of the device. Authentication methods with password, PIN, face recognition and fingerprint identification have been widely used; how...