Hiroshi Ishiguro

Hiroshi Ishiguro
Osaka University | Handai · Department of Systems Innovation

Doctor of Engineering

About

725
Publications
156,517
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
14,219
Citations
Citations since 2016
336 Research Items
8452 Citations
201620172018201920202021202202004006008001,0001,2001,400
201620172018201920202021202202004006008001,0001,2001,400
201620172018201920202021202202004006008001,0001,2001,400
201620172018201920202021202202004006008001,0001,2001,400

Publications

Publications (725)
Article
Full-text available
Language models (LMs) continue to reveal non-trivial relations to human language performance and the underlying neurophysiology. Recent research has characterized how word embeddings from a LM can be used to generate integrated discourse representations in order to perform inference on events. The current research investigates how such event knowle...
Article
Full-text available
Several studies have shown that infants anticipate human goal-directed actions, but not robot's ones. However, the studies focusing on the robot goal-directed actions have mainly analyzed the effect of mechanical arms on infant's attention. To date, the prediction of goal-directed actions in infants has not yet been studied when the agent is a huma...
Article
Full-text available
Developing a communication agent that can mutually interact with a human has been expected. To realize the agent, real-time situation recognition and motion generation are necessary. The human-human interaction data is utilized to develop the recognition and the generation model. However, a cost of giving a certain label to the data is expensive, i...
Article
For some individuals with social anxiety disorders (SAD) comorbid with autism spectrum disorders (ASD), it is difficult to speak in front of others. Herein, we report the case of a patient with SAD comorbid with ASD who could not speak in front of others until she used a humanoid robot as her avatar. During the intervention, her personality changed...
Chapter
Due to the Covid-19 outbreak, more people in the workforce, especially in the IT industry, started working from home. This brought a set of issues and challenges for both workers and companies across the globe such as losing touch with other co-workers. This could potentially result in decrease of the performance and innovation. This paper investig...
Article
Full-text available
When designing rule-based dialogue systems, the need for the creation of an elaborate design by the designer is a challenge. One way to reduce the cost of creating content is to generate utterances from data collected in an objective and reproducible manner. This study focuses on rule-based dialogue systems using survey data and, more specifically,...
Article
Full-text available
This study shows an autonomous android robot that can have a natural daily dialogue with humans. The dialogue system for daily dialogue is different from a task-oriented dialogue system in that it is not given a clear purpose or the necessary information. That is, it needs to generate an utterance in a situation where there is no clear request from...
Article
Full-text available
Successful cases of robot sales promotions have been increasing. Users tend to make purchases when robots properly interact with users. Most robot interactions/recommendations are created using specific products and locations within the context. Therefore, developers have to prepare a new recommendation interaction each time with each new product,...
Article
Full-text available
The research and development of robots that can have daily dialogues autonomously with humans have become increasingly important. Most of them, however, have been limited to studies on speech recognition and interfaces. As the result, they still cannot build relationships with humans through long-term daily dialogue. In this background, we have dev...
Article
Full-text available
Synchronization between humans is often observed in our daily lives, for example in breathing, in hand clapping in crowds, and in walking. It has been reported that pedestrian gait synchronization maximizes walking flow efficiency. As increasingly more mobile robots are being developed for practical use, it is important to consider how robots may i...
Preprint
When designing rule-based dialogue systems, the need for elaborate design by the designer is a challenge for dialogue systems. One way to reduce the cost of creating content is to generate utterances from data collected in an objective and reproducible manner. This study focuses on rule-based dialogue systems using survey data, and more specificall...
Article
Full-text available
When a person uses a single modality to obtain information from multiple sources, the modality experiences resource competition, affecting perception. To avoid such human resource conflicts, we investigated whether a person could multitask efficiently by using tactile perception instead of visual perception to recognize the robot in a scenario wher...
Article
Emotional voice conversion (EVC) is a task that converts an utterance’s emotional features into a target one while retaining semantic information and speaker identity. Recently, some researchers leverage deep learning methods to improve the performance of EVC, such as deep neural network (DNN), sequence-to-sequence model (seq2seq), long-short-term...
Article
Full-text available
The emotion expressions of social robots are some of the most important developments in recent studies on human–robot interactions (HRIs). Several research studies have been conducted to assess effective factors to improve the quality of emotion expression of the robots. In this study, we examined the effects of a robot’s vertical oscillation and t...
Article
Full-text available
We examined the influence of groups of agents and the type of avatar on movement interference. In addition, we studied the synchronization of the subject with the agent. For that, we conducted experiments utilizing human subjects to examine the influence of one, two, or three agents, as well as human or robot avatars, and finally, the agent moving...
Article
Full-text available
Studies on social robots that can communicate with humans are increasingly important. In particular, semi-aautonomous robots have shown potential for practical applications in which robot autonomy and human teleoperation are jointly used to accomplish difficult tasks. However, it is unknown how the attitude represented in the autonomous behavior of...
Article
Full-text available
Android robots are employed in various fields. Many individuals with autism spectrum disorders (ASD) have the motivation and aptitude for using such robots. Interactions with these robots are structured to resemble social situations in which certain social behaviors can occur and to simulate daily life. Considering that individuals with ASD have st...
Article
Full-text available
Many individuals with autism spectrum disorders (ASD) demonstrate some challenges with personal narrative writing. Sentence completion tests (SCT) is a class of semi-structured projective techniques and encourage respondents to disclose their private narratives. Even in SCT, only providing beginning of sentences is inadequate to compensate atypical...
Article
The goal of this study is to realize a non-task-oriented dialogue agent that is accepted by people in the long term. One approach is using a dialogue strategy in which an agent shares information about other users who are not participating in the current dialogue. This study aims to develop a chatbot that is capable of sharing information about oth...
Article
Full-text available
This paper investigates the influence of adding an upper body to a bipedal robot on its stable walking behavior. The robot’s parts are mutually interconnected through an actuator network system. Therefore, the movement pattern of the upper body depends on the type of interactions created with other limbs. Throughout the experiments, various interac...
Article
Full-text available
Mental health issues are receiving more and more attention in society. In this paper, we introduce a preliminary study on human–robot mental comforting conversation, to make an android robot (ERICA) present an understanding of the user’s situation by sharing similar emotional experiences to enhance the perception of empathy. Specifically, we create...
Article
Full-text available
The rapid expansion of online job interviews during the COVID-19 pandemic is expected to continue after the pandemic has subsided. These interviews are a significant barrier for individuals with autism spectrum disorders (ASD). There is little evidence-based training for online job interviews for individuals with ASD, and the development of new tra...
Article
Speaker individual bias may cause emotion-related features to form clusters with irregular borders (non-Gaussian distributions), making the model sensitive to local irregularities of pattern distributions, resulting in model over-fit of the in-domain dataset. This problem may cause a decrease in the validation scores in cross-domain (i.e., speaker-...
Article
Full-text available
In recent years, the demand for remote services has increased with concerns regarding the spread of infectious diseases and employees’ quality of life. Many attempts have been made to enable store staff to provide various services remotely via avatars displayed to on-site customers. However, the workload required on the part of service staff by the...
Preprint
Full-text available
In this study, we explore the transformer's ability to capture intra-relations among frames by augmenting the receptive field of models. Concretely, we propose a CycleGAN-based model with the transformer and investigate its ability in the emotional voice conversion task. In the training procedure, we adopt curriculum learning to gradually increase...
Article
Full-text available
Recent developments in conversational technologies have attracted researchers to study their applications in recommending items through conversations. It is considered that physical robots, rather than virtual ones, are effective in situations in which robots talk about items near participants. However, in real situations, robots may be required to...
Chapter
We investigate how older adults with mild cognitive impairment can be affected by a robot companion at home in a long-term study. For this purpose, we selected two participants living alone and set up the robotic communication media RoBoHoN at their homes so that participants could interact with it at any time for one and half to three months. Afte...
Article
Full-text available
Communication apprehension (CA), defined as anxiety in oral communication, and anxiety in eye contact (AEC), defined as the discomfort felt in communication while being stared at by others, limit communication effectiveness. In this study, we examined whether using a teleoperated robot avatar in a video teleconference provides communication support...
Article
Robots are required to be significantly compliant and versatile to work in unstructured environments. In a number of studies, robots have positively exploited the environments during interactions and completed tasks from a morphological viewpoint. Modular robots can help realize real-world adaptive robots. Researchers have been investigating the ac...
Article
Full-text available
In this study, we implemented a model with which a robot expressed such complex emotions as heartwarming (e.g., happy and sad) or horror (fear and surprise) by its touches and experimentally investigated the effectiveness of the modeled touch behaviors. Robots that can express emotions through touching behaviors increase their interaction capabilit...
Article
Full-text available
In conversations between people and social robots, it is important that robots show agreements to user's opinions from the aspect of building relationships. However, robot's agreements are often incoherent to user's opinions due to speech recognition failures. This paper proposes a new approach called double-meaning agreement to conceal the incoher...
Preprint
Research currently being conducted on the use of robots as human labor support technology. In particular, the service industry needs to allocate more manpower, and it will be important for robots to support people. This study focuses on using a humanoid robot as a social service robot to convey information in a shopping mall, and the robot's behavi...
Article
Full-text available
Humans can express their emotions with not only facial expressions or gestures but also whole-body motion, even while walking, which are essential for our interpersonal relationships and our interaction with others. Communication with people is also considered an important task for robots, however emotional expressions by wheeled mobile humanoid ro...
Article
Full-text available
This research develops a conversational robot that stimulates users’ dialogue satisfaction and motivation in non-task-oriented dialogues that include opinion and/or preference exchanges. One way to improve user satisfaction and motivation is by demonstrating the robot’s ability to understand user opinions. In this paper, we explore a method that ef...
Article
To design a dialogue well and easily implement it into an agent dialogue system, we constructed and verified typical dialogue patterns as “ Dialogue Design Patterns ”. To analyze the dialogues, we defined the “ Standard Dialogue Structure ”that represents simple components of dialogues. This is constructed using the“ Turn ”that is one turn-taking b...
Article
For a conversational robot, conveying its intention explicitly to the communicating human is one of the most important but challenging tasks in the field of human–robot interaction (HRI). Expressing the robot’s current mental state or feeling while conversing may help achieve a more effective communication. In this study, a robot equipped with a pr...
Article
Expressing emotions through various modalities is a crucial function not only for humans but also for robots. The mapping method from facial expressions to the basic emotions is widely used in research on robot emotional expressions. This method claims that there are specific facial muscle activation patterns for each emotional expression and peopl...
Article
Full-text available
Although before-touch situations are essential to achieve natural touch interactions between people and robots, they receive less attention than after-touch situations. This study reports pre-touch reaction distance analysis results around touchable upper body parts, i.e., shoulders, elbows, and hands, based on human–human pre-touch interaction. We...
Article
Full-text available
One essential role of social robots is supporting human mental health by interaction with people. In this study, we focused on making people's moods more positive through conversations about their problems as our first step to achieving a robot that cares about mental health. We employed the column method, a typical stress coping technique in Japan...
Article
Full-text available
In this paper, we present an electrically driven childlike android named ibuki equipped with a wheeled mobility unit that enables it to move in a real environment. Since the unit includes a vertical oscillation mechanism, the android can replicate the movements of the human center of mass and can express human-like upper-body movements even when mo...
Article
Full-text available
Individuals with autism spectrum disorders (ASD) are often not comfortable during mobile-phone conversations with unfamiliar people. “ Hugvie ” is a pillow with a human-like shape that has been designed to provide users with the tactile sensation of hugging another person during phone conversations to promote feelings of comfort and trust in the sp...
Article
Full-text available
Sensory overresponsivity (SOR) emerges before anxiety and positively predicts subsequent increasing levels of anxiety in individuals with autism spectrum disorder (ASD). Sensory seeking behavior occurs as compensation for SOR, and individuals may seek sensory input in one sensory domain to compensate for SOR. Tactile seeking behavior is sufficient...
Article
Full-text available
We propose a new wearable agent“, FinU (Friend in You)”, based on the hypothesis that inducing social facilitation effect, i.e., the effect of having other agents around to increase the task performance, is possible, even for wearable agents with a single sensory modality, by establishing beliefs about the agent in advance. Our agent system, FinU,...
Chapter
To design a dialogue well and easily implement it into an autonomous dialogue system, a dialogue with simple components in which interaction with the partners is smoothly achieved is required. In designing interactions to use in an autonomous dialogue system, we consider that there are typical dialogue structures that convey agency and facilitate t...
Article
Full-text available
Motivated by the fact that some human emotional expressions promote affiliating functions such as signaling, social change, and support, all of which have been established as providing social benefits, we investigated how these behaviors can be extended to Human-Robot Interaction (HRI) scenarios. We explored how to furnish an android robot with soc...
Article
Full-text available
Social connectedness is vital for developing group cohesion and strengthening belongingness. However, with the accelerating pace of modern life, people have fewer opportunities to participate in group-building activities. Furthermore, owing to the teleworking and quarantine requirements necessitated by the Covid-19 pandemic, the social connectednes...
Article
Full-text available
Information technology, including digital devices, robots, and the internet, is of great interest in the field of education. Many previous studies have focused on improving lecturer–student communication during lectures. In this paper, we describe a new robot-teleoperation system for transferring students’ opinions or questions to the lecturer. Thr...
Chapter
We designed HIRO, a robotic baby doll, to be used in an interactive, non-pharmacological intervention that combines doll therapy with robot technology for elderly people with dementia. We took a minimal design approach; only the most basic human-like features are represented on the robotic system to encourage users to use their imagination to fill...
Article
Full-text available
Though existing social robots can already be used in a variety of applications, there are technical limitations to their use, especially outside the laboratory, and humans do not fully trust or recognize them. Considering these problems, a method to make humans accept a robot’s suggestion more easily was investigated. An idea called “sequential per...
Article
Full-text available
The number of isolated elderly people with few opportunities to talk to other people is currently increasing. Research is ongoing to develop talking robots for addressing the situation. The aim of the present study was to develop a talking robot that could converse with elderly people over an extended period. To enable long-duration conversation, w...
Article
Full-text available
The perception of putative pheromones or social odors (PPSO) in humans is a widely debated topic because the published results seem ambiguous. Our research aimed to evaluate how cross-modal processing of PPSO and gender voice can affect the behavioral and psychophysiological states of the subject during a listening task with a bodily contact medium...
Conference Paper
In this paper, we propose an adversarial auto-encoder-based classifier, which can regularize the distribution of latent representation to smooth the boundaries among categories. Moreover, we adopt multi-instance learning by dividing speech into a bag of segments to capture the most salient moments for presenting an emotion. The proposed model was t...