Tomoo Inoue

University of Tsukuba · College of Information Science

Proceedings of the 3rd CODASSCA workshop on Data Science, Human-Centered Computing, and Intelligent Technologies.

In recent years, online commensality, such as remote dining, has become a way to connect people in different places. In remote dining, people have drinks, snacks, or meals while chatting with each other via video calls and seek connectedness and belonging. However, many people feel that there is a gap between real-life and digital co-eating and tha...

In recent years, various organizations, such as companies and governments, have been required to take measures for the mental health of their employees, and the importance of self-care for mental health by employees themselves has been increasing, as well as being supported by administrators, such as doctors and workplace managers. As a means of se...

Co-eating, also known as commensality, provides people with an opportunity to chat in a relaxed atmosphere. Research has also suggested some advantages of having food while conversing. In recent years, online commensality, such as remote co-eating via video-calling, has become a way to connect people in different places. However, there are still ma...

Proceedings of the 2nd Workshop on Collaborative Technologies and Data Science in Smart City Applications (CODASSCA2020).

Modern corporate activities are increasingly moving from the traditional way to teleworking. However, as teleworking spreading, the problem of declining employee engagement among teleworkers also comes to the fore. To address this issue, we propose a new approach based on the concept of interactive people analytics. It uses daily video reports to i...

One of the challenges found with learning using a lecture video is the short attention span of students due to high cognitive load when they are watching the video. Several methods have been proposed to increase students’ attention, such as segmenting learning content into smaller pieces where each piece has short video duration. In this study we p...

This book constitutes the proceedings of the 26th International Conference on Collaboration Technologies and Social Computing, CollabTech 2020. The conference was scheduled to take place in Tartu, Estonia, in September 2020. It was held virtually due to the COVID-19 pandemic. The 10 full and 5 work-in-progress papers presented in this volume were c...

Prior to this study, we digitized the counseling technique SAT (Structured Association Technique) method used in industrial clinics and developed a self-mental care course (SAT-VR method) for smartphones and VR, and confirmed its efficacy and safety. The SAT-VR method uses images such as light, color, and shape to change the physical discomfort of...

In this article, we explain how to process and interpret stage directions in order to support actors’ performances. To this end, we specify the function of coverbal gesture and movement as an additional statement by an actor. We introduce a classification of communicative gestures by individuals and groups based on a description with typical body t...

Conversation between native speakers and non-native speakers is not always easy. Non-native speakers sometimes feel hard to understand what native speakers talk because of their speaking speed. Even kind native speakers who speak slower in the beginning often get back to their “natural” speed unconsciously after a while. Although non-native speaker...

When a non-native speaker talks with a native speaker, he/she sometimes feels hard to take speaking turns due to language proficiency. The resulting conversation between a non-native speaker and a native speaker is not always productive. In this paper, we propose a conversational agent to support a non-native speaker in his/her second language conv...

In recent years, mental health management of employees in companies has become increasingly important. As the number of psychotherapists is not enough, it is necessary for employees to be able to keep their mental wellness on their own. A self-guided mental healthcare course using VR devices has been developed, and its stress reduction effect has b...

Our goal is to facilitate real-time serial cooperative work. In real-time serial cooperative work, the order of subtasks is important because a failure of the order leads to a failure of the whole task. So, coordinating the order of workers’ subtasks is necessary to smoothly accomplish the tasks. In this paper, we propose a method that uses vibrati...

In theatrical performance practices, actors are stressed once practice stops due to occurring mistakes. Our goal is to reduce the number of mistakes occurring in the theatrical performance practice by cuing the action order. We introduce a cuing system which uses tactile cues through vibrations and notifies actors of the turn of actions. We also re...

Multilingual communication often causes difficulty when speakers have different language proficiency. Real-time keywords potentially demonstrated positive effects when they are provided in cross-cultural communication. Previously it was found that keywords enhanced mutual understanding and knowledge in conversation, and it was beneficial when it wa...

This book constitutes the refereed proceeding of the 23rd International Conference on Collaboration and Technology, CRIWG 2017, held in Saskatoon, Canada, in August 2017. The 14 full papers presented together with 5 work-in-progress papers were carefully reviewed and selected from 33 submissions. The papers focus on collaboration technology design,...

In theatrical performance, actors are required to understand the libretto as they act. However, actors often make mistakes in their actions in early stages of practice when they still do not understand the libretto. This stops the flow of the practice. In order to learn action, it is necessary to coordinate a smooth group practice. We propose a sys...

In orchestra performance, a single conductor directs all the players in the real world. However no restriction is applied when designing a virtual conductor in the virtual world. Thus a virtual conductor system that employed multiple virtual conductors has been proposed. The system assigns each virtual conductor to each musical instrument part, mak...

Crowdsourcing has been gaining attention. Microtasking is a specially featured way of distributing work among crowd workers. With the combination of a number of microtasks which is simple and need short period of time, goal objective is achieved. Because it typically shows advantages in time and money costs, methods to achieve variety of goals by t...

It often causes difficulty to participate in teleconference for foreign language learners due to language and cultural barrier. In this paper we proposed Key-Typing method to investigate its effects on a conversation. This method successfully enhanced mutual understanding in point of presence of Evidence in Grounding, and promoting retention of sha...

This study focuses on supporting theatrical performances. A system that supports actors learning their acting orders has been already proposed. The system detects actors’ speech and cues the next actor to speak. It can however only respond to speech, despite the fact that movement is a very important factor of theatrical performance. Thus this pape...

Conversation between native speakers and non-native speakers is not always easy. Non-native speakers sometimes feel hard to understand what native speakers talked because of their speech speed. Even kind native speakers who speak slower in such a situation in the beginning often get back to their “natural” speed unconsciously after a while. Moreove...

Asynchronous exchange of video messaging is a way to achieve time-shifted communication for the people who have difficulties to enjoy daily family communication in real time, because of time-zone differences or life-rhythm differences. However face-to-face communication and video messaging communication is significantly different. Since mealtime is...

This book constitutes the refereed proceedings of the 8th International Conference on Collaboration Technologies, CollabTech 2016, held in Kanazawa, Japan, in September 2016. The 16 revised full papers presented together with 4 short papers and a keynote were carefully reviewed and selected from 48 submissions. The papers focus on the following to...

In pair-programming, two developers share a computer to work together on developing one piece of code. To test Pair-programming effects on student performance in a Middle Eastern society where some interaction restrictions are found, we devised an experiment that was carried out over an entire academic year consists of two semesters. The experiment...

To the people who are difficult to have a meal together with their families or close partners because of the time-zone difference or the life-rhythm difference, asynchronous video messaging is one way to achieve time-shifted communication. This paper studies the influence of adaptive video speed control in such a video message. We propose synchroni...

Illustrations, which attract readers and improve readability of documents, have high demand partly because not everybody can make them in good quality. Conventionally clients request professional creators to draw illustrations and pay rewards. However, there exists potential huge needs for less quality and less expensive illustrations. In this pape...

This paper presents user's communication behavior in a pseudo same-room videoconferencing named “Being Here System,” in comparison with a conventional videoconferencing. The system extracts the remote person's figure and superimposes it on the local site's front view in a large display in real-time. This method makes the local person feel as if the...

Having a meal with conversation is regarded to have good effects. However, all the existing research assumed that all the participants have meals, whereas this assumption is not always true in reality. Conversation often takes place where a part of the participants have meals. To better understand co-dining conversation, we should also pay attentio...

When we generate new ideas or think over existing ideas, talking to another person is often helpful. This is not really has to be a discussion. Rather, the person needs someone to talk to for reflecting himself/herself with the ideas. The other person is not necessarily be talkative, and may desirable to be attentive. In interpersonal communication...

It is known that conversation over a meal is better than the one without it. We often have a banquet when we socialize. We have two styles for such co-dining social activity; standing and seated. However we do not know if these styles matter for conversation. Therefore we have conducted an experimental study to investigate their differences. Findin...

A conversation over a meal and its support as a research topic has been gaining attention. Although all the researches so far assumed all participants have a meal, this paper points out the uneven meal distribution setting as an additional case to analyze. After conducting a face-to-face dyadic conversation experiment, analyses show that uneven mea...

This paper presents the design, implementation, and evaluation of a sports tactics analysis supporting system. In the field of sports, tactics analysis is conducted using data from multiplayer games. In so doing, it is important to recognize the actual play in a sports game. This research focuses on reproducing player action in sports games. Unlike...

A system "KIZUNA" was recently proposed enabling time-shifted people to enjoy a meal together in a virtual environment involving the transmission of recorded video messages. The system achieves synchrony through adapting the displayed video's playback speed to the difference in the dining progress between local and remote person. A subjective syste...

This book constitutes the refereed proceedings of the 7th International Conference on Collaboration Technologies, CollabTech 2014, held in Santiago, Chile, in September 2014. The 10 revised full papers presented together with 4 short papers and a keynote were carefully reviewed and selected from 34 submissions. The papers are organized in topical s...

地理的に離れていたり生活リズムが違ったりして食事を一緒にとることが難しい相手と疑似的に共 食を実現するために，ビデオメッセージを利用することが考えられる．しかし，単にビデオを流しても一緒に食べ ているようには感じられない．このようにビデオメッセージを通じて非同期に疑似的な共食をする際に、ビデオ内 の食事の進捗がユーザの食事の進捗に合うようにビデオの再生速度を動的に調整することで、疑似的共食が改善さ れ，コミュニケーションに変化が見られた． One way to have conversation with those who are not present is to use asynchronous communication tools. Exchanging video messag...

This paper presents user's communication behavior in the pseudo same-room videoconferencing named “Being Here System,” in comparison with a conventional videoconferencing. The system extracts the remote person's figure and superimposes it on the local site's front view in a large display. In this way, the local person may feel as if the remote pers...

This paper presents the design, implementation, and evaluation of an interactive tabletop and vertical touch screen system that supports recognition of virtual soccer field. Arrangement player positions, imagine the sense of distance between players, such task is difficult for inexperienced people, because they need to imagine real field space in d...

A high-presence videoconferencing system called "Being Here System (BHS)" has been proposed and implemented. The system superimposes the remote person's extracted figure on the local site front view in the display. Though a user study by questionnaire was conducted, the user's actual behavior was left out. Thus in this paper, the influence on user'...

Dining with a remote person requires that both participants are available at the same time to eat together. Because of time-zone differences and other such contingent factors, this condition can often be hard to fulfill. One solution may lie in time-shifted communication. A person can enjoy a meal while watching an earlier recorded video of a remot...

A tabletop dish recommendation system for multiple users dining together, called Group FDT (Future Dining Table), is presented. The system continually assesses the dining status of users, and recommends dishes in a timely manner. The recommendation timing and displayed position of recommended dishes are based on research on real dining, extant lite...

Pair programming, a programming technique conducted by two programmers working together at one work station, has been adopted for learning programming. Although it is known to be effective in various aspects, micro observation of the learning activity and collaboration has yet to be conducted in relation to the outcome. In this study, behavior in p...

During a mealtimes, we usually enjoy not only eating itself but also having a conversation with other people together. Having a meal with our family or close friends is so enjoyable and an easy task because we already know each other. However we also have a chance to eat with acquaintances or totally new persons. In these cases, it is thought that...

Videoconferencing continues to emerge as a popular means of connecting remote participants. One of its goals is to establish a sense of presence through video imagery. One way to achieve a highly realistic presence is to generate a life-sized image of a remote person on a large display. However, in this case, the display conceals a large region of...

Videoconferencing environment is one of the most popular ways of connecting remote people. To achieve conveyance of realistic sensation through its video image is one of the major goals. One way to implement highly realistic image is to use life-size scale image of a remote person which is presented by a large display. However at the same time, the...

Theater is a collaborative art form that involves production team members with different specialties. Because theater involves various technical elements, such as stage design and lighting, the production team must work in cooperation among various departments to design a theatrical production. When planning a theatrical production, it is difficult...

Watching a real teacher in a real environment from a good distance and with a clear viewing angle has a significant effect on learning physical tasks. This applies to physical-task learning in a mixed-reality environment as well. Observing and imitating body motion is important for learning some physical tasks, including spatial collaborative work....

Dining is an essential activity in our lives. During the mealtimes, family members get a chance to talk and share experiences. However, sometimes not everyone can join the meal either because they are busy or maybe because they lives apart. In recent years, the wide variety of videoconferencing technologies has broadened the ways people communicate...

In this paper we propose a time-shifted co-dining system “KIZUNA”. This system enables family members or close friends to enjoy a meal together even when they are apart and in a different time zone each other. The system records remote person’s dining sessions and displays these sessions later on the local person when he/she starts eating and vice...

This paper presents a video communication system “Being Here System (BHS)” that provides a feeling of being in the same room with a remote user when conversing. Different from a conventional videoconferencing system that displays the raw image from the remote camera, BHS displays the image that is processed in realtime to match with the local site....

The tabletop dish recommendation system that recognizes the user's dining activity in real time has been developed. The system displays recommendations over the table to the existing dishes. This paper presents the investigation of the display positions of the recommended dish. Three display positions to the existing dishes were investigated. The p...

It is known that a virtual teacher-model's position and orientation influence (a) the number of errors, and (b) the accomplishment time, in physical-task learning using mixed- reality environments. This paper proposes an automatic adjustment method of the virtual teacher's rotation angle so that the learner can observe the important body motion eas...

It is known that a virtual teacher-model's position and orientation influence (a) the number of errors, and (b) the accomplishment time, in physical-task learning using mixed reality (MR) environments. This paper proposes an automatic method to adjust the virtual teacher's orientation according to a given task motion. Through always showing the phy...

Most of the existing physical tasks learning support systems do not show the task's physical motion in the real world. Because of this, a physical task learning support system showing a 3D virtual teacher model in the real world using mixed reality was developed. Our primary contribution is proving that the virtual teacher model's position and orie...

Enhancement of dining environment by information technology is explored in this paper. A table system to recommend additional dishes according to the dining status is introduced. By modeling dining behavior as the sequence of eating, dining status is estimated from the history of bites. The system recognizes the user's dining activity in real time,...

Dining table is one of the environments that remain to be explored by information technology and that could be important for happy and healthy life of everybody. We have been studying the Future Dining Table system, dining environment of the future. The system features the real time recognition of dining activity, which is represented by the histor...

This paper presents a study of the learning process in a distance collaborative learning environment with a chat system and a Wiki, and development of a new chat system based on the study. Collaborative learning as the combination of conversation and collaborative work was investigated, which revealed 1) There is a time lag between conversation and...

1

Many support systems for learner-centered question-posing learning have been developed. Some effectiveness in using such systems have been reported. However, most researches have indicated a single factor or combined two factors as the effectiveness of question-posing learning. In this paper, association rule mining was used for analyzing the effec...

This paper describes a system called DiamondTheater that supports creative activities in theater using a tabletop tangible interface. This system is used to aid in the planning of certain aspects of theater production, such as actor positioning, and sound and lighting cues. Without having some considerable experience in production, it is difficult...

In this paper, we propose a tangible tabletop interface that can identify individual users using digital and physical objects. In environments in which multiple users are participating, the system can provide user-adaptive information regarding both digital and physical objects, and can record and utilize the operation history for individual users....

We have developed a content construction system for collaborative learning based on a Wiki, a Web- based collaborative document authoring system. Requirements for such a tool are explained in three aspects (usability, content construction, easy and secure operation) and implemented accordingly. Experiment on usability of the system interface sugges...

We focused on face-to-face collaborative learning in a classroom using spatio-temporal contents, which is typically conducted after outdoor class in an elementary school. We have developed a tangible collaborative learning support system that uses physical objects and associating spatio-temporal contents. We have implemented a few methods to handle...

This paper describes a technique for mapping objects such as insects and plants that exist in the field on a blank map in mobile learning. We propose to use man’s geographic recognition in addition to a GPS for mapping objects. With the help of man’s ability to recognize placement of objects and geographical relations between objects, objective geo...

This paper focuses on face-to-face collaborative learning in a classroom using spatio-temporal contents, which is typically conducted after outdoor class in an elementary school. A tangible collaborative learning support system that uses spatio-temporal contents has been proposed and implemented. Temporal data sequence that shows growth of a plant...

This paper describes a technique for mapping objects such as insects and plants in the field on a blank map in mobile learning. We propose map creating system that utilizes man's subjective geographic recognition in addition to a GPS. With the help of man's ability of recognizing placement of objects and geographical relations between objects, obje...

The design and evaluation of HERMES, the videoconferencing system that integmtes face-to-face and video-mediated meetings, are presented. Spatial design of the meeting space with an automatic video control mechanism was employed to support both local and remote communication. The evaluation of the system revealed that the design was effective in so...

This paper describes an evaluation of a videoconferencing system that is based on the presentation of TV programs. To improve video in current videoconferencing systems, the presentation of pictures on TV programs was studied and a multiparty videoconferencing system that utilizes the result of the analysis was made. The system includes automated c...

This chapter examines the possibility of making use of gestural animations to convey feelings in asynchronous network communication. The chapter focuses on the expression of feelings through gestures for exchanging various types of nonverbal information, which constitutes a large part of human communication, and proposes to use it in network commun...

The paper deals with nonverbal communication in asynchronous networks. It is well known that nonverbal communication plays an important role in interpersonal communication. However, nonverbal communication has not been used in traditional character based network communication until now, yet the need for conveying feelings has increased. Due to the...

Mixed reality has been used as a way to add virtual ob-jects over the physical world. One of the way to realize a distributed meeting with high realistic sensation could be the use of mixed reality. Avatars of distant partic-ipants are superimposed over the sight of a local par-ticipant. However, it is not very clear about the design of conference...