Publications (4)0 Total impact
- Journal of Japan Society for Fuzzy Theory and Intelligent Informatics 01/2008; 20(4):540-556.
- Journal of Japan Society for Fuzzy Theory and Intelligent Informatics 01/2008; 20(4):526-539.
Conference Proceeding: Modeling Human-Agent Interaction Using Bayesian Network Technique.[show abstract] [hide abstract]
ABSTRACT: Task manipulation is direct evidence of understanding, and speakers adjust their utterances that are in progress by monitoring listener’s task manipulation. Aiming at developing animated agents that control multimodal instruction dialogues by monitoring users’ task manipulation, this paper presents a probabilistic model of fine-grained timing dependencies among multimodal communication behaviors. Our preliminary evaluation demonstrated that our model quite accurately judges whether the user understand the agent’s utterances and predicts user’s successful mouse manipulation, suggesting that the model is useful in estimating user’s understanding and can be applied to determining the next action of an agent.New Frontiers in Artificial Intelligence, JSAI 2007 Conference and Workshops, Miyazaki, Japan, June 18-22, 2007, Revised Selected Papers; 01/2007
- [show abstract] [hide abstract]
ABSTRACT: The aim of this paper is to develop ani- mated agents that can control multimodal instruction dialogues by monitoring user's behaviors. First, this paper reports on our Wizard-of-Oz experiments, and then, using the collected corpus, proposes a probabilis- tic model of fine-grained timing dependen- cies among multimodal communication behaviors: speech, gestures, and mouse manipulations. A preliminary evaluation revealed that our model can predict a in- structor's grounding judgment and a lis- tener's successful mouse manipulation quite accurately, suggesting that the model is useful in estimating the user's under- standing, and can be applied to determining the agent's next action.ACL 2007, Proceedings of the 45th Annual Meeting of the Association for Computational Linguistics, June 23-30, 2007, Prague, Czech Republic; 01/2007