An Architecture For Multi-Modal Natural Dialogue Systems

Abstract

In this paper we present an architecture for multi-modal dialogue systems. It is illustrated from our development of a multi-modal information system for local bus timetable information. The system is based on a natural language interface for typed interaction that is enhanced to handle also multi-modal interaction. The multi-modal user interface was designed based on empirical investigations and some results from these investigations are presented. We also show how information specification forms can be utilised to handle requests typical for timetable information systems and how spatial and temporal information is integrated and used in the system. 1. INTRODUCTION Today's computer and communication technology creates the opportunity for easy access to many information sources, and the opportunity to support complex information retrieval tasks. For the emerging technology to fulfil its promises it is not enough for the information to be available, it also needs to be easy accessible...