Roberta Catizone's research while affiliated with Florida Institute for Human and Machine Cognition and other places

Publications (40)

Conference Paper
The paper describes a prototype Embodied Conversational Agent or Companion, called CALONIS, for a brain-injured Veteran with severe cognitive impairment. The CALONIS project is a sub-project of the larger Tampa VA SmartHome implementation initiative. CALONIS is intended to provide increased engagement, diversion and assistance beyond the usual mech...
Article
This paper describes an initial prototype of the Companions project (www.companions-project.org): the Senior Companion (SC), designed to be a platform to display novel approaches to:(1)The use of Information Extraction (IE) techniques to extract the content of incoming dialogue utterances after an ASR phase.(2)The conversion of the input to RDF for...
Article
Several dialogue management (DM) architectures and conversational speech for dialogue systems are presented. Basic types of DM systems include dialogue grammars and frames, plan-based and collaborative systems, and conversational games theory. DM architectures include SmartKom, Trindi, WITAS, CONVERSE, COMIC, agent-based dialogue management, and DM...
Article
COMPANIONS is a concept that aims to change the way we think about the relationships of people to computers and the Internet by developing a virtual 'Companion' to stand between individuals and the torrent of data on the Internet, including their own life information, which will soon be too large for people to handle easily without some new form of...
Chapter
Companions are agents devised to accompany users day by day building long-term relationships with them. They do not only assist users for particular tasks in sporadic times, but they provide more support and have more information to adapt themselves to each users' needs. Currently, these agents and their possibilities are being researched as a part...
Article
Full-text available
This paper presents an overview of a cognitive architecture, OntoAgent, that supports the creation and deployment of intelligent agents capable of simulating human-like abilities. The agents, which have a simulated mind and, if applicable, a simulated body, are intended to operate as members of multi-agent teams featuring both artificial and human...
Conference Paper
Full-text available
This paper presents a case study showing how hybrid methods of knowledge elicitation can be used to build models in support of the functioning of intelligent agents. What facilitates both the elicitation of knowledge and its conversion into actionable models is the use of a unified representational knowledge scheme - specifically, an unambiguous, o...
Conference Paper
Full-text available
This paper briefly describes four kinds of learning carried out by intelligent agents in a computational environment facilitating joint activities of people and software agents. The types of learning and the applications we draw examples from are: learning by being told and learning by experience, as illustrated through a virtual patient applicatio...
Conference Paper
Full-text available
This paper describes an initial prototype demonstrator of a Companion, designed as a platform for novel approaches to the following: 1) The use of Information Extraction (IE) techniques to extract the content of incoming dialogue utterances after an Automatic Speech Recognition (ASR) phase, 2) The conversion of the input to Resource Descriptor Form...
Conference Paper
Full-text available
The Senior Companion (SC) is a fully implemented Windows application intended for intermittent use by one user only (a senior citizen) over potentially many years. The thinking behind the SC is to make a device that will give its owner comfort, company, entertainment, and some practical functions. The SC will typically be installed at home, either...
Conference Paper
Full-text available
This paper discusses how Information Extraction is used to understand and manage Dialogue in the EU-funded Companions project. This will be discussed with respect to the Senior Companion, one of two applications under development in the EU-funded Companions project. Over the last few years, research in human-computer dialogue systems has increased...
Conference Paper
Full-text available
This article presents a multi-agent dialogue system. We show how a collection of relatively simple agents is able to treat complex dialogue phenomena and deal successfully with different deployment configurations. We analyze our system regarding robustness and scalability. We show that it degrades gracefully under different failures and that the ar...
Article
Full-text available
COMPANIONS is a major EU project that aims to change the way we think about the relationships of people to computers and the Internet by developing virtual conversational 'Companions', agents or 'presences' that stay with the user for long periods of time, developing a relationship and 'knowing' their owner's preferences and wishes. They will commu...
Article
Full-text available
As web searches increase, there is a need to represent the search results in the most comprehensible way possible. In particular, we focus on search results from queries about people and places. The standard method for presentation of search results is an ordered list determined by the Web search engine. Although this is satisfactory in some cases,...
Article
Full-text available
We describe our participation in the Mul-tilingual Summarization Evaluation MSE 2006 where multiple documents in Eng-lish, Arabic and Arabic-English machine translations are used to create a brief 100 word summary in English. Our system output was evaluated using the automated ROUGE evaluation system. The greedy optimization technique used to ensur...
Conference Paper
Full-text available
We describe how context-sensitive, usertailored output is specified and produced in the COMIC multimodal dialogue system. At the conference, we will demonstrate the user-adapted features of the dialogue manager and text planner. 1
Chapter
We describe two major dialogue system segments: the first is an analysis module that learns to assign dialogue acts from corpora, but on the basis of limited quantities of data, and up to what seems to be some kind of limit on this task, a fact we also discuss. Secondly, we describe a Dialogue Manager which uses a representation of stereotypical di...
Article
Full-text available
With increasing amounts of electronic information available, and the increase in the variety of languages used to produce documents of the same type, the problem of how to manage similar documents in different languages arises. This paper proposes an approach to processing /structuring text so that Multilingual Authoring (creating hypertext links)...
Article
This paper describes some aspects of the construction of the glish language dictionary, in l:,articular a project to verify and enh,-mce information on noun phrases in the English Word Dictionary undertaken by the Computing Research Laboratory at New Mexico State University aud the University of Sheffield. We believe the work so hr raises issues of...
Article
Full-text available
The next generation internet applica- tions will feature not only the ability to understand spoken and written nat- ural language text, (pen) gestures and body postures, they will also and im- portantly be able to engage with the user in a natural dialogue about the ap- plication. In this paper we will de- scribe the design of a multimodal dia- log...
Article
Full-text available
The growing availability of multilingual resources, like EuroWordnet, has recently inspired the development of large scale linguistic technologies, e.g. multilingual IE and Q&A, that were considered infeasible until a few years ago. In this paper a system for categorisation and automatic authoring of news streams in different languages is presented...
Conference Paper
Full-text available
The paper contrasts three approaches to the extension of lexical sense: what we shall call, respectively, lexical tuning; another based on lexical closeness and relaxation; and a third known as underspecification, or the use of lexical rules. These approaches have quite different origins in artificial intelligence(AI) and linguistics, and involve c...
Conference Paper
Full-text available
With increasing amounts of electronic information available, and the increase in the variety of languages used to produce documents of the same type, the problem of how to manage similar documents in different languages arises. This paper proposes an approach to processing/structuring text so that Multilingual Authoring (creating hypertext links) c...
Article
Full-text available
GATE, a General Architecture for Text Engineering, aims to provide a software infrastructure for researchers and developers working in NLP. GATE has now been widely available for four years. In this paper, we review the objectives which motivated the creation of GATE and the functionality and design of the current system. We describe some of the wa...
Article
Full-text available
. NLP systems crucially depend on the knowledge structures devoted to describing and representing word senses. Although automatic Word Sense Disambiguation (WSD) is now an established task within empirically-based computational approaches to NLP, the suitability of the available set (and granularity) of senses is still a problem. Application domain...
Conference Paper
It seems widely agreed that IE (Information Extraction) is now a tested language technology that has reached precision+recall values that put it in about the same position as Information Retrieval and Machine Translation, both of which are widely used commercially. There is also a clear range of practical applications that would be eased by the sor...
Article
Full-text available
The article surveys a little of the history of the technology, sets out the main current theoretical approaches in brief, and discusses the on-going opposition between theoretical and empirical approaches. It illustrates the situation with some discussion of CONVERSE, a system that won the Loebner prize in 1997 and which displays features of both a...
Article
Full-text available
Empirical and theoretical investigations of the nature and structure of human dialogue have been a topic of research in artificial intelligence and the more human areas of linguistics for decades: there has been much interesting work but no definitive or uncontroversial findings. the best performance overall has probably been Colby’s PARRY (Colby,1...
Conference Paper
Full-text available
Thispaper describes some aspects of the construction of theglish language dictionary, in l:,articular a project to verifyand enh,-mce information on noun phrases in the EnglishWord Dictionary undertaken by the Computing ResearchLaboratory at New Mexico State University aud the Universityof Sheffield. We believe the work so hr raises issues ofwider...
Article
Full-text available
We describe two major dialogue system segments: first we describe a Dialogue Manager which uses a representation of stereotypical dialogue patterns that we call Dialogue Action Frames and which, we believe, generate strong and novel constraints on later access to incomplete dialogue topics. Secondly, an analysis module that learns to assign dialogu...

Citations

... This data suggested that that people with moderate dementia can be engaged in interactions with a PVA. This results confirm the state of the art in the field [9,10,11,12,13]. ...
... Concept hierarchies are very expensive resources. Lexical databases such as WordNet [6] or Euro-WordNet [9] are currently widely used in NLP applications (e.g. in Question Answering [4] or in automatic hyperlinking [2]). However, they required huge efforts and large investments. ...
... Examples include the morphological decomposition described by Miller and Chapman (1983) and Cappelli, Maccari, and Pfanner ( 1991) in order to compute the mean length ofutterance. Other kinds of statistical automatic assessment of corpora of impaired speech have been carried out by Perkins (I 994) and Perkins, Catizone, Peers, and Wilks (1997). More complex linguistic evaluations, such as the language assessment, remediation, and screening procedure (LARSP) created by Crystal, Fletcher, and Garman (1976), must be performed by hand. ...
... The Senior Companion (SC) prototype (Wilks, 2007(Wilks, , 2008Wilks et al., 2008) was designed to make a rapid advance in the first two years of a project so as to be the basis for a second round of prototypes embodying more advanced ML. This strategy was deliberately chosen to avoid a well-known problem with experimental AI systems: that a whole project is spent in design so that a prototype never emerges until the very end, which is then never fully evaluated and, most importantly, nothing is ever built upon the experience obtained in its construction. ...
... Previous work has highlighted an overall classification for Dialog Management (DM) paradigms [9]. According to this classification a DM is based on either stochastic processes i.e. ...
... The interference between automotive radars, densely deployed on the road, may significantly reduce the radar performance. The MOSARIM project, funded by EU [1], aimed to identify the main consequences caused by mutual interference (MI) on the range-Doppler map (RDM) generated at the output of the radar processing. The final deliverable of this project showed that MI plays an important role in radars for ADAS applications. ...
... Many of the developments since then have been a series of extensions to the work of Lehnert and Riloff on Autoslog (Riloff and Lehnert, 1993), the automatic induction of a lexicon for IE. This tradition of work goes back to an AI notion that might be described as lexical tuning, that of adapting a lexicon automatically to new senses in texts, a notion discussed in (Wilks and Catizone, 1999) and going back to work like Wilks (1979) and Granger (1977) on detecting new preferences of words in texts and interpreting novel lexical items from context and stored knowledge. These notions are important, not only for IE in general but, in particular, as it adapts to traditional AI tasks like QA. ...
... One of the first established chatbots was programmed in the 1960s, called ELIZA, which was used for text-based psychiatric interviews [11]. This sparked the development of several early chatbots, such as GURU [12], CONVERSE [13], ALICE, and Elizabeth [14]. The renewed interest in chatbots in recent years is largely because of the advancements in deep learning technology [15], which enables agent-based chatbots, and the advancements in voice recognition technology, which have facilitated voice assistants such as Apple's Siri, Microsoft's Cortana, Amazon's Alexa, and Google's new Assistant [16]. ...
... Multi-modality has been explored in a very limited way to date for curating VAs in different domains and tasks. In [10], the authors designed a multi-modal DM module, which was part of the COMIC demonstrator for a bathroom design application. The multi-modal features used by these modules were speech and gesture of the user interacting with the system. ...
... Ontologies often focus on noun hierarchies and overlook hierarchies based on verbs, event structures or argument structures. A promising exception is Basili et al.'s (2002) paper which develops event hierarchies for information extraction and multilingual document analysis. Another approach is presented by Petersen (2001). ...