Claire Bonial

Claire Bonial
Army Research Laboratory | ALC · Adelphi Laboratory Center (ALC)

Doctor of Philosophy

About

49
Publications
5,789
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
1,462
Citations
Citations since 2017
26 Research Items
1179 Citations
2017201820192020202120222023050100150200
2017201820192020202120222023050100150200
2017201820192020202120222023050100150200
2017201820192020202120222023050100150200
Additional affiliations
August 2009 - May 2015
University of Colorado Boulder
Position
  • Research Associate

Publications

Publications (49)
Article
Full-text available
How do we gauge understanding? Tests of understanding, such as Turing's imitation game, are numerous; yet, attempts to achieve a state of understanding are not satisfactory assessments. Intelligent agents designed to pass one test of understanding often fall short of others. Rather than approaching understanding as a system state, in this paper, we...
Chapter
We present a dialogue system based on statistical classification which was used to automate human-robot dialogue in a collaborative navigation domain. The classifier was trained on a small corpus of multi-floor Wizard-of-Oz dialogue including two wizards: one standing in for dialogue capabilities and another for navigation. Below, we describe the i...
Article
Light verb constructions (LVCs) in English and Romance languages are somewhat unique crosslinguistically because LVCs in these languages tend to have semantically similar synthetic verb counterparts (Zarco 1999): e.g. make an appearance and appear . This runs contrary to assumptions in linguistic theories that two competing forms are rarely maintai...
Technical Report
Here we provide detailed guidelines on how to annotate a multifloor human‒robot dialogue for structure elements relevant to informing dialogue management in robotic systems. We start with transcribed and time-aligned dialogue data collected from participants and Wizards of Oz across multiple years of an Army Research Laboratory human‒robot interact...
Preprint
We describe the task of Visual Understanding and Narration, in which a robot (or agent) generates text for the images that it collects when navigating its environment, by answering open-ended questions, such as 'what happens, or might have happened, here?'
Article
Full-text available
In this research, we begin to tackle the challenge of natural language understanding (NLU) in the context of the development of a robot dialogue system. We explore the adequacy of Abstract Meaning Representation (AMR) as a conduit for NLU. First, we consider the feasibility of using existing AMR parsers for automatically creating meaning representa...
Conference Paper
Full-text available
This paper describes the construction and annotation of a corpus of verbal MWEs for English as part of the PARSEME Shared Task 1.1 on automatic identification of verbal MWEs. The criteria for corpus selection, the categories of MWEs used, and the training process are discussed, along with the particular issues that led to revisions in edition 1.1 o...
Conference Paper
Full-text available
We describe a multi-phased Wizard-of-Oz approach to collecting human-robot dialogue in a collaborative search and navigation task. The data is being used to train an initial automated robot dialogue system to support collaborative exploration tasks. In the first phase, a wizard freely typed robot utterances to human participants. For the second pha...
Preprint
We describe a multi-phased Wizard-of-Oz approach to collecting human-robot dialogue in a collaborative search and navigation task. The data is being used to train an initial automated robot dialogue system to support collaborative exploration tasks. In the first phase, a wizard freely typed robot utterances to human participants. For the second pha...
Preprint
This paper identifies stylistic differences in instruction-giving observed in a corpus of human-robot dialogue. Differences in verbosity and structure (i.e., single-intent vs. multi-intent instructions) arose naturally without restrictions or prior guidance on how users should speak with the robot. Different styles were found to produce different r...
Conference Paper
Full-text available
Commonsense, real-world knowledge about the events that entities or "things in the world" are typically involved in, as well as part-whole relationships, is valuable for allowing computational systems to draw everyday inferences about the world. Here, we focus on automatically extracting information about (1) the events that typically bring about c...
Conference Paper
In this paper, dialogue overlap at the transaction unit structure level is examined. In particular we investigate a corpus of multi-floor dialogue in a human-robot navigation domain.Two conditions are contrasted: a human wizard typing with a keyboard vs using a constricted GUI. The GUI condition leads to more utterances and transaction units, but l...
Preprint
Many previous methods have demonstrated the importance of considering semantically relevant objects for carrying out video-based human activity recognition, yet none of the methods have harvested the power of large text corpora to relate the objects and the activities to be transferred into learning a unified deep convolutional neural network. We p...
Conference Paper
We present an annotation scheme for meso-level dialogue structure, specifically designed for multi-floor dialogue. The scheme includes a transaction unit that clusters utterances from multiple participants and floors into units according to realization of an initiator’s intent, and relations between individual utterances within the unit. We apply t...
Conference Paper
Collaboration with a remotely located robot in tasks such as disaster relief and search and rescue can be facilitated by grounding natural language task instructions into actions executable by the robot in its current physical context. The corpus we describe here provides insight into the translation and interpretation a natural language instructio...
Article
Full-text available
We describe the adaptation and refinement of a graphical user interface designed to facilitate a Wizard-of-Oz (WoZ) approach to collecting human-robot dialogue data. The data collected will be used to develop a dialogue system for robot navigation. Building on an interface previously used in the development of dialogue systems for virtual agents an...
Chapter
In this chapter, we present our challenges and successes in producing the OntoNotes word sense groupings [41], which represent a slightly more coarse-grained set of English verb senses drawn from WordNet [13], and which have provided the foundation for our VerbNet sense annotation. These sense groupings were based on the successive merging of WordN...
Chapter
This chapter gives an overview of the infrastructure, annotation practices, and current challenges of both the English and Arabic PropBank corpora. More details about the Hindi and Urdu PropBanks can be found in chapter “The Hindi/ Urdu Treebank Project” (this volume). The focus of current efforts is on expanding the types of relations covered by P...
Conference Paper
Full-text available
Our research aims to develop a natural dialogue interface between robots and humans. We describe two focused efforts to increase data collection efficiency towards this end: creation of an annotated corpus of interaction data, and a robot simulation, allowing greater flexibility in when and where we can run experiments.
Article
Our overall program objective is to provide more natural ways for soldiers to interact and communicate with robots, much like how soldiers communicate with other soldiers today. We describe how the Wizard-of-Oz (WOz) method can be applied to multimodal human-robot dialogue in a collaborative exploration task. While the WOz method can help design ro...
Conference Paper
The Wizard-of-Oz (WOz) method is a common experimental technique in virtual agent and human-robot dialogue research for eliciting natural communicative behavior from human partners when full autonomy is not yet possible. For the first phase of our research reported here, wizards play the role of dialogue manager, acting as a robot’s dialogue proces...
Conference Paper
Human activity recognition has often prioritized low-level features extracted from imagery or video over higher-level class attributes and ontologies because they have traditionally been more effective on small datasets. However, by including knowledge-driven associations between actions and attributes while recognizing the lower-level attributes w...
Conference Paper
Full-text available
We describe the ongoing development of a lexically-informed, upper-level event ontology and explore use cases of the ontology. This ontology draws its lexical sense distinctions from VerbNet, FrameNet and the Rich Entities, Relations and Events Project. As a result, the ontology facilitates interoperability and the combination of annotations done f...
Conference Paper
Activity and event recognition from video has utilized low-level features over higher-level text-based class attributes and ontologies because they traditionally have been more effective on small datasets. However, by including human knowledge-driven associations between actions and attributes while recognizing the lower-level attributes with their...
Article
This research describes the development of a supervised classifier of English light verb constructions, for example, "take a walk" and "make a speech." This classifier relies on features from dependency parses, OntoNotes sense tags, WordNet hypernyms and WordNet lexical file information. Evaluation shows that this system achieves an 89% F1 score (f...
Conference Paper
Full-text available
Any given verb can appear in some syntactic frames (Sally broke the vase, The vase broke) but not others (*Sally broke at the vase, *Sally broke the vase to John). There is now considerable evidence that the syntactic behaviors of some verbs can be predicted by their meanings, and many current theories posit that this is true for most if not all ve...
Conference Paper
Full-text available
This research discusses preliminary efforts to expand the coverage of the PropBank lexicon to multi-word and idiomatic expressions, such as take one for the team. Given overwhelming numbers of such expressions, an efficient way for increasing coverage is needed. This research discusses an approach to adding multiword expressions to the PropBank lex...
Article
This research describes efforts to use crowdsourcing to improve the validity of the semantic predicates in VerbNet, a lexicon of about 6300 English verbs. The current semantic predicates can be thought of semantic primitives, into which the concepts denoted by a verb can be decomposed. For example, the verb spray (of the Spray class), involves the...
Conference Paper
Full-text available
This research compares several of the thematic roles of Verb Net (VN) to those of the Linguistic Infrastructure for Interoperable Resources and Systems (LIRICS). The purpose of this comparison is to develop a standard set of thematic roles that would be suited to a variety of natural language processing (NLP) applications. We draw from both resourc...
Article
Full-text available
In this paper, we have addressed the task of PropBank annotation of light verb constructions, which like multi-word expressions pose special problems. To arrive at a solution, we have evaluated 3 different possible methods of annotation. The final method involves three passes: (1) manual identification of a light verb construction, (2) annotation b...
Conference Paper
Full-text available
This paper demonstrates two annotation tools related to Propbank: Cornerstone and Jubilee. Propbank is a corpus in which the arguments of each verb predicate are annotated with their semantic roles. Propbank annotation also requires the choice of a sense ID for each predicate, defined in the corresponding frameset file. Jubilee expedites the annota...
Conference Paper
Full-text available
This paper gives guidelines of how to annotate Propbank instances using a dedicated editor, Jubilee. Propbank is a corpus in which the arguments of each verb predicate are annotated with their semantic roles in relation to the predicate. Propbank annotation also requires the choice of a sense ID for each predicate. Jubilee facilitates this annotati...
Conference Paper
Full-text available
This paper gives guidelines of how to create and update Propbank frameset files using a dedicated editor, Cornerstone. Propbank is a corpus in which the arguments of each verb predicate are annotated with their semantic roles in relation to the predicate. Propbank annotation also requires the choice of a sense ID for each predicate. Thus, for each...
Technical Report
Full-text available
This report gives a guideline of how to use a Propbank frameset editor, Cornerstone. Propbank is a corpus where the arguments of each verb predicate are annotated with their semantic roles in relation to the predicate. Propbank annotation also requires the choice of a sense id (also known as a frameset or roleset id) for each predicate. Therefore,...
Technical Report
Full-text available
This report gives a guideline of how to use a Propbank instance editor, Jubilee. Propbank is a corpus in which the arguments of each predicate are annotated with their semantic roles in relation to the predicate. In addition to semantic role annotation, Propbank annotation requires the choice of a sense id (also known as a roleset or frameset id) f...

Network

Cited By