Conference Paper

Extrinsic Summarization Evaluation: A Decision Audit Task.

DOI: 10.1007/978-3-540-85853-9_32 Conference: Machine Learning for Multimodal Interaction, 5th International Workshop, MLMI 2008, Utrecht, The Netherlands, September 8-10, 2008. Proceedings
Source: DBLP

ABSTRACT In this work we describe a large-scale extrinsic evaluation of automatic speech summarization technologies for meeting speech.
The particular task is a decision audit, wherein a user must satisfy a complex information need, navigating several meetings
in order to gain an understanding of how and why a given decision was made. We compare the usefulness of extractive and abstractive
technologies in satisfying this information need, and assess the impact of automatic speech recognition (ASR) errors on user
performance. We employ several evaluation methods for participant performance, including post-questionnaire data, human subjective
and objective judgments, and an analysis of participant browsing behaviour.


Preview (2 Sources)

Available from