Stefan Hillmann

Stefan Hillmann
Technische Universität Berlin | TUB · Quality and Usability Lab, Telekom Innovation Laboratories

Dr.-Ing.

About

33
Publications
2,803
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
55
Citations
Additional affiliations
January 2010 - present
Technische Universität Berlin
Position
  • Research Assistant
July 2007 - December 2009
Novedia AG
Position
  • Software Developer
June 2006 - June 2007
Freie Universität Berlin
Position
  • Research Assistant
Description
  • EXIST-Seed funded spin-off project
Education
October 2000 - April 2006
Technische Universität Berlin
Field of study
  • Computer Science

Publications

Publications (33)
Chapter
A common way of interacting with conversational agents is through voice commands. Finding appropriate voice commands can be a challenge for developers and often require empirical methods where participants come up with voice commands for specific tasks. Textual and visual task representations were compared in an online study to assess the influence...
Chapter
The main task of this chapter is the presentation of the state-of-the-art for the research which will be presented in the Chaps. 4, 5, and 6. First, the term usability will be defined at the beginning of Sect. 2.1. Then, the same section presents the fundamentals of traditional usability evaluation methods and of methods for automatic usability eva...
Chapter
Several approaches are known aiming at the evaluation of the performance of user behaviour models and related simulation approaches. This chapter describes and evaluates a new approach for the evaluation of the performance of user behaviour simulations on the basis of generated dialogues. Here, performance means the ability of a user behaviour simu...
Chapter
In Sect. 2.6 research question \(Q_1\) has asked how interactivity patterns can be used in an automatic usability evaluation process. The current chapter addresses that question by three steps. First, Sect. 5.1 of this chapter describes a study in which technical-sociological methods have been used to reconstruct interactivity patterns from observe...
Chapter
Today’s applications are getting more and more sophisticated, demanding richer and more advanced interaction between users and systems. In this context, multimodal approaches try to combine several types of sensory modalities to augment input and output capabilities of current systems (e.g. smart homes, in-vehicle infotainment, or smartphones). Mul...
Chapter
The MeMo Workbench is a tool for the automatic usability evaluation of interactive dialogue systems, such as spoken dialogue systems and GUI-based systems (with mouse and keyboard, or touch based input). The introduction of five automatic usability evaluation tools in Sect. 2.2.5 had already sketched the main principles of the MeMo Workbench. This...
Book
This book describes an extension of the user behaviour simulation (UBS) of an existing tool for automatic usability evaluation (AUE). This extension is based upon a user study with a smart home system. It uses technical-sociological methods for the execution of the study and the analysis of the collected data. A comparison of the resulting UBS with...
Poster
Full-text available
Textual and visual task representations were compared in an online study to assess the influence of semantic priming on spontaneous, user generated voice commands. Our results indicate that visual representations of tasks lead to a different distribution of used phrases, compared to the textual representation, within the target population. Furtherm...
Article
Full-text available
Four of the nine big Technical Universities in Germany, together with Chalmers University of Technology in Sweden, have developed a new Massive Open Online Course (MOOC) on the subject of Communication Acoustics. The idea is to foster education on the late Bachelor or early Master level by joining the expertise available at individual universities...
Conference Paper
Full-text available
Psychological reactance is well known in psychology and marketing, but has not yet been adopted in HCI-research. The authors aim at assessing the benefit of measuring psychological reactance in the context of usability and user experience evaluation in a HCI context. To date, there are no tools that are designed to evaluate psychological reactance...
Article
This paper deals with the relevance of the first impression of interactive systems, based on short passive visual/auditory stimuli of system output. Individual consistency between such impressions and retrospective user ratings, obtained directly after real interaction, is studied in four exploratory experiments. All systems allow for voice user in...
Conference Paper
User simulation is frequently used to evaluate spoken dialogue systems. Previous work in this field primarily focused on the users’ interaction behaviour. Less attention has been paid to the users’ goals, how they relate to the system capabilities, and how they may change over the course of a dialogue. User goals may be underspecified or overspecif...
Conference Paper
As a complement to the 2011 ITG Guideline 2.1-01 on the evaluation of terminal devices, a new ITG guideline on the usability of smart home environments has been drafted. This guideline addresses services and applications which allow for an implicit interaction between user and system taking place in an environment equipped with networked sensors an...
Article
Multimodal interfaces are expected to improve input and output capabilities of increasingly sophisticated applications. Several approaches are aimed at formally describing multimodal interaction. However, they rarely treat it as a continuous flow of actions, preserving its dynamic nature and considering modalities at the same level. This work propo...
Conference Paper
We argue that standardized metrics and automatic evaluation tools are necessary for speeding up knowledge generation and development processes for dialog systems.
Conference Paper
The complexity in developing and evaluating user interfaces has been extremely increased in the last few years, because more and more devices offer capabilities for multimodal interaction. This applies in particular to mobile devices like smartphones and tablet computers. An existing parameter set, aimed at describing aspects of various modalities,...
Conference Paper
This paper presents work in progress which aims at analyzing the origins of interaction problems which certain users have when interacting with new technology. Our analysis is based on device models which categorize certain classes of devices via a pre-defined set of features. We provide examples which show that usability problems are partially cau...
Conference Paper
Full-text available
This paper addresses the performance of a user simulator in producing interactions with a spoken dialog system which include usability problems. Simple and general models of user behavior and speech understanding performance, as they are known in early design stages, are shown to detect up to 85% of the usability problems found in a real user test....

Network

Cited By

Projects