Martin Schmettow

Verified

Martin verified their affiliation via an institutional email.

Learn more

Verified

Martin verified their affiliation via an institutional email.

Learn more

• Dr. rer. pol.
• Professor (Assistant) at University of Twente

Intelligent systems, such as chatbots, are likely to strike new qualities of UX that are not covered by instruments validated for legacy human–computer interaction systems. A new validated tool to evaluate the interaction quality of chatbots is the chatBot Usability Scale (BUS) composed of 11 items in five subscales. The BUS-11 was developed mainly...

Objective The postictal state is underrecognized in epilepsy. Animal models show improvement of postictal symptoms and cerebral perfusion with acetaminophen or nimodipine. We studied the effects of acetaminophen or nimodipine on postictal electroencephalographic (EEG) recovery, clinical reorientation, and hypoperfusion in patients with ECT‐induced...

Coal mining activities increase the soil concentrations of heavy metals manifold thus impacting soil health and biodiversity. The understanding of the impact of bioturbation activities by ant colonies on soil in coal mine spoil site across different restoration ages is not studied. The study aimed to investigate the influence of bioturbation activi...

Chatbot-based tools are becoming pervasive in multiple domains from commercial websites to rehabilitation applications. Only recently, an eleven-item satisfaction inventory was developed (the ChatBot Usability Scale, BUS-11) to help designers in the assessment process of their systems. The BUS-11 has been validated in multiple contexts and language...

Objective: We aim to provide a quantitative description of the relation between seizure duration and the postictal state using features extracted from the postictal electroencephalogram (EEG). Methods: Thirty patients with major depressive disorder treated with electroconvulsive therapy (ECT) were studied with continuous EEG before, during, and...

Chatbot-based tools becoming pervasive in multiple domains from commercial websites to rehabilitation applications. Only recently an eleven-item satisfaction inventory was developed (the chatBot Usbaliy Scale, BUS-11) to help designers in the assessment process of their systems. The BUS-11 has been validated in multiple contexts and languages i.e.,...

The Bot Usability Scale (BUS) is a standardised tool to assess and compare the satisfaction of users after interacting with chatbots to support the development of usable conversational systems. The English version of the 15-item BUS scale (BUS-15) was the result of an exploratory factorial analysis; a confirmatory factorial analysis tests the repli...

Many situations in traffic involve multiple road users and can only be solved by successful cooperation. However, 30% of cooperation in traffic fail, which indicates that there is potential for improvement (Benmimoun et al., 2004). In this study, lane change manoeuvres were examined as a typical cooperative situation. In order to improve cooperatio...

Standardised tools to assess a user’s satisfaction with the experience of using chatbots and conversational agents are currently unavailable. This work describes four studies, including a systematic literature review, with an overall sample of 141 participants in the survey (experts and novices), focus group sessions and testing of chatbots to (i)...

Linear models answer the question of how one quantitative outcome, say ToT, decreases or increases, when a condition changes. This chapter introduces the three basic ways how such conditions can enter a linear model. The most basic LM, the grand mean model, does not account for any conditions and produces just a single estimate: the grand mean in t...

In this book, we will be using the statistical computing environment R. R at its core is a programming language that specializes in statistics and data analysis. R comes with a complete set of standard packages that cover common routines in statistical analysis. However, the classic standard packages are known to be incomplete, inconsistent and dif...

Multi-level linear models introduce a special type of categorial variable, the random factor, which applies when the factor levels can be seen as members of a population, such as participants in a sample. Multi-level models allows to simultaneously produce estimates on population level and on participant level. That makes multi-level models interes...

In Chaps. 4 and 6, we have seen a marvelous variety of models spawning from just two basic principles, linear combination of multiple effects and Gaussian distribution. Chapter 7 further expanded the variety of models, letting us choose response distributions that sit snug on the outcome variable. This chapter is dedicated to methods that assess ho...

The aim of scientific research is to avoid the pitfalls of our minds and act as rational as possible by translating our theory into a formal model of reality, gathering evidence in an unbiased way and weigh evidence against noise in a controlled way. This chapter introduces the Bayesian approach to statistical modeling from the ground up and illust...

Design researchers are often collecting data under a variety of conditions, each of which qualifies as a predictor in its own right. The advantage of the linear terms is that they can be combined, which allows estimating the simultaneous influence of multiple predictors in one model. We will start with models, where all predictors act mutually inde...

The preceding chapters were all about specifying an appropriate (and often sophisticated) predictor term. In this chapter, we will give the outcome variables their due respect. First, the assumptions of Gaussian linear model are reviewed and generally discarded. Next, the framework of Generalized Linear Models is explained from ground up. After tha...

Design Research uses scientific methods to evaluate designs and build design theories. This book starts with recognizable questions in Design Research, such as A/B testing, how users learn to operate a device and why computer-generated faces are eerie. Using a broad range of examples, efficient research designs are presented together with statistic...

Robot-assisted surgery training is shifting towards simulation-based training. Challenges that accompany this shift are high costs, working hour regulations and the high stakes aspects of the surgery domain. Adaptive training could be a possible solution to reduce the problems. First, an adaptive system needs diagnostic data with which the system c...

Die stetig zunehmende Automation geht mit einer Verbesserung der technischen Zuverlässigkeit einher und ermöglicht eine manöverbasierte Fahrzeugführung, bei der ein Fahrzeug Stabilisierungsaufgaben und Manöver sicher ausgeführt. Die Manöver können dabei durch Menschen initiiert, abgebrochen oder übersteuert werden. Basierend auf der Designmetapher...

Die fortschreitende Erforschung und Entwicklung neuer Mobilitätskonzepte, die vor allem durch die Digitalisierung ermöglicht werden, stellt für öffentliche Verkehrsunternehmen eine vielversprechende Möglichkeit dar, nutzerzentrierte Alternativangebote zum motorisierten Individualverkehr anzubieten. Nicht nur in ländlichen Räumen führt der Trend weg...

This paper proposes and demonstrates an extended protocol for usability validation testing of medical devices. A review of currently used methods for the usability evaluation of medical devices revealed two main shortcomings. Firstly, the lack of methods to closely trace the interaction sequences and derive performance measures. Secondly, a prevail...

We validated the usability of a new infusion pump interface designed with a situated Cognitive Engineering approach by comparing it to a reference interface using a novel testing method employing repeated measurements and process measures, in addition to traditional outcome measures. The sample consisted of 25 nurses who performed eight critical ta...

Card sorting is a method for eliciting mental models and is frequently used for creating efficient website navigation structures. The present studies set out to validate card sorting by linking browsing performance to the degree of match between the mental model and the navigation structure. First, a card sorting study was conducted (n = 27) to eli...

Despite a century of progress in statistics since the introduction of ANOVA and Pearson correlation, many researchers are still squeezing their precious data into the tight corset of those dated statistical models. This is particularly limiting in applied disciplines such as HCI, where impact factors can be numerous, heterogeneous and difficult to...

Unlabelled: The aim of this study was to advance the conceptualisation of team adaptation by applying social network analysis (SNA) measures in a field study of a paediatric cardiac surgical team adapting to changes in task complexity and ongoing dynamic complexity. Forty surgical procedures were observed by trained human factors researchers, and...

This paper examines combinations of complementary evaluation methods as a strategy for efficient usability problem discovery. A data set from an earlier study is re-analyzed, involving three evaluation methods applied to two virtual environment applications. Results of a mixed-effects logistic regression suggest that usability testing and inspectio...

The personality construct of geekism is introduced as the tendency to act out one's need for cognition in the domain of computing technology. Achievement goal theory is introduced, and we ask, what drives geeks in terms of achievement. In a questionnaire study, it is shown that geekism is related to achievement motivation in imagined situations wit...

Previous studies have found that basic movement characteristics of a robot influence the emotional attributes people perceive independent of the embodiment of the motion (e.g. iCat vs. Roomba). Here, with a very simple LEGO robot, we replicate these associations between levels of acceleration and curvature and the extent to which positive and negat...

Twenty-five years ago, Dennis Egan published a review on the impact of individual differences in human-computer interaction, where he claimed that users are more diverse than designs are [5]. While being cited frequently, this claim has not been tested since then. An efficient research design for separating and comparing variance components is pres...

Usability testing is recognized as an effective means to improve the usability of medical devices and prevent harm for patients and users. Effectiveness of problem discovery in usability testing strongly depends on size and representativeness of the sample. We introduce the late control strategy, which is to continuously monitor effectiveness of a...

User experience research has made considerable progress in understanding subjective experience with interactive technology. Nevertheless, we argue, some blind spots have remained: individual differences are frequently ignored, the prevalent measures of self-report rarely undergo verification, and overly focus is on utilitarian and hedonic dimension...

We examined how culture and recipient perspective affect direction giving during wayfinding. Participants from the United States and the Netherlands provided directions from starting locations to destinations for fictional recipients driving through a town (route perspective) or looking at a map of the town (survey perspective). US participants pro...

Usability studies are important for developing usable, enjoyable products, identifying design flaws (usability problems) likely to compromise the user experience. Usability testing is recommended for improving interactive design, but discovery of usability problems depends on the number of users tested. When usability is critical, an extended stati...

Viele Arbeiten im Usability Engineering befassen sich damit, neue Methoden zur Aufdeckung von Usability Schwachstellen zu entwickeln und ihre Effizienz mit etablierten Methoden zu vergleichen. Hier wird die Perspektive eingenommen, dass Evaluationsmethoden grundsätzlich selektiv in Bezug auf Typen von Schwachstellen sind. Diese Selektivität ist tei...

In cases where usability is a mission critical system quality it is becoming essential to know whether an evaluation study has identified the majority of existing defects. Previous work has shown that procedures for estimating the progress of evaluation studies have to account for variation in defect visibility; otherwise, harmful bias will happen....

In this paper a modular authoring system for interactive videos is intro-duced. The system enables the author to edit the video and add annotations like images, text, hyperlinks to defined scenes or the whole video. It provides a video cutting tool to define scenes, a scene graph to realize non-linear flow of the video and a HTML editor to create t...

Usability evaluation methods have a long history of research. Latest contributions significantly raised the validity of method evaluation studies. But there is still a measurement model lacking that incorporates the relevant factors for inspection performance and accounts for the probabilistic nature of the process. This paper transfers a modern pr...

Current prediction models for usability evaluations are based on stochastic distributions derived from series of Bernoulli pro- cesses. The underlying assumption of these models is a homoge- neous detection probability despite of it being intuitively unreal- istic. This paper contributes a simple statistical test for existence of heterogeneity in t...

Usability professionals may face strict economic demands on the usability process in near future. This position paper outlines a research agenda to make usability evaluation a predictable and highly efficient engineering process.

The Usability Pattern Inspection (UPI) is a new usability inspection method designed for the added downstream utility of producing concrete design recommendations. This paper provides first empirical evidence that UPI measures up to the established inspection method Heuristic Evaluation (HE) regarding defect identification. It is shown that there i...

Redesign of a municipal internet portal

The Usability Pattern Inspection (UPI) is a new usability inspection method designed for the added downstream utility of producing concrete design recommendations. This paper provides first em- pirical evidence that UPI measures up to the established inspection method Heuristic Evaluation (HE) regarding defect identification. It is shown that th...

Über das Internet werden von Hochschulen, Bildungseinrichtungen und Verlagen im In- und Ausland Lehr- und Lernmaterialien bereitgestellt. Der Bekanntheitsgrad dieser Produkte beschränkt sich jedoch meist auf einen begrenzten Personenkreis. Die mangelnde Erschließung dieser elektronischen Dokumente macht das Auffinden geeigneter Produkte für Lehrzwe...

Usability Inspections are essential for early detection of defects in UI design, but they require sound usability knowledge. Usability Patterns are the state-of-the-art format for describing usability knowledge. Thus, it seems obvi-ous to use them as a means for evaluating the design of user interfaces. In this paper a usability inspection method b...