Koen V. Hindriks

Koen V. Hindriks
Vrije Universiteit Amsterdam | VU · Department of Computer Science

PhD

About

264
Publications
58,046
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
4,788
Citations
Introduction
Koen Hindriks is Full Professor Artificial Intelligence at the Vrije Universiteit (VU) Amsterdam and CIO of the spin-off Interactive Robotics. He is chair of the Special Interest Group on Artificial Intelligence in The Netherlands (An IPN member). His work on Artificial Intelligence focuses on socio-cognitive robotics. He has published more than 150 papers on cognitive agent technology. Interaction between man and robot is at the heart of his research and also drives the goals of his company. He has developed robots as companions and assistants for healthcare and education, and is developing service robots for business solutions.
Additional affiliations
November 2018 - present
Vrije Universiteit Amsterdam
Position
  • Professor (Full)
January 2015 - present
Delft University of Technology
Position
  • Professor (Associate)
December 2014 - July 2016
Delft University of Technology
Position
  • Interim Section Lead
Education
September 1990 - August 1996
University of Groningen
Field of study
  • Computer Science

Publications

Publications (264)
Article
Objectives: Children with cancer often experience sleep problems, which are associated with many negative physical and psychological health outcomes, as well as with a lower quality of life. Therefore, interventions are strongly required to improve sleep in this population. We evaluated interactive education with respect to sleep hygiene with a soc...
Article
Full-text available
The robot rights debate has thus far proceeded without any reliable data concerning the public opinion about robots and the rights they should have. We have administered an online survey ( n = 439) that investigates layman’s attitudes toward granting particular rights to robots. Furthermore, we have asked them the reasons for their willingness to g...
Preprint
Full-text available
We present a discovery-based, first version, explicit model of social interaction that provides a basis for measuring the quality of interaction of a human user with a social robot. The two core elements of the social interaction model are engagement and co-regulation. Engagement emphasizes the \textit{qualitative nature} of social interaction and...
Conference Paper
Existing agent-based models of emotion contagion that account for the emotional diversity in groups have mostly focussed on the spread of categorical emotions (happy, sad, angry). In practice this raises problems with regard to how the spread of different emotions should interact. Can one be both very happy and very angry at the same time, or shift...
Chapter
Effective use of negotiation support systems depends on the systems capability of explaining itself to the user. This paper introduces the notion of an explanation matrix and an aberration detection mechanism for bidding strategies. The aberration detection is a mechanism that detects if one of the negotiating parties deviates from their expected b...
Article
Full-text available
This review aims to summarize and describe research on the topic of automatic group emotion recognition. In recent years, the topic of emotion analysis of groups or crowds has gained interest, with studies performing emotion detection in different contexts, using different datasets and modalities (such as images, video, audio, social media messages...
Article
Full-text available
Serious games and gamification is a popular and growing field, commercially and for academic research. This paper aims to give an overview of a specific domain within the field of serious gaming and gamification; the field of serious games and gamification to empower vulnerable target groups. This overview contributes to a better understanding of t...
Article
We define hybrid intelligence (HI) as the combination of human and machine intelligence, augmenting human intellect and capabilities instead of replacing them and achieving goals that were unreachable by either humans or machines. HI is an important new research focus for artificial intelligence, and we set a research agenda for HI by formulating f...
Chapter
The issue of explainability for autonomous systems is becoming increasingly prominent. Several researchers and organisations have advocated the provision of a “Why did you do that?” button which allows a user to interrogate a robot about its choices and actions. We take previous work on debugging cognitive agent programs and apply it to the questio...
Chapter
The commercial availability of robots and voice-operated smart devices such as Alexa or Google Home have some companies wondering whether they can replace some current human interactions by using these devices. One such area of interaction is at the reception desk. While both platforms can offer the necessary interaction features to take on the tas...
Article
It is claimed that, in the nascent ‘Cognitive Era’, intelligent systems will be trained using machine learning techniques rather than programmed by software developers. A contrary point of view argues that machine learning has limitations, and, taken in isolation, cannot form the basis of autonomous systems capable of intelligent behaviour in compl...
Article
Full-text available
It is claimed that, in the nascent ‘Cognitive Era’, intelligent systems will be trained using machine learning techniques rather than programmed by software developers. A contrary point of view argues that machine learning has limitations, and, taken in isolation, cannot form the basis of autonomous systems capable of intelligent behaviour in compl...
Preprint
BACKGROUND Society is facing a global shortage of 17 million healthcare workers, along with increasing healthcare demands from a growing number of older adults. Social robots are being considered as solutions to part of this problem. OBJECTIVE To evaluate the quality of care perceived by patients and caregivers for an integrated care pathway in an...
Article
Background: Society is facing a global shortage of 17 million health care workers, along with increasing health care demands from a growing number of older adults. Social robots are being considered as solutions to part of this problem. Objective: Our objective is to evaluate the quality of care perceived by patients and caregivers for an integr...
Article
Full-text available
Patient reported outcome measures (PROMs) are an essential means for collecting information on the effectiveness of hospital care as perceived by the patients themselves. Especially older adult patients often require help from nursing staff to successfully complete PROMs, but this staff already has a high work load. Therefore, a social robot is int...
Conference Paper
Full-text available
This paper presents the design and evaluation of human-like welcoming behaviors for a humanoid robot to draw the attention of passersby by following a three-step model: (1) selecting a target (person) to engage, (2) executing behaviors to draw the target's attention, and (3) monitoring the attentive response. A computer vision algorithm was develop...
Chapter
We are developing a social robot that should autonomously interact long-term with pediatric oncology patients. The child and the robot need to get acquainted with one another before a long-term interaction can take place. We designed five interaction design patterns and two sets of robot behaviors to structure a getting acquainted interaction. We d...
Chapter
We report on the exploratory design and study of a robot math tutor that can provide feedback on specific errors made by children solving basic addition and subtraction problems up to 100. We discuss two interaction design patterns, one for speech recognition of answers when children think aloud, and one for providing error-specific feedback. We ev...
Article
Agents in teamwork may be highly interdependent on each other, the awareness of interdependence relationships is an important requirement for designing and consequently implementing a multi-agent system. In this work, we propose a formal graphical and domain-independent language that can facilitate the identification of comprehensive interdependenc...
Article
Full-text available
Artificial Intelligence (AI) is becoming more and more ubiquitous, and AI also invades health care and related fields ever more. We believe this is a good thing. Inspired by work that we have done in various projects at the Alan Turing Institute Almere (ATIA), Delft University of Technology (TUD), Utrecht University (UU), and Vrije University (VU),...
Chapter
Full-text available
The evaluation of cognitive agent systems, which have been advocated as the next generation model for engineering complex, distributed systems, requires more benchmark environments that offer more features and involve controlling more units. One issue that needs to be addressed time and again is how to create a connector for interfacing cognitive a...
Article
The continuous integration of software-intensive systems together with the ever-increasing computing power offer a breeding ground for intelligent agents and multi-agent systems (MAS) more than ever before. Over the past two decades, a wide variety of languages, models, techniques and methodologies have been proposed to engineer agents and MAS. Des...
Conference Paper
Drawing the attention of passersby is a basic task of a social robot to initiate an interaction in a public environment (e.g., shopping malls, museums or hospitals). Humans use several social cues, both verbal and nonverbal, to draw the attention of others. In this study, we investigate whether similar behaviors can also be effectively used by a so...
Article
Full-text available
Background /Objectives Healthcare professionals (HCP) are confronted with an increased demand for assessments of important health status measures, such as patient-reported outcome measurements (PROM), and the time this requires. The aim of this study was to investigate the effectiveness and acceptability of using an HCP robot assistant, and to test...
Article
Full-text available
We are designing a social robot to collect patient data in hospitals by interviewing patients. This task is crucial for improving and providing value-based care. Currently, professional caretakers administer self-reported outcome questionnaires called patient reported outcome measures (PROMs) to collect this data. By delegating this task to a robot...
Conference Paper
Full-text available
It has been argued that the evaluation of cognitive agent systems requires richer benchmark problems. We think that real-time strategy (RTS) games can offer such a testbed, as AI for RTS requires the design of complicated strategies for coordinating hundreds of units that need to solve a range of challenges. Therefore, in this paper, we report on t...
Conference Paper
Full-text available
Patient Reported Outcome Measures (PROMs) are a means of collecting information on the effectiveness of care delivered to patients as perceived by the patients themselves. A patient's pain level is a typical parameter only a patient him/herself can describe. It is an important measure for a person?s quality of life. When a patient stays in a Dutch...
Conference Paper
We report on a field exercise in which a team of human fire-fighters used robots to enact a realistic disaster response mission in an industrial environment. In this exercise we evaluated the technical working of an integrated robotic system and gained insights concerning the manner in which robots and information streams can be utilized effectivel...
Conference Paper
Full-text available
Today, off-the-shelf social robots are used increasingly in the HRI community to research social interactions with different target user groups across a range of domains (e.g. healthcare, education, retail and other public spaces). We invite everyone doing HRI studies with end users, in the lab or in the wild, to collect past experiences of methods...
Preprint
See https://goalapl.atlassian.net/wiki/spaces/GOAL/pages/33043/Tutorials+Documentation+and+Education for the latest version of the GOAL Programming Guide.
Preprint
Full-text available
See https://goalapl.atlassian.net/wiki/spaces/GOAL/pages/33043/Tutorials+Documentation+and+Education for the latest version.
Conference Paper
Full-text available
Pediatric oncology patients could benefit from bonding with a social robot and talking about their day in the hospital. With our research we aim to contribute to the development of a robot that is able to facilitate a child-robot bond autonomously and long-term. We propose to use robot-disclosure and a shared interaction history to create a child-r...
Conference Paper
Full-text available
Medical staff uses Patient Reported Outcome Measurement (PROM) questionnaires as a means of collecting information on the effectiveness of care delivered to patients as perceived by the patients themselves. Especially for the older patient group, the PROM questioning poses an undesirable workload on the staff. This proof of concept paper investigat...
Conference Paper
Full-text available
Task allocation and management is crucial for human-robot collaboration in Urban Search And Rescue response efforts. The job of a mission team leader in managing tasks becomes complicated when adding multiple and different types of robots to the team. Therefore, to effectively accomplish mission objectives, shared situation awareness and task manag...
Conference Paper
Exploration games are games where agents (or robots) need to search resources and retrieve these resources. In principle, performance in such games can be improved either by adding more agents or by exchanging more messages. However, both measures are not free of cost and it is important to be able to assess the trade-off between these costs and th...
Conference Paper
Full-text available
Artificial Intelligence (AI) systems, including intelligent agents, are becoming increasingly complex. Explainable AI (XAI) is the capability of these systems to explain their behaviour, in a for humans understandable manner. Cognitive agents, a type of intelligent agents, typically explain their actions with their beliefs and desires. However, hum...
Conference Paper
Full-text available
This paper presents a cognitive (belief-desire-intention based) agent that can self-explain its behaviour based on its goals and emotions. We implement a cognitive agent, embodied by a nao-robot or virtual avatar thereof, to play a quiz with its user. During the interaction the agent intelligently selects questions to optimally educate the user. We...
Article
Full-text available
When an agent program exhibits unexpected behaviour, a developer needs to locate the fault by debugging the agent’s source code. The process of fault localisation requires an understanding of how code relates to the observed agent behaviour. The main aim of this paper is to design a source-level debugger that supports single-step execution of a cog...
Conference Paper
Full-text available
When designing a social robot for children whose daily lives are affected by a physical or mental health condition, it is important to involve them in the design process to safeguard their needs and values. However, implementing this core user-centered design principle proves to be challenging. In this paper we address the question of how to approp...
Conference Paper
Full-text available
A good explanation takes the user who is receiving the explanation into account. We aim to get a better understanding of user preferences and the differences between children and adults who receive explanations from a robot. We implemented a Nao-robot as a belief-desire-intention (BDI)-based agent and explained its actions using two different expla...
Conference Paper
Full-text available
Children are eager to anthropomorphize (ascribe human attributes to) social robots. As a consequence they expect a more unconstrained, substantive and useful interaction with the robot than is possible with the current state-of-the art. In this paper we reflect on several of our user studies and investigate the form and role of expectations in chil...
Conference Paper
Full-text available
For real-time programs reproducing a bug by rerunning the system is likely to fail, making fault localization a time-consuming process. Omniscient debugging is a technique that stores each run in such a way that it supports going backwards in time. However, the overhead of existing omniscient debugging implementations for languages like Java is so...
Conference Paper
Full-text available
The main goal of our demonstration is to show how omniscient debugging can be applied in practice to cognitive agents. A concrete implementation of the mechanisms proposed in Koeman et. al [2017] has been created for the GOAL agent programming language in the Eclipse environment, integrated with the source-level debugger of Koeman et. al [2016], th...
Conference Paper
Full-text available
The Pocket Negotiator (PN) is a negotiation support system developed at TU Delft as a tool for supporting people in bilateral negotiations over multi-issue negotiation problems in arbitrary domains. Users are supported in setting their preferences, estimating those of their opponent, during the bidding phase and sealing the deal. We describe the ov...
Conference Paper
We propose Boolean Negotiation Games, a computationally grounded model to investigate strategic aspects of negotiations. Our model is inspired by the popular Boolean Game framework and Rubinstein’s bargaining model of alternating offers. We analyse restrictions on negotiation protocols and investigate properties of agreements. We propose and invest...
Chapter
In May 2015, we organized the Sixth International Automated Negotiating Agents Competition (ANAC 2015) in conjunction with AAMAS 2015. ANAC is an international competition that challenges researchers to develop a successful automated negotiator for scenarios where there is incomplete information about the opponent. One of the goals of this competit...
Chapter
This paper presents a general framework for multilateral turn-taking protocols and two fully specified protocols namely Stacked Alternating Offers Protocol (SAOP) and Alternating Multiple Offers Protocol (AMOP). In SAOP, agents can make a bid, accept the most recent bid or walk way (i.e., end the negotiation without an agreement) when it is their t...
Conference Paper
We report on the latest large-scale disaster-response exercise conducted by our project, which involves a robotic system with both ground robots (UGVs) and aerial robots (UAVs). In particularly, we focus on aspects related to Human-Robot teaming, and the uptake of new technology by end-users.
Article
The annual International Automated Negotiating Agents Competition (ANAC) is used by the automated negotiation research community to benchmark and evaluate its work andto challenge itself. The benchmark problems and evaluation results and the protocols and strategies developed are available to the wider research community.
Conference Paper
The annual International Automated Negotiating Agents Competition (ANAC) is used by the automated negotiation research community to benchmark and evaluate its work and to challenge itself. The benchmark problems and evaluation results and the protocols and strategies developed are available to the wider research community. https://aaai.org/ocs/ind...
Chapter
As robots are increasingly used in Search and Rescue (SAR) missions, it becomes highly relevant to study how SAR robots can be developed and deployed in a responsible way. In contrast to some other robot application domains, e.g. military and healthcare, the ethics of robot-assisted SAR are relatively under examined. This paper aims to fill this ga...
Conference Paper
Full-text available
Cognitive agent programming frameworks facilitate the development of intelligent virtual agents. By adding a computational model of emotion to such a framework, one can program agents capable of using and reasoning over emotions. Computational models of emotion are generally based on cognitive appraisal theory; however, these theories introduce a l...
Article
Full-text available
A negotiation between agents is typically an incomplete information game, where the agents initially do not know their opponent’s preferences or strategy. This poses a challenge, as efficient and effective negotiation requires the bidding agent to take the other’s wishes and future behavior into account when deciding on a proposal. Therefore, in or...
Article
Full-text available
Many application domains require search and retrieval, which is also known in the robotic domain as foraging. For example, in a search and rescue domain, a disaster area needs to be explored and transportation of survivors to a safe area needs to be arranged. Performing such a search and retrieval task by more than one robot increases performance i...
Book
The development of Artificial Intelligence is experiencing a fruitful period of incredible progress and innovation. After decades of notable successes and disappointing failures, AI is now poised to emerge in the public sphere and completely transform human society, altering how we work, how we interact with each other and our environments, and how...
Conference Paper
We propose a new strategic model of negotiation, called Boolean negotiation games. Our model is inspired by Boolean games and the alternating offers model of bargaining. It offers a computationally grounded model for studying properties of negotiation protocols in a qualitative setting. Boolean negotiation games can yield agreements that are more b...
Conference Paper
Full-text available
Debugging is notoriously difficult and extremely time consuming but also essential for ensuring the reliability and quality of a software system. In order to reduce debugging effort and enable automated failure detection, we propose an automated testing framework for detecting failures in cognitive agent programs. Our approach is based on the assum...
Conference Paper
Full-text available
In order to reduce debugging effort and enable automated failure detection, we proposed an automated testing framework for cognitive agent programs that provides support for detecting frequently occurring failure types. Automated testing yields a reduction in the effort needed to detect a failure and is more effective than manual code inspection me...