Jan Schneider

DIPF - Leibniz Institute for Research and Information in Education · Educational Technologies

Current lifelong learning platforms offer users a query option to select a wide variety of courses. However, finding a suitable course among the seemingly endless catalogs of options presented by the platforms is not straightforward. We argue that digital counseling can enhance this process. In this paper, we present a set of three formative studie...

Background Learning Analytics (LA) is an emerging field concerned with measuring, collecting, and analysing data about learners and their contexts to gain insights into learning processes. As the technology of Learning Analytics is evolving, many systems are being implemented. In this context, it is essential to understand stakeholders' expectation...

Learning Analytics (LA) consists of miscellaneous steps that include data harvesting, storing, cleaning, anonymisation, mining, analysis, and visualisation so that the vast amount of educational data is comprehensible and ethically utilisable by educators or instructors to obtain the advantages and benefits that LA can bring to the educational scen...

This chapter describes the insights derived by the design and development of the Multimodal Tutor, a system that uses artificial intelligence for providing digital feedback and to support psychomotor skills acquisition. In this chapter, we discuss the insights which we gained from eight studies: (1) an exploratory study combining physiological data...

Technology is gradually becoming an integral part of learning at all levels of educational. This includes the now pervasive presence of virtual learning environments (VLEs) and the inclusion of interactive devices used or worn by learners or that are present in the physical classroom environment. These new technology-rich educational ecosystems hav...

Acquisition and internalisation of many fundamental skills rely on repeated authentic practice and teachers providing support during practice. Despite this well accepted norms in skills acquisition, much of our assumptions about learning skills, mostly from a cognitive perspective, remain nebulous. Besides splitting hairs to classify skills acquisi...

While digital education technologies have improved to make educational resources more available, the modes of interaction they implement remain largely unnatural for the learner. Modern sensor-enabled computer systems allow extending human-computer interfaces for multimodal communication. Advances in Artificial Intelligence allow interpreting the d...

Lay Description What is already known about this topic? Learning design (LD) is the pedagogic process used in teaching/learning that leads to the creation and sequencing of learning activities and the environment in which it occurs. Learning analytics (LA) is the measurement, collection, analysis & reporting of data about learners and their contex...

In recent years, Learning Analytics (LA) has become a very heterogeneous research field due to the diversity in the data generated by the Learning Management Systems (LMS) as well as the researchers in a variety of disciplines, who analyze this data from a range of perspectives. In this paper, we present the evaluation of a LA tool that helps cours...

This paper presents results from our design and evaluation studies of the Learning Analytics Cockpit (LA Cockpit) for a quiz app, which aims to provide lecturers with important information about students’ knowledge levels. We define a LA Cockpit as a tool for instructors that enables them to steer students’ learning process by providing a LA Dashbo...

This paper describes the CPR Tutor, a real-time multimodal feedback system for cardiopulmonary resuscitation (CPR) training. The CPR Tutor detects training mistakes using recurrent neural networks. The CPR Tutor automatically recognises and assesses the quality of the chest compressions according to five CPR performance indicators. It detects train...

Research shows that various contextual factors can have an impact on learning. Some of these factors can originate from the physical learning environment (PLE) in this regard. When learning from home, learners have to organize their PLE by themselves. This paper is concerned with identifying, measuring, and collecting factors from the PLE that may...

Digital distractions can interfere with goal attainment and lead to undesirable habits that are hard to get red rid of. Various digital self‐control interventions promise support to alleviate the negative impact of digital distractions. These interventions use different approaches, such as the blocking of apps and websites, goal setting, or visuali...

Currently, a vast number of the population faces several barriers like the lack of motivation and guidance that impede them from practicing physical activities. Thus, we developed the Pilates Correction Game (PCG), a gamified application designed to support learners with the practice of Pilates. The PCG is composed of two applications: a smartphone...

The link between the body and mind has fascinated philosophers and scientists for ages. The increasing availability of sensor technologies has enabled the possibility to explore this link even deeper, providing some evidence that certain physiological measurements such as galvanic skin response can have in the performance of different learning acti...

Chatbots are a promising technology with the potential to enhance workplaces and everyday life. In terms of scalability and accessibility, they also offer unique possibilities as communication and information tools for digital learning. In this paper, we present a systematic literature review investigating the areas of education where chatbots have...

Workshop proposal for CrossMMLA focused on collecting and analysing multimodal data across the physical and the virtual. Under the current global pandemic, cross physical and virtual spaces play a substantial factor and challenge for MMLA, which is focused on collaborative learning in physical spaces. The workshop proposes an asynchronous format th...

Workshop proposal for CrossMMLA focused on collecting and analysing multimodal data across the physical and the virtual. Under the current global pandemic, cross physical and virtual spaces play a substantial factor and challenge for MMLA, which is focused on collaborative learning in physical spaces. The workshop proposes an asynchronous format th...

Learning to solve graph tasks is one of the key prerequisites of acquiring domain-specific knowledge in most study domains. Analyses of graph understanding often use eye-tracking and focus on analyzing how much time students spend gazing at particular areas of a graph—Areas of Interest (AOIs). To gain a deeper insight into students’ task-solving pr...

Im Forschungsfeld Learning Analytics haben Studien konkrete Beispiele dazu geliefert, wie die direkte Interaktion mit sog. Learning-Management-Systemen zur Optimierung und zum besseren Verständnis von Lernprozessen dienen kann. Allerdings findet Lernen nicht nur in der unmittelbaren Interaktion mit einem solchen System statt. Mittels Sensoren könne...

In this demo paper we present a tool that provides an overview of learning analytics indicators, metrics, and learning design activities in the field of learning analytics over the past decade. The system is based on our literature review from a total of 123 scientific publications, where we fetched 132 indicators and their metrics, 40 learning act...

We developed the CPR Tutor, a real-time multimodal feedback system for cardiopulmonary resuscitation (CPR) training. The CPR Tutor detects mistakes using recurrent neural networks for real-time time-series classification. From a multimodal data stream consisting of kinematic and electromyographic data, the CPR Tutor system automatically detects the...

The communication behavior of us humans has changed greatly in recent years. The ubiquitous presence of digital media, networked devices and technology has created new types of conversations, discussions and information sharing. However, the resulting possibilities for designing lessons and supporting learners have not yet been fully exploited. Esp...

One key factor for the successful outcome of a Learning Analytics (LA) infrastructure is the ability to decide which software architecture concept is necessary. Big Data can be used to face the challenges LA holds. Additional challenges on privacy rights are introduced to the Europeans by the General Data Protection Regulation (GDPR). Beyond that,...

Online educational Portals (OEPs) subsume a field of online repositories for a wide range of stakeholders. They are characterized by easily accessible structures that do not require visitor accounts. Most OEPs therefore provide content in one way to all visitors also known as "one size fits all" approach. With this study, we examine if Web Analytic...

Dancing is a discipline that makes enhances the mood in people and is challenging to learn because it requires good coordination and feeling of the rhythm. In this paper we present and describe the Dancing Coach (DC), a tutoring system designed to help users to learn and practice dancing steps. The current implementation of the DC provides guidance...

Dancing is an activity that positively enhances the mood of people that consists of feeling the music and expressing it in rhythmic movements with the body. Learning how to dance can be challenging because it requires proper coordination and understanding of rhythm and beat. In this paper, we present the first implementation of the Dancing Coach (D...

In this demo paper, we introduce the Multimodal Pipeline, a prototypical approach for the collection, storing, annotation, processing and exploitation of multimodal data for supporting learning. At the current stage of development, the Multimodal Pipeline consists of two relevant prototypes: 1) Multimodal Learning Hub for the collection and storing...

The development of multimodal sensor-based applications designed to support learners with the improvement of their skills is expensive since most of these applications are tailor-made and built from scratch. In this paper, we show how the Presentation Trainer (PT), a multimodal sensor-based application designed to support the development of public...

This study investigated to what extent multimodal data can be used to detect mistakes during Cardiopulmonary Resuscitation (CPR) training. We complemented the Laerdal QCPR ResusciAnne manikin with the Multimodal Tutor for CPR, a multi-sensor system consisting of a Microsoft Kinect for tracking body position and a Myo armband for collecting electrom...

We introduce the Multimodal Learning Analytics Pipeline, a generic approach for collecting and exploiting multimodal data to support learning activities across physical and digital spaces. The MMLA Pipeline facilitates researchers in setting up their multimodal experiments, reducing setup and configuration time required for collecting meaningful da...

This paper introduces the Visual Inspection Tool (VIT) which supports researchers in the annotation of multimodal data as well as the processing and exploitation for learning purposes. While most of the existing Multimodal Learning Analytics (MMLA) solutions are tailor-made for specific learning tasks and sensors, the VIT addresses the data annotat...

Goal setting is an important step in Self-Regulated Learning. Setting goals is not a straight forward task. Some types of goals are more useful than others. The SMART goal setting guideline helps to generate more meaningful goals. In this paper, we present a research roadmap designed to assist learners with the generation of meaningful learning goa...

The chapter highlights the role of sensors for supporting seamless learning experiences. In the first part, the relation between sensor tracking of learning activities and research around real-time feedback in educational situations is introduced. The authors present an overview of the kinds of sensor data that have been used for educational purpos...

This paper presents the Learning Analytics Indicator Repository (LAIR), an interactive web-based application that allows the exploration of learning analytics approaches. From scientific publications in the field of learning analytics, we extracted the stakeholders, metrics, platforms and indicators, and transformed them into a directed graph repre...

Studies in Learning Analytics provide concrete examples of how the analysis of direct interactions with learning management systems can be used to optimize and understand the learning process. Learning, however, does not necessarily only occur when the learner is directly interacting with such systems. With the use of sensors, it is possible to col...

Multimodality in learning analytics and learning science is under the spotlight. The landscape of sensors and wearable trackers that can be used for learning support is evolving rapidly, as well as data collection and analysis methods. Multimodal data can now be collected and processed in real time at an unprecedented scale. With sensors, it is pos...

Educational practitioners have stressed the relevance of providing learners with a set of 21th century skills that will allow them to face current life challenges. Among others this includes communication and social skills such as public speaking, argumentation, negotiation, etc. Besides the acquisition of knowledge and techniques, these skills hav...

The WEKIT.one prototype is a platform for immersive procedural training with wearable sensors and Augmented Reality. Focusing on capture and re-enactment of human expertise, this work looks at the unique affordances of suitable hard- and software technologies. The practical challenges of interpreting expertise, using suitable sensors for its captur...

In recent years, research on multimodal sensor-based technologies has produced different prototypes designed to support the development of public skills. These prototypes are able to analyze the nonverbal communication of learners and provide them with feedback, in cases where human feedback is not available. One of these prototypes is called the P...

The ability to present effectively is essential for professionals; therefore, oral communication courses have become part of the curricula for higher education studies. However, speaking in public is still a challenge for many graduates. To tackle this problem, driven by the recent advances in computer vision techniques and prosody analysis, multim...

In our pursue to study effective real-time feedback in Technology Enhanced Learning, we developed the Presentation Trainer, a tool designed to support the practice of nonverbal communication skills for public speaking. The tool tracks the user’s voice and body to analyze her performance, and selects the type of real-time feedback to be presented. T...

The acquisition of knowledge is a key aspect for learners. However, in moments of stress the cognitive capacities of learners decrease considerably, making it very difficult for learners to get access and use their already acquired knowledge. Therefore we developed The Booth, a prototypical toolkit designed to support learners to prepare for key si...

The increasing accessibility of sensors allows the study and development of multimodal learning tools that create opportunities for learners to practice while receiving feedback. One of the potential learning scenarios addressed by these learning applications is the development of public speaking skills. First applications and studies showed promis...

The Presentation Trainer is a multimodal tool designed to support the practice of public speaking skills, by giving the user real-time feedback about different aspects of her nonverbal communication. It tracks the user's voice and body to interpret her current performance. Based on this performance the Presentation Trainer selects the type of inter...

The paper presents the evolution of Presentation Trainer, a prototypical sensor-based toolkit that works as a public speaking instructor. It tracks the learner’s body posture, movements and voice in order to provide instructional feedback on nonverbal communication skills. Based on our design-based research the current version of the Presentation T...

The increasing accessibility of sensors has made it possible to create instructional tools able to present immediate feedback to their users. In order to study how this type of instruction can have an effect on learning, we created the Presentation Trainer: a prototype designed to help users to develop their nonverbal communication skills for publi...

In recent years sensor components have been extending classical computer-based support systems in a variety of applications domains (sports, health, etc.). In this article we review the use of sensors for the application domain of learning. For that we analyzed 82 sensor-based prototypes exploring their learning support. To study this learning supp...

This paper discußes the design and development of the instructional aspects of a multimodal dialogue system to train youth parliament members' presentation and debating skills. Real-time, in-action feedback informs learners on the fly how they perform key skills and enables them to adapt instantly. About-action feedback informs learners after finis...

The increasing accessibility of sensors has made it possible to create instructional tools able to present immediate feedback to the learners. To study how this type of instruction is able to support learning, we developed the Presentation Trainer, a tool whose purpose is to train the non-verbal communication skills for public presentations. In thi...

The paper presents and outlines the demonstration of Presentation Trainer, a prototype that works as a public speaking instructor. It tracks and analyses the body posture, movements and voice of the user in order to give instructional feedback on non-verbal communication skills. Besides exploring the background of the feedback theory used by the pr...

This paper describes a comparative study between the usage of low-fidelity and a high-fidelity prototyping for the creation of multi-user multi-touch interfaces. The multi-touch interface presented in this paper allows users to collaboratively search for existing multimedia content, create new compositions with this content, and finally integrate i...

In educational settings, current digital technologies often work counter-productively because people using them with separation and isolation. This paper describes a set of multi-touch multimedia interaction applications that were especially designed to enhance collaboration between users. We present the underlying framework for creating such appli...

Multi-touch interaction techniques are becoming more widespread because of new industrial initiatives to make this hardware available and affordable for the consumer market. To cope with the diversity in hardware setups and the lack of knowledge about developing generic multi- touch applications, we created a framework, Eunomia, for abstracting the...