Nikol Rummel’s research while affiliated with Ruhr University Bochum and other places

What is this page?


This page lists works of an author who doesn't have a ResearchGate profile or hasn't added the works to their profile yet. It is automatically generated from public (personal) data to further our legitimate goal of comprehensive and accurate scientific recordkeeping. If you are this author and want this page removed, please let us know.

Publications (279)


Figure 11.1 Simplified representation of evidence-centered design (adapted from Kubsch, Czinczel, et al. 2022).
Figure 11.2 Evidence-centered design of algorithmic models for the automated assessment of learning.
Figure 11.3 Overview of the steps in the procedure for the development of an automated assessment for existing curriculum materials.
Figure 11.4 Constructed response example task.
Figure 11.5 Learning progression of energy according to Neumann et al. (2013).

+2

Using Evidence-Centered Design to Develop an Automated System for Tracking Students' Physics Learning in a Digital Learning Environment
  • Chapter
  • Full-text available

November 2024

·

75 Reads

·

Adrian Grimm

·

·

[...]

·

Nikol Rummel
Download

Figure 1: Timeline of university courses focused on hardware security. Dots mark courses with only a single iteration; dashed lines signify unclear continuity of the course. Courses with a strong focus on HRE are highlighted.
Matrix of common course contents. The three courses with strong HRE focus are highlighted on the left.
Evaluation data presented for each course, using the data type (DT) taxonomy by Švábenský et al. [31]. Only courses with an accompanying publication are included.
An Evidence-Based Curriculum Initiative for Hardware Reverse Engineering Education

November 2024

·

8 Reads

The increasing importance of supply chain security for digital devices -- from consumer electronics to critical infrastructure -- has created a high demand for skilled cybersecurity experts. These experts use Hardware Reverse Engineering (HRE) as a crucial technique to ensure trust in digital semiconductors. Recently, the US and EU have provided substantial funding to educate this cybersecurity-ready semiconductor workforce, but success depends on the widespread availability of academic training programs. In this paper, we investigate the current state of education in hardware security and HRE to identify efficient approaches for establishing effective HRE training programs. Through a systematic literature review, we uncover 13 relevant courses, including eight with accompanying academic publications. We identify common topics, threat models, key pedagogical features, and course evaluation methods. We find that most hardware security courses do not prioritize HRE, making HRE training scarce. While the predominant course structure of lectures paired with hands-on projects appears to be largely effective, we observe a lack of standardized evaluation methods and limited reliability of student self-assessment surveys. Our results suggest several possible improvements to HRE education and offer recommendations for developing new training courses. We advocate for the integration of HRE education into curriculum guidelines to meet the growing societal and industry demand for HRE experts.


Screenshot of the 360° video ‘Was wollten Sie in Berlin?’ [‘What did you want in Berlin?!’].
Screenshot of the 360°‐video ‘Du bist nichts wert!’ [‘You are worth nothing!’].
Extract from the checklist as implemented in the ind training+ condition.
Improving students' processing of history‐related 360° videos through collaboration and emotion regulation

October 2024

·

51 Reads

Journal of Computer Assisted Learning

Background With the increasing availability of immersive technologies such as 360° videos for educational purposes, research needs to shift from media comparison studies to value‐added studies in order to identify conditions for effective learning with such technologies. For the educational use of history‐related virtual reality media, which are characterized by immersion and emotionalization, instructional approaches that promote cognitive and critical rather than emotional processing of the content are required. Objectives Drawing on research on self‐regulated learning, emotion regulation, and collaborative learning, the present value‐added study examines whether (1) strategy training in cognitive and emotion regulation strategies and (2) collaboration can enhance students' cognitive processing of history‐related 360° videos. Methods In a quasi‐experimental study with school students (N = 157), we compared the effects of training addressing cognitive and emotion regulation strategies with training focusing on cognitive strategies alone. Before and during each of the two types of training, students were asked to either collaboratively or individually analyse a history‐related 360° video. Results and Conclusions Training in cognitive strategies alone promotes cognitive processing of 360° videos, while combined training leads to more emotional processing. Collaboration helps students to analyse a history‐related 360° video in a cognitive and reflective way before training and to acquire the cognitive strategies during the training. After training, however, students who had previously collaborated processed the video more emotionally than students who had previously worked alone. This study highlights the importance of tailored instructional approaches to maximize the educational potential of immersive technologies in history education.





Comparing the effects of a collaboration script and collaborative reflection on promoting knowledge about good collaboration and effective interaction

August 2024

·

166 Reads

·

2 Citations

International Journal of Computer-Supported Collaborative Learning

A key challenge in CSCL research is to find ways to support learners in becoming effective collaborators. While the effectiveness of external collaboration scripts is well established, there is a need for research into support that acknowledges learners’ autonomy during collaboration. In the present study, we compare an external collaboration script and a reflection scaffold to a control condition and examine their effects on learners’ knowledge about effective collaboration and on their groups’ interaction quality. In an experimental study that employed a 1× three-factorial design, 150 university students collaborated in groups of three to solve two information pooling problems. These groups either received an external collaboration script during collaboration, no support during collaboration but a reflection scaffold before beginning to collaborate on the second problem, or no support for their collaboration. Multilevel modeling suggests that learners in the reflection condition gained more knowledge about effective collaboration than learners who collaborated guided by an external collaboration script or learners who did not receive any support. However, we found no effect of the script or the reflection scaffold on the quality of interaction in the subsequent collaboration. Explorative analyses suggest that learners acquired knowledge particularly about those interactions that are required for solving information pooling tasks (e.g., sharing information). We discuss our findings by contrasting the design of the external collaboration script and the reflection scaffold to identify potential mechanisms behind scripting and collaborative reflection and to what extent these forms of support foster collaboration skills and engagement in productive interaction.


Fig. 2 Two-dimensional illustration of the authenticity dilemma
Fig. 3 Reconceptualizing the authenticity dilemma through thick authenticity
The authenticity dilemma: towards a theory on the conditions and effects of authentic learning

August 2024

·

119 Reads

·

2 Citations

European Journal of Psychology of Education

A highly authentic learning setting is likely to trigger positive motivational and emotional reactions due to its emphasis on promoting the acquisition of knowledge that is connected and transferable to real-world phenomena outside the learning environment. However, a high level of authenticity is usually accompanied by a high level of complexity due to the complexity inherent in the real world. This complexity can be overwhelming for learners and can hamper or even prevent cognitive learning outcomes. Consequently, to help learners cope with this complexity, they need some kind of instructional support. By building a high level of support into the learning setting in order to promote cognitive learning outcomes, the level of authenticity and thereby the effects of authenticity on motivational outcomes may, however, in turn be reduced. In the present conceptual paper, we refer to this tension between authenticity and complexity, on the one hand, and instructional support, on the other hand, as the “authenticity dilemma”. Based on existing empirical evidence from previous studies, we (1) outline this dilemma, (2) discuss ways to reconceptualize it, and (3) derive implications regarding the conditions and effects of authentic learning. Finally, we discuss the findings of the studies included in the special issue “Perspectives on Authentic Learning” through the lens of the authenticity dilemma.


Following the Impact Chain of the LA Cockpit: An Intervention Study Investigating a Teacher Dashboard's Effect on Student Learning

July 2024

·

134 Reads

·

1 Citation

Journal of Learning Analytics

This paper presents a teacher dashboard intervention study in secondary school practice involving teachers (n = 16) with their classes (n = 22) and students (n = 403). A quasi-experimental treatment-control group design was implemented to compare student learning outcomes between classrooms where teachers did not have access to the dashboard and classrooms where teachers had access to the dashboard. We examined different points in the impact chain of the “LA Cockpit,” a teacher dashboard with a feedback system through which teachers can send feedback to their students on student learning. To investigate this impact chain from teacher use of dashboards to student learning, we analyzed 1) teachers’ perceived technology acceptance of the LA Cockpit, 2) teacher feedback practices using the LA Cockpit, and 3) student knowledge gains as measured by pre- and post-tests. The analysis of n = 355 feedback messages sent by teachers through the LA Cockpit revealed that the dashboard assists teachers in identifying students facing difficulties and that teachers mostly provided process feedback, which is known to be effective for student learning. For student learning, significantly higher knowledge gains were found in the teacher dashboard condition compared to the control condition.



Citations (61)


... For instance, the mathematical scientist Pólya (1957, p. vii) described "mathematics in the making […] as an experimental, inductive science". However, teachers often do not associate learning mathematics with experimental approaches (see, e.g., Geisler & Beumann, 2020) and hands-on experimentation is often rarely implemented in mathematics classes (e.g., Hagenkötter et al., 2024). Hence, students probably have no or only few experience, and thus, providing them with first authentic insights into mathematical hands-on experimentation by letting them observe corresponding video modeling examples seems to be a particularly promising and not too cognitively demanding way. ...

Reference:

Model authenticity in learning mathematical experimentation: how students perceive and learn from scientist and peer models
Typische mathematische Tätigkeiten beim realen mathematischen Experimentieren aus Sicht von Schüler*innen und Lehrer*innen
  • Citing Chapter
  • January 2024

... Malatesta et al. (2024) similarly found that an educational escape room enhances students' active participation in learning and effectively improves peer collaboration to complete tasks. The results of this study align with prior research showing that collaborative learning facilitates knowledge sharing, negotiation, and coordinated interaction (Strauß et al., 2024). ...

Comparing the effects of a collaboration script and collaborative reflection on promoting knowledge about good collaboration and effective interaction

International Journal of Computer-Supported Collaborative Learning

... For example, research could explore how this study's interpretation and operationalisation of an ill-defined activity contributed to the outcomes. Moreover, our findings should be examined in light of the recently conceptualised authenticity dilemma, which highlights the interplay between levels of authenticity and complexity, the guidance and structure provided, and how these factors influence the cognitive and motivational effects of the activity (Nachtigall et al., 2024). Meanwhile, there is accumulating evidence indicating that the Phenom SEM device serves as an excellent tool for providing science students and teachers with authentic scientific experiences. ...

The authenticity dilemma: towards a theory on the conditions and effects of authentic learning

European Journal of Psychology of Education

... The legal and ethical obligations for implementing a field study in schools have been met. The data of the present study were collected in a larger intervention study reported in [10]. The sample consisted of 225 students from 7th and 8th grade physics classrooms, which were taught by 7 teachers who had access to a teacher dashboard throughout the instructional units and could use it to send feedback messages. ...

Following the Impact Chain of the LA Cockpit: An Intervention Study Investigating a Teacher Dashboard's Effect on Student Learning

Journal of Learning Analytics

... DBR was selected as the most appropriate methodology for this study due to its iterative, flexible, and pragmatic nature, which is well-suited to address the complexities of MOOC learning environments and the need for actionable insights (Anderson & Shattuck, 2012;Teich et al., 2024). DBR facilitates continuous improvement of learning experience design through successive cycles of design, implementation, analysis, and redesign (McKenney & Reeves, 2013). ...

User-Centered Design of Adaptive Support in a Continuing Education Online Course: Findings from a Design-Based Research Process
  • Citing Chapter
  • June 2024

... In order to systematically investigate the underlying mechanisms in PS-I learning scenarios, it is necessary to consider three perspectives: (1) the instruction design, (2) the learning processes, and (3) the knowledge components (Koedinger et al. 2012; specified for PS-I in Loibl et al. 2024). With regard to the instructional design (perspective 1), there is already substantial evidence for the effective use of incorrect and correct solutions to foster learning. ...

CID: a framework for the cognitive analysis of composite instructional designs

Instructional Science

... Most of the papers investigate the effectiveness of authentic learning settings that intend to emulate the work of professionals. These studies either investigate learning in out-of-school labs (Hagenkötter et al., 2024;Hohrath et al. 2024;Nachtigall & Firstein, 2023) or learning with simulations (Bichler et al. 2024, Corves & M. Fischer, 2024Stürmer et al. 2024). Out-of-school labs are non-formal learning settings that are usually visited by whole classes for a one-day project. ...

Model authenticity in learning mathematical experimentation: how students perceive and learn from scientist and peer models

European Journal of Psychology of Education

... Our error analysis suggests that missing contextual information (e.g., problem statements, hints, and feedback messages) containing domain and platform-specific language limits model transfer across subject areas and platforms. This result aligns with recent research that identifies limitations in classifying tutorial dialogue independent of its problem-solving context [11]. Future work could evaluate model transfer of SRL prediction tasks when incorporating instructional context. ...

Combining Dialog Acts and Skill Modeling: What Chat Interactions Enhance Learning Rates During AI-Supported Peer Tutoring?

... However, in line with our expectations with regard to RQ1-RQ3, we expect to find positive effects of collaboration prior to (RQ4) and during the training (RQ5) as well as a positive effect of the combined training under instructional conditions (RQ6). It should be noted that preliminary analyses related to the fourth research question have been previously published in conference proceedings(Nachtigall et al., 2023). ...

The Impact of Collaboration on Students' Processing of History-Related 360°-Videos
  • Citing Conference Paper
  • October 2023

... Holstein et al. (2018) konnten zeigen, dass learning-analytics-basierte KI-Tools die Echtzeitwahrnehmung von Lehrkräften unterstützen können und sich als so wirksame Instruktionsunterstützung erweisen, dass sich positive Effekte auf das Lernen von Schülerinnen und Schüler zeigen. Karumbaiah et al. (2023b) konnten dementsprechend das Teacher-Noticing-Framework für KI-unterstützte Lehr-Lernsettings ( van Es und Sherin 2021), das den Prozess der Wahrnehmung, Interpretation und dem Heranziehen zusätzlicher Informationen einer problematischen Lernsituation durch eine Lehrkraft bis hin zu deren Intervention beschreibt, adäquat operationalisieren und weiter ausdifferenzieren. Sie fanden beispielsweise, dass Lehrkräfte durch den tieferen Einblick in das Lerngeschehen mit mixed reality glasses, gezielter ihre Aufmerksamkeit den Lernenden mit dem aktuell größten Unterstützungsbedarf widmen konnten (Karumbaiah et al. 2023a). ...

Teacher Noticing and Student Learning in Human-AI Partnered Classrooms: A Multimodal Analysis
  • Citing Conference Paper
  • October 2023