María Jesús Rodríguez-Triana

Universidad de Valladolid | UVA · Department of Informatics

Developing ethical reasoning as a competence is gaining relevance in higher education settings influenced by the current demands of society. One approach to achieve this competence is to propose realistic ethical dilemmas to the students. Nevertheless, educators need help in integrating ethics education effectively in higher education due to curric...

With technological advances, institutional stakeholders are considering evidence-based developments such as Curriculum Analytics (CA) to reflect on curriculum and its impact on student learning, dropouts, program quality, and overall educational effectiveness. However, little is known about the CA state of the art in Higher Education Institutions (...

Multimodal learning analytics (MMLA) research has shown the feasibility of building automated models of collaboration quality using artificial intelligence (AI) techniques (e.g., supervised machine learning (ML)), thus enabling the development of monitoring and guiding tools for computer-supported collaborative learning (CSCL). However, the practic...

The recent advances in educational technology enabled the development of solutions that collect and analyse data from learning scenarios to inform the decision-making processes. Research fields like Learning Analytics (LA) and Artificial Intelligence (AI) aim at supporting teaching and learning by using such solutions. However, their adoption in au...

Driven by the rising popularity of chatbots such as ChatGPT, there is a budding line of research proposing guidelines for chatbot design, both in general and specifically for digital education. Nevertheless, few researchers have focused on providing conceptual tools to frame the chatbot design process itself. In this paper, we present a model to gu...

The Multimodal Learning Analytics (MMLA) research community has significantly grown in the past few years. Researchers in this field have harnessed diverse data collection devices such as eye-trackers, motion sensors, and microphones to capture rich mul-timodal data about learning. This data, when analyzed, has been proven highly valuable for under...

Multimodal learning analytics (MMLA) research has made significant progress in modelling collaboration quality for the purpose of understanding collaboration behaviour and building automated collaboration estimation models. Deploying these automated models in authentic classroom scenarios, however, remains a challenge. This paper presents findings...

Recent advances in machine learning and natural language processing have the potential to transform human activity in many domains. The field of learning analytics has applied these techniques successfully to many areas of education but has not been able to permeate others, such as doctoral education. Indeed, doctoral education remains an under-res...

Driven by the rising popularity of chatbots such as ChatGPT, there is a budding line of research proposing guidelines for chatbot design, both in general and specifically for digital education. Nevertheless, few researchers have focused on providing conceptual tools to frame the chatbot design process itself. In this paper, we present a model to gu...

Multimodal Learning Analytics researchers have explored relationships between collaboration quality and multimodal data. However, the current state-of-art research works have scarcely investigated authentic settings and seldom used video data that can offer rich behavioral information. In this paper, we present our findings on potential indicators...

Despite the momentum that Artificial Intelligence (AI) is gaining in education, its role and impact on teachers’ learning design practices are still underexplored. This paper reports an experimental study (N = 38) taking place in a teacher training where an AI-driven feedback system aided teachers in the creation of learning designs. The study anal...

Doctoral education suffers from widespread dropout and well-being problems, for which we have not yet found scalable and generalizable interventions. This paper characterizes these problems as amenable to technology-enhanced learning (TEL) intervention and derives design knowledge for such solutions. We conducted two iterations of design-based rese...

Multimodal Learning Analytics researchers have explored relationships between collaboration quality and multimodal data. However , the current state-of-art research works have scarcely investigated authentic settings and seldom used video data that can offer rich be-havioral information. In this paper, we present our findings on potential indicator...

Multimodal Learning Analytics (MMLA) solutions aim to provide a more holistic picture of a learning situation by processing multimodal educational data. Considering contextual information of a learning situation is known to help in providing more relevant outputs to educational stakeholders. However, most of the MMLA solutions are still in prototyp...

Multimodal Learning Analytics (MMLA) has enabled researchers to address learning in physical settings which have long been either overlooked or studied using observational methods. With the use of sensors, researchers have been able to understand learning through an entirely new perspective (e.g., analyzing heart-rate variability to find collaborat...

Multimodal Learning Analytics (MMLA) has been progressively used to develop tools that can capture group activities and support teachers during collaborative learning with monitoring in the classroom. However, the development of tools that can also guide teachers with intervention strategies is still an under-explored area of research in MMLA. In t...

The use of peer code review exercises is well established in software engineering education. Nevertheless, challenges involving students’ ability to perform code reviews have been identified as barriers to successfully integrating code reviews in educational settings. We have previously proposed code review notebooks as a way to address this issue....

Multimodal Learning Analytics (MMLA) has been applied to collaborative learning, often to estimate collaboration quality with the use of multimodal data, which often have uneven time scales. The difference in time scales is handled by dividing and aggregating data using a fixed-size time window. The current MMLA research lacks the systematic explor...

Multimodal learning analytics (MMLA) research for building collaboration quality estimation models has shown significant progress. However, the generalizability of such models is seldom addressed. In this paper, we address this gap by systematically evaluating the across-context generalizability of collaboration quality models developed using a typ...

Recent advances in machine learning and natural language processing have the potential to transform human activity in many domains. The field of learning analytics has applied these techniques successfully to many areas of education but has not been able to permeate others, such as doctoral education. Indeed, doctoral education remains an under-res...

Data-informed decision making in teachers’ practice, now recommended by different teacher inquiry models and policy documents, implies deep practice change for many teachers. However, not much is known how teachers perceive the different steps that analytics-informed teacher inquiry into their own practice entails. This paper presents the results o...

Although the number of students in higher education institutions (HEIs) has increased over the past two decades, it is far from assured that all students will gain an academic degree. To that end, institutional analytics (IA) can offer insights to support strategic planning with the aim of reducing dropout and therefore of minimizing its negative i...

This research was triggered by the identified need in literature for large-scale studies about the kinds of designs that teachers create for mobile learning (m-learning). These studies require analyses of large datasets of learning designs. The common approach followed by researchers when analyzing designs has been to manually classify them followi...

High rates of dropout and mental health problems in doctoral education hint that social and emotional learning (SEL) support could help doctoral students face the challenges of such an arduous, lengthy, and unstructured learning experience. The uniqueness of each individual student, doctoral process and contextual influences, makes it hard for rese...

Peer code review has proven to be a valuable tool in software engineering. However, integrating code reviews into educational contexts is particularly challenging due to the complexity of both the process and popular code review tools. We propose to address this challenge by designing a code review application (CRA) aimed at teaching the code revie...

The understanding of collaboration quality is crucial for teachers to become aware of the activities going on in the groups and also for identifying groups in need to offer support in CSCL (Computer-Supported Collaborative Learning). Multimodal data captured during CSCL activity in the classroom can facilitate a holistic understanding of collaborat...

When MultiModal Learning Analytics (MMLA) are applied in authentic educational scenarios, multiple stakeholders (such as teachers, researchers and developers) often communicate to specify the requirements of the envisioned MMLA solution. Later on, developers instantiate the software solution for the MMLA data processing needed, as per the stakehold...

To build a culture of integrity in a HE institution, innovative approaches are needed to enhance education of research ethics and integrity (REI). In addition to educating students, understanding is needed on how to facilitate for those who lead others. The focus is on early-career researchers (ECRs) as future REI leaders. The current study sheds l...

Background In the field of Learning Design, it is common that researchers analyse manually design artefacts created by practitioners, using pedagogically‐grounded approaches (e.g., Bloom's Taxonomy), both to understand and later to support practitioners' design practices. Automatizing these high‐level pedagogically‐grounded analyses would enable la...

While research ethics and developing respective competencies is gaining prominence in higher education institutions, there is limited knowledge about the learning process and scaffolding during such training. The global health crisis has made the need for facilitator-independent training materials with sufficient support even more pronounced. To un...

Over the past decade, the use of chatbots for educational purposes has gained considerable traction. A similar trend has been observed in social coding platforms, where automated agents support software developers with tasks such as performing code reviews. While incorporating code reviews and social coding platforms into software engineering educa...

Mobile learning (m-learning) tools foster seamless learning environments that create new possibilities for practitioners to design innovative learning activities, as well as for students to learn in contextualised settings. Nevertheless, m-learning also entails difficulties as for instance, the aforementioned stakeholders should consider learning t...

Resumen Este trabajo identifica cinco grandes retos que enfrentan los modelos emergentes de construcción y creación de conocimiento en contextos digitales: la democratización de la educación y la toma en consideración de las cuestiones relacionadas con la diversidad en un sentido amplio; el impacto de la pandemia de la COVID-19 y sus implicaciones...

Aim/Purpose: This paper explores an intervention approach (in the form of workshops) focusing on doctoral progress, to address the problems of low emotional well-being experienced by many doctoral candidates. Background: Doctoral education suffers from two severe overlapping problems: high dropout rates and widespread low emotional well-being (e.g....

To understand and support teachers' design practices, researchers in Learning Design manually analyse small sets of design artifacts produced by teachers. This demands substantial manual work and provides a narrow view of the community of teachers behind the designs. This paper compares the performance of different Supervised Machine Learning (SML)...

Research indicates that data-informed practice helps teachers change their teaching and promotes teacher professional development (TPD). Although educational data are often collected from digital spaces, in-action evidence from physical spaces is seldom gathered, providing an incomplete view of the classroom reality. Also, most learning analytics t...

Aim/Purpose. Doctoral education still suffers from two severe overlapping problems: high dropout rates and low emotional wellbeing experienced by many doctoral candidates (e.g., depression or anxiety symptoms). Yet, there are few interventional approaches specifically designed to address them in the doctoral student population.Background. Among str...

The usage of educational technologies does not necessarily imply the adoption of the pedagogical approaches they are designed to support. Existing works analysing learning design practices often focus on the usage metrics of the authoring platform, the authoring process or structural aspects of the designs themselves. While such usage metrics are u...

Orchestrating technology-enhanced learning is a difficult task, especially in demanding pedagogical approaches like inquiry-based learning (IBL). To foster effective teacher adoption, both the complexity of designing IBL activities and the uncertainty about the student learning path during enactment need to be addressed. Previous research suggests...

Despite the ubiquity of learning in workplace and professional settings, the learning analytics (LA) community has paid significant attention to such settings only recently. This may be due to the focus on researching formal learning, as workplace learning is often informal, hard to grasp and not unequivocally defined. This paper summarizes the sta...

As development of research ethics competencies is in the focus in higher education (HE) institutions, it is crucial to understand how to support the learning process during such training. While there is plenty of research on how to scaffold children’s learning of cognitive skills, there is limited knowledge on how to enhance collaborative case-base...

Multimodal Learning Analytics (MMLA) researchers are progressively employing machine learning (ML) techniques to develop predictive models to improve learning and teaching practices. These predictive models are often evaluated for their generalizability using methods from the ML domain, which do not take into account MMLA’s educational nature. Furt...

The use of Curriculum Analytics (CA) helps teachers, learners, as well as other institutional stakeholders to make evidence-based decisions at the program level to improve student success and reduce dropouts. This paper presents the first insights of a systematic literature review on Curriculum Analytics at Higher Education Institutions to determin...

Certain educational contexts like lifelong learning have been comparatively understudied, due to the uniqueness of such learning processes, which make it difficult to ascertain generalizable models or average intervention effects. The ability to collect large amounts of data from a single learner longitudinally, throughout their lifelong trajectory...

Designing and implementing online or digital learning material is a demanding task for teachers. This is even more the case when this material is used for more engaged forms of learning, such as inquiry learning. In this article, we give an informed account of Go-Lab, an ecosystem that supports teachers in creating Inquiry Learning Spaces (ILSs). T...

Promoted by the growing access to mobile devices and the emphasis on situated learning, location-based tools are being used increasingly in education. Multiple stakeholders could benefit from understanding the learning and teaching processes triggered by these tools, supported by data analytics. For instance, practitioners could use analytics to mo...

Social practices are well-known mediators in the adoption of educational innovations during professional learning, as postulated by the Knowledge Appropriation Model (KAM). However, understanding how teachers adopt new pedagogical approaches at scale is often difficult due to the lack of evidence available about their daily practices. In that sense...

Social practices are assumed to play an important role in the evolution of new teaching and learning methods. Teachers internalize knowledge developed in their communities through interactions with peers and experts while solving problems or co-creating materials. However, these social practices and their influence on teachers’ adoption of new peda...

The original version of the book was inadvertently published with wrong values in Table 2B and Figure 2 in Chapter 31. The values of emission probability were corrected in ‘Table 2B: Emission Probability’ and ‘Fig. 2. HMM Probabilities from Table 1 & 2’, by replacing the wrong values of emission probability with the appropriate ones to justify the...

The estimation of collaboration quality using manual observation and coding is a tedious and difficult task. Researchers have proposed the automation of this process by estimation into few categories (e.g., high vs. low collaboration). However, such categorical estimation lacks in depth and actionability, which can be critical for practitioners. We...

The smart classrooms of the future will use different software, devices and wearables as an integral part of the learning process. These educational applications generate a large amount of data from different sources. The area of Multimodal Learning Analytics (MMLA) explores the affordances of processing these heterogeneous data to understand and i...

With the wide availability of mobile devices and the growing interest in social media, numerous applications have emerged to support student engagement in the classroom. There is conflicting evidence, however, on whether the engagement benefits of such applications outweigh their potential cost as a source of disaffection. To investigate these issu...

Educational processes take place in physical and digital places. To analyse educational processes, Learning Analytics (LA) enable data collection from the digital learning context. At the same time, to gain more insights, the LA data can be complemented with the data coming from physical spaces enabling Multimodal Learning Analytics (MMLA). To inte...

Mobile and Ubiquitous Learning (m/u‐learning) are finding an increasing adoption in education. They are often distinguished by hybrid learning environments that encompass elements of formal and informal learning, in activities that happen in distributed settings (indoors and outdoors), across physical and virtual spaces. Despite their purported ben...

Multimodal Learning Analytics (MMLA) systems, understood as those that exploit multimodal evidence of learning to better model a learning situation, have not yet spread widely in educational practice. Their inherent technical complexity, and the lack of educational stakeholder involvement in their design, are among the hypothesized reasons for the...

Collaborative learning is a complex and multifaceted phenomenon which requires teachers to pay close attention to their students in order to understand the underlying learning process and to offer needed help. However, in authentic settings with multiple groups, it becomes extremely difficult for teachers to observe each group. This paper presents...

Analysis of learning interactions can happen for different purposes. As educational practices increasingly take place in hybrid settings, data from both spaces are needed. At the same time, to analyse and make sense of machine aggregated data afforded by Technology-Enhanced Learning (TEL) environments, contextual information is needed. We posit tha...

Collocated collaboration in blended settings involves the usage of technology in addition to face-to-face interactions among participants (Martinez-Maldonado et al., 2017), enabling interactions across physical and digital spaces. LA solutions often rely only on interactions captured in the digital space, offering a partial picture of the learning...

Educational processes take place in physical and digital places. To analyse educational processes, Learning Analytics (LA) enable data collection from the digital learning context. At the same time, to gain more insights, the LA data can be complemented with the data coming from physical spaces enabling Multimodal Learning Analytics (MMLA). To inte...

This book constitutes the proceedings of the 26th International Conference on Collaboration Technologies and Social Computing, CollabTech 2020. The conference was scheduled to take place in Tartu, Estonia, in September 2020. It was held virtually due to the COVID-19 pandemic. The 10 full and 5 work-in-progress papers presented in this volume were c...

The chapters: “Designing an Online Self-Assessment for Informed Study Decisions: The User Perspective”; “Living with Learning Difficulties: Two Case Studies Exploring the Relationship Between Emotion and Performance in Students With Learning Difficulties”; “Applying Instructional Design Principles on Augmented Reality Cards for Computer Science Edu...