Sergio Gutierrez-Santos

Sergio Gutierrez-Santos
Birkbeck, University of London · Department of Computer Science and Information Systems

About

87
Publications
11,055
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
1,010
Citations

Publications

Publications (87)
Article
Full-text available
While it is commonly accepted that Learning Analytics (LA) tools can support teachers' awareness and classroom orchestration, not all forms of pedagogy are congruent to the types of data generated by digital technologies or the algorithms used to analyse them. One such pedagogy that has been so far underserved by LA is exploratory learning, exempli...
Conference Paper
Full-text available
This paper describes how graph-based modelling can be used to explore interactions associated with a change in students' affective state when they are working with an exploratory learning environment (ELE). We report on a user study with an ELE that is able to detect students' affective states from their interactions and speech. The data collected...
Article
Full-text available
The paper is available at http://rdcu.be/GqPq This paper describes the design and ecologically valid evaluation of a learner model that lies at the heart of an intelligent learning environment called iTalk2Learn. A core objective of the learner model is to adapt formative feedback based on students' affective states. Types of adaptation include w...
Conference Paper
Full-text available
This paper describes the development and evaluation of an affect-aware intelligent support component that is part of a learning environment known as iTalk2Learn. The intelligent support component is able to tailor feedback according to a student's affective state, which is deduced both from speech and interaction. The affect prediction is used to d...
Chapter
This paper describes the development and evaluation of an affect-aware intelligent support component that is part of a learning environment known as iTalk2Learn. The intelligent support component is able to tailor feedback according to a student's affective state, which is deduced both from speech and interaction. The affect prediction is used to d...
Conference Paper
We present and evaluate a web-based architecture for monitoring student-system interaction indicators in Exploratory Learning Environments (ELEs),using as our case study a microworld for secondary school algebra. We discuss the challenging role of teachers in exploratory learning settings and motivate the need for visualisation and notification too...
Chapter
We present and evaluate a web-based architecture for monitoring student-system interaction indicators in Exploratory Learning Environments (ELEs), using as our case study a microworld for secondary school algebra. We discuss the challenging role of teachers in exploratory learning settings and motivate the need for visualisation and notification to...
Conference Paper
We present our approach to designing and evaluating tools that can assist teachers in classroom settings where students are using Exploratory Learning Environments (ELEs), using as our case study the MiGen system, which targets 11-14 year old students' learning of algebra. We discuss the challenging role of teachers in exploratory learning settings...
Article
This paper describes a computer-based tool that helps teachers group their students for collaborative activities in the context of secondary school math teaching, the challenge being to organize groups of students based on their recent work, so that their collaboration results in meaningful interactions. The complexity of the exploratory learning t...
Article
This paper describes a computer-based tool that helps teachers group their students for collaborative activities in the classroom, the challenge being to organise groups of students based on their recent work so that their collaboration results in meaningful interactions. Students first work on an exploratory task individually, and then the compute...
Conference Paper
Full-text available
It is widely acknowledged that many children have difficulty learning fractions. Accordingly, we are developing the iTalk2Learn system (www.italk2learn.eu), which aims to facilitate the robust learning of fractions by children in primary and early secondary education. The iTalk2Learn system integrates structured, practice-based tasks with explorato...
Conference Paper
Full-text available
We describe a Wizard-of-Oz study that investigates the impact of different types of feedback on students' affective states. Our results indicate the importance of matching carefully the affective state with appropriate feedback in order to help students transition into more positive states. For example when students were confused affect boosts and...
Conference Paper
Full-text available
Affective states play a significant role in students' learning behaviour. Positive affective states can enhance learning, while negative ones can inhibit it. This paper describes the development of an affective state reasoner that is able to adapt the feedback type according to students' affective states in order to evoke positive affective states...
Article
Students' interaction data from learning environments has an inherent temporal dimension, with successive events being related through the"next event"relationship. Exploratory learning environments (ELEs), in particular, can generate very large volumes of such data, making their interpretation a challenging task. Using two mathematical microworlds...
Conference Paper
Log files from adaptive Exploratory Learning Environments can contain prohibitively large quantities of data for visualisation and analysis. Moreover, it is hard to know in advance what data is required for analytical purposes. Using a microworld for secondary algebra as a case study, we discuss how students' interaction data can be transformed int...
Chapter
Log files from adaptive Exploratory Learning Environments can contain prohibitively large quantities of data for visualisation and analysis. Moreover, it is hard to know in advance what data is required for analytical purposes. Using a microworld for secondary algebra as a case study, we discuss how students' interaction data can be transform...
Conference Paper
Full-text available
Affective states play a significant role in students’ learning behaviour. Positive affective states can enhance learning, whilst negative affective states can inhibit it. This paper describes a Wizard-of-Oz study which investigates whether the way feedback is presented should change according to the affective state of a student, in order to encoura...
Article
Full-text available
Affective states play a significant role in students' learning behaviour. Positive affective states can enhance learning, while negative affective states can inhibit it. This paper describes a Wizard-of-Oz study that investigates the impact of different types of feedback on students' affective states. Our results indicate the importance of providin...
Chapter
Affective states play a significant role in students’ learning behaviour. Positive affective states can enhance learning, while negative ones can inhibit it. This paper describes the development of an affective state reasoner that is able to adapt the feedback type according to students’ affective states in order to evoke positive affective states...
Chapter
We describe a Wizard-of-Oz study that investigates the impact of different types of feedback on students’ affective states. Our results indicate the importance of matching carefully the affective state with appropriate feedback in order to help students transition into more positive states. For example when students were confused affect boosts and...
Conference Paper
The ‘FLIP Learning’ (Flexible, Intelligent and Personalised Learning) is an Exploratory Learning Environment (ELE) for teaching elementary programming to beginners using JavaScript. This paper presents the subsystem that is used to generate individualised real-time support to students depending on their initial misconceptions. The subsystem is inte...
Conference Paper
Full-text available
The work described in this paper investigates the potential of Automatic Speech Recognition (ASR) to support young children’s exploration and reflection as they are working with interactive learning environments. We describe a unique ecologically valid Wizard-of-Oz (WoZ) study in a classroom equipped with computers, two of which were set up to allo...
Conference Paper
Affect plays a significant role in students’ learning behaviour. Positive affective states can enhance learning, while negative ones can inhibit it. This paper describes how we provide intelligent support in a learning platform based on affect states. We discuss two components: an affective state detector to perceive affective states in speech duri...
Article
Learning programming is an inherently exploratory activity. Supporting this process is not a trivial task and requires resources. This paper proposes the utilisation of an intelligent Exploratory Learning Environment to enhance teaching and learning in this context with minimal cost.
Article
The 'FLIP Learning' (Flexible, Intelligent and Personalised Learning) is an Exploratory Learning Environment (ELE) for teaching elementary programming to beginners using JavaScript. This paper presents the subsystem that is used to generate individualised real-time support to students depending on their initial misconceptions. The subsystem is inte...
Conference Paper
This paper presents a tool that has been developed to support teaching of computer programming in practical laboratory sessions. The tool has been implemented as a plugin for the Eclipse IDE and can be deployed in a distributed manner to provide real-time monitoring of the students' activity.
Conference Paper
The work described in this paper investigates the potential of Automatic Speech Recognition (ASR) to support young children’s exploration and reflection as they are working with interactive learning environments. We describe a unique ecologically valid Wizard-of-Oz (WoZ) study in a classroom equipped with computers, two of which were set up to allo...
Conference Paper
Emotions play a significant role in students’ learning behaviour. Positive emotions can enhance learning, whilst negative emotions can inhibit it. This paper describes a Wizard-of-Oz (WoZ) study which investigates the potential of Automatic Speech Recognition (ASR) together with an emotion detector able to classify emotions from speech to support y...
Article
The 'FLIP Learning' (Flexible, Intelligent and Personalised Learning) is an Exploratory Learning Environment (ELE) for teaching elementary programming to beginners using JavaScript. This paper presents a sub-system in FLIP that can be used to generate individualised real-time support to students depending on their initial misconceptions. The sub-sy...
Article
Full-text available
The new forms of interaction afforded by innovative technology and open-ended environments provide promising opportunities for exploratory learning. Exploratory environments, however, require appropriate support to lead to meaningful learning outcomes. This paper focuses on the design and validation of intelligent exploratory environments. The goal...
Article
Full-text available
The MiGen project is designing and developing an intelligent exploratory environment to support 11-14-year-old students in their learning of algebraic generalization. Deployed within the classroom, the system also provides tools to assist teachers in monitoring students' activities and progress. This paper describes the design of these Teacher Assi...
Article
This paper charts the design and application of a system to support 11–14 year old students’ learning of algebraic generalisation, presenting students with the means to develop their understanding of the meaning of generality, see its power for mathematics and develop algebraic ways of thinking. We focus squarely on design, while taking account of...
Article
Full-text available
Exploratory learning environments (ELEs) can have a positive effect on learning as long as they have proper support. However, the difficulty of supporting exploration and unstructured interaction means that there are few systems with intelligent computer-based support. The paper presents a divide-and-conquer strategy to approach the difficult tasks...
Chapter
Full-text available
Exploratory Learning Environments allow learners to use different strategies for solving the same problem. However, not all possible strategies are known in advance to the designer or teacher and, even if they were, considerable time and effort would be required to introduce them in the knowledge base. We have previously proposed a learner modellin...
Article
Full-text available
Similar to other exploratory learning activities, ensuring that students' interactions with a mathematical microworld are effective requires a significant pedagogic support. This paper presents the design of the intelligent support func-tionalities of a mathematical microworld: eXpresser, that supports 11–14 year old students to develop algebraic w...
Article
Educational technologies have experienced an impressive change in recent years. This, in turn, is having a clear impact on educational practices and processes. Two important consequences for lifelong learning experts are the new possibilities of reusing learning material from different sources, and the need of adapting learning resources to differe...
Article
Full-text available
The design of learner modelling components for Exploratory Learning Environments (ELEs) presents a significant challenge, partic-ularly when pertaining to ill-defined tasks and knowledge domain. We argue that representing a learner's knowledge just in relation to concepts is not adequate in such cases. We focus particularly on microworlds and prese...
Conference Paper
Ensuring that students’ interactions with Exploratory Learning Environments are effective in terms of learning requires a significant pedagogic support from teachers. The challenge therefore is to develop intelligent systems which would be entrusted to support either the student directly when appropriate, or provide information to teachers, assisti...
Conference Paper
Full-text available
Detecting and automating repetitive patterns in users’ actions has several applications. One of them, often overlooked, is supporting learning. This paper presents an approach for detecting repetitive actions in students who are interacting with an exploratory environment for mathematical generalisation. The approach is based on the use of two slid...
Conference Paper
Full-text available
In exploratory learning environments, learners can use different strategies to solve a problem. To the designer or teacher, however, not all these strategies are known in advance and, even if they were, introducing them in the knowledge base would involve considerable time and effort. In previous work, we have proposed a case-based knowledge repres...
Conference Paper
Full-text available
This paper focuses on microworlds, a special type of Exploratory Learning Environment, where students freely interact with the system to create their own models and constructions. Most microworlds developed so far provide integrated scaffolds to help students’ learning process, but the nature of the interaction makes it difficult to design, develop...
Conference Paper
Full-text available
This paper presents a case-based reasoning (CBR) approach to provide adaptive support in microworlds. Interaction in microworlds is complex and unstructured, making the analysis of student behaviour difficult and the provision of computer-based feedback challenging. Our approach starts with the ellicitation of expected solutions to microworld tasks...
Article
This paper presents a methodology for the design of intelligent learning environments. We recognise that in the educational technology field, theory development and system-design should be integrated and rely on an iterative process that addresses: (a) the difficulty to elicit precise, concise, and operationalised knowledge from ‘experts’ and (b) t...
Article
One of the difficulties that self-directed learners face on their learning process is choosing the right learning resources. One of the goals of adaptive educational systems is helping students in finding the best set of learning resources for them. Adaptive systems try to infer the students’ characteristics and store them in a user model whose info...
Conference Paper
Exploratory Learning Environments (ELE) are virtual environments that adhere to constructivist theories of learning emphasizing learner control. However, research suggests that lack of sufficient explicit support may undermine their effectiveness. Advanced technologies provide opportunities to supply learners with the right information at the right...
Article
In the complex world of e-learning, there are many aspects to consider: administrative issues (e.g. keeping track of the courses of a student), technical issues (e.g. packaging learning content in a platform-independent way), and academic issues. This chapter concentrates on one of the latter, namely the problem of adaptive sequencing. This problem...
Conference Paper
Full-text available
Exploratory learning allows learners to solve a problem using different strategies. However, only a limited number of these strategies is known in advance and can be introduced by the designer and/or teacher. In previous work we have proposed a case-based knowledge representation, modelling the learner behaviour as simple cases and collection of ca...
Conference Paper
This paper presents a system that connects students with complementary profiles, so they can interchange knowledge and help each other. The profile of the students is built by a modified intelligent tutoring system. Every time the user profile is updated, a gateway updates the profile stored in the user’s personal terminal using a web-service based...
Article
Full-text available
In the last years, there is a rising interest in exploratory learning environments, due to their positive effects on learning. However, their lack of structure makes the provision of intelligent support and feedback a very challenging problem. This workshop tries to shed some light on several of the aspects of this complicated issue. This preface m...
Article
In this paper, we seek to broaden the sense in which the word ‘dynamic’ is applied to computational media. Focussing exclusively on the problem of design, the paper describes work in progress, which aims to build a computational system that supports students’ engagement with mathematical generalisation in a collaborative classroom environment by he...
Conference Paper
Book synopsis: This publication covers papers presented at the Artificial Intelligence in Education conference 2009 (AIED). AIED2009 is part of an ongoing series of biennial international conferences for top quality research in intelligent systems and cognitive science for educational computing applications. The conference provides opportunities fo...
Conference Paper
This paper presents a method for the design of intelligent support for Technology Enhanced Learning (TEL) systems. In particular it deals with challenges that arise from the need to elicit precise, concise, and operationalised knowledge from ‘experts’ as a means of informing the design of intelligent components of TEL systems. We emphasise that the...
Conference Paper
Book synopsis: Brand New Book. This publication covers papers presented at the Artificial Intelligence in Education conference 2009 (AIED). AIED2009 is part of an ongoing series of biennial international conferences for top quality research in intelligent systems and cognitive science for educational computing applications. The conference provides...
Article
In this paper, we seek to broaden the sense in which the word ‘dynamic’ is applied to computational media. Focusing exclusively on the problem of design, the paper describes work in progress, which aims to build a computational system that supports students’ engagement with mathematical generalisation in a collaborative classroom environment by hel...
Conference Paper
Full-text available
We present a brief description of the design of a diagram- based system that supports the development of thinking about mathe- matical generalisation. Within the software, the user constructs a depen- dency graph that explicitly shows the relationships between components of a task. Using this dependency graph, the user manipulates graphical visuali...
Conference Paper
Expressing generality, recognising and analysing patterns and articulating structure is a complex task and one that is invariably problematic for students. Nonetheless, very few systems exist that support learners explicitly in the process of mathematical generalisation. We have addressed this by developing a novel environment that supports users i...
Conference Paper
Full-text available
Exploratory learning environments give a lot of freedom to learners to explore a task on their own. Although this can have a positive effect on their learning, the lack of structure makes it difficult to provide intelligent support on these system. Besides, the open nature of these systems makes it harder to compare how support is provided in diffe...
Conference Paper
Full-text available
Although the notion of generality is central in mathematics and science, beingable to identify and express general patterns and/or articulate structures is one of the main difficulties for children when they learn mathematics. This paper presents a step towards a set of tools that addresses this problem by encouraging students to connect between ac...
Conference Paper
This paper presents an approach to create adaptive web-based educative systems that can be automatically audited by means of standard web testing tools. The auditing tool takes the role of a learner interacting with the system, checking that no errors are present. The tool can communicate with the exercises to know the correct answers to them; a co...
Chapter
This chapter provides an overview of the use of swarm-intelligence techniques in the field of e-learning. Swarm intelligence is an artificial intelligence technique inspired by the behavior of social insects. Taking into account that the Internet connects a high number of users with a negligible delay, some of those techniques can be combined with...
Article
Full-text available
This paper describes the process of translating an adaptive sequencing strategy designed using Sequencing Graphs to the semantics of IMS Learning Design. The relevance of this contribution is twofold. First, it combines the expressive power and flexibility of Sequencing Graphs, and the interoperability capabilities of IMS. Second, it shows some imp...
Conference Paper
Full-text available
A data mining and visualization tool for the discovery of student trails in web-based educational systems is presented and described. The tool uses graphs to visualize results, allowing non-expert users, such as course instructors, to interpret its output. Several experiments have been conducted, using real data collected from a web-based intellige...
Article
Full-text available
Few systems exist that support learners explicitly in the process of learning mathematical generalisation. This paper presents the eXpresser, part of a new system that seeks to address this issue by providing the user with a microworld for the construction and analysis of general patterns. The design includes the provision of sophisticated intellig...
Article
Full-text available
Few systems exist that support learners explicitly in the process of learning mathematical generalisation. This paper presents the eXpresser, part of a new system that seeks to address this issue by providing the user with a microworld for the construction and analysis of general patterns. After a brief description of its main features, we discuss...
Chapter
A swarm may be defined as a population of interacting elements that is able to optimize some global objective through collaborative search of a space (Kennedy, 2001). The elements may be very simple machines or very complex living beings, but there are two restrictions to be observed: They are limited to local interactions; usually the interaction...
Chapter
E-learning has evolved very rapidly in recent years, from a first stage in which a set of documents were simply made available to the students in an electronic platform, to current tools that integrate not only academic but also administrative aspects in educational institutions. Today, learning is possible virtually anywhere, anytime and new scena...
Article
Full-text available
The IMS Learning Design specification aims at capturing the complete learning flow of courses, without being restricted to a particular pedagogical model. Such flow description for a course, called a Unit of Learning, must be able to be reproduced in different systems using a so called run-time environment. In the last few years there has been seve...
Conference Paper
This paper describes a possible application of swarm intelligence techniques in e-learning: an auditing tool for pedagogical planning. Swarm intelligence techniques can be applied to a web system thanks to the fact that the available online material can be organized in a graph by means of hyperlinks. In this case, the swarm that moves on the graph...
Article
Web-based education (WBE) has seen in recent years a significant increase both in its functionality as well as possible scenarios. After a first stage in which these systems offered mainly content management and course management capabilities, systems now offer solutions that cover pedagogical aspects such as activity sequencing. This chapter prese...
Conference Paper
Full-text available
This paper describes an initiative aimed at adapting swarm intelligence techniques (in particular, Ant Colony Optimization) to an e-learning environment, thanks to the fact that the available online ma- terial can be organized in a graph by means of hyperlinks of educational topics. In this case, the agents that move on the graph are students who u...
Chapter
E-learning has evolved very rapidly in recent years, from a first stage in which a set of documents were simply made available to the students in an electronic platform, to current tools that integrate not only academic but also administrative aspects in educational institutions. Today, learning is possible virtually anywhere, anytime and new scena...
Conference Paper
In this document a platform for the development of ITSs is presented. The objective of this architecture is to provide a tutoring platform with a modular structure suitable to accommodate different sequencing paradigms through a common functional interface. The platform has been tested with positive results.
Conference Paper
One of the challenges of adaptive hypermedia educational (AHE) systems is that of adapting the sequencing of learning units presented to the student. One approach is to model the set of possible sequencings with a graph, but the process of designing and maintaining the graph may be tedious and error-prone. This paper presents some ideas to overcome...
Conference Paper
Full-text available
An adaptive tutoring system for an Operating System course is presented. The architecture, based on sequencing graphs, that supports an adaptive sequencing of the learning units is described. The content structure is presented as well. The system is now in use in regular university courses and results of this experience will be published in the fut...
Conference Paper
Full-text available
A web-based intelligent tutoring system with some swarm intelligence capabilities is presented. It is based on a for- mer one which led to good results in experiments with real students. Adaptation to the students, necessary for a more efective learning experience is achieved through two means: the use of sequencing graphs and swarm in- telligence...
Conference Paper
Full-text available
An adaptive tutoring system is presented based on hierarchical graphs that capture the sequencing of a set of learning objects depending on how students interact with them. The use of hierarchy allows the definition of complex transition structures over arbitrarily large sets of objects. Using this approach a tutoring tool has been designed and tes...
Article
Full-text available
One of the main challenges when developing Elearning systems is the capability to adapt the learning experience to different users. This adaptability requires a flexible scheme for sequencing the learning material to different students. Content sequencing has been recently included in standard- ization efforts such as SCORM or IMS, namely IMS Sim-...