Figure 3 - uploaded by Martin Ebner
Content may be subject to copyright.
Probabilities (error rates) of an operand intrusion error for each simple multiplication problem. Figures 3A and 3B show the error rates for the first operand A and the second operand B respectively. 

Probabilities (error rates) of an operand intrusion error for each simple multiplication problem. Figures 3A and 3B show the error rates for the first operand A and the second operand B respectively. 

Source publication
Conference Paper
Full-text available
Literature in the area of psychology and education provides domain knowledge to learning applications. This work detects the difficulty levels within a set of multiplication problems and analyses the dataset on different error types as described and determined in several pedagogical surveys and investigations. Our research sheds light to the impact...

Context in source publication

Context 1
... intrudes into the result. Figure 3 depicts the error rates for the first operand A and the second operand B respectively. In general the probability of an intrusion for the second operand B is higher than for the first operand A. While no specific pattern can be found within the set of simple multiplication problems, it can be observed that some operands reveal a higher probability relatively to other problems. For instance in case of the first operand intrusion, specially the operand A = 4 shows a probability over 10% while multiplied by difficult operands B ∈ {7,8, 9} . Interestingly A ∈ {4, 6, 7,8} are more often intruded to the results while multiplied by B = 9. In case of second operand intrusion, B = 6 reveals a probability of 12% while being multiplied by difficult operands A ∈ {7,8, 9} . It is followed by A ∈ {3, 4} multiplied by B = 8. In both cases, first operands A ∈ {6, 7,8, 9} play a stronger role in operand intrusion compared with other operands. Considering the decade and unit consistency errors, we could find no clear pattern in the multiplication table. The probability of error occurrence related to decade consistency is relatively higher than unit consistency. Decade consistency errors are specially more probable if both operands are greater than 5 and are unequal. The reason for this could be explained by the problem-size ...

Similar publications

Article
Full-text available
The research area related to the use of Learning Analytics and the prediction of student performance is multidimensional; therefore, it can be explored and analyzed through different perspectives. This research addresses the relationship between pedagogical interventions based on Learning Analytics and student learning performance. The research pro...
Article
Full-text available
Earlier studies have shown the power of online learning systems data to develop prediction methods that try to identify successful students patterns of accomplishment and engagement to allow timely pedagogical interventions. Our learning platform, SocialWire, collects a detailed record of the students' activity so, in this paper, we compare and com...
Article
Full-text available
Lay Description What is already known about this topic The term “Classroom Proxemics” refers to how teachers and students use the classroom space, and its impact on learning. A large number of teachers, particularly in higher education, receive no pedagogical training or feedback on classroom proxemics. Little is known about how to create interfac...

Citations

... Students' errors provide a unique window into the mind, as error responses may reflect the cognitive processes-such as applied strategies-activated during problem solving. This fundamental understanding has spawned decades of research, from classifications of errors (Ben-Zeev, 1998;Straatemeier, 2014), and cognitive models aimed at explaining errors (Braithwaite et al., 2017;Buwalda et al., 2016), to the diagnosis of observed errors (Taraghi et al., 2015;Taraghi et al., 2016). In this contribution to the field of errors in learning, we propose a model for the latter. ...
Article
Full-text available
In learning, errors are ubiquitous and inevitable. As these errors may signal otherwise latent cognitive processes, tutors-and students alike-can greatly benefit from the information they provide. In this paper, we introduce and evaluate the Systematic Error Tracing (SET) model that identifies the possible causes of systematically observed errors in domains where items are susceptible to most or all causes and errors can be explained by multiple causes. We apply the model to single-digit multiplication, a domain that is very suitable for the model, is well-studied, and allows us to analyze over 25,000 error responses from 335 learners. The model, derived from the Ising model popular in physics, makes use of a bigraph that links errors to causes. The error responses were taken from Math Garden, a computerized adaptive practice environment for arithmetic that is widely used in the Netherlands. We discuss and evaluate various model configurations with respect to the ranking of recommendations and calibration of probability estimates. The results show that the SET model outranks a majority vote baseline model when more than a single recommendation is considered. Finally, we contrast the SET model to similar approaches and discuss limitations and implications.
... Any false answer that does not belong to one of those six categories is assigned to the unclassified category. The description of the error types is explained in detail in [48]; a brief description follows here: ...
Chapter
Full-text available
One-digit multiplication problems is one of the major fields in learning mathematics at the level of primary school that has been studied over and over. However, the majority of related work is focusing on descriptive statistics on data from multiple surveys. The goal of our research is to gain insights into multiplication misconceptions by applying machine learning techniques. To reach this goal, we trained a probabilistic graphical model of the students’ misconceptions from data of an application for learning multiplication. The use of this model facilitates the exploration of insights into human learning competence and the personalization of tutoring according to individual learner’s knowledge states. The detection of all relevant causal factors of the erroneous students answers as well as their corresponding relative weight is a valuable insight for teachers. Furthermore, the similarity between different multiplication problems - according to the students behavior - is quantified and used for their grouping into clusters. Overall, the proposed model facilitates real-time learning insights that lead to more informed decisions.
... Since the LTI protocol ensures a connection between any two online learning environments that support the protocol, the bridge can also be used by teachers and researchers that use a different type of learning environment. Those other environments might also benefit from additional pedagogical flexibility and learning measures, or neither provide the tools for teacher-driven experimental comparisons, thus for those teachers and researchers the protocol can also come in helpful (e.g., Henrick, 2012 Ben-Zeev, 1998;Straatemeier, 2014), and cognitive models aimed at explaining errors (e.g., Buwalda, Borst, van der Maas, & Taatgen, 2016), to the identification of misconceptions from observed errors (e.g., Taraghi et al., 2015;Taraghi, Saranti, Legenstein, & Ebner, 2016). In this contribution to the field of errors in learning, we investigate a method for the latter-a new approach to detecting the latent causes of an individual student's manifest errors. ...
Thesis
Full-text available
Picture education as a long chain of interventions in a self-organizing developmental system. On the one extreme, such educational sequences can be identical for each and every student, whereas on the other extreme, each sequence may be perfectly tailored to the individual. The latter is what is meant with idiographic education. All educational programs can be seen to lie somewhere in between those extremes, and in this book, methods are explored that may help increase the tailoring of education. The book covers advances in three fundamental approaches. First, it discusses and illustrates an experimental approach: online randomized experiments, so-called A/B tests, that enable truly double-blind evidence-based educational improvements. Second, it introduces a diagnostic approach: a scalable method that helps identify students’ misconceptions. Third and finally, it introduces a theoretical approach: a formal conceptualization of intelligence that permits a novel educational, developmental, and individual perspective, and that may justify and ultimately guide the tailoring of education.
... As part of the previous frameworks, an adequate visualization has to be applied to present the feedback as simple and informative as possible to the stakeholders [32,33]. Furthermore, analytical approaches to model a learner's profile based on their answering behaviour and the analysis of different error types can lead to findings that help to enhance the whole learning process [34,35]. 3 The platform 3 ...
Article
Full-text available
According to the NMC Horizon Report (Johnson et al. in Horizon Report Europe: 2014 Schools Edition, Publications Office of the European Union, The New Media Consortium, Luxembourg, Austin, 2014 [1]), data-driven learning in combination with emerging academic areas such as learning analytics has the potential to tailor students’ education to their needs (Johnson et al. 2014 [1]). Focusing on this aim, this article presents a web-based (training) platform for German-speaking users aged 8–12.Our objective is to support primary-school pupils—especially those who struggle with the acquisition of the German orthography—with an innovative tool to improve their writing and spelling competencies. On this platform, which is free of charge, they can write and publish texts supported by a special feature, called the intelligent dictionary. It gives automatic feedback for correcting mistakes that occurred in the course of fulfilling a meaningful writing task. Consequently, pupils can focus on writing texts and are able to correct texts on their own before publishing them. Additionally, they gain deeper insights in German orthography. Exercises will be recommended for further training based on the spelling mistakes that occurred. This article covers the background to German orthography and its teaching and learning as well as details concerning the requirements for the platform and the user interface design. Further, combined with learning analytics we expect to gain deeper insight into the process of spelling acquisition which will support optimizing our exercises and providing better materials in the long run.
... The results of such analysis are demonstrated on Learning Analytics Dashboards for better comprehension and further recognition of ongoing activities. An example of in detail analysis is the work on one-digit multiplication problems [19,20,21] or even beyond [22,23]. Taraghi et al analyzed at the first step the most prevalent error types and the statistical correlations between them in one-digit multiplication problems [24]. ...
Conference Paper
Full-text available
In this paper, we discuss the design, development, and implementation of a Learning Analytics (LA) dashboard in the area of Higher Education (HE). The dashboard meets the demands of the different stakeholders, maximizes the mainstreaming potential and transferability to other contexts, and is developed in the path of Open Source. The research concentrates on developing an appropriate concept to fulfil its objectives and finding a suitable technology stack. Therefore, we determine the capabilities and functionalities of the dashboard for the different stakeholders. This is of significant importance as it identifies which data can be collected, which feedback can be given, and which functionalities are provided. A key approach in the development of the dashboard is the modularity. This leads us to a design with three modules: the data collection, the search and information processing, and the data presentation. Based on these modules, we present the steps of finding a fitting Open Source technology stack for our concept and discuss pros and cons trough out the process.
... The authors [40,41] show that, in addition to the above analysis, it is necessary to take into account how information is presented to the stakeholders in this process information, that is, system feedback. Finally, the study of students' behavior patterns can be very useful in order to adopt strategies to improve the learning process [42,43]. ...
Conference Paper
The emergence of new technologies such as IoT and Big Data, the change in the behavior of society in general and the younger generation in particular, require higher education institutions to “look” for teaching differently. This statement is complemented by the prediction of the futurist Thomas Frey, who postulates that “in 14 years it will be a big deal when students learn from robot teachers over the internet”. Thus, it is necessary to urgently begin a disruption of current teaching models, to be able to include in these processes the new technologies and the daily habits of the new generations. The early usage of mobile devices and the constant connection to the Internet (social networks, among others) mean that the current generation of young people, who are reaching higher education, has the most technological literacy ever. In this new context, this article presents a disruptive conceptual approach to higher education, using information gathered by IoT and based on Big Data & Cloud Computing and Learning Analytics analysis tools. This approach will, for example, allow individualized solutions taking into account the characteristics of the students, to help them customize their curriculum and overcome their limitations and difficulties, throughout the learning process .
... As a part of the previous frameworks, an adequate visualization has to be applied to present the feedback as simple and informative as possible to the stakeholders [14,15]. Furthermore, analytical approaches to model a learner's profile based on their answering behavior and the analysis of different error types can lead to findings that help to enhance the whole learning process [18,19]. ...
Conference Paper
Full-text available
Data-driven learning in combination with emerging academic areas such as Learning Analytics (LA) has the potential to tailor students’ education to their needs [1]. The aim of this article is to present a web-based training platform for primary school pupils who struggle with the acquisition of German orthography. Our objective is the improvement in their writing and spelling competences. The focus of this article is on the development of the platform and the details concerning the requirements and the design of the User Interface (UI). In combination with Learning Analytics, the platform is expected to provide deeper insight into the process of spelling acquisition. Furthermore, aspects of Learning Analytics will help to develop the platform, to improve the exercises and to provide better materials in the long run.
... After analysing the most prevalent error types that are observed in one-digit multiplication, we carried out a detailed analysis [23], [22], [19]. With the use of heat maps and diagrams we depicted those misconceptions that are of higher relevance, because they occur more often, and we provided hints at probable reasons. ...
... We have considered six specific error types of the onedigit multiplication: operand, intrusion, consistency, off-by-±1 and off-by-±2, pattern, as well as confusion with addition, subtraction, and division operation errors, as described in [3] and [19]. The collection of these mistakes consist of our bug library [4] or taxonomy of misconceptions [5] which, at this point, is created by enumeration and is driven by domain knowledge. ...
Conference Paper
One-digit multiplication errors are one of the most extensively analysed mathematical problems. Research work primarily emphasises the use of statistics whereas learning analytics can go one step further and use machine learning techniques to model simple learning misconceptions. Probabilistic programming techniques ease the development of probabilistic graphical models (bayesian networks) and their use for prediction of student behaviour that can ultimately influence learning decision processes.
Article
Full-text available
Many pupils struggle with the acquisition of the German orthography. In order to meet this struggle a web based platform for German speaking countries is currently developed. This platform aims to motivate pupils aged 8 to 12 to improve their writing and spelling competences. In this platform pupils can write texts in the form of blog entries concerning everyday events or special topics. Since the core of this platform consists of an intelligent dictionary focussing on different categories of misspellings, students can improve their own spelling skills by trying to correct their mistakes according to the feedback of the system. Teachers are informed about specific orthographic problems of a particular student by getting a qualitative analysis of the misspellings from this intelligent dictionary. The article focuses on the development of the intelligent dictionary, details concerning the requirements, the categorization and the used wordlist. Further, necessary information on German orthography, spelling competence in general and the platform itself is given. By implementing methods of learning analytics it is expected to gain deeper insight into the process of spelling acquisition and thus serves as a basis to develop better materials on the long run.