ArticlePDF Available

Abstract

The topic of this chapter is the measurement of students' self-regulated learning (SRL) and its components. The first section develops key points about measurement in general. In the second section, the authors describe a model of SRL and its components that researchers seek to measure—metacognition, intrinsic motivation, strategic action. Currently used protocols are surveyed, including questionnaires, structured interviews, teacher ratings, think aloud methods, error detection tasks, trace methodologies, and observations. Finally, the authors critique these current protocols and forecast what measurements of SRL might be like in the future. (PsycINFO Database Record (c) 2012 APA, all rights reserved)
. Handbook of Self-Regulation.
: Academic Press, . p 562
http://site.ebrary.com/id/10529531?ppg=562
Copyright © Academic Press. . All rights reserved.
May not be reproduced in any form without permission from the publisher,
except fair uses permitted under U.S. or applicable copyright law.
. Handbook of Self-Regulation.
: Academic Press, . p 563
http://site.ebrary.com/id/10529531?ppg=563
Copyright © Academic Press. . All rights reserved.
May not be reproduced in any form without permission from the publisher,
except fair uses permitted under U.S. or applicable copyright law.
. Handbook of Self-Regulation.
: Academic Press, . p 564
http://site.ebrary.com/id/10529531?ppg=564
Copyright © Academic Press. . All rights reserved.
May not be reproduced in any form without permission from the publisher,
except fair uses permitted under U.S. or applicable copyright law.
. Handbook of Self-Regulation.
: Academic Press, . p 565
http://site.ebrary.com/id/10529531?ppg=565
Copyright © Academic Press. . All rights reserved.
May not be reproduced in any form without permission from the publisher,
except fair uses permitted under U.S. or applicable copyright law.
. Handbook of Self-Regulation.
: Academic Press, . p 566
http://site.ebrary.com/id/10529531?ppg=566
Copyright © Academic Press. . All rights reserved.
May not be reproduced in any form without permission from the publisher,
except fair uses permitted under U.S. or applicable copyright law.
. Handbook of Self-Regulation.
: Academic Press, . p 567
http://site.ebrary.com/id/10529531?ppg=567
Copyright © Academic Press. . All rights reserved.
May not be reproduced in any form without permission from the publisher,
except fair uses permitted under U.S. or applicable copyright law.
. Handbook of Self-Regulation.
: Academic Press, . p 568
http://site.ebrary.com/id/10529531?ppg=568
Copyright © Academic Press. . All rights reserved.
May not be reproduced in any form without permission from the publisher,
except fair uses permitted under U.S. or applicable copyright law.
. Handbook of Self-Regulation.
: Academic Press, . p 569
http://site.ebrary.com/id/10529531?ppg=569
Copyright © Academic Press. . All rights reserved.
May not be reproduced in any form without permission from the publisher,
except fair uses permitted under U.S. or applicable copyright law.
. Handbook of Self-Regulation.
: Academic Press, . p 570
http://site.ebrary.com/id/10529531?ppg=570
Copyright © Academic Press. . All rights reserved.
May not be reproduced in any form without permission from the publisher,
except fair uses permitted under U.S. or applicable copyright law.
. Handbook of Self-Regulation.
: Academic Press, . p 571
http://site.ebrary.com/id/10529531?ppg=571
Copyright © Academic Press. . All rights reserved.
May not be reproduced in any form without permission from the publisher,
except fair uses permitted under U.S. or applicable copyright law.
. Handbook of Self-Regulation.
: Academic Press, . p 572
http://site.ebrary.com/id/10529531?ppg=572
Copyright © Academic Press. . All rights reserved.
May not be reproduced in any form without permission from the publisher,
except fair uses permitted under U.S. or applicable copyright law.
. Handbook of Self-Regulation.
: Academic Press, . p 573
http://site.ebrary.com/id/10529531?ppg=573
Copyright © Academic Press. . All rights reserved.
May not be reproduced in any form without permission from the publisher,
except fair uses permitted under U.S. or applicable copyright law.
. Handbook of Self-Regulation.
: Academic Press, . p 574
http://site.ebrary.com/id/10529531?ppg=574
Copyright © Academic Press. . All rights reserved.
May not be reproduced in any form without permission from the publisher,
except fair uses permitted under U.S. or applicable copyright law.
. Handbook of Self-Regulation.
: Academic Press, . p 575
http://site.ebrary.com/id/10529531?ppg=575
Copyright © Academic Press. . All rights reserved.
May not be reproduced in any form without permission from the publisher,
except fair uses permitted under U.S. or applicable copyright law.
. Handbook of Self-Regulation.
: Academic Press, . p 576
http://site.ebrary.com/id/10529531?ppg=576
Copyright © Academic Press. . All rights reserved.
May not be reproduced in any form without permission from the publisher,
except fair uses permitted under U.S. or applicable copyright law.
. Handbook of Self-Regulation.
: Academic Press, . p 577
http://site.ebrary.com/id/10529531?ppg=577
Copyright © Academic Press. . All rights reserved.
May not be reproduced in any form without permission from the publisher,
except fair uses permitted under U.S. or applicable copyright law.
. Handbook of Self-Regulation.
: Academic Press, . p 578
http://site.ebrary.com/id/10529531?ppg=578
Copyright © Academic Press. . All rights reserved.
May not be reproduced in any form without permission from the publisher,
except fair uses permitted under U.S. or applicable copyright law.
. Handbook of Self-Regulation.
: Academic Press, . p 579
http://site.ebrary.com/id/10529531?ppg=579
Copyright © Academic Press. . All rights reserved.
May not be reproduced in any form without permission from the publisher,
except fair uses permitted under U.S. or applicable copyright law.
. Handbook of Self-Regulation.
: Academic Press, . p 580
http://site.ebrary.com/id/10529531?ppg=580
Copyright © Academic Press. . All rights reserved.
May not be reproduced in any form without permission from the publisher,
except fair uses permitted under U.S. or applicable copyright law.
. Handbook of Self-Regulation.
: Academic Press, . p 581
http://site.ebrary.com/id/10529531?ppg=581
Copyright © Academic Press. . All rights reserved.
May not be reproduced in any form without permission from the publisher,
except fair uses permitted under U.S. or applicable copyright law.
. Handbook of Self-Regulation.
: Academic Press, . p 582
http://site.ebrary.com/id/10529531?ppg=582
Copyright © Academic Press. . All rights reserved.
May not be reproduced in any form without permission from the publisher,
except fair uses permitted under U.S. or applicable copyright law.
. Handbook of Self-Regulation.
: Academic Press, . p 583
http://site.ebrary.com/id/10529531?ppg=583
Copyright © Academic Press. . All rights reserved.
May not be reproduced in any form without permission from the publisher,
except fair uses permitted under U.S. or applicable copyright law.
. Handbook of Self-Regulation.
: Academic Press, . p 584
http://site.ebrary.com/id/10529531?ppg=584
Copyright © Academic Press. . All rights reserved.
May not be reproduced in any form without permission from the publisher,
except fair uses permitted under U.S. or applicable copyright law.
. Handbook of Self-Regulation.
: Academic Press, . p 585
http://site.ebrary.com/id/10529531?ppg=585
Copyright © Academic Press. . All rights reserved.
May not be reproduced in any form without permission from the publisher,
except fair uses permitted under U.S. or applicable copyright law.
. Handbook of Self-Regulation.
: Academic Press, . p 586
http://site.ebrary.com/id/10529531?ppg=586
Copyright © Academic Press. . All rights reserved.
May not be reproduced in any form without permission from the publisher,
except fair uses permitted under U.S. or applicable copyright law.
. Handbook of Self-Regulation.
: Academic Press, . p 587
http://site.ebrary.com/id/10529531?ppg=587
Copyright © Academic Press. . All rights reserved.
May not be reproduced in any form without permission from the publisher,
except fair uses permitted under U.S. or applicable copyright law.
. Handbook of Self-Regulation.
: Academic Press, . p 588
http://site.ebrary.com/id/10529531?ppg=588
Copyright © Academic Press. . All rights reserved.
May not be reproduced in any form without permission from the publisher,
except fair uses permitted under U.S. or applicable copyright law.
. Handbook of Self-Regulation.
: Academic Press, . p 589
http://site.ebrary.com/id/10529531?ppg=589
Copyright © Academic Press. . All rights reserved.
May not be reproduced in any form without permission from the publisher,
except fair uses permitted under U.S. or applicable copyright law.
. Handbook of Self-Regulation.
: Academic Press, . p 590
http://site.ebrary.com/id/10529531?ppg=590
Copyright © Academic Press. . All rights reserved.
May not be reproduced in any form without permission from the publisher,
except fair uses permitted under U.S. or applicable copyright law.
. Handbook of Self-Regulation.
: Academic Press, . p 591
http://site.ebrary.com/id/10529531?ppg=591
Copyright © Academic Press. . All rights reserved.
May not be reproduced in any form without permission from the publisher,
except fair uses permitted under U.S. or applicable copyright law.
. Handbook of Self-Regulation.
: Academic Press, . p 592
http://site.ebrary.com/id/10529531?ppg=592
Copyright © Academic Press. . All rights reserved.
May not be reproduced in any form without permission from the publisher,
except fair uses permitted under U.S. or applicable copyright law.
. Handbook of Self-Regulation.
: Academic Press, . p 593
http://site.ebrary.com/id/10529531?ppg=593
Copyright © Academic Press. . All rights reserved.
May not be reproduced in any form without permission from the publisher,
except fair uses permitted under U.S. or applicable copyright law.
. Handbook of Self-Regulation.
: Academic Press, . p 594
http://site.ebrary.com/id/10529531?ppg=594
Copyright © Academic Press. . All rights reserved.
May not be reproduced in any form without permission from the publisher,
except fair uses permitted under U.S. or applicable copyright law.
. Handbook of Self-Regulation.
: Academic Press, . p 595
http://site.ebrary.com/id/10529531?ppg=595
Copyright © Academic Press. . All rights reserved.
May not be reproduced in any form without permission from the publisher,
except fair uses permitted under U.S. or applicable copyright law.
. Handbook of Self-Regulation.
: Academic Press, . p 596
http://site.ebrary.com/id/10529531?ppg=596
Copyright © Academic Press. . All rights reserved.
May not be reproduced in any form without permission from the publisher,
except fair uses permitted under U.S. or applicable copyright law.
. Handbook of Self-Regulation.
: Academic Press, . p 597
http://site.ebrary.com/id/10529531?ppg=597
Copyright © Academic Press. . All rights reserved.
May not be reproduced in any form without permission from the publisher,
except fair uses permitted under U.S. or applicable copyright law.
... Metacognition, particularly metacognitive monitoring and control, is central to students' self-regulated learning (SRL; Efklides, 2011;Panadero, 2017;Winne & Perry, 2000). According to the metacognitive and affective model of SRL (MASRL; Efklides, 2011), subjective experiences, also called metacognitive feelings (such as confidence judgements), as well as emotions during learning processes, provide critical information for the regulation of learning. ...
Article
Full-text available
Recent investigations have suggested that both metacognition and emotions play important roles in second language (L2) learning. However, the majority of these studies focused on negative emotions, such as anxiety, or considered high school or university students, neglecting primary school age students, which is frequently the starting period in which a L2 is learned. Moreover, none of these studies investigated both metacognition and emotions in relation to L2 learning. Thus, the present study aimed to explore within a short-term longitudinal design the role of both metacognition and emotions in learning English as a L2 starting from an early stage, namely, in primary school. We included 305 Italian 2nd and 3rd graders (Mage = 7.44 years; SD = 0.59; 48.5% females). They were evaluated twice, at the beginning (T0) and the end of the school year (T1), on an English vocabulary test, metacognitive monitoring and control of performance on the English vocabulary test, and achievement emotions (i.e., enjoyment, anxiety, and boredom) related to learning English as a L2. Basic cognitive abilities were also assessed at T0. The results showed that both metacognitive monitoring and control abilities significantly predicted children’s English vocabulary improvements from the first to the second test administration points. Among the achievement emotions, only boredom was a strong predictor of English vocabulary learning. These outcomes showed that metacognitive and emotional variables are relevant beginning at the early stage of L2 learning.
... Therefore, the measurement and support of students' SRL skills have become key areas of research in learning analytics. Traditionally, SRL skills can be measured by surveys or ongoing observations of students learning behaviours, which can be expensive and time-consuming [7,43]. The increasing availability of trace data -records of student interactions with online learning environments, provides significant potential to automatically assess SRL at scale. ...
Conference Paper
Full-text available
Self-regulated learning (SRL) skills are critical for effective learning and academic success. With the growing availability of trace data from students' online learning activities, researchers are increasingly leveraging this data to infer SRL processes. However, challenges remain regarding the validity of these inferences and their generalisability across diverse learning contexts. This study presents a structured approach to investigate these challenges by examining SRL behaviours in a multidisciplinary university co-hort. The dataset includes 76 baseline survey responses, over 300 daily SRL survey submissions, and more than 6,000 sequences of recorded learning actions as trace data. Using mixed linear models and sequence mining, the analysis is grounded in SRL theory and evaluated through machine learning performance metrics. Our findings indicate consistent within-person patterns of SRL and online learning behaviours, supporting the concept of transferable, holistic skill development. Additionally, the results validate the trace-based detection of SRL engagement but highlight limitations in accurately detecting planning and reflection phases. These findings underscore the potential of automating SRL engagement detection while emphasising the need for multi-modal approaches to capture the full spectrum of SRL processes comprehensively.
... Such a lens has been applied -and extended-over the years through the work of several researchers who applied a temporal lens to capture the sequences, the transitions, and the temporal unfolding of learning events and their typical patterns [18,21,22,27]. In particular, TNA draws on Winne and Perry's framework that the learning process unfolds as transitions (i.e., contingencies) between occurrences (the actions learners take), such as from reading a passage to taking a note [43,46]. Repeated transitions form -patterns-that can be inferred and "computed using matrices that tally transitions from one SRL event to another" [43, p. 275]. ...
Conference Paper
Full-text available
This paper presents a novel learning analytics method: Transition Network Analysis (TNA), a method that integrates Stochastic Process Mining and probabilistic graph representation to model, visualize, and identify transition patterns in the learning process data. Combining the relational and temporal aspects into a single lens offers capabilities beyond either framework, including centralities to capture important learning events, community detection to identify behavior patterns, and clustering to reveal temporal patterns. Furthermore, TNA introduces several significance tests that go beyond either method and add rigor to the analysis. Here, we introduce the theoretical and mathematical foundations of TNA and we demonstrate the functionalities of TNA with a case study where students (n=191) engaged in small-group collaboration to map patterns of group dynamics using the theories of co-regulation and socially-shared regulated learning. The analysis revealed that TNA can map the regulatory processes as well as identify important events, patterns, and clusters. Bootstrap validation established the significant transitions and eliminated spurious transitions. As such, TNA can capture learning dynamics and provide a robust framework for investigating the temporal evolution of learning processes. Future directions include —inter alia— expanding estimation methods, reliability assessment, and building longitudinal TNA.
... In such cases, their behaviors resemble avoidant help-seeking behaviors, but their reasons for not seeking help differ. Help-seeking is a form of self-regulated learning, and Winne and Perry (2000) suggested two ways to measure it: self-report questionnaires and behavioral observations and records. Self-report questionnaires focus on static and broad measurements of students' attitudes, whereas behavioral observations and records focus on more granular, dynamic processes. ...
Article
Full-text available
Studies have shown that students have different help-seeking behavior patterns and tendencies and furthermore, that students with certain help-seeking behavior patterns and tendencies may have poor performance (i.e., at-risk students). This study applied an educational data mining approach, including clustering and classification, to analyze students’ problem-solving and help-seeking data in a computer assisted learning system to identify student help-seeking behavior patterns and tendencies. First, nine observable problem-solving and help-seeking features for identifying help-seeking behavior patterns were established. Second, this study applied the k-means clustering method and identified three well-known help-seeking behavior patterns: executive, avoidant, and instrumental help-seeking. The results further identified two new help-seeking behavior patterns. One was static instrumental help-seeking and the other was static instrumental and executive help-seeking. Third, executive help-seeking and static instrumental and executive help-seeking patterns could be used as at-risk predicators of poor performance. Fourth, the study applied clustered and identified results to build a minimum distance classifier to identify help-seeking behavior patterns in new data. The study also investigated the accuracy of the classifier in early identifying help-seeking behavior patterns from early-stage data. The early identification accuracy was 61% for the first three minutes and 75% for the seven-minutes of early-stage data, respectively. Fifth, this study identified three help-seeking tendencies: independent problem-solvers, executive help-seekers, and static instrumental and executive help-seekers. In summary, the study showed the feasibility and effectiveness of applying an educational data mining approach, including clustering and classification, to build data-driven student models to identify student help-seeking behavior patterns and tendencies.
Article
Listening poses significant challenges for L2 learners and is difficult to improve ( Graham, 2011 ). Research shows that L2 Chinese learners’ listening performance lags behind speaking and reading even after four years of college study ( Winke et al., 2020 ). However, the factors influencing listening comprehension remain underexplored ( Cai, 2015 ; Wang & Treffers-Daller, 2017 ). This study investigates the impact of oral proficiency, vocabulary size, metacognitive awareness, and test anxiety on listening comprehension among 89 CSL learners. Results from multiple regression analyses indicate that oral proficiency and vocabulary size are significant predictors of listening performance. For less proficient listeners, oral proficiency was crucial, while vocabulary size was most significant for advanced listeners. The importance of step-by-step vocabulary development and proficiency-guided language output opportunities is discussed.
Article
This study investigates the self‐regulated learning strategies employed by students in computer programming courses. Utilising the Questionnaire on Learning Strategies in Computer Programming (CEAPC), the research aims to identify specific strategies used by students. The findings reveal a variety of effective learning strategies, including problem‐solving, knowledge acquisition and study environment management in the context of computer programming learning. However, difficulties in idea organisation were noted, suggesting a need for enhanced support in structuring and documenting thought processes and code. The study also highlights the interdependence of learning strategies, particularly the role of metacognition in conjunction with practice, problem‐solving and time management. Differences in strategy use across course levels and gender were observed, with advanced courses prompting more complex strategies and female students excelling in structured and collaborative learning. These insights provide educators with valuable guidance for developing targeted interventions to improve students' self‐regulated learning abilities in programming education.
Article
Full-text available
The topic of how students become self-regulated as learners has attracted researchers for decades. Initial attempts to measure self-regulated learning (SRL) using questionnaires and interviews were successful in demonstrating significant predictions of students’ academic outcomes. The present article describes the second wave of research, which has involved the development of online measures of self-regulatory processes and motivational feelings or beliefs regarding learning in authentic contexts. These innovative methods include computer traces, think-aloud protocols, diaries of studying, direct observation, and microanalyses. Although still in the formative stage of development, these online measures are providing valuable new information regarding the causal impact of SRL processes as well as raising new questions for future study.
Chapter
Full-text available
Six features are enumerated that distinguish studying from learning in general and describe circumstances that essentially compel students to engage in complex bundles of goal-directed cognitive and motivational processes that 'get studying done.' We view these bundles as instances of metacognitively powered self-regulated learning. As a first step toward examining studying through metacognitive lenses, we present a general typology that delineates facets of academic tasks in general, including studying tasks. Then, we use this typology to characterize four distinguishable but recursively linked stages of studying: task definition, goal setting and planning, enacting study tactics and strategies, and metacognitively adapting studying. Next, we develop connections between our typology for studying and models of metacognitive monitoring, metacognitive control, and self-regulated learning. With this backdrop, we then survey select research that highlights metacognitive activities in each of the four stages of studying. Finally, we summarize our model of studying and offer suggestions for next steps in research on studying as a complex, self-regulated learning event.
Article
We examined achievement goals measured by self-reports and by traces (behavioral indicators) gathered as undergraduates used software tools to study a multimedia-formatted article. Traces were operationalized by tags participants applied to selections of text and hyperlinks they clicked in the article. Tags and hyperlinks were titled to represent achievement goal orientations. Self-reported goal orientations did not correlate with goals traced as actions. In separate regression models, traces of goal orientations were stronger predictors of achievement than self reports. We suggest future research include traces in studies of achievement goals because traces reflect proximal events that comprise learning activities that can supplement static orientations that are operationally defined to be indifferent to the dynamics of learning activities.
Article
THIS 7-MONTH naturalistic study investigated students' reading and writing engagements as they conducted a research investigation related to World War II. Students were free to choose their research topics, to search for and to select from source materials, and to write up and present their findings in their own way. The participants were 11- and 12-year-old pupils in an open-concept school in Aberdeen, Scotland. Data took the form of fieldnotes, photocopies of research booklets and source texts, structured, unstructured, and debriefing interviews, and audio and videotapes. Ongoing data analysis led to selection of key informants whose work sampled the range of composing-from-sources processes which were apparent in this context. Three major task impressions were uncovered: research as accumulating information, research-as transferring information, and research as transforming information. These task impressions were characterized by differing emphases on the following research subtasks: planning, searching, finding, recording, reviewing, and presenting. Students did not carry out these subtasks in either a strictly linear or a strictly cyclical pattern. Task impressions were also related to the differential use of the following strategies when working from sources: duplicating, drawing, and labeling, sentence-by-sentence reworking, read/remember/write, cut-and-paste synthesis, and discourse synthesis. The task impressions and strategy use of individual students influenced and were influenced by the materials used and the social and instructional context of the classroom. Students who viewed research as a process of transforming information were more likely to demonstrate a range of strategies which allowed them to traverse their topics from multiple perspectives.
Article
Realizing the promise of software technologies in education requires thinking differently about how software simultaneously can serve research and contribute to learning. This article examines 3 axioms underlying contemporary educational psychology: Learners construct knowledge, learners are agents, and data include lots of randomness. By drawing out corollaries of these axioms, this research uncovers significant challenges researchers face in using classical forms of experimental research to build a basis for school reform and for testing school reforms using randomized field trials. This article describes a software system, gStudy, that is designed to address these challenges by gathering finer grained data that better support theorizing about the processes of learning and self-regulated learning. This research illustrates how this can be realized and suggests 10 ways that using software like gStudy can help pull up research by its bootstraps and bolster searches for what works.
Article
Self-regulated learning (SRL) with hypermedia environments involves a complex cycle of temporally unfolding cognitive and metacognitive processes that impact students’ learning. We present several methodological issues related to treating SRL as an event and strengths and challenges of using online trace methodologies to detect, trace, model, and foster students’ SRL processes. We first describe a scenario illustrating the complex nature of SRL processes during learning with hypermedia. We provide our theoretically driven assumptions regarding the use of several cognitive methodologies, including concurrent think aloud protocols, and provide several examples of empirical evidence regarding the advantages of treating SRL as an event. Last, we discuss challenges for measuring cognitive and metacognitive processes in the context of MetaTutor, an intelligent adaptive hypermedia learning environment. This discussion includes the roles of pedagogical agents in goal-generation, multiple representations, agent-learner dialogue, and a system's ability to detect, track, and model SRL processes during learning.
Article
People's judgments about how well they have learned and comprehended text materials can be important for effectively regulating learning, but only if those judgments are accurate. Over two decades of research examining judgments of text learning—or metacomprehension—has consistently demonstrated that people's judgment accuracy is quite poor. We review recent research that has shown some success in improving judgment accuracy and then argue that the most common method used to investigate metacomprehension accuracy may inadvertently constrain it. We describe a new method that sidesteps some problems of the older method and present evidence showing how people can achieve high levels of metacomprehension accuracy.