No full-text available
To read the full-text of this research,
you can request a copy directly from the authors.
Monitoring the Student Progress in PBL: A Proposal Based on Authentic Assessment and Visual Board
Abstract
This Research to Practice Full Paper presents a proposal for monitoring student progress in Problem-Based Learning (PBL). The adoption of the PBL approach has been growing in computer education, where problem-solving and group work are essential. Despite the compatibility and benefits of PBL, some challenges remain, in particular, with respect to the assessment process. For an effective assessment process, it needs to be well defined and managed by both teachers and students themselves, considering that, in PBL, the students are at the center of the teaching and learning process, they are active, and self-regulating. In this context, this paper proposes an interface for student progress monitoring (a "student board") based on an authentic assessment model called PBL-SEE. Constructed using the Design Science Research (DSR) method, this interface was initially prototyped and validated by PBL specialists. The results showed a good acceptance of the student board and important recommendations for improvements.
... In this context, assessment models aim to collaborate with the PBL-based teaching process, based not only on the implementation of the approach but on its ongoing management, as highlighted in [PS43]: "application of the model based on continuous monitoring, prompted by feedback meetings throughout the program, not only enabled points of improvement to be identified, but strategies to be defined that might enable the weaknesses found to be overcome and strengths to be maximized". Assessment models can also offer more clarity on how to monitor student motivation and engagement, allowing the teaching team to adjust the PBL process for better results [PS51], [PS64], [PS94]. ...
... When that environment is a virtual learning platform, it allows students to remain immersed in practices, facilitating communication between the whole group and the exchange of feedback between all involved in a much more agile and continuous way. It is also worth mentioning the concern of some studies with specialized learning environments in PBL [PS3], [PS4], [PS61], [PS66], [PS94], which incorporate collaborative methodologies and facilitate the dynamics of the method, reducing the effort of the pedagogical team in the configuration of generalpurpose environments. ...
... Finally, studies highlighted many challenges related to the process element, more especially in the second decade, such as: the definition of educational objectives and goals; the planning and management of an evaluation process that allows monitoring the attainment of these objectives and goals [PS12], [PS41]; the awareness of constructivist pedagogy and its impacts on the learning strategy [PS35], [PS70], [PS72]; the stimulus to regulation and self-regulation of students with continuous feedbacks and [PS21], [PS35], [PS39], [PS91], [PS94]; the coordination of projects conducted by student teams [PS60]. In [PS51], practically all elements are evident: "Professors need to customize assessment activities, according to each course nature in the proposed method. ...
Contribution: This article adds to the results of previous systematic mapping study by addressing a more ample context of problem-based learning (PBL) in computing education. Background: PBL is defined as an instructional method of constructivist teaching that uses real problems as a motivating element for learning. Although PBL was born in medical education, it has been used in computing education to facilitate the students' engagement and learning capacity, contributing to developing skills, such as teamwork, holistic vision, critical thinking, and solving problem. Considering that approach much more descriptive than prescriptive, it favors the implementation of diverse methodologies on its behalf.
... Authentic assessment provides opportunities for students to perform authentic assignments that are interesting, useful, and relevant to students' lives (Abduh, et al., 2018). In authentic assessment, students are involved in a learning environment with activities aimed at applying their knowledge, stimulating their thinking and critical vision to solve real problems and practicing various ways to solve them (dos Santos, et al., 2019). ...
Learning during the COVID-19 pandemic has an impact on students' learning outcomes. Observation results in SMP 2 Dawe Kudus showed that students' learning outcomes in science subjects are still low. This school was chosen because of the location of the school in remote areas which resulted in not optimal use of digital devices for assessment in learning. The purpose of this study is to analyze the characteristics, feasibility, and profile of learning outcomes using digital science scrapbooks as authentic assessment to measure the learning outcomes of junior high school students on the theme of Additives and Addictive Substances. This study used a Research and Development (R&D) design with ADDIE model. The science digital scrapbook as an authentic assessment developed in this study was declared feasible to use based on the assessment of material experts and evaluations. The reliability coefficient values obtained from small-scale tests for essay questions, attitude assessment instruments, and skills assessment instruments were obtained 0.62; 0.84; and 0.38. Students' learning outcomes measured using a digital science scrapbook as an authentic assessment showed 83.3% of students were complete in the realm of knowledge, 100% completed in the realm of attitudes, and 100% completed in the realm of skills. The conclusion of this study is science digital scrapbook as an authentic assessment developed in this study was feasible to be used to measure the learning outcomes of junior high school students on additives and addictive substances concept.
... Despite the obvious benefits of PBL, according to [9], its dynamic nature results in difficulty in evaluating the results of the teaching and learning experience [14]. The verification of the conformity between the assimilated knowledge and the educational objectives must then take into account different perspectives. ...
This Research Full Paper presents an overview of student assessment proposals for Problem-Based Learning (PBL) in Computing Education. Computing teaching has many challenges, as it requires different skills from students, often subjective and difficult to assess. In fact, technical knowledge alone is not enough to fully understand what is being taught, but the interpretive and logical skills to deal with practical problems and non-technical skills such as group work, creativity, critical vision, ability to cooperate and communicate. Active learning methodologies as Problem-Based Learning (PBL) have been used to dealing with such challenges, broadly developing technical and non-techniques skills in students. However, despite the benefits of PBL, the student assessment process is one of the points that present its own adversities and, therefore, an aspect that deserves greater attention. To better understand the nuances of this process and how it can contribute to the teaching and learning process based on PBL, this study aimed to investigate primary studies in the last two decades, seeking answers to the following research questions: RQ1) What assessment models are being used?; RQ2) Which aspects are evaluated?; RQ3) What criteria and media have been defined?; RQ4) Who gets involved in the assessment process?; RQ5) What is the ideal frequency to conduct the evaluations?; RQ6) What can these models reveal? As a research method, this study used the Systematic Literature Review method proposed by Kitchenham. As main conclusions, it was possible to identify that: generally, computing education based on PBL occurs at the undergraduate level, having as main educational objective the teaching of technical content; in practice, the need for a diverse teaching team is not reflected, the traditional student-teacher remains; to evaluate students, it is necessary to consider several aspects, technical and non-technical, defining specific criteria for each one of them; the main benefits for students are related to changes in behavior, development of soft skills and better absorption of technical knowledge; as main challenges for students, the difficulty to understand the nuances of the proposed problem and to be the main responsible for devising a solution for it without the figure of a teacher to give a clear definition of how to do it stands out.
The dynamism of the global economy and its growing dependence on Information Technology, more complex and integrated, has required a transformation in the education of software professionals with the focus on the development of skills such as teamwork, real practice of problem-solving, managerial profile and analysis of solutions. In this context, the Problem-Based Learning (PBL) approach falls as a glove for the training of professionals in these competencies. From this motivation, this paper describes the application of the PBL approach in an Information Systems course. Aiming the effectiveness of this approach, the Framework described in (Santos and Rodrigues, 2016) was applied, which proposes tools for the planning, execution, monitoring, and improvements of PBL. The results showed the suitability of the Framework for this purpose, describing how it was applied and how the PBL can be managed, besides emphasizing main benefits and improvement points from this application.
The Software Engineering sector has been demanding an education model that targets real market practices more and more exactly. This includes bearing in mind that, in the market, a software project is subject to numerous restrictions of time, budget and other resources required for its development. In this context, this article describes the application of a learning methodology based on problems, called xPBL. This methodology consists of elements that enable a learning environment to be built that in its essence is practical and contains real learning, and that ensure that this is supported by processes that make it possible to evaluate the effectiveness of the PBL approach from various perspectives: namely, the student's, the teacher's and that of the methodological approach itself. Based on this case study, evidence of the applicability of xPBL is demonstrated as is how the behavior should be understood of all stakeholders involved in the process of teaching and learning in one of the most complex disciplines of Software Engineering.
In order to exploit the benefits of PBL and mitigate the risk of failure when implementing it, the NEXT (iNnovative Educational eXperience in Technology) research group has been working on methods and tools focused on managing the PBL approach as applied to Computing. In this context, this article proposes a teaching and learning methodology based on PBL, called xPBL, consisting of elements that reinforce PBL principles, namely: real and relevant problems; a practical environment; an innovative and flexible curriculum; an authentic assessment process; close monitoring by technical tutors and process tutors, and finally, professional practitioners as teachers and tutors. Based on these elements, the paper describes the design of a PBL approach for a Design course, grounded on acquired knowledge of Design content and past PBL experiences in Software Engineering courses. This approach provides an insightful guide to implementing PBL from xPBL methodology, and provides instruments based on management techniques such as 5W2H (what, why, who, when, where, how and how much) and the production of artifacts to support the conception process of courses based on PBL.
The continuous growth of the use of Information and Communication Technology in different sectors of the market calls out for software professionals with the qualifications needed to solve complex and diverse problems. Innovative teaching methodologies, such as the "Software Internship" model and PBL teaching approaches that are learner-centered and focus on bringing market reality to the learning environment, have been developed and implemented with a view to meeting this demand. However, the effectiveness of these methods cannot always be satisfactorily proved. Prompted by this, this paper proposes a model for assessing students based on real market practices while preserving the authenticity of the learning environment. To evaluate this model, a case study on skills training for software specialists for the Telecom market is discussed, and presents important results that show the applicability of the proposed model for teaching Software Engineering.
In computing courses, the teaching and learning approach normally emphasizes theoretical knowledge at the expense of practical knowledge. The major disadvantages of this approach are learners' lack of motivation during class and their quickly forgetting the knowledge they have acquired. With a view to overcoming these difficulties, Problem Based Learning (PBL), an institutional method of teaching, has been applied to teaching computing disciplines. Despite the growth of the practice of PBL in various disciplines of Computing, there is little evidence of its specific characteristics in this area, the effectiveness of different PBL methodological approaches, or of benefits and challenges encountered. In this context, this paper presents a systematic mapping study in order to identify studies which involve best practices when using the PBL method in Computing between 1997 and 2011, answering five research questions: “What are the main characteristics of PBL that support teaching in Computing?”; “What are the criteria for applying PBL effectively in this area?”; “How is the PBL methodology applied?”, “What are the advantages and benefits of applying PBL in Computing?” and, finally, “What are the main challenges about learning in PBL in Computing?”.
Many medical schools have moved towards problem-based learning (PBL). Unfortunately, the use of PBL in many medical schools has not been followed with appropriate changes in evaluation of students. Assessment of PBL needs to focus on the objectives that PBL fosters in conjunction with the educational course objectives. In an effort to appropriately assess PBL sessions, The School of Medicine Tec de Monterrey uses a criterion-based system that includes three checklists: 1) tutor assessment of students, 2) self-assessment, and 3) peer-assessment. Each checklist contains criteria that correspond to the four objectives (rubrics) of PBL: knowledge application, critical thinking, self-directed study and collaboration, and a fifth rubric for professionalism and attitude during the discussion. Course objectives are integrated within each of the rubrics. The three checklists are used for summative and formative purposes in all PBL core courses of the Basic Medical Sciences department and for the Gynecology PBL core clinical course. Although no quantifiable data have been obtained, the use of this criterion- based system has helped establish appropriate standards of performance. Additionally, it has assisted in identifying those students who are having trouble developing critical thinking and decision-making skills and has greatly fostered feedback to students. If PBL assessment is consistent with curricular goals and course learning objectives, validity of assessment is enhanced and subjectivity across instructors' evaluations can be diminished.
A problem for educators and the developers of interactive multimedia is the apparent incongruity between the demands of authentic assessment and the deliverables of computer‐based assessment. Lecturers wishing to use interactive multimedia are commonly limited to assessment using multiple choice tests which are easily marked by the computer.This article describes seven defining characteristics of authentic assessment which have been operationalized in a learning environment employing interactive multimedia. The article describes the multimedia program and its implementation with a class of pre‐service teachers. The implication of these findings for educational practice are that authentic assessment can be used within interactive multimedia learning environments, albeit not totally contained within the software itself. The qualitative study reported here showed that students responded favourably to the elements of authentic assessment; that they had a good understanding of the content of the interactive multimedia program; and that the assessment was corroborated by observation of teaching strategies used by the students in their teaching practice.
These words are formulated by Freire in Education for critical consciousness. We could formulate similar hypotheses: while all problem and project based learning (PBL) transitions involve change, not all PBL changes result in more comprehensive transition. If academic staff and students are not critically aware of the transition from a lecture-based curriculum to a problem and project based curriculum, contradictions increase between ways of knowing, acting and being in the traditional curriculum and an emerging curriculum.
Teaching Computer has led to the design of an educational model that is increasingly making use of market practices linked to business corporations. Within this scenario, a practical and dynamic learning system is being fostered that allows simulations to be carried out in real contexts through problem resolution. Based on constructivist theories, PBL (Problem-Based Learning) is a teaching method that is focused on the students and its main characteristic is that it uses real-world problems to create the learning content and teach the skills required for their solution. However, the adoption of this approach is not an easy task, since it is accompanied by abrupt changes in the traditional paradigm of education, which require changes in the attitudes of the actors involved. In addition, the planning and monitoring of the PBL, involve complex activities that are difficult to manage, especially with regard to determining the quality and compliance of the processes used for problem resolution. Additionally, the Computer Science courses require working on projects provided by real clients, within a dynamic and iterative development process. This strengthens the need to introduce strategies and technologies to support the implementation and management of the method and, enable its effectiveness to be monitored In addition, it provides continuous feedback, and assesses the results generated from the evaluation of the solutions produced during the teaching-learning process. Thus, it is essential to adopt strategies that allow a better management of teaching practice, improved learning by the students and a means of validating the clients involved. From this perspective, this paper presents a virtual teaching and learning environment, called PBLMaestro, which has been designed to support the workflow of a methodology for the implementation of PBL in teaching Computer Science, called xPBL. With the aid of xPBL, it is possible to perform the management of courses using the dynamics of a cycle and series of stages to allow a better control of management processes, by linking real problems to well-defined educational goals. In the case of teacher planning, we were used elements described in xPBL methodology, aligned with educational goals defined from the Bloom Revised Taxonomy. With regard to student tracking, we used the authentic assessment model and mechanisms of Learning Analytics. Gamification strategies were included to increase engagement, retention and motivation, and push notification messages were displayed in a mobile application the PBLMaestro was validated by means of application the environment in the context of the discipline “Network Design” of Computer Science Course, and the results are analyzed in this study. In addition, semi-structured interviews were conducted with the teachers and there was a high degree of satisfaction among the tutors, students and customers who used the service, with regard to the usability and consistency of the proposed environment as well as with its improvements and changes. Although the environment was improved in the area of computer science, it is possible that it can provide support to the STEM context with some customizations.
Ensuring satisfactory results by using problem-based learning in education in the Computing area is challenging. Faithfully maintaining the philosophy of PBL requires not only full compliance with its principles but also that its processes are managed efficiently. To facilitate the adoption of PBL, especially as to managing its processes, this article puts forward a framework based on Demig's PDCA cycle. The framework highlights its ability to re-use artifacts and recommends models for the stages of planning, implementation, monitoring and corrective actions. Special attention is paid to the components that are essential to the framework: xPBL methodology, maturity models, such as PBL-Test and valuation models, and authentic assessment. Results on the applicability of the framework during an under-graduate modular Computing course are also presented.
The problem-based learning (PBL) approach has been successfully applied to teaching software engineering thanks to its principles of group work, learning by solving real problems, and learning environments that match the market realities. However, the lack of well-defined methodologies and processes for implementing the PBL approach represents a major challenge. The approach requires great flexibility and dynamism from all involved, whether in mapping content, in teacher performance, or laying out the process of how learners should go about solving problems. This paper suggests that management processes can help in implementing PBL throughout its life cycle (planning, implementation, monitoring, and enhancement), and proposes an assessment model called PBL-SEE for use in software engineering education (SEE). Two examples of its use are provided. The results show how the model can be applied and how the resulting information can be used to make the PBL initiatives "authentic," in that they bring the reality of the labor market to the learning environment, while keeping to PBL principles.
This book provides guidelines for practicing design science in the fields of information systems and software engineering research. A design process usually iterates over two activities: first designing an artifact that improves something for stakeholders and subsequently empirically investigating the performance of that artifact in its context. This validation in context is a key feature of the book - since an artifact is designed for a context, it should also be validated in this context.
Given the demand in the area of Software Engineering for solutions that actually contribute to modern organizations, the search for qualified professionals who have considerable practical experience has been growing day-by-day. Set against this background is the learning process of traditional teaching, in which the Student is largely a mere recipient of information, including concepts and theoretical foundations, and is seldom given practice in problem solving. Therefore with a view to minimizing this problem, teaching and learning methods such as the Problem Based Learning (PBL) have emerged in higher education as an approach to foster changes in teaching and learning processes, which are aligned to the new requirements of the labor market and redefine the roles of those involved in educational processes. To evaluate these processes, a case study on skills training to teach Usability Testing is discussed, and important results presented that show the applicability of the proposed approach for teaching Software Engineering.
Problem-based learning (PBL) is now widely acknowledged and regarded for its educational and training objectives. Assessment plays an important role in PBL and can be a multi-faceted activity and a key factor influencing the way students learn and respond to teaching. Teachers, peers, and self-assessment should all make an appropriate contribution to the final assessment. A comprehensive model of formative and summative assessment for use in computer courses is presented.
Collaborative learning and problem-based learning are two approaches to pedagogy that have been used in many academic disciplines. Treisman was successful in creating a learning environment in first-year calculus that combines both of these approaches. His model has been replicated in many science and engineering programs, but few computer science programs have adopted it. This paper describes the design and implementation of such a learning environment for courses in the beginning sequence of a computer science program.
this paper is to provide a clear link between the theoretical principles of constructivism and the practice of instructional design and the practice of teaching. We will begin with a basic characterization of constructivism identifying what we believe to be the central principles in learning and understanding. We will then identify and elaborate on eight instructional principles for the design of a constructivist learning environment. Finally, we will exam what we consider to be one of the best exemplars of a constructivist learning environment -- Problem Based Learning as described by Barrows (1985, 1986, 1992) at the Southern Illinois University Medical School and at the Problem Based Learning Institute for high school teachers .
Assessment in Problem Based Learning connected with IT Engineering Education
- tuohi
R. Tuohi, "Assessment in Problem Based Learning connected with IT
Engineering Education", International Conference on Engineering
Education & Research December 2-7, 2007 Melbourne, Australia.
Selfregulated learning: From teaching to self-reflective practice
- D H Schunk
- Zimmerman
Schunk, D.H., & Zimmerman, B.J. (Eds.). (1998). Selfregulated
learning: From teaching to self-reflective practice. New York:
Guilford Press.
What is your temperament
- D Keirsey
Keirsey, D. "What is your temperament?" https://www.keirsey.com/
[25] UPE -http://www.upe.br/garanhuns
Design Science Methodology for Information Systems and Software Engineering
- J R Weringa
J. R. Weringa, "Design Science Methodology for Information
Systems and Software Engineering". Springer, 2014.
Meaningful learning with technology
- Jane L Howland
- David H Jonassen
- Marra
- M Rose
Howland, Jane L.; Jonassen, David H.; Marra, Rose M. Meaningful
learning with technology. Upper Saddle River, NJ: Pearson, 2012.
PBL Curriculum Strategies from Course Based PBL to a Systemic PBL Approach
- kolmos