No full-text available
To read the full-text of this research,
you can request a copy directly from the authors.
Striking a Balance: User-Experience and Performance in Computerized Game-Based Assessment
Abstract
Game-based assessment (GBA) is a new frontier in the assessment industry. However, as with serious games, it will likely be important to find an optimal balance between making the game “fun” versus focusing on achieving the educational goals. We created two minigames to assess students’ knowledge of argumentation skills. We conducted an iterative counter-balanced pre-survey-interaction-post-survey study with 124 students. We discovered that game presentation sequence and game perceptions are related to performance in two games with varying numbers of game features and alignment to educational content. Specifically, understanding how to play the games is related to performance when users start with a familiar environment and move to one with more game features, whereas enjoyment is related to performance when users start with a more gamified experience before moving to a familiar environment.
... We noted that the authors used two significant families of machine learning methods: supervised learning and unsupervised learning. Supervised learning includes techniques such as regression [81] while unsupervised learning uses other methods, such as clustering techniques like k-means [12] or dimensionality reduction techniques like Principal Component Analysis (PCA) [82]. For example, the authors in [83] developed a game for evaluating the logic abilities of first-year university students. ...
Technology has become an essential part of our everyday life, and its use in educational environments keeps growing. In addition, games are one of the most popular activities across cultures and ages, and there is ample evidence that supports the benefits of using games for assessment. This field is commonly known as game-based assessment (GBA), which refers to the use of games to assess learners' competencies, skills, or knowledge. This paper analyzes the current status of the GBA field by performing the first systematic literature review on empirical GBA studies. It is based on 65 research papers that used digital GBAs to determine: (1) the context where the study has been applied; (2) the primary purpose; (3) the domain of the game used; (4) game/tool availability; (5) the size of the data sample; (6) the computational methods and algorithms applied; (7) the targeted stakeholders of the study; and (8) what limitations and challenges are reported by authors. Based on the categories established and our analysis, the findings suggest that GBAs are mainly used in K-16 education and for assessment purposes, and that most GBAs focus on assessing STEM content, and cognitive and soft skills. Furthermore, the current limitations indicate that future GBA research would benefit from the use of bigger data samples and more specialized algorithms. Based on our results, we discuss current trends in the field and open challenges (including replication and validation problems), providing recommendations for the future research agenda of the GBA field.
One strength of educational games stems from their potential to increase students’ motivation and engagement during educational tasks. However, game features may also detract from principle learning goals and interfere with students’ ability to master the target material. To assess the potential impact of game-based learning environments, in this study we examined motivation and learning for 84 high-school students across eight 1-hr sessions comparing 2 versions of a reading strategy tutoring system, an intelligent tutoring system (iSTART) and its game-based version (iSTART–ME). The results demonstrate equivalent target task performance (i.e., learning) across environments at pretest, posttest, and retention, but significantly higher levels of enjoyment and motivation for the game-based system. Analyses of performance across sessions reveal an initial decrease in performance followed by improvement within the game-based training condition. These results suggest possible constraints and benefits of game-based training, including time-scale effects. The findings from this study offer a potential explanation for some of the mixed findings within the literature and support the integration of game-based features within intelligent tutoring environments that require long-term interactions for students to develop skill mastery. (PsycINFO Database Record (c) 2013 APA, all rights reserved)
Within the intelligent tutoring systems community, narrative is emerging as an effective medium for contextualizing learning. To date, relatively few empirical studies have been conducted to assess learning in narrative-centered learning environments. In this paper, we investigate the effect of narrative on learning experiences and outcomes. We present results from an experiment conducted with eighth-grade middle school students interacting with a narrative-centered learning environment in the domain of microbiology. The study found that students do exhibit learning gains, that those gains are less than those produced by traditional instructional approaches, but that the motivational benefits of narrative-centered learning with regard to self-efficacy, presence, interest, and perception of control are substantial.
Good computer and video games like System Shock 2, Deus Ex, Pikmin, Rise of Nations, Neverwinter Nights, and Xenosaga: Episode 1 are learning machines. They get themselves learned and learned well, so that they get played long and hard by a great many people. This is how they and their designers survive and perpetuate themselves. If a game cannot be learned and even mastered at a certain level, it won't get played by enough people, and the company that makes it will go broke. Good learning in games is a capitalist-driven Darwinian process of selection of the fittest. Of course, game designers could have solved their learning problems by making games shorter and easier, by dumbing them down, so to speak. But most gamers don't want short and easy games. Thus, designers face and largely solve an intriguing educational dilemma, one also faced by schools and workplaces: how to get people, often young people, to learn and master something that is long and challenging--and enjoy it, to boot.
How can we make sure that our children are learning to be creative thinkers in a world of global competition - and what does that mean for the future of education in the digital age? David Williamson Shaffer offers a fresh and powerful perspective on computer games and learning. How Computer Games Help Children Learn shows how video and computer games can help teach children to build successful futures - but only if we think in new ways about education itself. Shaffer shows how computer and video games can help students learn to think like engineers, urban planners, journalists, lawyers, and other innovative professionals, giving them the tools they need to survive in a changing world. Based on more than a decade of research in technology, game science, and education, How Computer Games Help Children Learn revolutionizes the ongoing debate about the pros and cons of digital learning.
Cognitive load during problem solving: effects on learning
- J Sweller