Conference Paper

Augmented Reality Enhanced Analytics to Measure and Mitigate Disengagement in Teaching Young Children

Authors:
To read the full-text of this research, you can request a copy directly from the authors.

No full-text available

Request Full-text Paper PDF

To read the full-text of this research,
you can request a copy directly from the authors.

... Singh et al. [90] explored how augmented reality-enhanced analytics can be used to measure young learners' engagement. Their proposed system uses various learning analytics components and integrates them into an augmented reality application. ...
Article
Full-text available
This study aims to examine the combination of educational data mining and learning analytics with virtual reality, augmented reality, mixed reality, and the metaverse, its role in education, and its impact on teaching and learning. Therefore, a systematic literature review, a bibliometric and scientific mapping analysis, and a content analysis are carried out based on 70 relevant documents identified from six databases, namely, ACM, ERIC, IEEE, ScienceDirect, Scopus, and Web of Science (WoS) following the PRISMA framework. The documents were separated into the following three categories, (i) Theoretical and Review studies, (ii) Proposal and Showcase studies, and (iii) Experimental and Case studies and were examined from different dimensions through an in-depth content analysis using both quantitative and qualitative approaches. The documents were further analyzed using scientometric tools, such as Bibliometrix and VOSviewer and topic modeling through Latent Dirichlet Allocation (LDA). The most prominent topics, areas, and themes were revealed and the outcomes regarding the influence of this combination on learning and teaching were summarized. Based on the results, this combination can effectively enrich education, positively affect learning and teaching, offer deep and meaningful learning, and support both students and teachers. Additionally, it can support different educational approaches and strategies, various learning styles, and special education and be utilized in both formal and informal learning environments. The real-time identification, tracking, monitoring, analysis, and visualization of multimodal learning data of students’ behavior, emotions, cognitive and affective states and the overall learning and teaching processes emerged as a significant benefit that contributes greatly to the realization of adaptive and personalized learning. Finally, it was revealed that the combination of extended reality technologies with learning analytics and educational data mining can support collaborative learning and social learning, improve students’ self-efficacy and self-regulated learning, and increase students’ learning gains, academic achievements, knowledge retention, motivation, and engagement.
Chapter
Learning Analytics (LA) are constantly evolving in the analysis and representation of data related to learners and educators to improve the learning and education process. Data obtained by sensors or questionnaires are processed employing new technologies. The emotional experiences of learners constitute a significant factor in the assimilation of knowledge about the learning process. The emerging technology of Emotional Learning Analytics (ELA) is increasingly being considered in educational settings. In this work, the significance and contribution of ELA in educational data processing are discussed as an integral part of designing and implementing computational models reflecting the learning process. In addition, a comprehensive overview of different methods and techniques for both LA and ELA is provided, while a conceptual model of ELA is proposed in parallel. Moreover, advantages, disadvantages, and challenges are highlighted. The final focus of the chapter is on ethical issues and future research directions.
Article
Full-text available
New teaching methodologies are nowadays integrating mobile devices, augmented reality (AR), and game-based learning in educational contexts. The combination of these three elements is considered highly innovative, and it allows learning to move beyond traditional classroom environments to nature spaces that students can physically explore. The literature does not present many studies of this approach's educational value. The purpose of the study is to present an illustrative case of a mobile AR game in order to analyse its educational value based on the users' opinion, both teachers and students, and on logs of game results. Through a mixed method approach, the educational value scale was applied to 924 users after playing the EduPARK app in a Green City Park. Results revealed high educational value scores, especially among teachers and students of 2nd and 3rd Cycles of Basic Education (83.0 for both). Hence, this particular software seems to be more suitable for 10-15 years-old students who highlighted motivational features, such as treasure hunting, points gathering, the use of mobile devices in nature settings, and AR features to learn. This study empirically revealed that mobile AR games have educational value, so these specific game features might be useful for those who are interested in creating or using games supported by apps for educational purposes.
Conference Paper
Full-text available
The paper discusses the use of virtual (VR) and augmented (AR) reality for visual analytics in information security. Paper answers two questions: “In which areas of information security visualization VR/AR can be useful?” and “What is the difference of the VR/AR from similar methods of visualization at the level of perception of information?”. The first answer is based on the investigation of information security areas and visualization models that can be used in VR/AR security visualization. The second answer is based on experiments that evaluate perception of visual components in VR.
Article
Full-text available
One of the greatest advantages of augmented reality (AR) in education is that AR increases student motivation. Nevertheless, there is a gap between the research on student motivation in AR and the definition of frameworks to inform and guide the design and development of AR applications that effectively support student motivation. In this paper, we attempt to bridge that gap as we introduce and evaluate a framework for designing motivational AR applications. Our framework has been built upon three theoretical foundations: motivational design, universal design for learning and co-creation. The evaluation study was conducted with 58 chemistry students enrolled in the vocational education and training (VET) program for Laboratory Operations, and we found that the framework not only effectively supports the four dimensions of Keller's (2010) ARCS (attention, relevance, confidence and satisfaction) model of motivation, but also demonstrates exceptional results in the Attention and Confidence dimensions of motivation.
Article
Full-text available
Scientific advances build on reproducible research which need publicly available benchmark datasets. The computer vision and speech recognition communities have led the way in establishing benchmark datasets. There are much less datasets available in mobile computing, especially for rich locomotion and transportation analytics. This paper presents a highly versatile and precisely annotated large-scale dataset of smartphone sensor data for multimodal locomotion and transportation analytics of mobile users. The dataset comprises 7 months of measurements, collected from all sensors of 4 smartphones carried at typical body locations, including the images of a body-worn camera, while 3 participants used 8 different modes of transportation in the southeast of the United Kingdom, including in London. In total 28 context labels were annotated, including transportation mode, participant’s posture, inside/outside location, road conditions, traffic conditions, presence in tunnels, social interactions, and having meals. The total amount of collected data exceed 950 GB of sensor data, which corresponds to 2812 hours of labelled data and 17562 km of traveled distance. We present how we set up the data collection, including the equipment used and the experimental protocol. We discuss the dataset, including the data curation process, the analysis of the annotations and of the sensor data. We discuss the challenges encountered and present the lessons learned and some of the best practices we developed to ensure high quality data collection and annotation. We discuss the potential applications which can be developed using this large-scale dataset. In particular, we present how a machine-learning system can use this dataset to automatically recognize modes of transportations. Many other research questions related to transportation analytics, activity recognition, radio signal propagation and mobility modelling can be adressed through this dataset. The full dataset is being made available to the community, and a thorough preview is already published 1.
Article
Full-text available
Augmented Reality (AR) has been used in various contexts in recent years in order to enhance user experiences in mobile and wearable devices. Various studies have shown the utility of AR, especially in the field of education, where it has been observed that learning results are improved. However, such applications require specialized teams of software developers to create and maintain them. In an attempt to solve this problem and enable educators to easily create AR content for existing textbooks, the ARTutor platform was developed. It consists of a web-based application that acts as an AR authoring tool, and an accompanying mobile application that is used to access and interact with the educational AR content. In addition, the ARTutor application allows students to ask questions verbally and receive answers based on the contents of the book. This means that the system is suitable for distance learning and promotes self-study and independent learning.
Article
We present Mobile Augmented-Reality Games for Instructional Support (MAGIS), a framework for the development of mobile augmented-reality (AR) games for education. The framework supports off-the-shelf, state-of-the-art technologies that enable AR tracking and rendering on consumer-level mobile devices, and integrates these technologies with content-generation tools that simplify the development of educational AR games, especially those that extensively use narrative-based game design and player-location tracking such as location-based historical or museum adventure games. We use Igpaw: Intramuros, a proof-of-concept game developed using MAGIS, to help describe the current state of the framework and to show its efficacy for implementing outdoor location-based educational games, and we briefly outline future development plans to improve MAGIS’ AR support (especially those involving indoor scenarios) as well as to improve the instructional design and authoring phases of AR applications written using this framework.
Conference Paper
We present a concept for analyzing user experiences in immersive virtual environments. Filtering World-in-Miniatures (FWIMs) contain, visualize, and aggregate records from user experiences, with a focus on comparing users' behaviors. Analysts use an immersive virtual reality system to manipulate FWIMs and their visualization and filtering settings within an analytics virtual environment. FWIMs also allow an analyst to enter the virtual experience from users' perspectives. We discuss how we mapped the concept to the analysis of data from a VR anatomy education experience.
Conference Paper
We present Mobile Augmented-Reality Games for Instructional Support (MAGIS), a framework for the development of mobile augmented-reality (AR) games for education. The framework supports off-the-shelf, state-of-the-art technologies that enable AR tracking and rendering on consumer-level mobile devices, and integrates these technologies with content generation tools that simplify the development of educational AR games, especially those that extensively use narrative-based game design and player-location tracking such as location-based historical or museum adventure games. We use Igpaw: Intramuros, a proof-of-concept game developed using MAGIS, to help describe the current state of the framework, and we briefly outline future development plans.
Article
This paper introduces the use of Augmented Reality as an immersive analytical tool in the physical world. We present Situated Analytics, a novel combination of real-time interaction and visualization techniques that allows exploration and analysis of information about objects in the user's physical environment. Situated Analytics presents both situated and abstract summary and contextual information to a user. We conducted a user study to evaluate its use in three shopping analytics tasks, comparing the use of a Situated Analytics prototype with manual analysis. The results showed that users preferred the Situated Analytics prototype over the manual method, and that tasks were performed more quickly and accurately using the prototype.
Chapter
Virtual worlds in education, intelligent tutorial systems, and learning analytics – all these are current buzz words in recent educational research. In this paper we introduce ProNIFA, a tool to support theory-grounded learning analytics developed in the context of the European project Next-Tell. Concretely we describe a log file analysis and presentation module to enable teachers making effectively use of educational scenarios in virtual worlds such as OpenSimulator or Second Life.
Article
Research on the effectiveness of augmented reality (AR) on learning exists, but there is a paucity of empirical work that explores the role that positive emotions play in supporting learning in such settings. To address this gap, this study compared undergraduate students’ emotions and learning outcomes during a guided historical tour using mobile AR applications. Data was collected in a laboratory (Study 1; N = 13) and outdoors (Study 2; N = 18) from thirty-one undergraduate students at a large North American university. Our findings demonstrated that learners were able to effectively and enjoyably learn about historical differences between past and present historical locations by contextualizing their visual representations, and that the two mobile AR apps were effective both in and outside of the laboratory. Learners were virtually situated in the historical location in Study 1 and physically visited the location in Study 2. In comparing results between studies, findings revealed that learners were able to identify more differences outdoors and required less scaffolding to identify differences. Learners reported high levels of enjoyment throughout both studies, but more enjoyment and less boredom in the outdoor study. Eye tracking results from Study 1 indicated that learners frequently compared historical information by switching their gaze between mobile devices and a Smart Board, which virtually situated them at the historical location. Results enhance our understanding of AR applications’ effectiveness in different contexts (virtual and location-based). Design recommendations for mobile AR apps are discussed.
Conference Paper
The relative ubiquity of high powered mobile devices and increasing high speed connectivity offers new opportunities for educators. On the App stores, the freemium model has gained popularity to such an extent that the majority of games are now free to play. This type of business model depends on the ability to record, analyze and interpret analytics and metrics to finesse the user experience and plan future iterations of a product to ensure a high level of user retention and monetization. This paper explores the use of analytics in an educational context to measure student engagement and retention. A mobile version of the Circuit Warz project is introduced and demonstrates how engineering education can be completely reimagined to create immersive and highly engaging student learning experiences.
Article
In this paper, it is advocated that the feedback loop between learners and teachers could be improved by making use of augmented reality ( AR ) techniques. The bidirectional communication between teacher and learners is sometimes hampered by students' fear of showing themselves up in front of their classmates. In order to overcome this problem, a system is proposed whereby teachers receive immediate and private feedback both individualised for each student as well as aggregated for the whole class. With that purpose, the teacher, who is equipped with a head‐mounted AR display, can visualise symbols that represent the status students have stated using private devices in relation to the lecture content. In order to explore the possibilities of this approach, an experience was conducted in a lecture on a university course. The results are encouraging and suggest that as this technology matures and less intrusive AR display models become available, it could provide effective support to improve communication and interaction during lectures. A video abstract of this article can be viewed at http://www.youtube.com/watch?v=qUCkNkuAiK8
Article
Augmented reality (AR) is currently considered as having potential for pedagogical applications. However, in science education, research regarding AR-aided learning is in its infancy. To understand how AR could help science learning, this review paper firstly has identified two major approaches of utilizing AR technology in science education, which are named as image-based AR and location-based AR. These approaches may result in different affordances for science learning. It is then found that students’ spatial ability, practical skills, and conceptual understanding are often afforded by image-based AR and location-based AR usually supports inquiry-based scientific activities. After examining what has been done in science learning with AR supports, several suggestions for future research are proposed. For example, more research is required to explore learning experience (e.g., motivation or cognitive load) and learner characteristics (e.g., spatial ability or perceived presence) involved in AR. Mixed methods of investigating learning process (e.g., a content analysis and a sequential analysis) and in-depth examination of user experience beyond usability (e.g., affective variables of esthetic pleasure or emotional fulfillment) should be considered. Combining image-based and location-based AR technology may bring new possibility for supporting science learning. Theories including mental models, spatial cognition, situated cognition, and social constructivist learning are suggested for the profitable uses of future AR research in science education.
Commissioner for Children and Young People
  • J Kirsten
  • Stephen Hancock
  • Zubrick
Framework for designing motivational augmented reality applications in vocational education and training
  • luis
MAGIS: mobile augmented-reality games for instructional support
  • cesar
Commissioner for Children and Young People
  • hancock
Callaghan, Niall McShane, and A Gomez Eguiluz. Using game analytics to measure student engagement/retention for engineering education
  • james