No full-text available
To read the full-text of this research,
you can request a copy directly from the authors.
MAGIS: mobile augmented-reality games for instructional support (short paper)
Abstract
We present Mobile Augmented-Reality Games for Instructional Support (MAGIS), a framework for the development of mobile augmented-reality (AR) games for education. The framework supports off-the-shelf, state-of-the-art technologies that enable AR tracking and rendering on consumer-level mobile devices, and integrates these technologies with content generation tools that simplify the development of educational AR games, especially those that extensively use narrative-based game design and player-location tracking such as location-based historical or museum adventure games. We use Igpaw: Intramuros, a proof-of-concept game developed using MAGIS, to help describe the current state of the framework, and we briefly outline future development plans.
... It provides an online tool for creating location-based interactive assignments, and for composing and playing location-based quiz games. Igpaw Intramuros [12] is a virtual tour game that encourages players to navigate through several historical markers within a city, to learn about their historical significance. Along the way, players can provide "help" to troubled historical characters in a traditional adventure-game setting, enhanced with augmented reality. ...
... [11] 2017 Help students in their biology course in a zoo. [12] 2016 Encourage players to navigate through several historical markers of a city to learn about their historical significance. [13] 2018 Teach the history of the Venetian walls of the city of Heraklion. ...
... [11] Not evaluated. - [12] Not evaluated. - [13] Not evaluated. ...
With the universal use of mobile computing devices, there has been a notable increase in the number of mobile applications developed for educational purposes. Gamification strategies offer a new set of tools to educators and, combined with the location services provided by those devices, allow the creation of innovative location-based mobile learning experiences. In this literature review, we conduct an analysis of educational mobile location-based games. The review includes articles published from January of 2010 to October of 2020, and from 127 records screened, 26 articles were analysed in full-text form. This analysis allowed us to answer the following six predefined research questions: Who are the target audiences for location-based games? In which subjects are location-based games most used? Which strategies are implemented with mobile devices to improve the student’s learning process? What are the main impacts of location-based games on students’ learning? What are the main challenges to the development of location-based games for education? What future tendencies and research opportunities can be identified from the analysis of the current state of the art?
... Hwang et al. (2016) [49] TW Learn about butterflies in a butterfly garden via a location-aware AR board game. Igpaw (2016) [50] PH Learn history in a location-based AR adventure game. Lan (2013) [51] SG Learn to be a responsible pet owner in a quiz game guided by animated 3D characters. ...
... UniRallye (2015) [63] DE Improves navigation skills with an AR treasure hunt game. [36] Energy awareness n/a Informal (any) Qualitative (n/a) AREEF [37] Environmental awareness Grades 1-6 Informal (swimming pool) Mixed-method (36) ARmatika [38] Arithmetics Grades 1-6 Formal Quantitative (30) ARMuseum [39] Oil production Grades 4-6 Informal (museum) -Astrid's spår [40] Culture Lifelong learners Informal (museum) Qualitative (20) Calory Battle AR [6] Physical exercise/any Grades 1-9 Informal (outdoors) Mixed-method (61) Conserv-AR [41] Environment conservation n/a Informal (nature) -EduPARK [42] Any Grades 3-7 Informal (park) Mixed-method (74) Electric Agents [43] Literacy (vocabulary) Grades K-4 Informal (livingroom) Qualitative (34) Eleftheria et al. [44] Science Grades 4-6 Formal/Informal -Furio et al. [45] Water cycle Grades 2-4 Formal Mixed-method (79) Furio et al. [46] Diversity, tolerance, solidarity Grades 2-4 Formal Mixed-method (84) Hsu [47] English Grade 3 Formal Quantitative (38) HUNT [48] n/a n/a Informal (any) -Hwang et al. [49] Ecology Grade 5 Informal (butterfly garden) Quantitative (57) Igpaw [50] History Lifelong Informal (city) -Lan [51] Pet ownership Grades 1-6 Informal (any) -Leometry [52] Geometry Grades 5-6 Informal (any) Mixed-method (29) Lin et al. [53] Geometry Grades 1-6 Formal Mixed-method (21) Luostarinmäki Adventure [54] History Lifelong Informal (museum) Mixed-method (56) Martinez Zarzuela et al. [55] Animals n/a Informal (any) Qualitative (5) NatureAR [56] Biology Grades K-6 Informal (nature) Qualitative (11) Parallel [57] Electromagnetism Higher education Formal Qualitative (150) PasswARG [58] Any Any Formal/Informal Quantitative (55) REENACT [59] History Lifelong Informal (cultural center) Mixex-method (61) Secret SLQ [60] Library education Grades 2-8 Informal (library) Qualitative (7) Table Mystery [61] Chemistry Grades 5-7 Informal (science center) Qualitative (9) Tangram AR [62] Spatial reasoning Grades 1-6 Formal -UniRallye [63] Navigation Higher education Informal (university campus) Mixed-method (30) The reviewed EMARGs were created for a wide range of pedagogical purposes. Mathematics was the most popular subject, including elementary areas such as fractions [34], geometry [52,53] and arithmetics [38]. ...
... Most EMARGs were created for primary school children, to be used in informal pedagogical settings, such as in science centers [61], libraries [60], in nature [41,49,56] or in museums [39,40], thus demonstrating how augmented content can enrich situated learning [64] experiences in authentic contexts. A few games targeted at higher education [57,63] or lifelong learners (i.e., any age group) [50,54,59]. The EMARGS that are marked as having formal contexts were created for and evaluated in classroom environments; however, many of them are context-independent and therefore can be played in anywhere (e.g., at home). ...
Augmented reality (AR) has evolved from research projects into mainstream applications that cover diverse fields, such as entertainment, health, business, tourism and education. In particular, AR games, such as Pokémon Go, have contributed to introducing the AR technology to the general public. The proliferation of modern smartphones and tablets with large screens, cameras, and high processing power has ushered in mobile AR applications that can provide context-sensitive content to users whilst freeing them to explore the context. To avoid ambiguity, I define mobile AR as a type of AR where a mobile device (smartphone or tablet) is used to display and interact with virtual content that is overlaid on top of a real-time camera feed of the real world. Beyond being mere entertainment, AR and games have been shown to possess significant affordances for learning. Although previous research has done a decent job of reviewing research on educational AR applications, I identified a need for a comprehensive review on research related to educational mobile AR games (EMARGs). This paper explored the research landscape on EMARGs over the period 2012–2017 through a systematic literature review complemented by two case studies in which the author participated. After a comprehensive literature search and filtering, I analyzed 31 EMARGs from the perspectives of technology, pedagogy, and gaming. Moreover, I presented an analysis of 26 AR platforms that can be used to create mobile AR applications. I then discussed the results in depth and synthesized my interpretations into 13 guidelines for future EMARG developers.
The article won the 2019 Computers Best Paper Award.
... Vidal et al [13] have proposed Intramuros -an AR, narrative-based, adventure game where users navigate through Intramuros, Manila, the Philippines using historical markers located at historical sites throughout the city. Along the way, users can "help" troubled historical figures such as Jose Rizal and Pope John Paul II. ...
Evacuation training is critical to the survival of building occupants in the event of an emergency. Live evacuation drills and two-dimensional (2D) floor plans have been the conventional way of informing people of proper evacuation procedures. However, people may not be able to participate in live evacuation drills due to time constraints. Also, 2D floor plans do not provide the perspective and imagery needed to thoroughly know the building layout and, ultimately, the evacuation path that is needed to be taken during an emergency. Augmented reality (AR) has been shown to captivate users, helping them retain information, and do not require users to be present in the environment being simulated. Thus, this work comprises an AR application being built to help users evacuate a building. The application was built for Microsoft HoloLens, a device offering users a 3D, holographic view of building floor plans so that they can have a better perspective of the building, making it easier for them to find a way out of the building during the evacuation. This paper proposes an architecture and describes the design and implementation of an AR application to leverage the Microsoft HoloLens for building evacuation purposes. Pilot studies were conducted with the system showing its partial success and demonstrated the effectiveness of the application in an emergency evacuation.
In this paper a sensor fusion algorithm is developed and implemented for detecting orientation in three dimensions. Tri-axis MEMS inertial sensors and tri-axis magnetometer outputs are used as input of fusion system. A Kalman filter is designed to compensate the inertial sensors errors by combining accelerometer and gyroscope data. A tilt compensation unit is designed to calculate the heading of the system.
The recent fusion of Augmented Reality (AR) and mobile technologies has enabled the creation of novel mobile AR applications.
As the image processing algorithms and processing capabilities of mobile hardware continue to improve, mobile AR will become
more commonplace. In addition, the mobile game industry itself has grown significantly in recent years. This is partly because
of the development of 3D game engines which are being widely used not only in game applications, but also in the areas of
virtual reality, virtual architecture, and education.
In augmented reality (AR), the position and orientation of the camera have to be estimated with high accuracy and low latency. This nonlinear estimation problem is studied in the present paper. The proposed solution makes use of measurements from inertial sensors and computer vision. These measurements are fused using a Kalman filtering framework, incorporating a rather detailed model for the dynamics of the camera. Experiments show that the resulting filter provides good estimates of the camera motion, even during fast movements
Within the last years educational games have attracted some attention from the academic community. Multiple enhancements of the learning experience are usually attributed to educational games, although the most cited is their potential to improve students' motivation. In spite of these expected advantages, how to introduce video games in the learning process is an issue that is not completely clear yet, which reduces the potential impact of educational video games. Our goal at the <;e-UCM> research group is to identify the barriers that are limiting the integration of games in the learning process and propose approaches to tackle them. The result of this work is the <;e-Adventure> platform, an educational game authoring tool that aims to make of video games just another educational tool at the disposal of the instructors. In this paper we describe how <;e-Adventure> contributes to the integration of games in the learning process through three main focuses: reduction of the high development costs of educational games, involvement of instructors in the development process to enhance the educational value, and the production of the games using a white-box model. In addition we describe the current research that we are conducting using the platform as a test-bed.
This paper presents a model-based hybrid tracking system for out- door augmented reality in urban environments enabling accurate, realtime overlays for a handheld device. The system combines several well-known approaches to provide a robust experience that surpasses each of the individual components alone: an edge-based tracker for accurate localisation, gyroscope measurements to deal with fast motions, measurements of gravity and magnetic field to avoid drift, and a back store of reference frames with online frame selection to re-initialise automatically after dynamic occlusions or failures. A novel edge-based tracker dispenses with the conven- tional edge model, and uses instead a coarse, but textured, 3D model. This yields several advantages: scale-based detail culling is automatic, appearance-based edge signatures can be used to im- prove matching and the models needed are more commonly avail- able. The accuracy and robustness of the resulting system is demon- strated with comparisons to map-based ground truth data.
This paper presents an innovative 3D reconstruction of ancient fresco paintings through the real-time revival of their fauna and flora, featuring groups of virtual animated characters with artificial-life dramaturgical behaviours in an immersive, fully mobile augmented reality (AR) environment. The main goal is to push the limits of current AR and virtual storytelling technologies and to explore the processes of mixed narrative design of fictional spaces (e.g. fresco paintings) where visitors can experience a high degree of realistic immersion. Based on a captured/real-time video sequence of the real scene in a video-see-through HMD set-up, these scenes are enhanced by the seamless accurate real-time registration and 3D rendering of realistic complete simulations of virtual flora and fauna (virtual humans and plants) in a real-time storytelling scenario-based environment. Thus the visitor of the ancient site is presented with an immersive and innovative multi-sensory interactive trip to the past
Two major limitations of real-time visual SLAM algorithms are the restricted range of views over which they can operate and their lack of robustness when faced with erratic camera motion or severe visual occlusion. In this paper we describe a visual SLAM algorithm which addresses both of these problems. The key component is a novel feature description method which is both fast and capable of repeat-able correspondence matching over a wide range of viewing angles and scales. This is achieved in real-time by using a SIFT-like spatial gradient descriptor in conjunction with efficient scale prediction and exemplar based feature representation. Results are presented illustrating robust realtime SLAM operation within an office environment.
We describe an augmented reality conferencing system which uses the overlay of virtual images on the real world. Remote collaborators are represented on virtual monitors which can be freely positioned about a user in space. Users can collaboratively view and interact with virtual objects using a shared virtual whiteboard. This is possible through precise virtual image registration using fast and accurate computer vision techniques and head mounted display (HMD) calibration. We propose a method for tracking fiducial markers and a calibration method for optical see-through HMD based on the marker tracking
We present work on a tablet- and smartphone-based Augmented Reality game application for learning Philippine History. This paper highlights the design of the game application with regards to its educational content, game mechanics, and user interface, discussing how these elements combine to enjoin players to learn about Philippine history while visiting the actual historical locations situated in Intramuros, Manila.
We investigate the extent to which Augmented Reality can contribute to effectiveness and enjoyment in the context of history-game-based learning. This paper presents a series of usability tests of a mobile Augmented Reality game application for learning Philippine history, Igpaw: Intramuros, with representatives of the game's target audience. These tests discovered issues that compromised player enjoyment, including fatigue during gameplay, hurdles in learning AR-specific game mechanics, game repetitiveness, and outdoor safety concerns, in addition to minor technical issues. Nevertheless, the tests show the game's high effectivity in teaching Philippine history.
In this paper a sensor fusion algorithm is developed and implemented for detecting orientation in three dimensions. Tri-axis MEMS inertial sensors and tri-axis magnetometer outputs are used as input to the fusion system. A Kalman filter is designed to compensate the inertial sensors errors by combining accelerometer and gyroscope data. A tilt compensation unit is designed to calculate the heading of the system.
We present MARCH, a complete solution for enhanced cultural heritage discovery using the mobile phone. Simply point the camera of a mobile device at prehistoric cave engravings. Then MARCH augments the captured images with the expert's drawings, highlighting in real time the animal engravings, which are almost impossible to observe with the naked eye. We have created a mobile augmented reality application which runs at 14 FPS for 320x240 frames on a Nokia N95 smartphone. We describe the optimizations and the requirements needed to obtain these results on mobile devices.
Explore! is an m-learning system that aims to improve young visitors' experience of historical sites. It exploits the imaging and multimedia capabilities of the latest generation cell phone, creating electronic games that support learning of ancient history during a visit to historical sites. Explore! consists of two main components: 1) the Game Application running on cellular phones, to be used during the game and 2) the Master Application running on a notebook, used by the game master (i.e. a teacher) to perform a reflection phase, which follows the game. Having the Game Application been described in previous papers, in this work we mainly illustrate the Master Application.
In Augmented Reality, see-through HMDs superimpose virtual 3D objects on the real world. This technology has the potential to enhance a user's perception and interaction with the real world. However, many Augmented Reality applications will not be accepted until we can accurately register virtual objects with their real counterparts. In previous systems, such registration was achieved only from a limited range of viewpoints, when the user kept his head still. This paper offers improved registration in two areas. First, our system demonstrates accurate static registration across a wide variety of viewing angles and positions. An optoelectronic tracker provides the required range and accuracy. Three calibration steps determine the viewing parameters. Second, dynamic errors that occur when the user moves his head are reduced by predicting future head locations. Inertial sensors mounted on the HMD aid head-motion prediction. Accurate determination of prediction distances requires low-overhead operating systems and eliminating unpredictable sources of latency. On average, prediction with inertial sensors produces errors 2-3 times lower than prediction without inertial sensors and 5-10 times lower than using no prediction at all. Future steps that may further improve registration are outlined.
Wireless indoor positioning systems have become very popular in recent years. These systems have been successfully used in many applications such as asset tracking and inventory management. This paper provides an overview of the existing wireless indoor positioning solutions and attempts to classify different techniques and systems. Three typical location estimation schemes of triangulation, scene analysis, and proximity are analyzed. We also discuss location fingerprinting in detail since it is used in most current system or solutions. We then examine a set of properties by which location systems are evaluated, and apply this evaluation method to survey a number of existing systems. Comprehensive performance comparisons including accuracy, precision, complexity, scalability, robustness, and cost are presented.
Our work stems from a program focused on developing tracking technologies for wide-area augmented realities in unprepared outdoor environments. Other participants in the Defense Advanced Research Projects Agency (Darpa) funded Geospatial Registration of Information for Dismounted Soldiers (Grids) program included University of North Carolina at Chapel Hill and Raytheon. We describe a hybrid orientation tracking system combining inertial sensors and computer vision. We exploit the complementary nature of these two sensing technologies to compensate for their respective weaknesses. Our multiple-sensor fusion is novel in augmented reality tracking systems, and the results demonstrate its utility
Vector Tile Service · Mapzen. https://mapzen.com/projects/vector-tiles
- Mapzen
MAPZEN.
Vector
Tile
Service
·
Mapzen.
https://mapzen.com/projects/vector-tiles/.
Usability Study of an Augmented Reality Game for Philippine History
- M M Vidal
- E C E Caluya
- N R Agapito
- J And Diy
RODRIGO, M.M., VIDAL, E.C.E., CALUYA, N.R., AGAPITO, J., AND
DIY, W.D. 2016. Usability Study of an Augmented Reality
Game for Philippine History. Proceedings of the 24th
International Conference on Computers in Education.
MARA, sensor based augmented reality system for mobile imaging device
- M And Murphy
KAHARI, M. AND MURPHY, D.J. 2006. MARA, sensor based
augmented reality system for mobile imaging device. ISMAR:
Proceedings of the International Symposium on Mixed and
Augmented Reality. IEEE Computer Society.
GeoJSON Specification
- H Daly
- M Doyle
- A Gillies
- S Schaub
- T And Schmidt
BUTLER, H., DALY, M., DOYLE, A., GILLIES, S., SCHAUB, T., AND
SCHMIDT,
C.
2008.
GeoJSON
Specification.
http://geojson.org/geojson-spec.html.
Igpaw: Intramuros—Design of an Augmented Reality Game for Philippine History
- M M Caluya
- N R Diy
- W D And
- E C E Vidal
RODRIGO, M.M., CALUYA, N.R., DIY, W.D., AND VIDAL, E.C.E.
2015. Igpaw: Intramuros—Design of an Augmented Reality
Game for Philippine History. Proceedings of the 23rd
International Conference on Computers in Education.
Mobile Augmented Reality Game Engine Handbook of Augmented Reality
- J And Duh
GU, J. AND DUH, H.B.L. 2011. Mobile Augmented Reality Game
Engine. In: B. Furht, ed., Handbook of Augmented Reality.
Springer New York, 99–122.
gov: GPS Accuracy. http://www.gps.gov/systems/gps
- Us Air Force
- Gps
US
AIR
FORCE.
GPS.gov:
GPS
Accuracy.
http://www.gps.gov/systems/gps/performance/accuracy/.
Survey of Wireless Indoor Positioning Techniques and Systems. IEEE transactions on systems, man and cybernetics. Part C, Applications and reviews: a publication of the
- H Darabi
- H Banerjee
- P And Liu
LIU, H., DARABI, H., BANERJEE, P., AND LIU, J. 2007. Survey of
Wireless Indoor Positioning Techniques and Systems. IEEE
transactions on systems, man and cybernetics. Part C,
Applications and reviews: a publication of the IEEE Systems,
Man, and Cybernetics Society 37, 6, 1067–1080.
ARToolKit: library for Vision-Based augmented reality
- H Kato
KATO, H. 2002. ARToolKit: library for Vision-Based augmented
reality. IEICE, PRMU.
Mixing virtual and real scenes in the site of ancient Pompeii: Research Articles, Computer Animation and Virtual Worlds, v
- George Papagiannakis
- Sébastien Schertenleib
- Brian O Kennedy
- Marlene Arevalo-Poizat
- Nadia Magnenat-Thalmann
- Andrew Stoddart
- Daniel Thalmann
MARA, sensor based augmented reality system for mobile imaging device
- M Kahari
- D J Murphy
KAHARI, M. AND MURPHY, D.J. 2006. MARA, sensor based
augmented reality system for mobile imaging device. ISMAR:
Proceedings of the International Symposium on Mixed and
Augmented Reality. IEEE Computer Society.
Marker tracking and HMD calibration for a video-based augmented reality conferencing system. Augmented Reality, 1999. (IWAR '99) Proceedings. 2nd
- H Kato
- M Billinghurst
KATO, H. AND BILLINGHURST, M. 1999. Marker tracking and
HMD calibration for a video-based augmented reality
conferencing system. Augmented Reality, 1999. (IWAR '99)
Proceedings. 2nd IEEE and ACM International Workshop on,
85-94.