ArticlePDF Available

Abstract and Figures

In this paper we discuss Augmented Reality (AR) displays in a general sense, within the context of a Reality-Virtuality (RV) continuum, encompassing a large class of "Mixed Reality" (MR) displays, which also includes Augmented Virtuality (AV). MR displays are defined by means of seven examples of existing display concepts in which real objects and virtual objects are juxtaposed. Essential factors which distinguish different Mixed Reality display systems from each other are presented, first by means of a table in which the nature of the underlying scene, how it is viewed, and the observer's reference to it are compared, and then by means of a three dimensional taxonomic framework, comprising: Extent of World Knowledge (EWK), Reproduction Fidelity (RF) and Extent of Presence Metaphor (EPM). A principal objective of the taxonomy is to clarify terminology issues and to provide a framework for classifying research across different disciplines.
Content may be subject to copyright.
A preview of the PDF is not available
... Abbildung 2.4.: Realitäts-Virtualitäts-Kontinuum nach Paul Milgram u. a.[34] ...
Article
Der Begriff "Industrie 4.0" fasst Technologien und Methoden zusammen, mit denen Produktionssysteme sich durch eine systematische Erfassung und Analyse von Daten selbstständig steuern und optimieren können. Insbesondere dort, wo Tätigkeiten innerhalb des Produktionsprozesses von Menschen ausgeführt werden, entsteht die Herausforderung, dass für die Erfassung menschlicher Daten in der Regel eine komplexe technische Infrastruktur notwendig ist. Die vorliegende Arbeit befasst sich mit der Fragestellung, ob der Prozess, menschliche Daten zu erfassen, durch die Anwendung eines AR-Headsets vereinfacht werden kann und auf ortsfeste Infrastruktur verzichtet werden kann. Zur Überprüfung des Ansatzes wird eine AR-Anwendung entwickelt, die kontinuierlich die Position eines Arbeiters in der Produktionsanlage bestimmt. Grundlage hierfür ist das dauerhaft vom AR-Headset durchgeführte SLAM-Tracking in Verbindung mit einem optischen, markerbasierten Kalibrierungsverfahren. Im Rahmen einer Messreihe wird die Präzision der Positionsbestimmung überprüft und mit anderen Verfahren zur Lokalisierung in Innenräumen verglichen. Für die Analyse der Positionsdaten wird zusätzlich eine Serveranwendung entwickelt, welche die Positionsdaten empfängt, speichert und mit Hilfe einer vorher festgelegten Prozessbeschreibung automatisiert Prozesszeiten aus den ermittelten Positionsdaten berechnet. Anhand eines praktischen Anwendungsfalls wird aufgezeigt, wie die ermittelten Prozesszeiten genutzt werden können, um die Reihenfolge des Prozesses zu optimieren.
... This is in stark contrast with the tourism industry. The United Nations World Tourism Organization (2019) reported approximately 180 million fewer international arrivals Fig. 1 Reality-virtuality continuum (Milgram et al. 1995) between January and March 2021 than in the first quarter of 2020. Expressly, the number of international tourist arrivals worldwide in 2020 declined by 73% compared to 2019, and by another 83% in 2021 compared to 2020. ...
Article
Full-text available
This review provides a comprehensive view of immersive technology in tourism by critically analysing prior scholarly work. More specifically, it identifies the recent use of immersive technology in this field and the potential challenges it poses. This systematic review follows PRISMA guidelines and involves four key steps—identifying research questions, defining keywords, selecting studies based on inclusion and exclusion criteria, and synthesising results. It focuses on immersive technology in tourism-related peer-reviewed journal articles published from 2012 to 2020. The papers were selected from ten prominent journal databases. Some databases used combinations of search queries but with inclusion and exclusion criteria. This systematic review builds on the existing reviews by adding knowledge regarding state-of-the-art immersive technology usage in tourism and its integration with other technology. This review additionally identifies the potential challenges of implementing immersive technology in tourism. Finally, it presents a set of directions for future research in this space. In practice, the findings from this review can make both software developers and tourism providers aware of the potential of immersive technology in tourism. Software developers might consider appropriate designs that suit such usage, and tourism providers might consider using immersive technology to promote tourism destinations and provide a support system to maximise the benefits of immersive technology.
... 360° Bilder werden als virtuelle Realität (VR) klassifiziert (Milgram et al. 1994). Hierbei lassen sich VR Umgebungen hinsichtlich ihrer Immersion und der Präsenz, welche sie bieten, beschreiben (Gutiérrez et al. 2008). ...
Technical Report
Full-text available
Please quote as: Weinert, T.; Thiel de Gafenco, M.; Billert, M. S.; Janson, A.; Klusmeyer, J.; Leimeister, J. M. (2022). Handlungsbroschüre. Ko-Kreative Entwicklung von Lernmaterialien im Arbeitsprozess in der Fertigungsindustrie-Eine anwenderzentrierte Betrachtung. Kassel: Kassel University Press. ISBN: 978-3-7376-1054-4.
... Similar to VR, several definitions of AR exist (e.g., Azuma et al., 2001;Caudell & Mizell, 1992;Milgram et al., 1995;Wu et al., 2013). For example, AR can be defined as "a situation in which a real-world context is dynamically overlaid with coherent location or context sensitive virtual information" (Klopfer & Squire, 2008, p. 205). ...
Article
Diante de um cenário de mercado altamente competitivo, instável e com constantes mudanças, sociais, políticas, econômicas e principalmente tecnológicas, a informação torna-se um ativo de grande valia para a organização. A gestão correta de informações, vem sendo utilizada como ferramenta estratégica para muitas organizações, onde através da Inteligência Competitiva (IC) é possível captar e organizar as informações auxiliando no processo de tomada de decisão. O estudo aponta os games como ferramenta para esse processo de busca e monitoramento de informações, já que os jogos fazem parte de todas gerações, de uma forma diferente em cada uma delas. Desta forma, foram realizadas pesquisas bibliográficas acerca dos conceitos de games e inteligência competitiva, onde foi possível demonstrar como os games podem ser utilizados como ferramenta estratégica na busca e monitoramento de IC. Foi feito ainda, um estudo acerca do jogo Pokémon Go, e como este jogo pode ser utilizado como ferramenta de prospecção e monitoramento de informações, ou seja, o processo de inteligência competitiva. ABSTRACTGAMES AS A STRATEGIC TOOL FOR SEARCH AND MONITORING OF COMPETITIVE INTELLIGENCE: A case study on Pokémon Go Faced with a highly competitive market scenario, unstable and with constant changes, political, economic and mainly technological, a product becomes a valuable asset for an organization. The correct management of information has been used as a strategic strategy for many organizations through Competitive Intelligence (CI) and it is possible to organize and organize as information facilitating any decision making process. The study of games as a tool for this process of searching and monitoring information, since the games are part of all generations, in a different way in each one of them. In this way, bibliographic researches on game concepts and competitive intelligence were carried out, where it was possible to demonstrate how games can be used as a strategic tool in the search and monitoring of CI. It was also done, a study on the Pokémon Go game, and how this game can be used as a competitive intelligence monitoring and tracking tool.
Article
As a result of stimulating the basic human senses, emotional states occur in humans. Of these senses, the visual sense is the most basic human sense. This sense perceives visual stimuli and elicits emotional states. Augmented Reality (AR) applications also work with these visual stimuli. This study investigates how AR systems, which are among immersive environments, are effective in distinguishing the emotional states of students in book reading activities, with the support of Electroencephalography (EEG). The BOOKAR dataset obtained within the scope of this study is among the first AR-supported datasets in emotion recognition using physiological signals with immersive methods. To reveal the emotional states of the readers, texts that stimulate emotional states such as disgusting, happy, neutral, and 2-dimensional pictures are presented within these texts. In the AR-based reading section, the 3-dimensional models of these 2-dimensional pictures and the rig-processed conditions of these models are presented as a stimulus to the reader. The results show that AR-based reading has a significant discriminatory effect, especially on the valence-arousal emotional states of readers, and achieves higher classification performance than real reading. The results also show that the proposed method is good at classifying emotional states from EEG signals with accuracy scores close to 100%. It has been observed that the designed AR application also meets the usability characteristics. The proposed emotion recognition method in AR applications has significant potential for integration into various Metaverse-based applications.
Chapter
Virtual reality is a technology for the relocation and interaction of users with a digital environment created by computers through an interface that recognizes actions carried out in the real world. It allows users a multimodal experience, making possible immersion in a digital world. On the other hand, 3D modeling is a process of design and representation of an object (3D model) in three dimensions with specialized software, a model that could become tangible through 3D printing. Virtual reality, 3D modeling, and 3D printing technologies, with appropriate teaching proposals and appropriate tools for process monitoring, offer students new ways of interacting with contents of social sciences, geography, and history. There are more resources for the management of classes with VR devices and specific VR applications for teaching. In general, virtual reality and 3D modeling/painting in class allows both interaction and several opportunities for learning adapted to the needs of students.
Article
Full-text available
Typical teleoperator display systems to date have relied on standard monoscopic video as the primary feedback link. Research clearly shows that using stereoscopic video (SV) is generally a significant improvement over monoscopic video (MV) for most teleoperation tasks. Abundant as the benefits of SV are, they can be dramatically increased with the superpositioning of stereoscopic graphics (SG) on the SV image. The resulting SV + SG system can greatly enhance the benefits of SV alone in the understanding of a remote world. This combination of media results in an exploration tool uniquely suited for examining different environments, whether remote, microscopic, or artificial. The SV + SG technology can also be used as a command tool that can be used to control manipulators (remote, microscopic, or artificial) in the different environment. A SV + SG system was implemented, and an experiment was performed to determine whether or not SG images were actually perceived as existing at the desired location in the SV view. The experiment compared the performance of a virtual SV + SG Pointer with that of a real-world pointer, and showed that the virtual pointer could be positioned as accurately as the real pointer, with only a slightly higher variance.
Article
Full-text available
This paper describes a number of aspects of a display technology under development, which involves the integration of stereoscopic computer graphics and stereoscopic video displays. The background and justification for this development are discussed, based on the need of operators of remotely controlled vehicles and/or manipulators to estimate absolute sizes and locations of objects at a remotely viewed site. The basic technology involves superimposing an interactively controllable computer-generated stereographic cursor onto a stereoscopically viewed video image. Absolute measurements can be made with this system, based on relative comparison of cursor position with target object location. Experimental results are presented in which the ability of subjects to perform such tasks was investigated. In general, results were promising; subjects were able to align virtual pointers with real targets essentially as well as they were able to manipulate real objects. A number of implications of this technology for the enhancement of three dimensional video displays are discussed.
Article
Full-text available
Mixed Reality (MR) visual displays, a particular subset of Virtual Reality (VR) related technologies, involve the merging of real and virtual worlds somewhere along the 'virtuality continuum' which connects completely real environments to completely virtual ones. Augmented Reality (AR), probably the best known of these, refers to all cases in which the display of an otherwise real environment is augmented by means of virtual (computer graphic) objects. The converse case on the virtuality continuum is therefore Augmented Virtuality (AV). Six classes of hybrid MR display environments are identified. However quite different groupings are possible and this demonstrates the need for an efficient taxonomy, or classification framework, according to which essential differences can be identified. An approximately three-dimensional taxonomy is proposed comprising the following dimensions: extent of world knowledge, reproduction fidelity, and extent of presence metaphor.
Article
Full-text available
One of the most promising and challenging future uses of head-mounted displays (HMDs) is in applications where virtual environments enhance rather than replace real environments. To obtain an enhanced view of the real environment, the user wears a see-through HMD to see 3D computer-generated objects superimposed on his/her real-world view. This see-through capability can be accomplished using either an optical or a video see-through HMD. We discuss the tradeoffs between optical and video see-through HMDs with respect to technological, perceptual, and human factors issues, and discuss our experience designing, building, using, and testing these HMDs.
This paper describes studies on perception of virtual object locations. It explores the behavior of some factors related to depth perception, especially the effect of inter-pupillary distance (IPD) mismatch and the interplay of image blur and binocular disparity. IPD mismatch (which is caused by errors in estimation of the parameter) results in a certain perceptual error of virtual objects' depth. Blur of images is also a source of error in depth representation. It was found, in some cases, to be a very strong depth cue. The results of a series of experiments conducted on IPD mismatch and image blur are also presented.
Article
A telerobot control system using stereoscopic viewing has been developed. The objective of the system is to implement a world-model mapping capability using live stereo video to provide an operator with three-dimensional image information of an unstructured environment and to use stereo computer graphics renderings of wire-frame models of sought-after features in the environment in order to relate robotic task information. The operator visually correlates or matches the stereo video image of the environment with the graphic image to register the world model space to the manipulator's environment. This allows operator control of the manipulator through teleoperation in unstructured environments with a change-over to autonomous operation when the operation can be restricted and a task becomes repetitive. Details of the robot control, stereo imaging, and system control components are provided.
Article
This paper describes our studies on perception of virtual object locations. We explore the behavior of various factors related to depth perception, especially the interplay of fuzziness and binocular disparity. Experiments measure this interplay with the use of a three- dimensional display. Image fuzziness is ordinarily seen as an effect of the aerial perspective in two-dimensional displays for distant objects. We found that it can also be a source of depth representation also in three-dimensional display space. This effect occurs with large individual variations, and for subjects who have good stereopsis it does not significantly affect their depth perception. However, it can be a very strong depth cue for subjects who have weak stereopsis. A subsequent experiment measured the effects when both size and brightness of sharp stimuli are adjusted to a standard fuzzy stimulus. The results suggest that the fuzziness cue at short range is explained by other cues (i.e. the size cue and the brightness cue). This paper presents results of a series of such experiments.
Article
Along with the marriage of motion pictures and computers has come an increasing interest in making images appear to have a greater degree of realness or presence, or `realspace imaging.' Such topics as high-definition television, 3-D, fisheye lenses, surrogate travel, and `cyberspace' reflect such interest. These topics are usually piled together and are unparsable, with the implicit assumptions that the more resolution, the more presence, and the more presence, the better. This paper proposes a taxonomy of the elements of real-space imaging. The taxonomy is organized around six sections: (1) monoscopic imaging, (2) stereoscopic imaging, (3) multiscopic imaging, (4) panoramics, (5) surrogate travel, and (6) real-time imaging.
Article
The ability to make on-line adjustments to stereoscopic camera position parameters dynamically, during execution of telemanipulation tasks, allows one to maintain a theoretically `optimal' camera configuration, in response to changing viewing conditions. Associated with this, however, is the problem of the observer's being forced to adapt to a (continuously) changing relationship between perceived inter-object distances in the depth plane and the corresponding real distances. One problem in particular is the potential conflict between varying stereoscopic depth cues and unchanging size cues. Two experiments were performed. In the first we investigated how depth judgement ability varied with unsignalled changes in camera convergence distance. This resulted in significant changes in distance judgement, with overestimation for increases in camera separation and underestimation for decreases. Short- term feedback on judgement error was sufficient to correct the changes. In the second experiment, on-screen calibrated depth cues were added, by means of overlaid stereoscopic computer graphics, causing the significant estimation errors found in the first experiment to disappear. The implication of this is that distance/depth judgement can in principle be rescaled to compensate for perceptual conflicts caused by changing camera configuration, by providing either real or virtual depth scaling cues at the task site.