Conference Paper

Pick-by-Vision: A First Stress Test

Tech. Univ. Munchen, Munich, Germany
DOI: 10.1109/ISMAR.2009.5336484 Conference: Mixed and Augmented Reality, 2009. ISMAR 2009. 8th IEEE International Symposium on
Source: IEEE Xplore


In this paper we report on our ongoing studies around the application of augmented reality methods to support the order picking process of logistics applications. Order picking is the gathering of goods out of a prepared range of items following some customer orders. We named the visual support of this order picking process using head-mounted displays ldquopick-by-visionrdquo. This work presents the case study of bringing our previously developed pick-by-vision system from the lab to an experimental factory hall to evaluate it under more realistic conditions. This includes the execution of two user studies. In the first one we compared our pick-by-vision system with and without tracking to picking using a paper list to check picking performance and quality in general. In a second test we had subjects using the pick-by-vision system continuously for two hours to gain in-depth insight into the longer use of our system, checking user strain besides the general performance. Furthermore, we report on the general obstacles of trying to use HMD-based AR in an industrial setup and discuss our observations of user behaviour.

279 Reads
  • Source
    • "Processes like order picking in a logistic warehouse or storage can be supported by an HMD as a guidance system. The potentials of HMDs are well-known [1] and their capabilities are shown in different applicationscenarios [2]. On the other hand, there is a lack of user-friendliness in many systems that may lead to rejections or prejudices [3]. "
    [Show abstract] [Hide abstract]
    ABSTRACT: In this paper, a mobile assistance-system is described which supports users in performing manual working tasks in the context of assembling complex products. The assistance system contains a head-worn display for the visualization of information relevant for the workflow as well as a video camera to acquire the scene. This paper is focused on the interaction of the user with this system and describes work in progress and initial results from an industrial application scenario. We present image-based methods for robust recognition of static and dynamic hand gestures in realtime. These methods are used for an intuitive interaction with the assistance-system. The segmentation of the hand based on color information builds the basis of feature extraction for static and dynamic gestures. For the static gestures, the activation of particular sensitive regions in the camera image by the user’s hand is used for interaction. An HMM classifier is used to extract dynamic gestures depending on motion parameters determined based on the optical flow in the camera image.
    Journal of Intelligent Learning Systems and Applications 08/2014; 6(3):141-152. DOI:10.4236/jilsa.2014.63011
  • Source
    • "In the arts, systems have been developed to guide users in acting out film scripts while interacting with virtual characters [19], and to assist with playing music [10] [29] [7]. In logistics an AR system for warehouse order picking was shown to enable users to perform more quickly than a conventional paper-list–based approach [39]. All the previously cited AR systems for procedural task assistance track the position and orientation of the user's head relative to the task environment. "
    [Show abstract] [Hide abstract]
    ABSTRACT: Procedural tasks are common to many domains, ranging from maintenance and repair, to medicine, to the arts. We describe and evaluate a prototype augmented reality (AR) user interface designed to assist users in the relatively under-explored psychomotor phase of procedural tasks. In this phase, the user begins physical manipulations, and thus alters aspects of the underlying task environment. Our prototype tracks the user and multiple components in a typical maintenance assembly task, and provides dynamic, prescriptive, overlaid instructions on a see-through head-worn display in response to the user's ongoing activity. A user study shows participants were able to complete psychomotor aspects of the assembly task significantly faster and with significantly greater accuracy than when using 3D-graphics-based assistance presented on a stationary LCD. Qualitative questionnaire results indicate that participants overwhelmingly preferred the AR condition, and ranked it as more intuitive than the LCD condition.
    10th IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2011, Basel, Switzerland, October 26-29, 2011; 10/2011
  • Source
    • "In comparison with previous studies [4] [3] "
    [Show abstract] [Hide abstract]
    ABSTRACT: The potential of Augmented Reality (AR) to support industrial processes has been demonstrated in several studies. While there have been first investigations on user related issues in the long-duration use of mobile AR systems, to date the impact of theses systems on physiological and psychological aspects is not explored extensively. We conducted an extended study in which 19 participants worked 4 hours continuously in an order picking process with and without AR support. Results of the study comparing strain and work efficiency are presented and open issues are discussed.
    9th IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2010, Seoul, Korea, 13-16 October 2010; 01/2010
Show more