Content uploaded by Neville A Stanton
Author content
All content in this area was uploaded by Neville A Stanton on Apr 19, 2016
Content may be subject to copyright.
Situation awareness in military command and control (C4I) systems: the development of a tool to measure SA in C4I systems and battlefield environments. Stage 1: SA methods review
Abstract
To date, few specific techniques for the assessment of situation awareness (SA) in C4i (command, control, computers and communication) and battlefield environments have been developed, tested and validated in the human factors literature. A methods review was conducted in order to assess the potential usage of existing approaches to the measurement and assessment of SA during the design and evaluation process of a novel C4i system. A set of criteria were used in order to establish which of the methods were the most suitable for use in the design and evaluation of C4i systems. Furthermore, the output of the analysis is designed to act as a methods manual, aiding practitioners in the use of the SA assessment techniques reviewed. The following paper describes the purpose and process of the methods review, and offers conclusions regarding the approach to the measurement and assessment of SA in C4i environments
This paper describes an assessment tool for agents’ performance in C2 operations. Aspects that are considered to affect performance, such as mental workload and situation awareness, have been applied to create this tool. In order to measure performance from multiple perspectives, generic performance measures from First Person Shooter games and other simulated environments have also been applied. As a result, the assessment tool consists of the Crew Awareness Rating Scale (CARS), the Situation Awareness Global Assessment Technique (SAGAT) and the Nasa-Task Load Index (NASA-TLX). The tool also consists of generic performance measures for goal achievement, number of fratricide, and number of soldiers killed in action. Three feedback session with platoon commanders were conducted in order to refine the assessment tool. Each feedback session was preceded with a simulation run conducted in a simulated combat environment. The feedback sessions resulted in removing and adding questions in the questionnaires, as well as including generic performance measures considered relevant. The assessment tool presented in this paper is considered effective, easy to use, cost effective, flexible, and objective.KeywordsCommand and controlC2PerformancePerformance assessmentMilitaryNASA-TLXCARSSAGAT
This report is concerned with the measurement of controllers Situation Awareness (SA). Two measures of SA are proposed: the first, known as 'SA for SHAPE on-Line (SASHA_L)' is a query technique based on an existing measure; the second, known as 'SA for SHAPE Questionnaire (SASHA_Q)', is a questionnaire technique using carefully chosen questions that focus on key elements of SA which controllers have identified themselves. A wide-ranging review of nine current SA measures is also included.
The report has been prepared as part of the 'Solutions for Human-Automation Partnerships in European ATM (SHAPE)' Project being carried out by the ATM Human Resources Unit of EUROCONTROL, later renamed 'Human Factors and Manpower Unit (DIS/HUM)', and today known as 'Human Factors Management Business Division (DAS/HUM)'.
Ergonomics provides a group of powerful tools for the analysis of work, the design of usable products and the improvements of peoples' working environment. This handbook sets out in practical detail the main ergonomics, or human factors, methods along with practical examples. It presents approximately 100 methods, covering the assessment and measurement of physical, environmental, physiological, psychological, social and organizational phenomena. Each of the methods is set out in a very structured form to allow ready comparison covering: background, applications, procedure, a worked example, related methods, standards, approximate training and application times (based on the example), reliability and validity, costs, tools needed, related methods, and a short biography. A distinguished team of editors have drawn on international experts to cover each method.
We describe a technique ('SACRI') for measuring situation awareness in nuclear power plant control rooms. We intend SACRI to be supplementary to other operator performance measures we use for evaluations of nuclear power plant MMI. We have developed and begun validation of the technique with four methodological studies using our PWR simulator and a training simulator at a commercial PWR power plant.