Oliver Albert’s research while affiliated with Technische Universität Darmstadt and other places

2For some of today's simulations very expensive, heavy, and large equipment is needed. In order to reduce prototyping and training costs, immersive 'Virtual Cockpit Simulation' (VCS) becomes very attractive. Head Mounted Displays (HMD), datagloves, and cheap 'Seating Bucks' are used to generate an immersive stereoscopic virtual environment (VE) for designers, engineers, and trainees. The entire cockpit, displays, and a visual are modeled as 3D computer generated geometry with textured surfaces. HMD resolution, field of view (FOV), tracker lag, and missing force feedback are critical human machine interface (HMI) components in VCS. For VCS applications task performance and transfer of training into reality have to be evaluated. In this paper two test series evaluating the VCS HMI dependencies based on HMD resolution and FOV are described. FOV limitations are especially important for a two seater virtual cockpit. Cross viewing, observing overhead, glareshield, and pedestal are critical for flying. Test persons had to deal with different FOV settings varying from 30 degrees to 100 degrees. Their task was to find and count light arbitrary points located at different panels in a limited time. To evaluate cross viewing test persons also had to detect light points besides them while reading text in front of them. Based on the test results a recommendation for a necessary FOV was given. The most demanding component for HMD resolution are virtual flight guidance displays rendered in a virtual scene at correct size and location. They consist of small moving low contrast symbols. Under a hi-resolution (1280 X 1024) HMD test persons were asked to read-out letters, numbers, and symbols of different sizes, movement speeds, and contrasts. Some test persons also had to fulfill an additional task to reduce their attention. From the test results a minimal necessary symbol, letter, and numbersize was determined for hi-resolution (hires) HMDs.

For some of today's simulations very expensive, heavy and large equipment is needed. Examples are driving, shipping, and flight simulators with huge and expensive visual and motion systems. In order to reduce cost, immersive `Virtual Simulation' becomes very attractive. Head Mounted Displays or Computer Animated Virtual Environments, Datagloves, and cheap `Seating Bucks' are used to generate a stereoscopic virtual environment for a trainee. Such systems are already in use for caterpillar, submarine, and F15-fighter simulation. In our approach we partially simulate an Airbus A340 cockpit. All interaction devices such as side stick, pedals, thrust-levers, knobs, buttons, and dials are modeled as 3D geometry. All other parts and surfaces are formed by images (textures). Some devices are physically available such as sidesticks, pedals, and thrust-levers. All others are replaced by plastic panels to generate a forced feedback for the pilots. A simplified outside visual is available to generate immersive flight simulations. A virtual Primary Flight display, Navigation display, and a virtual stereoscopic Head Up Display are used in a first approach. These virtual displays show basic information necessary to perform a controlled flight and allow basic performance analysis with the system. All parts such as physical input devices, virtual input devices, flight mechanics, traffic, and rendering run in a distributed environment on different high end graphics work stations. The `Virtual Cockpit' can logically replace an also available conventional cockpit mockup in the flight simulation.

In today's civil flight training simulators only the cockpit and all its interaction devices exist as physical mockups. All other elements such as flight behavior, motion, sound, and the visual system are virtual. As an extension to this approach `Virtual Flight Simulation' tries to subsidize the cockpit mockup by a 3D computer generated image. The complete cockpit including the exterior view is displayed on a Head Mounted Display (HMD), a BOOM, or a Cave Animated Virtual Environment. In most applications a dataglove or virtual pointers are used as input devices. A basic problem of such a Virtual Cockpit simulation is missing force feedback. A pilot cannot touch and feel buttons, knobs, dials, etc. he tries to manipulate. As a result, it is very difficult to generate realistic inputs into VC systems. `Seating Bucks' are used in automotive industry to overcome the problem of missing force feedback. Only a seat, steering wheel, pedal, stick shift, and radio panel are physically available. All other geometry is virtual and therefore untouchable but visible in the output device. In extension to this concept a `Seating Buck' for commercial transport aircraft cockpits was developed. Pilot seat, side stick, pedals, thrust-levers, and flaps lever are physically available. All other panels are simulated by simple flat plastic panels. They are located at the same location as their real counterparts only lacking the real input devices. A pilot sees the entire photorealistic cockpit in a HMD as 3D geometry but can only touch the physical parts and plastic panels. In order to determine task performance with the developed Seating Buck, a test series was conducted. Users press buttons, adapt dials, and turn knobs. In a first test, a complete virtual environment was used. The second setting had a plastic panel replacing all input devices. Finally, as cross reference the participants had to repeat the test with a complete physical mockup of the input devices. All panels and physical devices can be easily relocated to simulate a different type of cockpit. Maximal 30 minutes are needed for a complete adaptation. So far, an Airbus A340 and a generic cockpit are supported.