Martin Litzenberger

AIT Austrian Institute of Technology | ait · Center for Digital Safety & Security

In this paper we describe the concept and ongoing work of the research project MOBILIZE, which addresses the operational safety and security of large railway systems to prevent sabotage and vandalism. Examples of such acts are manipulation of system components, intentional placement of objects on the tracks, theft of copper cables or damage to prop...

Wide area surveillance has become of critical importance, particularly for border control between countries where vast forested land border areas are to be monitored. In this paper, we address the problem of the automatic detection of activity in forbidden areas, namely forested land border areas. In order to avoid false detections, often triggered...

Chapter 16, “FOLDOUT: A Through Foliage Surveillance System for Border Security” was previously published non-open access. It has now been changed to open access under a CC BY 4.0 license and the copyright holder updated to ‘The Author(s)’. The book has also been updated with this change.

In this work, we present a Fusion and Tracking system developed within the EU project FOLDOUT aimed to facilitate border guards work by fusing separate sensor information and presenting automatic tracking of objects detected in the surveillance area. The focus of FOLDOUT is on through-foliage detection in the inner and outermost regions of the EU....

Improved methods for border surveillance are necessary to ensure an effective and efficient EU border management. In the border control context, as defined by the Schengen Border Code, border surveillance is defined as “the surveillance of borders between border crossing points and the surveillance of border crossing points outside the fixed openin...

In the context of railway safety, it is crucial to know the positions of all trains moving along the infrastructure. In this contribution, we present an algorithm that extracts the positions of moving trains for a given point in time from Distributed Acoustic Sensing (DAS) signals. These signals are obtained by injecting light pulses into an optica...

This paper investigates the effectiveness of traffic management tools, including traffic signal control and en-route navigation provided by variable message signs (VMS), in reducing traffic congestion and associated emissions of CO2, NOx, and black carbon. The latter is among the most significant contributors of climate change, and is associated wi...

We propose a novel method for the detection of vibrations caused by trains in an optical fiber buried nearby the railway track. Using optical time-domain reflectometry vibrations in the ground caused by different sources can be detected with high accuracy in time and space. While several algorithms have been proposed in the literature for train tra...

We propose an algorithm which uses an optical time-domain reflectometer (OTDR) for real-time tracking of trains. OTDR sensing, often also termed distributed acoustical sensing (DAS), measures the Rayleigh backscattering of a light pulse along an optical fiber. The resulting signal provides information on local acoustic pressure at linearly spaced p...

The presented traffic control system (CARBOTRAF) combines real-Time monitoring of traffic and air pollution with simulation models for traffic, emission and local air quality predictions to deliver on-line recommendations for alternative adaptive traffic management. The aim of introducing a CARBOTRAF system is to reduce BC and CO2 emissions and imp...

This article presents a study of vehicle acceleration measurements at the stop line of a traffic light in an urban environment. Accurate representation of vehicle acceleration behavior is an important parameter to traffic simulation tools especially when the emissions related to the simulated traffic need to be calculated. A smart eye traffic data...

A major challenge in robotic applications is the interaction with a dynamic environment and humans which is typically constrained by the capability of visual sensors and the computational cost of signal processing algorithms. Addressing this problem the paper presents an event-driven based embodied system for feature extraction and object recogniti...

This paper presents a recently developed dynamic stereo vision sensor system and its application for fall detection towards safety for elderly at home. The system consists of (1) two optical detector chips with 304×240 event-driven pixels which are only sensitive to relative light intensity changes, (2) an FPGA for interfacing the detectors, early...

There is no commercially available traffic monitoring device that is able to collect information on the composition of the traffic in terms of vehicle acceleration states. This report presents a traffic monitoring device with the potential for vehicle acceleration detection, which will be able to give the required real-time input for online emissio...

This paper presents a hardware implementation for high-speed, event-based data processing. A full-custom Address-Event (AER) processing system (GAEP) features a 10ns-resolution 33M/5.125M events·s−1 peak/sustained event rate sensor data interface for precision time-stamping of asynchronous sensor data and implements hardware-accelerated event pre-p...

This paper presents a neuromorphic dual-line vision sensor and signal-processing concepts for object recognition and classification. The system performs ultrahigh speed machine vision with a compact and low-cost embedded-processing architecture. The main innovation of this paper includes efficient edge extraction of moving objects by the vision sen...

This paper presents a high DR, high temporal resolution, frame-free image/video camera that encodes and processes visual information in asynchronous spikes. The event-driven optical sensor features 9.3-bit grayscale imaging at up to 143dB DR and <;0.25% FPN with hardware-based lossless video compression and time-domain correlated double sampling. T...

This live demonstration shows high DR, high temporal resolution, frame-free image/video acquisition based on asynchronous events. The presented camera features 9-bit gray-level imaging at up to 143dB DR and <;0.25% FPN with hardware-based lossless video compression and time-domain correlated double sampling. The main components of the camera - an a...

This paper describes concept and implementation of an asynchronous, column-parallel readout method for event-based pulse-width-modulation (PWM) image sensors. These time-based imaging devices transmit exposure information in the form of asynchronous spike-events (AER) via an arbitrated asynchronous data bus that is common to all pixels. Event-colli...

Reliable Advanced Driver Assistance Systems (ADAS) are intended to assist the driver under various traffic, weather and other environment conditions. The growing traffic requires sensors and systems which handle difficult urban and non-urban scenarios. For such systems new cost-efficient sensor technologies are developed and evaluated in the EU-FP7...

The paper presents night-time vehicle classification using an embedded vision system based on an optical transient sensor. This neuromorphic sensor features an array of 128times128 pixels that respond to relative light intensity changes with low latency and high dynamic range. The proposed algorithm exploits the temporal resolution and sparse repre...

Object tracking is an extensively researched subject within the field of computer vision, in reference to the large number of published contributions in major computer vision conference proceedings and journals every year. This chapter presents object tracking achievements over the past years as well as research trends. It attempts to give a struct...

A synchronous communication interface for neuromorphic temporal contrast vision sensors is described and evaluated in this paper. This interface has been designed for ultra high-speed synchronous arbitration of a temporal contrast image sensors pixels' data. Enabling high-precision timestamping, this system demonstrates its uniqueness for handling...

In this paper, a novel event-based dynamic IR vision sensor is presented. The device combines an uncooled microbolometer array with biology-inspired (ldquoneuromorphicrdquo) readout circuitry to implement an asynchronous, ldquospikingrdquo vision sensor for the 8-15 mum thermal infrared spectral range. The sensor's autonomous pixels independently r...

In this article, an ultra high-speed synchronous arbitration process for transient pixels' data is presented and evaluated. Enabling a high-precision timestamping, this system demonstrates its uniqueness for handling high peak rates and preserving the main advantage of the neuromorphic electronic systems, that is high and accurate temporal resoluti...

Neuromorphic temporal contrast vision sensors are sensitive to relative intensity changes. These sensors can be exploited to detect scene dynamics and representing the resulting dynamicpsilas shapes. Moreover, these sensors are ideal for ultra-high-speed vision with low computational effort. Two aspects have been ignored within the initial conceptu...

This paper describes an embedded system for traffic flow analysis based on fused traffic information coming from two different sensors. This can be used as test bed for traffic monitoring. Data is acquired by two sensor systems, Embedded Traffic Data Sensor (TDS) and a CCTV camera. Video data acquired by the CCTV camera is transmitted to an embedde...

This paper presents a sensor system for traffic data acquisition capable of discriminating vehicles into two classes (cars and trucks). The system is based on a bio-inspired `silicon retina' optical sensor in a compact embedded system and has been exhaustively evaluated in a real world environment at a highway test site. We further present the clas...

In this article, an ultra high-speed arbitration process for transient pixelspsila data is presented. Enabling a high-precision timestamping, this system demonstrates its uniqueness for handling high peak rates and preserving the main advantage of the neuromorphic electronic systems, that is high and accurate temporal resolution. Based on synchrono...

The architecture and prototype applications of an embedded vision system containing a neuromorphic temporal contrast vision sensor and a DSP are presented. The asynchronous vision sensor completely suppresses image data redundancy and encodes visual information in sparse address-event-representation (AER) data. Due to the efficient data preprocessi...

In this paper a sensor system for traffic data acquisition is presented. The embedded system, comprising a motion-sensitive optical sensor and a low-cost, low-power DSP, is capable of detecting, counting and measuring the velocity of passing vehicles. The detection is based on monitoring of the optical sensor output within configurable regions of i...

This paper presents a real-time data processing concept for asynchronous "address event" image sensors in highspeed machine vision applications. In the implemented system, a dual-line temporal contrast vision sensor asynchronously responds to relative illumination intensity changes in the visual scene, and encodes the information in the form of "ti...

This paper presents a 2times256 pixel dual-line temporal contrast vision sensor and the use of this sensor in exemplary high-speed machine vision applications over a wide range of target illumination. The sensor combines an asynchronous, data-driven pixel circuit with an on-chip precision time-stamp generator and a 3-stage pipelined synchronous bus...

Der Artikel beschreibt ein eingebettetes, optisches Sensorsystem, das auf einem speziellen optischen CMOS-Sensor mit analoger Signalvorverarbeitung basiert. Die Daten werden asynchron mit dem so genannten Address-event-Protokoll vom Sensor zur nachgeschalteten digitalen Signalverarbeitung übertragen. Dank der effizienten Datenkodierung und Signalvo...

A 120dB dynamic range 2times256 dual-line optical transient sensor uses pixels that respond asynchronously to relative intensity changes. A time stamp with variable resolution down to 100ns is allocated to the events at the pixel level. The pixel address and time stamp are read out via a 3-stage pipelined synchronous arbiter. The chip is fabricated...

This article presents an embedded multilane traffic data acquisition system based on an asynchronous temporal contrast vision sensor, and algorithms for vehicle speed estimation developed to make efficient use of the asynchronous high-precision timing information delivered by this sensor. The vision sensor features high temporal resolution with a l...

This paper presents an embedded vision system for object tracking applications based on a 128times128 pixel CMOS temporal contrast vision sensor. This imager asynchronously responds to relative illumination intensity changes in the visual scene, exhibiting a usable dynamic range of 120 dB and a latency of under 100 mus. The information is encoded i...

This work presents an embedded optical sensory system for traffic monitoring and vehicles speed estimation based on a neuromorphic "silicon-retina" image sensor, and the algorithm developed for processing the asynchronous output data delivered by this sensor. The main purpose of these efforts is to provide a flexible, compact, low-power and low-cos...

A low‐power compact embedded vision system capable of counting vehicles simultaneously on up to four lanes of a motorway is presented. The system comprises a wide dynamic range ‘silicon retina’ optical sensor with asynchronous event‐driven data interface and an off‐the‐shelf DSP for data acquisition, processing and interfacing to Ethernet. Each ind...

An automated scanning interferometer setup for time resolved measurement of thermal and free carrier distribution in semiconductor devices during short stress pulses is presented. The semiconductor device is probed via the thermal and free carrier induced changes in the semiconductor refractive index using a heterodyne interferometer. The setup int...

CDM hardening during the development of technology, devices, libraries and finally products differs significantly from the process well-established for HBM. This paper introduces a method on the basis of specialized CDM test structures including protection elements and sensitive monitor elements. These test structures mimic typical CDM-sensitive ci...

Backside transient interferometric mapping (TIM) techniques, based on focused-beam and holographic probing, are reviewed. Self-heating and free carrier effects in Si electrostatic discharge protection/power devices and III-V devices are investigated with ns time resolution.

Switching dynamics and current flow homogeneity under very-fast TLP (vf-TLP) stress is investigated in smart power and CMOS technology ESD protection devices by means of optical transient interferometric mapping (TIM) techniques with sub-nanosecond time resolution. Comparison between the device behavior under vf- and conventional TLP stress is disc...

A nonscanning optical method for single-shot thermal imaging of semiconductor devices is presented. The method detects changes in the band-to-band absorption due to local self-heating effects. The device is illuminated from the substrate side and the image reflected from the device topside is detected. The illumination wavelength is set near the se...

We have investigated the thermal dynamics in GaAs-based quantum cascade lasers during pulsed operation with an interferometric thermal mapping technique. The method enables us to determine thermal properties of these multilayered structures.

The thermal dynamics in quantum-cascade lasers under pulsed operation is investigated by a scanning interferometric thermal mapping technique. An infrared laser beam probes the change in the refractive index caused by current-induced heating of the working devices. The measured phase shift provides a quantitative information on the thermal characte...

We investigated the thermal dynamics of GaAs-based quantum cascade lasers by a scanning interferometric thermal mapping technique. The current-induced heating of the working devices causes a change of the semiconductor refractive index, which is probed by an infrared laser beam. The interferometrically detected phase shift provides a quantitative i...

In the backside interferometric thermal mapping technique, an infrared (IR) laser beam probes the temperature-induced changes in the semiconductor refractive index inside a semiconductor device, which results in a change in the measured optical phase shift. In this paper, a theoretical analysis of the phase shift is reported. The focus is on nanose...

We report on a method for the extraction of power dissipation sources inside semiconductor devices from laser-interferometry thermal mapping measurements. The two-dimensional power dissipation density is calculated from the time and space derivative of the measured optical phase shift. The method is applied to the analysis of an electrostatic disch...

A method for the extraction of power dissipation sources inside semiconductor devices on a nanosecond-time scale is proposed using a backside transient interferometric mapping technique. The two-dimensional power dissipation density is extracted from the time and space derivative of the measured optical phase shift. The method is applied to the ana...

Electric potential and field are probed in selected III-V devices by backside infrared (1.3mum wavelength) optical beam induced current (OBIC) technique under the DC and transient conditions. In an InGaP/InGaAs high electron mobility transistor (HEMT), the OBIC signal is sensitive to the distribution of electrical potential profile in the InGaP/InG...

For the development of ESD protection concepts a precise understanding of the behaviour of the active devices and possible protection elements under ESD stress is inevitable. Methods are required which can give information about physical relevant parameters. Today, ESD device simulation has been proven to be a powerful tool for the ESD engineer wit...

Trigger dynamics during a single ESD event and pulse-to-pulse variations in the trigger location are studied in ESD protection devices of a smart power technology. NPN bipolar transistors with and without a lateral shift in the collector buried layer are investigated. The homogeneity of the current flow along the device width is studied by means of...

We study the influence of layout parameters on trigger behavior of 0.35μm and 0.18μm technology grounded gate nMOSFET electrostatic discharge (ESD) protection devices. The homogeneity of the current flow along the device width is studied using an interferometric thermal mapping technique. The current density in the device, sustaining voltage and di...

We study thermal and free carrier distribution during electrostatic discharge (ESD) stress in npnp and anti-serial npn transistor ESD protection devices with different blocking capability. The thermal energy and free carrier distribution is studied using the measurements of temperature- and free carrier-induced optical phase shift. The dominant hea...

Thermal and free carrier distribution during electrostatic discharge (ESD) - like stress are investigated in anti-serial smart power technology ESD protection devices by using a laser interferometry mapping technique. The temperature- and free carrier - induced phase shift along the device length and width is studied as a function of stress current...

Triggering homogeneity of 0.35 mum and 0.18 mum technology grounded-gate nMOSFET electrostatic discharge (ESD) protection devices is investigated as a function of pulse risetime and current stress level. The current distribution along the device width is analysed using a backside interferometric thermal mapping technique. Differences in the trigger...

First Page of the Article

Spatial distribution of temperature and free-carrier concentration during high-current stress is studied in smart power electrostatic discharge (ESD) protection devices using a backside laser interferometric technique. The method is based on detecting changes in the refractive index of silicon due to thermo-optical and plasma-optical effects. We us...

Inhomogeneities in the parasitic bipolar transistor triggering during an electrostatic discharge (ESD) event are analyzed in 0.35 μm technology grounded-gate nMOSFET ESD protection devices operating in snapback. The current density during high current stress is studied by monitoring the temperature-induced increase in optical phase shift using a ba...

We study failure mechanisms in 0.35μm process grounded-gate nMOS electrostatic discharge (ESD) protection devices stressed by high current - ESD like - pulses. Stress evolution of leakage current and low frequency noise is correlated with the position of the ESD damage analyzed using optical beam induced current (OB1C) technique. While a kink-free-...

Electro-thermal simulation and a laser-interferometric thermal mapping technique are employed to study temperature distribution and dynamics in smart power technology electrostatic discharge (ESD) protection npn transistor devices during a high current stress. The simulation predicts two temperature peaks along the device length which are due to a...

Not Available

Thermal dynamics, temperature distribution and bipolar transistor triggering during electrostatic discharge (ESD) events are studied in smart-power technology ESD protection devices by a backside interferometric technique. Temperature changes in the device active area are monitored via ns-time scale measurements of optical phase shift. The bipolar...

Electrostatic discharge (ESD) stress - induced damage is analyzed in smart-power technology ESD protection devices. The lateral position of the ESD damage in diode and npn transistor protection structures is analyzed by using backside infrared microscopy. The lateral extension of the ESD damage is correlated with the magnitude and shape of the IV c...

A backside heterodyne interferometric technique is presented to study thermal effects in smart-power electrostatic discharge (ESD) protection devices during the ESD stress. The temperature increase in the device active area causes an increase in the silicon refractive index (thermo-optical effect) which is monitored by the time-resolved measurement...

We present a differential backside laser probing technique for the investigation of lateral temperature variations in power devices. The method is applied to analyze the temperature evolution in IGBTs operated under short circuit conditions. The extraction of the temperature from optical modulation signals is supported by electro-thermal device sim...

Breakdown homogeneity and triggering of bipolar transistor action are studied in smart power technology ESD protection devices via measurements of temperature distribution and thermal dynamics by a laser interferometric technique. Temperature changes in the devices biased in the avalanche multiplication or snapback region are monitored by ns-time s...

We present a study of thermal effects in Smart Power Electrostatic Discharge (ESD) protection structures by application of a noninvasive infrared backside laserprober technique. The temperature increase in the device active area is obtained from the time resolved measurements of optical phase changes under ESD-like high current stress. Results of t...