Andreas Velten

Andreas Velten
The Discovery Building · Medical Devices

About

117
Publications
16,863
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
3,529
Citations

Publications

Publications (117)
Preprint
Active imaging systems sample the Transient Light Transport Matrix (TLTM) for a scene by sequentially illuminating various positions in this scene using a controllable light source, and then measuring the resulting spatiotemporal light transport with time of flight (ToF) sensors. Time-resolved Non-line-of-sight (NLOS) imaging employs an active imag...
Preprint
Full-text available
Fluorescence guided surgery (FGS) is a promising surgical technique that gives surgeons a unique view of tissue that is used to guide their practice by delineating tissue types and diseased areas. As new fluorescent contrast agents are developed that have low fluorescent photon yields, it becomes increasingly important to develop computational mode...
Article
Full-text available
Position and time measurements of scintillation events encode information about the radiation source. Single photon avalanche diode (SPAD) arrays offer multiple-megapixel spatial resolution and tens of picoseconds temporal resolution for detecting single photons. Current lensless designs for measuring scintillation events use sensors that are lower...
Article
Full-text available
A focused imaging system such as a camera will reflect light directly back at a light source in a retro-reflection (RR) or cat-eye reflection. RRs provide a signal that is largely independent of distance providing a way to probe cameras at very long ranges. We find that RRs provide a rich source of information on a target camera that can be used fo...
Article
Full-text available
Non-line-of-sight (NLOS) imaging systems involve the measurement of an optical signal at a diffuse surface. A forward model encodes the physics of these measurements mathematically and can be inverted to generate a reconstruction of the hidden scene. Some existing NLOS imaging techniques rely on illuminating the diffuse surface and measuring the ph...
Article
Single-photon technologies are vital to a broad range of research areas such as nuclear physics, astrophysics, biology and computer vision. Fields such as LiDAR, single-photon imaging, biomedical imaging, quantum communication, optical quantum computing, quantum metrology, remote sensing and non-line-of-sight (NLOS) imaging also benefit from develo...
Preprint
Full-text available
Optical coding has been widely adopted to improve the imaging techniques. Traditional coding strategies developed under additive Gaussian noise fail to perform optimally in the presence of Poisson noise. It has been observed in previous studies that coding performance varies significantly between these two noise models. In this work, we introduce a...
Preprint
Full-text available
Non-line-of-sight (NLOS) imaging methods are capable of reconstructing complex scenes that are not visible to an observer using indirect illumination. However, they assume only third-bounce illumination, so they are currently limited to single-corner configurations, and present limited visibility when imaging surfaces at certain orientations. To re...
Article
Non-line-of-sight (NLOS) imaging methods are capable of reconstructing complex scenes that are not visible to an observer using indirect illumination. However, they assume only third-bounce illumination, so they are currently limited to single-corner configurations, and present limited visibility when imaging surfaces at certain orientations. To re...
Article
Full-text available
Non-line-of-sight (NLOS) imaging methods reconstruct scenes hidden around one corner using indirect third-bounce illumination on a visible relay surface. We show how diffuse hidden objects may exhibit specular behaviour in NLOS methods, and how fourth- and fifth-bounce illumination can encode useful information, such as imaging objects hidden aroun...
Article
Full-text available
Significance: Fluorescence lifetime imaging microscopy (FLIM) of the metabolic co-enzyme nicotinamide adenine dinucleotide (phosphate) [NAD(P)H] is a popular method to monitor single-cell metabolism within unperturbed, living 3D systems. However, FLIM of NAD(P)H has not been performed in a light-sheet geometry, which is advantageous for rapid imag...
Preprint
Full-text available
Single photon avalanche diode (SPAD) array sensors can increase the imaging speed for fluorescence lifetime imaging microscopy (FLIM) by transitioning from laser scanning to widefield geometries. While a SPAD camera in epi-fluorescence geometry enables widefield FLIM of fluorescently labeled samples, label-free imaging of single-cell autofluorescen...
Article
Computational approach to imaging around the corner, or non-line-of-sight (NLOS) imaging, is becoming a reality thanks to major advances in imaging hardware and reconstruction algorithms. A recent development towards practical NLOS imaging, Nam et al. [1] demonstrated a high-speed non-confocal imaging system that operates at 5 Hz, 100x faster than...
Preprint
Full-text available
Computational approach to imaging around the corner, or non-line-of-sight (NLOS) imaging, is becoming a reality thanks to major advances in imaging hardware and reconstruction algorithms. A recent development towards practical NLOS imaging, Nam et al. demonstrated a high-speed non-confocal imaging system that operates at 5Hz, 100x faster than the p...
Article
Full-text available
Non-Line-Of-Sight (NLOS) imaging aims at recovering the 3D geometry of objects that are hidden from the direct line of sight. One major challenge with this technique is the weak available multibounce signal limiting scene size, capture speed, and reconstruction quality. To overcome this obstacle, we introduce a multipixel time-of-flight non-line-of...
Article
Non-line-of-sight (NLOS) imaging systems reconstruct hidden scenes using computational methods based on indirect light that diffusely reflected from relay walls. Due to the computation and memory requirements of reconstruction algorithms, real-time NLOS imaging for room-size scenes based on non-confocal data has long been challenging. This paper pr...
Article
Non-Line-of-Sight (NLOS) imaging reconstructs occluded scenes based on indirect diffuse reflections. The computational complexity and memory consumption of existing NLOS reconstruction algorithms make them challenging to be implemented in real-time. This paper presents a fast and memory-efficient phasor field-diffraction-based NLOS reconstruction a...
Preprint
Full-text available
Non-line-of-sight (NLOS) imaging is based on capturing the multi-bounce indirect reflections from the hidden objects. Active NLOS imaging systems rely on the capture of the time of flight of light through the scene, and have shown great promise for the accurate and robust reconstruction of hidden scenes without the need for specialized scene setups...
Preprint
Digital camera pixels measure image intensities by converting incident light energy into an analog electrical current, and then digitizing it into a fixed-width binary representation. This direct measurement method, while conceptually simple, suffers from limited dynamic range and poor performance under extreme illumination -- electronic noise domi...
Preprint
The light transport matrix (LTM) is an instrumental tool in line-of-sight (LOS) imaging, describing how light interacts with the scene and enabling applications such as relighting or separation of illumination components. We introduce a framework to estimate the LTM of non-line-of-sight (NLOS) scenarios, coupling recent virtual forward light propag...
Preprint
Indirect Time-of-Flight (iToF) cameras are a promising depth sensing technology. However, they are prone to errors caused by multi-path interference (MPI) and low signal-to-noise ratio (SNR). Traditional methods, after denoising, mitigate MPI by estimating a transient image that encodes depths. Recently, data-driven methods that jointly denoise and...
Article
Full-text available
The development of single-photon counting detectors and arrays has made tremendous steps in recent years, not the least because of various new applications, e.g., LIDAR devices. In this work, a 3D imaging device based on real thermal light intensity interferometry is presented. By using gated SPAD technology, a basic 3D scene is imaged in reasonabl...
Preprint
Full-text available
Single-photon avalanche diodes (SPADs) are a rapidly developing image sensing technology with extreme low-light sensitivity and picosecond timing resolution. These unique capabilities have enabled SPADs to be used in applications like LiDAR, non-line-of-sight imaging and fluorescence microscopy that require imaging in photon-starved scenarios. In t...
Preprint
Non-Line-of-Sight (NLOS) imaging aims at recovering the 3D geometry of objects that are hidden from the direct line of sight. In the past, this method has suffered from the weak available multibounce signal limiting scene size, capture speed, and reconstruction quality. While algorithms capable of reconstructing scenes at several frames per second...
Preprint
Full-text available
The development of single-photon counting detectors and arrays has made tremendous steps in recent years, not the least because of various new applications in, e.g., LIDAR devices. In this work, a 3D imaging device based on real thermal light intensity interferometry is presented. By using gated SPAD technology, a basic 3D scene is imaged in reason...
Article
Full-text available
Imaging of scenes using light or other wave phenomena is subject to the diffraction limit. The spatial profile of a wave propagating between a scene and the imaging system is distorted by diffraction resulting in a loss of resolution that is proportional with traveled distance. We show here that it is possible to reconstruct sparse scenes from the...
Preprint
Laser scanning microscopy techniques such as confocal and multiphoton fluorescence microscopy have been widely adopted by the biological research community due to their ability to monitor intact specimens at high spatial and temporal resolution. However, they have been limited for many biomedical, clinical and industrial applications by their funda...
Preprint
Imaging of scenes using light or other wave phenomena is subject to the diffraction limit. The spatial profile of a wave propagating between a scene and the imaging system is distorted by diffraction resulting in a loss of resolution that is proportional with traveled distance. We show here that it is possible to reconstruct sparse scenes from the...
Preprint
This paper presents a statistical treatment of phasor fields (P-fields) - a wave-like quantity denoting the slow temporal variations in time-averaged irradiance (which was recently introduced to model and describe non-line-of-sight (NLoS) imaging as well as imaging through diffuse or scattering apertures) - and quantifies the magnitude of a spuriou...
Article
Full-text available
In this paper we present a novel single-photon detector specifically designed for Non-Line-Of-Sight (NLOS) imaging applications within the framework of the DARPA REVEAL program. The instrument is based on a linear 16 × 1 Complementary Metal-Oxide-Semiconductor (CMOS) Single-Photon Avalanche Diode (SPAD) array operated in fast-gated mode by a novel...
Preprint
Emerging single-photon-sensitive sensors combined with advanced inverse methods to process picosecond-accurate time-stamped photon counts have given rise to unprecedented imaging capabilities. Rather than imaging photons that travel along direct paths from a source to an object and back to the detector, non-line-of-sight (NLOS) imaging approaches a...
Article
Emerging single-photon-sensitive sensors produce picosecond-accurate time-stamped photon counts. Applying advanced inverse methods to process these data has resulted in unprecedented imaging capabilities, such as non-line-of-sight (NLOS) imaging. Rather than imaging photons that travel along direct paths from a source to an object and back to the d...
Conference Paper
Full-text available
Non-Line-of-Sight imaging has been linked to wave diffraction by the recent phasor field method. In wave optics, the Wigner Distribution Function description for an optical imaging system is a powerful analytical tool for modeling the imaging process with geometrical transformations. In this paper, we focus on illustrating the relation between capt...
Article
Full-text available
Non-line-of-sight (NLOS) imaging recovers objects using diffusely reflected indirect light using transient illumination devices in combination with a computational inverse method. While capture systems capable of collecting light from the entire NLOS relay surface can be much more light efficient than single pixel point scanning detection, current...
Article
Full-text available
The non-line-of-sight (NLOS) imaging problem has attracted a lot of interest in recent years. The objective is to produce images of objects that are hidden around a corner, using the information encoded in the time-of-flight (ToF) of photons that scatter multiple times after incidence at a given relay surface. Most current methods assume a Lamberti...
Conference Paper
The Phasor field (P-field) integral has been shown to describe non-line-of-sight (NLoS) imaging completely for an incoherent underlying optical carrier due to aperture roughness [1-4]. We present a statistical treatment showing an introduction of a P- field noise term due to partially-coherent light and explain why experiments conducted by Liu, et....
Conference Paper
This paper demonstrates range imaging based on intensity interferometry with real thermal light. Advantages like robustness to atmospheric scattering or autonomy by exploiting external light sources make this approach interesting for future applications.
Conference Paper
A Phasor field [1-4] - defined as the slow-varying envelope of optical irradiance - has been shown to provide a Huygens-like description and practical reconstructions of non-line-of-sight imaging [5]. We provide results from a series of experiments [6] to show P-field propagation and interference properties similar to those of electric fields.
Article
Full-text available
The excited state lifetime of a fluorophore together with its fluorescence emission spectrum provide information that can yield valuable insights into the nature of a fluorophore and its microenvironment. However, it is difficult to obtain both channels of information in a conventional scheme as detectors are typically configured either for spectra...
Article
Full-text available
Time-of-flight (ToF) non-line-of-sight (NLoS) imaging reconstructs images of scenes with light that have undergone diffuse reflections. While, in the past, ToF light propagation and reconstruction methods have been described using their own inverse methods, it has recently been shown that ToF light transport can be described as the propagation of a...
Article
Full-text available
Non-line-of-sight (NLOS) imaging has recently attracted a lot of interest from the scientific community. The goal of this paper is to provide the basis for a comprehensive mathematical framework for NLOS imaging that is directly derived from physical concepts. We introduce the irradiance phasor field ( $\mathcal {P}$ P -field) as an abstract quanti...
Article
Full-text available
Non-line-of-sight imaging allows objects to be observed when partially or fully occluded from direct view, by analysing indirect diffuse reflections off a secondary relay surface. Despite many potential applications1–9, existing methods lack practical usability because of limitations including the assumption of single scattering only, ideal diffuse...
Article
Fluorescence lifetime imaging (FLIM) is used for measuring material properties in a wide range of applications, including biology, medical imaging, chemistry, and material science. In frequency-domain FLIM (FD-FLIM), the object of interest is illuminated with a temporally modulated light source. The fluorescence lifetime is measured by computing th...
Presentation
In a non-line-of-sight (NLOS) scenario, the target is hidden by an occluder from the imaging system. Recent publications have shown that it is possible to retrieve the image of the target in such scenario, using an hardware system comprising an ultra-fast laser and a single photon avalanche diode (SPAD) and backprojection-based recovery algorithms....
Preprint
Full-text available
Recently, an optical meta concept called the Phasor Field (P-Field) was proposed that yields great quality in the reconstruction of hidden objects imaged by non-line-of-sight (NLOS) imaging. It is based on virtual sinusoidal modulation of the light with frequencies in the MHz range. Phasor Field propagation was shown to be described by the Rayleigh...
Preprint
Full-text available
Single photon avalanche diodes (SPADs) are starting to play a pivotal role in the development of photon-efficient, long-range LiDAR systems. However, due to non-linearities in their image formation model, a high photon flux (e.g., due to strong sunlight) leads to distortion of the incident temporal waveform, and potentially, large depth errors. Ope...
Preprint
Single-photon avalanche diodes (SPADs) are an emerging technology with a unique capability of capturing individual photons with high timing precision. SPADs are being used in several active imaging systems (e.g., fluorescence lifetime microscopy and LiDAR), albeit mostly limited to low photon flux settings. We propose passive free-running SPAD (PF-...
Preprint
Full-text available
Non-Line-of-Sight (NLOS) imaging allows to observe objects partially or fully occluded from direct view, by analyzing indirect diffuse reflections off a secondary, relay surface. Despite its many potential applications, existing methods lack practical usability due to several shared limitations, including the assumption of single scattering only, l...
Patent
Fluorescent markers used to identify a tissue may be imaged in a bright environment by synchronizing the imaging process with rapidly switched ambient lighting so that imaging occurs in phase with a switching off of the ambient lighting. In this way, valuable fluorescent imaging may be performed in an environment that appears to be brightly illumin...
Preprint
Cameras capable of capturing videos at a trillion frames per second allow to freeze light in motion, a very counterintuitive capability when related to our everyday experience in which light appears to travel instantaneously. By combining this capability with computational imaging techniques, new imaging opportunities emerge such as three dimension...
Article
Recent advances in computer vision and inverse light transport theory have resulted in several non-line-of-sight imaging techniques. These techniques use photon time-of-flight information encoded in light after multiple, diffuse reflections to reconstruct a three-dimensional scene. In this paper, we propose and describe two iterative backprojection...
Conference Paper
Full-text available
Three dimensional imaging techniques have been widely used in both industry and academia. Time-of-flight (ToF) sensors offer a promising method of 3D imaging due to compact size and low complexity. However, state-of-the-art ToF sensors only have depth resolutions of centimeters due to limitations in the modulation frequencies that can be used. In t...
Article
The depth resolution achieved by a continuous wave time-of-flight (C-ToF) imaging system is determined by the coding (modulation and demodulation) functions that it uses. Almost all current C-ToF systems use sinusoid or square coding functions, resulting in a limited depth resolution. In this article, we present a mathematical framework for explori...
Conference Paper
We propose a time-of-flight imaging technique with modulation frequencies as high as 1 THz using optical superheterodyne interferometry. Our proposed system provides great flexibility in imaging range and resolution.
Conference Paper
A mathematical construct ‘Phasor Fields’ (P-Fields) is used to develop a light transport mathematical model for non-line-of-sight (NLOS) imaging applications. We show that NLOS imaging can be treated as conventional line-of-sight (LOS) imaging using P-Fields.
Conference Paper
We propose a time-of-flight imaging technique with modulation frequencies as high as 1 THz using optical superheterodyne interferometry. Our proposed system provides great flexibility in imaging range and resolution.
Article
The application of nonline-of-sight (NLoS) vision and seeing around a corner has been demonstrated in the recent past on a laboratory level with round trip path lengths on the scale of 1 m as well as 10 m. This method uses a computational imaging approach to analyze the scattered information of objects which are hidden from the sensor’s direct fiel...
Article
Full-text available
Recent advances in fluorescence microscopy have yielded an abundance of high-dimensional spectrally rich datasets that cannot always be adequately explored through conventional three-color visualization methods. While computational image processing techniques allow researchers to derive spectral characteristics of their datasets that cannot be visu...
Article
Full-text available
By using time-of-flight information encoded in multiply scattered light, it is possible to reconstruct images of objects hidden from the camera’s direct line of sight. Here, we present a non-line-of-sight imaging system that uses a single-pixel, single-photon avalanche diode (SPAD) to collect time-of-flight information. Compared to earlier systems,...