Ming-Jie Sun

Beihang University (BUAA) | BUAA · Department of Optoelectronics Engineering

Single-pixel imaging uses a single-pixel detector, rather than a focal plane detector array, to image a scene. It provides advantages for applications such as multi-wavelength, three-dimensional imaging. However, low frame rates have been a major obstacle inhibiting the use of computational ghost imaging technique in wider applications since its in...

First-photon imaging is a photon-efficient, computational imaging technique that reconstructs an image by recording only the first-photon arrival event at each spatial location and then optimizing the recorded photon information. The optimization algorithm plays a vital role in image formation. A natural scene containing spatial correlation can be...

Light-in-flight imaging enables the visualization and characterization of light propagation, which provides essential information for the study of the fundamental phenomena of light. A camera images an object by sensing the light emitted or reflected from it, and interestingly, when a light pulse itself is to be imaged, the relativistic effects, ca...

Spectral imaging technique, which retrieves both spatial and spectral information of a scene or an object, is an important tool in applications such as food inspection, vegetation monitoring and geographic remote sensing. Most spectral imaging systems have a complex system architecture, in which different components are used for different functions...

First-photon imaging allows the reconstruction of scene reflectivity and depth information with a much fewer number of photon countings, compared with conventional time-correlated single-photon counting based imaging systems. One problem of the original first-photon imaging is that the quality of depth reconstruction is significantly based on the d...

While transmission electron microscopes (TEM) can achieve a much higher resolution than optical microscopes, they face challenges of damage to samples during the high energy processes involved. Here, we explore using computational ghost imaging techniques in electron microscopy to reduce the total required intensity. The technological lack of the e...

Phase retrieval utilizing Fourier amplitudes plays a significant role in image recovery. Iterative phase retrieval algorithms have been developed to retrieve phase information that cannot be recorded by detectors directly. However, iterative algorithms face the problem of being trapped in local minima due to the nonconvexity of phase retrieval, and...

Transmission electron microscopes (TEM) achieve high resolution imaging by raster scanning a focused beam of electrons over the sample and measuring the transmission to form an image. While a TEM can achieve a much higher resolution than optical microscopes, they face challenges of damage to samples during the high energy processes involved. Here,...

Digital cameras obtain color information of the scene using a chromatic filter, usually a Bayer filter, overlaid on a pixelated detector. However, the periodic arrangement of both the filter array and the detector array introduces frequency aliasing in sampling and color misregistration during demosaicking process which causes degradation of image...

We propose a fast calibration method to compensate the non-uniform illumination in computational ghost imaging. Inspired by a similar procedure to calibrate pixel response differences for detector arrays in conventional digital cameras, the proposed method acquires one image of an all-white paper to determine the non-uniformity of the illumination...

Computational ghost imaging has been an interesting topic for the imaging research community. However, low resolution and quality of image have been a major problem inhibiting the application of computational ghost imaging technique. In this work, we develop a chromatic 64 × 64 LED array which provides high-speed structured illumination up to 2.5 M...

Conventional semi-active laser guidance takes advantage of the laser designator to illuminate the stable and uniform laser spot on target precisely. The seeker collects the reflected light by a quadrant detector and outputs the relative position information to guide the missile to the illuminating laser spot. However, the designation and guidance a...

Three-dimensional reconstruction can be performed in many ways, among which photometric stereo is an established and intensively investigated method. In photometric stereo, geometric alignment or pixel-matching between two-dimensional images under different illuminations is crucial to the accuracy of three-dimensional reconstruction, and the dynami...

Single-pixel imaging techniques extend the time dimension to reconstruct a target scene in the spatial domain based on single-pixel detectors. Structured light illumination modulates the target scene by utilizing multi-pattern projection, and the reflected or transmitted light is measured by a single-pixel detector as total intensity. To reduce the...

In single-pixel imaging (SPI), a large number of illuminations is usually required to capture one single image. Consequently, SPI may only achieve a very low frame rate for a fast-moving object and the reconstructed images are contaminated with blur and noise. In previous works, some attempts are made to perform motion estimation between neighborin...

Computational ghost imaging systems reconstruct images using a single element detector, which measures the level of correlation between the scene and a set of projected patterns. The sequential nature of these measurements means that increasing the system frame-rate reduces the signal-to-noise ratio (SNR) of the captured images. Furthermore, a high...

Phase retrieval plays an important role in Fourier spectrum based image recovery techniques. Despite the fact that many algorithms have been proposed to improve the performance of the phase optimization, it is an inherent contradiction that in order to increase the possibility of reaching the global minimum by introducing more ran-domness during th...

Whereas modern digital cameras use a pixelated detector array to capture images, single-pixel imaging reconstructs images by sampling a scene with a series of masks and associating the knowledge of these masks with the corresponding intensity measured with a single-pixel detector. Though not performing as well as digital cameras in conventional vis...

An atomic magnetometer is an ultra-high-sensitivity sensor that measures magnetic fields by means of atomic spin polarization. The spatial frequency response (SFR), which describes the spin polarizations corresponding to the field at different spatial frequencies, is an important property of atomic magnetometers. To characterize the SFR, one must g...

We develop a computational multispectral imaging system using a digital micromirror device as a spatial light modulator and a blazed grating. Multispectral images of 128 × 128 spatial resolution and ~40nm spectral interval are obtained.

Optical phased array (OPA) imaging technique, which uses electro-optic modulation to achieve beam steering rather than mechanical scanning, is a raster scanning imaging method with great potential due to its non-inertia and high-speed. However, fabrication imperfection of an OPA causes pre-designed phase modulations not yielding desired steering an...

Digital cameras use detector arrays with regular geometry for optical sampling. Though regular arrangement was demonstrated to be optimal for two-dimensional sampling, it causes aliasing at high frequencies exceeding its Nyquist limit. Here, we proposed a randomization procedure to generate 2D hyperuniform patterns that can be used to suppress alia...

Sinusoidal Fourier patterns are one of the orthogonal basis patterns used in single-pixel imaging. By retrieving the complex Fourier coefficients with phase-shifting algorithm, it reconstructs the image of a scene using inverse Fourier transform. It has been shown that Fourier single-pixel imaging is particularly well-suited to non-conventional ima...

Single-pixel imaging, also known as computational ghost imaging, provides an alternative method to perform imaging in various applications which are difficult for conventional cameras with pixelated detectors, such as multi-wavelength imaging, three-dimensional imaging, and imaging through turbulence. In recent years, many improvements have success...

Single-pixel imaging uses a single-pixel detector, rather than a focal plane detector array, to image a scene. It provides advantages for applications such as multi-wavelength, three-dimensional imaging. However, low frame rates have been a major obstacle inhibiting the use of computational ghost imaging technique in wider applications since its in...

Phase retrieval is an important tool for image recovery techniques based on Fourier spectrum. Different iterative algorithms have been developed to retrieve phase information. However, due to the non-convex feature of the phase optimization problem, it remains a challenge to globally obtain the optimal phase information. In this work, we proposed a...

To retrieve an N pixel image of a scene, conventional digital cameras record the information using a N pixelated detector with one measurement, while single-pixel imaging achieves it by sampling the image in a particular basis and recording the light intensities of N temporal measurements with a single-pixel detector. Besides these two scheme, it i...

Single-pixel imaging is an alternate imaging technique particularly well-suited to imaging modalities such as hyper-spectral imaging, depth mapping, 3D profiling. However, the single-pixel technique requires sequential measurements resulting in a trade-off between spatial resolution and acquisition time, limiting real-time video applications to rel...

In contrast to conventional multipixel cameras, single-pixel cameras capture images using a single detector that measures the correlations between the scene and a set of patterns. However, these systems typically exhibit low frame rates, because to fully sample a scene in this way requires at least the same number of correlation measurements as the...

We describe a single-pixel imaging system with an enhanced frame-rate, achieved by reconstructing images with a variable resolution across the field-of-view. Resolution can be adaptively changed from frame to frame to track moving objects.

We describe a single-pixel imaging system with an enhanced frame-rate, achieved by reconstructing images with a variable resolution across the field-of-view. Resolution can be adaptively changed from frame to frame to track moving objects.

We use an ultrashort-pulsed laser and a high-speed spatial light modulator to illuminate a scene with a series of patterns. A photomultiplier and fast electronics are used to histogram the first-photon backscattered from which a computer algorithm can reconstruct 3D images.

As an alternative to conventional multi-pixel cameras, single-pixel cameras enable images to be recorded using a single detector that measures the correlations between the scene and a set of patterns. However, to fully sample a scene in this way requires at least the same number of correlation measurements as there are pixels in the reconstructed i...

Time-of-flight three-dimensional imaging is an important tool for applications such as object recognition and remote sensing. Conventional time-of-flight three-dimensional imaging systems frequently use a raster scanned laser to measure the range of each pixel in the scene sequentially. Here we show a modified time-of-flight three-dimensional imagi...

Real-time three-dimensional video of a mannequin head and a swinging ball.

Real-time three-dimensional video of a swinging ball.

Supplementary Figures 1-3, Supplementary Notes 1-3, Supplementary Methods and Supplementary References.

Single-pixel cameras provide a means to perform imaging at wavelengths where pixelated detector arrays are expensive or limited. The image is reconstructed from measurements of the correlation between the scene and a series of masks. Although there has been much research in the field in recent years, the fact that the signal-to-noise ratio (SNR) sc...

Ghost imaging and diffraction, inspired by the Hanbury Brown and Twiss effect, have potential in both classical and quantum optics regimes on account of their nonlocal characteristics and subwavelength resolution capability, and therefore have aroused particular interest. By extending the correspondence imaging scheme, we utilize the positive and n...

Time-of-flight three dimensional imaging is an important tool for many applications, such as object recognition and remote sensing. Unlike conventional imaging approach using pixelated detector array, single-pixel imaging based on projected patterns, such as Hadamard patterns, utilises an alternative strategy to acquire information with sampling ba...

Since the invention of digital cameras there has been a concerted drive towards detector arrays with higher spatial resolution. Microscanning is a technique that provides a final higher resolution image by combining multiple images of a lower resolution. Each of these low resolution images is subject to a sub-pixel sized lateral displacement. In th...

The Hanbury Brown and Twiss (HBT) effect is a classical intensity correlation effect, but it is also widely used in the quantum optics regime, and has led to many important breakthroughs in both basic and applied physics, among which ghost imaging (GI) has aroused particular interest. In this article, the positive and negative intensity correlation...

Super-resolution (SR) imaging is a technology based on oversampling to reduce the aliasing and increase the image resolution. Pixel active area (PAA) model is essential in SR related research. The difference of MTF with the widely used square model and the "Z" shape model we proposed was calculated to simulate the practical infrared focal plane arr...

The key technique in super-resolution reconstruction is sub-pixel scan, which is mainly achieved by moving detector or optic axis. Moving optic axis is performed by rotating or vibrating one optical component of the imaging lens. However, the machining requirements of the optical component for sub-pixel scan are rigorous or sometimes even impossibl...

The previous image quality assessment(IQA) methods request the same size of original and distorted image, not suitable for the super-resolution image. The effective of image size change has rarely been discussed. An improved reduced-reference image quality assessment (RRIQA) method based on the structural similarity image metric(SSIM) and scale inv...

The ideal square pixel active area (PAA) model is widely used in researches of micro scanning (MS) based infrared (IR) super-resolution (SR) imaging. However, according to the micrographs of practical IR focal plane array (FPA) productions, the PAAs of these productions are actually not a strict square. Three different PAA shapes, i.e. square, rect...

The performance of linear frequency-modulated continuous-wave (LFMCW) coherent Lidar system is inevitably influenced by the modulation characteristics of the transmitting light and some issues may arise when the system does not work under the ideally specified conditions. The relationship between the asymmetric and nonlinear modulation of transmitt...

A 1.55-µm all-solid frequency-modulated continuous-wave (FMCW) coherent lidar based on the sinusoidal frequency demodulation technique for range and velocity measurement is presented. Both the nonlinearity of linear modulation waveform and the difficulty in measuring the frequency of sinusoidal modulation system are circumvented by utilizing segmen...

The imaging quality using two-detector arbitrary Nth-order intensity correlation in optics is investigated. It is theoretically demonstrated that with the order of intensity correlation N increases, the visibility of the retrieved image enhances promptly; and different n-fold intensity on one arm of the intensity correlation leads to different visi...

Second-order 2D ghost imaging using near-infrared light is investigated theoretically and experimentally. The far-field analytical results of this imaging technology realized with a uniformly bright, incoherent and quasi-monochromatic light source are deduced and the numerical simulations are performed using pinhole as the imaging object. Simulatio...

Speckle, severely affecting the image quality in laser projection, would arise when coherent lights are scattered from a rough surface. Vibrating or rotating a diffuser or a diffractive optical element, the conventional method of speckle suppression (hereinafter refered to as ``the conventional method''), does reduce the speckle, however, also caus...

When coherent light scattered from a rough surface, speckle is detected by an intensity detector. In laser projection, speckle severely affects the image quality and therefore must be suppressed. It is mostly achieved by vibrating or rotating a diffuser or a diffractive optical element (DOE) in illumination system. These methods can effectively red...