Multiscale and multimodal image fusion. Coping with differences in scanned area and spatial resolution for Raman/fluorescence images of labelled cells.

Abstract

Multiscale and multimodal image fusion is a challenge derived from the diversity of chemical and spatial information provided by the current hyperspectral image platforms. Efficient image fusion approaches are essential to exploit the complementary chemical information across different zoom scales. Most current image fusion algorithms tend to work by equalizing the spatial characteristics of the platforms to be combined, i.e., downsampling pixel size and cropping non-common scanned sample areas if required. In this work, a new image unmixing algorithm based on a flexible mathematical framework is proposed to enable working with all available image information while preserving the original spatial properties of every imaging measurement. The algorithm is tested on a challenging image fusion scenario of fluorescence and Raman images collected on labelled HeLa cells. The system is relevant from an analytical point of view, since smart fluorescence labelling allows profiting from the excellent morphological information without causing interferences in the rich chemical information furnished by Raman. From a data handling perspective, it offers a challenging multiscale problem, where the fast fluorescence imaging acquisition allows recording full cell images, and the slower Raman image acquisition is focused on scanning only relevant small regions of the cells analyzed. By applying the image fusion algorithm proposed, an improved morphological and chemical characterization of cell constituents in the full cell area is obtained despite the different spatial scales used in the original imaging measurements.