Conference PaperPDF Available

Panchromatic sharpening of FOD-based DEC maps by structural T1 information

Authors:

Abstract

Diffusion weighted imaging (DWI) acquisitions typically suffer from a lower spatial resolution, compared to their T1 structural counterparts, but provide unique angular information. Researchers and clinical users may often find themselves switching back and forth between the "traditional" directionally-encoded colour (DEC) FA map and a T1 map to navigate anatomy, or try to overlay them using (partial) transparency. We propose a panchromatic sharpening approach tailored to (FOD-based) DEC and (T1) structural information to create a single fused image. The resulting contrast is striking and allows for easy identification of various anatomical structures beyond the resolution of the DWI data.
PANCHROMATIC SHARPENING OF FOD-BASED DEC MAPS BY STRUCTURAL T1 INFORMATION
Thijs Dhollander
1
, David Raffelt
1
, Robert Elton Smith
1
, and Alan Connelly
1,2
1
The Florey Institute of Neuroscience and Mental Health, Melbourne, Victoria, Australia,
2
The Florey Department of Neuroscience, University of Melbourne,
Melbourne, Victoria, Australia
Introduction: Diffusion weighted imaging (DWI) acquisitions typically suffer from a lower spatial resolution, compared to their T1 structural counterparts, but provide
unique angular information on the microstructure in each voxel. Consequently, researchers as well as clinical users may often find themselves switching back and forth
between the traditional directionally-encoded colour (DEC) fractional anisotropy (FA) map and an aligned T1 map in order to navigate and identify the anatomy, or try
their luck at overlaying them using (partial) transparency. In doing so, they rely mostly on the T1 intensities to define fine boundaries, while using the DEC for added
specificity. The FA intensity’s role is often reduced to providing a spatial cue to match both maps. This scenario is highly similar to the challenges encountered when
visualising satellite image data. A typical solution used for that purpose is panchromatic sharpening, or pansharpening for short: a high resolution panchromatic image
is fused with a lower resolution multispectral image, relying on the human visual system’s relatively lower sensitivity to colour differences. Another application relying
on this is chroma subsampling (e.g., used for video encoding and JPEG compression). We propose a pansharpening approach tailored to DEC information and (T1)
structural data. However, we found that the DEC derived from the first eigenvector (FEV)
[1,2]
of the diffusion tensor can introduce false edges in the contrast (Fig.1),
furthermore leading us to a more suitable DEC contrast based on the fibre orientation distribution (FOD) as obtained from constrained spherical deconvolution (CSD)
[3]
.
Theory: We denote the “traditional” unit DEC vector of the FEV by DECFEV; it evaluates to the elementwise absolute value of the
FEV. Our FOD-based DEC vector, on the other hand, is defined as an FOD amplitude weighted mix of colours for all orientations:
DECFODFOD
∙DEC∙d FOD∙DEC∙d
The first step of our panchromatic sharpening approach consists of resampling either (FEV or FOD-based) DEC map to the grid of the
T1-weighted structural volume. In this work, we apply cubic interpolation. This may, however, result in DEC vectors featuring non-
unit norms; hence, we renormalise them at this stage. The resulting map is directly weighted by the T1 intensities; i.e., the T1 provides
the luminance, while the DEC yields the chrominance information. This leaves the T1 information (and interpretation) fully intact.
Data & processing: DWI data of a single subject were acquired on a Siemens 3T scanner, with a voxel size of 2.5×2.5×2.5 mm³, and
using a multi-shell acquisition scheme by applying diffusion weightings of b = 0, 1000, 2000, 3000 s/mm² respectively for 5, 17, 31, 50
directions. An extra b = 0 volume was acquired with reversed phase encoding. Additionally, a T1-weighted structural volume was
acquired with a voxel size of 1×1×1 mm³. The DWI data was preprocessed using a state-of-the-art pipeline, including susceptibility-
induced distortion correction using the reversed phase encoding volume
[4]
, combined eddy-current induced distortion and head motion
correction
[5]
, and N3 bias-field correction
[6]
. The T1 volume was rigidly registered to the corrected DWI data (using a b = 0 volume) by
maximising a normalised mutual information similarity metric. White matter (WM) FODs were obtained by applying multi-shell
multi-tissue (MSMT) CSD
[7]
to the DWI data. The normalised DECFOD, as defined above, was calculated using discrete samples of
the FODs evaluated for a set of 1281 directions (4
th
order icosahedral tessellation). This computation only takes a few seconds for the
whole dataset. We also calculated the DECFEV map from the tensor model. Both DEC maps were resampled to the 1×1×1 mm³ grid
of the T1 volume, and the DEC vectors were renormalised. Finally, both maps were weighted by the T1 volume.
Results & discussion: Fig.2 presents the T1 map as well as the resampled/renormalised DEC contrasts obtained from the FEV/FOD,
before they are fused. The FEV-based DEC contrast shows higher saturation because it is derived from single orientations, yet noisier
“blobs” resulting from resampled noisy individual DEC voxels in regions where the FEV is less well-defined. This behaviour is similar
to the example provided in Fig.1. After weighting by the T1 intensities, it becomes even more apparent that an often noisy contrast arises in the pansharpened FEV-
based map, while the pansharpened FOD-based map provides better quality; hence we focus on the latter result. Fig.3 and Fig.4 show several other slices through the
FOD-based pansharpened volume. Specific structures at the brim of (or even beyond) the DWI data’s spatial resolution, e.g. the fornix, the optical chiasm and finer
structures of the cerebellum, are still easily identified thanks to the T1 contrast. When looking closer, orientations in the cortex can even be clearly seen: we found this
information is typically “greyed out” when observing single-shell FOD-based pansharpened maps (not shown), which may in fact be less overwhelming and overall
easier on the eyes for some observers (a similar effect, if desired, could in principle also be achieved using multi-shell data). Finally, note that our pansharpened
contrasts do not require fibre tracking (e.g., as in track-weighted imaging
[8]
), and preserve the full interpretation and spatial coverage of the T1 information.
Conclusion: A pansharpening approach tailored to DEC and (T1) structural data can work wonders, creating a single striking and easily navigated contrast image.
Fig.2: T1-weighted structural volume (top);
DECFEV and DECFOD, resampled to the
T1 volume’s grid and renormalised (middle);
panchromatic T1 sharpened DECFEV and
DECFOD contrasts (bottom). Note how this
works out better for DECFOD.
Fig.3: Panchromatic T1 sharpened FOD-based DEC map.
At first sight, the amount of information may be
overwhelming. Upon closer inspection, it can be seen that
the colours often consistently indicate perpendicular
directions in the cortical ribbon. Using single-shell CSD
instead, this map can actually be easier on the eyes, but the
details in the cortex appear more greyed out (not shown).
Fig.4: Panchromatic T1
sharpened FOD-based
DEC maps.
Top: slice at an oblique
angle, approximately in
the “plane” of the
optical chiasm.
Bottom: sagittal slice
providing a good view
on the cerebellum.
References: [1] Pierpaoli C, Proc. ISMRM 5, 1741 (1997), [2] Pajevic S and Pierpaoli C, MRM 42(3), 526-540 (1999), [3] Tournier JD et al., NeuroImage 35(4), 1459-
1472 (2007), [4] Andersson JLR et al., NeuroImage 20(2), 870-888 (2003), [5] Andersson JLR et al., Proc. ISMRM 20, 2426 (2012), [6] Tustison NJ et al., IEEE TMI
29(6), 1310-1320 (2010), [7] Jeurissen B et al., NeuroImage 103, 411-426 (2014), [8] Calamante F et al., NeuroImage 59(3), 2494-2503 (2012).
Fig.1: FODs in neighbouring
voxels with slightly different
relative lobe amplitudes, and
the resulting DECFE
V
and
DECFOD contrasts.
DEC(FEV)
DEC(FOD)
Proc. Intl. Soc. Mag. Reson. Med. 23 (2015) 0566.
... Tracking parameters were: step size 0.16 mm; stopping angle 30˚; stopping and initial fiber orientation amplitude 0.1; generated tracks 1000. Seed placement was determined by directionally encoded color (DEC) diffusion maps which were weighted by the FOD and panchromatically sharpened by the higher resolution T1 anatomical image [43,44]. ...
Article
Full-text available
Purpose Diffusion magnetic resonance imaging and tractography has an important role in the visualization of brain white matter and assessment of tissue microstructure. There is a lack of correspondence between diffusion metrics of live tissue, ex vivo tissue, and histological findings. The objective of this study is to elucidate this connection by determining the specific diffusion alterations between live and ex vivo brain tissue. This may have an important role in the incorporation of diffusion imaging in ex vivo studies as a complement to histological sectioning as well as investigations of novel neurosurgical techniques. Methods This study presents a method of high angular resolution diffusion imaging and tractography of intact and non-fixed ex vivo piglet brains. Most studies involving ex vivo brain specimens have been formalin-fixed or excised from their original biological environment, processes both of which are known to affect diffusion parameters. Thus, non-fixed ex vivo tissue is used. A region-of-interest based analysis of diffusion tensor metrics are compared to in vivo subjects in a selection of major white matter bundles in order to assess the translatability of ex vivo diffusion measurements. Results Tractography was successfully achieved in both in vivo and ex vivo groups. No significant differences were found in tract connectivity, average streamline length, or apparent fiber density. Significantly decreased diffusivity (mean, axial, and radial; p<0.0005) in the non-fixed ex vivo group and unaltered fractional anisotropy (p>0.059) between groups were observed. Conclusion This study validates the extrapolation of non-fixed fractional anisotropy measurements to live tissue and the potential use of ex vivo tissue for methodological development.
... Visualisation and maps: directionally-encoded colour (DEC) maps for tensors (Pajevic and Pierpaoli, 1999) and fODFs (Dhollander et al., 2015b); panchromatic sharpening (Dhollander et al., 2015a) and luminance correction ; track density imaging (TDI) , track-weighted imaging (TWI) (Calamante, 2017) and track orientation density imaging (TODI) . ...
Article
MRtrix3 is an open-source, cross-platform software package for medical image processing, analysis and visualisation, with a particular emphasis on the investigation of the brain using diffusion MRI. It is implemented using a fast, modular and flexible general-purpose code framework for image data access and manipulation, enabling efficient development of new applications, whilst retaining high computational performance and a consistent command-line interface between applications. In this article, we provide a high-level overview of the features of the MRtrix3 framework and general-purpose image processing applications provided with the software.
... Visualisation and maps: directionally-encoded colour (DEC) maps for tensors (Pajevic and Pierpaoli, 1999) and fODFs (Dhollander et al., 2015b); panchromatic sharpening (Dhollander et al., 2015a) and luminance correction ; track density imaging (TDI) , track-weighted imaging (TWI) (Calamante, 2017) and track orientation density imaging (TODI) . ...
Preprint
Full-text available
MRtrix3 is an open-source, cross-platform software package for medical image processing, analysis and visualization, with a particular emphasis on the investigation of the brain using diffusion MRI. It is implemented using a fast, modular and flexible general-purpose code framework for image data access and manipulation, enabling efficient development of new applications, whilst retaining high computational performance and a consistent command-line interface between applications. In this article, we provide a high-level overview of the features of the MRtrix3 framework and general-purpose image processing applications provided with the software.
Article
Full-text available
Background: Deep brain stimulation of the anterior nucleus of the thalamus (ANT) is emerging EU/US-approved form of therapy for drug-resistant focal epilepsy. Its mechanism of action is not yet fully understood, and the patient outcomes in epilepsy appear less consistent compared to for instance movement disorders. Furthermore, very little anatomy-based information, such as tractography of relevant fiber systems, exists guiding DBS therapy at present. Objective: To demonstrate ANT-related fiber systems based on histology in vivo employing multi-shell/multi-tissue constrained spherical deconvolution (MSMT-CSD) based deterministic and probabilistic tractography using a sophisticated scanning protocol of 3T high angular resolution diffusion-weighted imaging (HARDI) data in healthy volunteers. Method: HARDI data was acquired from five healthy volunteers in a 3T Siemens MAGNETOM Skyra Magnetic resonance imaging (MRI) machine using multiple b-values (1000, 2000, and 3000), 64 directions, and further preprocessed for tractography. MSMT-CSD-based deterministic and probabilistic tractography was performed from selected fiber systems based on existing literature. Results: Multiple fiber systems were identified: The anterior thalamic radiation (ANT), the thalamo-cingulate tract, the inferior thalamic peduncle (with remote termination areas in the amygdala, the ventral tegmental area, and the occipital cortex), and the mammillothalamic tract. In addition, we observed three parallel connections to the hippocampus (via the cingulum bundle, the fornix, and the temporo-pulvinar pathway). Interestingly , different seed areas in ANT complex mimicking DBS contact locations resulted in visualization of different fiber systems. Discussion: The connections of the ANT are complex and different stimulation sites are likely to affect different networks depending on lead locations and the selection of the active contact. Conclusions: In-depth understanding of the network of anatomical structures related to the ANT is likely to influence therapy outcomes. A hypothetical model of neuronal networks affected by different DBS lead contact locations is proposed. A more profound understanding of neuroanatomic characteristics may guide stereotactic implantation and subsequent programming to optimize outcomes.
Chapter
In magnetic resonance imaging (MRI), the image contrast is the result of the subtle interaction between the physicochemical properties of the imaged living tissue and the parameters used for image acquisition. By varying parameters such as the echo time (TE) and the inversion time (TI), it is possible to collect images that capture different expressions of this sophisticated interaction. Sensitization to diffusion-summarized by the b-value-constitutes yet another explorable “dimension” to modify the image contrast, which reflects the degree of dispersion of water in various directions within the tissue microstructure. The full exploration of this multidimensional acquisition parameter space offers the promise of a more comprehensive description of the living tissue but at the expense of lengthy MRI acquisitions, often unfeasible in clinical practice. The harnessing of multidimensional information passes through the use of intelligent sampling strategies for reducing the amount of images to acquire, and the design of methods for exploiting the redundancy in such information. This chapter reports the results of the MUDI challenge, comparing different strategies for predicting the acquired densely sampled multidimensional data from sub-sampled versions of it.
Chapter
Diffusion MRIDiffusion MRI (dMRIDMRI) tractographyTractography may help locate critical white matter (WM) tracts that should be preserved during neurosurgery. A key step in this process is estimating fiber orientation distributionFiber orientation distribution (FODFOD), often done from a model such as constrained spherical deconvolutionConstrained spherical deconvolution (CSDCSD). Multi-shellMulti-shell (MS) multi-tissue CSDCSD (M-CSDCSD) provides a robust WM FODFOD by estimating the relative contribution to the dMRIDMRI signal from each tissue type (WM, grey matter, and cerebrospinal fluid), however, single-shellSingle-shell (SS) single tissue CSDCSD (S-CSDCSD) cannot independently estimate the signal contribution for each tissue type. S-CSDCSD is therefore less accurate estimating FODFOD in voxels where multiple tissues are present. Due to that inaccuracy, tractographyTractography using S-CSDCSD often generates more spurious WM streamlines compared to M-CSDCSD. In this work, we present a framework to regress the M-CSDCSD model coefficients from the S-CSDCSD model coefficients using a convolutional neural network (CNNCNN) in order to improve tractographyTractography. We construct a training dataset comprising acquired MS dMRIDMRI and paired synthetic SS dMRIDMRI, generated by selecting the outer shell from the MS dMRIDMRI. We select a High Resolution Network (HighResNet) as our choice of CNNCNN to ensure subtle details of the CSDCSD models are preserved during regression. The HighResNet is trained to perform patch-based regression from the S-CSDCSD model coefficients and a co-registered T1-wieghted MR (T1) to the M-CSDCSD model coefficients. We evaluate the method on patients with epilepsy who appeared structurally normal on T1. Four WM tracts related to language are extracted using a ROI-based probabilistic tractographyTractography. For comparison, M-CSDCSD is as a pseudo ground truth. The original S-CSDCSD generated tracts with Dice of 0.53–0.64, and the HighResNet regressed CSDCSD models generated tracts with Dice of 0.73–0.77. We demonstrate HighResNet can regress M-CSDCSD model coefficients from S-CSDCSD model coefficients resulting in tracts more similar to the M-CSDCSD generated tracts and with fewer spurious streamlines than S-CSDCSD generated tracts.
Article
Since its inception 30 years ago, diffusion-weighted magnetic resonance imaging (dMRI) has advanced to become a common component of routine clinical MRI examinations. Diffusion-weighted magnetic resonance offers a way to measure anisotropic diffusion in-vivo, which has led to the development of techniques capable of characterising the orientation of diffusion within living tissue. These modelling techniques can be used to investigate the microstructure and connectivity of white matter tracts within the human brain. Such techniques have been used to study many neural networks within the human body. There is, however, a notable paucity of research utilising dMRI techniques to investigate the white matter tracts of the auditory brainstem. In this review we provide a brief introduction to the basic principles of dMRI analysis and consider some of the difficulties associated with applying dMRI techniques to study the auditory pathways of the brainstem. We also consider aspects of current dMRI methodologies relevant to the auditory brainstem to inform future research in this area.
ResearchGate has not been able to resolve any references for this publication.