Light-Sensitive Visualization of Multimodal Data for Neurosurgical Applications

ABSTRACT We present a technique for enhancing multimodal visualizations for image-guided neurosurgery in the presence of adverse lighting conditions. In the surgical environment, images used for real time navigation are displayed in suboptimal conditions due to the varying lighting conditions. Our approach actively monitors the incoming light on the display and appropriately enhances the visualization based on the change in light. Based on the results of a user study to evaluate our approach, we found that our enhanced visualization techniques were mostly preferred over regular visualizations.

Download full-text


Available from: Alexander M Papanastassiou, Mar 17, 2015
5 Reads
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Most direct volume renderings produced today employ 1D transfer functions which assign color and opacity to the volume based solely on the single scalar quantity which comprises the data set. Though they have not received widespread attention, multi-dimensional transfer functions are a very effective way to extract materials and their boundaries for both scalar and multivariate data. However, identifying good transfer functions is difficult enough in 1D, let alone 2D or 3D. This paper demonstrates an important class of 3D transfer functions for scalar data, and describes the application of multi-dimensional transfer functions to multivariate data. We present a set of direct manipulation widgets that make specifying such transfer functions intuitive and convenient. We also describe how to use modern graphics hardware to both interactively render with multidimensional transfer functions and to provide interactive shadows for volumes. The transfer functions, widgets and hardware combine to form a powerful system for interactive volume exploration.
    IEEE Transactions on Visualization and Computer Graphics 08/2002; 8(3):270- 285. DOI:10.1109/TVCG.2002.1021579 · 2.17 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: This paper presents a new reflectance model for rendering computer synthesized images. The model accounts for the relative brightness of different materials and light sources in the same scene. It describes the directional distribution of the reflected light and a color shift that occurs as the reflectance changes with incidence angle. The paper presents a method for obtaining the spectral energy distribution of the light reflected from an object made of a specific real material and discusses a procedure for accurately reproducing the color associated with the spectral energy distribution. The model is applied to the simulation of a metal and a plastic.
    ACM Transactions on Graphics 01/1982; 1(1):7-24. DOI:10.1145/965161.806819 · 4.10 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Accurately and automatically conveying the structure of a volumemodel is a problem not fully solved by existing volume renderingapproaches. Physics-based volume rendering approaches createimages which may match the appearance of translucent materialsin nature, but may not embody important structural details.Transfer function approaches allow flexible design of the volumeappearance, but generally require substantial hand tuning for eachnew data set in order to be effective. We introduce the volumeillustration approach, combining the familiarity of a physics-basedillumination model with the ability to enhance importantfeatures using non-photorealistic rendering techniques. Sincefeatures to be enhanced are defined on the basis of local volumecharacteristics rather than volume sample value, the applicationof volume illustration techniques requires less manual tuning thanthe design of a good transfer function. Volume illustrationprovides a flexible unified framework for enhancing structuralperception of volume models through the amplification offeatures and the addition of illumination effects.
    Proceedings of the 11th IEEE Visualization 2000 Conference (VIS 2000); 01/2000