Ball-Scale Based Hierarchical Multi-Object Recognition in 3D Medical Images

Proc SPIE 02/2010; DOI: 10.1117/12.839920
Source: arXiv

ABSTRACT This paper investigates, using prior shape models and the concept of ball scale (b-scale), ways of automatically recognizing objects in 3D images without performing elaborate searches or optimization. That is, the goal is to place the model in a single shot close to the right pose (position, orientation, and scale) in a given image so that the model boundaries fall in the close vicinity of object boundaries in the image. This is achieved via the following set of key ideas: (a) A semi-automatic way of constructing a multi-object shape model assembly. (b) A novel strategy of encoding, via b-scale, the pose relationship between objects in the training images and their intensity patterns captured in b-scale images. (c) A hierarchical mechanism of positioning the model, in a one-shot way, in a given image from a knowledge of the learnt pose relationship and the b-scale image of the given image to be segmented. The evaluation results on a set of 20 routine clinical abdominal female and male CT data sets indicate the following: (1) Incorporating a large number of objects improves the recognition accuracy dramatically. (2) The recognition algorithm can be thought as a hierarchical framework such that quick replacement of the model assembly is defined as coarse recognition and delineation itself is known as finest recognition. (3) Scale yields useful information about the relationship between the model assembly and any given image such that the recognition results in a placement of the model close to the actual pose without doing any elaborate searches or optimization. (4) Effective object recognition can make delineation most accurate. Comment: This paper was published and presented in SPIE Medical Imaging 2010

  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Segmentation of anatomical structures from medical images is a challenging problem, which depends on the accurate recognition (localization) of anatomical structures prior to delineation. This study generalizes anatomy segmentation problem via attacking two major challenges: 1) automatically locating anatomical structures without doing search or optimization, and 2) automatically delineating the anatomical structures based on the located model assembly. For 1), we propose intensity weighted ball-scale object extraction concept to build a hierarchical transfer function from image space to object (shape) space such that anatomical structures in 3-D medical images can be recognized without the need to perform search or optimization. For 2), we integrate the graph-cut (GC) segmentation algorithm with prior shape model. This integrated segmentation framework is evaluated on clinical 3-D images consisting of a set of 20 abdominal CT scans. In addition, we use a set of 11 foot MR images to test the generalizability of our method to the different imaging modalities as well as robustness and accuracy of the proposed methodology. Since MR image intensities do not possess a tissue specific numeric meaning, we also explore the effects of intensity nonstandardness on anatomical object recognition. Experimental results indicate that: 1) effective recognition can make the delineation more accurate; 2) incorporating a large number of anatomical structures via a model assembly in the shape model improves the recognition and delineation accuracy dramatically; 3) ball-scale yields useful information about the relationship between the objects and the image; 4) intensity variation among scenes in an ensemble degrades object recognition performance.
    IEEE transactions on medical imaging. 12/2011; 31(3):777-89.
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Abnormal nodular branching opacities at the lung periphery in Chest Computed Tomography (CT) are termed by radiology literature as tree-in-bud (TIB) opacities. These subtle opacity differences represent pulmonary disease in the small airways such as infectious or inflammatory bronchiolitis. Precisely quantifying the detection and measurement of TIB abnormality using computer assisted detection (CAD) would assist clinical and research investigation of this pathology commonly seen in pulmonary infections. This paper presents a novel method for automatically detecting TIB patterns based on fast localization of candidates using local scale information of the images. The proposed method combines shape index, local gradient statistics, and steerable wavelet features to automatically identify TIB patterns. Experimental results using 39 viral bronchiolitis human para-influenza (HPIV) CTs and 21 normal lung CTs achieved an overall accuracy of 89.95%.
    Conference proceedings: ... Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Conference 08/2011; 2011:5096-9.

Full-text (2 Sources)

Available from
May 15, 2014