Stefan Zachow

Zuse-Institute Berlin (ZIB) · Visual Data Analysis

Alternative treatment methods for knee osteoarthritis (OA) are in demand, to delay the young (< 50 Years) patient’s need for osteotomy or knee replacement. Novel interpositional knee spacers shape based on statistical shape model (SSM) approach and made of polyurethane (PU) were developed to present a minimally invasive method to treat medial OA in...

Statistical shape modeling aims at capturing shape variations of an anatomical structure that occur within a given population. Shape models are employed in many tasks, such as shape reconstruction and image segmentation, but also shape generation and classification. Existing shape priors either require dense correspondence between training examples...

Statistical shape modeling aims at capturing shape variations of an anatomical structure that occur within a given population. Shape models are employed in many tasks, such as shape reconstruction and image segmentation, but also shape generation and classification. Existing shape priors either require dense correspondence between training examples...

Enfacement illusions are traditionally elicited by visuo-tactile stimulation, but more active paradigms become possible through the usage of virtual reality techniques. For instance, virtual mirrors have been recently proposed to induce enfacement by visuo-motor stimulation. In a virtual mirror experiment, participants interact with an avatar that...

We present a novel and computationally efficient method for the detection of meniscal tears in Magnetic Resonance Imaging (MRI) data. Our method is based on a Convolutional Neural Network (CNN) that operates on complete 3D MRI scans. Our approach detects the presence of meniscal tears in three anatomical sub-regions (anterior horn, body, posterior...

We present a novel approach for nonlinear statistical shape modeling that is invariant under Euclidean motion and thus alignment-free. By analyzing metric distortion and curvature of shapes as elements of Lie groups in a consistent Riemannian setting, we construct a framework that reliably handles large deformations. Due to the explicit character o...

Convolutional neural networks (CNNs) are the state-of-the-art for automated assessment of knee osteoarthritis (KOA) from medical image data. However, these methods lack interpretability, mainly focus on image texture, and cannot completely grasp the analyzed anatomies’ shapes. In this study we assess the informative value of quantitative features d...

Vertebral labelling and segmentation are two fundamental tasks in an automated spine processing pipeline. Reliable and accurate processing of spine images is expected to benefit clinical decision support systems for diagnosis, surgery planning, and population-based analysis of spine and bone health. However, designing automated algorithms for spine...

We present a novel approach for nonlinear statistical shape modeling that is invariant under Euclidean motion and thus alignment-free. By analyzing metric distortion and curvature of shapes as elements of Lie groups in a consistent Riemannian setting, we construct a framework that reliably handles large deformations. Due to the explicit character o...

Three-dimensional medical imaging enables detailed understanding of osteoarthritis structural status. However, there remains a vast need for automatic, thus, reader-independent measures that provide reliable assessment of subject-specific clinical outcomes. To this end, we derive a consistent generalization of the recently proposed B-score to Riema...

Purpose Segmentation of surgical instruments in endoscopic video streams is essential for automated surgical scene understanding and process modeling. However, relying on fully supervised deep learning for this task is challenging because manual annotation occupies valuable time of the clinical experts. Methods We introduce a teacher–student learn...

The aim of this paper is to provide a comprehensive overview of the MICCAI 2020 AutoImplant Challenge1. The approaches and publications submitted and accepted within the challenge will be summarized and reported, highlighting common algorithmic trends and algorithmic diversity. Furthermore, the evaluation results will be presented, compared and dis...

A high realism of avatars is beneficial for virtual reality experiences such as avatar-mediated communication and embodiment. Previous work, however, suggested that the usage of realistic virtual faces can lead to unexpected and undesired effects, including phenomena like the uncanny valley. This work investigates the role of photographic and behav...

Background and Objective: We present a fully automated method for the quantification of knee alignment from full-leg radiographs. Methods: A state-of-the-art object detector, YOLOv4, was trained to locate regions of interests in full-leg radiographs for the hip joint, knee, and ankle. Residual neural networks were trained to regress landmark coordi...

Three-dimensional medical imaging enables detailed understanding of osteoarthritis structural status. However, there remains a vast need for automatic, thus, reader-independent measures that provide reliable assessment of subject-specific clinical outcomes. To this end, we derive a consistent generalization of the recently proposed B-score to Riema...

Purpose: Segmentation of surgical instruments in endoscopic videos is essential for automated surgical scene understanding and process modeling. However, relying on fully supervised deep learning for this task is challenging because manual annotation occupies valuable time of the clinical experts. Methods: We introduce a teacher-student learning ap...

Currently, new materials for knee implants need to be extensively tested but such tests are expensive in a knee wear simulator in a realized design. However, using a rolling-sliding test bench, these materials can be examined under the same test conditions, but with simplified geometries. In the present study, the test bench was optimized, and forc...

We present an automated method for extrapolating missing regions in label data of the skull in an anatomically plausible manner. The ultimate goal is to design patient-specific cranial implants for correcting large, arbitrarily shaped defects of the skull that can, for example, result from trauma of the head. Our approach utilizes a 3D statistical...

Surgical tool segmentation in endoscopic videos is an important component of computer assisted interventions systems. Recent success of image-based solutions using fully-supervised deep learning approaches can be attributed to the collection of big labeled datasets. However, the annotation of a big dataset of real videos can be prohibitively expens...

Automatic recognition of surgical phases is an important component for developing an intra-operative context-aware system. Prior work in this area focuses on recognizing short-term tool usage patterns within surgical phases. However, the difference between intra- and inter-phase tool usage patterns has not been investigated for automatic phase reco...

Surgical tool segmentation in endoscopic videos is an important component of computer assisted interventions systems. Recent success of image-based solutions using fully-supervised deep learning approaches can be attributed to the collection of big labeled datasets. However, the annotation of a big dataset of real videos can be prohibitively expens...

This study’s objective was the generation of a standardized geometry of the healthy nasal cavity. An average geometry of the healthy nasal cavity was generated using a statistical shape model based on 25 symptom-free subjects. Airflow within the average geometry and these geometries was calculated using fluid simulations. Integral measures of the n...

We present a novel approach for nonlinear statistical shape modeling that is invariant under Euclidean motion and thus alignment-free. By analyzing metric distortion and curvature of shapes as elements of Lie groups in a consistent Riemannian setting, we construct a framework that reliably handles large deformations. Due to the explicit character o...

We describe a novel nonlinear statistical shape model based on differential coordinates viewed as elements of . We adopt an as-invariant-as possible framework comprising a bi-invariant Lie group mean and a tangent principal component analysis based on a unique -left-invariant, -right-invariant metric. Contrary to earlier work that equips the coordi...

In our chapter we are describing how to reconstruct three-dimensional anatomy from medical image data and how to build Statistical 3D Shape Models out of many such reconstructions yielding a new kind of anatomy that not only allows quantitative analysis of anatomical variation but also a visual exploration and educational visualization. Future digi...

Successful functional surgery on the nasal framework requires reliable and comprehensive diagnosis. In this regard, the authors introduce a new methodology: Digital Analysis of Nasal Airflow (diANA). It is based on computational fluid dynamics, a statistical shape model of the healthy nasal cavity and rhinologic expertise. diANA necessitates an ano...

Functional surgery on the nasal framework requires referential criteria to objectively assess nasal breathing for indication and follow-up. This motivated us to generate a mean geometry of the nasal cavity based on a statistical shape model. In this study, the authors could demonstrate that the introduced nasal cavity's mean geometry features chara...

Surgical tool detection is attracting increasing attention from the medical image analysis community. The goal generally is not to precisely locate tools in images, but rather to indicate which tools are being used by the surgeon at each instant. The main motivation for annotating tool usage is to design efficient solutions for surgical workflow an...

We present a method for the automated segmentation of knee bones and cartilage from magnetic resonance imaging (MRI) that combines a priori knowledge of anatomical shape with Convolutional Neural Networks (CNNs). The proposed approach incorporates 3D Statistical Shape Models (SSMs) as well as 2D and 3D CNNs to achieve a robust and accurate segmenta...

Here, we report on different types of shell pathologies of the enigmatic deep-sea (mesopelagic) cephalopod Spirula spirula. For the first time, we apply non-invasive imaging methods to: document trauma-induced changes in shell shapes, reconstruct the different causes and effects of these pathologies, unravel the etiology, and attempt to quantify th...

This talk focusses on the aerodynamics within an averaged geometry of the healthy nasal cavity.

Temperature-based estimation of time of death (ToD) can be performed either with the help of simple phenomenological models of corpse cooling or with detailed mechanistic (thermodynamic) heat transfer models. The latter are much more complex, but allow a higher accuracy of ToD estimation as in principle all relevant cooling mechanisms can be taken...

Presentation of an averaged geometry of the healthy nasal cavity.

Objective: To present a novel method for automated segmentation of knee menisci from MRIs. To evaluate quantitative meniscal biomarkers for osteoarthritis (OA) estimated thereof. Method: A segmentation method employing convolutional neural networks in combination with statistical shape models was developed. Accuracy was evaluated on 88 manual se...

Simulations and measurements of blood and airflow inside the human circulatory and respiratory system play an increasingly important role in personalized medicine for prevention, diagnosis and treatment of diseases. This survey focuses on three main application areas. (1) Computational fluid dynamics (CFD) simulations of blood flow in cerebral aneu...

In an aging society where the number of joint replacements rises, it is important to also increase the longevity of implants. In particular hip implants have a lifetime of at most 15 years. This derives primarily from pain due to implant migration, wear, inflammation, and dislocation, which is affected by the positioning of the implant during the s...

Changes in knee shape and geometry resulting from total knee arthroplasty can affect patients in numerous important ways: pain, function, stability, range of motion, and kinematics. Quantitative data concerning these changes have not been previously available, to our knowledge, yet are essential to understand individual experiences of total knee ar...

Based on data derived from computed tomography, we demonstrate that integrating 2D and 3D morphological data from ammonoid shells represents an important new approach for investigating the palaeobiology of ammonoids. Characterization of ammonite morphology has long been constrained to 2D data, with only a few studies collecting ontogenetic data in...

We propose a novel Riemannian framework for statistical analysis of shapes that is able to account for the nonlinearity in shape variation. By adopting a physical perspective, we introduce a differential representation that puts the local geometric variability into focus. We model these differential coordinates as elements of a Lie group thereby en...

Currently, there is no fully sufficient way to differentiate between symptomatic and normal nasal breathing. Using the nose's total resistance is disputed as a valid means to objectify nasal airflow, and the need for a more comprehensive diagnostic method is increasing. This work's aim was to test a novel approach considering intranasal wall shear...

Purpose: Despite the success of total knee arthroplasty, there continues to be a significant proportion of patients who are dissatisfied. One explanation may be a shape mismatch between pre- and postoperative distal femurs. The purpose of this study was to investigate methods suitable for matching a statistical shape model (SSM) to intraoperativel...

Temperature-based death time estimation is based either on simple phenomenological models of corpse cooling or on detailed physical heat transfer models. The latter are much more complex but allow a higher accuracy of death time estimation, as in principle, all relevant cooling mechanisms can be taken into account. Here, a complete workflow for fin...

Purpose: A fully automated surgical tool detection framework is proposed for endoscopic video streams. State-of-the-art surgical tool detection methods rely on supervised one-vs-all or multi-class classification techniques, completely ignoring the co-occurrence relationship of the tools and the associated class imbalance. Methods: In this paper,...

The reconstruction of an object’s shape or surface from a set of 3D points plays an important role in medical image analysis, e.g. in anatomy reconstruction from tomographic measurements or in the process of aligning intra-operative navigation and preoperative planning data. In such scenarios, one usually has to deal with sparse data, which signifi...

Background: Pelvic tilt influences acetabular orientation (AO). Anatomical AO can be measured in relation to the anterior pelvic plane (APP), functional AO can be calculated relative to table's plane. Objective: To assess to what extent functional AO is determined by pelvic tilt and if APP and table plane give equal information for correct AO....

A transfer learning method for generating features suitable for surgical tools and phase recognition from the ImageNet classification features [1] is proposed here. In addition, methods are developed for generating contextual features and combining them with time series analysis for final classification using multi-class random forest. The proposed...

Background Fossil ticks are extremely rare and Ixodes succineus Weidner, 1964 from Eocene (ca. 44–49 Ma) Baltic amber is one of the oldest examples of a living hard tick genus (Ixodida: Ixodidae). Previous work suggested it was most closely related to the modern and widespread European sheep tick Ixodes ricinus (Linneaus, 1758). Results Restudy us...

We present a novel framework for fully automated and highly accurate determination of facial landmarks and dense correspondence, e.g. a topologically identical mesh of arbitrary resolution, across the entire surface of 3D face models. For robustness and reliability of the proposed approach, we are combining 2D landmark detectors and 3D statistical...

Deformable model-based approaches to 3D image segmentation have been shown to be highly successful. Such methodology requires an appearance model that drives the deformation of a geometric model to the image data. Appearance models are usually either created heuristically or through supervised learning. Heuristic methods have been shown to work eff...

The evolution of complexly folded septa in ammonoids has long been a controversial topic. Explanations of the function of these folded septa can be divided into physiological and mechanical hypotheses with the mechanical functions tending to find widespread support. The complexity of the cephalopod shell has made it difficult to directly test the m...

The Ammonoidea is a group of extinct cephalopods ideal to study evolution through deep time. The evolution of the planispiral shell and complexly folded septa in ammonoids has been thought to have increased the functional surface area of the chambers permitting enhanced metabolic functions such as: chamber emptying, rate of mineralization and incre...

Comparison of various expansion rates against septal angle and septal angle expansion rate for the ammonite Amauroceras sp. The expansion rate of a parameter is defined as the value of that parameter in one chamber divided by the value of the same parameter in the preceding chamber; e.g. Vc expansion rate = Vn/Vn-1 where Vn is the volume of chamber...

Volumetric Data for All Specimens. (ODS)

Paper available here: https://arxiv.org/abs/1602.08425 The reconstruction of an object's shape or surface from a set of 3D points is a common topic in materials and life sciences, computationally handled in computer graphics. Such points usually stem from optical or tactile 3D coordinate measuring equipment. Surface reconstruction also appears in...

Statistical shape models (SSM) describe the shape variability contained in a given population. They are able to describe large populations of complex shapes with few degrees of freedom. This makes them a useful tool for a variety of tasks that arise in computer-aided medicine. In this chapter we are going to explain the basic methodology of SSMs an...

Facial surgery deals with a part of the human body that is of particular importance in everyday social interactions. The perception of a person's natural, emotional, and social appearance is significantly influenced by one's expression. This is why facial dynamics has been increasingly studied by both artists and scholars since the mid-Renaissance....

This article reflects the research of the last two decades in computational planning for cranio-maxillofacial surgery. Model-guided and computer-assisted surgery planning has tremendously developed due to ever increasing computational capabilities. Simulators for education, planning, and training of surgery are often compared with flight simulators...

Facial appearance in our societies is often associated with notions of attractiveness, juvenileness, beauty, success, and so forth. Hence, the role of facial plastic surgery is highly interrelated to a patient's desire to feature many of these positively connoted attributes, which of course, are subject of different cultural perceptions or social t...

Pelvic tilt determines functional orientation of the acetabulum. In this study, we investigated the interaction of pelvic tilt and functional acetabular anteversion (AA) in supine position. Pelvic tilt and AA of 138 individuals were measured by computed tomography (CT). AA was calculated in relation to the anterior pelvic plane (APP) and relative t...

The chambered shell of modern cephalopods functions as a buoyancy apparatus, allowing the animal to enter the water column without expending a large amount of energy to overcome its own weight. Indeed, the chambered shell is largely considered a key adaptation that allowed the earliest cephalopods to leave the ocean floor and enter the water column...

The reproductive strategy of ammonoids has been considered an important component to their global distribution and survivability through extinction events. High fecundity and small egg sizes (around 1 mm) separate ammonoids from nautiloids who produce a small number of eggs with hatchlings around 2 cm in diameter. Ammonoid hatchlings have been view...

Computed tomography (CT) is a powerful and nigh universal tool in modern palaeontology, applied to such diverse fields as phylogenetics and biomechanics. Despite this, CT has had a limited application to ammonoids and other fossil cephalopods. Here we present a new method that utilizes modern advances in high resolution CT technology such as Micro-...

Several non-invasive methods are common practice in natural sciences today. Here we present how they can be applied and contribute to current topics in cephalopod (paleo-) biology. Different methods will be compared in terms of time necessary to acquire the data, amount of data, accuracy/resolution, minimum/maximum size of objects that can be studi...

Ammonoids are an extinct group of externally shelled cephalopods that evolved into a diverse and important component of the Palaeozoic and Mesozoic marine fauna. Despite a long history of intensive study, basic questions of ammonoid palaeobiology—specifically the buoyant properties of the chambered ammonoid shell—are still debated. The shell is con...

The external shell of the ammonite is a readily recognized and iconic fossil yet the function of this structure remain contested. The shell is divided into the phragmocone, comprised of a series of mostly gas filled chambers separated by septa, and the body chamber where the animal would have resided. Quantitative studies of the functional morpholo...

The authors report on the first experiences with the prototype of a surgical tool for cranial remodeling. The device enables the surgeon to transfer statistical information, represented in a model, into the disfigured bone. The model is derived from a currently evolving databank of normal head shapes. Ultimately, the databank will provide a set of...

We propose a novel GPU-based approach to render virtual X-ray projections of deformable tetrahedral meshes. These meshes represent the shape and the internal density distribution of a particular anatomical structure and are derived from statistical shape and intensity models (SSIMs). We apply our method to improve the geometric reconstruction of 3D...