D.J. Hawkes’s research while affiliated with University College London and other places

What is this page?


This page lists works of an author who doesn't have a ResearchGate profile or hasn't added the works to their profile yet. It is automatically generated from public (personal) data to further our legitimate goal of comprehensive and accurate scientific recordkeeping. If you are this author and want this page removed, please let us know.

Publications (214)


Performance of image guided navigation in laparoscopic liver surgery – A systematic review
  • Literature Review

July 2021

·

149 Reads

·

35 Citations

Surgical Oncology

·

·

·

[...]

·

B.R. Davidson

Background Compared to open surgery, minimally invasive liver resection has improved short term outcomes. It is however technically more challenging. Navigated image guidance systems (IGS) are being developed to overcome these challenges. The aim of this systematic review is to provide an overview of their current capabilities and limitations. Methods Medline, Embase and Cochrane databases were searched using free text terms and corresponding controlled vocabulary. Titles and abstracts of retrieved articles were screened for inclusion criteria. Due to the heterogeneity of the retrieved data it was not possible to conduct a meta-analysis. Therefore results are presented in tabulated and narrative format. Results Out of 2015 articles, 17 pre-clinical and 33 clinical papers met inclusion criteria. Data from 24 articles that reported on accuracy indicates that in recent years navigation accuracy has been in the range of 8–15 mm. Due to discrepancies in evaluation methods it is difficult to compare accuracy metrics between different systems. Surgeon feedback suggests that current state of the art IGS may be useful as a supplementary navigation tool, especially in small liver lesions that are difficult to locate. They are however not able to reliably localise all relevant anatomical structures. Only one article investigated IGS impact on clinical outcomes. Conclusions Further improvements in navigation accuracy are needed to enable reliable visualisation of tumour margins with the precision required for oncological resections. To enhance comparability between different IGS it is crucial to find a consensus on the assessment of navigation accuracy as a minimum reporting standard.


Augmented reality visualisation of a 3D liver model overlayed onto the laparoscopic view. The liver surface outline (arrows) is not displayed to allow a clearer view of blood vessels and bile ducts (hepatic veins—blue; portal veins—purple; arteries—red, bile ducts & gallbladder—green). NB: The text on top of the image will be removed for the revised version of the manuscript (Color figure online)
A Several patches of point clouds (yellow dots) represent the shape of the liver surface. The un-registered (non-aligned) position of the 3D model can be seen as a brown liver shape below the patches. B Following iterative closest point matching, the semi-automatic registration algorithm has positioned the 3D liver model optimally to reflect the intraoperative anatomy
The surgeon uses a standard laparoscopic screen (1) whilst the research team uses a separate screen (2) for calibration, registration and data capture. In the later phase of the study the surgeon is allowed to visualise the AR view through this screen. The optical tracking camera (3) is attached to an adjustable arm
Study structure. In phase one, registration was retrospective whereas intraoperative registration was carried out in phase two. The data from phase one were used to drive improvements to SmartLiver which were implemented in phase two
A A registration with a low error results in relative proximity of patient anatomy (blue landmarks) and 3D model anatomy (green landmarks). B In contrast to this a registration with a substantial error results in long distance between the corresponding landmarks. NB: The landmarks have been highlighted to enhance visibility. Landmark 3 is outside the visible area of the screen
Comparison of manual and semi-automatic registration in augmented reality image-guided liver surgery: a clinical feasibility study
  • Article
  • Full-text available

October 2020

·

668 Reads

·

50 Citations

Surgical Endoscopy

Background The laparoscopic approach to liver resection may reduce morbidity and hospital stay. However, uptake has been slow due to concerns about patient safety and oncological radicality. Image guidance systems may improve patient safety by enabling 3D visualisation of critical intra- and extrahepatic structures. Current systems suffer from non-intuitive visualisation and a complicated setup process. A novel image guidance system (SmartLiver), offering augmented reality visualisation and semi-automatic registration has been developed to address these issues. A clinical feasibility study evaluated the performance and usability of SmartLiver with either manual or semi-automatic registration.Methods Intraoperative image guidance data were recorded and analysed in patients undergoing laparoscopic liver resection or cancer staging. Stereoscopic surface reconstruction and iterative closest point matching facilitated semi-automatic registration. The primary endpoint was defined as successful registration as determined by the operating surgeon. Secondary endpoints were system usability as assessed by a surgeon questionnaire and comparison of manual vs. semi-automatic registration accuracy. Since SmartLiver is still in development no attempt was made to evaluate its impact on perioperative outcomes.ResultsThe primary endpoint was achieved in 16 out of 18 patients. Initially semi-automatic registration failed because the IGS could not distinguish the liver surface from surrounding structures. Implementation of a deep learning algorithm enabled the IGS to overcome this issue and facilitate semi-automatic registration. Mean registration accuracy was 10.9 ± 4.2 mm (manual) vs. 13.9 ± 4.4 mm (semi-automatic) (Mean difference − 3 mm; p = 0.158). Surgeon feedback was positive about IGS handling and improved intraoperative orientation but also highlighted the need for a simpler setup process and better integration with laparoscopic ultrasound.Conclusion The technical feasibility of using SmartLiver intraoperatively has been demonstrated. With further improvements semi-automatic registration may enhance user friendliness and workflow of SmartLiver. Manual and semi-automatic registration accuracy were comparable but evaluation on a larger patient cohort is required to confirm these findings.

Download

Figure 1: (a) Pre-treatment: GT-data generation and PSMM building. (b) MR acquisition sequence.
Figure 2: Top: GT-MIDRplan shows an underdosage of the tumour and hotspots at the heart and the liver. Middle: PSMM -GT-MIDR. Bottom: Shift -GT-MIDR. Yellow (resp. blue) colour indicates that PSMM/shift-MIDR is hotter (resp. colder) than the GT. Table: DVH endpoints for the plan and MIDR.
In silico validation of motion-including dose reconstruction for MR-guided lung SBRT using a patient specific motion model

June 2019

·

39 Reads

·

2 Citations

Motion-including dose reconstruction (MIDR) aims at reconstructing the actually delivered dose to the moving anatomy during radiotherapy. Patient-specific motion models (PSMM) can be used to determine the time-resolved anatomy during treatment delivery on an MR-linac for MIDR. In this study, PSMM-based MIDR was validated for MR-guided lung SBRT. The digital XCAT phantom was used to generate a ground truth moving anatomy (GT-XCAT) based on in-vivo measured motion. Using the first 10 minutes of the motion trace, GT-XCAT volumes were subsampled to simulate pre-treatment interleaved sagittal/coronal MR acquisition with a sagittal navigator slice for breathing signal extraction. A PSMM was fitted and a motion-compensated super-resolution image (MCSRI) was reconstructed simultaneously. An MR-linac treatment plan for 3-fraction lung-SBRT was designed on a reference GT-XCAT. GT-XCATs were generated for the remainder of the motion trace. The intra-treatment time-resolved anatomy was estimated via MCSRI deformation using the PSMM and the breathing signals extracted from navigator slices sub-sampled from GT-XCATs. Treatment delivery was simulated in our in-house emulator. The treatment fluence was discretized into sub-beams, each associated with the GT or deformed-MCSRI anatomy that it was delivered to. The dose was accumulated onto the reference anatomy. For comparison, shift-MIDR was calculated emulating tumour motion as sub-beam isocenter shifts on the static reference GT-XCAT anatomy. For the plan dose, GT-MIDR, PSMM-MIDR and shift-MIDR respectively: GTV-D98% was 70.8Gy, 67.7Gy, 69.0Gy and 67.4Gy; GTV-D50% was 77.7Gy, 775.2Gy, 75.5Gy and 76.0Gy; heart-V30Gy was 48.4cc, 55.6cc, 53.0cc and 64.7cc; Oesophagus-V2% was 22.6Gy, 21.7Gy, 21.7Gy and 23.1Gy. Evaluated against GT-MIDR, PSMM-MIDR was more accurate than shift-MIDR for organ at risk (OAR) dose estimation and similar for target dose estimation. The MR-based PSMM was shown to be suitable for MIDR of the target and OAR. Shift-MIDR is not intended to correctly estimate OAR dose but may be used for target dose estimation.



OC-0296 Validation of motion-including dose reconstruction on a ground-truth time-resolved moving anatomy

April 2019

·

32 Reads

·

1 Citation

Radiotherapy and Oncology

Purpose or Objective Motion-including dose reconstruction (MIDR) aims at reconstructing the actually delivered dose to the moving anatomy during radiotherapy. However, the time-resolved patient anatomy during treatment is generally unknown and commonly estimated using 3D or 4D pre-treatment images. In this study, we reconstructed the delivered dose on a ground-truth, fully time-resolved anatomy (GT-MIDR) and used this to evaluate the accuracy of MIDR based on 3D and 4D CT images. Material and Methods The digital XCAT phantom was used to generate three regularly breathing thorax phantoms, each with a lung tumour moving according to its location (Fig 1). A 4DCT was generated and treatment plans were created for either a mid-ventilation approach (midVent) or treatment delivery with dynamic MLC tracking (tracking) (9-beam step-and-shoot IMRT, RTOG 1021). Treatment delivery under regular motion or regular motion and continuous drift was simulated in our in-house software. For MIDR, the treatment fluence is discretized into subbeams; each sub-beam is associated with the anatomy instance that it was delivered to and shifted to account for residual tumour position difference between the estimated anatomy and the actual target position if any. I.e. motion is modelled by a sub-beam isocenters shift, to emulate the actual relative target/beam position. The dose for each instance is then calculated in a research treatment planning system (TPS) and accumulated on the reference anatomy via deformable registration. For GT-MIDR, ground-truth anatomy instances were generated from the XCAT. For 3D-MIDR, only one anatomy instance, the midVent 4DCT phase, was used and motion was accounted for by sub-beam isocenter shifts only. For 4D-MIDR, anatomy instances were chosen as the 4DCT phase where the tumour is closest to the actual tumour position and sub-beam isocenter shifts accounted for residual position differences. Results Differences between GT-MIDR and planning (Fig 2) show the effect of motion (midVent) or motion and mitigation (tracking) on dose delivery. Target underdosage was highest for tumour A. Tracking resulted in higher dose to the spinal cord and heart (tumour A, B) or aorta (tumour C). Differences between 3D or 4D and GT-MIDR (Fig 3) show the accuracy of the respective methods. Reconstructed target dose errors above 1Gy were observed for 3D-MIDR. For tumour A, reconstructed dose to the organs-at-risks (OAR) were underestimated by 3D-MIDR. For tumour B, dose to the oesophagus and aorta was overestimated by 3D-MIDR. For tumour C, dose to the spinal cord and the oesophagus were overestimated by 4D-MIDR and dose to the aorta was underestimated by 3D and 4D-MIDR. Conclusion In the first demonstration of GT-MIDR, we calculated the delivered dose to target and OAR for a range of lung tumour locations. We showed that MIDR based on planning data does not accurately resolve the delivered dose even in the case of regular motion. Our method may be used to validate MIDR for other motion models and treatment sites.





Statistical Motion Mask and Sliding Registration

June 2018

·

34 Reads

·

4 Citations

Accurate registration of images depicting respiratory motion, e.g. 4DCT or 4DMR, can be challenging due to sliding motion that occurs between the chest wall and organs within the pleural sac (lungs, mediastinum, liver). In this paper we propose a methodology that (1) segments one of the images to be registered (the source or floating/moving image) into two distinct regions by fitting a statistical motion mask, and (2) registers the image with a modified B-spline registration algorithm that can account for sliding motion between the regions. This registration requires the segmentation of the regions in the source image domain as a signed distance map. Two underlying transformations allow the regions to deform independently, while a constraint term based on the transformed distance maps penalises gaps and overlaps between the regions. Although implemented in a B-spline algorithm, the required modifications are not specific to the transformation type and thus can be applied to parametric and non-parametric frameworks alike. The registration accuracy is evaluated using the landmark registration error on the basis of the publicly available DIR-Lab dataset. The overall average landmark error after registration is 1.21 mm and the average gap and overlap volumes are 26.4 cm³ and 34.5 cm³ respectively. The fitted statistical motion masks are compared to previously proposed motion masks and the corresponding mean Dice coefficient is 0.96.



Citations (64)


... However, these advancements also bring challenges such as missing tactile feedback, limited field of view, and, in general, more demanding surgeries. To overcome these challenges, programs like navigation assistance systems are being developed [2]. These come with additional demanding tasks, such as 3D to 3D registration, requiring more information about the environment intraoperatively. ...

Reference:

Synthetic Data in Supervised Monocular Depth Estimation of Laparoscopic Liver Images
Performance of image guided navigation in laparoscopic liver surgery – A systematic review
  • Citing Article
  • July 2021

Surgical Oncology

... Eleven (33%) studies have based the evaluation of their results on the surgical outcomes like operative time, blood loss, hospitalization time and postoperative complications. [38][39][40][41][42][44][45][46][47][48][49] Other studies assessed registration time (n = 7, 21%), 19,20,44,[50][51][52][53] resection margin accuracy (n = 3, 9%), 33,37,54 robustness to noise or occlusion of view (n = 2, 6%), 34,55 calibration accuracy (n = 1, 3%), 56 identification precision (n = 1, 3%), 57 and spatial perception (n = 1, 3%). 31 Furthermore, 36% (n = 12) of the articles evaluated registration accuracy (Table 3), 16,19,20,24,32,34,36,43,53,56,58,59 using varying metrics. In general, registration accuracy refers to the ...

Comparison of manual and semi-automatic registration in augmented reality image-guided liver surgery: a clinical feasibility study

Surgical Endoscopy

... Virtual and augmented reality (VR/AR) find increasingly more interest in the medical field [11,25]. They are used as a training tools [6,23], in diagnostics [27,32], and to educate patients about their condition [12]. ...

Evaluation of an augmented reality based image guidance system for laparoscopic liver surgery

HPB

... The XCAT phantom provides a tool to assess not only the geometric accuracy of the motion models, but also their dosimetric impact. Bertholet et al. [Bertholet et al. 2019b] showed that the patient-specific surrogate-driven motion model (PSMM) built from XCAT data with the generalized framework was suitable for MIDR of the target and OARs for lung SBRT on a Unity MR-Linac. Thanks to the availability of a MIDR of the XCAT ground truth time-resolved anatomy (GT-MIDR), they showed that the motion model presented a similar accuracy as the beam isocenter shift method when used to estimate the dose to the target. ...

In silico validation of motion-including dose reconstruction for MR-guided lung SBRT using a patient specific motion model

... To generate the signal, we manually selected We investigated the PC scores of the first three PCs (i.e. PC1, PC2, PC3) on image intensities or B-spline CPD from the surrogate images (CPD s ), as potential surrogate signals to build and drive motion models [Tran et al. 2019a]. ...

OC-0413 MR-derived signals for respiratory motion models evaluated using sagittal and coronal datasets
  • Citing Article
  • April 2019

Radiotherapy and Oncology

... Z uwagi na możliwość realizacji dziennej frakcji napromieniania podczas swobodnego oddechu pacjenta (bez konieczności przerywania dostarczania dziennej frakcji promieniowania), śledzenie ruchomości mimowolnej guza (tumor tracking) w czasie rzeczywistym było jednym z dominujących tematycznie aspektów raportowanych naukowo podczas konferencji ESTRO 38 w Mediolanie [3][4][5][6][7][8][9][10][11]. Należy tu podkreślić, że podążanie wiązki terapeutycznej za poruszającym się guzem rozpatrywane jest nie tylko w kontekście nowotworów płuc, ale również innych lokalizacji nowotworów, których położenie może znacząco zmieniać się w trakcie realizacji napromieniania. ...

OC-0296 Validation of motion-including dose reconstruction on a ground-truth time-resolved moving anatomy
  • Citing Article
  • April 2019

Radiotherapy and Oncology

... The definition of the right intensities can be tedious and time consuming. [20][21][22] drop intensity based penalization in favour if a distinct term added to the loss function penalizing overlaps and gaps. These terms can consist of the product of deformed signed distance fields [20], requiring a computationally expensive creation of motion mask and being restricted to two subdomains, or a local distance metric to the opposing interface via the sum of sample surface points [22]. ...

Statistical Motion Mask and Sliding Registration
  • Citing Conference Paper
  • June 2018

... The spatial resolution of a 2D navigator can be at 1.8x1.8mm 2 with an expected temporal resolution no better than around 185ms [32]. One advantage of the 2D navigators is that multiple 1D navigators can be extracted from distant points providing multiple surrogate signals for motion tracking, or an input for a more complete fully 3D respiratory motion model [33]. The disadvantage of a 2D navigator lies in the out-of-plane motion which a 3D navigator can resolve effectively. ...

OC-0411: Investigation of MRI-derived surrogate signals for modelling respiratory motion on an MRI-Linac
  • Citing Article
  • April 2018

Radiotherapy and Oncology

... The source of this limitation is associated with the registration algorithms used to build the motion models. In this thesis the Bspline registration regularised and constrained the motion to be smooth, excluding the possibility of reproducing sliding motion [Eiben et al. 2018b]. ...

EP-2135: Statistical motion masks to identify sliding surfaces for motion models used on an MR-Linac
  • Citing Article
  • April 2018

Radiotherapy and Oncology

... Minimally invasive laparoscopic surgery has been a common clinical application, showing an effective reduction of trauma and recovery period. Performing accurate surgical scene segmentation can facilitate further pose estimation [1], surgery navigation [2], and risk assessment [3]. However, accurate segmentation of surgical scene is a challenging task, which is due to two reasons. ...

3D Pose Estimation of Articulated Instruments in Robotic Minimally Invasive Surgery

IEEE Transactions on Medical Imaging