C I Sánchez’s research while affiliated with Radboud University Medical Centre (Radboudumc) and other places

What is this page?


This page lists works of an author who doesn't have a ResearchGate profile or hasn't added the works to their profile yet. It is automatically generated from public (personal) data to further our legitimate goal of comprehensive and accurate scientific recordkeeping. If you are this author and want this page removed, please let us know.

Publications (9)


Automated chest X-ray reading for tuberculosis in the Philippines to improve case detection: a cohort study
  • Article

July 2019

·

109 Reads

·

15 Citations

The International Journal of Tuberculosis and Lung Disease

·

C. I. Sánchez

·

·

[...]

·

B. van Ginneken

BACKGROUND: DetecTB (Diagnostic Enhanced Tools for Extra Cases of TB), an intensified tuberculosis (TB) case-finding programme targeting prisons and high-risk communities was implemented on Palawan Island, the Philippines.OBJECTIVE: To evaluate the performance of TB detection based on computerised chest radiography (CXR) readings.DESIGN: Data from 14 094 subjects were analysed from September 2012 to June 2014. All CXRs were read by a physician and by software. Individuals with TB symptoms or CXR abnormalities according to the physician underwent Xpert® MTB/RIF testing, the remaining persons were considered TB-negative (screening reference). A subset of 200 CXRs was read by an independent human reader (radiological reference). This reader also re-read a subset of the most abnormal cases as identified using the software but read as normal by the physician (discordant cases).RESULTS: A total of 10 755 individuals were included in the analysis, 2534 of whom had a positively assessed CXR; 298 cases were Xpert-positive. Using the screening reference, the area under the receiver operating characteristic curve for software readings was 0.93 (95%CI 0.92-0.94), with a sensitivity of 0.98 (95%CI 0.97-0.99) and a specificity of 0.69 (95%CI 0.40-0.98). Based on the radiological reference, the physician performed slightly worse than the software (sensitivity, 0.82, 95%CI 0.74-0.89 and specificity, 0.87, 95%CI 0.81-0.96 vs. sensitivity, 0.83, 95%CI 0.71-0.93 and specificity, 0.87, 95%CI 0.75-0.95), although this was not statistically significant. Of the 291 discordant cases, 70% were assessed as positive, resulting in a 22% increase in TB detection when extrapolated to the full cohort.CONCLUSION: The performance of automated CXR reading is comparable to that of the attending physicians in DetecTB, and its use as a second reader could increase TB detection.


Figure 1 Proposed workflow with integration of CAD for tuberculosis detection as a first triage test before human reading.* Predetermined cut-off value. † Clinical and microbiological assessment. CXR ¼ chest radiograph; CAD ¼ computeraided detection. 
Accuracy of an automated system for tuberculosis detection on chest radiographs in high-risk screening
  • Article
  • Full-text available

May 2018

·

240 Reads

·

29 Citations

The International Journal of Tuberculosis and Lung Disease

Setting: Tuberculosis (TB) screening programmes can be optimised by reducing the number of chest radiographs (CXRs) requiring interpretation by human experts. Objective: To evaluate the performance of computerised detection software in triaging CXRs in a high-throughput digital mobile TB screening programme. Design: A retrospective evaluation of the software was performed on a database of 38 961 postero-anterior CXRs from unique individuals seen between 2005 and 2010, 87 of whom were diagnosed with TB. The software generated a TB likelihood score for each CXR. This score was compared with a reference standard for notified active pulmonary TB using receiver operating characteristic (ROC) curve and localisation ROC (LROC) curve analyses. Results: On ROC curve analysis, software specificity was 55.71% (95%CI 55.21-56.20) and negative predictive value was 99.98% (95%CI 99.95-99.99), at a sensitivity of 95%. The area under the ROC curve was 0.90 (95%CI 0.86-0.93). Results of the LROC curve analysis were similar. Conclusion: The software could identify more than half of the normal images in a TB screening setting while maintaining high sensitivity, and may therefore be used for triage.

Download

Figure 1: Two example CXRs with corresponding heatmaps. (a) Culture negative CXR with an ACR score of 18. (b) Corresponding abnormality heatmap. (c) Culture positive CXR with a subtle abnormality visible on the CXR and picked up by the CAD4TB software resulting in an ACR score of 71. (d) Corresponding abnormality heatmap. ACR, automated chest radiography; CXR, chest X-ray.
Figure 2: Diagnostic algorithm proposed in this paper. Subjects presenting at a TB screening unit start with a pre-screening ACR with a 1-minute computation time to determine whether follow-up Xpert test is needed. In the latter case, the Xpert test takes 2 hours to complete. ACR, automated chest radiography; TB, tuberculosis; Xpert, Xpert MTB/RIF.
Automated chest-radiography as a triage for Xpert testing in resource-constrained settings: A prospective study of diagnostic accuracy and costs

July 2015

·

149 Reads

·

77 Citations

Molecular tests hold great potential for tuberculosis (TB) diagnosis, but are costly, time consuming, and HIV-infected patients are often sputum scarce. Therefore, alternative approaches are needed. We evaluated automated digital chest radiography (ACR) as a rapid and cheap pre-screen test prior to Xpert MTB/RIF (Xpert). 388 suspected TB subjects underwent chest radiography, Xpert and sputum culture testing. Radiographs were analysed by computer software (CAD4TB) and specialist readers, and abnormality scores were allocated. A triage algorithm was simulated in which subjects with a score above a threshold underwent Xpert. We computed sensitivity, specificity, cost per screened subject (CSS), cost per notified TB case (CNTBC) and throughput for different diagnostic thresholds. 18.3% of subjects had culture positive TB. For Xpert alone, sensitivity was 78.9%, specificity 98.1%, CSS 13.09andCNTBC13.09 and CNTBC 90.70. In a pre-screening setting where 40% of subjects would undergo Xpert, CSS decreased to 6.72andCNTBCto6.72 and CNTBC to 54.34, with eight TB cases missed and throughput increased from 45 to 113 patients/day. Specialists, on average, read 57% of radiographs as abnormal, reducing CSS (8.95)andCNTBC(8.95) and CNTBC (64.84). ACR pre-screening could substantially reduce costs, and increase daily throughput with few TB cases missed. These data inform public health policy in resource-constrained settings.


Multiple-instance learning for computer-aided detection of tuberculosis

March 2014

·

64 Reads

·

14 Citations

Proceedings of SPIE - The International Society for Optical Engineering

Detection of tuberculosis (TB) on chest radiographs (CXRs) is a hard problem. Therefore, to help radiologists or even take their place when they are not available, computer-aided detection (CAD) systems are being developed. In order to reach a performance comparable to that of human experts, the pattern recognition algorithms of these systems are typically trained on large CXR databases that have been manually annotated to indicate the abnormal lung regions. However, manually outlining those regions constitutes a time-consuming process that, besides, is prone to inconsistencies and errors introduced by interobserver variability and the absence of an external reference standard. In this paper, we investigate an alternative pattern classi cation method, namely multiple-instance learning (MIL), that does not require such detailed information for a CAD system to be trained. We have applied this alternative approach to a CAD system aimed at detecting textural lesions associated with TB. Only the case (or image) condition (normal or abnormal) was provided in the training stage. We compared the resulting performance with those achieved by several variations of a conventional system trained with detailed annotations. A database of 917 CXRs was constructed for experimentation. It was divided into two roughly equal parts that were used as training and test sets. The area under the receiver operating characteristic curve was utilized as a performance measure. Our experiments show that, by applying the investigated MIL approach, comparable results as with the aforementioned conventional systems are obtained in most cases, without requiring condition information at the lesion level.


Fig. 2. (a) Query image containing exudates (indicated by arrows) and (b) the most similar looking image for (a). (c) Query image containing drusen and (d) the most similar looking image for (c)
Fig. 3. Precision graph for the retrieval task.
Fig. 4. ROC curves for the classification task on set A and B.
A Bag of Words approach for discriminating between retinal images containing exudates or drusen

April 2013

·

61 Reads

·

28 Citations

Proceedings / IEEE International Symposium on Biomedical Imaging: from nano to macro. IEEE International Symposium on Biomedical Imaging

Population screening for sight threatening diseases based on fundus imaging is in place or being considered worldwide. Most existing programs are focussed on a specific disease and are based on manual reading of images, though automated image analysis based solutions are being developed. Exudates and drusen are bright lesions which indicate very different diseases, but can appear to be similar. Discriminating between them is of interest to increase screening performance. In this paper, we present a Bag of Words approach which can be used to design a system that can play the dual role of content based retrieval (of images with exudates or drusen) system and a decision support system to address the problem of bright lesion discrimination. The approach consists of a novel partitioning of an image into patches from which color, texture, edge and granulometry based features are extracted to build a dictionary. A bag of Words approach is then employed to help retrieve images matching a query image as well as derive a decision on the type of bright lesion in the given (query) image. This approach has been implemented and tested on a combination of public and local dataset of 415 images. The area under the curve for image classification is 0.90 and retrieved precision is 0.76.



Interactive classification of lung tissue in CT scans by combining prior and interactively obtained training data: A simulation study

January 2012

·

35 Reads

·

4 Citations

We describe an interactive system for classification of normal and seven types of abnormal lung tissue in CT scans from interstitial lung disease patients, using training data from previously annotated scans and annotations by the observer in the scan under investigation. We compared seven different interactive annotation strategies using different combinations of both types of training data, in order to minimize user effort in the interactive annotation process. The lungs in all scans were divided into roughly spherical volumes of interest (VOIs). An observer labeled all VOIs in 21 thoracic CT scans. Leave-one-scan-out experiments that simulated slice-by-slice interactive annotation sessions were performed. The best results were obtained with a strategy in which the simulated user decides for each slice whether to use a classifier trained on pooled data from prior scans or a classifier trained on data from the current scan. In this approach, the labels of 88% of all VOIs were predicted correctly, meaning that only 12% of all labels needed to be changed by the simulated user.


Active learning for an efficient training strategy of computer-aided diagnosis systems: application to diabetic retinopathy screening.

January 2010

·

80 Reads

·

9 Citations

The performance of computer-aided diagnosis (CAD) systems can be highly influenced by the training strategy. CAD systems are traditionally trained using available labeled data, extracted from a specific data distribution or from public databases. Due to the wide variability of medical data, these databases might not be representative enough when the CAD system is applied to data extracted from a different clinical setting, diminishing the performance or requiring more labeled samples in order to get better data generalization. In this work, we propose the incorporation of an active learning approach in the training phase of CAD systems for reducing the number of required training samples while maximizing the system performance. The benefit of this approach has been evaluated using a specific CAD system for Diabetic Retinopathy screening. The results show that (1) using a training set obtained from a different data source results in a considerable reduction of the CAD performance; and (2) using active learning the selected training set can be reduced from 1000 to 200 samples while maintaining an area under the Receiver Operating Characteristic curve of 0.856.


Active Learning for an Efficient Training Strategy of Computer-Aided Diagnosis Systems: Application to Diabetic Retinopathy Screening

January 1970

·

166 Reads

·

14 Citations

Lecture Notes in Computer Science

The performance of computer-aided diagnosis (CAD) systems can be highly influenced by the training strategy. CAD systems are traditionally trained using available labeled data, extracted from a specific data distribution or from public databases. Due to the wide variability of medical data, these databases might not be representative enough when the CAD system is applied to data extracted from a different clinical setting, diminishing the performance or requiring more labeled samples in order to get better data generalization. In this work, we propose the incorporation of an active learning approach in the training phase of CAD systems for reducing the number of required training samples while maximizing the system performance. The benefit of this approach has been evaluated using a specific CAD system for Diabetic Retinopathy screening. The results show that 1) using a training set obtained from a different data source results in a considerable reduction of the CAD performance; and 2) using active learning the selected training set can be reduced from 1000 to 200 samples while maintaining an area under the Receiver Operating Characteristic curve of 0.856.

Citations (9)


... For example, in Parkinson's disease, remote care based on wearables provides ecologically valid methods for monitoring and evaluating symptoms (Bloem et al., 2019;Gatsios et al., 2020). In tuberculosis screening in low-resource settings, automated diagnosis can increase sensitivity of identifying persons at risk while reducing cost (Philipsen et al., 2019). Self-assessment using eHealth vision tools improves access to diagnosis and facilitates timely diagnosis, although consistent criteria for referring to the clinical pathway and validity and reliability of eHealth tools are still a concern (W. ...

Reference:

Toward AI-Assisted Teleaudiology
Automated chest X-ray reading for tuberculosis in the Philippines to improve case detection: a cohort study
  • Citing Article
  • July 2019

The International Journal of Tuberculosis and Lung Disease

... CAD interprets abnormalities on CXRs suggestive of TB and expresses results as abnormality scores (either 0-100 or 0-1), which are deemed positive or negative if the abnormality score is above or below a precalibrated threshold. Recent data suggest that CAD performs on par with human readers to identify potential TB on CXR, helping to focus limited resources on the relevant cases [9,10]. In 2021, the WHO conditionally endorsed the use of chest radiography and CAD for pulmonary TB screening [11]. ...

Accuracy of an automated system for tuberculosis detection on chest radiographs in high-risk screening

The International Journal of Tuberculosis and Lung Disease

... A modeling study from Pakistan estimated the costs of country-wide ACF with CXR comparing human reading and computer aided interpretation as well as across deployment modes of the AI concluding that the per image cost at scale would be cheaper with AI than human readers and that unlimited reads would be less expensive than pay per image charges [22]. An early evaluation of AI for CXR modeled data from the facility based TB-NEAT study [23] to calculate diagnostic costs of using CXR and AI to triage people for Xpert testing and found it improve the daily screening throughput and substantially reduce testing costs [24]. Finally, a study from Brazil in three prisons compared four different screening algorithms and found that using CXR with an early version of CAD4TB (v5, Delft Imaging) with a threshold score of 60 was more costly and less sensitive than testing everyone with Xpert who could produce sputum regardless of symptoms [25]. ...

Automated chest-radiography as a triage for Xpert testing in resource-constrained settings: A prospective study of diagnostic accuracy and costs

... Rohan et al. [17] proposed a model comprising three standard architectures: AlexNet, GoogLeNet, and ResNet, with an accuracy of 88.24% and AUC 0.93. Melendez et al. [18] classify tuberculosis using MIL, SVM, and MIL ? AL with pixel-level AUC 0.855, 0.900, and 0.877 and case-level AUC 0.801, 0.878, 0.861. ...

Multiple-instance learning for computer-aided detection of tuberculosis
  • Citing Conference Paper
  • March 2014

Proceedings of SPIE - The International Society for Optical Engineering

... A max margin classifier was then used to classify various lesions such as microaneurysms, cotton wool spots, exudates and drusen. Grinsven et al. [39] introduced a method for automatic retrieval and classification of bright lesions, i.e. exudates and drusen, by applying the BOVW technique. The SN Computer Science (2025) 6: 11 11 Page 4 of 12 ...

A Bag of Words approach for discriminating between retinal images containing exudates or drusen

Proceedings / IEEE International Symposium on Biomedical Imaging: from nano to macro. IEEE International Symposium on Biomedical Imaging

... The use of automated classification system for the identification of scares in the lungs is becoming important diagnosis process in CAD. Many classification method is proposed for the ordering of lung scars in CT [7]. HRTC is the popular tool for diagnosis by using detection and characterizing numerous disorder of lungs [8]. ...

Interactive classification of lung tissue in CT scans by combining prior and interactively obtained training data: A simulation study
  • Citing Conference Paper
  • January 2012

... CXR images commonly contain projections of foreign artifacts that occur for a variety of reasons and may relate to the patient, health professional, materials and equipment used and their configurations, as well as to the method of obtaining, handling, recording, and storage [12], [14], [15], [16]. For example, the foreign body aspiration is an important cause of morbidity and mortality in pediatrics occurring mainly in children younger than 3 years [17]. ...

Foreign object detection and removal to improve automated analysis of chest radiographs
  • Citing Article
  • January 2013

... ADL has reduced the need for large expert-labeled samples for DR diagnosis. One study compared two ADL learning schemes involving query-by-bagging and uncertainty sampling (Sánchez et al. 2010). Here, selecting the most informative patches to be used for training multiple CNNs increases the computation cost. ...

Active Learning for an Efficient Training Strategy of Computer-Aided Diagnosis Systems: Application to Diabetic Retinopathy Screening
  • Citing Conference Paper
  • January 1970

Lecture Notes in Computer Science

... In the context of medical images, they have been shown to reduce training sample sizes in a wide array of scenarios, both with classical and modern machine learning techniques. Examples of the former include: computer-aided diagnosis of diabetic retinopathy (Sánchez et al. 2010, based on uncertainty sampling and query-by-bagging); segmentation of different organs in CT and MRI scans (Iglesias et al. 2011;Top et al. 2011); or patient-specific 3D heart models for surgical planning (Pace et al. 2015). ...

Active learning for an efficient training strategy of computer-aided diagnosis systems: application to diabetic retinopathy screening.
  • Citing Article
  • January 2010