Breast Cancer Risk Evaluation with Artificial Neural Networks Revisited

Industrial and Systems Engineering Department, University of Wisconsin, Madison, Wisconsin 53792-3252, USA.
Cancer (Impact Factor: 4.89). 07/2010; 116(14):3310-21. DOI: 10.1002/cncr.25081
Source: PubMed


Discriminating malignant breast lesions from benign ones and accurately predicting the risk of breast cancer for individual patients are crucial to successful clinical decisions. In the past, several artificial neural network (ANN) models have been developed for breast cancer-risk prediction. All studies have reported discrimination performance, but not one has assessed calibration, which is an equivalently important measure for accurate risk prediction. In this study, the authors have evaluated whether an artificial neural network (ANN) trained on a large prospectively collected dataset of consecutive mammography findings can discriminate between benign and malignant disease and accurately predict the probability of breast cancer for individual patients.
Our dataset consisted of 62,219 consecutively collected mammography findings matched with the Wisconsin State Cancer Reporting System. The authors built a 3-layer feedforward ANN with 1000 hidden-layer nodes. The authors trained and tested their ANN by using 10-fold cross-validation to predict the risk of breast cancer. The authors used area the under the receiver-operating characteristic curve (AUC), sensitivity, and specificity to evaluate discriminative performance of the radiologists and their ANN. The authors assessed the accuracy of risk prediction (ie, calibration) of their ANN by using the Hosmer-Lemeshow (H-L) goodness-of-fit test.
Their ANN demonstrated superior discrimination (AUC, 0.965) compared with the radiologists (AUC, 0.939; P<.001). The authors' ANN was also well calibrated as shown by an H-L goodness of fit P-value of .13.
The authors' ANN can effectively discriminate malignant abnormalities from benign ones and accurately predict the risk of breast cancer for individual abnormalities.

Download full-text


Available from: Jagpreet Chhatwal, May 20, 2014
  • Source
    • "This decision relies on the ability of the radiologist to accurately differentiate benign and malignant features. To aid in biopsy decision making, several ANN-based CADx models based on radiologists' observations have been developed since 1990s [40–43]. "
    [Show abstract] [Hide abstract]
    ABSTRACT: Screening mammography is the most effective means for early detection of breast cancer. Although general rules for discriminating malignant and benign lesions exist, radiologists are unable to perfectly detect and classify all lesions as malignant and benign, for many reasons which include, but are not limited to, overlap of features that distinguish malignancy, difficulty in estimating disease risk, and variability in recommended management. When predictive variables are numerous and interact, ad hoc decision making strategies based on experience and memory may lead to systematic errors and variability in practice. The integration of computer models to help radiologists increase the accuracy of mammography examinations in diagnostic decision making has gained increasing attention in the last two decades. In this study, we provide an overview of one of the most commonly used models, artificial neural networks (ANNs), in mammography interpretation and diagnostic decision making and discuss important features in mammography interpretation. We conclude by discussing several common limitations of existing research on ANN-based detection and diagnostic models and provide possible future research directions.
    Computational and Mathematical Methods in Medicine 05/2013; 2013:832509. DOI:10.1155/2013/832509 · 0.77 Impact Factor
    • "Besides that, another problem often found in medical diagnosis [4] [5] [6] is that the misclassification costs/risks for each class are not equal. For example, wrong diagnosis of a healthy person to be patient will be asked back to the doctor for more sophisticated tests and then likely to reveal the error. "
    [Show abstract] [Hide abstract]
    ABSTRACT: Multilayer Perceptron (MLP) neural network classifiers have been successfully applied to solve many classification problems. By learning process they reduce the cost function, generally defined by the total sum of errors (TSE) caused by each pattern. The classification result from this type of learning method can be biased to the number of patterns in the classes and does not reflect the importance of the class. However, pattern classification often encounters the problem of different ratio on the pattern numbers and risk ratio between classes. In this paper, a method for effectively controlling the classification rate by adjusting the bias of the output neurons in the neural network based on the penalty matrix is presented. It first trains the multilayer neural network with linear output nodes to find the solution with or without duplication of the patterns in the minor class or important class. Then, the biases of the output nodes are adjusted based on Bayesian decision concept in order to make the classification rate for a certain class to a desired level. Experimental results of this proposed method showed that it is very effective to control the trained network to produce the desired level of classification rate for a certain class with a possible degradation of classification rate for other classes. In the first experiment, the correction rate for Dirtiness fault was changed from 18% to 65.9% as desired of increasing the correction rate for Dirtiness fault. In the second experiment, the error rate of classifying from class Other Faults to class Pastry Fault was decreased from 7.6% to 6.9% when we modified the penalty matrix to archive a lower error rate of classifying from class Other Faults to class Pastry Fault. The proposed method is very useful for the applications that misclassification risk for a specific class is more critical such as medical diagnosis and military decision.
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Breast cancer is the most common non-skin cancer affecting women in the United States, where every year more than 20 million mammograms are performed. Breast biopsy is commonly performed on the suspicious findings on mammograms to confirm the presence of cancer. Currently, 700,000 biopsies are performed annually in the U.S.; 55%-85% of these biopsies ultimately are found to be benign breast lesions, resulting in unnecessary treatments, patient anxiety, and expenditures. This paper addresses the decision problem faced by radiologists: When should a woman be sent for biopsy based on her mammographic features and demographic factors? This problem is formulated as a finite-horizon discrete-time Markov decision process. The optimal policy of our model shows that the decision to biopsy should take the age of patient into account; particularly, an older patient's risk threshold for biopsy should be higher than that of a younger patient. When applied to the clinical data, our model outperforms radiologists in the biopsy decision-making problem. This study also derives structural properties of the model, including sufficiency conditions that ensure the existence of a control-limit type policy and nondecreasing control-limits with age.
    Operations Research 11/2010; 58(6):1577-1591. DOI:10.1287/opre.1100.0877 · 1.74 Impact Factor
Show more