Comparison of discriminatory power and accuracy of three lung cancer risk models

Department of Epidemiology, UT MD Anderson Cancer Center, 1155 Pressler Street - Unit 1340, Houston, Texas 77030-4009, USA.
British Journal of Cancer (Impact Factor: 4.82). 07/2010; 103(3):423-9. DOI: 10.1038/sj.bjc.6605759
Source: PubMed

ABSTRACT Three lung cancer (LC) models have recently been constructed to predict an individual's absolute risk of LC within a defined period. Given their potential application in prevention strategies, a comparison of their accuracy in an independent population is important.
We used data for 3197 patients with LC and 1703 cancer-free controls recruited to an ongoing case-control study at the Harvard School of Public Health and Massachusetts General Hospital. We estimated the 5-year LC risk for each risk model and compared the discriminatory power, accuracy, and clinical utility of these models.
Overall, the Liverpool Lung Project (LLP) and Spitz models had comparable discriminatory power (0.69), whereas the Bach model had significantly lower power (0.66; P=0.02). Positive predictive values were highest with the Spitz models, whereas negative predictive values were highest with the LLP model. The Spitz and Bach models had lower sensitivity but better specificity than did the LLP model.
We observed modest differences in discriminatory power among the three LC risk models, but discriminatory powers were moderate at best, highlighting the difficulty in developing effective risk models.


Available from: John K Field, Jun 05, 2015
  • [Show abstract] [Hide abstract]
    ABSTRACT: Identification of high risk individuals will facilitate early diagnosis, reduce overall costs and also improve the current poor survival from lung cancer. The Liverpool Lung Project prospective cohort of 8760 participants aged 45-79 years, recruited between 1998 and 2008, were followed annually through the hospital episode statistics until 31 January 2013. Cox proportional hazards models were used to identify risk predictors of lung cancer incidence. C-statistic was used to assess the discriminatory accuracy of the models. Models were internally validated using bootstrap method. During mean follow-up of 8.7 years, 237 participants developed lung cancer. Age (hazard ratio [HR] 1.04; 95%CI, 1.02-1.06), male gender (HR 1.48; 95%CI:1.10-1.98), smoking duration (HR 1.04; 95%CI 1.03-1.05), COPD (HR 2.43; 95%CI 1.79-3.30), prior diagnosis of malignant tumour (HR 2.84; 95%CI 2.08-3.89)and early onset of family history of lung cancer (HR 1.68;95%CI 1.04-2.72) were associated with the incidence of lung cancer. The LLPi risk model had a good calibration (goodness-of-fit χ2 7.58, P=0.371). The apparent C-statistic was 0.852(95%CI 0.831-0.873) and the optimism-corrected bootstrap resampling C-statistic was 0.849 (95% CI of 0.829-0.873). The LLPi risk model may assist in identifying individuals at high risk of developing lung cancer in population-based screening programs. Copyright © 2015, American Association for Cancer Research.
    Cancer Prevention Research 04/2015; DOI:10.1158/1940-6207.CAPR-14-0438 · 5.27 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: Background:There is an urgent need to improve lung cancer outcome by identifying and validating markers of risk. We previously reported that the cytokinesis-blocked micronucleus assay (CBMN) is a strong predictor of lung cancer risk. Here we validate our findings in an independent external lung cancer population and test discriminatory power improvement of the Spitz risk prediction model upon extension with this biomarker. Methods:1,506 participants were stratified into a test set of 995 (527 cases /468 controls) from MD Anderson Cancer Center and a validation set of 511 (239 cases / 272 controls) from Massachusetts General Hospital. An epidemiologic questionnaire was administered and genetic instability was assessed using the CBMN assay. Results:Excellent concordance was observed between the two populations in levels and distribution of CBMN endpoints [binucleated-micronuclei (BN-MN), binucleated-nucleoplasmic bridges (BN-NPB)] with significantly higher mean BN-MN and BN-NPB values among cases (P<0.0001). Extension of the Spitz model led to an overall improvement in the AUC (95% CI) from 0.61 (55.5 - 65.7) with epidemiological variables to 0.92 (89.4 - 94.2) with the addition of BN-MN endpoint. The most dramatic improvement was observed with the never smokers extended model followed by the former and current smokers. Conclusions:The CBMN assay is a sensitive and specific predictor of lung cancer risk and extension of the Spitz risk prediction model led to an AUC that may prove useful in population screening programs to identify the "true" high risk individuals. Impact: Identifying high-risk subgroups that would benefit from screening surveillance has immense public health significance.
    Cancer Epidemiology Biomarkers & Prevention 08/2014; 23(11). DOI:10.1158/1055-9965.EPI-14-0462 · 4.32 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Lung cancer remains the leading cause of cancer-related death in the United States. Cigarette smoking is a well-recognized risk factor for lung cancer, and a sustained elevation of lung cancer risk persists even after smoking cessation. Despite identifiable risk factors, there has been minimal improvement in mortality for patients with lung cancer primarily stemming from diagnosis at a late stage when there are few effective therapeutic options. Early detection of lung cancer and effective screening of high-risk individuals may help improve lung cancer mortality. While low dose computerized tomography (LDCT) screening of high risk smokers has been shown to reduce lung cancer mortality, the high rates of false positives and potential for over-diagnosis have raised questions on how to best implement lung cancer screening. The rapidly evolving field of lung cancer screening and early-detection biomarkers may ultimately improve the ability to diagnose lung cancer in its early stages, identify smokers at highest-risk for this disease, and target chemoprevention strategies. This review aims to provide an overview of the opportunities and challenges related to lung cancer screening, the field of biomarker development for early lung cancer detection, and the future of lung cancer chemoprevention.
    06/2014; 6(2):1157-79. DOI:10.3390/cancers6021157