Receiver-operating characteristic curve analysis in diagnostic, prognostic and predictive biomarker research.

Department of Surgery, Stavanger University Hospital, Stavanger, Norway.
Journal of clinical pathology (Impact Factor: 2.43). 10/2008; 62(1):1-5. DOI: 10.1136/jcp.2008.061010
Source: PubMed

ABSTRACT From a clinical perspective, biomarkers may have a variety of functions, which correspond to different stages in the disease development, e.g. in the progression of cancer. Biomarkers can assist in the care of patients for screening, diagnosis, prognosis, prediction and surveillance. Fundamental for the use of biomarkers in all situations is biomarker accuracy - the ability to correctly classify one condition and/or outcome from another. Receiver-operating characteristic (ROC) curve analysis is a useful tool in assessment of biomarker accuracy. Its advantages include testing accuracy across the entire range of scores and thereby not requiring a predetermined cut-off point, in addition to easily examined visual and statistical comparisons across tests or scores, and, finally, independence from outcome prevalence. Further, ROC curve analysis is a useful tool for evaluating the accuracy of a statistical model that classifies subjects into one of two categories. Diagnostic models are different from predictive and prognostic models in that the latter incorporate time-to-event analysis, for which censored data may pose a weakness of the model, or the reference standard. However, with the appropriate use of ROC curves, investigators of biomarkers can improve their research and presentation of results. ROC curves help identify the most appropriate classification rules. ROC curves avoid confounding resulting from varying thresholds with subjective ratings. The ROC curve results should always be put in perspective, because a good classifier does not guarantee the eventual clinical outcome, in particular for time-dependant events in screening, prediction, and/or prognosis studies where particular statistical precautions and methods are needed.

  • [Show abstract] [Hide abstract]
    ABSTRACT: Numerous attempts for detection of circulating tumor cells (CTC) have been made to develop reliable assays for early diagnosis of cancers. In this study, we validated the application of folate receptor α (FRα) as the tumor marker to detect CTC through tumor-specific ligand PCR (LT-PCR) and assessed its utility for diagnosis of bladder transitional cell carcinoma (TCC). Immunohistochemistry for FRα was performed on ten bladder TCC tissues. Enzyme-linked immunosorbent assay (ELISA) for FRα was performed on both urine and serum specimens from bladder TCC patients (n = 64 and n = 20, respectively) and healthy volunteers (n = 20 and n = 23, respectively). Western blot analysis and qRT-PCR were performed to confirm the expression of FRα in bladder TCC cells. CTC values in 3-mL peripheral blood were measured in 57 bladder TCC patients, 48 healthy volunteers, and 15 subjects with benign urologic pathologies by the folate receptor α ligand-targeted PCR. We found that FRα protein was overexpressed in both bladder TCC cells and tissues. The levels of FRα mRNA were also much higher in bladder cancer cell lines 5637 and SW780 than those of leukocyte. Values of FRα were higher in both serum and urine specimens of bladder TCC patients than those of control. CTC values were also higher in 3-mL peripheral blood of bladder TCC patients than those of control (median 26.5 Cu/3 mL vs 14.0 Cu/3 mL). Area under the receiver operating characteristic (ROC) curve for bladder TCC detection was 0.819, 95 % CI (0.738-0.883). At the cutoff value of 15.43 Cu/3 mL, the sensitivity and the specificity for detecting bladder cancer are 82.14 and 61.9 %, respectively. We concluded that quantitation of CTCs through FRα ligand-PCR could be a promising method for noninvasive diagnosis of bladder TCC.
    Tumor Biology 04/2014; · 2.52 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: To identify the differential urinary metabolic pattern of oligozoospermic infertile men and to determine the potential biomarkers indicative of infertility. Observational study. University hospital. Totals of 158 fertile volunteers and 135 oligozoospermic infertile men. None. Urinary metabolic profiles were acquired with the use of liquid chromatography/mass spectrometry. Potential oligozoospermic biomarkers were screened from orthogonal projections to latent structures discriminant analysis and further evaluated by receiver operating characteristic analysis. The Spearman correlations between the individual sets of biomarkers and between biomarkers and sperm parameters were investigated. The disrupted biologic pathways which the biomarkers were involved in also were analyzed. Oligozoospermic infertile men could be differentiated from fertile control subjects based on altered urinary metabolic profiles. A total of ten potential biomarkers were screened and tentatively identified. Among those, decreased acylcarnitines, aspartic acid, and leucylproline and increased adenine and methylxanthine were strongly associated with oligozoospermic risk. Many biomarkers were associated with sperm concentration and amplitude of lateral head displacement. The combined pattern of acetylcarnitine, carnitine C3:1, and aspartic acid provided moderate diagnostic power. Urinary metabolomics identified unique metabolic pattern of oligozoospermic infertility. The potential biomarkers suggested that oligozoospermia may be tightly associated with energy consumption and antioxidant defenses in spermatogenesis.
    Fertility and sterility 04/2014; · 3.97 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: To identify a body fat percentage (%BF) threshold related to an adverse cardiometabolic profile and its surrogate BMI cut-off point.
    Public health nutrition. 06/2014;