Monitoring for Lack of Benefit: A Critical Component of a Randomized Clinical Trial

Biometric Research Branch, Division of Cancer Treatment and Diagnosis, National Cancer Institute, Bethesda, MD 20892, USA.
Journal of Clinical Oncology (Impact Factor: 18.43). 02/2009; 27(4):629-33. DOI: 10.1200/JCO.2008.17.8905
Source: PubMed


To balance patient interests against the need for acquiring evidence, ongoing randomized clinical trials are formally monitored for early convincing indication of benefit or lack of benefit. In lethal diseases like cancer, where new therapies are often toxic and may have limited preliminary efficacy data, monitoring for lack of benefit is particularly important. We review the complex nature of stopping a randomized trial for lack of benefit and argue that many cancer trials could be improved by a more aggressive approach to monitoring. On the other hand, we caution that some commonly used monitoring guidelines may result in stopping for lack of benefit even when a nontrivial beneficial effect is observed.

Full-text preview

Available from:
  • [Show abstract] [Hide abstract]
    ABSTRACT: It has been suggested in the literature that the well-known bias of treatment-effect estimators due to the possibility of early stopping for positive results is a major concern with interim monitoring. To discuss approaches one might use to compare the inflation of the treatment-effect estimator when the trial is stopped early for positive results with the inflation that would be seen in a comparable set of positive trials that used fixed sample sizes with no interim monitoring, and to quantify the relative inflation of monitored trials relative to that of the corresponding subset of positive fixed sample-size trials. Via simulation for some O'Brien-Fleming and Haybittle-Peto monitoring boundaries, the inflation of the treatment-effect estimator when the trial crossed an interim-monitoring boundary for positive results is compared with the preferred approach to estimate the inflation from a comparable set of positive fixed sample-size trials. Although the inflation of the treatment-effect estimator when a trial is stopped early can be considerable, only at very early interim analyses (<or=25% of information) is this inflation much larger than the inflation that would be seen for an appropriate subset of similar positive fixed sample-size trials. The treatment-effect inflation from stopping at second or later interim analyses that are not so early is relatively small and similar to that seen in the corresponding subset of fixed sample-size trials. The results apply to adequately powered trials with well-designed prospectively specified interim-monitoring plans. For trials with a well-designed interim-monitoring plan, stopping at 50% or greater information has a negligible impact on estimation. Except for very early interim analyses (<or=25% of the information), concerns about the inflation of the treatment effect should be minor.
    No preview · Article · Apr 2009 · Clinical Trials
  • [Show abstract] [Hide abstract]
    ABSTRACT: Following a phase II trial in which pemetrexed-platinum demonstrated similar activity to that of historical etoposide-platinum controls, a phase III study was conducted to compare pemetrexed-carboplatin with etoposide-carboplatin for the treatment of extensive-stage small-cell lung cancer (ES-SCLC). Chemotherapy-naive patients with ES-SCLC and an Eastern Cooperative Oncology Group performance status of zero to 2 were randomly assigned to receive pemetrexed-carboplatin (pemetrexed 500 mg/m(2) on day 1; carboplatin at area under the serum concentration-time curve [AUC] 5 on day 1) or etoposide-carboplatin (etoposide 100 mg/m(2) on days 1 through 3; carboplatin AUC 5 on day 1) every 3 weeks for up to six cycles. The primary objective of the study was noninferiority of pemetrexed-carboplatin overall survival with a 15% margin. Accrual was terminated with 908 of 1,820 patients enrolled after results of a planned interim analysis. In the final analysis, pemetrexed-carboplatin was inferior to etoposide-carboplatin for overall survival (median, 8.1 v 10.6 months; hazard ratio [HR],1.56; 95% CI, 1.27 to 1.92; log-rank P < .01) and progression-free survival (median, 3.8 v 5.4 months; HR, 1.85; 95% CI, 1.58 to 2.17; log-rank P < .01). Objective response rates were also significantly lower for pemetrexed-carboplatin (31% v 52%; P < .001). Pemetrexed-carboplatin had lower grade 3 to 4 neutropenia, febrile neutropenia, and leukopenia than etoposide-carboplatin; grade 3 to 4 thrombocytopenia was comparable between arms and anemia was higher in the pemetrexed-carboplatin arm. Pemetrexed-carboplatin is inferior for the treatment of ES-SCLC. Planned translational research and pharmacogenomic analyses of tumor and blood samples may help explain the study results and provide insight into new treatment strategies.
    No preview · Article · Aug 2009 · Journal of Clinical Oncology
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Clinical biomarker tests that aid in making treatment decisions will play an important role in achieving personalized medicine for cancer patients. Definitive evaluation of the clinical utility of these biomarkers requires conducting large randomized clinical trials (RCTs). Efficient RCT design is therefore crucial for timely introduction of these medical advances into clinical practice, and a variety of designs have been proposed for this purpose. To guide design and interpretation of RCTs evaluating biomarkers, we present an in-depth comparison of advantages and disadvantages of the commonly used designs. Key aspects of the discussion include efficiency comparisons and special interim monitoring issues that arise because of the complexity of these RCTs. Important ongoing and completed trials are used as examples. We conclude that, in most settings, randomized biomarker-stratified designs (ie, designs that use the biomarker to guide analysis but not treatment assignment) should be used to obtain a rigorous assessment of biomarker clinical utility.
    Full-text · Article · Feb 2010 · Journal of the National Cancer Institute
Show more