Ram C. Tiwari’s research while affiliated with Bristol-Myers Squibb and other places

In a randomized controlled trial with time‐to‐event endpoint, some commonly used statistical tests to test for various aspects of survival differences, such as survival probability at a fixed time point, survival function up to a specific time point, and restricted mean survival time, may not be directly applicable when external data are leveraged to augment an arm (or both arms) of an RCT. In this paper, we propose a propensity score‐integrated approach to extend such tests when external data are leveraged. Simulation studies are conducted to evaluate the operating characteristics of three propensity score‐integrated statistical tests, and an illustrative example is given to demonstrate how these proposed procedures can be implemented.

The propensity score‐integrated composite likelihood (PSCL) method is one method that can be utilized to design and analyze an application when real‐world data (RWD) are leveraged to augment a prospectively designed clinical study. In the PSCL, strata are formed based on propensity scores (PS) such that similar subjects in terms of the baseline covariates from both the current study and RWD sources are placed in the same stratum, and then composite likelihood method is applied to down‐weight the information from the RWD. While PSCL was originally proposed for a fixed design, it can be extended to be applied under an adaptive design framework with the purpose to either potentially claim an early success or to re‐estimate the sample size. In this paper, a general strategy is proposed due to the feature of PSCL. For the possibility of claiming early success, Fisher's combination test is utilized. When the purpose is to re‐estimate the sample size, the proposed procedure is based on the test proposed by Cui, Hung, and Wang. The implementation of these two procedures is demonstrated via an example.

In the area of diagnostics, it is common practice to leverage external data to augment a traditional study of diagnostic accuracy consisting of prospectively enrolled subjects to potentially reduce the time and/or cost needed for the performance evaluation of an investigational diagnostic device. However, the statistical methods currently being used for such leveraging may not clearly separate study design and outcome data analysis, and they may not adequately address possible bias due to differences in clinically relevant characteristics between the subjects constituting the traditional study and those constituting the external data. This paper is intended to draw attention in the field of diagnostics to the recently developed propensity score‐integrated composite likelihood approach, which originally focused on therapeutic medical products. This approach applies the outcome‐free principle to separate study design and outcome data analysis and can mitigate bias due to imbalance in covariates, thereby increasing the interpretability of study results. While this approach was conceived as a statistical tool for the design and analysis of clinical studies for therapeutic medical products, here, we will show how it can also be applied to the evaluation of sensitivity and specificity of an investigational diagnostic device leveraging external data. We consider two common scenarios for the design of a traditional diagnostic device study consisting of prospectively enrolled subjects, which is to be augmented by external data. The reader will be taken through the process of implementing this approach step‐by‐step following the outcome‐free principle that preserves study integrity.

External data, referred to as data external to the traditional clinical study being planned, include but are not limited to real-world data (RWD) and data collected from clinical studies being conducted in the past or in other countries. The external data are sometimes leveraged to augment a single-arm, prospectively designed study when appropriate. In such an application, recently developed propensity score-integrated approaches including PSPP and PSCL can be used for study design and data analysis when the clinical outcomes are binary or continuous. In this paper, the propensity score-integrated Kaplan-Meier (PSKM) method is proposed for a similar situation but the outcome of interest is time-to-event. The propensity score methodology is used to select external subjects that are similar to those in the current study in terms of baseline covariates and to stratify the selected subjects from both data sources into more homogeneous strata. The stratum-specific PSKM estimators are obtained based on all subjects in the stratum with the external data being down-weighted, and then these estimators are combined to obtain an overall PSKM estimator. A simulation study is conducted to assess the performance of the PSKM method, and an illustrative example is presented to demonstrate how to implement the proposed method.

The document ICH E9 (R1) has brought much attention to the concept of estimand in the clinical trials community. ICH stands for International Conference for Harmonization. In this article, we draw attention to one facet of estimand that is not discussed in that document but is crucial in the context of observational studies, namely weighting for covariate balance. How weighting schemes are connected to estimand, or more specifically to one of its five attributes identified in ICH E9 (R1), the attribute of population, is illustrated using the Rubin Causal Model. Three estimands are examined from both theoretical and practical perspectives. Factors that may be considered in choosing among these estimands are discussed.

Background: Meta-analysis of related trials can provide an overall measure of safety-signal accounting for variability across studies. In addition to an overall measure, researchers may often be interested in study-specific measures to assess safety of the product. Likelihood ratio tests (LRT) methods serve this purpose by identifying studies that appear to show a safety concern. In this paper, we present a Bayesian approach. Despite having good statistical properties, the LRT methods may not be suitable for the meta-analysis of randomized controlled trials (RCTs) when there are several studies with zero events in at least one arm. Methods: In this article, we describe a Bayesian framework using a Zero-inflated binomial model with spike-and-slab parameterization for the treatment effects. In addition to providing an overall meta-analytic estimate, this method provides posterior probability of a safety-signal for each study. Results: We illustrate the approach using two published data sets comprising several randomized controlled trials (RCTs) each and compare the model performance for different choices of priors for treatment effect. Discussion: The proposed Bayesian methodological framework is useful to identify potential signal for single adverse event and to determine overall meta-analytic estimate of the magnitude of the signal. Practitioners may consider this approach as an alternative to the frequentist's LRT approach discussed in Jung et al. (J Biopharm Stat 31:47-54, 2020) when there are zero events in either the treatment arm or the control arm. In the future, this approach can be further extended to accommodate multiple adverse events.

In this paper, we develop a methodology for leveraging real-world data into single-arm clinical trial studies. In recent years, the idea of augmenting randomized clinical trials data with real-world data has emerged as a particularly attractive technique for health organizations and drug developers to accelerate the drug development process. Major regulatory authorities such as the Food and Drug Administration and European Medicines Agency have recognized the potential of utilizing real-world data and are advancing toward making regulatory decisions based on real-world evidence. Several statistical methods have been developed in recent years for borrowing data from real-world sources such as electronic health records, product and disease registries, as well as claims and billing data. We propose a novel approach to augment single-arm clinical trials with the real-world data derived from single or multiple data sources. Furthermore, we illustrate the proposed method in the presence of missing data and conduct simulation studies to evaluate its performance in diverse settings.

Necessity for finding improved intervention in many legacy therapeutic areas are of high priority. This has the potential to decrease the expense of medical care and poor outcomes for many patients. Typically, clinical efficacy is the primary evaluating criteria to measure any beneficial effect of a treatment. Albeit, there could be situations when several other factors (e.g. side-effects, cost-burden, less debilitating, less intensive, etc.) which can permit some slightly less efficacious treatment options favorable to a subgroup of patients. This often leads to non-inferiority (NI) testing. NI trials may or may not include a placebo arm due to ethical reasons. However, when included, the resulting three-arm trial is more prudent since it requires less stringent assumptions compared to a two-arm placebo-free trial. In this article, we consider both Frequentist and Bayesian procedures for testing NI in the three-arm trial with binary outcomes when the functional of interest is risk difference. An improved Frequentist approach is proposed first, which is then followed by a Bayesian counterpart. Bayesian methods have a natural advantage in many active-control trials, including NI trial, as it can seamlessly integrate substantial prior information. In addition, we discuss sample size calculation and draw an interesting connection between the two paradigms.

In this paper, a propensity score-integrated power prior approach is developed to augment the control arm of a two-arm randomized controlled trial (RCT) with subjects from multiple external data sources such as real-world data (RWD) and historical clinical studies containing subject-level outcomes and covariates. The propensity scores for the subjects in the external data sources versus the subjects in the RCT are first estimated, and then subjects are placed in different strata based on their estimated propensity scores. Within each propensity score stratum, a power prior is formulated with the information contributed by the external data sources, and Bayesian inference on the treatment effect is obtained. The proposed approach is implemented under the two-stage study design framework utilizing the outcome-free principle to ensure the integrity of a study. An illustrative example is provided to demonstrate the implementation of the proposed approach.

In many orphan diseases and pediatric indications, the randomized controlled trials may be infeasible because of their size, duration, and cost. Leveraging information on the control through a prior can potentially reduce sample size. However, unless an objective prior is used to impose complete ignorance for the parameter being estimated, it results in biased estimates and inflated type‐I error. Hence, it is essential to assess both the confirmatory and supplementary knowledge available during the construction of the prior to avoid “cherry‐picking” advantageous information. For this purpose, propensity score methods are employed to minimize selection bias by weighting supplemental control subjects according to their similarity in terms of pretreatment characteristics to the subjects in the current trial. The latter can be operationalized through a proposed measure of overlap in propensity‐score distributions. In this paper, we consider single experimental arm in the current trial and the control arm is completely borrowed from the supplemental data. The simulation experiments show that the proposed method reduces prior and data conflict and improves the precision of the of the average treatment effect.