Equivalence of ELISpot Assays Demonstrated between Major HIV Network Laboratories

University of Toronto, Canada
PLoS ONE (Impact Factor: 3.53). 12/2010; 5(12):e14330. DOI: 10.1371/journal.pone.0014330
Source: PubMed

ABSTRACT The Comprehensive T Cell Vaccine Immune Monitoring Consortium (CTC-VIMC) was created to provide standardized immunogenicity monitoring services for HIV vaccine trials. The ex vivo interferon-gamma (IFN-γ) ELISpot is used extensively as a primary immunogenicity assay to assess T cell-based vaccine candidates in trials for infectious diseases and cancer. Two independent, GCLP-accredited central laboratories of CTC-VIMC routinely use their own standard operating procedures (SOPs) for ELISpot within two major networks of HIV vaccine trials. Studies are imperatively needed to assess the comparability of ELISpot measurements across laboratories to benefit optimal advancement of vaccine candidates.
We describe an equivalence study of the two independently qualified IFN-g ELISpot SOPs. The study design, data collection and subsequent analysis were managed by independent statisticians to avoid subjectivity. The equivalence of both response rates and positivity calls to a given stimulus was assessed based on pre-specified acceptance criteria derived from a separate pilot study.
Detection of positive responses was found to be equivalent between both laboratories. The 95% C.I. on the difference in response rates, for CMV (-1.5%, 1.5%) and CEF (-0.4%, 7.8%) responses, were both contained in the pre-specified equivalence margin of interval [-15%, 15%]. The lower bound of the 95% C.I. on the proportion of concordant positivity calls for CMV (97.2%) and CEF (89.5%) were both greater than the pre-specified margin of 70%. A third CTC-VIMC central laboratory already using one of the two SOPs also showed comparability when tested in a smaller sub-study.
The described study procedure provides a prototypical example for the comparison of bioanalytical methods in HIV vaccine and other disease fields. This study also provides valuable and unprecedented information for future vaccine candidate evaluations on the comparison and pooling of ELISpot results generated by the CTC-VIMC central core laboratories.

Download full-text


Available from: Aloysious Ssemaganda, Aug 20, 2015
1 Follower
  • Source
    • "There have been earlier attempts at evaluating ELISpot proficiency panels and assay equivalence (Cox et al., 2005; Boaz et al., 2009; Gill et al., 2010), which focused primarily on positive or negative responses and concordance among labs. The EQAPOL ELISpot program does not have criteria for defining positive or negative responses, rather the goal is to assess how accurate to the consensus average and precise laboratories are using their own in-house assay given standard peptides and samples. "
    [Show abstract] [Hide abstract]
    ABSTRACT: In September 2011 Duke University was awarded a contract to develop the National Institutes of Health/National Institute of Allergy and Infectious Diseases (NIH/NIAID) External Quality Assurance Program Oversight Laboratory (EQAPOL). Through EQAPOL, proficiency testing programs are administered for Interferon-γ (IFN-γ) Enzyme-linked immunosorbent spot (ELISpot), Intracellular Cytokine Staining Flow Cytometry (ICS) and Luminex-based cytokine assays. One of the charges of the EQAPOL program was to apply statistical methods to determine overall site performance. We utilized various statistical methods for each program to find the most appropriate for assessing laboratory performance using the consensus average as the target value. Accuracy ranges were calculated based on Wald-type confidence intervals, exact Poisson confidence intervals, or via simulations. Given the nature of proficiency testing data, which has repeated measures within donor/sample made across several laboratories; the use of mixed effects models with alpha adjustments for multiple comparisons was also explored. Mixed effects models were found to be the most useful method to assess laboratory performance with respect to accuracy to the consensus. Model based approaches to the proficiency testing data in EQAPOL will continue to be utilized. Mixed effects models also provided a means of performing more complex analyses that would address secondary research questions regarding within and between laboratory variability as well as longitudinal analyses.
    Journal of immunological methods 01/2014; 409. DOI:10.1016/j.jim.2014.01.007 · 2.01 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: As part of an ongoing study of early human immunodeficiency virus type 1 (HIV-1) infection in sub-Saharan African countries, we have identified 134 seroconverters (SCs) with distinct acute-phase (peak) and early chronic-phase (set-point) viremias. SCs with class I human leukocyte antigen (HLA) variants B*44 and B*57 had much lower peak viral loads (VLs) than SCs without these variants (adjusted linear regression beta values of -1.08 ± 0.26 log(10) [mean ± standard error] and -0.83 ± 0.27 log(10), respectively; P < 0.005 for both), after accounting for several nongenetic factors, including gender, age at estimated date of infection, duration of infection, and country of origin. These findings were confirmed by alternative models in which major viral subtypes (A1, C, and others) in the same SCs replaced country of origin as a covariate (P ≤ 0.03). Both B*44 and B*57 were also highly favorable (P ≤ 0.03) in analyses of set-point VLs. Moreover, B*44 was associated with relatively high CD4(+) T-cell counts during early chronic infection (P = 0.02). Thus, at least two common HLA-B variants showed strong influences on acute-phase as well as early chronic-phase VL, regardless of the infecting viral subtype. If confirmed, the identification of B*44 as another favorable marker in primary HIV-1 infection should help dissect mechanisms of early immune protection against HIV-1 infection.
    Journal of Virology 06/2011; 85(17):8894-902. DOI:10.1128/JVI.00439-11 · 4.65 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: The recent modest success of the RV144 HIV vaccine trial in Thailand has shown that development of an HIV vaccine is possible. Designing a vaccine that achieves better protection, however, will require a more complete understanding of vaccine mechanisms of action and correlates of protection. Systems biology approaches enable integration of large datasets from a variety of assays and offer new approaches to understanding how vaccine-induced immune responses are coordinately regulated. In this review, we discuss the recent advances in clinical trial design, specimen collection, and assay standardization that will generate datasets for systems analyses of immune responses to HIV vaccines. Several recently published HIV vaccine trials have shown that different HIV vaccine prime/boost combinations can greatly affect the immune response generated, but mechanistic insights into their modes of action are lacking. Novel systems biology studies of efficacious, licensed vaccines provide a new template for analysis of HIV vaccines. To generate datasets appropriate for systems analysis, current HIV vaccine clinical trials are undergoing design modifications and increased standardization of specimen collection and immune response assays. Systems biology approaches to HIV vaccine evaluation are driving new methods of HIV vaccine immune response profiling in clinical trials and will hopefully lead to new improved HIV vaccines in the near future.
    Current opinion in HIV and AIDS 11/2011; 7(1):32-7. DOI:10.1097/COH.0b013e32834ddcd9 · 4.39 Impact Factor
Show more