Design and Analytical Validation of Clinical DNA Sequencing Assays

ARUP Laboratories, Institute of Clinical and Experimental Pathology, Salt Lake City, Utah, USA.
Archives of pathology & laboratory medicine (Impact Factor: 2.88). 01/2012; 136(1):41-6. DOI: 10.5858/arpa.2010-0623-OA
Source: PubMed

ABSTRACT DNA sequencing is the method of choice for mutation detection in many genes.
To demonstrate the analytical accuracy and reliability of DNA sequencing assays developed in clinical laboratories. Only general guidelines exist for the validation of these tests. We provide examples of assay validation strategies for DNA sequencing tests.
We discuss important design and validation considerations.
The validation examples include an accuracy study to evaluate concordance between results obtained by the newly designed assay and analyzed by another method or laboratory. Precision (reproducibility) studies are performed to determine the robustness of the assay. To assess the quality of sequencing assays, several sequence quality measures are available. In addition, assessing the ability of primers to specifically and robustly amplify target regions before sequencing is important.
Protocols for validation of laboratory-developed sequencing assays may vary between laboratories. An example summary of a validation is provided.

  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: The aim of the present study was to evaluate the frequency and type of oncogenic v-raf murine sarcoma viral oncogene homolog B1 (BRAF)/neuroblastoma RAS viral (v-ras) oncogene homolog (NRAS) mutations in cutaneous melanoma with clinically detected nodal metastases (stage IIIB and C) in relation to clinicopathological features and outcome. The clinicopathological data of 250 patients following therapeutic lymphadenectomy (LND) between 1995 and 2010, as well as BRAF/NRAS mutational status in corresponding nodal metastases, were analyzed. The median follow-up time was 53 months. BRAF mutations were detected in 154 (62%) cases (141 p.V600E, nine p.V600K and four others) and mutually exclusive NRAS mutations were detected in 42 (17%) cases. The presence of a BRAF mutation was found to correlate with patients of a younger age. The five-year overall survival (OS) rate was 33 and 43% for LND and primary tumor excision, respectively, and the five-year disease-free survival (DFS) rate for LND was 25%. No correlation was identified between BRAF/NRAS mutational status and RFS or OS (calculated from the date of the LND and primary tumor excision); for BRAF- and NRAS-mutated melanoma, the prognosis was the same for patients with wild-type (WT) melanoma. The important factors which had a negative impact on OS and DFS were as follows: Male gender, >1 metastatic lymph node and extracapsular extension of nodal metastases. The interval between the diagnosis of the initial melanoma to regional nodal metastasis (median, 10 months) was not significantly different between BRAF-mutant and -WT patients. Our largest comprehensive molecular analysis of clinical stage III melanoma revealed that BRAF and NRAS mutational status is not a prognostic marker in stage III melanoma patients with macroscopic nodal involvement, but may have implications for potential adjuvant therapy.
    Oncology letters 07/2014; 8(1):47-54. DOI:10.3892/ol.2014.2122 · 0.99 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: Purpose: Clinical investigational studies were conducted to demonstrate the accuracy and reproducibility of the Illumina MiSeqDx CF System, a next-generation sequencing (NGS) in vitro diagnostic device for cystic fibrosis testing. Methods: Two NGS assays - a Clinical Sequencing Assay (Sequencing Assay) and a 139-Variant Assay (Variant Assay) - were evaluated in both an Accuracy Study and a Reproducibility Study, with comparison to bi-directional Sanger sequencing and PCR as reference methods. For each study, positive agreement (PA), negative agreement (NA), and overall agreement (OA) were evaluated. Results: In the Accuracy Study, the Sequencing Assay achieved PA of 99.7% including the polyTG/polyT region and PA of 100% excluding the region. The Variant Assay achieved PA of 100%. NA and OA were >99.99% for both Assays. In the Reproducibility Study, the Sequencing Assay achieved PA of 99.2%; NA and OA were both 99.7%. The Variant Assay achieved PA of 99.8%; NA and OA were both 99.9%. Sample pass rates were 99.7% in both studies for both assays. Conclusion: This is the first systematic evaluation of a NGS platform for broad clinical use as an in vitro diagnostic, including accuracy validation with multiple reference methods and reproducibility validation at multiple clinical sites. These NGS-based Assays had accurate and reproducible results which were comparable to or better than other methods currently in clinical use for clinical genetic testing of cystic fibrosis.
    Expert Review of Molecular Diagnostics 06/2014; 14(5):605-22. DOI:10.1586/14737159.2014.916618 · 4.27 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: High throughput sequencing (HTS) generates large amounts of high quality sequence data for microbial genomics. The value of HTS for microbial forensics is the speed at which evidence can be collected and the power to characterize microbial-related evidence to solve biocrimes and bioterrorist events. As HTS technologies continue to improve, they provide increasingly powerful sets of tools to support the entire field of microbial forensics. Accurate, credible results allow analysis and interpretation, significantly influencing the course and/or focus of an investigation, and can impact the response of the government to an attack having individual, political, economic or military consequences. Interpretation of the results of microbial forensic analyses relies on understanding the performance and limitations of HTS methods, including analytical processes, assays and data interpretation. The utility of HTS must be defined carefully within established operating conditions and tolerances. Validation is essential in the development and implementation of microbial forensics methods used for formulating investigative leads attribution. HTS strategies vary, requiring guiding principles for HTS system validation. Three initial aspects of HTS, irrespective of chemistry, instrumentation or software are: 1) sample preparation, 2) sequencing, and 3) data analysis. Criteria that should be considered for HTS validation for microbial forensics are presented here. Validation should be defined in terms of specific application and the criteria described here comprise a foundation for investigators to establish, validate and implement HTS as a tool in microbial forensics, enhancing public safety and national security.
    07/2014; 5:9. DOI:10.1186/2041-2223-5-9
    This article is viewable in ResearchGate's enriched format


Available from
May 23, 2014