A Multicenter Analysis of the Ophthalmic Knowledge Assessment Program and American Board of Ophthalmology Written Qualifying Examination Performance

Department of Ophthalmology, Baylor College of Medicine, Houston, Texas
Ophthalmology (Impact Factor: 6.14). 07/2012; 119(10):1949-53. DOI: 10.1016/j.ophtha.2012.06.010
Source: PubMed


To compare the performance on the American Board of Ophthalmology Written Qualifying Examination (WQE) with the performance on step 1 of the United States Medical Licensing Examination (USMLE) and the Ophthalmic Knowledge Assessment Program (OKAP) examination for residents in multiple residency programs.
Comparative case series.
Fifteen residency programs with 339 total residents participated in this study. The data were extracted from the 5-year American Board of Ophthalmology report to each participating program in 2009 and included residency graduating classes from 2003 through 2007. Residents were included if data were available for the USMLE, OKAP examination in ophthalmology years 1 through 3, and the WQE score. Residents were excluded if one or more of the test scores were not available.
Two-sample t tests, logistic regression analysis, and receiver operating characteristic (ROC) curves were used to examine the association of the various tests (USMLE, OKAP examination year 1, OKAP examination year 2, OKAP examination year 3, and maximum OKAP examination score) as a predictor for a passing or failing grade on the WQE.
The primary outcome measure of this study was first time pass rate for the WQE.
Using ROC analysis, the OKAP examination taken at the third year of ophthalmology residency best predicted performance on the WQE. For the OKAP examination taken during the third year of residency, the probability of passing the WQE was at least 80% for a score of 35 or higher and at least 95% for a score of 72 or higher.
The OKAP examination, especially in the third year of residency, can be useful to residents to predict the likelihood of success on the high-stakes WQE examination.
The author(s) have no proprietary or commercial interest in any materials discussed in this article.

20 Reads
  • [Show abstract] [Hide abstract]
    ABSTRACT: The ACGME is moving towards the next generation of accreditation in the USA called the Next Accreditation System (NAS). The NAS is anticipated to reduce the burden on programs to comply with accreditation requirements; to produce meaningful, innovative, and continuous benchmark outcomes data; to use ongoing individual and programmatic milestones to judge performance; and ultimately to produce better trained residents, to improve the quality of care, to reduce health care costs and health care disparities, and to provide objective evidence to the public and other external stakeholders of the quality of graduate medical education across the specialties of medicine. We describe the ACGME milestone development process for ophthalmology. If successful, the NAS will benefit all programs by reducing the programmatic burden and paperwork; increasing accreditation cycle length; and improving all programs through formative and summative feedback.
    Survey of Ophthalmology 07/2013; 58(4):359-69. DOI:10.1016/j.survophthal.2013.01.002 · 3.85 Impact Factor
  • Ophthalmology 10/2012; 119(10):1947-8. DOI:10.1016/j.ophtha.2012.07.060 · 6.14 Impact Factor
  • 03/2014; 6(1 Suppl 1):144-5. DOI:10.4300/JGME-06-01s1-37