Validation of an instrument to assess evidence-based practice knowledge, attitudes, access, and confidence in the dental environment.

Educational and Faculty Development, Dental School, University of Texas Health Science Center at San Antonio, 7703 Floyd Curl Drive, San Antonio, TX 78229, USA.
Journal of dental education (Impact Factor: 0.99). 02/2011; 75(2):131-44.
Source: PubMed

ABSTRACT This article reports the validation of an assessment instrument designed to measure the outcomes of training in evidence-based practice (EBP) in the context of dentistry. Four EBP dimensions are measured by this instrument: 1) understanding of EBP concepts, 2) attitudes about EBP, 3) evidence-accessing methods, and 4) confidence in critical appraisal. The instrument-the Knowledge, Attitudes, Access, and Confidence Evaluation (KACE)-has four scales, with a total of thirty-five items: EBP knowledge (ten items), EBP attitudes (ten), accessing evidence (nine), and confidence (six). Four elements of validity were assessed: consistency of items within the KACE scales (extent to which items within a scale measure the same dimension), discrimination (capacity to detect differences between individuals with different training or experience), responsiveness (capacity to detect the effects of education on trainees), and test-retest reliability. Internal consistency of scales was assessed by analyzing responses of second-year dental students, dental residents, and dental faculty members using Cronbach coefficient alpha, a statistical measure of reliability. Discriminative validity was assessed by comparing KACE scores for the three groups. Responsiveness was assessed by comparing pre- and post-training responses for dental students and residents. To measure test-retest reliability, the full KACE was completed twice by a class of freshman dental students seventeen days apart, and the knowledge scale was completed twice by sixteen faculty members fourteen days apart. Item-to-scale consistency ranged from 0.21 to 0.78 for knowledge, 0.57 to 0.83 for attitude, 0.70 to 0.84 for accessing evidence, and 0.87 to 0.94 for confidence. For discrimination, ANOVA and post hoc testing by the Tukey-Kramer method revealed significant score differences among students, residents, and faculty members consistent with education and experience levels. For responsiveness to training, dental students and residents demonstrated statistically significant changes, in desired directions, from pre- to post-test. For the student test-retest, Pearson correlations for KACE scales were as follows: knowledge 0.66, attitudes 0.66, accessing evidence 0.74, and confidence 0.76. For the knowledge scale test-retest by faculty members, the Pearson correlation was 0.79. The construct validity of the KACE is equivalent to that of instruments that assess similar EBP dimensions in medicine. Item consistency for the knowledge scale was more variable than for other KACE scales, a finding also reported for medically oriented EBP instruments. We conclude that the KACE has good discriminative validity, responsiveness to training effects, and test-retest reliability.

  • Source
    Evidence-based dentistry 03/2012; 13(1):2-3.
  • [Show abstract] [Hide abstract]
    ABSTRACT: This report describes the implementation and evaluation of the Bronx-Lebanon Hospital Center Dental Faculty Development Program (DFDP) for fifteen participants: five advanced dental education faculty members and ten residents. The 100-hour DFDP, designed in the longitudinal immersion model for faculty development, was conducted in four phases at the Bronx-Lebanon Department of Dentistry in the Bronx, New York, in 2010-11. The DFDP was implemented to help underrepresented minority (URM) dental residents and clinical faculty members develop skills necessary for academic careers and enhanced teaching effectiveness. The program's curriculum had four themes: teaching and learning, scholarship, academic leadership, and career planning. For each phase, the participants completed pre- and post-training assessments of their knowledge, attitudes, and confidence, as well as qualitative evaluation of DFDP organization, content, activities, and value. The participants' pre-instruction mean knowledge score for all phases combined was 48.3 percent, and the post-test score was 81.1 percent (p=0.01). The participants showed minimal change in their attitudes about educational issues, but they reported enhanced confidence for twenty-five skills addressed in the DFDP. The total confidence score was 77.5 (25 skills × 3.1 group mean) on all pre-tests combined and 100.2 (25 × 4.0 group mean) on the post-tests (p=0.01). The participant ratings for overall DFDP implementation and for twenty-four topical sessions were uniformly positive. The faculty and resident participants in this year-long faculty development initiative at an advanced dental education program with a high URM representation demonstrated enhanced knowledge and confidence and provided positive program evaluations. This report also describes curricular and assessment enhancements for subsequent years of the DFDP based on the first-year outcomes.
    Journal of dental education 03/2013; 77(3):276-91. · 0.99 Impact Factor
  • Journal of Public Health 12/2013; 35(4):624-7. · 2.06 Impact Factor

Full-text (2 Sources)

Available from
May 16, 2014