Interrater Reliability of Drug-Induced Sleep Endoscopy

Department of Otolaryngology-Head and Neck Surgery, University of California, San Francisco, 94115, USA.
Archives of otolaryngology--head & neck surgery (Impact Factor: 2.33). 04/2010; 136(4):393-7. DOI: 10.1001/archoto.2010.26
Source: PubMed


To determine the interrater reliability of drug-induced sleep endoscopy (DISE).
Prospective cohort; blinded comparison.
Academic referral center.
Subjects with obstructive sleep apnea unable to tolerate positive airway pressure therapy.
Drug-induced sleep endoscopy was performed with intravenous propofol infusion to achieve sedation, and the videoendoscopy recording was evaluated by 2 independent reviewers.
The following outcomes were measured: a global assessment of obstruction at the palate and/or hypopharynx; the degree of obstruction at the palate and hypopharynx; and the contribution of individual structures (palate, tonsils, tongue, epiglottis, and lateral pharyngeal walls) to obstruction.
A total of 108 subjects underwent DISE examination. Diagnostic sleep studies demonstrated a mean (SD) apnea-hypopnea index of 39.6 (24.0). Three-quarters of the subjects demonstrated multilevel airway obstruction at the palate and hypopharynx, with a diversity of individual structures contributing to obstruction. The interrater reliability for the presence of obstruction at the palate and hypopharynx (kappa values, 0.76 and 0.79, respectively) was higher than for the degree of obstruction (weighted kappa values, 0.60 and 0.44). The interrater reliability for the assessment of primary structures contributing to obstruction at the palate and hypopharynx (0.70 and 0.86) was higher than for the contributions of individual structures (kappa values, 0.42-0.71). The interrater reliability for evaluation of the hypopharyngeal structures was higher than for those of the palate region.
The interrater reliability of DISE is moderate to substantial. Trial Registration Identifier: NCT00695214.

Download full-text


Available from: Atul Malhotra, Mar 02, 2015
  • Source
    • "The authors found that their intra-rater and inter-rater agreement, on both studies ranged from moderate to substantial. However, their population was heterogeneous with a predominance of abnormal findings, and the assessors were both experienced sleep surgeons [8,9]. "
    [Show abstract] [Hide abstract]
    ABSTRACT: To validate the pharyngeal findings in sleep nasopharyngoscopy (SNP) of children with snoring - sleep disordered breathing (S-SDB). Prospective agreement diagnostic study on retrospective data. We conducted an inter-and intra-rater agreement study on video documentations of SNP performed on children (non-syndromic, complex, or operated upon) who presented with S-SDB. The videos featured various pharyngeal findings (normal, collapse, mixed or obstruction). Three ‘non-expert’ raters at various stages in their otolaryngological careers rated the videos independently, and on two separate occasions following an instructional session. We calculated both weighted and non-weighted linear kappa. Each independent observer rated sixty-one videos (2 weeks apart). Intra-observer agreement was 0.64 ± 0.08 (95% CI 0.48-0.81), 0.74 ± 0.07 (95% CI 0.60-0.88), 0.59 ± 0.08 (95% CI 0.43-0.74), for raters 1, two and three. Weighted kappa was 0.6 ± 0.1 (95% CI 0.41-0.79), 0.8 ± 0.06 (95% CI 0.7-0.92), 0.7 ± 0.07 (95% CI 0.57-0.83), respectively. Inter-rater agreements between raters one and two, two and three, three and four were 0.83 ± 0.06 (95% CI 0.71-0.95), 0.52 ± 0.08 (95% CI 0.36-0.70), and 0.53 ± 0.08 (95% CI 0.37-0.69), respectively. Weighted kappa was 0.83 ± 0.073 (95% CI 0.69-0.98), 0.68 ± 0.06 (95% CI 0.56-0.79), and 0.64 ± 0.07 (95% CI 0.49-0.78), respectively. This is the first validation of pharyngeal findings on SNP in children. It is based on a four types’ classification. Overall reproducibility amongst the three raters and their agreement was moderate to good. Further work should be phase four trials investigating the impact on outcome.
    Journal of otolaryngology - head & neck surgery = Le Journal d'oto-rhino-laryngologie et de chirurgie cervico-faciale 06/2014; 43(1):13. DOI:10.1186/1916-0216-43-13 · 0.89 Impact Factor
  • Source
    • "A number of studies have examined the utility of sleep endoscopy in the management of complex and persistent OSA. Various scoring schemes have been proposed to grade and classify obstruction seen during sleep endoscopy [14–17]. Yet the ultimate goal has been to identify the site of obstruction in order to direct further interventions. "
    [Show abstract] [Hide abstract]
    ABSTRACT: Pediatric obstructive sleep apnea (OSA) is not always resolved or improved with adenotonsillectomy. Persistent or complex cases of pediatric OSA may be due to sites of obstruction in the airway other than the tonsils and adenoids. Identifying these areas in the past has been problematic, and therefore, therapy for OSA in children who have failed adenotonsillectomy has often been unsatisfactory. Sleep endoscopy is a technique that can enable the surgeon to determine the level of obstruction in a sleeping child with OSA. With this knowledge, site-specific surgical therapy for persistent and complex pediatric OSA may be possible.
    International Journal of Pediatrics 02/2012; 2012(8):576719. DOI:10.1155/2012/576719
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Since history and physical examination alone cannot reliably diagnose obstructive sleep apnea (OSA), the gold standard for the diagnosis of OSA is polysomnography. When an oral device or surgery is considered, it is of utmost importance to examine an individual’s pattern, degree and site(s) of upper airway obstruction. This article tries to evaluate recent literature published on the use of (drug-induced) sleep endoscopy in evaluating the individually tailored treatment. Different techniques, interrater reliability, test–retest reliability and currently available data on the relationship with treatment outcome are reviewed.
    03/2013; 1(1). DOI:10.1007/s40136-012-0005-2
Show more