Research
Print page Print page
Switch language
Rigshospitalet - a part of Copenhagen University Hospital
Published

Inter-observer and intra-observer agreement in drug-induced sedation endoscopy — a systematic approach

Research output: Contribution to journalJournal articleResearchpeer-review

  1. Robotkirurgi inden for øre-, næse- og halskirurgi

    Research output: Contribution to journalReviewpeer-review

  2. Second primary cancer following primary oral squamous cell carcinoma: a population-based, retrospective study

    Research output: Contribution to journalJournal articleResearchpeer-review

View graph of relations

Objective: To evaluate the feasibility of systematic observer training in drug-induced sedation endoscopy (DISE) interpretation. Methods: Fifty DISE videos were randomly selected from a group of 200 videos of cohort of patients with OSA and/or snoring. The videos were assessed blindly and independently using a modified VOTE classification by an expert observer and by two novice observers starting their training. A systematic approach was initiated. Clusters of 10 videos were scored individually by each observer and then re-evaluated as the expert observer clarified the decision-making in plenum. Kappa coefficient (κ) was calculated as a measure of agreement. Results: The intra-observer variation for the total agreement and kappa values for the expert observer ranged between moderate to substantial agreement in VOTE classification, whereas the novices varied between “less than chance agreement” to “moderate agreement.” The inter-observer variation showed increased agreement and kappa values from day 1 to day 2 for both novice observers except at the velum level for observer C. The total agreement and kappa values for each site also improved compared to results of day 1, except at velum for observer C. The velum site seemed to be more difficult to evaluate. The learning curve varied during the study course for each site of the upper airways. Conclusion: This study shows that systematic intensive training is feasible, although expert level is not acquired after 100 evaluations. The learning curve for the expert observer showed “moderate to substantial agreement” but differed between the trainees. Level of evidence: 2.

Original languageEnglish
Article number52
JournalEgyptian Journal of Otolaryngology
Volume38
Issue number1
ISSN1012-5574
DOIs
Publication statusPublished - Dec 2022

Bibliographical note

Publisher Copyright:
© 2022, The Author(s).

    Research areas

  • DISE, ENT, OSA, OSAS, Sleep apnea, Surgical treatment of OSA, Systematic education

ID: 79392881