Research
Print page Print page
Switch language
Rigshospitalet - a part of Copenhagen University Hospital
Published

Nonspecialist Raters Can Provide Reliable Assessments of Procedural Skills

Research output: Contribution to journalJournal articleResearchpeer-review

  1. Direct Observation vs. Video-Based Assessment in Flexible Cystoscopy

    Research output: Contribution to journalJournal articleResearchpeer-review

  2. Evaluation of Procedural Simulation as a Training and Assessment Tool in General Surgery-Simulating a Laparoscopic Appendectomy

    Research output: Contribution to journalJournal articleResearchpeer-review

  3. Ensuring Competency of Novice Laparoscopic Surgeons-Exploring Standard Setting Methods and their Consequences

    Research output: Contribution to journalJournal articleResearchpeer-review

  4. Training and Assessment of Hysteroscopic Skills: A Systematic Review

    Research output: Contribution to journalJournal articleResearchpeer-review

  1. Simulation-based training for flexible cystoscopy - A randomized trial comparing two approaches

    Research output: Contribution to journalJournal articleResearchpeer-review

  2. Robotic versus laparoscopic urological surgery: incidence of reoperation and complications

    Research output: Contribution to journalJournal articleResearchpeer-review

  3. Direct Observation vs. Video-Based Assessment in Flexible Cystoscopy

    Research output: Contribution to journalJournal articleResearchpeer-review

  4. Onabotulinumtoxin A (Botox) in treatment of neurogenic bladder overactivity

    Research output: Contribution to journalJournal articleResearchpeer-review

View graph of relations

BACKGROUND: Competency-based learning has become a crucial component in medical education. Despite the advantages of competency-based learning, there are still challenges that need to be addressed. Currently, the common perception is that specialist assessment is needed for evaluating procedural skills which is difficult owing to the limited availability of faculty time. The aim of this study was to explore the validity of assessments of video recorded procedures performed by nonspecialist raters.

METHODS: This study was a blinded observational trial. Twenty-three novices (senior medical students) and 9 experienced doctors were video recorded while each performing 2 flexible cystoscopies on patients. The recordings were anonymized and placed in random order and then rated by 2 experienced cystoscopists (specialist raters) and 2 medical students (nonspecialist raters). Flexible cystoscopy was chosen as it is a simple procedural skill that is crucial to master in a resident urology program.

RESULTS: The internal consistency of assessments was high, Cronbach's α = 0.93 and 0.95 for nonspecialist and specialist raters, respectively (p < 0.001 for both correlations). The interrater reliability was significant (p < 0.001) with a Pearson's correlation of 0.77 for the nonspecialists and 0.75 for the specialists. The test-retest reliability showed the biggest difference between the 2 groups, 0.59 and 0.38 for the nonspecialist raters and the specialist raters, respectively (p < 0.001).

CONCLUSION: Our study suggests that nonspecialist raters can provide reliable and valid assessments of video recorded cystoscopies. This could make mastery learning and competency-based education more feasible.

Original languageEnglish
JournalJournal of Surgical Education
Volume75
Issue number2
Pages (from-to)370-376
ISSN1931-7204
DOIs
Publication statusPublished - 2018

    Research areas

  • Journal Article

ID: 51953654