Research
Print page Print page
Switch language
Rigshospitalet - a part of Copenhagen University Hospital
Published

Virtual reality simulator metrics cannot be used to assess competence in ureteronephroscopy and stone removal - a validation study

Research output: Contribution to journalJournal articleResearchpeer-review

  1. Risk of recurrence and long-term mortality following radical cystectomy for bladder cancer

    Research output: Contribution to journalJournal articleResearchpeer-review

  2. Safety and oncological outcome following radiofrequency ablation of small renal masses in a single center

    Research output: Contribution to journalJournal articleResearchpeer-review

  3. Evaluation of boys with daytime incontinence by combined cystourethroscopy, voiding cystourethrography and urodynamics

    Research output: Contribution to journalJournal articleResearchpeer-review

  4. Prostatic cystadenoma. A case-report illustrating diagnosis and surgical management of an unusual condition

    Research output: Contribution to journalJournal articleResearchpeer-review

  5. DaPeCa-4: outcome in penile cancer patients with N3 disease due to extra nodal extension treated with surgery and chemo-irradiation

    Research output: Contribution to journalJournal articleResearchpeer-review

  1. National Implementation of Simulator Training Improves Transurethral Resection of Bladder Tumours in Patients

    Research output: Contribution to journalJournal articleResearchpeer-review

  2. Leukocyte TNFR1 and TNFR2 Expression Contributes to the Peripheral Immune Response in Cases with Ischemic Stroke

    Research output: Contribution to journalJournal articleResearchpeer-review

  3. Lymphopenia and neutropenia are associated with subsequent incident proteinuria in Danish patients with systemic lupus erythematosus

    Research output: Contribution to journalJournal articleResearchpeer-review

  4. Simulation-based training for flexible cystoscopy - A randomized trial comparing two approaches

    Research output: Contribution to journalJournal articleResearchpeer-review

  5. Direct Observation vs. Video-Based Assessment in Flexible Cystoscopy

    Research output: Contribution to journalJournal articleResearchpeer-review

View graph of relations

OBJECTIVE: The growing use of simulation-based training makes it necessary to develop efficient training programs in order to ensure optimal use of time and resources. Our aim was to develop and gather validity evidence for a simulation-based test in ureteronephroscopy and set a pass/fail standard for the test that will allow future mastery learning.

DESIGN: This study is a validation study. A test in ureteronephroscopy and stone removal on the URO Mentor™ virtual reality simulator (3D Systems, USA) was developed by two experienced urologists in order to ensure content. Participants with different experience completed three standardized tasks on the simulator and simulator-generated metrics were used as outcome parameters to minimize bias and ensure a fair response process.

RESULTS: Twenty novices, 15 intermediates, and 8 experienced urologists were included in the study. Validity evidence for internal structure and relationship to other variables was questionable with weak and mostly insignificant correlations across all four metrics (Cronbach's alpha = 0.14, p = 0.15) and across the three modules (Cronbach's alpha = 0.41 (p = 0.02), 0.35 (p = 0.06), 0.10 (p = 0.35), and 0.30 (p = 0.09) for each metric, respectively). It was not possible to establish a pass/fail score for the simulation test with meaningful consequences.

CONCLUSION: Our study showed that automatically generated simulator metrics cannot be used as a valid way of assessing competence in ureteronephroscopy. Virtual-reality simulator training could still be a valuable and patient-safe way to practice these skills, but an experienced supervisor is needed to determine when the trainee is ready to continue to supervised practice on patients.

Original languageEnglish
JournalScandinavian Journal of Urology
Volume55
Issue number5
Pages (from-to)399-403
Number of pages5
ISSN2168-1805
DOIs
Publication statusPublished - Oct 2021

    Research areas

  • Ureteroscopy, medical education, urology urolithiasis, virtual reality

ID: 66958403