Research
Print page Print page
Switch language
Rigshospitalet - a part of Copenhagen University Hospital
Published

Reliable and valid assessment of procedural skills in resuscitative endovascular balloon occlusion of the aorta (REBOA)

Research output: Contribution to journalJournal articleResearchpeer-review

  1. The Geriatric Nutritional Risk Index is a powerful predictor of adverse outcome in the elderly emergency surgery patient

    Research output: Contribution to journalJournal articleResearchpeer-review

  2. Identification of a new genetic variant associated with cholecystitis: a multicenter genome-wide association study

    Research output: Contribution to journalJournal articleResearchpeer-review

  3. Most of the variation in length of stay in emergency general surgery is not related to clinical factors of patient care

    Research output: Contribution to journalJournal articleResearchpeer-review

  1. 3D-Printed Models for Temporal Bone Surgical Training: A Systematic Review

    Research output: Contribution to journalReviewResearchpeer-review

  2. Low-dose hydrocortisone in patients with COVID-19 and severe hypoxia: the COVID STEROID randomised, placebo-controlled trial

    Research output: Contribution to journalJournal articleResearchpeer-review

  3. Central and peripheral nervous system complications of COVID-19: a prospective tertiary center cohort with 3-month follow-up

    Research output: Contribution to journalJournal articleResearchpeer-review

  4. Three-dimensional ultrasound is a reliable alternative in endovascular aortic repair surveillance

    Research output: Contribution to journalJournal articleResearchpeer-review

View graph of relations

BACKGROUND: Valid and reliable assessment of skills is essential for improved and evidence-based training concepts. In a recent study, we presented a novel tool to assess procedural skills in resuscitative endovascular balloon occlusion of the aorta (REBOA), REBOA-RATE, based on international expert consensus. Although expert consensus is a strong foundation, the performance of REBOA-RATE has not been explored. The study aimed to examine the reliability and validity of REBOA-RATE.

METHODS: This was an experimental simulation-based study. We enrolled doctors with three levels of expertise to perform two REBOA procedures in a simulated scenario of out-of-hospital cardiac arrest. Procedures were video-recorded, and videos were blinded and randomized. Three clinical experts independently rated all procedures using REBOA-RATE. Data were analyzed using Messick's framework for validity evidence, including generalizability analysis of reliability and determination of a pass/fail standard.

RESULTS: Forty-two doctors were enrolled: 16 novices, 13 anesthesiologists, and 13 endovascular experts. They all performed two procedures, yielding 84 procedures and 252 ratings. The REBOA-RATE assessment tool showed high internal consistency (Cronbach's α = 0.95) and excellent interrater reliability (intraclass correlation coefficient, 0.97). Assessment using one rater and three procedures could ensure overall reliability suitable for high-stakes testing (G-coefficient >0.80). Mean scores (SD) for the three groups in the second procedure were as follows: novices, 32% (24%); anesthesiologists, 55% (29%); endovascular experts, 93% (4%) (p < 0.001). The pass/fail standard was set at 81%, which all experts but no novices passed.

CONCLUSION: Data strongly support the reliability and validity of REBOA-RATE, which successfully discriminated between all experience levels. The REBOA-RATE assessment tool requires minimal instruction, and one rater is sufficient for reliable assessment. Together, these are strong arguments for the use of REBOA-RATE to assess REBOA skills, allowing for competency-based training and certification concepts.

LEVEL OF EVIDENCE: Diagnostic test, no or poor gold standard, level V.

Original languageEnglish
JournalThe journal of trauma and acute care surgery
Volume91
Issue number4
Pages (from-to)663-671
Number of pages9
ISSN2163-0755
DOIs
Publication statusPublished - 1 Oct 2021

ID: 66793201