Print page Print page
Switch language
The Capital Region of Denmark - a part of Copenhagen University Hospital

Ensuring Competency in Open Aortic Aneurysm Repair - Development and Validation of a New Assessment Tool

Research output: Contribution to journalJournal articleResearchpeer-review

  1. Cutdown Technique is Superior to Fascial Closure for Femoral Artery Access after Elective Endovascular Aortic Repair

    Research output: Contribution to journalJournal articleResearchpeer-review

  2. EJVES, the Leading Journal in Vascular Surgery, is One of the Numerous Scientific Pillars of the ESVS

    Research output: Contribution to journalJournal articleResearchpeer-review

  3. Supervised Trainee Led Open Vascular Surgery Procedures Should Be "Part" of Modern Training Curricula!

    Research output: Contribution to journalComment/debateResearchpeer-review

  1. Simulation of advanced cataract surgery - validation of a newly developed test

    Research output: Contribution to journalJournal articleResearchpeer-review

  2. Contrast-Enhanced Ultrasound: Development of Syllabus for Core Theoretical and Practical Competencies

    Research output: Contribution to journalJournal articleResearchpeer-review

  3. Flow Complexity Estimation in Dysfunctional Arteriovenous Dialysis Fistulas using Vector Flow Imaging

    Research output: Contribution to journalJournal articleResearchpeer-review

  • Collaborators in Denmark
View graph of relations

OBJECTIVE: The aims of this study were to develop a procedure specific assessment tool for open abdominal aortic aneurysm (AAA) repair, gather validity evidence for the tool and establish a pass/fail standard.

METHODS: Validity was studied based on the contemporary framework by Messick. Three vascular surgeons experienced in open AAA repair and an expert in assessment and validation within medical education developed the OPEn aortic aneurysm Repair Assessment of Technical Expertise (OPERATE) tool. Vascular surgeons with varying experiences performed open AAA repair in a standardised simulation based setting. All procedures were video recorded with the faces anonymised and scored independently by three experts in a mutual blinded setup. The Angoff standard setting method was used to establish a credible pass/fail score.

RESULTS: Sixteen novices and nine experienced open vascular surgeons were enrolled. The OPERATE tool achieved high internal consistency (Cronbach's alpha .92) and inter-rater reliability (Cronbach's alpha .95) and was able to differentiate novices and experienced surgeons with mean scores (higher score is better) of 13.4 ± 12 and 25.6 ± 6, respectively (p = .01). The pass/fail score was set high (27.7). One novice passed the test while six experienced surgeons failed.

CONCLUSION: Validity evidence was established for the newly developed OPERATE tool and was able to differentiate between novices and experienced surgeons providing a good argument that this tool can be used for both formative and summative assessment in a simulation based environment. The high pass/fail score emphasises the need for novices to train in a simulation based environment up to a certain level of competency before apprenticeship training in the clinical environment under the tutelage of a supervisor. Familiarisation with the simulation equipment must be ensured before performance is assessed as reflected by the low scores in the experienced group's first attempt.

Original languageEnglish
JournalEuropean journal of vascular and endovascular surgery : the official journal of the European Society for Vascular Surgery
Issue number5
Pages (from-to)767-774
Number of pages8
Publication statusPublished - May 2020

    Research areas

  • Aortic Aneurysm, Abdominal/surgery, Clinical Competence, Humans, Vascular Surgical Procedures/methods

ID: 60096819