Research
Print page Print page
Switch language
The Capital Region of Denmark - a part of Copenhagen University Hospital
Published

Assessment of EVAR Competence: Validity of a Novel Rating Scale (EVARATE) in a Simulated Setting

Research output: Contribution to journalJournal articlepeer-review

Harvard

APA

CBE

MLA

Vancouver

Author

Bibtex

@article{aab6c0ef99ba41da8f3dddf399248fe1,
title = "Assessment of EVAR Competence: Validity of a Novel Rating Scale (EVARATE) in a Simulated Setting",
abstract = "OBJECTIVES: The aims of this study were to investigate the validity evidence for a novel procedure specific assessment tool of competence in endovascular aortic repair (EVAR) and to establish a pass/fail level for the assessment.METHODS: Computed tomography angiography data of a 55 mm in diameter infrarenal aortic aneurysm was implemented into an endovascular simulator. Twenty-three physicians with varying EVAR experiences were video-recorded when performing a standard EVAR procedure on the simulator. Two experienced EVAR operators assessed the participants using the novel rating scale, {"}EndoVascular Aortic Repair Assessment of Technical Expertise{"} (EVARATE). Validity was studied according to the framework endorsed by the American Educational Research Association.RESULTS: The EVARATE scale had a high internal consistency (Cronbach's alpha = .90). The inter-rater reliability was acceptable (Intraclass Correlation Coefficient = .68, p = .005). Specific EVAR experience correlated significantly with the EVARATE score (Spearman's rho = .62, p = .002), but general endovascular experience did not. Consequence analysis showed that the EVARATE assessment could distinguish novices from intermediates (p < .01) and from experts (p < .001). A pass/fail score was determined using the contrasting groups' method.CONCLUSION: This paper presents the initial validity evidence for a novel procedure specific assessment tool, EVARATE, for operator competence in endovascular aortic repair investigated in a simulated setting. The assessment tool can be used to provide structured formative feedback to trainees.",
author = "Michael Str{\o}m and Lars L{\"o}nn and Lars Konge and Schroeder, {Torben V} and Hans Lindgren and Thomas Nyheim and Maarit Venermo and Bo Bech",
note = "Copyright {\textcopyright} 2018 European Society for Vascular Surgery. Published by Elsevier B.V. All rights reserved.",
year = "2018",
month = jul,
doi = "10.1016/j.ejvs.2018.02.035",
language = "English",
volume = "56",
pages = "137--144",
journal = "European Journal of Vascular Surgery",
issn = "1078-5884",
publisher = "W.B./Saunders Co. Ltd",
number = "1",

}

RIS

TY - JOUR

T1 - Assessment of EVAR Competence

T2 - Validity of a Novel Rating Scale (EVARATE) in a Simulated Setting

AU - Strøm, Michael

AU - Lönn, Lars

AU - Konge, Lars

AU - Schroeder, Torben V

AU - Lindgren, Hans

AU - Nyheim, Thomas

AU - Venermo, Maarit

AU - Bech, Bo

N1 - Copyright © 2018 European Society for Vascular Surgery. Published by Elsevier B.V. All rights reserved.

PY - 2018/7

Y1 - 2018/7

N2 - OBJECTIVES: The aims of this study were to investigate the validity evidence for a novel procedure specific assessment tool of competence in endovascular aortic repair (EVAR) and to establish a pass/fail level for the assessment.METHODS: Computed tomography angiography data of a 55 mm in diameter infrarenal aortic aneurysm was implemented into an endovascular simulator. Twenty-three physicians with varying EVAR experiences were video-recorded when performing a standard EVAR procedure on the simulator. Two experienced EVAR operators assessed the participants using the novel rating scale, "EndoVascular Aortic Repair Assessment of Technical Expertise" (EVARATE). Validity was studied according to the framework endorsed by the American Educational Research Association.RESULTS: The EVARATE scale had a high internal consistency (Cronbach's alpha = .90). The inter-rater reliability was acceptable (Intraclass Correlation Coefficient = .68, p = .005). Specific EVAR experience correlated significantly with the EVARATE score (Spearman's rho = .62, p = .002), but general endovascular experience did not. Consequence analysis showed that the EVARATE assessment could distinguish novices from intermediates (p < .01) and from experts (p < .001). A pass/fail score was determined using the contrasting groups' method.CONCLUSION: This paper presents the initial validity evidence for a novel procedure specific assessment tool, EVARATE, for operator competence in endovascular aortic repair investigated in a simulated setting. The assessment tool can be used to provide structured formative feedback to trainees.

AB - OBJECTIVES: The aims of this study were to investigate the validity evidence for a novel procedure specific assessment tool of competence in endovascular aortic repair (EVAR) and to establish a pass/fail level for the assessment.METHODS: Computed tomography angiography data of a 55 mm in diameter infrarenal aortic aneurysm was implemented into an endovascular simulator. Twenty-three physicians with varying EVAR experiences were video-recorded when performing a standard EVAR procedure on the simulator. Two experienced EVAR operators assessed the participants using the novel rating scale, "EndoVascular Aortic Repair Assessment of Technical Expertise" (EVARATE). Validity was studied according to the framework endorsed by the American Educational Research Association.RESULTS: The EVARATE scale had a high internal consistency (Cronbach's alpha = .90). The inter-rater reliability was acceptable (Intraclass Correlation Coefficient = .68, p = .005). Specific EVAR experience correlated significantly with the EVARATE score (Spearman's rho = .62, p = .002), but general endovascular experience did not. Consequence analysis showed that the EVARATE assessment could distinguish novices from intermediates (p < .01) and from experts (p < .001). A pass/fail score was determined using the contrasting groups' method.CONCLUSION: This paper presents the initial validity evidence for a novel procedure specific assessment tool, EVARATE, for operator competence in endovascular aortic repair investigated in a simulated setting. The assessment tool can be used to provide structured formative feedback to trainees.

U2 - 10.1016/j.ejvs.2018.02.035

DO - 10.1016/j.ejvs.2018.02.035

M3 - Journal article

C2 - 29628288

VL - 56

SP - 137

EP - 144

JO - European Journal of Vascular Surgery

JF - European Journal of Vascular Surgery

SN - 1078-5884

IS - 1

ER -

ID: 55235787