Construct Validity and Reliability of Structured Assessment of endoVascular Expertise in a Simulated Setting

B Bech; L Lönn; M Falkenberg; Niels Jakob Bartholdy; S B Räder; T V Schroeder; C Ringsted

doi:10.1016/j.ejvs.2011.05.003

Construct Validity and Reliability of Structured Assessment of endoVascular Expertise in a Simulated Setting

B Bech, L Lönn, M Falkenberg, Niels Jakob Bartholdy, S B Räder, T V Schroeder, C Ringsted

Department of Diagnostic Radiology

29 Citations (Scopus)

448 Downloads (Pure)

Abstract

OBJECTIVES: To study the construct validity and reliability of a novel endovascular global rating scale, Structured Assessment of endoVascular Expertise (SAVE). DESIGN: A Clinical, experimental study. MATERIALS: Twenty physicians with endovascular experiences ranging from complete novices to highly experienced operators performed a video-recorded simulated contra-lateral iliac-artery-stenting procedure. The virtual-patient case was a novel technically challenging procedure presenting the distal arteries below the knee. METHODS: Three experts assessed the performances blinded to operator identity. Validity was analysed by correlating experience with performance results. Reliability was analysed according to generalisability theory. RESULTS: The mean score on the 29 items of the SAVE scale correlated well with clinical experience (R = 0.84, P 5000 procedures) obtained maximum scores. The inter-rater reliability was high (G = 0.94 and G = 0.95). The procedure time (median 69 min, range 32-86) correlated moderately with clinical experience (R = -0.53, P

Original language	English
Journal	European Journal of Vascular and Endovascular Surgery
Volume	42
Issue number	4
Pages (from-to)	539-48
Number of pages	10
ISSN	1078-5884
DOIs	https://doi.org/10.1016/j.ejvs.2011.05.003
Publication status	Published - 15 Jun 2011

Access to Document

10.1016/j.ejvs.2011.05.003

Cite this

@article{b7b37d2864bf479298732fc39ef442ef,

title = "Construct Validity and Reliability of Structured Assessment of endoVascular Expertise in a Simulated Setting",

abstract = "OBJECTIVES: To study the construct validity and reliability of a novel endovascular global rating scale, Structured Assessment of endoVascular Expertise (SAVE). DESIGN: A Clinical, experimental study. MATERIALS: Twenty physicians with endovascular experiences ranging from complete novices to highly experienced operators performed a video-recorded simulated contra-lateral iliac-artery-stenting procedure. The virtual-patient case was a novel technically challenging procedure presenting the distal arteries below the knee. METHODS: Three experts assessed the performances blinded to operator identity. Validity was analysed by correlating experience with performance results. Reliability was analysed according to generalisability theory. RESULTS: The mean score on the 29 items of the SAVE scale correlated well with clinical experience (R = 0.84, P 5000 procedures) obtained maximum scores. The inter-rater reliability was high (G = 0.94 and G = 0.95). The procedure time (median 69 min, range 32-86) correlated moderately with clinical experience (R = -0.53, P ",

author = "B Bech and L L{\"o}nn and M Falkenberg and Bartholdy, \{Niels Jakob\} and R{\"a}der, \{S B\} and Schroeder, \{T V\} and C Ringsted",

year = "2011",

month = jun,

day = "15",

doi = "10.1016/j.ejvs.2011.05.003",

language = "English",

volume = "42",

pages = "539--48",

journal = "European Journal of Vascular and Endovascular Surgery",

issn = "1078-5884",

publisher = "W.B. Saunders Ltd",

number = "4",

}

TY - JOUR

T1 - Construct Validity and Reliability of Structured Assessment of endoVascular Expertise in a Simulated Setting

AU - Bech, B

AU - Lönn, L

AU - Falkenberg, M

AU - Bartholdy, Niels Jakob

AU - Räder, S B

AU - Schroeder, T V

AU - Ringsted, C

PY - 2011/6/15

Y1 - 2011/6/15

N2 - OBJECTIVES: To study the construct validity and reliability of a novel endovascular global rating scale, Structured Assessment of endoVascular Expertise (SAVE). DESIGN: A Clinical, experimental study. MATERIALS: Twenty physicians with endovascular experiences ranging from complete novices to highly experienced operators performed a video-recorded simulated contra-lateral iliac-artery-stenting procedure. The virtual-patient case was a novel technically challenging procedure presenting the distal arteries below the knee. METHODS: Three experts assessed the performances blinded to operator identity. Validity was analysed by correlating experience with performance results. Reliability was analysed according to generalisability theory. RESULTS: The mean score on the 29 items of the SAVE scale correlated well with clinical experience (R = 0.84, P 5000 procedures) obtained maximum scores. The inter-rater reliability was high (G = 0.94 and G = 0.95). The procedure time (median 69 min, range 32-86) correlated moderately with clinical experience (R = -0.53, P

AB - OBJECTIVES: To study the construct validity and reliability of a novel endovascular global rating scale, Structured Assessment of endoVascular Expertise (SAVE). DESIGN: A Clinical, experimental study. MATERIALS: Twenty physicians with endovascular experiences ranging from complete novices to highly experienced operators performed a video-recorded simulated contra-lateral iliac-artery-stenting procedure. The virtual-patient case was a novel technically challenging procedure presenting the distal arteries below the knee. METHODS: Three experts assessed the performances blinded to operator identity. Validity was analysed by correlating experience with performance results. Reliability was analysed according to generalisability theory. RESULTS: The mean score on the 29 items of the SAVE scale correlated well with clinical experience (R = 0.84, P 5000 procedures) obtained maximum scores. The inter-rater reliability was high (G = 0.94 and G = 0.95). The procedure time (median 69 min, range 32-86) correlated moderately with clinical experience (R = -0.53, P

UR - https://www.scopus.com/pages/publications/80052925411

U2 - 10.1016/j.ejvs.2011.05.003

DO - 10.1016/j.ejvs.2011.05.003

M3 - Journal article

C2 - 21680207

SN - 1078-5884

VL - 42

SP - 539

EP - 548

JO - European Journal of Vascular and Endovascular Surgery

JF - European Journal of Vascular and Endovascular Surgery

IS - 4

ER -

Construct Validity and Reliability of Structured Assessment of endoVascular Expertise in a Simulated Setting

Abstract

Access to Document

Other files and links

Fingerprint

Cite this