TY - JOUR
T1 - Standard Setting in Simulation-Based Training of Surgical Procedures
T2 - A Systematic Review
AU - Pietersen, Pia Iben
AU - Bjerrum, Flemming
AU - Tolsgaard, Martin Grønnebæk
AU - Konge, Lars
AU - Andersen, Steven Arild Wuyts
N1 - Copyright © 2021 Wolters Kluwer Health, Inc. All rights reserved.
PY - 2022/5/1
Y1 - 2022/5/1
N2 - OBJECTIVE: This systematic review aims to examine the use of standard-setting methods in the context of simulation-based training of surgical procedures.SUMMARY OF BACKGROUND: Simulation-based training is increasingly used in surgical education. However, it is important to determine which level of competency trainees must reach during simulation-based training before operating on patients. Therefore, pass/fail standards must be established using systematic, transparent, and valid methods.METHODS: Systematic literature search was done in 4 databases (Ovid MEDLINE, Embase, Web of Science, and Cochrane Library). Original studies investigating simulation-based assessment of surgical procedures with the application of a standard setting were included. Quality of evidence was appraised using GRADE.RESULTS: Of 24,299 studies identified by searches, 232 studies met the inclusion criteria. Publications using already established standard settings were excluded (N = 70), resulting in 162 original studies included in the final analyses. Most studies described how the standard setting was determined (N = 147, 91%) and most used the mean or median performance score of experienced surgeons (n = 65, 40%) for standard setting. We found considerable differences across most of the studies regarding study design, setup, and expert level classification. The studies were appraised as having low and moderate evidence.CONCLUSION: Surgical education is shifting toward competency-based education, and simulation-based training is increasingly used for acquiring skills and assessment. Most studies consider and describe how standard settings are established using more or less structured methods but for current and future educational programs, a critical approach is needed so that the learners receive a fair, valid, and reliable assessment.
AB - OBJECTIVE: This systematic review aims to examine the use of standard-setting methods in the context of simulation-based training of surgical procedures.SUMMARY OF BACKGROUND: Simulation-based training is increasingly used in surgical education. However, it is important to determine which level of competency trainees must reach during simulation-based training before operating on patients. Therefore, pass/fail standards must be established using systematic, transparent, and valid methods.METHODS: Systematic literature search was done in 4 databases (Ovid MEDLINE, Embase, Web of Science, and Cochrane Library). Original studies investigating simulation-based assessment of surgical procedures with the application of a standard setting were included. Quality of evidence was appraised using GRADE.RESULTS: Of 24,299 studies identified by searches, 232 studies met the inclusion criteria. Publications using already established standard settings were excluded (N = 70), resulting in 162 original studies included in the final analyses. Most studies described how the standard setting was determined (N = 147, 91%) and most used the mean or median performance score of experienced surgeons (n = 65, 40%) for standard setting. We found considerable differences across most of the studies regarding study design, setup, and expert level classification. The studies were appraised as having low and moderate evidence.CONCLUSION: Surgical education is shifting toward competency-based education, and simulation-based training is increasingly used for acquiring skills and assessment. Most studies consider and describe how standard settings are established using more or less structured methods but for current and future educational programs, a critical approach is needed so that the learners receive a fair, valid, and reliable assessment.
KW - Clinical Competence
KW - Competency-Based Education
KW - Computer Simulation
KW - Humans
KW - Simulation Training/methods
KW - assessment
KW - medical education
KW - simulation
KW - technical skills
KW - proficiency
KW - surgery
UR - http://www.scopus.com/inward/record.url?scp=85127091744&partnerID=8YFLogxK
U2 - 10.1097/SLA.0000000000005209
DO - 10.1097/SLA.0000000000005209
M3 - Review
C2 - 34520423
SN - 0003-4932
VL - 275
SP - 872
EP - 882
JO - Annals of Surgery
JF - Annals of Surgery
IS - 5
ER -