Forskning
Udskriv Udskriv
Switch language
Region Hovedstaden - en del af Københavns Universitetshospital
Udgivet

Development and Validation of an Assessment Tool for Technical Skills in Handheld Otoscopy

Publikation: Bidrag til tidsskriftTidsskriftartikelForskningpeer review

Harvard

APA

CBE

MLA

Vancouver

Author

Bibtex

@article{50536d70277943feae8b7bf5ffc2e9d5,
title = "Development and Validation of an Assessment Tool for Technical Skills in Handheld Otoscopy",
abstract = "OBJECTIVE: Handheld otoscopy requires both technical and diagnostic skills, and is often reported to be insufficient after medical training. We aimed to develop and gather validity evidence for an assessment tool for handheld otoscopy using contemporary medical educational standards.STUDY DESIGN: Educational study.SETTING: University/teaching hospital.SUBJECTS AND METHODS: A structured Delphi methodology was used to develop the assessment tool: nine key opinion leaders (otologists) in undergraduate training of otoscopy iteratively achieved consensus on the content. Next, validity evidence was gathered by the videotaped assessment of two handheld otoscopy performances of 15 medical students (novices) and 11 specialists in otorhinolaryngology using two raters. Standard setting (pass/fail criteria) was explored using the contrasting groups and Angoff methods.RESULTS: The developed Copenhagen Assessment Tool of Handheld Otoscopy Skills (CATHOS) consists 10 items rated using a 5-point Likert scale with descriptive anchors. Validity evidence was collected and structured according to Messick's framework: for example the CATHOS had excellent discriminative validity (mean difference in performance between novices and experts 20.4 out of 50 points, P < .001); and high internal consistency (Cronbach's alpha = 0.94). Finally, a pass/fail score was established at 30 points for medical students and 42 points for specialists in ORL.CONCLUSION: We have developed and gathered validity evidence for an assessment tool of technical skills of handheld otoscopy and set standards of performance. Standardized assessment allows for individualized learning to the level of proficiency and could be implemented in under- and postgraduate handheld otoscopy training curricula, and is also useful in evaluating training interventions.LEVEL OF EVIDENCE: NA.",
keywords = "evidence-based medical education, handheld otoscopy, otology, standard setting, standardized assessment",
author = "Guldager, {Mads J} and Jacob Melchiors and Andersen, {Steven Arild Wuyts}",
year = "2020",
month = jul,
doi = "10.1177/0003489420904734",
language = "English",
volume = "129",
pages = "715--721",
journal = "Annals of Otology, Rhinology and Laryngology",
issn = "0003-4894",
publisher = "Annals Publishing Co",
number = "7",

}

RIS

TY - JOUR

T1 - Development and Validation of an Assessment Tool for Technical Skills in Handheld Otoscopy

AU - Guldager, Mads J

AU - Melchiors, Jacob

AU - Andersen, Steven Arild Wuyts

PY - 2020/7

Y1 - 2020/7

N2 - OBJECTIVE: Handheld otoscopy requires both technical and diagnostic skills, and is often reported to be insufficient after medical training. We aimed to develop and gather validity evidence for an assessment tool for handheld otoscopy using contemporary medical educational standards.STUDY DESIGN: Educational study.SETTING: University/teaching hospital.SUBJECTS AND METHODS: A structured Delphi methodology was used to develop the assessment tool: nine key opinion leaders (otologists) in undergraduate training of otoscopy iteratively achieved consensus on the content. Next, validity evidence was gathered by the videotaped assessment of two handheld otoscopy performances of 15 medical students (novices) and 11 specialists in otorhinolaryngology using two raters. Standard setting (pass/fail criteria) was explored using the contrasting groups and Angoff methods.RESULTS: The developed Copenhagen Assessment Tool of Handheld Otoscopy Skills (CATHOS) consists 10 items rated using a 5-point Likert scale with descriptive anchors. Validity evidence was collected and structured according to Messick's framework: for example the CATHOS had excellent discriminative validity (mean difference in performance between novices and experts 20.4 out of 50 points, P < .001); and high internal consistency (Cronbach's alpha = 0.94). Finally, a pass/fail score was established at 30 points for medical students and 42 points for specialists in ORL.CONCLUSION: We have developed and gathered validity evidence for an assessment tool of technical skills of handheld otoscopy and set standards of performance. Standardized assessment allows for individualized learning to the level of proficiency and could be implemented in under- and postgraduate handheld otoscopy training curricula, and is also useful in evaluating training interventions.LEVEL OF EVIDENCE: NA.

AB - OBJECTIVE: Handheld otoscopy requires both technical and diagnostic skills, and is often reported to be insufficient after medical training. We aimed to develop and gather validity evidence for an assessment tool for handheld otoscopy using contemporary medical educational standards.STUDY DESIGN: Educational study.SETTING: University/teaching hospital.SUBJECTS AND METHODS: A structured Delphi methodology was used to develop the assessment tool: nine key opinion leaders (otologists) in undergraduate training of otoscopy iteratively achieved consensus on the content. Next, validity evidence was gathered by the videotaped assessment of two handheld otoscopy performances of 15 medical students (novices) and 11 specialists in otorhinolaryngology using two raters. Standard setting (pass/fail criteria) was explored using the contrasting groups and Angoff methods.RESULTS: The developed Copenhagen Assessment Tool of Handheld Otoscopy Skills (CATHOS) consists 10 items rated using a 5-point Likert scale with descriptive anchors. Validity evidence was collected and structured according to Messick's framework: for example the CATHOS had excellent discriminative validity (mean difference in performance between novices and experts 20.4 out of 50 points, P < .001); and high internal consistency (Cronbach's alpha = 0.94). Finally, a pass/fail score was established at 30 points for medical students and 42 points for specialists in ORL.CONCLUSION: We have developed and gathered validity evidence for an assessment tool of technical skills of handheld otoscopy and set standards of performance. Standardized assessment allows for individualized learning to the level of proficiency and could be implemented in under- and postgraduate handheld otoscopy training curricula, and is also useful in evaluating training interventions.LEVEL OF EVIDENCE: NA.

KW - evidence-based medical education

KW - handheld otoscopy

KW - otology

KW - standard setting

KW - standardized assessment

U2 - 10.1177/0003489420904734

DO - 10.1177/0003489420904734

M3 - Journal article

C2 - 32090596

VL - 129

SP - 715

EP - 721

JO - Annals of Otology, Rhinology and Laryngology

JF - Annals of Otology, Rhinology and Laryngology

SN - 0003-4894

IS - 7

ER -

ID: 59872336