Research
Print page Print page
Switch language
The Capital Region of Denmark - a part of Copenhagen University Hospital
Published

Development and validation of a multiple-choice questionnaire-based theoretical test in direct ophthalmoscopy

Research output: Contribution to journalJournal articleResearchpeer-review

Harvard

APA

CBE

MLA

Vancouver

Author

Bibtex

@article{6f8dbf33aca94d6683fe6e9aab8868f5,
title = "Development and validation of a multiple-choice questionnaire-based theoretical test in direct ophthalmoscopy",
abstract = "Purpose: Direct ophthalmoscopy can reveal systemic, neurologic and ophthalmic conditions, but is poorly mastered among young physicians. A theoretical test is needed to measure effect of educational interventions. We developed and gathered validity evidence for a multiple-choice questionnaire (MCQ)-based theoretical test in direct ophthalmoscopy. Methods: The MCQ was developed by interviewing experts. Then, validity evidence was evaluated using Messick's validity framework. Content was ensured by inviting the experts to contribute in a Delphi-like process. Response process was ensured by piloting and by streamlining all instructions. Then, the test was taken by ophthalmologists and by medical students without experience in direct ophthalmoscopy. Results were used to evaluate internal structure (item quality analysis and internal consistency), relations to other variables (correlation of test scores to experience level) and consequences (establishment of pass–fail score and the consequences of its use). Results: The first phase of the study yielded 100 MCQs. In second phase, we identified that 60 items fulfilled predefined relevance and item quality requirements. These items demonstrated very high internal consistency (Cronbach's alpha = 0.95), significantly discriminated medical students from specialists (p < 0.001, independent samples t-test) and the established pass–fail score of 50 (83{\%}) correct answers resulted in no false positives (students passing) and no false negatives (specialists failing). A Decision study identified that sampling 15 items suffice for certification. Conclusion: We developed and validated an MCQ-based theoretical test in direct ophthalmoscopy that enables an evidence-based approach to measuring, evaluating and certifying the theoretical knowledge necessary for direct ophthalmoscopy.",
keywords = "direct ophthalmoscopy, education, Messick, multiple-choice questionnaire, theoretical test",
author = "Morten J{\o}rgensen and Savran, {Mona Meral} and Christos Christakopoulos and Toke Bek and Jakob Grauslund and Toft, {Peter Bjerre} and Focke Ziemssen and Lars Konge and S{\o}rensen, {Torben Lykke} and Yousif Subhi",
note = "{\circledC} 2019 Acta Ophthalmologica Scandinavica Foundation. Published by John Wiley & Sons Ltd.",
year = "2019",
month = "2",
day = "28",
doi = "10.1111/aos.14065",
language = "English",
journal = "Acta Ophthalmologica (Online)",
issn = "1755-3768",
publisher = "Wiley-Blackwell Publishing, Inc",

}

RIS

TY - JOUR

T1 - Development and validation of a multiple-choice questionnaire-based theoretical test in direct ophthalmoscopy

AU - Jørgensen, Morten

AU - Savran, Mona Meral

AU - Christakopoulos, Christos

AU - Bek, Toke

AU - Grauslund, Jakob

AU - Toft, Peter Bjerre

AU - Ziemssen, Focke

AU - Konge, Lars

AU - Sørensen, Torben Lykke

AU - Subhi, Yousif

N1 - © 2019 Acta Ophthalmologica Scandinavica Foundation. Published by John Wiley & Sons Ltd.

PY - 2019/2/28

Y1 - 2019/2/28

N2 - Purpose: Direct ophthalmoscopy can reveal systemic, neurologic and ophthalmic conditions, but is poorly mastered among young physicians. A theoretical test is needed to measure effect of educational interventions. We developed and gathered validity evidence for a multiple-choice questionnaire (MCQ)-based theoretical test in direct ophthalmoscopy. Methods: The MCQ was developed by interviewing experts. Then, validity evidence was evaluated using Messick's validity framework. Content was ensured by inviting the experts to contribute in a Delphi-like process. Response process was ensured by piloting and by streamlining all instructions. Then, the test was taken by ophthalmologists and by medical students without experience in direct ophthalmoscopy. Results were used to evaluate internal structure (item quality analysis and internal consistency), relations to other variables (correlation of test scores to experience level) and consequences (establishment of pass–fail score and the consequences of its use). Results: The first phase of the study yielded 100 MCQs. In second phase, we identified that 60 items fulfilled predefined relevance and item quality requirements. These items demonstrated very high internal consistency (Cronbach's alpha = 0.95), significantly discriminated medical students from specialists (p < 0.001, independent samples t-test) and the established pass–fail score of 50 (83%) correct answers resulted in no false positives (students passing) and no false negatives (specialists failing). A Decision study identified that sampling 15 items suffice for certification. Conclusion: We developed and validated an MCQ-based theoretical test in direct ophthalmoscopy that enables an evidence-based approach to measuring, evaluating and certifying the theoretical knowledge necessary for direct ophthalmoscopy.

AB - Purpose: Direct ophthalmoscopy can reveal systemic, neurologic and ophthalmic conditions, but is poorly mastered among young physicians. A theoretical test is needed to measure effect of educational interventions. We developed and gathered validity evidence for a multiple-choice questionnaire (MCQ)-based theoretical test in direct ophthalmoscopy. Methods: The MCQ was developed by interviewing experts. Then, validity evidence was evaluated using Messick's validity framework. Content was ensured by inviting the experts to contribute in a Delphi-like process. Response process was ensured by piloting and by streamlining all instructions. Then, the test was taken by ophthalmologists and by medical students without experience in direct ophthalmoscopy. Results were used to evaluate internal structure (item quality analysis and internal consistency), relations to other variables (correlation of test scores to experience level) and consequences (establishment of pass–fail score and the consequences of its use). Results: The first phase of the study yielded 100 MCQs. In second phase, we identified that 60 items fulfilled predefined relevance and item quality requirements. These items demonstrated very high internal consistency (Cronbach's alpha = 0.95), significantly discriminated medical students from specialists (p < 0.001, independent samples t-test) and the established pass–fail score of 50 (83%) correct answers resulted in no false positives (students passing) and no false negatives (specialists failing). A Decision study identified that sampling 15 items suffice for certification. Conclusion: We developed and validated an MCQ-based theoretical test in direct ophthalmoscopy that enables an evidence-based approach to measuring, evaluating and certifying the theoretical knowledge necessary for direct ophthalmoscopy.

KW - direct ophthalmoscopy

KW - education

KW - Messick

KW - multiple-choice questionnaire

KW - theoretical test

UR - http://www.scopus.com/inward/record.url?scp=85062339481&partnerID=8YFLogxK

U2 - 10.1111/aos.14065

DO - 10.1111/aos.14065

M3 - Journal article

JO - Acta Ophthalmologica (Online)

JF - Acta Ophthalmologica (Online)

SN - 1755-3768

ER -

ID: 56724329