Research
Print page Print page
Switch language
The Capital Region of Denmark - a part of Copenhagen University Hospital
Published

Assessment of competence in local anaesthetic thoracoscopy: development and validity investigation of a new assessment tool

Research output: Contribution to journalJournal articleResearchpeer-review

DOI

  1. Structured and evidence-based training of technical skills in respiratory medicine and thoracic surgery

    Research output: Contribution to journalReviewResearchpeer-review

  2. Efficacy and safety of omitting chest drains after video-assisted thoracoscopic surgery: a systematic review and meta-analysis

    Research output: Contribution to journalJournal articleResearchpeer-review

  3. Using structured progress to measure competence in flexible bronchoscopy

    Research output: Contribution to journalJournal articleResearchpeer-review

  4. EUS-B for suspected left adrenal metastasis in lung cancer

    Research output: Contribution to journalJournal articleResearchpeer-review

  5. Benefits of omitting chest drain after thoracoscopic major lung resection

    Research output: Contribution to journalJournal articleResearchpeer-review

  1. Education in the placement of ultrasound-guided peripheral venous catheters: a systematic review

    Research output: Contribution to journalReviewResearchpeer-review

  2. Quantitative fluorescence angiography detects dynamic changes in gastric perfusion

    Research output: Contribution to journalJournal articleResearchpeer-review

  3. The learning curve of robot-assisted vitreoretinal surgery - A randomized trial in a simulated setting

    Research output: Contribution to journalJournal articleResearchpeer-review

View graph of relations

Background: The aims of the study were to develop an assessment tool in local anaesthetic thoracoscopy (LAT), investigate validity evidence, and establish a pass/fail standard.

Methods: Validity evidence for the assessment tool was gathered using the unified Messick framework. The tool was developed by five experts in respiratory medicine and medical education. Doctors with varying experience performed two consecutive procedures in a standardized, simulation-based setting using a newly developed thorax/lung silicone model. Performances were video-recorded and assessed by four expert raters using the new tool. Contrasting groups' method was used to set a pass/fail standard.

Results: Nine novices and 8 experienced participants were included, generating 34 recorded performances and 136 expert assessments. The tool had a high internal consistency (Cronbach's alpha =0.94) and high inter-rater reliability (Cronbach's alpha =0.91). The total item score significantly correlated with the global score (rs=0.86, P<0.001). Participants' first performance correlated to second performance (test-retest reliability) with a Pearson's r of 0.93, P<0.001. Generalisability (G) study showed a G-coefficient of 0.92 and decision (D) study estimated that one performance assessed by two raters or four performances assessed by one rater are needed to reach an acceptable reliability, i.e., G-coefficient >0.80. The tool was able to discriminate between the two groups in both performances: experienced mean score =30.8±4.2; novice mean score =15.8±2.3, P<0.001. Pass/fail standard was set at 22 points.

Conclusions: The newly developed assessment tool showed solid evidence of validity and can be used to ensure competence in LAT.

Original languageEnglish
JournalJournal of Thoracic Disease
Volume13
Issue number7
Pages (from-to)3998-4007
Number of pages10
ISSN2072-1439
DOIs
Publication statusPublished - Jul 2021

    Research areas

  • Assessment, Pleuroscopy, Simulation training, Thoracoscopy, Training, Validation study

ID: 67245020