1. Psychometric evaluation of a direct observation of procedural skills assessment tool for ultrasound-guided regional anaesthesia
- Author
-
Michael J. Barrington, L Lin, Roman Kluger, A K Lansdown, I. Ng, Daniel M. Wong, M J Watson, Alwin Chuan, Michael D. Herrick, and Damian J. Castanelli
- Subjects
Adult ,Aged, 80 and over ,Male ,medicine.medical_specialty ,Psychometrics ,business.industry ,Intraclass correlation ,Direct observation ,Construct validity ,Regional anaesthesia ,Middle Aged ,Anesthesiology and Pain Medicine ,Procedural skill ,Anesthesia, Conduction ,Scale (social sciences) ,Physical therapy ,Humans ,Medicine ,Female ,Clinical Competence ,business ,Ultrasonography, Interventional ,Reliability (statistics) ,Aged - Abstract
Summary Assessment tools must be investigated for reliability, validity and feasibility before being implemented. In 2013, the Australian and New Zealand College of Anaesthetists introduced workplace-based assessments, including a direct observation of a procedural skills assessment tool. The objective of this study was to evaluate the psychometric properties of this assessment tool for ultrasound-guided regional anaesthesia. Six experts assessed 30 video-recorded trainee performances of ultrasound-guided regional anaesthesia. Inter-rater reliability, assessed using absolute agreement intraclass correlation coefficients, varied from 0.10 to 0.49 for the nine individual nine-point scale items, and was 0.25 for a ‘total score’ of all items. Internal consistency was measured by correlation between ‘total score’ and ‘overall performance’ scale item (r = 0.68, p
- Published
- 2014
- Full Text
- View/download PDF