Back to Search
Start Over
Simulation-based assessment to identify critical gaps in safe anesthesia resident performance
- Source :
- Anesthesiology. 120(1)
- Publication Year :
- 2014
-
Abstract
- Background: Valid methods are needed to identify anesthesia resident performance gaps early in training. However, many assessment tools in medicine have not been properly validated. The authors designed and tested use of a behaviorally anchored scale, as part of a multiscenario simulation-based assessment system, to identify high- and low-performing residents with regard to domains of greatest concern to expert anesthesiology faculty. Methods: An expert faculty panel derived five key behavioral domains of interest by using a Delphi process (1) Synthesizes information to formulate a clear anesthetic plan; (2) Implements a plan based on changing conditions; (3) Demonstrates effective interpersonal and communication skills with patients and staff; (4) Identifies ways to improve performance; and (5) Recognizes own limits. Seven simulation scenarios spanning pre-to-postoperative encounters were used to assess performances of 22 first-year residents and 8 fellows from two institutions. Two of 10 trained faculty raters blinded to trainee program and training level scored each performance independently by using a behaviorally anchored rating scale. Residents, fellows, facilitators, and raters completed surveys. Results: Evidence supporting the reliability and validity of the assessment scores was procured, including a high generalizability coefficient (ρ2 = 0.81) and expected performance differences between first-year resident and fellow participants. A majority of trainees, facilitators, and raters judged the assessment to be useful, realistic, and representative of critical skills required for safe practice. Conclusion: The study provides initial evidence to support the validity of a simulation-based performance assessment system for identifying critical gaps in safe anesthesia resident performance early in training.
- Subjects :
- Adult
Male
Operating Rooms
Psychometrics
Delphi method
Pilot Projects
Manikins
Patient safety
Operating Room Technicians
Anesthesiology
Medicine
media_common.cataloged_instance
Humans
Learning
Generalizability theory
Anesthesia
media_common
Medical education
Operating room technician
business.industry
Behaviorally anchored rating scales
Communication
Data Collection
Training level
Internship and Residency
Reproducibility of Results
Patient Simulation
Anesthesiology and Pain Medicine
Scale (social sciences)
Surgical Procedures, Operative
Female
Clinical Competence
Patient Safety
business
Subjects
Details
- ISSN :
- 15281175
- Volume :
- 120
- Issue :
- 1
- Database :
- OpenAIRE
- Journal :
- Anesthesiology
- Accession number :
- edsair.doi.dedup.....4256f4850562c9a2e90dcc7ea7ff2bec