1. Simulation Performance Evaluation: Inter-rater Reliability of the DARE2-Patient Safety Rubric
- Author
-
Siobhan Murphy, Sinead O'Brien, Robert Graham, Irene Hartigan, and Nuala Walshe
- Subjects
medicine.medical_specialty ,Nursing (miscellaneous) ,business.industry ,Intraclass correlation ,education ,Exploratory research ,Rubric ,Patient assessment ,Education ,Reliability engineering ,Patient safety ,Inter-rater reliability ,Modeling and Simulation ,medicine ,Medical physics ,business ,Reliability (statistics) - Abstract
Background The DARE2-patient safety rubric was developed for the performance evaluation of final year nursing students. The rubric contains four domains of competency: systematic patient assessment, clinical response, clinical-psychomotor skills, and communication proficiency. The aim of this research was to investigate the inter-rater reliability of data from the DARE2. Method A nonexperimental quantitative exploratory design was employed. Archived recorded performances of students (n = 34) were independently evaluated by nurse lecturers who teach and examine in the simulation centre (n = 4). Results Intraclass correlation coefficients (ICC) were greater than 0.70 for three of the four domains of practice and 0.58 for the fourth (clinical-psychomotor skills). An ICC of 0.75 for the overall rubric score is indicative of excellent reliability. Percentage agreement for the overall rubric was 59%. Conclusion These results support the inter-rater reliability of data from the DARE - patient safety rubric and highlights the difference between consensus and consistency estimates of inter-rater reliability.
- Published
- 2014
- Full Text
- View/download PDF