Back to Search
Start Over
Evaluating Resident Procedural Skills: Faculty Assess a Scoring Tool.
- Source :
-
PRiMER (Leawood, Kan.) [PRiMER] 2020 Apr 17; Vol. 4, pp. 4. Date of Electronic Publication: 2020 Apr 17 (Print Publication: 2020). - Publication Year :
- 2020
-
Abstract
- Background and Objective: Procedural skills assessment is critical in residency training. The Council of Academic Family Medicine recommends the Procedural Competency Assessment Tool (PCAT) for assessing procedure competence of family medicine residents. We sought to evaluate the reliability of the PCAT and to better identify its strengths and limitations.<br />Methods: In this mixed-methods study conducted in 2017, 18 faculty members of an academic family medicine residency program watched a video of one of the authors performing a simulated shave biopsy with intentional errors. Faculty scored the procedure using the shave biopsy PCAT, then participated in a focus group discussion of the rationale for the scores given. Qualitative analysis assessed perceived benefits and challenges of the PCAT. Following the discussion, faculty scored the same procedure again, using a PCAT modified with additional objective criteria.<br />Results: On the original PCAT, 40% of respondents rated the physician as competent. This dropped to 21.4% on the modified PCAT ( P =.035). Respondents scored competent even though procedure components were scored as novice. Score variability decreased with the checklist-based PCAT. Qualitative analysis revealed that the PCAT is subjective and interpretation of the tool varies widely.<br />Conclusions: Further studies regarding PCAT validity and reliability are needed. The PCAT may require further norming with additional objective criteria to improve reliability. Residencies may train faculty on using the PCAT to improve interobserver agreement, or decide to use a more intuitive checklist evaluation tool.<br /> (© 2020 by the Society of Teachers of Family Medicine.)
Details
- Language :
- English
- ISSN :
- 2575-7873
- Volume :
- 4
- Database :
- MEDLINE
- Journal :
- PRiMER (Leawood, Kan.)
- Publication Type :
- Academic Journal
- Accession number :
- 32537604
- Full Text :
- https://doi.org/10.22454/PRiMER.2020.462869