Search

Background: Assessment is critical to support pediatric endoscopy training. Although trainee engagement in assessment is encouraged, the use of self-assessment and its accuracy among pediatric endoscopists is not well described. We aimed to determine the self-assessment accuracy of novice, intermediate, and experienced pediatric endoscopists., Methods: Novice (performed <50 previous colonoscopies), intermediate (50-500), and experienced (>1000) pediatric endoscopists from 3 North American academic teaching hospitals each performed a clinical colonoscopy. Endoscopists were assessed in real-time by 2 experienced endoscopists using the Gastrointestinal Endoscopy Competency Assessment Tool for Pediatric Colonoscopy (GiECATKIDS). In addition, participants self-assessed their performance using the same instrument. Self-assessment accuracy between the externally assessed and self-assessed scores was evaluated using absolute difference scores, intraclass correlation coefficients, and Bland-Altman analyses., Results: Forty-seven endoscopists participated (21 novices, 16 intermediates, and 10 experienced). Overall, there was moderate agreement of externally assessed and self-assessed GiECATKIDS total scores with an intraclass correlation coefficient of 0.72 (95% confidence interval, 0.55-0.83). The absolute difference scores among the 3 groups were significantly different (P = 0.005), with experienced endoscopists demonstrating a more accurate self-assessment compared to novices (P = 0.003). Bland-Altman plots revealed that novice endoscopists' self-assessed scores tended to be higher than their externally assessed scores, indicating they overestimated their performance., Conclusions: We found that endoscopic experience was positively associated with self-assessment accuracy among pediatric endoscopists. Novices were inaccurate in assessing their endoscopic competence and were prone to overestimation of their performances. Our findings suggest novices may benefit from targeted interventions aimed at improving their insight and self-awareness.

Background and Aims: Colonoscopy performance is typically assessed by a supervisor in the clinical setting. There are limitations of this approach, however, because it allows for rater bias and increases supervisor workload demand during the procedure. Video-based assessment of recorded procedures has been proposed as a complementary means by which to assess colonoscopy performance. This study sought to investigate the reliability, validity, and feasibility of video-based assessments of competence in performing colonoscopy compared with live assessment., Methods: Novice (<50 previous colonoscopies), intermediate (50-500), and experienced (>1000) endoscopists from 5 hospitals participated. Two views of each colonoscopy were videotaped: an endoscopic (intraluminal) view and a recording of the endoscopist's hand movements. Recorded procedures were independently assessed by 2 blinded experts using the Gastrointestinal Endoscopy Competency Assessment Tool (GiECAT), a validated procedure-specific assessment tool comprising a global rating scale (GRS) and checklist (CL). Live ratings were conducted by a non-blinded expert endoscopist. Outcomes included agreement between live and blinded video-based ratings of clinical colonoscopies, intra-rater reliability, inter-rater reliability and discriminative validity of video-based assessments, and perceived ease of assessment., Results: Forty endoscopists participated (20 novices, 10 intermediates, and 10 experienced). There was good agreement between the live and video-based ratings (total, intra-class correlation [ICC] = 0.847; GRS, ICC = 0.868; CL, ICC = 0.749). Intra-rater reliability was excellent (total, ICC = 0.99; GRS, ICC = 0.99; CL, ICC = 0.98). Inter-rater reliability between the 2 blinded video-based raters was high (total, ICC = 0.91; GRS, ICC = 0.918; CL, ICC = 0.862). GiECAT total, GRS, and CL scores differed significantly among novice, intermediate, and experienced endoscopists (P < .001). Video-based assessments were perceived as "fairly easy," although live assessments were rated as significantly easier (P < .001)., Conclusions: Video-based assessments of colonoscopy procedures using the GiECAT have strong evidence of reliability and validity. In addition, assessments using videos were feasible, although live assessments were easier., (Copyright © 2018 American Society for Gastrointestinal Endoscopy. Published by Elsevier Inc. All rights reserved.)

Background and Aims: Self-assessment is important for life-long learning and a recommended assessment method for endoscopy skills. Prior literature has not investigated self-assessment accuracy of colonoscopic competence in the clinical setting. This study aimed to determine the self-assessment accuracy of novice, intermediate, and experienced endoscopists., Methods: Novice (performed <50 previous colonoscopies), intermediate (50-500), and experienced (>1000) endoscopists from 5 hospitals each performed a clinical colonoscopy. Video recordings of procedures were independently assessed by 2 blinded expert endoscopists by using the Gastrointestinal Endoscopy Competency Assessment Tool (GiECAT). Externally assessed and self-assessed GiECAT scores were defined as the mean of the 2 video-based ratings and as participants' own assigned ratings, respectively. Self-assessment accuracy between the externally assessed and self-assessed scores was evaluated by using absolute difference scores, intraclass correlation coefficients, and the Bland-Altman analysis., Results: Twenty novice, 10 intermediate, and 10 experienced endoscopists participated. There was moderate agreement of externally assessed and self-assessed GiECAT scores, with an intraclass correlation coefficient of 0.65 (95% confidence interval, 0.44-0.80). The absolute difference scores among the 3 groups were significantly different (P = .002), with experienced endoscopists demonstrating a more accurate self-assessment ability compared with novices (P = .002). Bland-Altman plots suggest that novice and experienced endoscopists tend to overrate and underrate their clinical competence, respectively; no specific trends were associated with intermediates., Conclusion: Participants demonstrated moderate self-assessment accuracy of clinical competence. Endoscopist experience was positively associated with self-assessment accuracy; novices demonstrated lower self-assessment accuracy compared with experienced endoscopists. Moreover, novices tended to overestimate their performances. Novice endoscopists may benefit from targeted interventions to improve self-assessment accuracy., (Copyright © 2018 American Society for Gastrointestinal Endoscopy. Published by Elsevier Inc. All rights reserved.)

Background: The validity of high-stakes decisions derived from assessment results is of primary concern to candidates and certifying institutions in the health professions. In the field of orthopaedic manual physical therapy (OMPT), there is a dearth of documented validity evidence to support the certification process particularly for short-answer tests. To address this need, we examined the internal structure of the Case History Assessment Tool (CHAT); this is a new assessment rubric developed to appraise written responses to a short-answer test of clinical reasoning in post-graduate OMPT certification in Canada., Methods: Fourteen physical therapy students (novices) and 16 physical therapists (PT) with minimal and substantial OMPT training respectively completed a mock examination. Four pairs of examiners (n = 8) participated in appraising written responses using the CHAT. We conducted separate generalizability studies (G studies) for all participants and also by level of OMPT training. Internal consistency was calculated for test questions with more than 2 assessment items. Decision studies were also conducted to determine optimal application of the CHAT for OMPT certification., Results: The overall reliability of CHAT scores was found to be moderate; however, reliability estimates for the novice group suggest that the scale was incapable of accommodating for scores of novices. Internal consistency estimates indicate item redundancies for several test questions which will require further investigation., Conclusion: Future validity studies should consider discriminating the clinical reasoning competence of OMPT trainees strictly at the post-graduate level. Although rater variance was low, the large variance attributed to error sources not incorporated in our G studies warrant further investigations into other threats to validity. Future examination of examiner stringency is also warranted.

Objectives: Validated assessment tools are required to support competency-based education. We aimed to assess the reliability and validity of the Gastrointestinal Endoscopy Competency Assessment Tool for Pediatric Colonoscopy (GiECATKIDS), an instrument developed by 41 North American experts using Delphi methodology., Methods: GiECATKIDS consists of a 7-item global rating scale (GRS) and an 18-item checklist (CL). An attending physician assessed 104 colonoscopies performed at 3 North American hospitals by 56 endoscopists, including 25 novices (<50 previous procedures), 21 intermediates (50-250), and 10 advanced endoscopists (>500). Another observer rated procedures to assess interrater reliability using intraclass correlation coefficient (ICC). Test-retest reliability was measured with ICC comparing endoscopists' first and second procedure scores. Discriminative validity was examined by comparing experience level with scores. Concurrent validity was assessed by correlating scores with colonoscopy experience, cecal and terminal ileal intubation rates, and physician global assessment., Results: Interrater reliability of the GiECATKIDS was high (total: ICC = 0.88; GRS: ICC = 0.79; CL: ICC = 0.89). Test-retest reliability was excellent (total: ICC = 0.94; GRS: ICC = 0.94; CL: ICC = 0.84). GiECATKIDS total, GRS, and CL scores differed significantly among novice, intermediate, and advanced endoscopists (P < 0.001). There was a significant positive correlation (P < 0.001) between scores and number of previous colonoscopies (total: ρ = 0.91, GRS: ρ = 0.92, CL: ρ = 0.84), cecal intubation rate (total: ρ = 0.82, GRS: ρ = 0.85, CL: ρ = 0.77), ileal intubation rate (total: ρ = 0.82, GRS: ρ = 0.82, CL: ρ = 0.80), and physician global assessment (total: ρ = 0.95, GRS: ρ = 0.94, CL: ρ = 0.89)., Conclusions: The GiECATKIDS demonstrates strong reliability and validity as a measure of performance of pediatric colonoscopy that can be used to support training and assessment.

Sound application of clinical reasoning (CR) by the physical therapist is critical to achieving optimal patient outcomes. As such, it is important for institutions granting certification in orthopaedic manual physical therapy (OMPT) to ensure that the assessment of CR is sufficiently robust. At present, the dearth of validated instruments to assess CR in OMPT presents a serious challenge to certifying institutions. Moreover, the lack of documentation of the development process for instruments that measure CR pose additional challenges. The purpose of this study is to evaluate the sensibility of a newly developed instrument for assessing written responses to a test of CR in OMPT; a 'pilot' phase that examines instrument feasibility and acceptability. Using a sequential mixed-methods approach, Canadian OMPT examiners were recruited to first review and use the instrument. Participants completed a sensibility questionnaire followed by semi-structured interviews, the latter of which were used to elaborate on questionnaire responses regarding feasibility and acceptability. Eleven examiners completed the questionnaire and interviews. Questionnaire results met previously established sensibility criteria, while interview data revealed participants' (dis)comfort with exerting their own judgment and with the rating scale. Quantitative and qualitative data provided valuable insight regarding content validity and issues related to efficiency in assessing CR competence; all of which will ultimately inform further psychometric testing. While results suggest that the new instrument for assessing clinical reasoning in the Canadian certification context is sensible, future research should explore how rater judgment can be utilized effectively and the mental workload associated with appraising clinical reasoning., (Copyright © 2014 Elsevier Ltd. All rights reserved.)

Background: Rigorously developed and validated direct observational assessment tools are required to support competency-based colonoscopy training to facilitate skill acquisition, optimize learning, and ensure readiness for unsupervised practice., Objective: To examine reliability and validity evidence of the Gastrointestinal Endoscopy Competency Assessment Tool (GiECAT) for colonoscopy for use within the clinical setting., Design: Prospective, observational, multicenter validation study. Sixty-one endoscopists performing 116 colonoscopies were assessed using the GiECAT, which consists of a 7-item global rating scale (GRS) and 19-item checklist (CL). A second rater assessed procedures to determine interrater reliability by using intraclass correlation coefficients (ICCs). Endoscopists' first and second procedure scores were compared to determine test-retest reliability by using ICCs. Discriminative validity was examined by comparing novice, intermediate, and experienced endoscopists' scores. Concurrent validity was measured by correlating scores with colonoscopy experience, cecal and terminal ileal intubation rates, and physician global assessment., Setting: A total of 116 colonoscopies performed by 33 novice (<50 previous procedures), 18 intermediate (50-500 previous procedures), and 10 experienced (>1000 previous procedures) endoscopists from 6 Canadian hospitals., Main Outcome Measurements: Interrater and test-retest reliability, discriminative, and concurrent validity., Results: Interrater reliability was high (total: ICC=0.85; GRS: ICC=0.85; CL: ICC=0.81). Test-retest reliability was excellent (total: ICC=0.91; GRS: ICC=0.93; CL: ICC=0.80). Significant differences in GiECAT scores among novice, intermediate, and experienced endoscopists were noted (P<.001). There was a significant positive correlation (P<.001) between scores and number of previous colonoscopies (total: ρ=0.78, GRS: ρ=0.80, CL: Spearman's ρ=0.71); cecal intubation rate (total: ρ=0.81, GRS: Spearman's ρ=0.82, CL: Spearman's ρ=0.75); ileal intubation rate (total: Spearman's ρ=0.82, GRS: Spearman's ρ=0.82, CL: Spearman's ρ=0.77); and physician global assessment (total: Spearman's ρ=0.90, GRS: Spearman's ρ=0.94, CL: Spearman's ρ=0.77)., Limitations: Nonblinded assessments., Conclusion: This study provides evidence supporting the reliability and validity of the GiECAT for use in assessing the performance of live colonoscopies in the clinical setting., (Copyright © 2015 American Society for Gastrointestinal Endoscopy. Published by Elsevier Inc. All rights reserved.)

Objectives: Many aspects of pediatric colonoscopy differ from adult practice. To date, there is no validated measure of endoscopic competence for use in pediatrics. Using Delphi methodology, we aimed to determine expert consensus regarding items required on a checklist and global rating scale designed to assess the competence of clinicians performing colonoscopy on pediatric patients., Methods: A total of 41 North American pediatric endoscopy experts rated potential checklist and global rating items for their importance as indicators of the competence of trainees learning to perform pediatric colonoscopy. Responses were analyzed and re-sent to the panel for further ratings until consensus was reached. Items that ≥ 80% of experts rated as ≥ 4 out of 5 were included in the final instrument. Consensus items were compared with those items deemed by adult endoscopy experts as fundamental to assessing the performance of adult colonoscopy., Results: Five rounds of surveys were completed with response rates ranging from 76% to 100%. Seventy-five checklist and 38 global rating items were reduced to 18 checklist and 7 global rating items that reached consensus. Three pediatric checklist items differed from those considered to be critical adult indicators, whereas 4 items on the latter did not reach consensus among pediatric experts., Conclusions: Delphi methodology allowed for achievement of expert consensus regarding essential items to be included in the Gastrointestinal Endoscopy Competency Assessment Tool for Pediatric Colonoscopy (GiECATKIDS), a measure of endoscopic competence specific to performing pediatric colonoscopy. Key differences in the checklist items, compared with items reaching consensus during a separate adult Delphi process using the same indicators, emphasize the need for a pediatric-specific tool.

Background: Ensuring competence remains a seminal objective of endoscopy training programs, professional organizations, and accreditation bodies; however, no widely accepted measure of endoscopic competence currently exists., Objective: By using Delphi methodology, we aimed to develop and establish the content validity of the Gastrointestinal Endoscopy Competency Assessment Tool for colonoscopy., Design: An international panel of endoscopy experts rated potential checklist and global rating items for their importance as indicators of the competence of trainees learning to perform colonoscopy. After each round, responses were analyzed and sent back to the experts for further ratings until consensus was reached., Main Outcome Measurements: Consensus was defined a priori as ≥80% of experts, in a given round, scoring ≥4 of 5 on all remaining items., Results: Fifty-five experts agreed to be part of the Delphi panel: 43 gastroenterologists, 10 surgeons, and 2 endoscopy managers. Seventy-three checklist and 34 global rating items were generated through a systematic literature review and survey of committee members. An additional 2 checklist and 4 global rating items were added by Delphi panelists. Five rounds of surveys were completed before consensus was achieved, with response rates ranging from 67% to 100%. Seven global ratings and 19 checklist items reached consensus as good indicators of the competence of clinicians performing colonoscopy., Limitations: Further validation required., Conclusion: Delphi methodology allowed for the rigorous development and content validation of a new measure of endoscopic competence, reflective of practice across institutions. Although further evaluation is required, it is a promising step toward the objective assessment of competency for use in colonoscopy training, practice, and research., (Copyright © 2014 American Society for Gastrointestinal Endoscopy. Published by Mosby, Inc. All rights reserved.)

Background: Peer-coaching has been used within the education field to successfully transfer a high percentage of knowledge into practice. In recent years, within health care, it has been the subject of interest as a method of both student training and staff continuing education as well as a format for knowledge translation., Aims: To review the literature from health care training and education to determine the nature and use of peer-coaching., Method: Due to the status of the literature, a scoping review methodology was followed. From a total of 137 articles, 16 were found to fit the inclusion criteria and were further reviewed., Results: The review highlights the state of the literature concerning peer-coaching within health care and discusses key aspects of the peer-coaching relationship that are necessary for success., Conclusions: Most research is being conducted in the domains of nursing and medicine within North America. The number of studies has increased in frequency over the past 10 years. Interest in developing the potential of peer-coaching in both health care student education and continuing clinical education of health care professionals has grown. Future directions for research in this quickly developing area are included.

Introduction: Educators often simplify complex tasks by setting learning objectives that focus trainees on isolated skills rather than the holistic task. We designed 2 sets of learning objectives for intravenous catheterization using goal setting theory. We hypothesized that setting holistic goals related to technical, cognitive, and communication skills would result in superior holistic performance, whereas setting isolated goals related to technical skills would result in superior technical performance., Methods: We randomly assigned practicing health care professionals to set holistic (n = 14) or isolated (n = 15) goals. All watched an instructional video and studied a list of 9 goals specific to their group. Participants practiced independently in a hybrid simulation (standardized patient combined with an arm simulator). The first and the last practice trials were videotaped for analysis. One-week later, participants completed a transfer test in another hybrid simulation scenario. Blinded experts evaluated performance on all 3 trials using the Direct Observation of Procedural Skills tool., Results: The holistic group scored higher than the isolated group on the holistic Direct Observation of Procedural Skills score for all 3 trials [mean (SD), 45.0 (9.16) vs. 38.4 (9.17); P = 0.01]. The isolated group did not perform better than the holistic group on the technical skills score [10.3 (2.73) vs. 11.6 (3.01); P = 0.11]., Conclusions: Our results suggest that asking learners to set holistic goals did not interfere with their attaining competent holistic and technical skills during hybrid simulation training. This exploratory trial provides preliminary evidence for how to consider integrating hybrid simulation into medical curricula and for the design of learning goals in simulation-based education.

Context:   Video-based observational practice can extend simulation-based learning outside the training space. This study explores the value of collaborative feedback provided during observational practice to the acquisition of clinical skills., Methods:   Nursing students viewed a video demonstrating the proper ventrogluteal injection technique before performing a videotaped pre-test trial on a simulator. They were then assigned randomly to one of three observational practice groups: a group that observed the expert demonstration (EO group); a group that viewed the expert demonstration, self-assessed their individual pre-test and contrasted their self-assessments with expert feedback (ESO group), and a group that observed the expert demonstration, self-assessed and contrasted their assessments with those of an expert, and formed a community that engaged in peer-to-peer feedback (ESPO group). The observation of all videos, the provision of assessments and all networking occurred via an Internet-mediated network. After 2 weeks, participants returned for post-tests and transfer tests., Results:   The pre-test-post-test analyses revealed significant interactions (global rating scale: F((2,22)) =4.00 [p =0.033]; checklist: F((2,22)) =4.31 [p =0.026]), which indicated that post-test performance in the ESPO group was significantly better than pre-test performance. The transfer analyses revealed main effects for both the global rating scale (F((2,23)) =6.73; p =0.005) and validated checklist (F((2,23)) =7.04; p =0.004) measures. Participants in the ESPO group performed better on the transfer test than those in the EO group., Conclusions:   The results suggest that video-based observational practice can be effective in extending simulation-based learning, but its effectiveness is mediated by the amount of time the learner spends engaged in the practice and the type of learning activities the learner performs in the observational practice environment. We speculate that increasing collaborative interactivity supports observational learning by increasing the extent to which the educational environment can accommodate learners' specific needs., (© Blackwell Publishing Ltd 2012.)

This pilot study explored the use of tensiometry as a measure of retention of knot tying skills. Medical students learned a one-handed square knot tying technique. Their final performances were video recorded and these videos were uploaded on to a website. Students were divided into two groups: an observational learning group that had access to videos before a retention test, and a control group that did not. After a two-week retention period, all students came back and performed one more trial to test the amount of retention of the skill. Tensiometry was used to measure strengths of the knots before and after the retention period. The scores showed no significant difference between the groups (p&gt;0.308) or tests (p&gt;0.737). We interpret the results to suggest that tensiometry is not sensitive enough to detect degradation in the performance of fundamental clinical skills as they are forgotten after being taught.

This study explored the activities of trainees learning technical skills using an educational networking tool with and without expert facilitation. Medical students (participants) were video-recorded practicing suturing and knot tying techniques and the resulting videos were uploaded to an educational networking site. Participants were then divided into two groups (one group containing an expert facilitator while the other group did not) and encouraged to comment on the videos within their group. We monitored the number of logins and comments posted and all participants completed an exit survey. There were no differences between the activities the two groups (p = 0.387). We conclude that the presence of an expert within collaborative Internet environments in not necessary to promote interactivity amongst the learners.

Directed self-guidance, whereby trainees independently practice a skill-set in a structured setting, may be an effective technique for novice training. Currently, however, most evaluation methods require an expert to be present during practice. The study aim was to determine if absolute symmetry error, a clinically important measure that can be assessed by the trainee, is a feasible assessment tool for self-guided learning of suturing skill. Forty-eight undergraduate medical trainees independently practiced suturing and knot tying skills using a benchtop model. Performance on a pretest, posttest, retention test and a transfer test was assessed using (1) the validated final product analysis (FPA), (2) the surgical efficiency score (SES), a combination of the FPA and hand motion analysis and (3) absolute symmetry error, a new measure that assesses the symmetry of the final product. Absolute symmetry error, along with the other objective assessment tools, detected improvements in performance from pretest to posttest (P < 0.05). A battery of correlation analyses indicated that absolute symmetry error correlates moderately with the FPA and SES. The development of valid, reliable and feasible technical skill assessments is needed to ensure all training centers evaluate trainee performance in a standardized fashion. Measures that do not require the use of experts or computers have potential for widespread use. We suggest that absolute symmetry error is a useful approximation of novices' suturing and knot tying performance. Future research should evaluate whether absolute symmetry error can enhance learning when used as a source of feedback during self-guided practice.

Objectives: Mounting evidence suggests that trainees acquire psychomotor skills better when they are allowed self-guided access to instructional material and when they set goals that are related to performance processes rather than performance outcomes. The present study assessed whether self-guided access to instruction and the setting of process goals lead to better acquisition of clinical technical skills., Methods: To learn wound closure skills, 48 medical students were randomly assigned to one of four groups in a 2 x 2 study design. Self-guided participants were able to access the instructional video freely, whereas control participants were restricted to watching only those video segments accessed by their matched self-guided participant. Each group was further divided into two subgroups, comprising a process goal subgroup, where participants set goals focused on performance mechanisms, and an outcome goal subgroup, where participants set goals focused on performance products. Performance on pre-, post-, retention and transfer tests was assessed with hand motion measures and expert evaluations. Group differences were evaluated using one-way anovas., Results: The self-guided group with process goals showed greater skill retention than its matched control group, whereas the self-guided group with outcome goals did not. Furthermore, the groups with process goals performed better on the transfer test than the outcome goal groups. Outcome goal participants accessed the instructional video most frequently., Conclusions: Our findings advance the study of independent learning in medical education. Trainees used interactive and structured instructional materials to effectively self-guide their learning of clinical technical skills. However, a self-guided benefit was demonstrated only when trainees set process goals.

Background: The purpose of our study was to investigate the impact of distracting noise on the performance on a simulated orthopedic bone drilling skill when that noise blocks routine auditory feedback associated with the sounds of the drill., Methods: Medical students (n=11), intermediate residents (postgraduate years 3-5, n=10) and surgeons (n=8) each drilled 20 bicortical holes in a femur bone from a lamb: 10 holes without and 10 holes with the presence of distracting noise. We quantified surgical outcome in the form of plunge depth using computer-assisted objective methods., Results: Novice participants plunged more than did the intermediate trainees and surgeons (p<0.001). With the addition of distracting noise, the plunges of both intermediate residents and surgeons were affected., Conclusion: Distracting noise impairs orthopedic bone drilling performance, and the ability to use drilling sounds to guide drilling motions is part of surgical expertise.

Introduction: This study examined the validity of tensiometry as an objective method of assessing the improvements in the quality of knots and technical performance due to practice on suturing and knot-tying skills., Methods: We evaluated the quality of 1,830 knots produced by undergraduate medical students before training (pre-test), after (post-test), and after a week retention (retention-test) using tensiometry. These results were compared to expert-based assessments of products and performance., Results: Tensiometry, as well as expert-based assessments can detect changes in the quality of knots and technical performance from pre to post and retention-test ( p<0.05). However, these three methods may assess different dimensions of the same products and actions., Conclusions: The development of trainee evaluation criteria for the acquisition of surgical skills is a crucial element in surgical education. Based on our patterns of results it is hypothesized that tensiometry can serve as an economic first approximation of the quality of knots and suturing performance.

Background: The quantification of movement processes describes how a movement is generated. These process measures have been shown to be effective sources of feedback to facilitate motor learning and can thus be applied to teach fundamental technical skills in surgery. The aim of this study was to determine, through detailed analyses, whether specific process measures of hand motions and forces imposed on tissues during suturing were sensitive to (1) practice and (2) levels of surgical expertise., Methods: Six junior surgical residents (PGY-1) and 7 faculty surgeons were required to perform 20 simulated sutures on an artificial artery model, during which time the performers' hand movements were tracked by electromagnetic markers and the quantity of force they applied was measured by a force platform holding the arterial suturing models. The amount of wrist rotation and peak hand velocity produced during the suturing movement, peak and average forces applied to the tissue, the temporal difference between force and wrist rotation onsets, and the total suturing time were evaluated., Results: Surgeons showed greater wrist rotation, higher average forces, shorter force-rotation initiation times, and shorter suturing times than did junior residents. Only the amount of wrist rotation and the time elapsed between force and wrist rotation onsets improved with practice for the junior group., Conclusions: Although all 4 variables measured can be used to distinguish between expert and novice performances, only the process measures (wrist rotation and force-rotation initiation time) changed as a result of practice for the junior residents. Thus, these measures can be used to facilitate skills learning by serving as a source of detailed structured feedback to trainees.

Laparoscopic surgery requires new methods of technical competency evaluation, as well as training. The first purpose was to assess the differences in motion characteristics between the tip of the instrument and the wrist. The second purpose was to determine whether similar control strategies are used to move instruments in virtual reality and bench model environments. Surgically naive participants were required to tap a laparoscopic instrument between two targets that differed in size and separation distance. Large amplitude movements were controlled with the movements of the wrist and small amplitude with the wrist and the fingers (p<.001). Participants utilized the flexibility of the skin of the laparoscopic trainer to facilitate their movements. These results suggest that monitoring the motions of the instrument tip is a more precise indication of its motions than are motions of the wrist when movements of small amplitudes are produced. Moreover, in order to increase fidelity, VR trainers should simulate the flexibility of the real structures around the insertion of the instrument.

Training for use of personal protective equipment such as gloves, gowns and masks, often involves didactic methods with insufficient emphasis placed on physical practice. Additionally, practice is limited by the availability of space, time and experts to monitor sessions. Unfortunately, procedural skills such as these are susceptible to decay when there are lengthy intervals between acquisition and clinical use that do not include sufficient practice. Computer-based programs and simulations for practicing technical clinical skills have been explored extensively in other healthcare disciplines, but there are few examples in infection prevention and control. To address the need for alternate practice opportunities, a simple interactive computer-based simulation was developed. As an initial study, novices were trained using an established online tutorial, after which a subset of the group practiced using the simulation. At the end of practice and one week later, all trainees underwent a test where they were asked to physically demonstrate their response to a mock clinical scenario. Changes in scores between end of practice and one week retention suggest that the simulation is useful for enhancing skill retention. Further research and development is required to fully characterize the utility of the simulation for maintaining personal protective equipment skills after practice. [ABSTRACT FROM AUTHOR]

Background: Technical and communicative skills are both important features for one's perception of practitioner competence. Purpose: This research examines how trainees’ perceptions of practitioner competence change as they view health care practitioners who vary in their technical and communicative skill proficiencies. Methods: Occupational therapy students watched standardized encounters of a practitioner performing a patient transfer in combinations of low and high technical and communicative proficiency and then reported their perceptions of practitioner competence. Results: The reports indicate that technical and communicative skills have independently identifiable impacts on the perceptions of practitioner competency, but technical proficiency has a special impact on the students’ perceptions of practitioner communicative competence. Conclusions: The results are discussed with respect to the way in which students may evaluate their own competence on the basis of either technical or communicative skill. The issue of how this may lead trainees to dedicate their independent learning efforts to an incomplete set of features needed for the development of practitioner competency is raised. [ABSTRACT FROM PUBLISHER]

brydges r., carnahan h., rose d. & dubrowski a. (2010) Comparing self-guided learning and educator-guided learning formats for simulation-based clinical training. Journal of Advanced Nursing 66(8), 1832–1844. Title. Comparing self-guided learning and educator-guided learning formats for simulation-based clinical training. Aim. In this paper, we tested the over-arching hypothesis that progressive self-guided learning offers equivalent learning benefit vs. proficiency-based training while limiting the need to set proficiency standards. Background. We have shown that self-guided learning is enhanced when students learn on simulators that progressively increase in fidelity during practice. Proficiency-based training, a current gold-standard training approach, requires achievement of a criterion score before students advance to the next learning level. Methods. Baccalaureate nursing students ( n = 15/group) practised intravenous catheterization using simulators that differed in fidelity (i.e. students’ perceived realism). Data were collected in 2008. Proficiency-based students advanced from low- to mid- to high-fidelity after achieving a proficiency criterion at each level. Progressive students self-guided their progression from low- to mid- to high-fidelity. Yoked control students followed an experimenter-defined progressive practice schedule. Open-ended students moved freely between the simulators. One week after practice, blinded experts evaluated students’ skill transfer on a standardized patient simulation. Group differences were examined using analyses of variance. Results. Proficiency-based students scored highest on the high-fidelity post-test (effect size = 1·22). An interaction effect showed that the Progressive and Open-ended groups maintained their performance from post-test to transfer test, whereas the Proficiency-based and Yoked control groups experienced a significant decrease ( P < 0·05). Surprisingly, most Open-ended students (73%) chose the progressive practice schedule. Conclusion. Progressive training and proficiency-based training resulted in equivalent transfer test performance, suggesting that progressive students effectively self-guided when to transition between simulators. Students’ preference for the progressive practice schedule indicates that educators should consider this sequence for simulation-based training. [ABSTRACT FROM AUTHOR]