Search

Purpose: In this cohort study, we used a sponge simulator to train students in second-degree perineal laceration repair. We examined whether the training course improved the students' skills, as measured with an objective structured assessment of technical skills (OSATS) and by a senior physician. We also examined the correlation between these ratings to assess the validity of OSATS application in this context. Methods: Between April and July 2022, 40 medical students took part in gynecological/obstetrics training that included a lecture about perineal trauma and the viewing of a video that demonstrated second-degree perineal laceration repair using a sponge model. They then underwent initial evaluation by a senior physician and OSATS application, yielding two independent scores. After training with the sponge model, a second evaluation was performed. The OSATS assessed practical skills (8 items) and suture results (2 items). The senior physician assigned ratings on a five-point ordinal scale ranging from 1 (excellent) to 5 (poor). Results: Training with the sponge simulator significantly increased students' OSATS (practical skills, p < 0.001; suture results, p < 0.05) and senior physician (p < 0.001) ratings. The OSATS and senior physician ratings correlated strongly (Spearman's r: first assessment, – 0.72; second assessment, – 0.74; p < 0.01). Conclusion: The sponge-based training improves students' skills for the repair of a second-degree perineal laceration. The OSATS for the sponge model might be a valid option to examine medical students in an obstetrical course. [ABSTRACT FROM AUTHOR]

Objective: To estimate and adjust for rater effects in operating room surgical skills assessment performed using a structured rating scale for nasal septoplasty. Methods: We analyzed survey responses from attending surgeons (raters) who supervised residents and fellows (trainees) performing nasal septoplasty in a prospective cohort study. We fit a structural equation model with the rubric item scores regressed on a latent component of skill and then fit a second model including the rating surgeon as a random effect to model a rater‐effects‐adjusted latent surgical skill. We validated this model against conventional measures including the level of expertise and post‐graduation year (PGY) commensurate with the trainee's performance, the actual PGY of the trainee, and whether the surgical goals were achieved. Results: Our dataset included 188 assessments by 7 raters and 41 trainees. The model with one latent construct for surgical skill and the rater as a random effect was the best. Rubric scores depended on how severe or lenient the rater was, sometimes almost as much as they depended on trainee skill. Rater‐adjusted latent skill scores increased with attending‐estimated skill levels and PGY of trainees, increased with the actual PGY, and appeared constant over different levels of achievement of surgical goals. Conclusion: Our work provides a method to obtain rater effect adjusted surgical skill assessments in the operating room using structured rating scales. Our method allows for the creation of standardized (i.e., rater‐effects‐adjusted) quantitative surgical skill benchmarks using national‐level databases on trainee assessments. Level of Evidence: N/A Laryngoscope, 134:3548–3554, 2024 [ABSTRACT FROM AUTHOR]

The drive to improve surgical proficiency through advanced simulation-based training has gained momentum. This meta-analysis systematically evaluated evidence regarding the impact of plastic surgery-related simulation on the performance of residents. A systematic search of PubMed, Web of Science, and Cochrane Library and review of articles was performed following the Preferred Reporting Items for Systematic Reviews and Meta-Analysis protocol. An inverse-variance random-effects model was used to combine study estimates to account for between-study variability. Objective structured assessment of technical skills (OSATS) scores and subjective confidence scores were used to assess the impact of the simulation with positive changes from the baseline indicating better outcomes. Eighteen studies pooling 367 trainees who participated in various simulations were included. Completion of simulation training was associated with significant improvement in subjective confidence scores with a mean increase of 1.44 units (95% CI: 0.93 to 1.94, P < 0.001), and in OSATS scores, with a mean increase of 1.24 units (95% CI: 0.87 to 1.62, P < 0.001), both on a 1–5 scale. Participants reported high satisfaction scores (mean = 4.76 units, 95% CI = 4.61 to 4.91, P = 0.006), also on a 1–5 scale. Participation in surgical simulation markedly improved objective and subjective scoring metrics for surgical trainees. Several simulation devices are available for honing surgical skills, with the potential for advancements. The evidence demonstrates the effectiveness of simulations; thus, incorporating simulation into training curricula should be a priority in the field of plastic surgery. [ABSTRACT FROM AUTHOR]

Abstract Introduction Updating the method for evaluating suturing and scaling skills in dental education has attracted relatively little attention and there is no consensus to what should be assessed and how. The purpose of this study was to investigate the applicability of the Objective Structured Assessment of Technical Skill (OSATS) method for these two basic skills, the possible association between the scores and demographic factors, and the level of satisfaction of residents with this method. Methods All six periodontics and three oral medicine residents were recruited by census method and video-recorded while performing a simple interrupted suture, a figure eight suture and scaling on a model. Then, the videos were evaluated independently via a checklist and a global rating scale (GRS) by two expert raters. Agreement between raters and residents’ satisfaction were evaluated. Correlation between demographic factors of participants and scores was also assessed. T-test and linear regression analysis were used. Results There was no significant difference between the scores based on the views of the two raters for each of the checklist (ICC = 0.99, CI = 0.96–0.99, P

Background: Indocyanine green (ICG) fluorescence imaging is effective in increasing the number of lymph node dissections during laparoscopic radical gastrectomy; however, no studies have attempted to explain this phenomenon. Methods: This study utilized the data from a previous randomized controlled trial (FUGES-012 study) investigating ICG-guided laparoscopic radical gastrectomy performed between November 2018 and July 2019. The Objective Structured Assessments of Technical Skills (OSATS) scoring system was used to grade videos from the ICG and non-ICG groups. Patients with an OSATS score greater than 29 were classified as the high-OSATS population, while those with an OSATS score less than or equal to 29 were classified as the low-OSATS population. Results: A total of 258 patients were included in the modified intention-to-treat analysis: 129 in the ICG group and 129 in the non-ICG group. The OSATS score of the ICG group was higher than that of the non-ICG group (29.6 ± 2.6 vs. 26.6 ± 3.6; P< 0.001). The ICG group underwent a significantly higher mean total number of lymph node dissections than the non-ICG group (50.5 ± 15.9 vs. 42.0 ± 10.3; adjusted P<0.001). The group assigned to ICG use, better OSATS (high-OSATS) scores were observed, which correlated with greater D2 lymph node retrieval (54.1 ± 15.0 vs. 47.2 ± 8.7; adjusted P =0.039). Finally, the ICG group had a lower rate of lymph node noncompliance than that of the non-ICG group (31.8 vs. 57.4%; P <0.001). Conclusions: By applying the ICG fluorescence navigation technique, better OSATS scores were observed, which correlated with greater lymph node retrieval and a lower lymph node noncompliance rate, as recommended for individualized laparoscopic radical gastrectomy. [ABSTRACT FROM AUTHOR]

• The OSATS scale is a benchmark in the scientific literature for assessing skills in the operating theatre. • It is a generic scale applicable to all types of surgery. • Its French translation was validated, with good inter-assessor reproducibility. • This scale can be incorporated into the assessment of surgical interns in French-speaking countries. The OSATS rating scale is one of the tools most widely used in the scientific literature for assessing technical surgical skill. The aim of this study was to translate this scale into French (OSATS-FR) and validate it. OSATS was translated into French by two independent translators. The two translations were pooled and back-translated by a third translator into English to produce a consensus version (OSATS-FR). Three independent assessors then used it to assess surgical skill in tracheostomy videos. The reproducibility of the scoring was measured. The OSATS-FR version was easily understood and used by all three assessors. In all, 18 procedures were assessed, performed by 14 interns and 4 senior surgeons. The mean OSATS-FR score was 18.6 ± 4.08 for the interns and 31.6 ± 1.62 for the seniors (p < 0.0001). The Pearson correlation coefficient was 0.937 CI95% [0.867–1.269] between assessors 1 and 2, 0.977 CI95% [0.899–1.149] between assessors 1 and 3, and 0.965 CI95% [0.876–1.196] between assessors 2 and 3. Cronbach's alpha was greater than 0.9 for each assessor. OSATS-FR can distinguish between two groups with different surgical expertise and assess surgical skill with an inter-assessor reproducibility and internal consistency comparable to those of the English version. [ABSTRACT FROM AUTHOR]

Introduction: Updating the method for evaluating suturing and scaling skills in dental education has attracted relatively little attention and there is no consensus to what should be assessed and how. The purpose of this study was to investigate the applicability of the Objective Structured Assessment of Technical Skill (OSATS) method for these two basic skills, the possible association between the scores and demographic factors, and the level of satisfaction of residents with this method. Methods: All six periodontics and three oral medicine residents were recruited by census method and video-recorded while performing a simple interrupted suture, a figure eight suture and scaling on a model. Then, the videos were evaluated independently via a checklist and a global rating scale (GRS) by two expert raters. Agreement between raters and residents' satisfaction were evaluated. Correlation between demographic factors of participants and scores was also assessed. T-test and linear regression analysis were used. Results: There was no significant difference between the scores based on the views of the two raters for each of the checklist (ICC = 0.99, CI = 0.96–0.99, P < 0.001) and GRS (ICC = 0.97, CI = 0.86–0.99, P < 0.001). Linear regression showed no correlation between gender and scores but periodontics major and higher year of education showed correlation with higher scores. Conclusion: Considering the excellent agreement between raters in using both the checklist and GRS components of OSATS, and satisfaction of 88% the residents with this method, it seems to be able to provide a reliable assessment. [ABSTRACT FROM AUTHOR]

Objective: To assess the learning curve of pancreaticojejunostomy during robotic pancreatoduodenectomy (RPD) and to predict the risk of postoperative pancreatic fistula (POPF) by using the objective structured assessment of technical skills (OSATS), taking the fistula risk into account. Background: RPD is a challenging procedure that requires extensive training and confirmation of adequate surgical performance. Video grading, modified for RPD, of the pancreatic anastomosis could assess the learning curve of RPD and predict the risk of POPF. Methods: Post hoc assessment of patients prospectively included in 4 Dutch centers in a nationwide LAELAPS-3 training program for RPD. Video grading of the pancreaticojejunostomy was performed by 2 graders using OSATS (attainable score: 12--60). The main outcomes were the combined OSATS of the 2 graders and POPF (grade B/C). Cumulative sum analyzed a turning point in the learning curve for surgical skill. Logistic regression determined the cutoff for OSATS. Patients were categorized for POPF risk (ie, low, intermediate, and high) based on the updated alternative fistula risk scores. Results: Videos from 153 pancreatic anastomoses were included. Median OSATS score was 48 (interquartile range: 41--52) points and with a turning point at 33 procedures. POPF occurred in 39 patients (25.5%). An OSATS score below 49, present in 77 patients (50.3%), was associated with an increased risk of POPF (odds ratio: 4.01, P=0.004). The POPF rate was 43.6% with OSATS < 49 versus 15.8% with OSATS ≥ 49. The updated alternative fistula risk scores category "soft pancreatic texture" was the second strongest prognostic factor of POPF (odds ratio: 3.37, P= 0.040). Median cumulative surgical experience was 17 years (interquartile range: 8--21). Conclusions: Video grading of the pancreatic anastomosis in RPD using OSATS identified a learning curve and a reduced risk of POPF in case of better surgical performance. Video grading may provide a valid method to surgical training, quality control, and improvement. [ABSTRACT FROM AUTHOR]

Purpose Regular practice, quality clinical exposure, and academic discussion are essential in any surgical specialty training. This study discusses and validates the option of using a fresh “chicken quarter” model with a measurable scoring system, as a standard training regimen in microvascular surgery. This can be a very effective, economical, and easily accessible model for residents. Materials and Methods This study was conducted in the Department of Plastic surgery, from October 2020 to May 2021. Twenty-four fresh “chicken quarter” specimens were dissected and the ischial arteries and femoral veins' external diameter (ED) were measured. The microsurgical skills of the trainee were assessed in 6 months intervals using the Objective Structured Assessment of Technical Skills Scale (OSATS) as well as the time taken for anastomosis. All the data were analyzed using SPSS (statistical package for social sciences) version 21. Results A task-specific score value of 50% on October 2020 improved to 85.7% by May 2021. This was found to be statistically significant (p = 0.043). The mean ED of the ischial artery and femoral vein was 2.07 and 2.26 mm, respectively. The mean width of the vein measured at the lower one-third of the tibia was 2.08 mm. A greater than 50% reduction in anastomosis time was observed after a period of 6 months. Conclusion In our minimal experience, the “chicken quarter model” with OSATS scoring system seems to be effective, economical, very affordable, and easily accessible microsurgery training model for the residents. Our study is done only as a pilot project due to limited resources and we have the plan to introduce it as a proper training method in the near future with more residents.

Background: Microlaryngoscopy is a basic technical skill in Oto‐HNS. It is essential for residency programs to have a competency‐based assessment tool to evaluate residents' performance of this procedure. An Objective Structured Assessment of Technical Skills (OSATS) is a procedure‐specific assessment, which consists of the following: (a) Operation‐Specific Checklist and (b) Global Rating Scale (GRS). Objective: The objective of this study was to create an OSATS for adult microlaryngoscopy. Methods: This was a prospective study, with an initial qualitative phase for OSATS development (Phase I), and a clinical pilot phase (Phase II). In Phase I, interviews were conducted with three laryngologists to establish a stepwise description of adult microlaryngoscopy and review a previously validated GRS for relevance to microlaryngoscopy. Responses were used to create a framework for the OSATS. The OSATS was then presented to Oto‐HNS residents and laryngologists in an alternating fashion, for review of clarity and relevance. A pilot study was then performed to evaluate the resident performance of adult microlaryngoscopy. Multiple regression analysis was carried out to investigate whether training level, case complexity, and previous OSATS exposure could predict participant scores. Results: Phase I of this study led to the creation of a 34‐item OSATS. The pilot study (N = 28 procedures) revealed that training level was significantly correlated with increased OSATS scores. There was no statistically significant correlation between case complexity and resident scores. Assessors reported the perceived utility of the OSATS and intent for use in residency training. Conclusion: Application of the proposed OSATS will allow for competency‐based assessment of the resident performance of microlaryngoscopy. Level of Evidence: NA Laryngoscope, 133:2719–2724, 2023 [ABSTRACT FROM AUTHOR]

Aim: To develop an Objective Structured Assessment of Technical Skills (OSATS) tool for partial pulpotomy and to preliminary assess the validity of this tool. Secondary objectives were to check internal consistency as well as the interrater reliability of this specific checklist and to compare it with the previously validated global rating score (GRS). Methodology: The study assessed three groups of dental participants (mix of practitioners or students) possessing differing levels of clinical experience (7 novices, 7 intermediates, 7 experts), during a partial pulpotomy procedure on a simulated tooth with deep caries, using a bespoke procedure‐specific checklist (PSC) and the GRS. Two independent examiners received the study participants in groups of two, in order to be able to directly observe their actions and grade the different steps of the procedure from 1 to 5 on the PSC and GRS. The internal validity of the specific checklist was assessed using a Cronbach's alpha test. As the construct validity of such a tool can be determined when the tool differentiates performance based on the level of experience, the total score of the PSC of the three groups (e.g., novice group, intermediate group, experienced group) were compared using the Kruskal–Wallis and post‐hoc Mann–Whitney pairwise U test. The total scores of the GRS were also analysed in the same manner. A correlation test (Correlation Matrices Test) was carried out for the entire sample between the specific checklist and the GRS (on total score). The intraclass correlation coefficient was used to measure the degree of agreement between the two evaluators. The statistical analysis was performed with XLSTAT® and Statistica® (significance p =.05). Results: The partial pulpotomy specific checklist graded from one to five demonstrated good internal consistency (0.86) and a good interrater reliability (0.91), a correct construct validity (p generally <.05) and a good positive correlation with the validated GRS (r =.92). Conclusions: To address the need to develop education in vital pulp treatment, and more specifically the technical skills assessment of partial pulpotomy, an OSATS‐specific checklist was developed and preliminary validated. The checklist will need to be validated in larger cohorts. [ABSTRACT FROM AUTHOR]

Objective: The acquisition of surgical skills requires motor learning. A special form of this is intermanual transfer by transferring motor skills from the nondominant hand (NDH) to the dominant hand (DH). The purpose of this study was to determine the learning gains that can be achieved for the DH by training with the DH, the NDH, and by non-surgical alternative training (AT). Methods: 124 preclinical (n=62) and clinical (n=62) dental students completed surgical knot tying and suturing technique training with the DH, with the NDH, and an AT in a controlled randomized trial. Results: A statistically significant learning gain in knot tying and suture technique with the DH was evident only after training with the DH when compared to training with the NDH (p<0.001 and p=0.004, respectively) and an AT (p=0.001 and p=0.010, respectively). Of those students who achieved a learning gain ≥4 OSATS points, 46.4% (n=32) benefited in their knot tying technique with the DH from training with the DH, 29.0% (n=20) from training with the NDH, and 24.6% (n=17) from an AT while 45.7% (n=32) benefited in their suturing technique with the DH from training with the DH, 31.4% (n=22) from training with the NDH, and 22, 9% (n=16) from an AT. Conclusions: Training with the DH enabled significantly better learning gains in the surgical knot tying and suturing techniques with the DH. [ABSTRACT FROM AUTHOR]

Purpose Regular practice, quality clinical exposure, and academic discussion are essential in any surgical specialty training. This study discusses and validates the option of using a fresh "chicken quarter" model with a measurable scoring system, as a standard training regimen in microvascular surgery. This can be a very effective, economical, and easily accessible model for residents. Materials and Methods This study was conducted in the Department of Plastic surgery, from October 2020 to May 2021. Twenty-four fresh "chicken quarter" specimens were dissected and the ischial arteries and femoral veins' external diameter (ED) were measured. The microsurgical skills of the trainee were assessed in 6 months intervals using the Objective Structured Assessment of Technical Skills Scale (OSATS) as well as the time taken for anastomosis. All the data were analyzed using SPSS (statistical package for social sciences) version 21. Results A task-specific score value of 50% on October 2020 improved to 85.7% by May 2021. This was found to be statistically significant (p = 0.043). The mean ED of the ischial artery and femoral vein was 2.07 and 2.26 mm, respectively. The mean width of the vein measured at the lower one-third of the tibia was 2.08 mm. A greater than 50% reduction in anastomosis time was observed after a period of 6 months. Conclusion In our minimal experience, the "chicken quarter model" with OSATS scoring system seems to be effective, economical, very affordable, and easily accessible microsurgery training model for the residents. Our study is done only as a pilot project due to limited resources and we have the plan to introduce it as a proper training method in the near future with more residents. [ABSTRACT FROM AUTHOR]

Introduction: The results of surgical techniques vary depending on the level of the surgeon's experience. The level of expertise can be evaluated quantitatively or qualitatively. In this study, we evaluated the duration of the procedure and the size of the incision of minimally invasive fixation of distal radius fractures as a means of grading expertise and surgical performance. The null hypothesis of our study was that the level of expertise did not match the level of performance. Material and methods: The study included 52 surgeons split in five levels of expertise who had performed 467 minimally invasive fixations of distal radius fractures. The performance of the surgeons in terms of duration of the procedure and size of the incision were scored according to the five levels of surgical experience using four different methodologies: clinical (setting limits compared to data found in literature), statistical (setting statistical limits of comparison in percentiles (20th, 40th, 60th, 80th) for each of the two parameters measured), arithmetical (setting limits compared to equal intervals for each of the 2 variables), and success rate (setting a threshold for each of the 2 variables). Results: Our results showed a great disparity between levels of experience depending on the method used. The scores for levels 1 and 2 were 72% for expertise, 13% for performance according to the clinical method, 75% for the statistical method, 0% for the arithmetical method, and 57% according the success rate. The rate of level 3 was 23% for expertise, 41% for performance by the clinical method, 17% by the statistical method, 17% by the arithmetical method, and 15% by the success rate. The rates of levels 4 and 5 were 5% for expertise, 46% for performance clinical method, 8% by the statistical method, 83% by the arithmetical method, and 28% by the success rate. Discussion: The null hypothesis of our study was confirmed by the results which show that there was no correlation between levels of expertise and performance. The clinical method of assessment appears to reflect best the true level of performance of the surgeon. Conclusion: Publications reporting the results of a surgical technique for a given pathology should always mention the level of performance as measured on a clinical scale. [ABSTRACT FROM AUTHOR]

Background: Surgical teaching is most often carried out in the operating theatre through mentorship, and the performance of surgical procedures is rarely measured. The objective of this article is to compare the progression in learning curves of junior surgeons trained in the anterior plating technique for the distal radius on a nonbiological model according to three different methods. Methods: The materials comprised 12 junior surgeons of level 1 or 2 (as per Tang and Giddins) divided into three groups: control (G1), naive practice (G2), and deliberate practice (G3). The three groups watched a demonstration video of a level 5 expert. The four G1 surgeons (two level 1 and two level 2) saw the video only once, and each inserted five plates. The four G2 surgeons (two level 1 and two level 2) inserted five plates and watched the video before each time. The four G3 surgeons (two level 1 and two level 2) saw the video before the first plate insertion. Before posing the subsequent four plates, the four G3 surgeons watched their own video, and the expert indicated their errors and how to avoid them next time. A 12-criteria OSATS defined on the basis of the 60 videos, each graded from one (min.) to five (max.), was used to measure the objective surgical performance per plating (min. 12; max. 60) and per series of five plate fixations (min. 60, max. 300). Results: The total average objective performance of G1 was 44.73, of G2 was 50.57 and of G3 was 54.35. Change in objective performance was better for G3 (13.25) than G2 (5) or G1 (3.75). For all groups, the progression in objective performance was better amongst level 1 surgeons (9) than level 2 surgeons (5.6). Conclusion: Surgical teaching is based on mentorship and experience. However, since "see one, practice many, do one" has started to replace "see one, do one, teach one", learning techniques have increasingly relied on procedure simulators. Against this background, few studies have looked at measuring the performance of surgical procedures and improved learning curves. Our results appear to suggest that deliberate practice, when used in addition to mentorship, is the best option for shortening the growth phase of the learning curve and improving performance. Deliberate practice is a learning technique for surgical procedures that is complementary to mentorship and experience, which allows the growth phase of the learning curve to be shortened and the objective performance of junior surgeons to be improved. [ABSTRACT FROM AUTHOR]

Background: We sought to evaluate our distributed practice program developed for training for beating heart anastomosis by employing a novel beating heart simulator. Methods: Eleven trainees watched and reviewed instructional video recordings of coronary anastomosis methods with a BEAT + YOUCAN training device, then performed coronary anastomosis procedures under a beating condition. Next, they participated in a four-hour training program developed by faculty surgeons. Ten different anastomosis components were assessed on a five-point rating scale (5, good; 3, average; 1, poor). After finishing the training program, each trainee again performed a coronary anastomosis procedure. Component scores were then compared before and after the training program. Results: The mean time to completion of the procedure improved from 1033 ± 424 to 795 ± 201 s (p < 0.05). Assessment scores improved from 1.88 ± 0.41 to 2.57 ± 0.30 (p < 0.05). Improvements in some technical components related to handling of instruments were noted (p < 0.05), whereas no significant improvement was seen with arteriotomy, graft orientation, suture management, or knot tying after finishing the training program. Conclusion: Trainees who participated in our four-hour focused training program for coronary anastomosis with a novel beating heart simulator showed improved ability under the beating condition in regard to technical skills related to handling instruments. [ABSTRACT FROM AUTHOR]

Introduction: The aim of this study was to develop a reliable objective structured assessment of technical skills (OSATS) score for linear-stapled, hand-sewn closure of enterotomy intestinal anastomoses (A-OSATS).Materials and Methods: The Delphi methodology was used to create a traditional and weighted A-OSATS score highlighting the more important steps for patient outcomes according to an international expert consensus. Minimally invasive novices, intermediates, and experts were asked to perform a minimally invasive linear-stapled intestinal anastomosis with hand-sewn closure of the enterotomy in a live animal model either laparoscopically or robot-assisted. Video recordings were scored by two blinded raters assessing intrarater and interrater reliability and discriminative abilities between novices (n = 8), intermediates (n = 24), and experts (n = 8).Results: The Delphi process included 18 international experts and was successfully completed after 4 rounds. A total of 4 relevant main steps as well as 15 substeps were identified and a definition of each substep was provided. A maximum of 75 points could be reached in the unweighted A-OSATS score and 170 points in the weighted A-OSATS score respectively. A total of 41 anastomoses were evaluated. Excellent intrarater (r = 0.807-0.988, p < 0.001) and interrater (intraclass correlation coefficient = 0.923-0.924, p < 0.001) reliability was demonstrated. Both versions of the A-OSATS correlated well with the general OSATS and discriminated between novices, intermediates, and experts defined by their OSATS global rating scale.Conclusion: With the weighted and unweighted A-OSATS score, we propose a new reliable standard to assess the creation of minimally invasive linear-stapled, hand-sewn anastomoses based on an international expert consensus. Validity evidence in live animal models is provided in this study. Future research should focus on assessing whether the weighted A-OSATS exceeds the predictive capabilities of patient outcomes of the unweighted A-OSATS and provide further validity evidence on using the score on different anastomotic techniques in humans. [ABSTRACT FROM AUTHOR]

Background: Robotic surgery may improve surgical performance during minimally invasive pancreatoduodenectomy as compared to 3D- and 2D-laparoscopy but comparative studies are lacking. This study assessed the impact of robotic surgery versus 3D- and 2D-laparoscopy on surgical performance and operative time using a standardized biotissue model for pancreatico- and hepatico-jejunostomy using pooled data from two randomized controlled crossover trials (RCTs). Methods: Pooled analysis of data from two RCTs with 60 participants (36 surgeons, 24 residents) from 11 countries (December 2017–July 2019) was conducted. Each included participant completed two pancreatico- and two hepatico-jejunostomies in biotissue using 3D-robotic surgery, 3D-laparoscopy, or 2D-laparoscopy. Primary outcomes were the objective structured assessment of technical skills (OSATS: 12–60) rating, scored by observers blinded for 3D/2D and the operative time required to complete both anastomoses. Sensitivity analysis excluded participants with excess experience compared to others. Results: A total of 220 anastomoses were completed (robotic 80, 3D-laparoscopy 70, 2D-laparoscopy 70). Participants in the robotic group had less surgical experience [median 1 (0–2) versus 6 years (4–12), p < 0.001], as compared to the laparoscopic group. Robotic surgery resulted in higher OSATS ratings (50, 43, 39 points, p =.021 and p <.001) and shorter operative time (56.5, 65.0, 81.5 min, p =.055 and p <.001), as compared to 3D- and 2D-laparoscopy, respectively, which remained in the sensitivity analysis. Conclusion: In a pooled analysis of two RCTs in a biotissue model, robotic surgery resulted in better surgical performance scores and shorter operative time for biotissue pancreatic and biliary anastomoses, as compared to 3D- and 2D-laparoscopy. [ABSTRACT FROM AUTHOR]

We investigated whether surgical skill and procedure were related to oncological outcomes in cervical cancer patients who underwent Laparoscopic Radical Hysterectomy (LRH). We previously assessed data of LRH from 251 patients with FIGO stage (2009) IA2, IB1and IIA1 cervical cancer collected for JGOG 1081s study. 1) The JGOG 1081s cohort study was re-examined to refine the surgical details and extend the follow-up period as chart review. 2) Unedited videos for recurrent cases and matched non-recurrent control cases were newly compared by experts for various surgical skills and surgical procedures using the modified Objective Structured Assessment of Technical Skills (OSATS) tool, without awareness of the recurrence status as video review. After a median follow-up of 46 months, tumors had recurred in 31 of the 251 patients. The five-year Recurrence-Free Survival rate was 86.9% (81.8–90.6) and five-year Overall Survival rate was 93.7% (87.5–96.8). Multivariate analysis from chart reviews found that an experience with LRH of less than 20 cases per institution was an independent prognostic factor for recurrence (Hazard Ratio (HR) 2.49, 95%CI 1.12–5.53, p = 0.025). For the surgical video review, we compared 23 videos of recurrent cases with 23 background-matched non-recurrent controls. Lower modified OSATS scores from the video review were consistently trended to have a higher risk of recurrence. Our new study has found that LRH surgical experience and skill trended to have better oncological outcomes. • From a chart review, the institution's experience level was a positive prognostic factor. • From expert video reviews, reduced surgical skill consistently trended with an increased risk of disease recurrence. [ABSTRACT FROM AUTHOR]

Background: Simulation has an increasing role in surgical training; however, using validated tools such as the Objective Structured Assessment of Technical Skills (OSATS) is time-consuming, which may be a potential barrier to simulation-based training. This study tests the hypothesis that assessors with technical expertise are necessary to objectively score a technical task. Methods: Three tasks, ring transfer, needle pass, and atresia cut, were performed using a synthetic thoracoscopic simulator for esophageal atresia/tracheoesophageal fistula. Three pediatric surgeons, 6 novice adults, and 3 children aged 9-13 years scored each attempt using the overall global OSATS rating from 1 to 5 (1 "repeated or awkward movements" to 5 "fluid movement. No awkwardness"). Results: For the ring transfer, all assessors scored novice participants significantly less than expert and intermediate scores (surgeon P = .0004, nonsurgeon adults P = .0009 and children P = .0003). For the needle pass, all assessors gave significantly different scores between novices and experts (surgeon P = .0007, nonsurgeon adult P = .0008, and children P = .0040). For the atresia cut, surgeon assessors gave significantly higher scores for experts and intermediate and novice (P = .0004). Nonsurgeon assessors gave experts and intermediates significantly higher scores than novices (P = .0001). Surgeon assessors achieved good reliability for ring transfer (0.8252) and needle pass (0.7769) compared with nonsurgeon assessors who showed poor reliability for the ring transfer (0.3959) and moderate for the needle pass (0.6551). Conclusions: Expertise in performing these procedures is not a prerequisite for an assessor to evaluate the technical skill, hence assessors of skill acquisition can be nonexpert, a nonsurgeon, or even a child. The variability in all groups suggests that reliability overall is increased with multiple assessors. Although nonsurgeon assessors may be appropriate for formative assessments, they lack the reliability to provide assessment of competence for high stakes complex tasks. Summative assessment will likely require at least 1 surgeon/expert assessor to provide reliability. [ABSTRACT FROM AUTHOR]

Background: Companionship and simple experience or naive practice (NP) rarely lead to expert level surgery, in contrast to deliberate practice (DP) where an expert analyzes the learner's errors and sets goals to improve performance. The main hypothesis was that using DP for learning would result in faster and/or greater progress than using NP., Objectives: The objective of this work was to compare the evolution of the learning curve for clavicle locking plate placement on a sawbone model of a clavicle fracture, by surgical trainees learning via two different methods; NP and DP., Patients and Methods: Ten surgical residents, divided into 2 groups of 5, each placed 6 plates. The 6 trials were filmed. The NP group saw an expert video before each placement. The DP group saw this video once and then received personalized advice from the expert for improvement, by analyzing their own video after each subsequent trial. Objective performance (OP) was measured by a standardized evaluation grid (OSATS, with a score ranging from 10 to 50 points per trial), self-evaluation of performance by a numerical scale (from 0 to 10) and stress by an analgesia-nociception index (ANI, calculated by heart rate recording, from 0 to 100)., Results: The mean OP at the last trial of clavicle plate placement was 41.8 (NP group) and 48.2 (DP group), with a mean progression from the first to last trials of 0.8 in the NP group, and 5.1 in the DP group. The mean progression in self-evaluation between the first and last trials was 3.4 (NP group) and 4.6 (DP group). The mean progression of the ANI between the first and last trials was -4.5 (NP group) and +5 (DP group)., Discussion: The results of learning a clavicle plate osteosynthesis technique measured by OSATS were better with deliberate practice than with naive practice. The progression in self-evaluated performance was better with deliberate practice, but with a higher stress level., Conclusion: Deliberate practice is a technique for learning the surgical procedure which complements companionship and experience. It shortens the learning curve and improves the level of performance of surgical trainees., Level of Evidence: IV; non-interventional research., (Copyright © 2024 The Authors. Published by Elsevier Masson SAS.. All rights reserved.)

Background: We tested the added value of 3D-vision on procedure time and surgical performance during robotic pancreatoduodenectomy anastomoses in biotissue. Robotic surgery has the advantage of articulating instruments and 3D-vision. Consensus is lacking on the added value of 3D-vision during laparoscopic surgery. Given the improved dexterity with robotic surgery, the added value of 3D-vision may be even less with robotic surgery. Methods: In this experimental randomized controlled cross-over trial, 20 surgeons and surgical residents from 5 countries performed robotic pancreaticojejunostomy and hepaticojejunostomy anastomoses in a biotissue organ model using the da Vinci® system and were randomized to start with either 3D- or 2D-vision. Primary endpoint was the time required to complete both anastomoses. Secondary endpoint was the objective structured assessment of technical skill (OSATS; range 12–60) rating; scored by two observers blinded to 3D/2D. Results: Robotic 3D-vision reduced the combined operative time from 78.1 to 57.3 min (24.6% reduction, p < 0.001; 20.8 min reduction, 95% confidence intervals 12.8–28.8 min). This reduction was consistent for both anastomoses and between surgeons and residents, p < 0.001. Robotic 3D-vision improved OSATS performance by 6.1 points (20.8% improvement, p = 0.003) compared to 2D (39.4 to 45.1 points, ± 5.5). Conclusion: 3D-vision has a considerable added value during robotic pancreatoduodenectomy anastomoses in biotissue in both time reduction and improved surgical performance as compared to 2D-vision. [ABSTRACT FROM AUTHOR]

Abstract Background Simulation in laparoscopic surgery is nowadays recognized as a valid instrument for learning and training surgeons in different procedures. However, its role as evaluation test and self-assessment tool to verify basic surgical skills is still under discussion. Methods Thirty-three residents in obstetrics and gynecology at University of Pisa, Italy were recruited, and they received a simulation program consisting of 5 tasks. They had to perform basic laparoscopic surgery maneuvers as creating pneumoperitoneum, positioning trocars under vision, demonstrating the appropriate use of dominant and non-dominant hand and making single stitch and knot. They were evaluated with a modified OSATs scale. Results Senior trainees had better score than junior trainees (p value

Abstract Background There is an increasing need for objective and validated educational concepts. This holds especially true for surgical procedures like chest tube insertion (CTI). Thus, we developed an instrument for objectification of learning successes: the assessment scale based on Objective Structured Assessment of Technical Skill (OSATS) for chest tube insertion, which is evaluated in this study. Primary endpoint was the evaluation of intermethod reliability (IM). Secondary endpoints are ‘indirect’ interrater reliability (IR) and construct validity of the scale (CV). Methods Every participant (N = 59) performed a CTI on a porcine thorax. Participants received three ratings (one ‘direct’ on site, two ‘indirect’ via video rating). IM compares ‘direct’ with ‘indirect’ ratings. IR was assessed between ‘indirect’ ratings. CV was investigated by subgroup analysis based on prior experience in CTI for ‘direct’ and ‘indirect’ rating. Results We included 59 medical students to our study. IM showed moderate conformity (‘direct’ vs. ‘indirect 1’ ICC = 0.735, 95% CI: 0.554–0.843; ‘direct’ vs. ‘indirect 2’ ICC = 0.722, 95% CI 0.533–0.835) and good conformity between ‘direct’ vs. ‘average indirect’ rating (ICC = 0.764, 95% CI: 0.6–0.86). IR showed good conformity (ICC = 0.84, 95% CI: 0.707–0.91). CV was proven between subgroups in ‘direct’ (p = 0.037) and ‘indirect’ rating (p = 0.013). Conclusion Results for IM suggest equivalence for ‘direct’ and ‘indirect’ ratings, while both IR and CV was demonstrated in both rating methods. Thus, the assessment scale seems a reliable method for rating trainees’ performances ‘directly’ as well as ‘indirectly’. It may help to objectify and facilitate the assessment of training of chest tube insertion.

目的 建立专科医师规范化培训中腹腔镜直肠癌手术客观结构化临床技能评估客观结构化临 床技能评估(OSATS)量表并评价其效果。方法 通过问卷调查的形式由结直肠癌手术量超过500台以上主任 医师结合中国抗癌协会结直肠癌腹腔镜手术操作指南制定OSATS量表,并对40名学员进行一次性考核,按照 评分结果将40名学员的分数等级分为A、B、C和D 4组,比较A、B、C和D 4组学员手术时间、出血量、术后排 气时间、住院时间、淋巴结清扫数量的差异。结果 在评分量表中不同分数的学员其手术时间[B组(292.0± 16.8)min,C组(232.5±26.9)min,D 组(188.6±14.9)min]和出血量[B组(140.0±37.4)mL,C组(87.5± 15.8)mL,D组(35.7±19.0)mL]差异有统计学意义(P <0.05),评分越高的学员手术时间和出血量均明显低 于评分低的学员;各组在排气时间、住院时间及淋巴结清扫数量方面比较,差异均无统计学意义上(P >0,05)。 结论 通过对OSATS量表的验证当学员等级分数达到80分时,其手术安全性和效果可达到该中心平均水平, 有独立开展腹腔镜直肠癌手术的能力。 [ABSTRACT FROM AUTHOR]

Background: Hysterectomy rates are decreasing in many countries, and virtual reality simulators bring new opportunities into residents' surgical education. The objective of this study was to evaluate the effect of training in laparoscopic hysterectomy module with virtual reality simulator on surgical outcomes among residents performing their first laparoscopic hysterectomy.Methods: This randomized study was carried out at the Department of Obstetrics and Gynecology in Helsinki University Hospital and Hyvinkää Hospital. We recruited twenty residents and randomly signed half of them to train ten times with the laparoscopic hysterectomy module on a virtual reality simulator, while the rest represented the control group. Their first laparoscopic hysterectomy was video recorded and assessed later by using the Objective Structured Assessment of Technical Skills (OSATS) forms and Visual Analog Scale (VAS). The scores and surgical outcomes were compared between the groups.Results: The mean OSATS score for the Global Rating Scale (GRS) was 17.0 (SD 3.1) in the intervention group and 11.2 (SD 2.4) in the control group (p = 0.002). The mean procedure-specific OSATS score was 20.0 (SD 3.3) and 16.0 (SD 2.8) (p = 0.012), and the mean VAS score was 55.0 (SD 14.8) and 29.9 (SD 14.9) (p = 0.001). Operative time was 144 min in the intervention group and 165 min in the control group, but the difference did not reach statistical significance (p = 0.205). There were no differences between the groups in blood loss or direct complications.Conclusion: Residents training with a virtual reality simulator prior to the first laparoscopic hysterectomy seem to perform better in the actual live operation. Thus, a virtual reality simulator hysterectomy module could be considered as a part of laparoscopic training curriculum. [ABSTRACT FROM AUTHOR]

This study analyzes how the FPD supply chain complanies can apply their proprietary technologies to high growth segments, alternative applications, and new business models. It uses examples of x‐ray sensors, LC antennas, and fan out panel level packaging to demonstrate business diversification strategies as the FPD industry undergoes unprecedented techonology and market changes. [ABSTRACT FROM AUTHOR]

Background: In the era of competency-based surgical education, VBC has gained increased attention and may enhance the efficacy of surgical education. The objective of this systematic review was to summarize the existing evidence of video-based coaching (VBC) and compare VBC to traditional master-apprentice-based surgical education.Methods: We performed a systematic review and meta-analysis of randomized controlled trials (RCT) assessing VBC according to the PRISMA and Cochrane guidelines. The MEDLINE, EMBASE, and COCHRANE and Researchgate databases were searched for eligible manuscripts. Standard mean difference (SMD) of performance scoring scales was used to assess the effect of VBC versus traditional training without VBC (control).Results: Of 627 studies identified, 24 RCTs were eligible and evaluated. The studies included 778 surgical trainees (n = 386 VBC vs. n = 392 control). 13 performance scoring scales were used to assess technical competence; OSATS-GRS was the most common (n = 15). VBC was provided preoperative (n = 11), intraoperative (n = 1), postoperative (n = 10), and perioperative (n = 2). The majority of studies were unstructured, where identified coaching frameworks were PRACTICE (n = 1), GROW (n = 2) and Wisconsin Coaching Framework (n = 1). There was an effect on performance scoring scales in favor of VBC coaching (SMD 0.87, p < 0.001). In subgroup analyses, the residents had a larger relative effect (SMD 1.13; 0.61-1.65, p < 0.001) of VBC compared to medical students (SMD 0.43, 0.06-0.81, p < 0.001). The greatest source of potential bias was absence of blinding of the participants and personnel (n = 20).Conclusion: Video-based coaching increases technical performance of medical students and surgical residents. There exist significant study and intervention heterogeneity that warrants further exploration, showing the need to structure and standardize video-based coaching tools. [ABSTRACT FROM AUTHOR]

Introduction: Simulation-based training has become essential in medical education. Objective: Report our experience of implementing an Objective Structured Assessment of Technical Skills (OSATS) to measure technical skills of year 1 surgical residents of our faculty, assess their preliminary psychometric qualities and collect the opinions of residents on this tool. Methods: An OSATS of four then five and six stations of 10 minutes each was administered successively to 3 cohorts of surgical residents. Each station aimed to achieve basic technical skill. Residents' performances were assessed by an examiner using a pre-established scoring sheet. The means obtained from the stations and their internal consistency (alpha coefficient) were analyzed. Residents' felt needs, the apparent validity and content of the OSATS were assessed using a questionnaire. Results: Seventy-nine residents were assessed over 3 years. Residents' performances were not correlated with ranking at the National Ranking Examination [0.13 (CI95%: −0.11; +0.36)]. Urinary catheter and skin suturing were controlled very early. All residents considered that the technical skills assessed at each station were realistic. For 93% of them, teaching by simulation was considered essential for their training. Conclusion: This initial experience demonstrated that implementation of an OSATS is feasible and has provided important information on the technical skills of surgical residents. The development of this type of tool would strengthen the role of simulation in surgical training. [ABSTRACT FROM AUTHOR]

Abstract Purpose Surgical simulation has proven useful in training for high-acuity, low frequency events such as airway foreign body removal (AWFBR). Studies have supported the role of simulation to improve trainee confidence and technical proficiency, but rigorous methodology is often lacking. Through a pilot study, we sought to evaluate the feasibility and utility of two-view video capture for rigorous assessment of trainee skill in an educational course setting. Methods Participants were asked to perform 1) self-assessment surveys using 5- point Likert scale questions and 2) rigid bronchoscopy with AWFBR on intubation trainers, at the beginning and end of a multi-institution airway course. Video was collected from endoscopic and wide-angle body cameras. The videos were blinded and evaluated in random order by two expert reviewers using a 5-point pediatric airway endoscopy specific objective structured assessment of technical skills (OSATS) instrument. Results Fourteen trainees submitted pre- and post-course surveys, and eight of these also had complete video data. Faculty feedback indicated the importance of pre- and post-course AWFBR recordings for real-time trainee feedback and post-course curricular refinement. Survey data showed an increase in confidence for AWFBR from 2.0 to 3.3 (p = 0.05). Average OSATS scores increased from 1.84 to 2.58 but this did not reach significance (p = 0.51). Paired improvements in confidence exceeded improvements in OSATS scores (1.29 vs. 0.18, p = 0.058). Conclusions Rigorously evaluated two-view video capture was feasible in an educational course setting. The course resulted in improvements in confidence to a greater degree than OSATS scores. This supports the importance of assessing course impact and refining curricula using all available data including objectively assessing technical skills. [ABSTRACT FROM AUTHOR]

Introduction: Clinical outcome after surgery depends on the surgeon's level of expertise or performance. The present study of minimally invasive plate osteosynthesis (MIPO) with anterior plate for distal radius fracture assessed whether clinical outcome correlated with surgeon performance., Methods: The series included 30 distal radius fractures: 15 operated on by 4 level III surgeons (Group 1) and 15 by 4 level V surgeons (Group 2), utilizing the MIPO technique. The surgical performance of all 8 surgeons was assessed using the OSATS global rating scale. Clinical outcomes were assessed at 3 months' follow-up using the modified Mayo score (MMS), in 4 grades: 0-64 (poor), 65-79 (moderate), 80-89 (good), and 90-100 (excellent). The QuickDASH score (QDASH) was also calculated, and complications were recorded., Results: Median MMS was better for level V (75 = fair result) than level III surgeons (62 = poor result). Median QDASH score likewise was better in group 2 (9.1) than group 1 (22.7). In group 1, there were 2 paresthesias in the median nerve territory, 1 type-1 complex regional pain syndrome, and 1 hypoesthesia in the scar area. Mean correlation between the 2 scores was -0.68. Group 1 patients were on average 7 years older. The number of patients, number of surgeons and distribution of OA A and C fractures were almost identical in the two groups. On MMS, the overall result of the two groups was moderate (70.5), which can be explained by short mean follow-up., Discussion: Quality of the clinical outcome on MMS and QDASH increased with surgical performance, with fewer complications. In the patients' interest, protocols for improving surgical performance should be implemented, for example, through deliberate practice., (Copyright © 2023 SFCM. Published by Elsevier Masson SAS. All rights reserved.)

Background: Acquiring laparoscopic skills is a necessity for every young surgeon. Whether it is a talent or a non-surgical skill that determines the surgical performance of an endoscopic operation has been discussed for years. In other disciplines aptitude testing has become the norm. Airlines, for example, have implemented assessments to test the natural aptitude of future pilots to predict their performance later on. In the medical field, especially surgery, there are no similar comparable tests implemented or even available. This study investigates the influence of potential factors that may predict the successful performance of a complex laparoscopic operation, such as the surgeon's age, gender or learning method. Methods: This study focussed 70 surgical trainees. It was designed as a secondary analysis of data derived from a 2 × 2 factorial randomised controlled trial of practical training and/or multimedia training (four groups) in an experimental exercise. Both before and then after the training sessions, the participating trainees performed a laparoscopic cholecystectomy in a pelvitrainer. Surgical performance was then evaluated using a modified objective structured assessment of technical skills (OSATS). Participants were classified as 'Skilled' (high score in the pre-test), 'Good Learner' (increase from pre- to post-test) or 'Others' based on the OSATS results. Based on the results of the recorded performance, the training methods as well as non-surgical skills were eventually evaluated in a univariate and in a multivariate analysis. Results: In the pre-training performance 11 candidates were categorised as 'Skilled' (15.7%), 35 participants as 'Good Learners' (50.0%) and 24 participants were classified as 'Others'. The univariate analysis showed that the age, a residency in visceral surgery, and participation in a multimedia training were significantly associated with this grouping. Multivariate analyses revealed that residency in visceral surgery was the most predictive factor for the 'Skilled' participants ( p = 0.059), and multimedia training was most predictive for the 'Good Learner' ( p = 0.006). Participants in the group of 'Others' who were neither 'Skilled' nor improved in the training phase were younger ( p = 0.011) and did not receive multimedia ( p < 0.001) or practical ( p = 0.025) training. Conclusion: The type of learning method has been shown to be the most effective factor to improve laparoscopic skills, with multimedia training proving to be more effective than practical training. [ABSTRACT FROM AUTHOR]

Objective: To evaluate and quantify surgical skill by grading surgical performance of the pancreaticojejunostomy from robotic pancreaticoduodenectomies (RPDs). We hypothesized that video grading of surgical performance would contribute to estimating risk of postoperative pancreatic fistula (POPF) after pancreaticoduodenectomy. Background: POPF majorly contributes to pancreaticoduodenectomy morbidity. Risk scores [Fistula Risk Score (FRS) and Braga] derived from patient variables are validated for predicting POPF. Birkmeyer et al showed assessment of surgical proficiency is an important component of outcomes. Methods: POPF was diagnosed using International Study Group definition. Technical performance of robotic pancreaticojejunostomy video was graded by 2 blinded surgeons using: (1) pancreaticojejunostomy step-by-step variables [PJ-specific variables (PJVs); max = 115]; and (2) the Objective Structured Assessment of Technical Skills (OSATS) score. Results: One hundred thirty-three pancreaticojejunostomies were analyzed. POPF was 18%. Higher FRS (P = 0.011) and Braga (P = 0.041) scores predicted POPF. Graders' subjective prediction did not correlate with FRS/ Braga scores. Grader 1 scores (P = 0.043), but not grader 2 (P = 0.44), predicted POPF. PJV scores >105 were predictive of POPF (P = 0.039). Scoring only PJV duct-to-mucosa stitches (max = 50) was highly predictive of POPF (P = 0.0053). Higher OSATS scores were associated with a decreased rate of POPF (P = 0.022). On multivariate analysis, adding technical scoring to statistically significant patient variables (ie, gland texture) improves the model and can independently predict POPF. The strongest predictive model for POPF consisted of soft gland (odds ratio = 18.28, 95% confidence interval = 2.19-152.57) and low OSATS (odds ratio = 0.82, 95% confidence interval = 0.70-0.96). OSATS, modeled with FRS or Braga scores, independently predicted POPF. Conclusions: This is the first study to demonstrate that technical scoring of a surgeon's performance independently predicts patient outcomes in pancreatic surgery. Future studies should consider how to validate and incorporate technical metrics. [ABSTRACT FROM AUTHOR]