Search

Background: In real-world medical education, there is a lack of reliable predictors of future clinical competencies. Hence, we aim to identify the factors associated with clinical competencies and construct a prediction model to identify "improvement required" trainees., Methods: We analyzed data from medical students who graduated from National Yang-Ming University with clerkship training and participated in the postgraduate year (PGY) interview at Taipei Veterans General Hospital. Clinical competencies were evaluated using grades of national objective structured clinical examination (OSCEs). This study used data from medical students who graduated in July 2018 as the derivation cohort (N = 50) and those who graduated in July 2020 (n = 56) for validation., Results: Medical school grades were associated with the performance of national OSCEs (Pearson r = 0.34, p = 0.017), but the grades of the structured PGY interviews were marginally associated with the national OSCE (Pearson r = 0.268, p = 0.06). A prediction model was constructed to identify "improvement required" trainees, defined: trainees with the lowest 25% of scores in the national OSCEs. According to this model, trainees with the lowest 25% medical school grades predicted a higher risk of the "improvement required" clinical performance (Q1-Q3 vs Q4 = 15% vs 60%, odds ratio = 8.5 [95% confidence interval = 1.8-39.4], p = 0.029). In the validation cohort, our prediction model could accurately classify 76.7% "improvement required" and "nonimprovement required" students., Conclusion: Our study suggests that interventions for students with unsatisfactory medical school grades are warranted to improve their clinical competencies., Competing Interests: Conflicts of interest: Dr. Ming-Chih Hou and Dr. Wayne Huey-Herng Sheu, editorial board members at Journal of the Chinese Medical Association, have no roles in the peer review process of or decision to publish this article. The other authors declare that they have no conflicts of interest related to the subject matter or materials discussed in this article., (Copyright © 2022, the Chinese Medical Association.)

Objective/design/setting: This study aims to develop preprocedural communication-specific framework that emphasises the use of audiovisual materials and compares its acceptability by trainees with a regular module., Trainees: Between October 2018 and July 2021, 96 medical clerks were enrolled and randomly divided into regular and intervention groups. Another 48 trainees whose did not join the framework-based training but complete self-assessments were enrolled as the control group., Interventions: In the intervention training module, the key steps of preprocedural communication-specific skills were structuralised into a framework using the acronym of OSCAR., Primary and Secondary Outcome Measures: This study compared the acceptability of trainees for two modules by measuring the degree of increase in the end-of-rotation and follow up (4 weeks later) competency from baseline by trainees' self-assessments and physician assessments after serial trainings., Results: In comparison with regular group trainees, greater degree of improvements (framework-1 statement: 111%±13% vs 27%±5%, p<0.001; framework-2 statement: 77%±9% vs 48%±2%, p<0.05; skill-1 statement: 105%±9% vs 48%±3%, p<0.001); skill-2 statement: 71%±11% vs 50%±9%, p<0.05) were noted in the framework-related and skill-related statement 1-2 (the familiarity and confidence to use the framework and skills) than those of intervention group. At the end-of-rotation stage, the trainees ability to use the ' A -step: using audiovisual materials' of the OSCAR was significantly improved (229%±13%, p<0.001), compared with other steps. In the intervention group, the degree of improvement of the end-of-rotation data of trainees' self-assessment from baseline was significantly correlated with the degree of the improvement in physicians' assessment data in the aspects of skills, framework and steps in framework (R=0.872, p<0.01; R=0.813, p<0.001; R=0.914, p<0.001)., Conclusions: The OSCAR framework-based intervention module is well accepted by medical clerks and motivates them to integrate the acquired skills in clinical practice, which leads to trainees' primary care patients being satisfied with their preprocedural communication., Competing Interests: Competing interests: None declared., (© Author(s) (or their employer(s)) 2022. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.)

Purpose: Undertaking a standard-setting exercise is a common method for setting pass/fail cut scores for high-stakes examinations. The recently introduced equal Z standard-setting method (EZ method) has been found to be a valid and effective alternative for the commonly used Angoff and Hofstee methods and their variants. The current study aims to estimate the minimum number of panelists required for obtaining acceptable and reliable cut scores using the EZ method., Methods: The primary data were extracted from 31 panelists who used the EZ method for setting cut scores for a 12-station of medical school’s final objective structured clinical examination (OSCE) in Taiwan. For this study, a new data set composed of 1,000 random samples of different panel sizes, ranging from 5 to 25 panelists, was established and analyzed. Analysis of variance was performed to measure the differences in the cut scores set by the sampled groups, across all sizes within each station., Results: On average, a panel of 10 experts or more yielded cut scores with confidence more than or equal to 90% and 15 experts yielded cut scores with confidence more than or equal to 95%. No significant differences in cut scores associated with panel size were identified for panels of 5 or more experts., Conclusion: The EZ method was found to be valid and feasible. Less than an hour was required for 12 panelists to assess 12 OSCE stations. Calculating the cut scores required only basic statistical skills.

Background: This study aimed to evaluate whether the role-play (RP) of real patients by medical students as part of interactive clinical reasoning training can improve medical students' clinical performance., Methods: A total of 26 medical students volunteered to portray real patients within this program and were treated as the RP group while the other 72 students as the non-RP group. In the interactive morning meeting, the medical students practiced how to approach the RP student as if they were encountering a real patient. All students were evaluated by mini-clinical evaluation exercises (mini-CEX) before and after this training program., Results: We found that all students had an increased total mini-CEX score after 4-week training, especially for interviewing skills. Notably, after training, the RP students had significantly elevated total mini-CEX scores (51.23 ± 1.06 vs 53.12 ± 1.11, p = 0.028), and for counselling (7.15 ± 0.14 vs 7.54 ± 0.18, p = 0.015) and overall clinical competence (7.27 ± 0.15 vs 7.65 ± 0.16, p = 0.030). In contrast, the non-RP students had lower scores compared with the RP group, as revealed by both the pre- and post-training tests. Moreover, their mini-CEX scores were not improved after training., Conclusion: Medical students who were motivated to RP real patients had better performance scores than those who did not. In addition, RP can enhance their counselling skills and clinical competences., Competing Interests: Conflicts of interest: The authors declare that they have no conflicts of interest related to the subject matter or materials discussed in this article., (Copyright © 2020, the Chinese Medical Association.)

Background: This study aims to assess the feasibility, reliability and validity of the panel-based Equal Z-score (EZ) method applied to objective structural clinical examination (OSCE) of Chinese medical students and undertaking a comparison with the statistical techniques-based Borderline Regression Method (BRM)., Methods: Data received from two cohorts of 6th and 7th year medical students in Taiwan who set the mock OSCE as a formative assessment. Traditionally this medical school uses BRM to set the pass/fail cut-score. For the current study, 31 OSCE panellists volunteered to participate in the EZ method in parallel to the BRM., Results: In the conduct of this study, each panel completed this task for an OSCE exam comprising 12 stations within less than 60 min. Moreover, none of the 31 panellists, whose are busy clinicians, had indicated that the task was too difficult or too time-consuming. Although EZ method yielded higher cut-scores than the BRM it was found reliable. Intraclass correlation (ICC) measuring absolute agreement, across the three groups of panellists was .893 and .937 for the first and second rounds respectively, demonstrating high level of agreement across groups with the EZ method and the alignment between the BRM and the EZ method was visually observed. The paired t-test results identified smaller differences between the cut-scores within methods than across methods., Conclusions: Overall this study suggests that the EZ method is a feasible, reliable and valid standard setting method. The EZ method requires relatively little resources (takes about an hour to assess a 12 station OSCE); the calculation of the cut-score is simple and requires basic statistical skills; it is highly reliable even when only 10 panellists participate in the process; and its validity is supported by comparison to BRM. This study suggests that the EZ method is a feasible, reliable and valid standard setting method.

Background: The Accreditation Council for Graduate Medical Education (ACGME) core competencies (CC) in general medicine-based primary care are essential for junior medical trainees. In this country, a regular faculty development (FD) program aimed at training faculty in instructing (teaching and assessing) these CC had operated. However, leadership was not emphasized. In a new intervention module, the roles and associated responsibilities of clinical instructors to conduct, design, and lead CC-based education were emphasis., Aims: This follow-up explanatory case study compares the effectiveness of intervention module with that of the previous regular module., Methods: The regular group (n = 28) comprised clinical instructors who participated in the FD module during the 2013-2014 year while the intervention group (n = 28) was composed of 2015-2016 participants. Prior to the formal (hands-on) training, participants in the intervention group were asked to study the online materials of the regular module. These participants then received a 30-h hands-on training in conducting, designing, and leading skills. Finally, they prepared a 10-h reflective end-of-module presentation of their real-world practices., Results: Following the training, a higher degree improvement in participants self-reported familiarity with CC education, self-confidence in their ability to deliver CC education and sustained involve CC education were noted among the intervention FD group, compared with the regular FD group. In the intervention group, senior academicians (associate and full professor) are more substantially involved in designing and leading CC-based courses than junior academicians (lecturers and assistant professors). Among non-teaching award winners of in the intervention FD group, the follow-up degree of sustained involvement in delivering, designing and leading CC-based courses was significantly higher than that of the regular group., Conclusions: Our study demonstrated that leadership training in the intervention FD modules substantially motivated clinical instructors to become leaders in CC education.

Background: For patient safety, this study aims to evaluate the effectiveness of additional objective structured clinical examination (OSCE)-based medical simulation courses to establish the "emergency-stabilization" subcompetency of postgraduate first year (PGY-1) residents., Methods: In the simulation course, trainees were randomly divided into three groups: intervention, regular, and control group as Trios-OSCE trainees, Single-OSCE trainees, or OSCE observers (feedback-givers) after attending the pre-OSCE common simulation workshop. Three PGY-1 residents rotated through the Trios OSCE long-station together, while single PGY-1 residents rotated through regular OSCE alone and the control group gave feedback after observation of their peers' OSCE performance. Using Queen's simulation assessment tool, either in Trios-OSCE or Single-OSCE, performance levels were rated as either inferior, novice, competent, advanced or superior in the "therapeutic actions" and "communication" domains. The "overall performances" of all trainees were graded by qualified assessors, experienced facilitators, and standardized senior nurse., Results: The proportion of "overall performance" of trainee's, rated by an experienced facilitator as "above competent level," was significantly higher in intervention group A than in regular group B. After training, the degree of increase in self-efficacy scores was higher among the intervention group than the regular and control groups. In the follow-up stage, a trend of increasing self-efficacy scores was noted in both the interventional and regular groups. For all trainees among the three groups, high postcourse value scores confirm that the new Trios-OSCE model meets the needs of trainees and also motivates the self-directed learning and self-reflection of trainees., Conclusion: Our results provide initial evidence that the new emergency-stabilization-enhanced Trios-OSCE-based medical simulation course including the additional training capacity offered by adding an observer group had positive effects on PGY-1 residents' self-efficacy and clinical transfer.

One of the ten recommendations of the commission on education of health professionals for the twenty-first century is the "promotion of interprofessional education that breaks down professional silos while enhancing collaborative relationships in effective teams." Continuously, the increasing prevalence of patients with complex chronic health issues challenges the staff's training strategy of healthcare institution. To ensure patient safety, the collaborative involvement of a team of health professional is necessary to delivery care to patients with complex health conditions and social disadvantage. Integrated interprofessional collaboration and team efficiency (IIT) is a competency that can optimize the multiple professional skills to provide well-coordinated, high-quality, and patient-centered care. IIT-based training is a way to improve team-based care through positive shared learning activities in a nonthreatening environment to respond to patient's needs. The describe, analysis, application (DAA) diamond is a debriefing method that provides different health professionals with valuable learning experiences through communication. Using advocacy-inquiry approach, DAA-based IIT simulation offers an effective platform for training IIT. Including all disciplines in the DAA-based IIT simulation process reinforces the unique role/contribution of each team member and provides a mechanism for the team to talk together for system improvements. Actually, good clinical care requires practitioner's ability to effectively resolve stress and conflict, improve job satisfaction/wellbeing, and enhance quality and safety of patient care. In our institution, regular DAA-based IIT simulation courses were held at various divisions and had been proved to improve the safety and quality of healthcare.

Purpose: Different from the basic core part of the clinical interviewing and physical examination (PE) skills course in basic, head-to-toe, and thorax systems, learners need structural feedback for the development of the complex skills in cluster part including abdominal, neuromuscular and musculoskeletal systems. It aimed to evaluate the effects of replacing Dreyfus scale, which having elements of continuous professional development, with Likert scale in the feedback in cluster part of training in Taiwan., Methods: Instructors and final-year medical students of class 2015-2016 comprised the regular cohort, whereas those of class 2017-2018 formed the intervention cohort. In the intervention cohort, Dreyfus scale-based feedback rather than Likert scale based feedback was used in the cluster part of the course in National Yang-Ming university, Taiwan., Results: Among the regular cohort, poor pre-trained standardized patients (SPs) rated class climate, low grouped students satisfaction with the instructors and course, and low grouped student self-assessed readiness were noted in the cluster part than those in the core part. In comparison with regular cohort, greater improvement of post-cluster part end-of-course group objective structured clinical examination (GOSCE) scores was noted in intervention cohort. In other word, the implementation of Dreyfus scale-based feedback in the cluster part improved the deficit in this part of the course among the intervention cohort., Conclusion: The implementation of Dreyfus scale-based feedback helped instructors to create a good class climate in the cluster parts of clinical interviewing plus PE skills course in our study. Simultaneously, this new intervention achieved the goal of medical students competency in interviewing, PE and self-directed learning (SDL) skills.

Purpose: Lack of confidence in suturing/ligature skills due to insufficient practices and assessments was common among novice Chinese medical interns. This study aims to improve the skill acquisition of medical interns with new interventional program., Methods: In addition to regular clinical training, additional expert-led or expert-led plus artificial intelligent (AI) system tutoring courses were implemented during the first 2 week of surgical block in our hospital. Interns can voluntarily join the regular (no additional tutoring), expert-led tutoring or expert-led+AI tutoring groups freely. In regular group, interns (n=25) did not join additional tutoring. The expert-led group received 3-hour expert-led tutoring and in-training formative assessment after twice practices. After similar expert-led course as expert-led group, the expert-led+AI group (n=23) practice and assess their skills on the AI system. Through the comparison with the internal standard, the system automatically recorded and evaluated every intern's suturing/ligature skills. Among expert-led+AI group, the performance and confidence were compared between interns whose doing one, two and three times of AI practices., Results: The end-of-surgical block OSCE' performance and self-assessed confidence for the suturing/ligature skills were highest in expert-led+AI group. In comparison with expert-led group, with similar performance in in-training assessment, expert-led+AI group have higher degree of improvement in their performance in end-of surgical block OSCE. Especially, in expert-led+AI group, the best performance and highest post-OSCE confidence were noted among trice AI practicing group., Conclusion: This pilot study demonstrated the promising effects of incorporation of additional expert-led plus AI system-assisted tutoring course into regular surgical curriculum.

Background: Failure to transfer procedural skills learned in a laboratory to the bedside is commonly due to a lack of peer support/stimulation. A digital platform (Facebook) allows new clinical clerks to share experiences and tips that help augment their procedural skills in a peer-assisted learning/teaching method. This study aims to investigate the effectiveness of the innovation of using the digital platform to support the transfer of laboratory-trained procedural skills in the clinical units., Methods: Volunteer clinical clerks (n = 44) were enrolled into the peer-assisted learning (PAL) group, which was characterized by the peer-assisted learning of procedural skills during their final 3-month clinical clerkship block. Other clerks (n = 51) did not join the procedural skills-specific Facebook group and served as the self-directed learning regular group. The participants in both the PAL and regular groups completed pre- and post-intervention self-assessments for general self-assessed efficiency ratings (GSER) and skills specific self-assessed efficiency ratings (SSSER) for performing vein puncture, intravenous (IV) catheter and nasogastric (NG) tube insertion. Finally, all clerks received the post-intervention 3-station Objective Structured Clinical Skills Examination (OSCE) to test their proficiency for the abovementioned three procedural skills., Results: Higher cumulative numbers of vein punctures, IV catheter insertions and NG tube insertions at the bedside were carried out by the PAL group than the regular group. A greater improvement in GSERs and SSSERs for medical procedures was found in the PAL group than in the regular group. The PAL group obtained higher procedural skills scores in the post-intervention OSCEs than the regular group., Conclusion: Our study suggested that the implementation of a procedural skill-specific digital platform effectively helps clerks to transfer laboratory-trained procedural skills into the clinical units. In comparison with the regular self-directed learning group, the peer-assisted learning characteristics of Facebook give additional benefits to the PAL group by enhancing their procedural skills., (Copyright © 2018. Published by Elsevier Taiwan LLC.)

Objectives: The primary healthcarecentre (PHCC) is the first place that medical students experience patient contact. Usually, medical students are frustrated by a lack of proper skills training for on-campus history taking (HT), physical examination (PE) and self-directed learning (SDL) to prepare for their PHCC and inhospital patient contact. For pre-clerks, this study aims to compare the effectiveness of PHCC training and PHCC training in combination with on-campus HT and PE training modules (PHCC+on-campus) on their clerkship preparedness., Design: This comparative study utilised prospective, consecutive, end of pre-clerkship group objective structured clinical examination (GOSCE), beginning of clerkship OSCE and self-administered Preparation for Hospital Practice Questionnaire (PHPQ)., Setting/participants: 128 pre-clinical clerk volunteers (64 each year) receiving PHCC training (7 week PHCCtraining in addition to 7 week assignment based group learning, academic year 2014, controls) and PHCC training in combination with on-campus module training (academic year 2015, 7 week PHCCtraining in addition to 7 week on-campus sessions) were sequentially assessed before the module (week 1), at the end of the module (week 14) and at the beginning of clerkship (week 25)., Results: For overall HT and PE skills, both PHCC and PHCC+on-campus module trained pre-clerks performed better on OSCE than GOSCE. Additionally, the improvement was accompanied by higher self-reported PHPQ scores in 'confidence/coping' and 'SDL' domains. At the end of the pre-clerkship and the beginning of the clerkship stages, the degree of improvement in preparedness in 'confidence/coping' and 'SDL' domains was higher for those in the PHCC+on-campus group than for those in the PHCC group. Among the PHCC+on-campus module participants, a positive association was observed between high mean PHPQ-SDL scores and high OSCE scores., Conclusions: Our study suggests that the PHCC+on-campus module, which is paired faculty led and pre-trained dyad student assisted, is effective in developing a preclinical clerk's HT and PE skills and intensifying SDL/patient management abilities to prepare for hospital practice in clerkship., Competing Interests: Competing interests: None declared., (© Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.)

Background: Opinions on the interaction between the genders of standardized patients and examinees are controversial. Our study sought to determine the influence of gender on communication skills assessment in Eastern country., Methods: We recruited year 5 medical students from a medical college in Taiwan. They were assigned to obtain informed consent from either male or female age-matched standardized patients. Their performance was rated by standardized checklist rating scores and global rating scores. Either male or female examiners rated their performance., Results: A total of 253 medical students (166 male students and 87 female students) were recruited. The checklist rating scores for students interacting with male standardized patients were significantly lower than the scores for interactions with female standardized patients (male examiners, P=0.006; female examiners, P=0.001). For male students, the checklist rating scores were significantly lower for male standardized patients than for female standardized patients (male examiners, P=0.006; female examiners, P=0.008). For male standardized patients, male students had significantly lower checklist rating scores than female students when rated by male examiners (P=0.044). The global rating scores were similar except when female students interacted with male and female SPs and when rated by female examiners (P=0.004)., Conclusion: The gender of standardized patients influences communication skills assessment. In terms of checklist rating scores, female standardized patients seem preferable to minimize potential gender effects. In the best interest of students, global rating score may be preferable to checklist rating score, especially for male examinees., (Copyright © 2015 European Federation of Internal Medicine. Published by Elsevier B.V. All rights reserved.)

Background: This study compared the effects of the "thinking aloud" (TA) morning report (MR), which is characterized by sequential and interactive case discussion by all participants, with "regular" MR for clinical skill training of young physicians., Methods: Between February 2011 and February 2014, young physicians [including postgraduate year-1 (PGY1) residents, interns, and clerks) from our hospital were sequentially enrolled and followed for 3 months. The self- and rater-assessed educational values of two MR models for building up clinical skills of young physicians were compared., Results: The junior (intern and clerk) attendees had higher self-assessed educational values scores and reported post-training application frequency of skills trained by TA MR compared with the senior (PGY1 resident) attendees. Higher average and percentage of increased overall rater-assessed OSCE scores were noted among the regular MR senior attendees and TA MR junior attendees than in their corresponding control groups (regular MR junior attendees and TA MR senior attendees). Interestingly, regular MRs provided additional beneficial effects for establishing the "professionalism, consulting skills and organization efficiency" aspects of clinical skills of senior/junior attendees. Moreover, senior and junior attendees benefited the most by participating in seven sessions of regular MR and TA MR each month, respectively., Conclusion: TA MR effectively trains junior attendees in basic clinical skills, whereas regular MR enhances senior attendees' "work reports, professionalism, organizational efficiency, skills in dealing with controversial and professional issues." Undoubtedly, all elements of the two MR models should be integrated together to ensure patient safety and good discipline among young physicians., (Copyright © 2015. Published by Elsevier Taiwan.)

Objectives: The current study focused on validating a protocol for training and auditing the resident's practice-based learning and improvement (PBLI) and quality improvement (QI) competencies for primary care., Methods: Twelve second-year (R2), 12 first-year (R1) and 12 postgraduate year-1 residents were enrolled into group A, B and C, respectively, as trainees. After three training protocols had been completed, a writing test, self-assessed questionnaire and mini-OSTE and end-of-rotation assessment were used in auditing the PBLI competency, performance and teaching ability of trainees., Results: Baseline expert-assessed PBLI and QI knowledge application tool writing scores were low for the R1 and R2 residents. After three training protocols, PBLI and QI proficiencies, performance and teaching abilities were improved to similar levels cross the three training levels of residents based on the expert-assessed writing test-audited assessments and on the faculty and standardized clerk-assessed end-of-rotation-/mini-OSTE-audited assessments., Conclusion: The different four-level hierarchical protocols used to teach group A, B and C were equally beneficial and fitted their needs; namely the different levels of the trainees. Specifically, each level was able to augment their PBLI and QI proficiency. This educational intervention helps medical institutions to train residents as PBLI instructors.

Background: The evaluation of professional behaviors and concepts of postgraduate first-year (PGY1) residents has been identified as an area for development. This study examined the efficiency of the professionalism-assessing objective structured clinical examination (OSCE), 360° evaluation, and mini-Clinical Examination Exercise scores (mini-CEX; p-OSCE, p-360° evaluation, and p-mini-CEX scores)., Methods: Between January 2009 and January 2012, 189 PGY1 residents were evaluated for behavior- and concept-based professionalism competence based on the above three methods using two checklists unique to each case. Data were analyzed for reliability, inter-rater agreement, interval changes, and gender-related difference for each method., Results: The test reliabilities of p-OSCE, p-360° evaluation, and p-mini-CEX were acceptable. Further, the reliability of concept and combined p-OSCE was higher than that of behavior p-OSCE. In addition, the concept OSCE p-scores and behavior 360° evaluation p-scores were significantly improved after 6 months of training. The inter-rater agreements were relatively good in p-OSCE and p-360° evaluation. Interestingly, male PGY1 residents had higher behavior 360° evaluation p-scores from nurses than those of females, whereas female PGY1 residents had higher behavior 360° evaluation p-scores from patients than those of males. Behavior and concept OSCE p-scores were positively correlated with behavior 360° evaluation p-scores. In comparison with p-360° evaluation, the combination of p-360° evaluation + OSCE + mini-CEX significantly increases their reliabilities., Conclusion: The current study suggests that the p-OSCE, p-360° evaluation, and p-mini-CEX are feasible methods for evaluating professionalism in clinical training of PGY1 residents. Combination of the above three evaluations, participation, and support from multiple constituencies and multiple representatives provides good reliability and adds credibility in the assessment of professionalism competence., (Copyright © 2013. Published by Elsevier B.V.)

Background: Clinical competency certifications are important parts of internal medicine residency training. This study aims to evaluate a composite objective structured clinical examination (OSCE) that assesses postgraduate year-1 (PGY(1)) residents' acquisition of the six core competencies defined by the Accreditation council for Graduate Medical Education (ACGME)., Methods: Six-core-competency-based OSCE was used as examination of the clinical performance of 192 PGY(1) residents during their 3-month internal medicine training between 2007 January and 2009 December. For each year, the reliability of the entire examination was calculated with Cronbach's alpha., Results: The reliability of six-core-competency-based OSCE was acceptable, ranging from 0.69 to 0.87 between 2007 and 2009. In comparison with baseline scores, the summary scores and core-competency subscores all showed significant increase after PGY(1) residents finished their 3-month internal medicine training program., Conclusion: By using a structured development process, the authors were able to create reliable evaluation items for determining PGY(1) residents' acquisition of the ACGME core competencies., (Copyright © 2011. Published by Elsevier B.V.)

Background: The year 2013 marks a watershed in the history of medical education in Taiwan. Following Taiwan's Taskforce of Medical School Curriculum Reform recommendations, the medical school curriculum was reduced from 7 to 6 years. This study aimed to analyze the impact of medical school curriculum reform on medical students' performance in objective structured clinical examinations (OSCEs). Methods: We retrospectively analyzed the OSCE records at Taipei Veterans General Hospital (Taipei VGH), one of Taiwan's largest tertiary medical centers, between November 2016 and July 2020. The eligibility criteria were medical students receiving a full one-year clinical sub-internship training at Taipei VGH and in their last year of medical school. All medical students received a mock OSCE-1 at the beginning of their sub-internship, a mock OSCE-2 after six months of training, and a national OSCE at the end of their sub-internship. The parameters for performance in OSCEs included "percentage of scores above the qualification standard" and "percentage of qualified stations." Results: Between November 2016 and July 2020, 361 undergraduates underwent clinical sub-internship training at Taipei VGH. Among them, 218 were taught under the 7-year curriculum, and 143 were instructed under the 6-year curriculum. Based on baseline-adjusted ANCOVA results, medical students under the 7-year curriculum had a higher percentage of scores above the qualification standard than those under the 6-year curriculum at the mock OSCE-1 (7-year curriculum vs. 6-year curriculum: 33.8% [95% CI 32.0–35.7] vs. 28.2% [95% CI 25.9–30.4], p < 0.001), and mock OSCE-2 (7-year curriculum vs. 6-year curriculum: 89.4% [95% CI 87.4–91.4] vs. 84.0% [95% CI 81.5–86.4], p = 0.001). Moreover, medical students in the 7-year curriculum had a higher percentage of qualified stations in mock OSCE-1 (7-year curriculum vs. 6-year curriculum: 89.4% [95% CI 87.4–91.4] vs. 84.0% [95% CI 81.5–86.4], p = 0.001) and mock OSCE-2 (7-year curriculum vs. 6-year curriculum: 91.9% [95% CI 90.1–93.8] vs. 86.1% [95% CI 83.8–88.3], p = 0.001). After clinical sub-internship training, there were no differences in the percentage of scores above the qualification standard (7-year curriculum vs. 6-year curriculum: 33.5% [95% CI 32.2–34.9] vs. 34.6 [95% CI 32.9–36.3], p = 0.328) and percentage of qualified stations (7-year curriculum vs. 6-year curriculum: 89.4% [95% CI 88.1–90.7] vs. 90.2% [95% CI 88.6–91.8], p = 0.492). Conclusions: At the beginning of the sub-internship, medical students under the 7-year curriculum had better OSCE performance than those under the 6-year curriculum. After the clinical sub-internship training in Taipei VGH, there was no difference in the national OSCE score between the 6- and 7-year curricula. Our study suggests that clinical sub-internship is crucial for the development of clinical skills and performance in the national OSCE. [ABSTRACT FROM AUTHOR]