3,087 results on '"Objective Structured Clinical Examination"'
Search Results
2. Organización y métodos didácticos de una asignatura que integra asignaturas y competencias transversales en el Grado en Medicina. Experiencia con «Talleres integrados II» de la Universidad Miguel Hernández de Elche
- Author
-
Ramos-Rincón, José M., Quereda-Seguí, Francisco, Diez-Miralles, Manuel, Hernández-Aguado, Idelfonso, Rodríguez-Díaz, Juan C., Betlloch-Mas, M. Isabel, Horga-de la Parte, José F., and Fernández-Sánchez, F. Javier
- Published
- 2019
- Full Text
- View/download PDF
3. Exploring effective video-review strategies of patient encounters for medical students: precepted review versus peer discussion.
- Author
-
Park, Kye-Yeung, Kang, Ye Ji, Park, Hoon-Ki, and Hwang, Hwan-Sik
- Subjects
- *
MEDICAL students , *SELF-efficacy in students , *PEER review committees , *SIMULATED patients , *PEERS , *MEDICAL preceptorship - Abstract
Background: Video-recordings review of patient encounters is reported to improve the clinical performance of medical students. However, evidence on specific remediation strategies or outcomes are lacking. We aimed to implement videorecording-based remediation of standardized patient encounters among medical students, combined with preceptor one-on-one feedback or peer group discussion, and evaluate the effectiveness of the two remediation methods using objective structured clinical examination (OSCE). Methods: Following standardized patient encounters, 107 final-year medical students were divided into two groups based on different remediation methods of video review: (1) precepted video review with preceptor feedback (N = 55) and (2) private video review and subsequent peer group discussion under supervision (N = 52). All students underwent twelve-stations of OSCE both before and after the video review. Students' pre- and post-remediation OSCE scores, self-efficacy level in patient encounters, and level of educational satisfaction with each method were assessed and compared between different video-based remediation methods to evaluate their respective effects. Results: After remediation, the total and subcomponent OSCE scores, such as history taking, physical examination, and patient – physician interaction (PPI), among all students increased significantly. Post-remediation OSCE scores showed no significant difference between two remediation methods (preceptor module, 79.6 ± 4.3 vs. peer module, 79.4 ± 3.8 in the total OSCE score). Students' self-efficacy levels increased after remediation in both modules (both p-value <0.001), with no difference between the two modules. However, students' satisfaction level was higher in the preceptor module than in the peer module (80.1 ± 17.7 vs. 59.2 ± 25.1, p-value <0.001). Among students with poor baseline OSCE performance, a prominent increase in PPI scores was observed in the preceptor-based module. Conclusion: Video-based remediation of patient encounters, either through preceptor review with one-on-one feedback or through private review with peer discussion, was equally effective in improving the OSCE scores and self-efficacy levels of medical students. Underperforming students can benefit from precepted video reviews for building PPI. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
4. Clues for improvement of research in objective structured clinical examination.
- Author
-
Foy, Jean Philippe, Serresse, Laure, Decavèle, Maxens, Allaire, Manon, Nathan, Nadia, Renaud, Marie Christine, Sabourdin, Nada, Souala-Chalet, Yasmine, Tamzali, Yanis, Taytard, Jessica, Tran, Mélanie, Cohen, Fleur, Bottemanne, Hugo, and Monsel, Antoine
- Subjects
- *
PERFORMANCE anxiety , *BIBLIOMETRICS , *CLINICAL competence , *MEDICAL students , *COOPERATIVE research - Abstract
While objective clinical structured examination (OSCE) is a worldwide recognized and effective method to assess clinical skills of undergraduate medical students, the latest Ottawa conference on the assessment of competences raised vigorous debates regarding the future and innovations of OSCE. This study aimed to provide a comprehensive view of the global research activity on OSCE over the past decades and to identify clues for its improvement. We performed a bibliometric and scientometric analysis of OSCE papers published until March 2024. We included a description of the overall scientific productivity, as well as an unsupervised analysis of the main topics and the international scientific collaborations. A total of 3,224 items were identified from the Scopus database. There was a sudden spike in publications, especially related to virtual/remote OSCE, from 2020 to 2024. We identified leading journals and countries in terms of number of publications and citations. A co-occurrence term network identified three main clusters corresponding to different topics of research in OSCE. Two connected clusters related to OSCE performance and reliability, and a third cluster on student's experience, mental health (anxiety), and perception with few connections to the two previous clusters. Finally, the United States, the United Kingdom, and Canada were identified as leading countries in terms of scientific publications and collaborations in an international scientific network involving other European countries (the Netherlands, Belgium, Italy) as well as Saudi Arabia and Australia, and revealed the lack of important collaboration with Asian countries. Various avenues for improving OSCE research have been identified: i) developing remote OSCE with comparative studies between live and remote OSCE and issuing international recommendations for sharing remote OSCE between universities and countries; ii) fostering international collaborative studies with the support of key collaborating countries; iii) investigating the relationships between student performance and anxiety. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
5. Oral interview in place of traditional objective structured clinical examinations for assessing placement readiness in nutrition and dietetics education.
- Author
-
Barker, Lisa A., Volders, Evelyn, Anderson, Amanda, Berlandier, Mina, and Palermo, Claire
- Subjects
- *
MEDICAL logic , *MEDICAL protocols , *MEDICAL education , *ACADEMIC medical centers , *INTERVIEWING , *INTERNSHIP programs , *HEALTH occupations students , *SCIENTIFIC observation , *PILOT projects , *EVALUATION of human services programs , *QUESTIONNAIRES , *DESCRIPTIVE statistics , *DIETETICS education , *LONGITUDINAL method , *CLINICAL competence , *REMEDIAL teaching , *CONCEPTUAL structures , *PROBLEM-based learning , *ELECTRONIC health records , *ONE-way analysis of variance , *NATIONAL competency-based educational tests , *PSYCHOLOGY of medical students , *COMPARATIVE studies , *DATA analysis software , *NUTRITION education , *PSYCHOSOCIAL factors , *PROFESSIONAL competence , *DIET therapy , *COVID-19 pandemic , *NUTRITION ,RESEARCH evaluation - Abstract
Aim: Objective structured clinical examinations have long been used in dietetics education. This observational study aims to describe the development, deployment, feasibility and validity of assessment using an oral interview in place of traditional objective structured clinical examinations, and to determine the ability of this assessment to identify students who are either not ready for placement or may require early support and/or remediation. Methods: Student assessment data were collected over a two‐and‐a‐half‐year period and used to test the predictive ability of an oral interview to determine dietetic placement outcomes and highlight a need for early remediation. Descriptive statistics as well as a between‐group one‐way ANOVA was used to describe results. Results: A total of 169 students participated in the oral interview and subsequent medical nutrition therapy placement over the study period. Significant differences in oral interview score were seen between students who passed placement and students who passed with remediation or those who failed. Oral interview performance was able to predict placement outcome, yet required less resources than traditional objective structured clinical examinations. Conclusion: An oral interview may provide the same utility as the objective structured clinical examination in dietetics education. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
6. Rôle des médecins hospitalo-universitaires de médecine interne dans la formation aux métiers de la santé et au sein des institutions en France : enquête du Collège National des Enseignants de Médecine Interne (CEMI)
- Author
-
Rauzy, Odile, Bouillet, Laurence, Chevalier, Kevin, Cohen-Aubart, Fleur, Delacroix, Isabelle, Hanslik, Thomas, Kaplanski, Gilles, Lazaro, Estibaliz, Le Moigne, Emmanuelle, Pottier, Pierre, Riviere, Etienne, and Mouthon, Luc
- Subjects
- *
INTERNAL medicine , *IMMUNOLOGY , *HOSPITAL administration , *UNIVERSITIES & colleges , *PUBLIC institutions - Abstract
À l'occasion des états généraux de la médecine interne, le Collège National des Enseignants de Médecine Interne (CEMI) a mené une enquête sur l'activité d'enseignement, auprès de l'ensemble des hospitalo-universitaires (HU) de médecine interne français. L'enquête a été réalisée en septembre 2023 en adressant un courriel aux 101 professeurs des universités–praticiens hospitaliers (PU–PH) et 18 maîtres de conférence des universités–praticiens hospitaliers (MCU–PH) de médecine interne de la sous-section 53-01 du conseil national des universités (CNU), ainsi qu'aux 11 internistes HU émargeant en immunologie (sous-section 47-01) ou en thérapeutique (sous-section 48-04). Soixante-treize HU (56,1 %) ont répondu à l'enquête, dont 65 PU–PH, 7 MCU–PH et 1 praticien hospitalo-universitaire (PHU). Les HU de médecine interne participent à l'enseignement facultaire : 80 % sont responsables d'enseignement, 30 % sont responsables d'année ou de cycle ou animent des commissions et 40 % ont eu ou ont un mandat d'élu à la faculté ou à l'université. Les HU de médecine interne sont investis dans l'enseignement de la sémiologie médicale au cours du premier cycle des études de médecine, mais aussi dans les formations en maïeutique, sciences pharmaceutiques, odontologie et les formations paramédicales. Ils sont très investis dans la mise en place de la réforme du second cycle et 80 % interviennent dans la préparation des Examens Cliniques Objectifs Structurés (ECOS), essentiellement comme examinateurs (90 %). Ils participent également aux enseignements utilisant la simulation (60 %), à l'enseignement aux infirmiers de pratique avancée (IPA) (25 %), à la rédaction des ouvrages du CEMI (75 %). Huit (12 %) HU de médecine interne co-animent des formations avec des patients et 26 (38 %) participent à des enseignements en master à la faculté des sciences. Enfin, 94 % sont affiliés à une unité de recherche et 48 % encadrent des étudiants en thèse d'université. Les HU de médecine interne ont un fort engagement pédagogique, en particulier dans la sémiologie et dans la réforme du second cycle des études médicales avec les ECOS et la simulation. On the occasion of the General stage meeting of Internal Medicine, the National College of Internal Medicine Teachers (CEMI) conducted a survey on teaching activity among all French university hospital (HU) internal medicine specialists. The survey was carried out in September 2023 by sending an email to 101 hospital practitioners university professors (PU–PH) and 18 hospital practitioners assistant professors (MCU–PH) of internal medicine in subsection 53-01 of the National council of universities (CNU), as well as to the 11 HU internists working in immunology (subsection 47-01) or therapeutics (subsection 48-04). Seventy-three HUs (56.1%) responded to the survey, including 65 PU–PH, 7 MCU–PH and 1 university hospital practitioner (PHU). Internal medicine HUs participate in faculty teaching: 80% are responsible for teaching, 30% are responsible for the year or cycle or lead committees and 40% have had or have an elected mandate at the faculty or at university. Internal medicine HU are involved in the teaching of semiology during the first cycle of medical studies, but also in pharmaceutical sciences, dentistry, midwifery and in paramedical training. They are very invested in the implementation of the second cycle reform and 80% are involved in the preparation of Objective Structured Clinical Examinations (ECOS), mainly as examiners (90%). They also participate in teaching using simulation (60%), teaching advanced practice nurses (IPA) (25%), and writing CEMI books (75%). For ECOS, 90% participate as examiners, 60% participate in teaching using simulation, 25% are involved in teaching advanced practice nurses (IPA), 75% participated in the writing of CEMI works. Eight (12%) internal medicine HUs co-facilitate training with patients and 26 (38%) participate in master's courses at the Faculty of Sciences. Finally, 94% are affiliated with a research unit and 48% supervise university theses students. Internal medicine universities teachers have a strong educational commitment, particularly in semiology and in the reform of the second cycle of medical studies with ECOS and simulation. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
7. Providing Care to People With Intellectual and Developmental Disabilities in Medical Education.
- Author
-
Lunsky, Isis Olivia, Gutierrez, Gilmar, Rabu, Olivier, Gemmill, Meg, and Hamer, Debra
- Subjects
PEOPLE with intellectual disabilities ,MEDICAL students ,PEOPLE with developmental disabilities ,DEVELOPMENTAL disabilities ,MEDICAL education - Abstract
Medical professionals commonly report having inadequate training providing care for individuals with intellectual and developmental disabilities (IDD). This pilot study aimed to address this gap through a virtual Objective Structured Clinical Examinations (OSCE) with individuals with IDD as patient educators for 25 first- and second-year medical students (OSCE participants). Quantitative data through the Prediger competency scale and qualitative data through a semistructured interview were analyzed. OSCE participants reported a significant increase (p < 0.05) in self-perceived competency scores when comparing pre- and post-OSCE scores. Qualitative analysis yielded themes corresponding to improving skills, practice considerations, and perspectives and biases changes. These results suggested that this virtual OSCE promoted the development of self-perceived clinical competency and comfort providing care for individuals with IDD. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
8. The use of the objective structured clinical examination to evaluate paediatric cardiopulmonary resuscitation skills in medical students and measures to improve training
- Author
-
Jesús López-Herce, Esther Aleo, Rafael González, and and UCM Paediatric C. P. R. Training Group
- Subjects
Education ,Medical students ,Objective structured clinical examination ,Paediatric life support courses ,Resuscitation education ,Resuscitation training ,Special aspects of education ,LC8-6691 ,Medicine - Abstract
Abstract Background The main objectives of the study were to analyse the use of the Objective Structured Clinical Examination (OSCE) to evaluate the skills of medical students in paediatric basic life support (PBLS), to compare two resuscitation training models and to evaluate the measures to improve the teaching program. Methods Comparative, prospective, observation study with intervention in two hospitals, one undergoing a PILS course (Paediatric Immediate Life Support) and another PBLS. The study was performed over three phases. 1º. PBLS OSCE in 2022 three months after the resuscitation training 2. Measures to improve the training program in 2023 3. PBLS OSCE in 2023. Overall results were analysed and comparison between both sites and those for 2022 and 2023 were made. Results A total of 210 and 182 students took part in the OSCE in 2022 and 2023, respectively. The overall mean score out of 100 was 83.2 (19), 77.8 (19.8) in 2022 and 89.5 (15.9) and 2023, P
- Published
- 2024
- Full Text
- View/download PDF
9. Can routine EPA-based assessments predict OSCE performances of undergraduate medical students?
- Author
-
Lin, Yi-Hsuan, Yang, Ying-Ying, Chen, Chen-Huan, Huang, Chia-Chang, Li, Chung-Pin, Shen, Hsiao-Chin, Yeh, Hsiao-Yun, Liang, Jen-Feng, Chu, Shao-Yin, Lirng, Jiing-Feng, and Wang, Shuu-Jiun
- Subjects
- *
GENERALIZED estimating equations , *MEDICAL students , *UNDERGRADUATES , *PREDICTION models , *REGRESSION analysis - Abstract
AbstractBackgroundMethodsResultsConclusionsObjective structured clinical examination (OSCE) is used worldwide. This study aims to explore potential alternatives to the OSCE by using entrustable professional activities (EPA)-based assessments in the workplace.This study enrolled 265 six-year undergraduate medical students (UGY) from 2021 to 2023. During their rotations, students were assessed using 13 EPAs, with the grading methods modified to facilitate application. Before graduation, they participated in two mock OSCEs and a National OSCE. We used generalized estimating equations to analyze the associations between the EPA assessments and the OSCE scores, adjusting for age and sex, and developed a prediction model. EPA8 and EPA9, which represent advanced abilities that were not significant in the regression models, were removed from the prediction model.Most EPAs were significantly correlated with OSCE scores across the three cohorts. The prediction model for forecasting passing in the three OSCEs demonstrated fair predictive capacity (area under curve = 0.82, 0.66, and 0.71 for students graduated in 2021, 2022, and 2023, respectively all
p < 0.05).The workplace-based assessments (EPA) showed a high correlation with competency-based assessments in simulated settings (OSCE). EPAs may serve as alternative tools to formal OSCE for medical students. [ABSTRACT FROM AUTHOR]- Published
- 2024
- Full Text
- View/download PDF
10. The use of the objective structured clinical examination to evaluate paediatric cardiopulmonary resuscitation skills in medical students and measures to improve training.
- Author
-
López-Herce, Jesús, Aleo, Esther, González, Rafael, Santiago, Maria José, Carrillo, Angel, Cordero, Marta, Mencía, Santiago, Butragueño, Laura, Alcón, Sara, García-Moreno, Ana Belén, Cieza, Raquel, Paúl, Marta, Escobar, María, Zapata, Cristina, De Angeles, Cristina, and Herranz, Gloria
- Subjects
MEDICAL students ,MEDICAL education ,CARDIOPULMONARY resuscitation ,COMPARATIVE method ,RESUSCITATION - Abstract
Background: The main objectives of the study were to analyse the use of the Objective Structured Clinical Examination (OSCE) to evaluate the skills of medical students in paediatric basic life support (PBLS), to compare two resuscitation training models and to evaluate the measures to improve the teaching program. Methods: Comparative, prospective, observation study with intervention in two hospitals, one undergoing a PILS course (Paediatric Immediate Life Support) and another PBLS. The study was performed over three phases. 1º. PBLS OSCE in 2022 three months after the resuscitation training 2. Measures to improve the training program in 2023 3. PBLS OSCE in 2023. Overall results were analysed and comparison between both sites and those for 2022 and 2023 were made. Results: A total of 210 and 182 students took part in the OSCE in 2022 and 2023, respectively. The overall mean score out of 100 was 83.2 (19), 77.8 (19.8) in 2022 and 89.5 (15.9) and 2023, P < 0.001. Overall cardiopulmonary resuscitation (CPR) effectiveness was adequate in 79.4% and 84.6% of students in 2022 and 2023, respectively. The results of hospital students undergoing a PILS course were better (86.4 (16.6) than those undergoing a PBLS. 80.2 (20.6) p < 0.001. The results from both hospitals improved significantly in 2023. Conclusions: The OSCE is a valid instrument to evaluate PBLS skills in medical students and to compare different training methods and program improvements. Medical students who receive a PILS attain better PBLS skills than those who undergo a PBLS course. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
11. A level playing field? Evaluation of the virtual Objective Structured Clinical Examination in Psychiatry and Addiction Medicine: A mixed methods study.
- Author
-
Reay, Rebecca E, Maguire, Paul A, and Looi, Jeffrey CL
- Subjects
- *
MEDICAL students , *TRAVEL time (Traffic engineering) , *NONVERBAL cues , *TECHNOLOGY Acceptance Model , *TELEPSYCHIATRY , *SIMULATED patients - Abstract
Objective: The Objective Structured Clinical Examination (OSCE) has been used for clinical assessment of a broad range of medical student competencies in Psychiatry and Addiction Medicine. However, there has been little research into online assessments. We investigated the virtual OSCE (v-OSCE) from the user perspective to better understand its acceptability, usefulness, benefits, challenges and potential improvements. Methods: At the conclusion of the v-OSCE, all participants (medical students, examiners and simulated patients) were invited to participate in a brief online survey, based on the Technology and Acceptance Model. Freeform qualitative feedback was also obtained to explore participants' experiences and attitudes. Results: Participants reported the v-OSCE was acceptable, efficient, convenient and easy to use. It was perceived as useful for demonstrating students' interviewing skills and interacting with the simulated patient. Benefits included greater convenience, reduced stress and travel time. Challenges were similar to those experienced in 'real world' telepsychiatry, primarily related to assessment of non-verbal cues and emotional prosody. Conclusions: Our findings inform recommendations for improving online examinations. These include increased preparation, practice and professionalism, to better simulate the in-person experience. Study credibility was strengthened by the triangulation of qualitative, quantitative and psychometric data. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
12. Clues for improvement of research in objective structured clinical examination
- Author
-
Jean Philippe Foy, Laure Serresse, Maxens Decavèle, Manon Allaire, Nadia Nathan, Marie Christine Renaud, Nada Sabourdin, Yasmine Souala-Chalet, Yanis Tamzali, Jessica Taytard, Mélanie Tran, Fleur Cohen, Hugo Bottemanne, and Antoine Monsel
- Subjects
OSCE ,objective structured clinical examination ,scientometry ,bibliometry ,scientific network ,Special aspects of education ,LC8-6691 ,Medicine (General) ,R5-920 - Abstract
While objective clinical structured examination (OSCE) is a worldwide recognized and effective method to assess clinical skills of undergraduate medical students, the latest Ottawa conference on the assessment of competences raised vigorous debates regarding the future and innovations of OSCE. This study aimed to provide a comprehensive view of the global research activity on OSCE over the past decades and to identify clues for its improvement. We performed a bibliometric and scientometric analysis of OSCE papers published until March 2024. We included a description of the overall scientific productivity, as well as an unsupervised analysis of the main topics and the international scientific collaborations. A total of 3,224 items were identified from the Scopus database. There was a sudden spike in publications, especially related to virtual/remote OSCE, from 2020 to 2024. We identified leading journals and countries in terms of number of publications and citations. A co-occurrence term network identified three main clusters corresponding to different topics of research in OSCE. Two connected clusters related to OSCE performance and reliability, and a third cluster on student’s experience, mental health (anxiety), and perception with few connections to the two previous clusters. Finally, the United States, the United Kingdom, and Canada were identified as leading countries in terms of scientific publications and collaborations in an international scientific network involving other European countries (the Netherlands, Belgium, Italy) as well as Saudi Arabia and Australia, and revealed the lack of important collaboration with Asian countries. Various avenues for improving OSCE research have been identified: i) developing remote OSCE with comparative studies between live and remote OSCE and issuing international recommendations for sharing remote OSCE between universities and countries; ii) fostering international collaborative studies with the support of key collaborating countries; iii) investigating the relationships between student performance and anxiety.
- Published
- 2024
- Full Text
- View/download PDF
13. Exploring effective video-review strategies of patient encounters for medical students: precepted review versus peer discussion
- Author
-
Kye-Yeung Park, Ye Ji Kang, Hoon-Ki Park, and Hwan-Sik Hwang
- Subjects
Feedback ,objective structured clinical examination ,peer ,preceptor ,remediation ,video ,Special aspects of education ,LC8-6691 ,Medicine (General) ,R5-920 - Abstract
Background Video-recordings review of patient encounters is reported to improve the clinical performance of medical students. However, evidence on specific remediation strategies or outcomes are lacking. We aimed to implement videorecording-based remediation of standardized patient encounters among medical students, combined with preceptor one-on-one feedback or peer group discussion, and evaluate the effectiveness of the two remediation methods using objective structured clinical examination (OSCE).Methods Following standardized patient encounters, 107 final-year medical students were divided into two groups based on different remediation methods of video review: (1) precepted video review with preceptor feedback (N = 55) and (2) private video review and subsequent peer group discussion under supervision (N = 52). All students underwent twelve-stations of OSCE both before and after the video review. Students’ pre- and post-remediation OSCE scores, self-efficacy level in patient encounters, and level of educational satisfaction with each method were assessed and compared between different video-based remediation methods to evaluate their respective effects.Results After remediation, the total and subcomponent OSCE scores, such as history taking, physical examination, and patient – physician interaction (PPI), among all students increased significantly. Post-remediation OSCE scores showed no significant difference between two remediation methods (preceptor module, 79.6 ± 4.3 vs. peer module, 79.4 ± 3.8 in the total OSCE score). Students’ self-efficacy levels increased after remediation in both modules (both p-value
- Published
- 2024
- Full Text
- View/download PDF
14. Standard setting OSCE: A comparison of arbitrary and Hofstee methods in a low stake OSCE
- Author
-
Uzma Khan
- Subjects
objective structured clinical examination ,standard setting ,hofstee method ,arbitrary method ,Education (General) ,L7-991 ,Medicine (General) ,R5-920 - Abstract
Objectives: To compare the cut scores and pass/fail rates achieved by arbitrary 60% method and Hofstee method in an undergraduate year 4 end semester objective structured clinical examination (OSCE) and check the possibility of using Hofstee method of standard setting in future exams. Method: 102 medical students of year 4 underwent a 10 station OSCE exam conducted in a state of art simulation lab in 3 cycles. The cut scores were calculated using arbitrary method aiming at 60% of task achievement and by Hofstee method. The student’s obtained scores were compared for cut scores and pass rates for individual stations and the entire exam. Results: The arbitrary and Hofstee methods of standard setting leads to different cut scores. For the individual stations it was 60% vs 65-70% and for the overall score it was 60% vs 70%. The percentage of students failing the exam is 13.7% based on arbitrary scores and is 29.4% when Hofstee cut score is applied. Conclusions: The two methods lead to different cut scores and students’ failure rates. Overall, Hofstee method is more appropriate for assessing competencies in an OSCE exam in medical schools as it leads to calculation of cut scores based on the difficulty level of the station/exam and the examiners expected level of performance by the students.
- Published
- 2024
- Full Text
- View/download PDF
15. Raters and examinees training for objective structured clinical examination: comparing the effectiveness of three instructional methodologies
- Author
-
Jefferson Garcia Guerrero, Ayidah Sanad Alqarni, Lorraine Turiano Estadilla, Lizy Sonia Benjamin, and Vanitha Innocent Rani
- Subjects
Instructional methodology ,Simulation-based learning ,Traditional lectures ,Online instructions ,Objective structured clinical examination ,Nursing ,RT1-120 - Abstract
Abstract Background Utilizing the objective structured clinical examination (OSCE) ensures objectivity when it comes to the assessment of nursing students’ skills and competency. However, one challenge in OSCE integration is rater and examinee training and orientation. Aim This study employed a quasi-experimental design to evaluate the effectiveness of different instructional methodologies in training and preparing raters and examinees for the OSCE. Methods Participants were divided into three group of training methodologies: online, simulation, and traditional lecture (six raters and 18 examinees were assigned to each group). A total of 18 raters and 54 examinees partook. Results The study found that raters trained through simulation exhibited a slight agreement with their rates, compared to those who were trained online and in traditional lectures. Moreover, examinees who were trained through the simulation methodology performed better compared to those trained via the other methodologies. Conclusions The study findings indicate that using simulation by training raters and examinees in the OSCE is the most effective approach.
- Published
- 2024
- Full Text
- View/download PDF
16. Analysis of satisfaction levels and perceptions of clinical competency: a mixed method study on objective structured clinical examinations in undergraduate dental students
- Author
-
Naseer Ahmed, Samiya Aziz, Rizwan Jouhar, Muneeba Rehmat, Afsheen Maqsood, Resham Nadeem, Laraib Magsi, and Artak Heboyan
- Subjects
Objective structured clinical examination ,Clinical competencies ,Dental students ,Student satisfaction ,Focus group interviews ,OSCE effectiveness ,Special aspects of education ,LC8-6691 ,Medicine - Abstract
Abstract Objective To analyze the satisfaction levels, perceptions of developing clinical competencies through objective structured clinical examination and to explore the experiences, challenges, and suggestions of undergraduate dental students. Methods The study adopted a mixed-method convergent design. Quantitative data were collected from 303 participants through surveys, evaluating satisfaction levels with objective structured clinical examination (OSCE). Additionally, qualitative insights were gathered through student focus group interviews, fundamental themes were developed from diverse expressions on various aspects of OSCE assessments. The Chi-Square tests, was performed to assess associations between variables. Data integration involved comparing and contrasting quantitative and qualitative findings to derive comprehensive conclusions. Results The satisfaction rates include 69.4% for the organization of OSCE stations and 57.4% for overall effectiveness. However, a crucial challenge was identified, with only 36.7% of students receiving adequate post-OSCE feedback. Furthermore, a majority of students (50%) expressed concerns about the clinical relevance of OSCEs. The study showed a significant associations (p
- Published
- 2024
- Full Text
- View/download PDF
17. Situational simulation teaching effectively improves dental students’ non-operational clinical competency and objective structured clinical examination performance
- Author
-
Ju-Hui Wu, Pei Chen Lin, Kun-Tsung Lee, Hsin-Liang Liu, Peih-Ying Lu, and Chen-Yi Lee
- Subjects
Clinical simulation education ,Simulated patient ,Objective structured clinical examination ,Undergraduate dental students ,Special aspects of education ,LC8-6691 ,Medicine - Abstract
Abstract Background Appropriate communication with dental patients enhances treatment outcomes and patient satisfaction. Implementing simulated patient interviews courses can improve patient-centered care and reduce conflict during clerkship training. Therefore, this study explored the relationship among student participation in a situational simulation course (SSC), academic performance, clerkship performance, and objective structured clinical examination (OSCE) performance. Methods This study was conducted with a sample of fifth-year dental students undergoing clerkship training. After implementing a situational simulation course to investigate the relationship among participation in SSC, academic performance, clerkship performance, and OSCE performance, a path analysis model was developed and tested. Results Eighty-seven fifth-year dental students were eligible for the SSC, and most (n = 70, 80.46%) volunteered to participate. The path analysis model revealed that academic performance had a direct effect on OSCE performance (β = 0.281, P = 0.003) and clerkship performance (β = 0.441, P
- Published
- 2024
- Full Text
- View/download PDF
18. Raters and examinees training for objective structured clinical examination: comparing the effectiveness of three instructional methodologies.
- Author
-
Guerrero, Jefferson Garcia, Alqarni, Ayidah Sanad, Estadilla, Lorraine Turiano, Benjamin, Lizy Sonia, and Rani, Vanitha Innocent
- Subjects
- *
NURSING audit , *RESEARCH funding , *DATA analysis , *EDUCATIONAL outcomes , *STATISTICAL sampling , *QUESTIONNAIRES , *TEACHING methods , *RANDOMIZED controlled trials , *DESCRIPTIVE statistics , *SIMULATION methods in education , *ONLINE education , *RESEARCH methodology , *STATISTICS , *ANALYSIS of variance , *NATIONAL competency-based educational tests , *DATA analysis software , *NURSING students , *PROFESSIONAL competence - Abstract
Background: Utilizing the objective structured clinical examination (OSCE) ensures objectivity when it comes to the assessment of nursing students' skills and competency. However, one challenge in OSCE integration is rater and examinee training and orientation. Aim: This study employed a quasi-experimental design to evaluate the effectiveness of different instructional methodologies in training and preparing raters and examinees for the OSCE. Methods: Participants were divided into three group of training methodologies: online, simulation, and traditional lecture (six raters and 18 examinees were assigned to each group). A total of 18 raters and 54 examinees partook. Results: The study found that raters trained through simulation exhibited a slight agreement with their rates, compared to those who were trained online and in traditional lectures. Moreover, examinees who were trained through the simulation methodology performed better compared to those trained via the other methodologies. Conclusions: The study findings indicate that using simulation by training raters and examinees in the OSCE is the most effective approach. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
19. Standard setting OSCE: A comparison of arbitrary and Hofstee methods in a low stake OSCE.
- Author
-
Khan, Uzma
- Subjects
- *
MEDICAL education examinations , *MEDICAL students - Abstract
Objectives: To compare the cut scores and pass/fail rates achieved by arbitrary 60% method and Hofstee method in an undergraduate year 4 end semester objective structured clinical examination (OSCE) and check the possibility of using Hofstee method of standard setting in future exams. Method: 102 medical students of year 4 underwent a 10 station OSCE exam conducted in a state of art simulation lab in 3 cycles. The cut scores were calculated using arbitrary method aiming at 60% of task achievement and by Hofstee method. The student’s obtained scores were compared for cut scores and pass rates for individual stations and the entire exam. Results: The arbitrary and Hofstee methods of standard setting leads to different cut scores. For the individual stations it was 60% vs 65-70% and for the overall score it was 60% vs 70%. The percentage of students failing the exam is 13.7% based on arbitrary scores and is 29.4% when Hofstee cut score is applied. Conclusions: The two methods lead to different cut scores and students’ failure rates. Overall, Hofstee method is more appropriate for assessing competencies in an OSCE exam in medical schools as it leads to calculation of cut scores based on the difficulty level of the station/exam and the examiners expected level of performance by the students. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
20. Assessment of an observed clinical skills exam in undergraduate medical education: a patient with opioid use disorder and chronic pain.
- Author
-
Sobel, Halle G., Kennedy, Amanda G., Holterman, Leigh Ann, Brooklyn, John, Hillios, Angelika, Nicholas, Cate, and Riser, Elly
- Subjects
- *
SUBSTANCE abuse , *PROFESSIONALISM , *MEDICAL education , *CHRONIC pain , *RESEARCH funding , *UNDERGRADUATES , *PILOT projects , *DESCRIPTIVE statistics , *EDUCATIONAL tests & measurements , *MEDICAL students , *CLINICAL competence , *SIMULATED patients , *NARCOTICS , *ACADEMIC achievement , *COMMUNICATION , *RESEARCH methodology , *NATIONAL competency-based educational tests - Abstract
It is crucial that future physicians understand the nature of opioid use disorder (OUD). We designed a pilot Observed Structured Clinical Examination (OSCE) using simulated patients (SPs) experiencing OUD with concurrent chronic pain. The case was piloted in 2021 and 2022 during the multi-station OSCE that all the medical school clerkship students take at the end of their third year of medical school. A total of 111 medical students completed the OSCE in 2021 and 93 in 2022. The authors developed a case description and an assessment instrument for the SP to evaluate the student's performance on history taking, communication and professionalism. The evaluation was mixed-methods using SP evaluation data and a qualitative assessment of medical students' answers to 4 questions which were analyzed with a priori codes. In both years, the total scores for the case were slightly slower than the established OSCE cases in both years. A total of 75% (148/197) of students who responded to the assessment found the case difficult to manage. Strengths of the case included a majority of the students reporting the case helped them to identify strengths and weakness in assessing and treating OUD. Weaknesses included the lack of enough patient history and the perception that the SP was unrealistic (too nice). This pilot OSCE was challenging for the third year medical students based on the evaluative data. Given the scope of OUD and deaths, training students to identify and treat OUD during undergraduate medical education is of paramount importance. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
21. Implementation of peer‐to‐peer oral care objective structured clinical examination‐based learning for nursing students.
- Author
-
Haresaku, Satoru, Miyoshi, Maki, Muramatsu, Masumi, Monji, Mayumi, Aoki, Hisae, Maeda, Hitomi, Miyazono, Mami, Obuse, Mika, Nakashima, Fuyuko, Uchida, Souhei, Iino, Hidechika, Akinaga, Kazuyuki, Chishaki, Akiko, and Naito, Toru
- Subjects
- *
PSYCHOLOGY of college students , *AFFINITY groups , *QUESTIONNAIRES , *MEDICAL care , *ORAL hygiene , *EDUCATIONAL tests & measurements , *CONFIDENCE , *NURSING schools , *NURSING , *DESCRIPTIVE statistics , *CHI-squared test , *MANN Whitney U Test , *CLINICAL competence , *PROBLEM-based learning , *ONE-way analysis of variance , *BACCALAUREATE nursing education , *HEALTH education , *NATIONAL competency-based educational tests , *COMPARATIVE studies , *DATA analysis software , *NURSING students , *ORAL health , *HEALTH care teams - Abstract
Aim: Nurses' skills and confidence in providing oral care to patients play important roles in healthcare. Studies have proved that peer‐to‐peer learning and assessment can help improve nurses' skills and confidence. However, no study has investigated it using an objective assessment checklist. This study investigated an oral hygiene practice training program for nursing students. It focused on their oral healthcare skills, confidence, and perspectives regarding implementing an objective structured clinical examination (OSCE). Methods: A pre‐ and post‐survey of 97 nursing students from a nursing school in Japan was conducted as a peer‐to‐peer oral health education training program that included an assessment and performance checklist. Results: Confidence in performing and assessing oral care significantly improved after attending the program. Furthermore, the changes were significantly greater in the developed program than in the training program without the checklist. The mean total assessment scores (0–25) of the first, second, third, and fourth participants in the four‐student groups were 22.1, 23.4, 23.9, and 24.1, respectively. The mean scores of the second, third, and fourth participant groups were significantly higher than that of the first participant group (p <.01). Fifty‐two positive and 58 negative comments were received regarding the implementation of the program with professional assessments and the checklist. The most common positive comment mentioned that the evaluation by professionals improved oral care learning and skills. Conclusions: This study developed a program to improve nursing students' confidence and oral care delivery skill building in an OSCE‐style delivery. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
22. Correlation Analysis between Multiple Mini-Interviews during Medical Student Selection and Their Academic Performance.
- Author
-
Adam, Siti Khadijah, Hod, Rafidah, Mahayidin, Hasni, Ahmad, Zalinah, and Salihan, Safuraa
- Subjects
- *
SCHOOL entrance requirements , *MEDICAL students , *ACADEMIC achievement , *MALAY language , *TEST scoring - Abstract
Multiple mini-interviews (MMI) have been used as a tool in the selection of medical students to evaluate their interpersonal and intrapersonal attributes. It is suggested that rigorous evaluation in MMI may predict academic performance during medical training. Thus, this study aims to determine the relationship between MMI scores and subsequent academic performance at the end of the preclinical phase. MMI scores for the academic session 2019/2020 intake in Universiti Putra Malaysia were gathered. The dependent variables were the students' academic performance at the end of the preclinical phase involving the Professional Examination and Professionalism and Personal Development (PPD) course. No significant positive correlation was observed between MMI and total Professional Examination scores. Total MMI and empathy station scores have a weak positive relationship with objective structured clinical examination (OSCE) marks. There was also a significant positive correlation between resilience station scores and PPD peer assessment marks. In contrast, there was a negative correlation between Malay language station scores and the theory component of Professional Examination marks. This study suggests that MMI has the potential to predict in-programme clinical performance and professionalism characteristics. Studies with larger cohorts are essential to support this evidence. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
23. The Effectiveness of High-Fidelity Simulation on Clinical Competence Among Nursing Students.
- Author
-
Nair, Manju Avinash, Muthu, Priyalatha, and Abuijlan, Israa A. M.
- Subjects
REPEATED measures design ,PEARSON correlation (Statistics) ,MEDICAL quality control ,EDUCATIONAL outcomes ,MEDICAL care ,SEX distribution ,NURSING ,DESCRIPTIVE statistics ,CHI-squared test ,SIMULATION methods in education ,CLINICAL competence ,ACADEMIC achievement ,RESEARCH methodology ,ANALYSIS of variance ,BACCALAUREATE nursing education ,NATIONAL competency-based educational tests ,COLLEGE students ,SOCIODEMOGRAPHIC factors ,DATA analysis software ,NURSING students - Abstract
Introduction: Clinical competence is a pre-requisite for every student nurse to showcase their proficiency in providing quality nursing care. Effective clinical experience during the study period plays a pivotal role in developing clinical competence among nursing students. Hence, the purpose of the study was to find the effectiveness of high fidelity simulation (HFS) on clinical competence among nursing students. Objectives: The objectives of the study were to determine the impact of HFS on level of clinical competence among nursing students, to find the association between selected demographic characteristics of nursing students with their level of clinical competence and also, to find the association between academic performances of nursing students with their level of competence. Method: The current study employed a quasi-experimental study design. Sixty-five nursing students from second year Bachelor of Science in Nursing (BSN) program were selected using consecutive sampling technique. The data was collected using demographic data form, objective structured clinical examination (OSCE) grade performa, and academic score sheet. SPSS version 24 was used to analyze data. Results: The study revealed a significant impact of HFS on clinical competence of nursing students. Majority (52.3%) of the nursing students obtained high level clinical competence following the HFS. The findings showed a significant association between gender and medium of instruction with the level of clinical competence of nursing students. Further, there was a significant correlation between academic performance and level of clinical competence of the nursing students. Conclusion: HFS served as a useful pedagogical approach in fulfilling the clinical learning outcomes. It further facilitated readiness of nursing students in second year BSN in terms of developing competence and confidence for clinical placement at the hospital for the third year of their study. However, further research is required to determine if HFS can be used in developing clinical reasoning skills in nursing students. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
24. Evaluation of the implementation of the objective structured clinical examination in health sciences education from a low‐income context in Tunisia: A cross‐sectional study.
- Author
-
Ben Amor, Asma, Farhat, Hassan, Alinier, Guillaume, Ounallah, Amina, and Bouallegue, Olfa
- Subjects
ALLIED health education ,PERIODIC health examinations ,RESOURCE-limited settings ,CLINICAL competence ,STUDENTS ,MEDICAL education examinations - Abstract
Background: Objective structured clinical examination (OSCE) is well‐established and designed to evaluate students' clinical competence and practical skills in a standardized and objective manner. While OSCEs are widespread in higher‐income countries, their implementation in low‐resource settings presents unique challenges that warrant further investigation. Aim: This study aims to evaluate the perception of the health sciences students and their educators regarding deploying OSCEs within the School of Health Sciences and Techniques of Sousse (SHSTS) in Tunisia and their efficacity in healthcare education compared to traditional practical examination methods. Methods: This cross‐sectional study was conducted in June 2022, focusing on final‐year Health Sciences students at the SHSTS in Tunisia. The study participants were students and their educators involved in the OSCEs from June 6th to June 11th, 2022. Anonymous paper‐based 5‐point Likert scale satisfaction surveys were distributed to the students and their educators, with a separate set of questions for each. Spearman, Mann–Whitney U and Krusakll–Wallis tests were utilized to test the differences in satisfaction with the OSCEs among the students and educators. The Wilcoxon Rank test was utilized to examine the differences in students' assessment scores in the OSCEs and the traditional practical examination methods. Results: The satisfaction scores were high among health sciences educators and above average for students, with means of 3.82 ± 1.29 and 3.15 ± 0.56, respectively. The bivariate and multivariate analyzes indicated a significant difference in the satisfaction between the students' specialities. Further, a significant difference in their assessment scores distribution in the practical examinations and OSCEs was also demonstrated, with better performance in the OSCEs. Conclusion: Our study provides evidence of the relatively high level of satisfaction with the OSCEs and better performance compared to the traditional practical examinations. These findings advocate for the efficacy of OSCEs in low‐income countries and the need to sustain them. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
25. Objective structured clinical examination to teach competency in planetary health care and management – a prospective observational study
- Author
-
Ulf Teichgräber, Maja Ingwersen, Max-Johann Sturm, Jan Giesecke, Manuel Allwang, Ida Herzog, Frederike von Gierke, Paul Schellong, Matthias Kolleg, Kathleen Lange, Daniel Wünsch, Katrin Gugel, Anne Wünsch, Janine Zöllkau, Inga Petruschke, Kristin Häseler-Ouart, Bianca Besteher, Swetlana Philipp, Urte Mille, Dominique Ouart, Jana Jünger, and Jena Planetary Health Collaboration Group
- Subjects
Climate change ,Communication ,Curriculum ,Feedback ,Objective structured clinical examination ,Planetary health ,Special aspects of education ,LC8-6691 ,Medicine - Abstract
Abstract Background Health professionals are increasingly called upon and willing to engage in planetary health care and management. However, so far, this topic is rarely covered in medical curricula. As the need for professional communication is particularly high in this subject area, this study aimed to evaluate whether the objective structured clinical examination (OSCE) could be used as an accompanying teaching tool. Methods During the winter semester 2022/2023, 20 third- and fifth-year medical students voluntarily participated in a self-directed online course, three workshops, and a formal eight-station OSCE on planetary health care and management. Each examinee was also charged alternatingly as a shadower with the role of providing feedback. Experienced examiners rated students’ performance using a scoring system supported by tablet computers. Examiners and shadowers provided timely feedback on candidates` performance in the OSCE. Immediately after the OSCE, students were asked about their experience using a nine-point Likert-scale survey and a videotaped group interview. Quantitative analysis included the presentation of the proportional distribution of student responses to the survey and of box plots showing percentages of maximum scores for the OSCE performance. The student group interview was analyzed qualitatively. Results Depending on the sub-theme, 60% -100% of students rated the subject of planetary health as likely to be useful in their professional lives. Similar proportions (57%-100%) were in favour of integrating planetary health into required courses. Students perceived learning success from OSCE experience and feedback as higher compared to that from online courses and workshops. Even shadowers learned from observation and feedback discussions. Examiners assessed students’ OSCE performance at a median of 80% (interquartile range: 83%-77%) of the maximum score. Conclusions OSCE can be used as an accompanying teaching tool for advanced students on the topic of planetary health care and management. It supports learning outcomes, particularly in terms of communication skills to sensitise and empower dialogue partners, and to initiate adaptation steps at the level of individual patients and local communities.
- Published
- 2024
- Full Text
- View/download PDF
26. Developing an innovative national ACP-OSCE program in Taiwan: a mixed method study
- Author
-
Yen-Lin Wu, Tsu-Yi Hsieh, Sheau-Feng Hwang, Yi-Yin Lin, and Wei-Min Chu
- Subjects
Advance care planning ,Objective structured clinical examination ,Medical education ,Communication ,Mix-method study ,Special aspects of education ,LC8-6691 ,Medicine - Abstract
Abstract Objectives To evaluate the process and the comprehensiveness of advance care planning (ACP), we designed a national ACP-OSCE (Objective Structured Clinical Examination) program. Methods The program was designed as a 40-minute OSCE test. Participants were categorized as different ACP team members to illustrate realistic scenarios. Preceptors were asked to observe ACP professionals’ actions, responses, and communication skills during ACP with standardized patients (SP) through a one-way mirror. Participants’ communication skills, medical expertise, legal knowledge, empathetic response and problem-solving skills of ACP were also self-evaluated before and after OSCE. Thematic analysis was used for qualitative analysis. Results In Nov 2019, a total of 18 ACP teams with 38 ACP professionals completed the ACP-OSCE program, including 15 physicians, 15 nurses, 5 social workers, and 3 psychologists. After the ACP-OSCE program, the average score of communication skills, medical expertise, legal knowledge, empathetic response, ACP problem-solving all increased. Nurses felt improved in medical expertise, legal knowledge, and problem-solving skills, psychologists and social workers felt improved in legal knowledge, while physicians felt no improved in all domain, statistically. Thematic analysis showed professional skills, doctoral-patient communication, benefit and difficulties of ACP were the topics which participants care about. Meanwhile, most participants agreed that ACP-OSCE program is an appropriate educational tool. Conclusion This is the first national ACP-OSCE program in Asia. We believe that this ACP-OSCE program could be applied in other countries to improve the ACP process and quality.
- Published
- 2024
- Full Text
- View/download PDF
27. Analysis of satisfaction levels and perceptions of clinical competency: a mixed method study on objective structured clinical examinations in undergraduate dental students
- Author
-
Ahmed, Naseer, Aziz, Samiya, Jouhar, Rizwan, Rehmat, Muneeba, Maqsood, Afsheen, Nadeem, Resham, Magsi, Laraib, and Heboyan, Artak
- Published
- 2024
- Full Text
- View/download PDF
28. Situational simulation teaching effectively improves dental students’ non-operational clinical competency and objective structured clinical examination performance
- Author
-
Wu, Ju-Hui, Lin, Pei Chen, Lee, Kun-Tsung, Liu, Hsin-Liang, Lu, Peih-Ying, and Lee, Chen-Yi
- Published
- 2024
- Full Text
- View/download PDF
29. Developing an innovative national ACP-OSCE program in Taiwan: a mixed method study
- Author
-
Wu, Yen-Lin, Hsieh, Tsu-Yi, Hwang, Sheau-Feng, Lin, Yi-Yin, and Chu, Wei-Min
- Published
- 2024
- Full Text
- View/download PDF
30. Objective structured clinical examination to teach competency in planetary health care and management – a prospective observational study
- Author
-
Teichgräber, Ulf, Ingwersen, Maja, Sturm, Max-Johann, Giesecke, Jan, Allwang, Manuel, Herzog, Ida, von Gierke, Frederike, Schellong, Paul, Kolleg, Matthias, Lange, Kathleen, Wünsch, Daniel, Gugel, Katrin, Wünsch, Anne, Zöllkau, Janine, Petruschke, Inga, Häseler-Ouart, Kristin, Besteher, Bianca, Philipp, Swetlana, Mille, Urte, Ouart, Dominique, and Jünger, Jana
- Published
- 2024
- Full Text
- View/download PDF
31. Impact of a Mock OSCE on Student Confidence in Applying the Pharmacists' Patient Care Process.
- Author
-
Cristobal, Eleonso, Perkins, Kathryn, Kang, Connie, and Chen, Steven
- Subjects
PHARMACIST-patient relationships ,PATIENT care ,PHARMACY students ,CLINICAL competence ,GROUPOIDS ,SIMULATED patients ,PHARMACY colleges - Abstract
The Medical and Pharmacy Student Collaboration (MAPSC) student organization at the University of Southern California, Alfred E. Mann School of Pharmacy and Pharmaceutical Sciences, created an extracurricular, peer-led, virtual group mock objective structured clinical examination (MOSCE) to expose first-year pharmacy students (P1s) to the Pharmacists' Patient Care Process (PPCP). The purpose of this study is to evaluate the impact of a MAPSC MOSCE on P1s self-reported confidence in applying the PPCP and on patient communication, medication knowledge, and clinical skills. An anonymous, optional, self-reported survey was administered to P1s before and after the event, where they rated their confidence on a scale of 0–100 (0 = not confident, 100 = certainly confident). The statistical analysis was a paired two-tailed t-test with a significance level of p < 0.05. A total of 152 P1s and 30 facilitators attended the MOSCE. One hundred thirty-nine students met the inclusion criteria and were included in the data analysis. There was a statistically significant difference in the change in self-reported confidence for all PPCP components and learning outcomes. The results of our study strongly indicate that introducing P1 students to the PPCP through a MAPSC MOSCE format is a valuable experience. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
32. The Psychometric Quality of Objective Structured Clinical Examinations Within Psychology Programs: A Systematic Review.
- Author
-
Vhora, Azaan, Davies, Ryan L., and Rice, Kylie
- Subjects
PSYCHOLOGY education ,EDUCATIONAL programs ,QUALITY assurance - Abstract
Background: Objective Structured Clinical Examinations (OSCEs) are a simulation-based assessment tool used extensively in medical education for evaluating clinical competence. OSCEs are widely regarded as more valid, reliable, and valuable compared to traditional assessment measures, and are now emerging within professional psychology training programs. While there is a lack of findings related to the quality of OSCEs in published psychology literature, psychometric properties can be inferred by investigating implementation. Accordingly, the current review assessed implementation of OSCEs within psychology programs against a set of Quality Assurance Guidelines (QAGs). Methods: A systematic review was conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) recommendations. Electronic databases including ProQuest Psychology, PsycArticles, Psychology and Behavioural Sciences Collection, PsycInfo and key indexing databases such as Scopus, ProQuest, and Web of Science were used to identify relevant articles. Twelve full-text articles met all inclusion criteria and were included in the review. Results: There was considerable heterogeneity in the quality of studies and reporting of OSCE data. Implementation of OSCEs against QAGs revealed overall adherence to be "Fair." Conclusion: The current review consolidated what is known on psychometric quality of OSCEs within psychology programs. A further need for quantitative evidence on psychometric soundness of OSCEs within psychology training is highlighted. Furthermore, it is recommended that future training programs implement and report OSCEs in accordance with standardized guidelines. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
33. Interrater reliability in neurology objective structured clinical examination across specialties.
- Author
-
Mechtouff, Laura, Balanca, Baptiste, Jung, Julien, Bourgeois-Vionnet, Julie, Dumot, Chloé, Guery, Déborah, Picart, Thiébaud, Bapteste, Lionel, Demarquay, Geneviève, Bani-Sadr, Alexandre, Rascle, Lucie, Berthezène, Yves, Jacquesson, Timothée, Amaz, Camille, Macabrey, Juliette, Ramos, Inès, Viprey, Marie, Rode, Gilles, and Cortet, Marion
- Subjects
- *
OCCUPATIONAL roles , *NEUROLOGY , *CONFIDENCE intervals , *MULTIVARIATE analysis , *REGRESSION analysis , *INTER-observer reliability , *EDUCATIONAL tests & measurements , *CLINICAL competence , *INTRACLASS correlation , *EDUCATORS , *NEUROLOGIC examination , *MEDICAL specialties & specialists , *VIDEO recording , *EVALUATION - Abstract
To assess interrater reliability and examiners' characteristics, especially specialty, associated with scoring of neurology objective structured clinical examination (OSCE). During a neurology mock OSCE, five randomly chosen students volunteers were filmed while performing 1 of the 5 stations. Video recordings were scored by physicians from the Lyon and Clermont-Ferrand university teaching hospitals to assess students performance using both a checklist scoring and a global rating scale. Interrater reliability between examiners were assessed using intraclass coefficient correlation. Multivariable linear regression models including video recording as random effect dependent variable were performed to detect factors associated with scoring. Thirty examiners including 15 (50%) neurologists participated. The intraclass correlation coefficient of checklist scores and global ratings between examiners were 0.71 (CI95% [0.45-0.95]) and 0.54 (CI95% [0.28-0.91]), respectively. In multivariable analyses, no factor was associated with checklist scores, while male gender of examiner was associated with lower global rating (β coefficient = –0.37; CI 95% [–0.62–0.11]). Our study demonstrated through a video-based scoring method that agreement among examiners was good using checklist scoring while moderate using global rating scale in neurology OSCE. Examiner's specialty did not affect scoring whereas gender was associated with global rating scale. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
34. Evaluation of the implementation of the objective structured clinical examination in health sciences education from a low‐income context in Tunisia: A cross‐sectional study
- Author
-
Asma Ben Amor, Hassan Farhat, Guillaume Alinier, Amina Ounallah, and Olfa Bouallegue
- Subjects
health sciences ,low‐resource settings ,medical education ,objective structured clinical examination ,reliability ,Medicine - Abstract
Abstract Background Objective structured clinical examination (OSCE) is well‐established and designed to evaluate students' clinical competence and practical skills in a standardized and objective manner. While OSCEs are widespread in higher‐income countries, their implementation in low‐resource settings presents unique challenges that warrant further investigation. Aim This study aims to evaluate the perception of the health sciences students and their educators regarding deploying OSCEs within the School of Health Sciences and Techniques of Sousse (SHSTS) in Tunisia and their efficacity in healthcare education compared to traditional practical examination methods. Methods This cross‐sectional study was conducted in June 2022, focusing on final‐year Health Sciences students at the SHSTS in Tunisia. The study participants were students and their educators involved in the OSCEs from June 6th to June 11th, 2022. Anonymous paper‐based 5‐point Likert scale satisfaction surveys were distributed to the students and their educators, with a separate set of questions for each. Spearman, Mann–Whitney U and Krusakll–Wallis tests were utilized to test the differences in satisfaction with the OSCEs among the students and educators. The Wilcoxon Rank test was utilized to examine the differences in students' assessment scores in the OSCEs and the traditional practical examination methods. Results The satisfaction scores were high among health sciences educators and above average for students, with means of 3.82 ± 1.29 and 3.15 ± 0.56, respectively. The bivariate and multivariate analyzes indicated a significant difference in the satisfaction between the students' specialities. Further, a significant difference in their assessment scores distribution in the practical examinations and OSCEs was also demonstrated, with better performance in the OSCEs. Conclusion Our study provides evidence of the relatively high level of satisfaction with the OSCEs and better performance compared to the traditional practical examinations. These findings advocate for the efficacy of OSCEs in low‐income countries and the need to sustain them.
- Published
- 2024
- Full Text
- View/download PDF
35. Novel use of an OSCE to assess medical students’ responses to a request for a low value diagnostic imaging test: A mixed methods analysis
- Author
-
Oza, Sandra K, Joo, Pablo, Grochowalski, Joseph H, Rougas, Steven, George, Paul, and Milan, Felise
- Subjects
Pain Research ,Clinical Research ,Biomedical Imaging ,Detection ,screening and diagnosis ,4.2 Evaluation of markers and technologies ,Clinical Competence ,Communication ,Diagnostic Imaging ,Educational Measurement ,Humans ,Physical Examination ,Students ,Medical ,Objective structured clinical examination ,Standardized patient ,High-value care ,Measure of patient centered communication ,Physician stewardship ,Medical and Health Sciences ,Psychology and Cognitive Sciences ,Public Health ,Health services and systems - Abstract
ObjectiveEvaluate medical students' communication skills with a standardized patient (SP) requesting a low value test and describe challenges students identify in addressing the request.MethodsIn this mixed-methods study, third-year students from two medical schools obtained a history, performed a physical examination, and counseled an SP presenting with uncomplicated low back pain who requests an MRI which is not indicated. SP raters evaluated student communication skills using a 14-item checklist. Post-encounter, students reported whether they ordered an MRI and challenges faced.ResultsStudents who discussed practice guidelines and risks of unnecessary testing with the SP were less likely to order an MRI. Students cited several challenges in responding to the SP request including patient characteristics and circumstances, lack of knowledge about MRI indications and alternatives, and lack of communication skills to address the patient request.ConclusionsMost students did not order an MRI for uncomplicated LBP, but only a small number of students educated the patient about the evidence to avoid unnecessary imaging or the harm of unnecessary testing.Practice implicationsKnowledge about unnecessary imaging in uncomplicated LBP may be insufficient to adhere to best practices and longitudinal training in challenging conversations is needed.
- Published
- 2022
36. Progress testing of an objective structured clinical examination during undergraduate clinical clerkship: a mixed-methods pilot study
- Author
-
Ikuo Shimizu, Junichiro Mori, Aiga Yamauchi, Sawako Kato, Yuichi Masuda, Yuichi Nakazawa, and Hiroyuki Kanno
- Subjects
Clinical clerkship ,Objective structured clinical examination ,Progress testing ,Rating scale ,Self-directed learning ,Special aspects of education ,LC8-6691 ,Medicine - Abstract
Abstract Background Progress testing is an assessment method in which an examination reflecting competencies at graduation is regularly administered to students over multiple years, thereby facilitating self-directed learning. However, the significance of the objective structured clinical examination as a progress test in undergraduate education, needs to be determined. This study provides evidence of the role of the objective structured clinical examination for progress testing and optimal scoring methods for assessing students in different academic years. Methods We conducted a sequential explanatory mixed-methods pilot study. Participants were assessed using the Item Rating Scale, the year-adjusted Global Rating Scale, and the Training Level Rating Scale. The characteristics of each scale were compared quantitatively. In addition, the influence of the objective structured clinical examination as a progress test on learning attitudes was examined. Qualitative data from a post-examination questionnaire were analyzed, using content analysis to explore influences on self-directed learning. Results Sixth and fifth year clinical students (n = 235) took the objective structured clinical examination progress test. The total Item Rating Scales were recorded (%) as 59.03 ± 5.27 and 52.64 ± 5.08 (p
- Published
- 2023
- Full Text
- View/download PDF
37. Effects of online frame-of-reference training on assessment accuracy in the objective structured clinical examination for physical therapy students
- Author
-
Tetsuro Watari, Kei Ohtsuka, Yukari Suzuki, Fumihiro Matsuda, Soichiro Koyama, Naoki Aizu, Yoshikiyo Kanada, and Hiroaki Sakurai
- Subjects
objective structured clinical examination ,rater ,frame-of-reference training ,accuracy ,online ,Medicine (General) ,R5-920 - Abstract
Objectives: This study investigates how online frame-of-reference (FOR) training of raters of the objective structured clinical examination (OSCE) for physical therapy students affects assessment accuracy. Methods: The research was conducted in a 1-month-long randomized controlled trial. Participants: The participants were 36 physical therapists without experience assessing clinical skills using the OSCE. The training group completed the FOR training online, which was conducted once a week in two 90-minute sessions. The control group self-studied the rubric rating chart used in the assessment. As a measure of accuracy, weighted kappa coefficients were used to check the agreement between correct score and those assessment by the participant in the OSCE. Results: The scores of the training group were higher than those of the control group in both post- and follow-up assessments, showing significant differences. No significant difference was found based on the assessment time and group for the high-agreement groups. Furthermore, scores of the low-accuracy training group were higher in the post- and follow-up assessments than those in the pre-assessment, showing significant differences. Conclusions: Online FOR training of the raters of the OSCE for physical therapists improved the assessment accuracy of the raters who had low accuracy in the pre-assessment; this improvement was maintained.
- Published
- 2023
- Full Text
- View/download PDF
38. Assessing clinical reasoning in the OSCE: pilot-testing a novel oral debrief exercise
- Author
-
Alexis Régent, Harish Thampy, and Mini Singh
- Subjects
Clinical reasoning assessment ,Oral debrief ,Objective structured clinical examination ,Special aspects of education ,LC8-6691 ,Medicine - Abstract
Abstract Introduction Clinical reasoning (CR) is a complex skill enabling transition from clinical novice to expert decision maker. The Objective Structured Clinical Examination (OSCE) is widely used to evaluate clinical competency, though there is limited literature exploring how this assessment is best used to assess CR skills. This proof-of-concept study explored the creation and pilot testing of a post-station CR assessment, named Oral Debrief (OD), in the context of undergraduate medical education. Methods A modified-Delphi technique was used to create a standardised domain-based OD marking rubric encapsulating the key skills of CR that drew upon existing literature and our existing placement-based CR tool. 16 OSCE examiners were recruited to score three simulated OD recordings that were scripted to portray differing levels of competency. Adopting a think-aloud approach, examiners vocalised their thought processes while utilising the rubric to assess each video. Thereafter, semi-structured interviews explored examiners’ views on the OD approach. Recordings were transcribed, anonymised and analysed deductively and inductively for recurring themes. Additionally, inter-rater agreement of examiners’ scoring was determined using the Fleiss Kappa statistic both within group and in comparison to a reference examiner group. Results The rubric achieved fair to good levels of inter-rater reliability metrics across its constituent domains and overall global judgement scales. Think-aloud scoring revealed that participating examiners considered several factors when scoring students’ CR abilities. This included the adoption of a confident structured approach, discriminating between relevant and less-relevant information, and the ability to prioritise and justify decision making. Furthermore, students’ CR skills were judged in light of potential risks to patient safety and examiners’ own illness scripts. Feedback from examiners indicated that whilst additional training in rubric usage would be beneficial, OD offered a positive approach for examining CR ability. Conclusion This pilot study has demonstrated promising results for the use of a novel post-station OD task to evaluate medical students’ CR ability in the OSCE setting. Further work is now planned to evaluate how the OD approach can most effectively be implemented into routine assessment practice.
- Published
- 2023
- Full Text
- View/download PDF
39. Comparison of Baseline and Test Day Cardiovascular Parameters, Anxiety Scores and Coffee Consumption Among Medical Students Undergoing Objective Structured Clinical Examinations in Jordan
- Author
-
Alhawari H, Alshelleh S, Alzoubi O, Khanfar AN, Akiely R, Abdallah B, Hajjaj N, Alkhalaileh S, and Khader Y
- Subjects
blood pressure ,anxiety ,stress ,objective structured clinical examination ,osce ,Medicine (General) ,R5-920 - Abstract
Hussein Alhawari,1 Sameeha Alshelleh,1 Osama Alzoubi,1 Asim N Khanfar,1 Reem Akiely,1 Bayan Abdallah,1 Nada Hajjaj,1 Saja Alkhalaileh,1 Yousef Khader2 1Department of Internal Medicine, School of Medicine, The University of Jordan, Amman, Jordan; 2Department of Public Health, Jordan University of Science and Technology, Irbid, JordanCorrespondence: Hussein Alhawari, Department of Internal Medicine, School of Medicine, The University of Jordan, Amman, 11942, Jordan, Email h.alhawari@ju.edu.joIntroduction: Objective Structured Clinical Examinations (OSCEs) are considered an integral part of the assessment process of many schools of medicine worldwide. Close monitoring by examiners, scrutinized interactions with patients, and fear of the unknown, among other factors have been reported to cause psychological stress among students during the examinations period. In this study, we aimed to assess changes in cardiovascular parameters, anxiety scores, and lifestyle patterns of medical students during their OSCEs as compared to their baseline.Materials and Methods: We recruited healthy medical students from our institution’s medical school. General demographics, academic, and baseline lifestyle characteristics were collected 1– 2 months before the OSCE day. The Generalized Anxiety Disorder 7-item (GAD-7) scale was used to measure anxiety symptoms. Data related to coffee consumption in addition to systolic, diastolic blood pressure and heart rate measurements were collected both at baseline and on OSCE day.Results: This study included 325 students (144 (44.3%) males and 181 (55.7%) females). The mean systolic blood pressure, diastolic blood pressure, and heart rate measurements were significantly higher on OSCE day as compared to the baseline. In addition, the daily consumption of coffee increased significantly during OSCE day as compared to the baseline. Although the anxiety score increased during OSCE day compared to the baseline, the difference was not statistically significant. However, the change in anxiety score (OSCE day – baseline) was significantly higher in females compared to males.Conclusion: In our study, we observed significant increases in blood pressure, heart rate, and coffee intake on the day of the test compared to baseline measurements. These findings underscore the significance of implementing measures to reduce the harmful effects of stress on students during exam preparations and medical school assessments.Keywords: blood pressure, anxiety, stress, objective structured clinical examination, OSCE
- Published
- 2023
40. The medical licensing assessment will fall short of determining whether a UK medical graduate behaves ethically.
- Author
-
Deans, Zuzana, Moorlock, Greg, and Trimble, Michael
- Abstract
UK medical graduates will soon need to pass the medical licensing assessment, which assesses skills and knowledge in ethics using multiple choice questions (eg single best answer questions) and objective structured clinical examination. However, educational leaders have recognised that these methods lack the sophistication needed to accurately assess medical ethics. The reasons are two-fold. First, there may be a knowledge and practice gap in medical schools when it comes to preparing students for the assessment. To this end, this article shares peer advice about how best to use objective structured clinical examinations and single best answer questions for assessing medical ethics to help prepare students for the medical licensing assessment. Second, the design of the assessment is unlikely to adequately measure graduates' ethical values and behaviour in real world scenarios. Further work is needed to design assessments that are sophisticated enough to examine candidates' ethical reasoning and their actual behaviour. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
41. Progress testing of an objective structured clinical examination during undergraduate clinical clerkship: a mixed-methods pilot study.
- Author
-
Shimizu, Ikuo, Mori, Junichiro, Yamauchi, Aiga, Kato, Sawako, Masuda, Yuichi, Nakazawa, Yuichi, and Kanno, Hiroyuki
- Subjects
CLINICAL clerkship ,AUTODIDACTICISM ,SELF-managed learning (Personnel management) ,TEST-taking skills ,PILOT projects ,MEDICAL education examinations ,FALSE discovery rate - Abstract
Background: Progress testing is an assessment method in which an examination reflecting competencies at graduation is regularly administered to students over multiple years, thereby facilitating self-directed learning. However, the significance of the objective structured clinical examination as a progress test in undergraduate education, needs to be determined. This study provides evidence of the role of the objective structured clinical examination for progress testing and optimal scoring methods for assessing students in different academic years. Methods: We conducted a sequential explanatory mixed-methods pilot study. Participants were assessed using the Item Rating Scale, the year-adjusted Global Rating Scale, and the Training Level Rating Scale. The characteristics of each scale were compared quantitatively. In addition, the influence of the objective structured clinical examination as a progress test on learning attitudes was examined. Qualitative data from a post-examination questionnaire were analyzed, using content analysis to explore influences on self-directed learning. Results: Sixth and fifth year clinical students (n = 235) took the objective structured clinical examination progress test. The total Item Rating Scales were recorded (%) as 59.03 ± 5.27 and 52.64 ± 5.08 (p < 0.01); Training Level Rating Scale was 3.94 ± 0.39 vs 3.22 ± 0.42 (p < 0.01); and the year-adjusted Global Rating Scale was 4.25 ± 0.44 vs 4.32 ± 0.52 (no significant difference), for the sixth and fifth year students, respectively. The correlations across stations and the reliability of each station were satisfactory. Four categories were identified in the qualitative analysis: "motivation to learn during the clinical clerkship was promoted," "dissatisfied with being asked about things they had not experienced," "confusion about being unable to use conventional test-taking strategies," and "insufficient understanding of competencies at graduation." The scores indicated significant differences in performance according to training year. Conclusions: This study provides evidence that the objective structured clinical examination can be used as a progress testing tool for undergraduate clinical clerkships. Further enhancement of training opportunities and dissemination of performance competency goals in clerkship curricula are required if we intend to promote self-directed learning through progress testing. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
42. Twelve tips for improving the quality of assessor judgements in senior medical student clinical assessments.
- Author
-
Malau-Aduli, Bunmi S., Hays, Richard B., D'Souza, Karen, Saad, Shannon L., Rienits, Helen, Celenza, Antonio, and Murphy, Rinki
- Subjects
- *
WORK environment , *AFFINITY groups , *JUDGMENT (Psychology) , *MEDICAL students , *JOB involvement , *CLINICAL competence , *QUALITY assurance , *PROFESSIONALISM , *PATIENT safety - Abstract
Assessment of senior medical students is usually calibrated at the level of achieving expected learning outcomes for graduation. Recent research reveals that clinical assessors often balance two slightly different perspectives on this benchmark. The first is the formal learning outcomes at graduation, ideally as part of a systematic, program-wide assessment approach that measures learning achievement, while the second is consideration of the candidate's contribution to safe care and readiness for practice as a junior doctor. The second is more intuitive to the workplace, based on experience working with junior doctors. This perspective may enhance authenticity in assessment decisions made in OSCEs and work-based assessments to better align judgements and feedback with professional expectations that will guide senior medical students and junior doctors' future career development. Modern assessment practices should include consideration of qualitative as well as quantitative information, overtly including perspectives of patients, employers, and regulators. This article presents 12 tips for how medical education faculty might support clinical assessors by capturing workplace expectations of first year medical graduates and develop graduate assessments based on a shared heuristic of 'work-readiness'. Peer-to-peer assessor interaction should be facilitated to achieve correct calibration that 'merges' the differing perspectives to produce a shared construct of an acceptable candidate. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
43. Structures, processes and outcomes of objective structured clinical examinations in dental education during the COVID‐19 pandemic: A scoping review.
- Author
-
Salawu, Yetunde Kemi, Stewart, Derek, and Daud, Alaa
- Subjects
- *
DENTAL education , *COVID-19 pandemic , *CINAHL database , *CLINICAL medical education , *INFORMATION resources - Abstract
Introduction: Objective structured clinical examinations (OSCEs) are an essential examination tool within undergraduate dental education. Fear of spread of the COVID‐19 virus led to dental institutions exploring alternative means of conducting OSCEs. The aim of this scoping review was to investigate what structures, processes and outcomes of dental OSCEs were reported during the COVID‐19 pandemic. Materials and Methods: This scoping review was conducted and reported adhering to the Preferred Reporting Items for Systematic Reviews and Meta‐analyses extension for scoping review guidelines (PRISMA‐ScR). Published literature was identified through a systematic search of PubMed, Embase, Cumulative Index to Nursing and Allied Health Literature (CINAHL), Education Resources Information Center (Eric), ProQuest and Google Scholar. Identified articles were independently reviewed by two authors (KS, AD), followed by synthesis in terms of the reported structures, processes and outcomes. Articles reporting cancellation or rescheduling were also included, extracting data on reasons and any suggestions/recommendations. Results: The search yielded a total of 290 studies of which 239 sources were excluded after removal of duplicates, leaving 51 studies for title and abstract evaluation. Thirty‐four articles were excluded as they did not report on the topic of interest, leaving 17 for full‐text evaluation, of which nine were analysed according to the pre‐set themes. All dental OSCEs taking place (n = 6) were conducted online whilst the remaining (n = 3) were either cancelled or rescheduled. Data on structures reported specific online videoconferencing software used and provision of staff and student training. Processes on the execution of online OSCEs varied significantly from one study to the other, providing rich data on how dental institutions may carry out such assessments tailored to their need. Information regarding outcomes was sparse, as little attention was paid to the results of the students compared to pre‐pandemic, lacking investigation into reliability and validity of online dental OSCEs. Conclusion: Dental OSCEs could be conducted online implementing well‐planned structures and processes; however, further evidence is needed to prove its reliability and validity based on outcomes. Dental institutions may need to consider alternative methods to assess practical competencies if online OSCEs are to take place. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
44. 'How Intense Should Be A Nurturing Program Physician Mindset?'
- Author
-
Nurokhmanti, Hikmawati, Utomo, Prattama Santoso, Susilo, Astrid Pratidina, Prihatiningsih, Titi Savitri, Claramita, Mora, editor, Soemantri, Diantha, editor, Hidayah, Rachmadya Nur, editor, Findyartini, Ardi, editor, and Samarasekera, Dujeepa D., editor
- Published
- 2023
- Full Text
- View/download PDF
45. Development, Validity and Reliability of Objective Structured Clinical Examination in Nursing Students.
- Author
-
Chabrera, Carolina, Diago, Eva, and Curell, Laura
- Subjects
EXPERIMENTAL design ,INFERENTIAL statistics ,SCIENTIFIC observation ,RESEARCH evaluation ,RESEARCH methodology ,RESEARCH methodology evaluation ,CRONBACH'S alpha ,PSYCHOMETRICS ,NURSING education ,PEARSON correlation (Statistics) ,RESEARCH funding ,OUTCOME-based education ,PROFESSIONAL competence ,DESCRIPTIVE statistics ,QUESTIONNAIRES ,NURSING students ,STATISTICAL sampling ,DATA analysis software - Abstract
Introduction: The adoption of measurement instruments such as the Objective Structured Clinical Examination (OSCE) is essential to assess clinical competencies in nursing students. Objective: The purpose of this study is to develop an OSCE, analyze its validity and reliability in the nursing curriculum and measure self-assessment, stress and satisfaction. Methods: The observational validation study of a measurement instrument was carried out in two phases: the design and development of the OSCE and validity and reliability analysis. Results: A total of 118 students participated in the study. Ten scenarios were designed that incorporated six competency components extracted from the curriculum. Good results were obtained in face validity, content validity (CVI.82-.95), criterion validity (r =.71, p <.001), and reliability (α Cronbach.84). Satisfaction and stress scores were high, and self-assessment scores were lower than the scores obtained. Conclusion: A rigorously designed OSCE provides a reliable and valid method for assessing the clinical competence of nursing students. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
46. Assessing clinical reasoning in the OSCE: pilot-testing a novel oral debrief exercise.
- Author
-
Régent, Alexis, Thampy, Harish, and Singh, Mini
- Subjects
MEDICAL logic ,MEDICAL students ,JUDGMENT (Psychology) ,MEDICAL education ,UNDERGRADUATE education ,SIMULATED patients - Abstract
Introduction: Clinical reasoning (CR) is a complex skill enabling transition from clinical novice to expert decision maker. The Objective Structured Clinical Examination (OSCE) is widely used to evaluate clinical competency, though there is limited literature exploring how this assessment is best used to assess CR skills. This proof-of-concept study explored the creation and pilot testing of a post-station CR assessment, named Oral Debrief (OD), in the context of undergraduate medical education. Methods: A modified-Delphi technique was used to create a standardised domain-based OD marking rubric encapsulating the key skills of CR that drew upon existing literature and our existing placement-based CR tool. 16 OSCE examiners were recruited to score three simulated OD recordings that were scripted to portray differing levels of competency. Adopting a think-aloud approach, examiners vocalised their thought processes while utilising the rubric to assess each video. Thereafter, semi-structured interviews explored examiners' views on the OD approach. Recordings were transcribed, anonymised and analysed deductively and inductively for recurring themes. Additionally, inter-rater agreement of examiners' scoring was determined using the Fleiss Kappa statistic both within group and in comparison to a reference examiner group. Results: The rubric achieved fair to good levels of inter-rater reliability metrics across its constituent domains and overall global judgement scales. Think-aloud scoring revealed that participating examiners considered several factors when scoring students' CR abilities. This included the adoption of a confident structured approach, discriminating between relevant and less-relevant information, and the ability to prioritise and justify decision making. Furthermore, students' CR skills were judged in light of potential risks to patient safety and examiners' own illness scripts. Feedback from examiners indicated that whilst additional training in rubric usage would be beneficial, OD offered a positive approach for examining CR ability. Conclusion: This pilot study has demonstrated promising results for the use of a novel post-station OD task to evaluate medical students' CR ability in the OSCE setting. Further work is now planned to evaluate how the OD approach can most effectively be implemented into routine assessment practice. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
47. Experience of Delivering an Online Internal Medicine Course to Undergraduate Medical Students during the COVID 19 Pandemic in a Medical College in Saudi Arabia.
- Author
-
Albulaihie, Hana, Omair, Mohammed A., Ahmad, Tauseef, Alrajhi, Nuha, Mujammammi, Mohammed, Bedaiwi, Mohamed, Alfadda, Assim A., and Soliman, Mona M.
- Subjects
- *
INTERNAL medicine , *COVID-19 pandemic , *MEDICAL students , *MEDICAL schools - Abstract
Background: Medical education was significantly impacted by the COVID-19 pandemic and the abrupt shift to online education on lockdown. Online education challenged and negatively impacted medical colleges worldwide, especially for medical training and teaching clinical skills that require practice and clinical encounters. The aim of the current study was to evaluate the curriculum delivery and assessment of the internal medicine course during the COVID-19 pandemic lockdown (2019-2020) and compare the assessment results to a control pre-COVID-19 year (2018-2019). Methods: The study design was a retrospective study. All 3rd-year medical students (a total of 882 students) enrolled in the internal medicine course were enrolled in the study: 303 students in 2018-2019, 299 students in 2019-2020, and 280 in 2020-2021. In March 2020, there was a sudden shift to online education due to the COVID-19 pandemic. All lectures were conducted online in the same number and with the same content. Clinical bedside teaching was replaced with selected videos that demonstrated the clinical examination skills planned in the learning objectives. Results: During COVID (62.4%), students performed better than pre-COVID (59.5%) on the medicine midterm multiple-choice questions (MCQs) examination. Similarly, students' marks in the long case during-COVID (84.6%) were improved compared to their marks pre-COVID (82.0%). A very strong correlation was found between midterm MCQs and final MCQs (r = 0.74; P = 0.000), followed by the objective structure clinical examination (OSCE) (r = 0.50; P = 0.000) and long-term MCQs (r = 0.29; P = 0.000). There was only a weak relation between midterm MCQs and DXR (r = 0.02; P = 0.67). Similarly, the final MCQs were strongly correlated with the midterm MCQs (P = 0.000), followed by the OSCE (P = 0.000). Conclusions: The present study demonstrated the success of the introduction of adaptive changes in the internal medicine course to cope with COVID-19 pandemic restrictions. It showed how medical education continued during the COVID-19 pandemic while ensuring student safety. While other medical education methods could be implemented and allow for similar results, innovation in medical education methods should continue to evolve even after the pandemic. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
48. Study to Assess Effectiveness of STP on Knowledge and Expressed-Practice regarding OSCE among Nursing-Tutors of Selected Colleges of Gujarat.
- Author
-
Macwan, Renkina and Gohil, Jerusa J.
- Subjects
NATIONAL competency-based educational tests ,PROFESSIONAL practice ,EXPERIMENTAL design ,RESEARCH ,TEACHING methods ,PROFESSIONS ,NURSING schools ,PRE-tests & post-tests ,COMPARATIVE studies ,T-test (Statistics) ,EDUCATIONAL tests & measurements ,CLINICAL competence ,DESCRIPTIVE statistics ,STATISTICAL sampling ,STATISTICAL correlation ,DATA analysis software - Abstract
Background and Objectives: OSCE has been widely and increasingly used now-a-days. The OSCE is comprised of several stations; examinees are expected to perform a variety of clinical tasks within a specified time period. Performing a variety of clinical skills, in the laboratory there by evaluating competency of skills is possible. Investigator had conducted this study to assess the knowledge and expressed practice of nursing tutors before and after administration of Structured Teaching Programme on OSCE. And to find out the correlation between post-test knowledge and post-test expressed practice score on OSCE among nursing tutors of selected self-finance nursing colleges.Methods: A pre-experimental research design was used for this study. For data collection, structured tools were prepared which consists of three parts, first part deals with demographic data, second and third part includes structured quantitative questionnaire. Simple random sampling technique was used to select potential participants. Total 50 participants were selected with chit and lottery method for this study. Results: The study revealed that mean post-test knowledge score (14.1) was higher than mean pretest knowledge score (7.52). The mean post-test expressed practice score (8.1) was higher than mean pre-test expressed practice score (3.56). There is an existence of a positive correlation (r =0.66) between knowledge and expressed Practice.Conclusion: The participants gained knowledge after delivering structured teaching about OSCE. There is positive co-relation between knowledge and expressed practice. So, it proves that structured teaching program is effective in imparting knowledge of OSCE. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
49. A pilot study of objective structured clinical examinations in a postgraduate speech pathology program.
- Author
-
Hill, Elizabeth, Timms, Lydia, and Brewer, Margo
- Subjects
PILOT projects ,HEALTH occupations students ,RESEARCH methodology ,SURVEYS ,CLINICAL competence ,SCALE analysis (Psychology) ,DESCRIPTIVE statistics ,STUDENT attitudes ,SPEECH therapists ,HUMAN beings - Abstract
Objective Structured Clinical Examinations (OSCEs) are a gold-standard method of assessing clinical competence, yet few studies have evaluated their use in speech-language pathology. This study aimed to evaluate the perceptions of postgraduate speechlanguage pathology students towards a final-year OSCE. Students' perceptions were captured via an online survey. Quantitative data were analysed descriptively. Qualitative responses were analysed using content analysis. Pass rates across stations are also reported. Over 80% of students passed each OSCE station. Survey respondents (n = 13) agreed that the OSCEs were valuable and well run, despite causing nervousness. Ambiguity was observed for items related to OSCE validity and authenticity, student confidence, preparedness, and overall experience. OSCEs can be feasible way to assess clinical competencies in speech-language pathology. When adopting this method of assessment, it is crucial to consider the students' experiences of, and preparedness for, the OSCE process and their perceptions of task validity and authenticity. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
50. Clinical Competence of Nurses in Mechanical Ventilation; Design and validation of Objective Structured Clinical Examination.
- Author
-
Aghal, Bagher, Moradian, Seyed Tayeb, Bahramifard, Ali, and Saeed, Yaser
- Subjects
NURSES ,PHYSICAL diagnosis ,OCCUPATIONAL roles ,HUMAN services programs ,QUALITATIVE research ,RESEARCH evaluation ,NURSING ,QUANTITATIVE research ,DESCRIPTIVE statistics ,REACTIVE oxygen species ,OXYGEN in the body ,ARTIFICIAL respiration ,CLINICAL competence ,RESEARCH methodology ,MEDICAL equipment reliability ,MECHANICAL ventilators - Abstract
Background & aim: Clinical evaluation is one of the main components in the discussion of clinical education in the field of nursing. Based on Miller's Pyramid in Education, objective structured clinical examination becomes one of the applied assessment methods to evaluate clinical skills. One of the clinical skills of nurses, especially in the Intensive Care Unit (ICU), is mechanical ventilation. This study was conducted with the aim of designing an objective structured clinical examination to evaluate the competence of nurses in mechanical ventilation. Methods: This descriptive study was conducted in 1401 in Tehran, Iran. According to the educational content of basic mechanical ventilation principles and the purpose of the study, six stations were determined and a specialized checklist was designed accordingly for each station. Checking the validity of the content of the designed checklists was done using the opinions of experts in both qualitative and quantitative ways. Results: Finally, the number of six stations with 31 items with titles; Tubing connection and initial preparation of the ventilator, initial and basic settings of the ventilator, check and intervention in the oxygenation status, check and intervention in the ventilation status, management of clinical challenges and management of alarms were finalized. Scoring ranged between 1 and 5, and the sum of the scores of the stations would indicate the nurse's clinical competence in mechanical ventilation. Conclusion: According to the results of the present study, the use of an objective structured clinical examination designed to evaluate the clinical competence of nurses in basic mechanical ventilation is suggested. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
Catalog
Discovery Service for Jio Institute Digital Library
For full access to our library's resources, please sign in.