Search

Construct & Background: In order to determine students' level of interprofessional competencies, there is a need for well-considered and thoroughly designed interprofessional assessments. Current literature about interprofessional assessments focuses largely on the development and validation of assessment instruments such as self-assessments or questionnaires to assess students' knowledge or attitudes. Less is known about the design and validity of integral types of assessment in interprofessional education, such as case-based assessments, or performance assessments. The aim of this study is to evaluate the evidence for and threats to the validity of the decisions about students' interprofessional performances based on such integral assessment task. We investigated whether the assessment prototype is a precursor to practice (authenticity) and whether the assessment provides valid information to determine the level of interprofessional competence (scoring). Approach: We used a design-based qualitative research design in which we conducted three group interviews with teachers, students, and interprofessional assessment experts. In semi-structured group interviews, participants evaluated the evidence for and threats to the validity of an interprofessional assessment task, which were analyzed using deductive and inductive content analysis. Findings: Although both evidence for and threats to validity were mentioned, the threats refuting the assessment's validity prevailed. Evidence for the authenticity aspect was that the assessment task, conducting a team meeting, is common in practice. However, its validity was questioned because the assessment task appeared more structured as compared to practice. The most frequently mentioned threat to the scoring aspect was that the process of interprofessional collaboration between the students could not be evaluated sufficiently by means of this assessment task. Conclusions: This study showed that establishing interprofessional assessment validity requires three major balancing acts. The first is the balance between authenticity and complexity. As interprofessional practice and competencies are complex, interprofessional tasks require build-up or guidance toward this complexity and chaotic practice. The second is that between authenticity and scoring, in which optimal authenticity might lead to threats to scoring and vice versa. Simultaneous optimal authenticity and scoring seems impossible, requiring ongoing evaluation and monitoring of interprofessional assessment validity to ensure authentic yet fair assessments for all participating professions. The third balancing act is between team scoring and individual scoring. As interprofessional practice requires collaboration and synthesis of diverse professions, the team process is at the heart of solving interprofessional tasks. However, to stimulate individual accountability, the individual performance should not be neglected. [ABSTRACT FROM AUTHOR]

In higher education, students often misunderstand teachers' written feedback. This is worrisome, since written feedback is the main form of feedback in higher education. Organising feedback conversations, in which feedback request forms and verbal feedback are used, is a promising intervention to prevent misunderstanding of written feedback. In this study a 2 × 2 factorial experiment (N = 128) was conducted to examine the effects of a feedback request form (with vs. without) and feedback mode (written vs. verbal feedback). Results showed that verbal feedback had a significantly higher impact on students' feedback perception than written feedback; it did not improve students' self-efficacy, or motivation. Feedback request forms did not improve students' perceptions, self-efficacy, or motivation. Based on these results, we can conclude that students have positive feedback perceptions when teachers communicate their feedback verbally and more research is needed to investigate the use of feedback request forms.

To develop independent healthcare professionals able to collaborate in interprofessional teams, health professions education aims to support students in transitioning from an individual perspective to interprofessional collaboration. The five elements that yield the conditions for effective interprofessional collaboration are: (1) positive interdependence, (2) individual accountability, (3) promotive interaction, (4) interpersonal skills, and (5) reflection on team processes. The aim of the current study is to gain insights into how to design tasks to assess a student team as a whole on their interprofessional collaboration. This was a pilot study using a qualitative design to evaluate an interprofessional assessment task. Four interprofessional student teams, comprising physiotherapy, occupational therapy, arts therapy and nursing students (N = 13), completed this task and five assessors used a rubric to assess video recordings of the teams' task completion, and then participated in a group interview. The completed rubrics and the interview transcript were analyzed using content analysis. Findings showed that the combination of individual preparation, an interprofessional team meeting resulting in care agreements and team reflection was a strength of the assessment task, enabling the task to elicit sufficient promotive interaction between students. Areas for improvement of the assessment task were however, due to a lack of interdependence, the care agreements which now proved to be the sum of students' intraprofessional ideas rather than an interprofessional integration of agreements. Additionally, assessors suggested that a series of varying assessment tasks is required to draw conclusions about students' interprofessional competence. [ABSTRACT FROM AUTHOR]

One of the goals of current education is to ensure that graduates can act as independent lifelong learners. Graduates need to be able to assess their own learning and interpret assessment results. The central question in this article is how to acquire sustainable assessment skills, enabling students to assess their performance and learning throughout life, and preparing them to meet their own future learning needs. This article presents an integrated model for developing sustainable assessment skills, consisting of three components: conditions necessary for the development of sustainable assessment skills, elements of sustainable assessment and instructional methods for guiding students in the development of sustainable assessment skills. The article concludes with suggestions for future research to further develop the proposed model. (Contains 2 tables and 2 figures.)

We conducted a study among students in secondary vocational education programmes in nursing and care (N = 68). The students work on learning tasks, self-assess their task performance and formulate points for improvement. We compared two groups of students on self-assessment, identification of points of improvement and perceived effort for the assessment task. One group was given a list of all possible assessment criteria for all tasks in which the relevant criteria for a particular learning task were highlighted. The other group received the same list without highlighting. Students in the relevant criteria group outperformed the students in the all criteria group on a test task, but they experienced higher mental effort in self-assessing their performance. Care students in the relevant criteria group generated more points of improvement than care students in the all criteria group. Nursing students outperformed care students on the test task and care students selected more criteria than did nursing students. (Contains 2 tables and 2 figures.)

In this study the relationship between domain-specific skills and peer assessment skills as a function of task complexity is investigated. We hypothesised that peer assessment skills were superposed on domain-specific skills and will therefore suffer more when higher cognitive load is induced by increased task complexity. In a mixed factorial design with the between-subjects factor task complexity (simple, n = 51; complex, n = 59) and within-subjects factor task type (domain-specific, peer assessment), secondary school students studied four integrated study tasks, requiring them to learn a domain-specific skill (i.e. identifying the six steps of scientific research) and to learn how to assess a fictitious peer performing the same skill. Additionally, the students performed two domain-specific test tasks and two peer assessment test tasks. The interaction effect found on test performance supports our hypothesis. Implications for the teaching and learning of peer assessment skills are discussed. (Contains 5 figures and 2 tables.)

Despite the popularity of peer assessment (PA), gaps in the literature make it difficult to describe exactly what constitutes effective PA. In a literature review, we divided PA into variables and then investigated their interrelatedness. We found that (a) PA's psychometric qualities are improved by the training and experience of peer assessors; (b) the development of domain-specific skills benefits from PA-based revision; (c) the development of PA skills benefits from training and is related to students' thinking style and academic achievement, and (d) student attitudes towards PA are positively influenced by training and experience. We conclude with recommendations for future research. (Contains 1 table.)

This article describes a blueprint for an online learning environment that is based on prominent instructional design and assessment theories for supporting learning in complex domains. The core of this environment consists of formative assessment tasks (i.e., assessment "for" learning) that center on professional situations. For each professional situation, three levels of situational complexity are defined, and within each of these three levels, tasks are offered that differ in the degree of support offered to the learner. This environment can support (beginning) professionals in complex domains in gaining insight into the available repertoire of behavior in professional situations, as well as into the quality and effectiveness of that behavior (assessment criteria), while simultaneously helping them to develop insight into the standards that their own behavior should (eventually) match.

In an effort to gain better understanding of the assessment of prior informal and non-formal learning, this article explores assessors' approaches to portfolio assessment. Through this portfolio assessment, candidates had requested exemptions from specific courses within an educational programme or admission to the programme based on their prior learning. The assessors judged the portfolios according to set rating criteria, and subsequently discussed their approaches. Their decision-making processes, perception of portfolio use in the Assessment of Prior Learning (APL), deciding factors in portfolio assessment and use of the rating criteria were key elements in this discussion. The results show that they do use the rating criteria as an indicator in decision-making, but have mixed perceptions regarding the fairness of APL portfolio assessment. They perceive the portfolio evidence in combination with sound argumentation as the deciding elements in portfolio assessment. (Contains 6 tables.)

This study investigates the effects of a competency-oriented course and the effects of feedback training on students' reflection skills. Thirty-one nursing students enrolled in a conventional course with lectures and assignments following a traditional test. Subsequently, they enrolled in a competency-oriented course, which included more performance-oriented tasks based on competencies and a performance-based assessment. In both courses, half of the students received feedback on their assignments from tutors who were trained in feedback skills (experimental group), while the other half of the students received feedback from non-trained tutors (control group). After each course, all students wrote a reflection report. Results show that students' reflection reports after the competency-oriented course were of a higher quality than the reports after the conventional course. Contrary to our expectations, the quality of the reflection reports of the control group (students supervised by non-trained tutors) was significantly higher than the quality of reflection reports of the experimental group (students supervised by trained tutors). This study shows that a competency-oriented design of courses enhances students' reflection skills, but that the training in feedback skills needs to be reconsidered. (Contains 3 tables.)

This article explores the opportunities to apply cognitive load theory and four-component instructional design to self-directed learning. Learning tasks are defined as containing three elements: learners must (a) "perform" the tasks, (b) "assess" their task performance, and (c) "select" future tasks for improving their performance. Principles to manage intrinsic and extraneous load for performing learning tasks, such as simple-to-complex ordering and fading-guidance strategies, are also applicable to assessing performance and selecting tasks. Moreover, principles to increase germane load, such as high variability and self-explanation prompts, are also applicable to assessment and selection. It is concluded that cognitive load theory and four-component instructional design provide a solid basis for a research program on self-directed learning.

This study investigated the effectiveness of different types of feedback content (elaborate versus global) and feedback timing (immediate versus delayed) for learning genetics in a web-based learning environment as a function of learners' prior knowledge. It was hypothesized that learning outcomes of students with low prior knowledge would be fostered by immediate elaborate feedback, whereas those of students with more prior knowledge would be enhanced by delayed global feedback. Students' perceptions of the feedback they received were explored. Results showed a significant positive effect of global feedback on learning outcomes for higher prior knowledge learners, although those who received elaborate feedback gave a higher appreciation rating. The findings are discussed in terms of implications for the design and delivery of feedback in web-based learning environments. (Contains 2 tables.)

This article describes how competence-based learning (CBL) can be organised in vocational education by integrating elements from a holistic instructional design model with recent ideas on assessment. A curriculum based on this model is pre-eminently suitable for an assessment approach emphasising that proof of competence is gathered by having learners perform authentic tasks under changing assessment conditions at regular intervals. The results are stored in a so-called electronic assessment portfolio. The portfolio is constructed according to the Protocol Portfolio Scoring (PPS). The value of PPS for flexible, demand-driven vocational education is discussed. (Contains 1 figure and 2 tables.)

A General Practitioner (GP) is no longer a loner, but a team player in either a group practice or a care centre. This change has led to a concomitant growth in curricular interest in skills essential for successful collaboration and for enhancing critical reflection towards colleagues' performance. Giving and receiving constructive feedback are examples of these skills. The aim of this study was to gain insight in the style and quality of feedback reports on consultation skills written by GPs-in-Training (GPiTs) and by their GP-trainers. Furthermore, the preferences of the GPiTs concerning feedback style were examined. Results show significant differences between GP-trainers and GPiTs in feedback style and quality. A ranking task indicated that GPiTs have a preference for reports characterised by a large number of reflective remarks. Questionnaire results indicate the added value of the use of peer feedback. Implications for the integration of peer feedback activities in the curriculum of GPiTs are discussed.

This article focuses on the design of competency-based performance assessment in e-learning. Though effort has been invested in designing powerful e-learning environments, relatively little attention has been paid to the design of valid and reliable assessments in such environments, leaving many questions to educational developers and teachers. As a solution to this problem, a systematic approach to designing performance assessments in e-learning contexts is presented, partly based on the 4C/ID model. This model enables the construction of realistic whole tasks instead of advocating education that is restricted to more isolated skills. A new assessment procedure also implies an alternative view of instructional design, learning and assessment. The requirements for the learning environment are addressed. Examples from a virtual seminar are presented to illustrate the design approach. The article concludes with the identification of possible pitfalls related to the approach and gives directions for future research.

Peer assessment can be a valuable learning tool in teacher education because it supports student teachers to acquire skills that are essential in their professional working life. This article presents a conceptual framework in which the training of peer assessment skills by means of peer assessment tasks is integrated in teacher education courses. Theories about constructive alignment, student involvement, instructional design, and performance assessment underlie the framework. Furthermore, two recently published empirical studies will be briefly described to provide empirical support for the value of the framework. Results of these studies show that the framework offers powerful guidelines for the design and integration of peer assessment activities in teacher training courses. In general, the peer assessment tasks that were embedded in the courses led to a general improvement in students' peer assessment skills as well as their task performance in the domain of the course. Implications for course and curriculum design are discussed.

This paper focuses on two increasingly important issues in teacher education: the design of more skill-based education and the involvement of students by means of peer assessment. Ninety-three student teachers were trained in one important peer-assessment skill, namely 'defining performance criteria'. This training, which consisted of four peer-assessment tasks, was integrated in an existing course. Half of the group was trained in the skill of 'defining criteria' (experimental groups) and the other half was not (control group). By working on the peer-assessment tasks, student teachers in the experimental group learned to define performance criteria for a course content-related product. The effects of the training on students' ability to define criteria and the effects on the content-related skill were examined. Findings show that the student teachers from the experimental group scored significantly higher on the use of criteria, but did not surpass the control group on the content-related task performance.

Studied the development of students' assessment skills and their skills in writing reflection papers as an effect of assessment training integrated into three mathematics courses. Findings for 110 first-year students at a teacher training college in the Netherlands show the usefulness of involving students in assessment procedures. (SLD)

Using a teacher education class, compared student teachers trained in peer assessment (including defining performance criteria, giving feedback, and writing assessment reports) with a control group. Found that trained students surpassed controls in the quality of assessment skill; they also received higher class grades and were more satisfied. (EV)

Processes involved in the regulation of learning have been researched for decades, because of its impact on academic and workplace performance. In fact, self‐regulated learning is the focus of countless studies in health professions education and higher education in general. While we will always need competent individuals who are able to regulate their own learning, developments in healthcare require a shift from a focus on the individual to the collective: collaboration within and between healthcare teams is at the heart of high‐quality patient care. Concepts of collaborative learning and collective competence challenge commonly held conceptualisations of regulatory learning and call for a focus on the social embeddedness of regulatory learning and processes regulating the learning of the collective. Therefore, this article questions the alignment of current conceptualisations of regulation of learning with demands for collaboration in current healthcare. We explore different conceptualisations of regulation of learning (self‐, co‐, and socially shared regulation of learning), and elaborate on how the integration of these conceptualisations adds to our understanding of regulatory learning in healthcare settings. Building on these insights, we furthermore suggest ways forward for research and educational practice. Bransen et al. explore the concept of 'self' to argue that the health professions need to shift from striving to optimize self‐regulation to understanding how to effectively regulate across self‐, co‐, and shared‐regulation. [ABSTRACT FROM AUTHOR]