Search

It is assumed that a programmatic approach to assessment supports students' self-regulated learning (SRL). This study investigated students' perceptions of this assumed support. Using a multiple-case study design, this study examined students' perceptions in two distinct study programmes. In each case, first-year students were enrolled in an assessment programme that was designed in accordance with the principles of programmatic assessment, which integrate both assessment purposes of assessment for learning (AfL) and assessment of learning (AoL). The second-year students in each case were enrolled in an assessment programme with a traditional AoL assessment approach. The findings suggest that in both cases first-year students perceived their assessment programme as more positive for their learning than second-year students. Through a cross-case analysis of students' perceptions of the two assessment programmes, three themes were identified that are essential to support students' SRL: 1) assessment design; 2) assessment as a dialogue; and 3) assessment as an information source. Key aspects of the themes that support or hinder SRL are discussed. The findings of this study highlight the importance of programme-level assessment design to support students in their SRL. [ABSTRACT FROM AUTHOR]

Purpose: This study aims to report the design, development and evaluation of a digital quality assurance application aimed at improving and ensuring the quality of assessment programmes in higher education. Design/methodology/approach: The application was developed using a design-based research (DBR) methodology. The application's design was informed by a literature search and needs assessment of quality assurance stakeholders to ensure compliance with daily practices and accreditation requirements. Stakeholders from three study programmes evaluated the application. Findings: As part of the development of the application, module- and programme-level dashboards were created to provide an overview of the programme's outcomes, assessment methods, assessment metrics, self-evaluated quality indicators and assessment documents. The application was evaluated by stakeholders at the module and programme levels. Overall, the results indicated that the dashboards aided them in gaining insight into the assessment programme and its alignment with underlying assessments. Practical implications: Visualisation of the assessment programme's structure and content identifies gaps and opportunities for improvement, which can be used to initiate a dialogue and further actions to improve assessment quality. Originality/value: The application developed facilitates a cyclical and transparent assessment quality assurance procedure that is continuously available to various stakeholders in quality assurance. [ABSTRACT FROM AUTHOR]

In this study, we aimed to identify how the learning activities elicited in a lesson study project contributed to self-perceived change in supervisors' pedagogical content knowledge (PCK). Lesson study is a method which combines both professional and educational development. During a lesson study project, teachers collaborate in a team and develop, teach, evaluate, and redesign a research lesson. During the 4-month lesson study project described here, four supervisors designed a protocol for research supervision meetings aimed at enhancing undergraduate students' learning. During the project, they experimented with open questioning and giving positive feedback instead of giving instruction and explanations. A mixed-methods design was used in this study. Data on the supervisors' learning activities and PCK were gathered using learner reports, video-recordings of meetings, and exit interviews. The analyses of these data showed that the lesson study project contributed to the development of the supervisors' PCK on instructional strategies and student understanding. The learning activity that contributed most to these changes was reflecting on their own practice and that of their students. [ABSTRACT FROM AUTHOR]

Supporting academics' initial development as university teachers is important for improving their ability to contribute to high-quality education and for reducing anxiety and stress around teaching. Focusing on tasks experienced as challenging is considered a key principle for organising effective teacher professional development. To apply this principle in practice, more knowledge is needed about the development of novice university teachers' self-efficacy in their teacher tasks. Therefore, this study aims to investigate phases in the development of novice university teachers' self-efficacy. Data were collected amongst 201 novice university teachers at a Dutch research-intensive university and associated university medical centre, using a questionnaire measuring self-efficacy in different teacher tasks. Polytomous Rasch analyses were performed on novice university teachers' self-efficacy scores, both across and within teacher tasks. Results suggested three developmental phases in novice university teachers' self-efficacy across teacher tasks: (1) development in 'teaching and supporting learning', (2) development in 'assessment and feedback' and 'educational design', (3) development in 'educational leadership and management' and 'educational scholarship and research'. Two or three phases for the development of self-efficacy were found within each of these teacher tasks. These results expand our knowledge of the development of academics' self-efficacy related to specific teacher tasks. They also provide suggestions for how pedagogic training and workplace learning may be shaped in such a way that they focus novice university teachers' learning on teacher tasks that are difficult but not overchallenging. [ABSTRACT FROM AUTHOR]

Supervision meetings give teachers and students opportunities to interact with each other and to co-regulate students' learning processes. Co-regulation refers to the transitional process of a student who is becoming a self-regulated learner by interacting with a more capable other such as a teacher. During a task, teachers are expected to pull back their support and give opportunities to students to take responsibility. This study aims to explore the shifting patterns of co-regulation, feedback perception, and motivation during a 5-month research project. Participants were 20 students conducting research in pairs and six teachers who supervised these students. Two videotaped supervision meetings at the beginning and end of the research process and questionnaires on feedback perception and motivation were analysed. Results on co-regulation showed a constant and comparable level of regulation at the start and at the end of students' research projects. Feedback perception did not change, but motivation decreased significantly. [ABSTRACT FROM AUTHOR]

Medical image interpretation is moving from using 2D- to volumetric images, thereby changing the cognitive and perceptual processes involved. This is expected to affect medical students' experienced cognitive load, while learning image interpretation skills. With two studies this explorative research investigated whether measures inherent to image interpretation, i.e. human-computer interaction and eye tracking, relate to cognitive load. Subsequently, it investigated effects of volumetric image interpretation on second-year medical students' cognitive load. Study 1 measured human-computer interactions of participants during two volumetric image interpretation tasks. Using structural equation modelling, the latent variable ‘volumetric image information’ was identified from the data, which significantly predicted self-reported mental effort as a measure of cognitive load. Study 2 measured participants' eye movements during multiple 2D and volumetric image interpretation tasks. Multilevel analysis showed that time to locate a relevant structure in an image was significantly related to pupil dilation, as a proxy for cognitive load. It is discussed how combining human-computer interaction and eye tracking allows for comprehensive measurement of cognitive load. Combining such measures in a single model would allow for disentangling unique sources of cognitive load, leading to recommendations for implementation of volumetric image interpretation in the medical education curriculum. [ABSTRACT FROM AUTHOR]

Rationale and objectives Current radiology practice increasingly involves interpretation of volumetric data sets. In contrast, most radiology tests still contain only 2D images. We introduced a new testing tool that allows for stack viewing of volumetric images in our undergraduate radiology program. We hypothesized that tests with volumetric CT-images enhance test quality, in comparison with traditional completely 2D image-based tests, because they might better reflect required skills for clinical practice. Materials and methods Two groups of medical students ( n = 139; n = 143), trained with 2D and volumetric CT-images, took a digital radiology test in two versions (A and B), each containing both 2D and volumetric CT-image questions. In a questionnaire, they were asked to comment on the representativeness for clinical practice, difficulty and user-friendliness of the test questions and testing program. Students’ test scores and reliabilities, measured with Cronbach's alpha, of 2D and volumetric CT-image tests were compared. Results Estimated reliabilities (Cronbach's alphas) were higher for volumetric CT-image scores (version A: .51 and version B: .54), than for 2D CT-image scores (version A: .24 and version B: .37). Participants found volumetric CT-image tests more representative of clinical practice, and considered them to be less difficult than volumetric CT-image questions. However, in one version (A), volumetric CT-image scores (M 80.9, SD 14.8) were significantly lower than 2D CT-image scores (M 88.4, SD 10.4) ( p < .001). The volumetric CT-image testing program was considered user-friendly. Conclusion This study shows that volumetric image questions can be successfully integrated in students’ radiology testing. Results suggests that the inclusion of volumetric CT-images might improve the quality of radiology tests by positively impacting perceived representativeness for clinical practice and increasing reliability of the test. [ABSTRACT FROM AUTHOR]

Disciplinary knowledge lies at the heart of academic work. However, connecting academics' disciplinary knowledge to their professional development as teachers has been a longstanding challenge for (research-intensive) universities. This is reflected in criticism of the practices that aim to support the professional development of university teachers. In order to create better connections, a deeper understanding is needed of how academics' disciplinary knowledge relates to the development of their teaching. In this paper, we therefore aim to advance theoretical insights about how academics' disciplinary knowledge connects to their professional development as university teachers. We do so by providing a conceptual analysis of teacher expertise and teacher knowledge perspectives. Literature discussed as part of the teacher expertise perspective provides insights into how knowledge is structured in order to perform teacher tasks. In our discussion of the teacher knowledge perspective, we include bodies of literature about teachers' knowledge base to explore the role of disciplinary knowledge in how to teach and about powerful knowledge to explore the role of disciplinary knowledge in what to teach. Insights from these bodies of literature can, from a teacher knowledge perspective, offer theoretical underpinnings for connecting academics' disciplinary knowledge to their professional development as university teachers. Adaptive expertise and practical knowledge are identified as concepts that include elements of both teacher expertise and teacher knowledge perspectives. Based on the conceptual analysis, we identify and discuss three aspects related to supporting the professional development of university teachers where attention to connection with teachers' disciplinary knowledge is important. [ABSTRACT FROM AUTHOR]

This study aimed to evaluate a training programme for Dutch teachers in six institutes for nursing education to support students’ reflection skills. The research question was: what are the feasibility, quality and effects of the programme? The training programme focused on four competences of teachers regarding instructing, guiding, giving feedback on and assessing students’ reflection skills. The programme development was informed by research-based features of effective teacher professional development and expertise about reflection and feedback. Nineteen teachers took part in the training programme and eight teachers formed a control group. Pre-measurements concerned teachers’ initial knowledge, experience, beliefs, practices and self-assessment of competences. During the programme, data were gathered about participants’ appraisal of the content and activities, learning concerns and perceived results. Post-measurements concerned quality and effects of the programme, using teachers’ assessment of own development, current teaching activities and repeated measurement of certain practices, beliefs and self-assessment of competences. Teachers’ appraisal of the training programme was fairly positive. Results indicate that teachers can develop competences in supporting students’ reflection skills and improve their practice in a relatively modest amount of time by participating in a purposeful and coherent programme including relevant content, active learning and expert feedback. [ABSTRACT FROM AUTHOR]

Aim. This paper is a report of a study in senior secondary vocational education designed to develop a framework for teacher competences to support nursing students in developing their reflection skills. Background. For healthcare-related professions such as nursing, there is a growing attention for developing reflection skills. Little is known about teacher competences required to support the development of reflection skills in nursing students. Developing a framework of teacher competences can contribute to filling up this gap. These competences are described in 91 indicators distributed over six task domains. Methods. A Delphi study was conducted in the first half year of 2008 to get consensus on a framework of teacher competences required for creating the learning environment needed for developing reflection skills in nursing students. Experts judged teacher competences on a seven-point Likert-type scale. Findings. In the first round, mean scores on the teacher competences were already high. Minor revisions were needed. In the second round, mean scores increased, whereas standard deviations decreased in round 2 compared with round 1. These changes were statistically significant. Coaching was seen as most important task domain. Conclusion. Consensus has been reached on teacher competences to be used in nursing education to develop students' reflection skills. The framework of competences may be a source for curriculum development concerning reflection skills and for teacher training programmes to coach nursing students' reflections. [ABSTRACT FROM AUTHOR]

Abstract: This study aims to explore the relationship between the occurrence of reflection (and non-reflection) and thinking activities (e.g., orientating, selecting, analysing) during portfolio-based conversations. Analysis of 21 transcripts of portfolio-based conversations revealed that 20% of the segments were made up of reflection (content reflection (6%), process reflection (10%), and premise reflection (4%)). The thinking activities comparing, analysing and concluding occurred significantly more often during reflection than during non-reflection. Orientating on the task, selecting and describing, occurred significantly less often during reflection. The outcomes show that the occurrence of certain thinking activities can be an indication of reflection. [Copyright &y& Elsevier]

This study concerns the relation between teachers’ beliefs towards teaching behaviour and their actual teaching behaviour in teacher portfolio assessment. We analysed the beliefs and behaviour of 18 teachers as described in their portfolios. In addition, each portfolio was independently assessed by two trained raters on eight content standards and the teachers’ classroom behaviour was assessed by their own students in a questionnaire (n=317). Linear multilevel analysis showed that part of the raters’ assessments of the teachers’ beliefs and their behaviour as described in their portfolios was significantly related to the students’ assessments of their teachers’ behaviour. Teachers with high raters’ assessments on the content standard about ‘choosing and arguing for teaching strategies that meet students’ knowledge, abilities and experience’ had significantly higher student assessments than teachers who were judged low on this standard. Implications of the results and suggestions for further research are discussed. [Copyright &y& Elsevier]

There is a need for assessment of teachers' competencies fostered by a growing attention given to accountability and quality improvement. Important questions are how good the demonstrated competencies of teachers should be for a satisfying assessment and how the different competencies should be weighted. Using a policy capturing method, in two rounds, in stakeholders developed performance standards (or cut-off scores) for teacher assessment on eight criteria (or content standards) that resulted from an earlier study. Between the rounds, the panelists held a structured group discussion. Policy capturing proved to be a clear and useful method generating consistent judgements that can be described according to both a compensatory model and a conjunctive model. From the firs to the second round, the consistency increased. However, while the panelists agreed to a substantial degree on the performance standards, they disagreed on the weights to be assigned to the criteria. [ABSTRACT FROM AUTHOR]

Diagnosing teachers are teachers who perceive diagnostic information about students' learning process, interpret these aspects, decide how to respond, and act based on this diagnostic decision. During supervision meetings about the undergraduate thesis supervisors make in-the-moment decisions while interacting with their students. We regarded research supervision as a teaching process for the supervisor and a learning process for the student. We tried to grasp supervisors' in-the-moment decisions and students' perceptions of supervisors' actions. Supervisor decisions and student perceptions were measured with video-stimulated recall interviews and coded using a content analysis approach. The results showed that the in-the-moment decisions our supervisors made had a strong focus on student learning. Supervisors often asked questions to empower students or to increase student understanding. These supervising strategies seemed to be adapted to students' needs, as the latter had positive perceptions when their control increased or when they received stimuli to think for themselves. [ABSTRACT FROM AUTHOR]

The importance of generic skills for life scientists is commonly recognised by employers, graduates, and higher education institutes. As it remains unclear which generic skills are relevant for different life sciences career paths, this study aims to give an overview to inform and inspire universities and students, by analysing 179 Dutch entry-level job postings. We deductively coded nine career paths, namely: life sciences industry, PhD-student, quality compliance, research-related, sales & business, communication/education, information technology, consultancy, and policy. We coded generic skills using an adapted categorisation consisting of 46 generic skills within four categories, which were: self, others, information, and tasks. The descriptive statistics and cluster analysis results showed that although language, communication, and collaboration were the most requested skills, differences in requested generic skills between career paths and cluster composition were observed as well. We concluded that although some generic skills are important in general, other generic skills are relevant for specific life sciences career paths. To educate skilled life scientists, universities should consider the flexible integration of these generic skills in their life sciences programmes. [ABSTRACT FROM AUTHOR]

In higher education, students often write an undergraduate thesis and receive one-to-one or small group support. During mentoring, 10 teachers ideally diagnose students' research skills, to be able to adapt their support to students' needs. In this study, we aimed to answer the question of how mentors apply the diagnostic phases of a diagnostic question, a diagnosis, a diagnostic check and an intervention, during mentoring meetings about 15 students' research skills. Four mentors participated in this multiple case study. Qualitative data were gathered and sixteen videotaped mentoring meetings were coded on the four diagnostic phases. The results were compared within and between mentors, showing that mentors asked several diagnostic questions, seldom articulated and shared their diagnoses explicitly with students, and mainly used interventions. We concluded that more support is needed for mentors who do not automatically use their diagnostic questions to formulate explicit diagnoses about students' research skills. [ABSTRACT FROM AUTHOR]

Objective: To develop an educational intervention that targets residents' beliefs and attitudes to quality Improvement (QI) and leadership in order to demonstrate proactive behaviour.Design: Theory-driven, mixed methods study including document analysis, interviews, observations and open-ended questionnaires.Setting: Six Dutch teaching hospitals.Intervention: Using expertise from medicine, psychology, organizational and educational sciences we developed a situated learning programme named Ponder and IMProve (PIMP). The acronym PIMP reflects the original upbeat name in Dutch, Verwonder & Verbeter. It has a modern, positive meaning that relates to improving your current circumstances. In quarterly 1-h sessions residents are challenged to identify daily workplace frustrations and translate them into small-scale QI activities.Main Outcome Measures: Organizational awareness, beliefs and attitudes to QI and organizational responsibilities, resident behaviour, barriers and facilitators to successful learning and the programme's potential impact on the organization.Results: Overall, 19 PIMP meetings were held over a period of 3 years. Residents defined 119 PIMP goals, resolved 37 projects and are currently working on another 39 projects. Interviews show that PIMP sessions make residents more aware of the organizational aspects of their daily work. Moreover, residents feel empowered to take up the role of change agent. Facilitators for success include a positive cost-benefit trade-off, a valuable group process and a safe learning environment.Conclusion: This article demonstrates the added value of multidisciplinary theory-driven research for the design, development and evaluation of educational programmes. Residents can be encouraged to develop organizational awareness and reshape their daily frustrations in QI work. [ABSTRACT FROM AUTHOR]

Objectives: Medical residents can play key roles in improving health care quality by speaking up and giving suggestions for improvements. However, previous research on speaking up by medical residents has shown that speaking up is difficult for residents. This study explored: (i) whether two main aspects of medical residents' work context (job control and supervisor support) are associated with speaking up by medical residents, and (ii) whether these associations differ between in‐hospital and out‐of‐hospital settings. Methods: Speaking up was operationalised and measured as voice behaviour. Structural equation modelling using a cross‐sectional survey design was used to identify and test factors pertaining to speaking up and to compare hospital settings. Results: A total of 499 medical residents in the Netherlands participated in the study. Correlational analysis showed significant positive associations between each of support and control, and voice behaviour. The authors assumed that the associations between support and control, and voice behaviour would be partially mediated by engagement. This partial mediation model fitted the data best, but showed no association between support and voice. However, multi‐group analysis showed that for residents in hospital settings, support is associated with voice behaviour. For residents outside hospital settings, control is more important. Engagement mediated the effects of control and support outside hospital settings, but not within the hospital. Conclusions: This study shows that in order to enable medical residents to share their suggestions for improvement, it is beneficial to invest in supportive supervision and to increase their sense of control. Boosting medical residents' support would be most effective in hospital settings, whereas in other health care organisations it would be more effective to focus on job control. Job control and supervisor support are identified through this research as resources associated with residents "speaking up" and making suggestions for change, but the importance of each may depend on the setting in which residents work. [ABSTRACT FROM AUTHOR]

• Scoping review on the assessment notions AaL, AfL, and AoL. • A synthesis is presented of common characteristics of AaL, AfL, and AoL. • The synthesis emphasizes an integrative view for successful educational assessment. Associations between assessment and learning are widely studied and often organized around the notions of Assessment as Learning (AaL), Assessment for Learning (AfL), and Assessment of Learning (AoL). Although these notions are appealing in theory, the notions are unclear constructs to comprehend, as both their definitions and their practice are used inconsistently in educational research. We present a synthesis of common characteristics among these notions, based on a scoping review on definitions and descriptions of AaL, AfL, and AoL (131 studies). The synthesis of common characteristics consists of nine themes that refer to how educational assessment relates to learning. The themes are grouped into: 1) Student-teacher roles and relationships within assessment; 2) Assessment learning environment; and 3) Educational outcomes of assessment. Then, we used the themes within the synthesis to analyze the results of the included empirical studies on their contributions to practice (84 studies). The synthesis provides stakeholders with a clear and integrative view of how educational assessment relates to learning and may be beneficial to educators to support and design their assessment practices. We argue that the notions of AaL, AfL, and AoL should be seen in coherence with one another in order to establish an assessment culture that facilitates students' learning maximally. [ABSTRACT FROM AUTHOR]