Search

In this study, we aimed to identify how the learning activities elicited in a lesson study project contributed to self-perceived change in supervisors' pedagogical content knowledge (PCK). Lesson study is a method which combines both professional and educational development. During a lesson study project, teachers collaborate in a team and develop, teach, evaluate, and redesign a research lesson. During the 4-month lesson study project described here, four supervisors designed a protocol for research supervision meetings aimed at enhancing undergraduate students' learning. During the project, they experimented with open questioning and giving positive feedback instead of giving instruction and explanations. A mixed-methods design was used in this study. Data on the supervisors' learning activities and PCK were gathered using learner reports, video-recordings of meetings, and exit interviews. The analyses of these data showed that the lesson study project contributed to the development of the supervisors' PCK on instructional strategies and student understanding. The learning activity that contributed most to these changes was reflecting on their own practice and that of their students.

This study considers the extent to which a professional development programme for educational leaders in a research-intensive university contributes to participants' adaptive expertise in the domain of leading educational change. We evaluated the programme by asking participants to execute an authentic task at the beginning and end of the programme and compared the outcomes with participants' self-reported learning gains. While participants report they have substantially learned from participating, according to the task scores there is no significant progress in the development of adaptive expertise. Suggestions are offered to include more purposeful practice and more reflective activities in the programme.

Higher education aims for deep learning and increasingly uses a specific form of online education: Small Private Online Courses (SPOCs). To overcome challenges that instructors face in order to promote deep learning through that format, the use of feedback may have significant potential. We interviewed eleven instructors and four students and organized a focus group to formulate scalable design propositions for instructors in SPOCs to promote deep learning. Propositions have been formulated according to the CIMO-logic. This study resulted in identification of four mechanisms by which the desired outcome (deep learning) can be achieved, which we describe here along with proposed interventions. Results show that the "online learning interaction model" can be deepened with these mechanisms: 1) Feeling personally committed, 2) Asking and providing relevant feedback, 3) Probing back and forth, and 4) Understanding one's own learning process. To activate these mechanisms, scalable feedback interventions are described in three categories. Results at this relatively young field of SPOCs also show that feedback as a dialogical process may contribute to solving the current challenges of instructors in SPOCs to achieve deep learning with their students.

Diagnosing teachers are teachers who perceive diagnostic information about students' learning process, interpret these aspects, decide how to respond, and act based on this diagnostic decision. During supervision meetings about the undergraduate thesis supervisors make in-the-moment decisions while interacting with their students. We regarded research supervision as a teaching process for the supervisor and a learning process for the student. We tried to grasp supervisors' in-the-moment decisions and students' perceptions of supervisors' actions. Supervisor decisions and student perceptions were measured with video-stimulated recall interviews and coded using a content analysis approach. The results showed that the in-the-moment decisions our supervisors made had a strong focus on student learning. Supervisors often asked questions to empower students or to increase student understanding. These supervising strategies seemed to be adapted to students' needs, as the latter had positive perceptions when their control increased or when they received stimuli to think for themselves.

Optimal integration of education and ongoing faculty research in many undergraduate science programs is limited to the capstone project. Here, we aimed to develop a novel course-based undergraduate research experience (CURE) in synergy with ongoing faculty research. This 10-week course called Biomedical Research Lab is embedded in the curriculum of the undergraduate program Biomedical Sciences and grounded in the theoretical framework of research-based learning. Four groups of four students work together in a dedicated laboratory on an actual ongoing research problem of faculty. All groups work on the same research problem, albeit from different (methodological) perspectives, thereby stimulating interdependence between all participants. Students propose new research, execute the experiments, and collectively report in a single research article. According to students, the course enhanced scientific, laboratory, and academic skills. Students appreciated ownership and responsibilities of the research, laboratory teachers as role models, and they were inspired and motivated by doing authentic actual research. The course resulted in a better understanding of what doing research entails. Faculty valued the didactical experience, research output and scouting opportunities. Since topics can change per course edition, we have showcased a widely applicable pedagogy creating synergy between ongoing research and undergraduate education.

This review provides an overview of the existing literature on school-aged children's and youth's (i.e. 6- to 18-year-olds) personal and social development within the context of physical education and sports. A total of 4359 non-duplicate articles were retrieved from six databases. After the title, abstract and full text screening, 88 articles met the inclusion criteria and were included for further analysis. Articles had to be published in a peer-reviewed journal between 1 January 2008 and 6 December 2017. The 88 studies used several study designs, methods and instruments to investigate a variety of concepts related to personal and social development. Concepts were grouped into the following 11 themes: work ethic; control and management; goal-setting; decision-making; problem-solving; responsibility; leadership; cooperation; meeting people and making friends; communication; and prosocial behaviour. The main findings for each of the 11 themes are reported, and limitations and implications are provided to guide researchers and practitioners in their future work.

In higher education, students often misunderstand teachers' written feedback. This is worrisome, since written feedback is the main form of feedback in higher education. Organising feedback conversations, in which feedback request forms and verbal feedback are used, is a promising intervention to prevent misunderstanding of written feedback. In this study a 2 × 2 factorial experiment (N = 128) was conducted to examine the effects of a feedback request form (with vs. without) and feedback mode (written vs. verbal feedback). Results showed that verbal feedback had a significantly higher impact on students' feedback perception than written feedback; it did not improve students' self-efficacy, or motivation. Feedback request forms did not improve students' perceptions, self-efficacy, or motivation. Based on these results, we can conclude that students have positive feedback perceptions when teachers communicate their feedback verbally and more research is needed to investigate the use of feedback request forms.

Supervision meetings give teachers and students opportunities to interact with each other and to co-regulate students' learning processes. Co-regulation refers to the transitional process of a student who is becoming a self-regulated learner by interacting with a more capable other such as a teacher. During a task, teachers are expected to pull back their support and give opportunities to students to take responsibility. This study aims to explore the shifting patterns of co-regulation, feedback perception, and motivation during a 5-month research project. Participants were 20 students conducting research in pairs and six teachers who supervised these students. Two videotaped supervision meetings at the beginning and end of the research process and questionnaires on feedback perception and motivation were analysed. Results on co-regulation showed a constant and comparable level of regulation at the start and at the end of students' research projects. Feedback perception did not change, but motivation decreased significantly.

We investigated the relation between providing and receiving audio peer feedback with a deep approach to learning within online education. Online students were asked to complete peer feedback assignments. Data through a questionnaire with 108 respondents and 14 interviews were used to measure to what extent deep learning was perceived and why. Results support the view that both providing and receiving audio peer feedback indeed promote deep learning. As a consequence of the peer feedback method, the following student mechanisms were triggered: "feeling personally committed," "probing back and forth," and "understanding one's own learning process." Particularly important for both providing and receiving feedback is feeling personally committed. Results also show that mechanisms were a stronger predictor for deep learning when providing than when receiving. Given the context in which instructors face an increasing number of students and a high workload, students may be supported by online audio peer feedback as a method to choose a deep approach to learning.

In higher education, students often write an undergraduate thesis and receive one-to-one or small group support. During mentoring, 10 teachers ideally diagnose students' research skills, to be able to adapt their support to students' needs. In this study, we aimed to answer the question of how mentors apply the diagnostic phases of a diagnostic question, a diagnosis, a diagnostic check and an intervention, during mentoring meetings about 15 students' research skills. Four mentors participated in this multiple case study. Qualitative data were gathered and sixteen videotaped mentoring meetings were coded on the four diagnostic phases. The results were compared within and between mentors, showing that mentors asked several diagnostic questions, seldom articulated and shared their diagnoses explicitly with students, and mainly used interventions. We concluded that more support is needed for mentors who do not automatically use their diagnostic questions to formulate explicit diagnoses about students' research skills.

This experimental study is aimed at examining the effect of involving pupils in primary education in setting assessment criteria and standards on their appraisal of a peer's work and their peer feedback style. It is expected that our intervention will lead to (1) a criteria-referenced appraisal and (2) more final vocabulary, which is associated with a more authoritative style. In total, 95 sixth grade pupils from The Netherlands were randomly assigned to one of two conditions. In the experimental group, the pupils first received an exemplar, which was followed by a group discussion about appropriate assessment criteria and standards. In the control group, the pupils provided peer feedback without this discussion. Their peer appraisal was measured with a questionnaire and feedback style was determined by analysing the written feedback using a person-oriented approach (cluster analysis). Results showed that the chance that pupils in the experimental group had an authoritative style was three times higher than in the control group. Theoretical and practical implications of the study are discussed.

A rubric for research theses was developed, based on the manual of the American Psychological Association, to be used as an assessment tool for teachers and students. The aim was to make students aware of what is expected, get familiar with criteria, and interpret teacher and peer feedback. In two studies, it was examined whether students use and value these functions. In the first study, a rubric was provided to 105 Educational Sciences students working on their bachelor's thesis. Questionnaire data indicated that students did value the rubric for the intended functions, although rubric use was not related to ability. In a panel interview, teachers stated that the number of proficiency levels should be increased to be able to distinguish between good and excellent students adequately, and that a criterion concerning student's role during supervision should be added. Therefore, in the second study, 11 teachers were interviewed about their motives to give high grades and about the supervision process. This lead to an extra criterion concerning student's role during supervision and an additional proficiency level to assess excellent performance. It is argued that an adequate course organisation is conditional for the rubric's effectiveness.

This study's aim was to examine the prevalence, development and domain specificity of fifth- and sixth-grade elementary school students' achievement goal profiles. Achievement goals were measured for language and mathematics among 722 pupils at three points in time. These data were analysed through latent profile analysis and latent transition analysis. Results indicated that three similar goal profiles could be discerned at all measurement waves for both language and mathematics. Profiles were labelled "multiple goals," "approach oriented" and "moderate/indifferent." In both mathematics and language, around 80% of the participants remained stable in their goal profiles across measurements. Students who transitioned between goal profiles mostly moved from less to more favourable profiles. Profile membership and transitions between profiles were found to be relatively domain general with 60% overlap between domains. The high level of stability over time and across domains suggests that students' goal profiles represent relatively stable personal dispositions.

Purpose: The purpose of this paper is to explore whether oral feedback by inspectors of the Dutch Inspectorate of Education is an adequate method to support the professional development of teachers in primary education. This study aims to examine the impact of short feedback training for inspectors (focused on effective feedback conversations) on feedback quality and on teachers' feedback perception. In addition, it aims to study the relation between immediate perception and the delayed perception of that feedback. Design/methodology/approach: In an independent sample experimental design, 15 inspectors provided feedback to 40 teachers in primary education. Nine inspectors received short feedback training (the experimental group), while six others did not receive this training (the control group). Findings: The results indicate that feedback provided by trained inspectors can foster professional development of teachers in primary education and that short feedback training has added value. The quality of the feedback by inspectors was related to teachers' immediate perception of the feedback and the delayed perception of the feedback. Research limitations/implications: A limitation of this study is the small group of inspectors and the limited number of feedback conversations they could provide. Further research could be aimed at examining the impact of feedback of trained inspectors on the professional development of underperforming teachers. Originality/value: This paper contributes to research that examines effective ways to use feedback conversations in workplace settings for the professional development of teachers. (Contains 5 tables, 1 figure, and 1 note.)

This study investigated the effects of feedback providing improvement strategies and a reflection assignment on students' writing motivation, process, and performance. Students in the experimental feedback condition (n = 41) received feedback including improvement strategies, whereas students in the control feedback condition (n = 41) received feedback without improvement strategies. Within each feedback condition, half of the students received a reflection assignment on feedback use and the revision (experimental reflection condition), while the other half received a reflection assignment on feedback perception (control reflection condition). Results indicated that in the experimental feedback condition writing performance gained from the control reflection assignment, while in the control feedback condition it gained from the experimental reflection assignment. Improvement strategies negatively predicted self-efficacy beliefs, especially when initial self-efficacy beliefs were low, and positively predicted planning/revising. Reflections on feedback use and the revision positively predicted mastery goal when mastery goal initially was low or moderate. (Contains 9 tables and 2 figures.)

The goal of this article is to contribute to the validation of a self-evaluation method, which can be used by schools to evaluate the quality of their Competence Assessment Program (CAP). The outcomes of the self-evaluations of two schools are systematically compared: a novice school with little experience in competence-based education and assessment, and an innovative school with extensive experience. The self-evaluation was based on 12 quality criteria for CAPs, including both validity and reliability, and criteria stressing the importance of the formative function of assessment, such as meaningfulness and educational consequences. In each school, teachers, management and examination board participated. Results show that the two schools use different approaches to assure assessment quality. The innovative school seems to be more aware of its own strengths and weaknesses, to have a more positive attitude towards teachers, students, and educational innovations, and to explicitly involve stakeholders (i.e., teachers, students, and the work field) in their assessments. This school also had a more explicit vision of the goal of competence-based education and could design its assessments in accordance with these goals.

The effects of progress feedback on university students' writing mastery goal, self-efficacy beliefs, and writing performance were examined in this experiment. Students in the experimental condition (n = 42) received progress feedback on their writing assignment, whereas students in the control condition (n = 44) received feedback without progress information. The Motivated Strategies for Learning Questionnaire (MSLQ) was used to measure students' writing mastery goal and self-efficacy beliefs. Results showed that progress feedback did not affect students' writing mastery goal and performance but did affect students' self-efficacy beliefs. The effect depended on the number of progress comments. (Contains 4 tables and 2 figures.)

For competences development of learners and professionals, target competences and corresponding competence development opportunities have to be identified. Personal Recommender Systems (PRS) provide personal recommendations for learners aimed at finding and selecting learning activities that best match their needs. This article argues that a clear-cut description of the concept of "competence" is needed for appropriate system-based personal recommendations. It is proposed to extend current initiatives on standardization of modelling competences with the concept of "Learning and performance situation" (LP-situation) and it is claimed that this extension has added value for personal recommendations for adequate selection of learning activities, for determining proficiency levels of competences, for the design of learning tasks, and for accreditation of prior knowledge. Advantages and disadvantages are discussed. (Contains 3 tables.)

As assessment methods are changing, the way to determine their quality needs to be changed accordingly. This article argues for the use Competence Assessment Programs (CAPs), combinations of traditional tests and new assessment methods which involve both formative and summative assessments. To assist schools in evaluating their CAPs, a self-evaluation procedure was developed, based on 12 quality criteria for CAPs developed in earlier studies. A self-evaluation was chosen as it is increasingly used as an alternative to external evaluation. The CAP self-evaluation is carried out by a group of functionaries from the same school and comprises individual self-evaluations and a group interview. The CAP is rated on the 12 quality criteria and a piece of evidence is asked for to support these ratings. In this study, three functionaries from eight schools (N=24) evaluated their CAP using the self-evaluation procedure. Results show that the group interview was very important as different perspectives on the CAP are assembled here into an overall picture of the CAP's quality. Schools seem to use mainly personal experiences to support their ratings and need to be supported in the process of carrying out a self-evaluation.

A General Practitioner (GP) is no longer a loner, but a team player in either a group practice or a care centre. This change has led to a concomitant growth in curricular interest in skills essential for successful collaboration and for enhancing critical reflection towards colleagues' performance. Giving and receiving constructive feedback are examples of these skills. The aim of this study was to gain insight in the style and quality of feedback reports on consultation skills written by GPs-in-Training (GPiTs) and by their GP-trainers. Furthermore, the preferences of the GPiTs concerning feedback style were examined. Results show significant differences between GP-trainers and GPiTs in feedback style and quality. A ranking task indicated that GPiTs have a preference for reports characterised by a large number of reflective remarks. Questionnaire results indicate the added value of the use of peer feedback. Implications for the integration of peer feedback activities in the curriculum of GPiTs are discussed.

This article focuses on the design of competency-based performance assessment in e-learning. Though effort has been invested in designing powerful e-learning environments, relatively little attention has been paid to the design of valid and reliable assessments in such environments, leaving many questions to educational developers and teachers. As a solution to this problem, a systematic approach to designing performance assessments in e-learning contexts is presented, partly based on the 4C/ID model. This model enables the construction of realistic whole tasks instead of advocating education that is restricted to more isolated skills. A new assessment procedure also implies an alternative view of instructional design, learning and assessment. The requirements for the learning environment are addressed. Examples from a virtual seminar are presented to illustrate the design approach. The article concludes with the identification of possible pitfalls related to the approach and gives directions for future research.

Quantitative content analysis is increasingly used to surpass surface level analyses in computer-supported collaborative learning (e.g., counting messages), but critical reflection on accepted practice has generally not been reported. A review of CSCL conference proceedings revealed a general vagueness in definitions of units of analysis. In general, arguments for choosing a unit were lacking and decisions made while developing the content analysis procedures were not made explicit. In this article, it will be illustrated that the currently accepted practices concerning the "unit of meaning" are not generally applicable to quantitative content analysis of electronic communication. Such analysis is affected by "unit boundary overlap" and contextual constraints having to do with the technology used. The analysis of e-mail communication required a different unit of analysis and segmentation procedure. This procedure proved to be reliable, and the subsequent coding of these units for quantitative analysis yielded satisfactory reliabilities. These findings have implications and recommendations for current content analysis practice in CSCL research.