Search

Background: Writing is an important and complex skill, which could be enhanced by teaching students effective writing strategies such as outlining. Electronic outlining - integrated feature in Microsoft® Word -- has been shown to enhance students' writing performance. However, little is known about the optimal didactic approach for electronic outlining. Objective: This study examined the effects of learning to use electronic outlining either via observational learning or via learning-by-doing on students' argumentative writing performance. Methods: Students (N = 129, 10th-grade) were assigned with their complete class to one of three conditions: a control (traditional pen and paper outlines via learning-by-doing), outline (electronic outlines via learning-by-doing) or observation (electronic outlines via observational learning) condition. Students followed an argumentative writing lesson-series that differed across conditions in terms of planning strategies and didactic approaches used. To examine the influence of the different conditions on students' writing, argumentative texts were used as pre- and post-tests, and the quality was evaluated with an analytic assessment protocol. In addition, data regarding students' perceived mental effort and the organisation of the writing process were collected. Finally, students' attitudes towards electronic outlining were assessed. Results and Conclusion: Although the overall text structure had improved after the lesson series, no significant differences were found between conditions. Electronic outlining increased the total amount of time dedicated to the texts as well as the revision ratio. Students in the observation condition showed a higher pause ratio and a lower fluency on the post-test as compared to students who learned by doing (both control and outline conditions). With regard to perceived mental effort, students in the outline and control conditions perceived significant decreases over tasks, as opposed to those in the observation condition. In conclusion, the self-reports indicate that students in the outline condition appropriated electronic outlining significantly better than those in the observation condition, suggesting that practice enhanced students' appropriation of electronic outlining.

High-quality elaborative peer feedback is a blessing for both learners and teachers. However, learners can experience difficulties in giving high-quality feedback on complex skills using textual analytic rubrics. High-quality elaborative feedback can be strengthened by adding video-modeling examples with embedded self-explanation prompts, turning textual analytic rubrics (TR) into so-called 'video-enhanced analytic rubrics' (VER). This study contrasts two experimental conditions (TR, n = 54; VERs, n = 49) with their version of the anonymized online tool (used to collect the given feedback in 'Tips for improvement and Tops identifying strengths'). Peer feedback quality (concreteness and consistency) was evaluated using Natural Language Processing. As expected, the video-enhanced rubrics condition resulted in a higher quantity of words used and a lower amount of naive wording compared to the textual rubric condition. Contrary to our assumptions, it did not lower the amount of non-constructive wording nor improved the amount of behavioral and process-related feedback. Possibly, the transition from providing more feedback to delivering more accurate behavioral and process-related feedback has not yet been made in the time set for the study.

Although various academic disciplines use data papers to support effective research practices, data papers are still uncommon in the educational sciences. Main goals of data papers are enhancing transparency regarding research processes and supporting data sharing among researchers and thus, open science. As many educational research projects include personal data often of minors, publishing raw data can be challenging due to privacy regulations and laws (GDPR). The present article aims at exploring how a data paper can contribute to open science and enhancing transparency regarding research and publication processes for educational research projects, often containing personal data that cannot be made openly available in its raw form. To this end, we describe a dataset of a research project on teachers' noticing as basis for their classroom management. As this project includes rich process-tracing recording methods, the dataset is diverse and serves as basis for multiple analyses and publications while containing personal data of teachers and minors. By elaborating on the characteristics of the dataset, its gathering, analysis approaches and sharing preprocessed and anonymized data files, this data paper explores how to contribute to transparency and open science in educational sciences while acting within the boundaries set by privacy regulations and laws.

Learners in the process of developing complex skills need a rich mental model of what such skills entail. Textual analytics rubrics (TR) are a widely used instrument to support formative assessment of complex skills, supporting feedback, reflection, and thus mental model development of complex skills. However, the textual nature of a rubric limits the possibility to deliver contextual and dynamic (time-and behaviour-oriented) information. In the Viewbrics online tool, we developed a version supporting the delivery of contextual and dynamic information by adding video-modelling examples with embedded self-explanation prompts to textual analytics rubrics. We called this combination as video-enhanced rubrics (VERs). Our current study investigates whether the Viewbrics online tool supports complex skills development and whether either textual- or video-enhanced rubrics best support complex skills' mastery. The study was a three-group (VERS n = 49, TR n = 54, control n = 50) within-subjects design. Learners' performance of complex skills was measured through expert, peer, and self-assessment using the Viewbrics online tool. A multilevel regression analysis shows learners in the TR and VERS conditions consistently outperforming the control condition to varying degrees across skills. However, no differences have been found between the two experimental conditions. Positive results across different complex skills indicate the Viewbrics online tool can be used to support the development of a wide range of complex skills in secondary education.

The aim of the present empirical study was to explore students' self-regulated learning behaviours in vocational education and training and to describe the micro processes associated with planning, monitoring and evaluating during practical learning tasks. The 18 participants were well-performing students from upper secondary vocational education. We collected data from observations, interviews and self-reports to gain detailed insights into students' behaviours and thoughts during practical task performance. The results reveal that most of the students planned their time and resources, but did not develop elaborate plans to regulate their learning behaviours. They monitored their work carefully and adjusted when necessary. When evaluating, students focussed more on work outcomes than learning processes. The results also showed that the students' actual behaviours corresponded with self-reports on internal regulation, with three students overestimating their internal regulation. This study sheds light on an underexplored context and population regarding self-regulated learning. Though the well-performing vocational students engaged in self-regulation, their self-regulating behaviours were led by a combination of hands-on activities and evolving work outcomes. Thus, it was the emerging performance and experiences that triggered their learning. Although self-regulated learning behaviours in vocational education and training were present, we conclude that instructional support needs to be developed and empirically tested to actively facilitate and foster vocational students' learning by doing and reflection.

For learners, it can be difficult to imagine how to perform a complex skill based on textual information from solely a text-based analytic rubric. Rubrics lack (1) the contextual information needed to convey real-world attributes (2) the dynamic information (such as gesturing in the complex skill of presenting) (3) the procedural information required to support the automation of constituent skills. We propose to address the text-based rubric's deficiencies by adding video-modeling examples, self-explanation prompts, an intertwined educational- and instructional narrative, natural segmentation, and a non-verbal script. With the resulting Video Enhanced Rubric, we aim to improve the formative assessment of complex skills by fostering learner's mental model development, feedback quality, and complex skill mastery. Designing multimedia to support the formative assessment of complex skills using can cause dilemmas for instructional designers. For example, is learner control needed to foster intrinsic motivation or is it deemed to create extraneous cognitive load? Is it wise to use a video modeling example of peer-aged learners when the model does not display perfect performance? We found seven dilemmas around proven complex skill development, motivational design, and multimedia design guidelines. This paper presents a theoretical contribution to instructional design by introducing a framework to address dilemmas regarding such design dilemmas. As a practical contribution, we support educational researchers and practitioners by presenting six practical guidelines for designing a Video Enhanced Rubric. A use case of the Viewbrics-project provides insight into the practical application of the framework within the context of Dutch pre-university education.

In vocational education, workplace simulations (WPS) have been implemented to ensure a better connection between the educational setting and the labour market. Moreover, WPS are supposed to motivate students and promote self-directed learning. So far, however, not much is known about the way students experience these WPS. The aim of the present exploratory case study was to investigate students' perceptions and preparedness for WPS and explore what factors they perceive to be relevant for their learning in these simulations. Forty students from three different pre-vocational secondary schools participated. Semi-structured group interviews were conducted and thematic analysis was used to examine the qualitative data. The results revealed that authentic WPS can increase student motivation and engagement. Learner characteristics regarded as relevant in WPS were motivation, responsibility, independence and discipline. For students, the presence and guidance of the teacher played an essential role in their working and learning effectively. They felt limited in making choices to direct their own learning. Assessment criteria were not transparent enough for students. Concluding, we found that students perceived factors closely related to self-regulated and self-directed learning to be relevant for their learning; however, these learning activities and processes have not yet been sufficiently promoted and supported in the investigated vocational schools. The study highlights design dilemmas for vocational practice and offers indications in how to match both learning environmental characteristics and teacher support tailored to learners' needs.

Teachers and students have their own perceptions of education. Congruent perceptions contribute to optimal teaching-learning processes and help achieving best learning outcomes. This study investigated patterns in differences between students' and teachers' perceptions of their learning environment. Student profiles were identified taking into account the degree of congruence/friction with teachers' perceptions. Teacher profiles were identified based on their differences in perceptions to students. Profiles were validated with regard to learning-related student characteristics and approaches to teaching. Tenth graders (N = 994) of four secondary schools filled out the Inventory of Perceived Study Environment-Extended (IPSEE) and the Inventory of Learning Styles. Their teachers (N = 136) filled out the teacher version of the IPSEE and the Approaches to Teaching Inventory. Latent class analyses were conducted to define profiles with respect to the magnitude of differences in perceptions. Results showed three student profiles: Closest match profile (30%), intermediate profile (59%), and distal profile (11%). While closest match students had desirable learning-related characteristics, others did not and are at risk for destructive friction. Two teacher profiles described idealistic teachers (70%) and adaptive teachers (30%), which related to approaches to teaching. Subgroups of students and teachers provide a comprehensive picture of those who are at risk because of too large differences in perceptions. This study stresses that differences in perceptions deserve detailed attention for optimising learning environments. Involving both students and teachers in the instructional design process could be a way to better account for perceptions of both stakeholders.

Background: Students' perspective on education is of crucial importance for its effectivity, but students' opinions are seldom acknowledged by teachers and designers. Student participation in the educational design process could be a suitable tool to better take students' preferences into account. However, for effective participatory design, it is necessary to know whether students have stable preferences for the design of their education. Changeability of preferences would require a more continuing design process allowing continuous adaptations. Aims: This longitudinal survey study aimed to determine the changeability over time of students' preferences for different aspects of a learning environment. Additionally, causes of possible changes in preferences are investigated. Sample: The participants were 1,335 high school students of five schools for secondary education in the Netherlands, joining this study during a period of 2 years. Method: Data about students' preferences were collected at three moments, using the Inventory of Perceived Study Environment Extended. Learning-related student characteristics, such as processing strategies and motivational orientations, were measured with the Inventory of Learning Styles. Additionally, data on learning performances were collected. Results: The results showed stability on preferences for almost all studied characteristics of the learning environment. Particularly remarkable was a drop in desirability for student autonomy. This was larger for students with a certificate-oriented motivation and smaller for self-regulated students. Additionally, poorly performing students had a larger decrease in preference for autonomy. Conclusions: The stability on most aspects supports that participatory design might result in fairly stable instructional designs, although caution is needed with respect to student autonomy. (Contains 3 figures and 5 tables.)

Students' perceptions of instruction are important because they direct the learning of students. The fact that teachers have only limited knowledge of these perceptions is likely to threaten the effectiveness of learning, because congruence between interpretations of an instructional intervention is necessary for its optimal use. This study examines participatory design as a strategy for taking student perceptions into account in instructional re/design. Participatory design meetings of groups of teachers and seven co-designing students in a secondary education setting identified changes to improve the regular education process. The results on changes in student perceptions, perceived-desired discrepancy, and teacher-student disagreement showed some improvement for the co-designers but, unexpectedly, limited or even negative effects for the non-co-designing students. Possible causes are discussed. Participatory design seems to have potential for improving education, but further research is needed. (Contains 7 tables.)

Background: Teachers have limited insight in students' perspectives on education, although these perspectives influence quality of learning. As students' and teachers' perspectives differ considerably, there is a need for teachers to learn more about students' experiences and ideas about education. Participatory design might be a good strategy for taking student perspectives into account in instructional design. In areas outside education, the positive effects of participation have already been demonstrated. Purpose: The main goals of this exploratory study are to develop an approach--based on the principles of participatory design--for student participation in instructional design, and to evaluate how students and teachers experience the discussion about possible changes in the design and how they co-operate in designing lessons. Additionally, the study investigates whether the used approach is workable and suitable for use with a range of courses. Sample: The sample consisted of six teachers (of mathematics, economics and English) from two secondary schools in the Netherlands and their 10th-grade pre-university students (N = 139; average age 16 years). In each class, a small group of seven co-designing students was selected as a representative sample of their class. All other students in these classes (i.e. those not directly involved in participatory re-design) were also included, as evaluators of the proposed changes. Design and methods: A participatory design meeting was organised for each group separately. In all groups, the same approach for participatory design was used. The quality of the meeting and the agreement with the proposed changes were evaluated using open questions. The questions were answered individually by both teachers and co-designing students. The remaining students answered questions about their agreement with the proposed changes. The written answers were analysed using a coding scheme. Results: Findings suggest that both teachers and co-designing students were largely satisfied with the meeting. The atmosphere was experienced predominantly as comfortable and enough opportunities were provided to express thoughts and ideas. Teachers, additionally, stated that the usability of students' suggestions was good. The remaining students predominantly agreed on the proposed changes discussed. No differences were found between the evaluation scores of students of different courses. Conclusions: The main conclusion from this exploratory study is that participatory design appears suitable for use in education. The approach used for initiating and structuring the discussion between the teacher and his/her students was appropriate for designing lessons, according to all those involved. As this study suggests, the barriers to the inclusion of students in the instructional design process are not insurmountable, and there are compelling reasons for implementing participatory design in education. (Contains 4 tables and 1 figure.)

This paper presents the IPS-I-model: a model that describes the process of information problem solving (IPS) in which the Internet (I) is used to search information. The IPS-I-model is based on three studies, in which students in secondary and (post) higher education were asked to solve information problems, while thinking aloud. In-depth analyses of the thinking-aloud protocols revealed that the IPS-process consists of five constituent skills: (a) defining information problem, (b) searching information, (c) scanning information, (d) processing information, and (e) organizing and presenting information. Further, the studies revealed that regulation skills prove to be crucial for the on-going IPS-process. The IPS-I-model depicts the constituent skills, regulation skills, and important conditional skills. The model gives an initial impetus for designing IPS-instruction. (Contains 3 tables and 3 figures.)

In on-demand education, students often experience problems with directing their own learning processes. A Structured Task Evaluation and Planning Portfolio (STEPP) was designed to help students develop 3 basic self-directed learning skills: Assessing the quality of own performance, formulating learning needs, and selecting future learning tasks. A case study with 10 first-year students in the domain of hairdressing was conducted to evaluate STEPP's use, usability, and perceived effectiveness. Results from student interviews show that usability and use are influenced by several factors. Students with low prior hairdressing skills, a weakly developed personal approach to direct their own learning, and an inclination to update STEPP as part of their weekly routine, use STEPP more frequently than students without these characteristics. Both the supervisor and students who frequently used STEPP perceived its use as a positive contribution to the development of self-directed learning skills. Furthermore, this study provides guidelines for the design of development portfolios in on-demand education.

This experimental study was designed to investigate whether supervision meetings, in which students receive specific advice on how to use a development portfolio to monitor their progress and plan their future learning, helps them to develop self-directed learning skills and improve their learning in the domain. In the first year of a hairdressing program in vocational education, supervision meetings were used to provide students with either specific advice or not. Students in the advice group (n = 21) formulated better learning needs, selected more suitable learning tasks, completed more practical assignments, and acquired more certificates than students in the feedback-only group (n = 22). Interviews also showed that students in the advice group appreciated the supervision meeting more and perceived them as more effective than students in the feedback-only group. Guidelines are provided for the use of development portfolios and the organization of supervision meetings in on-demand vocational education.

The World Wide Web (WWW) has become the biggest information source for students while solving information problems for school projects. Since anyone can post anything on the WWW, information is often unreliable or incomplete, and it is important to evaluate sources and information before using them. Earlier research has shown that students have difficulties with evaluating sources and information. This study investigates the criteria secondary educational students use while searching the Web for information. 23 students solved two information problems while thinking aloud. After completing the tasks they were interviewed in groups on their use of criteria. Results show that students do not evaluate results, source and information very often. The criteria students mention when asked which criteria are important for evaluating information are not always the same criteria they mention while solving the information problems. They mentioned more criteria but also admitted not always using these criteria while searching the Web. (Contains 1 figure and 12 tables.)

Research has shown the importance of students' perceptions of a learning environment and the existence of discrepancies between students' and teachers' perceptions. Participatory design could be a helpful strategy to reduce such discrepancies and eventually improve the design of learning environments, as it has proven to be effective to optimize design in other domains. The current study investigated the desirability and feasibility of possible use of participatory design in education. Students and teachers in secondary education were interviewed about their opinions on the idea of participatory design of a learning environment. Both students and teachers displayed predominantly positive opinions towards possibly engaging in participatory design, supporting its desirability and feasibility. Practical suggestions for implementation are included. (Contains 2 tables. Coding scheme: description of response categories to interview questions is appended.)

Educational designers often develop a "powerful learning environment" that is subsequently implemented by teachers. Due to a lack of cooperation with teachers they may receive limited feedback on the quality of their design and the way it is implemented. This study focuses on teachers' perceptions of a Dutch innovative learning environment called the "Second Phase", as well as their desires and their dis/satisfaction with this environment. The results show that teachers are reserved about student autonomy and productive learning. Perceptions and desires are related to their individual approaches to teaching. The findings provide useful feedback for designers and a starting point to intensify their cooperation with teachers.

Evaluating the trustworthiness of sources is important in today’s society. However, research has shown that students struggle when applying this skill. This study in history education aims to gain insight into students’ procedural knowledge about evaluating the trustworthiness of sources and into the value students attach to learning this skill. Grade 9 students (N = 132) performed tasks and filled out a questionnaire. Students applied more correct criteria of trustworthiness than they reported knowing. They considered this skill somewhat important and useful, but less interesting. Procedural knowledge and task value were significant predictors of students’ task performance. Therefore, it is important to make students aware of the knowledge they implicitly possess and to make learning this skill more interesting for students. [ABSTRACT FROM AUTHOR]

Fake news and disinformation are easily spread in today's digital society. Therefore, it is important that students learn how to evaluate the trustworthiness of online information, but this skill is often confined to a limited number of subjects in secondary education. History classes can potentially contribute to developing this skill. Therefore, the first aim of this study was to investigate whether there is a relationship between how Grade 9 students (N = 112) perform while evaluating the trustworthiness of historical sources and internet sources. Average student performance on both kinds of sources was similar, but the distribution of the scores was significantly different. There was a moderate correlation between students’ total scores on the historical task and the internet task. Two of the three criteria of trustworthiness that could be used on both kinds of sources were used by a great majority in both tasks. The second aim was to gain more insight into students’ (N = 8) and teachers’ perspectives (N = 8) on the usefulness of the evaluation skill learned in history class for other contexts, especially when searching on the internet. While most of the teachers mentioned the importance of the skill when using the internet, none of the students did so spontaneously. We suggest that history classrooms are an appropriate place to teach students not only about historical sources but also about internet sources, provided that more explicit attention is given to the relationship between both types of sources. [ABSTRACT FROM AUTHOR]

This study addresses to what extent and how electronic outlining enhances students' writing performance. To this end, the focus of this study is not only on students' final writing products but also on the organisation of the writing process (i.e., planning, translating, and reviewing) and perceived mental effort during writing. In addition, effects of repeated electronic outlining were examined. A combined within and between subjects design was implemented in which 93 10th-grade students wrote two argumentative texts with or without using electronic outlining. Analyses showed that using electronic outlining for planning and writing significantly improved the presentation of the argumentative structure. However, effects were less clear for correctly and completely establishing a text structure and no effects were found on the elaboration of students' argumentation. Process data showed that electronic outlining increased total process time, but no effect was found on students' overall planning and revision activities. Finally, self-reports showed no effect of electronic outlining on students' perceived mental effort. Nevertheless, repeated use of the same writing strategy enhanced writing fluency. [ABSTRACT FROM AUTHOR]