Search

The main result of this effectiveness study is that a reading program with a focus on students’ poetry reading processes, based on observational learning via eye movement modeling examples, can improve students’ reading comprehension for different text types. In a pretest-posttest design with an experimental group (ten classes) and a control group (five classes), students’ self-efficacy regarding their own reading process and their reading comprehension were measured. Over a six-week period, teachers of Dutch and their students worked with the six experimental lessons, instead of the regular reading program: students observed and evaluated contrasting peer reading processes, reflected on differences with their own reading process, and then they practiced aspects of a deep reading process. The program resulted in significant progress in the reading comprehension of “expository texts” (ES = .66), “short stories” (ES = .66), and especially “poetry” (ES = .81). Furthermore, the self-efficacy test results show that students in the experimental condition experienced significantly more learning effect after the intervention period than those in the control group. Moreover, based on the learning reports, evaluation tasks and interviews, it appears that the participants in the innovative program have become aware of their reading and how they improved their performance.

Assessing students’ writing performance is essential to adequately monitor and promote individual writing development, but it is also a challenge. The present research investigates a benchmark rating procedure for assessing texts written by upper-elementary students. In two studies we examined whether a benchmark rating procedure (1) leads to reliable and generalisable scores that converge with holistic and analytic ratings, and (2) can be used for rating texts varying in topic and genre. Results support evidence that benchmark ratings are a valid indicator of text quality as they converge with holistic and analytic scores. They are also associated with less rater variance and less task-specific variance, leading to reliable and generalisable ratings. Moreover, a benchmark scale can be used for rating different tasks with the same reliability, at least when texts are written in the same genre. Taken together, a benchmark rating procedure ensures meaningful and useful information on students’ writing.

National assessments yield a description of the proficiency level in a domain while accounting for differences between tasks. For instance, in writing assessments the level of proficiency is typically evaluated with a variety of topics and multiple tasks. This enables generalizations from specific tasks to a domain. In (quasi-)experimental research, however, writing skills are often evaluated with a single task. Yet, conclusions about the effectiveness of the treatment are formulated on the level of the domain, which is, euphemistically put, quite a stretch. Although conclusions drawn about the effect of the treatment are specific to the task administered, they are often generalized to the domain without any form of reservation. This raises the question whether we can use the results of national assessments about differences between tasks in the analyses of experimental studies. In this paper, we demonstrate how the information of a baseline data set can be used as a kind of control condition in the analysis of an experimental study.

Janneke Stuulen, Renske Bouwer en Huub van den Bergh onderzochten hoe leerlingen peerfeedback gaven met verschillende beoordelingsmethoden, en hoe zij deze peerfeedback gebruikten voor het reviseren van hun eigen tekst. De ene groep leerlingen gaf feedback aan de hand van paarsgewijs vergelijken, de andere groep gaf feedback met behulp van een analytisch beoordelingsformulier. De resultaten laten zien dat leerlingen uit de conditie met het beoordelingsformulier meer feedback gaven op inhoudelijke aspecten dan leerlingen uit de conditie paarsgewijs vergelijken, en dat zij deze feedback ook vaker verwerkten. Er is echter geen effect van peerfeedbackconditie op tekstkwaliteit: in beide condities was de tekstkwaliteit na het herschrijven in dezelfde mate verbeterd.

In Dutch L1 classrooms, style in non-fictional genres is typically taught by means of normative exercises in which students are tasked to identify stylistic lapses. Not much is known about the effectiveness of such exercises when teaching style. Unknown factors include what kinds of stylistic shortcomings are found in Dutch students’ writing, and how the occurrence of certain stylistic lapses relates to writing quality. The current study empirically explores these scarcely investigated issues. Teachers rated 125 argumentative texts written by tenth-grade pre-university students by means of comparative judgement. Additionally, these texts were manually analyzed to investigate the occurrence of stylistic lapses, taking into account stylistic lapses that are common in text books (‘standard category’) and other types of style related errors (‘other category’). Multilevel regression analyses revealed that only one of the stylistic lapses from the standard category negatively influenced text quality as evaluated by teachers, namely the use of detached phrases. In the other category, only mistakes in question marks negatively predicted text quality. A final model including those two predictors explained 11.1% of the variance in text quality. The article discusses the implications of these findings for non-fictional style education, suggesting that it might need to be refocused.

In the Netherlands, the quality of the reading curriculum is currently under debate because of disappointing results on national and international assessments of students’ reading skills and motivation. In a mixed-method study, we analyzed the content of Dutch textbooks for reading comprehension instruction (i.e., the implemented curriculum) and teachers’ evaluation and use of these books (i.e., the enacted curriculum). A materials analysis of reading comprehension lessons (N = 80) in eight textbooks for grades 4 and 5 was complemented with semi-structured teacher interviews (N = 29) and lesson observations (N = 11), with a focus on the quality of reading strategy and text structure instruction in the curriculum. Main findings are (1) a lack of alignment between lesson goals, theory, and assignments, (2) a strong focus on practicing strategies, (3) limited declarative knowledge about strategies and text structure, (4) little opportunities for self-regulated strategy application. The teachers that were interviewed mention similar problems, but still hardly deviate from the textbook’s content and pedagogical guidelines. We make recommendations to improve the quality of the curriculum.

In this study we examine process configurations in synthesis tasks. We study whether these configurations are students traits or vary within students per task. In a national survey with a representative sample of 658 Dutch upper-secondary school students, we collected writing tasks, registered students’ writing behaviors (via keylogging) and their task perceptions and assessed the quality of their texts. Each participant completed two informative and two argumentative synthesis tasks. Writing process configurations were based on a preselected set of writing behaviors that proved to be related to text quality: time spent on sources and production activities, switching between sources and between sources and text production, and speed of production; with reference to the phase in the process (first, mid, final part). Latent profile analyses distilled four process configurations, some of which were more likely to occur with the informative genre. One process configuration, that is, “Fast text production,” was related to qualitatively higher text quality scores than the others. Additionally, at the age of 16–18 a writing process configuration is not a student trait: in most instances, we observed two or more task configurations within students. Writers' task experiences such as topic knowledge and topic interest predicted the occurrence of certain process configurations which could indicate adaptivity. The finding that writing configurations of writers vary even between similar tasks has important implications for the generalizability of (synthesis) writing research on the basis of a single writing task and process per student.

The purpose of this study is to determine how specific language mistakes can influence the assessment of a written work when a rubric is used. In this study 45 written works by Dutch 3rd and 5th year secondary school students of English were assessed by 5 different Dutch teachers of English who used the same rubric for their assessment. The results show that certain types of language mistakes have a significant negative correlation with the language category of the rubric, but also other (unrelated) aspects of the rubric such as structure and content. When examining the results for each group this significant correlation still exists, mostly for the group of 3rd year students. None of the mistakes had any predictive value on any of the rubric categories besides language, but certain types of language mistakes seem to have a higher impact on the score for language. Three types of language mistakes, namely: spelling, verb tenses, and usage mistakes had a significant predictive value for the language score, but when taking into account the average amount of mistakes made of these types, the difference it would make would be relatively low.

Writing a synthesis text - a text that integrates information from different sources - forms part of the educational curriculum of Dutch secondary education. Representative information on students' synthesis writing skills is currently missing. Therefore, we carried out a national survey on synthesis writing in the three highest grades of preuniversity education in the Netherlands. The aim was to map synthesis writing on three aspects: text quality, writing process and students' perspectives on writing. A large and representative sample of 658 students participated. Each participant wrote several synthesis texts. Text quality was rated with benchmark texts: writing processes were registered with keystroke logging software and a questionnaire measured students' perspectives on writing. Multilevel analyses were used to identify the effect of grade. gender and genre (argumentative/ informative synthesis) on text quality and writing process. and the effect of grade and gender on perspectives. This national survey is a descriptive study providing information on the current state of synthesis writing of Dutch students: how well do students perform on synthesis tasks?, how do they write synthesis tasks?, and what are their perspectives on synthesis writing? Moreover, this study serves as a baseline for future research.

The aim of this study was to test whether Cummins' Linguistic Interdependence Hypothesis (LIH) might also apply to writing, by determining to what extent writers' text quality, source use and argumentation behavior are related in L1 and L2, how effective writers' behavior is and whether their L2 proficiency influenced the relations between them. To answer these questions, twenty students wrote four short argumentative source based essays each in L1 (Dutch) and four in L2 (English). A within-writer cross-linguistic comparison of their texts revealed that their L1 and L2 writing competencies appear to be related. Furthermore, writers' source use behavior differed to some extent between languages, but the strong positive correlations found between source use features suggest that in most cases this was more a person than a language effect. Similarly, for argumentation behavior, results showed some learner specific features (e.g. inclusion of titles and reference lists), but differences between languages for others (e.g. the inclusion of both arguments and counter-arguments). Effects of the different source use and argumentation features studied on text quality were limited and no clear effect of L2 proficiency on writers' behavior or their influence on text quality were found. Overall, in line with earlier research, these findings provide some additional support for Cummins' LIH and the idea that writers might have a common underlying source for writing related knowledge and practices which they can apply in multiple languages., Special Issue: SI

The aim of this study was to provide insight into the current practice of writing instruction in Dutch primary education, as a stepping stone for designing and implementing sustainable innovations that could satisfy both practitioners and policymakers. We investigated the extent to which three domain-specific approaches-communicative writing, process writing, and writing strategy instruction-and general features of high-quality instruction were implemented in writing lessons in the upper grades of primary schools. We also examined the learning time for writing, teachers' views on writing and writing instruction, how efficacious they feel about teaching writing, and how skilled they are in the writing instruction domain. Lastly, we explored relations between classroom practices, learning time, and teachers' beliefs and skills through correlation analysis, to identify potential aids and constraints to guide innovations in writing education. Participants were 61 teachers of 45 primary schools in the Netherlands. Data were collected through questionnaires, stimulated recall interviews and over 100 lesson observations. Results indicated that the three domain-specific approaches for writing instruction were insufficiently implemented in Dutch classrooms, as were differentiating and the teaching of learning strategies. The allocated learning time was also insufficient, but the realized learning time and the extent to which teachers promoted active learning were satisfactory, providing a strong basis for curricular improvement. Several relations were found between teachers' classroom practices, learning time, and teachers' beliefs and skills in the domain of writing instruction. Finally, we discuss options for sustainable innovations of writing instruction in this national context.