Search

This paper compares the effectiveness of two interventions aimed to improve teaching quality and student achievement in Indonesia. The first intervention was the use of education standards, while the second one was the combination of education standards with a teacher improvement program. The study involved 50 schools, 52 teachers, and 1660 students. Teaching quality was measured through classroom observations and student achievement was assessed with a performance test. The multilevel analysis showed student achievement improved only in the second intervention group, whereas the analyses of difference and effect size showed teaching quality in the same group improved only in the first half of the intervention program.

This paper presents the results of a European study investigating the extent to which the Dynamic Approach to School Improvement (DASI) can help schools situated in socially disadvantaged areas to improve their effectiveness. At the beginning of the school year 2015-2016, a sample of 72 primary schools in four European countries (Cyprus, England, Greece and Ireland) was randomly allocated into the experimental and control groups. A questionnaire measuring the functioning of school factors related with the school learning environment, school policy for teaching and school evaluation was administered to all teachers of the school sample (n = 762). A battery of mathematics tests and a questionnaire measuring students' socioeconomic status (SES) were administered to all students of grades 4-6 of the school sample (n = 5560). The experimental group made use of DASI to develop improvement strategies and action plans. Feedback was provided to the control group regarding their students' achievement and the functioning of school factors in their school. ?n each country, DASI had an effect on promoting student learning outcomes. For the control group of each country, the total effect of SES on student achievement at the end of the intervention was bigger than the effect of SES at the beginning of the intervention. No increase in the effect of SES was identified in the schools of the experimental group. Implications of findings for establishing a theory-driven and evidence-based approach to improve the quality and the equity dimensions of school effectiveness are discussed and suggestions for future studies are provided.

This paper argues that research on differential teacher and school effectiveness can be used to explore the relation between quality and equity in education. The results of secondary analyses of 2 studies concerned with effectiveness in different phases of schooling (pre-primary and primary education) are presented. These secondary analyses reveal that the socioeconomic gap in student achievement in each of the 2 core subjects (mathematics and language) tends to be smaller in classrooms and schools that are more effective than others in promoting student learning outcomes (after controlling for prior achievement, socioeconomic status, and gender). Such a relation was not identified when searching for differential teacher and school effectiveness in terms of gender. Implications for research on promoting quality and equity are drawn.

This paper argues that research on teacher professional development could be integrated with validated theoretical models of educational effectiveness research (EER). A dynamic integrated approach (DIA) to teacher professional development is proposed. The methods and results of a study comparing the impact of the DIA and the Holistic-Reflective Approach (HA) to teacher professional development are presented. Teaching skills and teacher perceptions of teaching of 130 teachers and the achievement of their students (n = 2,356) were measured at the beginning and at the end of the intervention. Teachers found to be at a certain developmental stage were randomly allocated evenly into two groups. The first group employed the DIA and the second the HA. Teachers employing the DIA managed to improve their teaching skills more than teachers employing the HA. Teacher perceptions and attitudes towards teaching have not been modified due to their participation in the interventions. On the other hand, the use of DIA also had a significant impact on student achievement. Implications of findings for the use of EER for improvement purposes are drawn and suggestions for research and practice in teacher professional development are provided.

Teacher effectiveness, which impacts student attainment even when controlling for student characteristics, is of key importance as a factor in educational effectiveness and improvement. Improving the quality of teaching is thus the primary means by which we can enhance student learning outcomes. Thus there has long been great interest in the development of classroom observation measures in the field of educational effectiveness research (EER). The International System for Teacher Observation and Feedback (ISTOF) is a unique instrument in the field, as it was developed by a team from 20 countries using an iterative Delphi process to ensure cross-cultural relevance and validity. While previous studies have looked at psychometric properties of the instrument, they have not interrogated the extent to which ISTOF is useful for evaluating individual lessons and providing feedback to teachers. In this study, we observed three grade 4 mathematics lessons taken from the NCTE video library at Harvard University for this purpose. Findings show that ISTOF can provide a highly differentiated and fine-grained picture of individual lessons, but that the strengths of the generic approach in terms of breadth are to an extent counterbalanced by limitations such as the lack of attention to content richness.

The dynamic model of educational effectiveness refers to eight factors that describe teachers' instructional role. A multidimensional framework for measuring both quantitative and qualitative characteristics of teaching factors is also proposed. Empirical support for the validity of the model has been provided, which revealed that the teaching factors can be grouped into five stages situated in developmental order. In this study, for the first time, a qualitative methodology is used to provide an in-depth analysis of three video-lessons through the perspective of the five stages of effective teaching. Thus, we present how each stage is defined and use the cases of the three video-lessons to justify the rationale for these stages and help readers see how observational data are used to identify individual improvement priorities and provide differentiated feedback, even to teachers allocated to the same stage. Finally, based on the qualitative analysis of the three case-studies, strengths and limitations of the dynamic model to evaluate quality of teaching for formative reasons are identified.

This paper investigates the impact of national policies for improving teaching and the school learning environment (SLE) on student achievement. In each participating country (i.e., Belgium/Flanders, Cyprus, Germany, Greece, Ireland, and Slovenia), a sample of at least 50 schools was drawn and tests in mathematics and science were administered to all Grade 4 students (N = 10,742) at the beginning and end of school year 2010-2011. National policies were measured through (a) content analysis of policy documents, (b) interviews with policymakers, and (c) head-teacher questionnaires. Multilevel analyses revealed that most aspects of national policies for teaching and SLE were associated with student achievement in each subject irrespective of the source of data used to measure them. Implications are, finally, drawn.

This European project investigates the impact of the school factors included in the dynamic model of educational effectiveness on student achievement. In each participating country (Belgium/Flanders, Cyprus, Germany, Greece, Ireland and Slovenia), a sample of at least 50 schools was drawn and tests in mathematics and science were administered to all grade 4 students (n = 10,742) at the beginning and end of school year 2010-2011. Teachers completed a questionnaire measuring school policy on teaching, the school-learning environment and the evaluation of school policy. Multilevel analysis revealed that the school factors measuring policy on teaching, the school-learning environment and the evaluation of school policy explain student achievement gains in mathematics and science across countries and in each participating country. The effect sizes of these factors are equally important for explaining variation in student achievement in each subject. Descriptive analyses also show that there is scope for improving the factors included in the dynamic model in each country. Implications for research, policy and practice are drawn.

This paper refers to the Dynamic Integrated Approach (DIA) towards teacher professional development, which attempts to merge research findings on teacher effectiveness and teacher professional development. The theoretical framework and the major features of the DIA are presented. It is argued that the DIA can be effectively implemented through five steps: establishing clarity and consensus about aims and objectives; identifying needs and priorities for improvement through empirical investigation; provision of improvement guidelines, reflection opportunities and coaching on effective teaching by the Advisory and Research Team; establishing a formative evaluation mechanism; and finally establishing a summative evaluation system. Results of empirical studies providing support to the basic elements and the overall effectiveness of the DIA are also presented. Implications of the findings are discussed and suggestions for further research, particularly in exploring the conditions under which the DIA could have a long-lasting effect on teacher effectiveness, are finally drawn.

This study investigates the extent to which the factors included in the dynamic model of educational effectiveness are associated with student achievement gains in six different European countries. At classroom level, the dynamic model refers to eight factors relating to teacher behavior in the classroom: orientation, structuring, questioning, teaching-modeling, application, management of time, teacher role in making classroom a learning environment, and classroom assessment. This paper presents results concerned with the impact of the teacher factors on student achievement. In each participating country (i.e., Belgium/Flanders, Cyprus, Germany, Greece, Ireland, and Slovenia), a sample of at least 50 primary schools (n?=?334) was drawn. Written tests in mathematics and science were administered to all grade 4 students (n?=?10,742) at the beginning and at the end of the school year 2010-2011. Students were also asked to complete a questionnaire concerning the eight teacher factors of the dynamic model. Structural equation modeling techniques were used to test the construct validity of the student questionnaire. Both across and within country analyses revealed that student ratings are reliable and valid for measuring the functioning of the teacher factors included in the dynamic model. Multilevel analyses revealed that teacher factors are associated with student achievement gains in mathematics and science. Implications for the development of educational effectiveness research and for improving quality of teaching are drawn.

This paper argues for the value of using student ratings to measure quality of teaching. An international study to test the validity of the dynamic model of educational effectiveness was conducted. At classroom level, the model consists of eight factors relating to teacher behaviour: orientation, structuring, questioning, teaching modelling, application, management of time, teacher role in making classroom a learning environment and assessment. In each participating country (i.e. Belgium/Flanders, Cyprus, Germany, Greece, Ireland and Slovenia), a sample of at least 50 primary schools was used and all grade 4 students (n?=?9967) were asked to complete a questionnaire concerning the eight factors of the dynamic model. Structural equation modelling techniques were used to test the construct validity of the questionnaire. Both across- and within-country analyses revealed that student ratings are reliable and valid for measuring the functioning of the teacher factors of the dynamic model. Implications for teacher education are drawn.

This project investigates the impact of the dynamic approach to school improvement (DASI) aiming to help schools face and reduce bullying through integrating research on bullying with educational effectiveness research (EER). A network of approximately 15 schools in each participating country (i.e., Belgium, Cyprus, England, Greece, and The Netherlands) received support to use DASI in order to improve the functioning of school factors included in the dynamic model of educational effectiveness which are associated with reduction of bullying. The Revised Olweus Bully/Victim Questionnaire was administered to students of the experimental (n = 1461) and control (n = 1535) group at the beginning and at the end of the intervention. With the use of multilevel modelling techniques, it was found that schools which made use of DASI were able to reduce bullying at a significantly higher level than the schools of the control group. Implications for the development of effective policies and practices in reducing bullying are drawn.

A framework based on research on bullying and on educational effectiveness was offered to schools to assist them in developing strategies and actions to improve their learning environment, their policy for teaching, and their evaluation mechanisms in order to reduce bullying. At the beginning and end of the intervention, the Revised Olweus Bully/Victim Questionnaire and a teacher questionnaire measuring three school factors (school policy for teaching, school learning environment, and school evaluation) were administered to the experimental and control groups. This experimental study reveals that the intervention had both a direct impact on the reduction of bullying and an indirect impact through improving the school factors. Implications for research into supporting schools to reduce bullying are given.

School policy on teaching and the school learning environment (SLE) are the main school factors of the dynamic model of educational effectiveness (Creemers & Kyriakides, 2008). A longitudinal study in which 50 primary schools, 108 classes, and 2369 students participated generated evidence supporting the validity of the dynamic model. This article reports the results of a re-analysis of the data of this study in order to search for direct and indirect effects of school factors included in the model. Using multilevel structural equation modelling techniques, indirect effects of school policy on teaching and SLE upon achievement in mathematics and Greek language are demonstrated. Implications of findings are drawn. Comparing the results of the multilevel direct and indirect effect model with those from using a multilevel regression model, we demonstrate the importance of choosing appropriate conceptual models and using relevant methodological approaches to understand the dynamic nature of educational effectiveness. (Contains 6 figures and 2 tables.)

This paper investigates the extent to which changes in the effectiveness status of schools can be related to changes in the functioning of school factors included in the dynamic model of educational effectiveness. The methods of a follow-up study were identical to those of a study conducted 4 years ago in order to test the validity of the dynamic model. Since the follow-up study took place in the same schools where the original study took place, changes in the effectiveness status of schools and in the functioning of effectiveness factors were identified. Discriminant function analysis reveals that changes not only in the functioning of some school factors but also in the quality of teaching practice can help us classify the schools into those which improved their effectiveness status, those which remained equally effective, and those which even reduced their effectiveness status. Implications of findings for the development of educational effectiveness research are drawn. (Contains 6 tables.)

This paper reviews educational effectiveness theory, concentrating on the time stability of the teacher and school effect. The contribution of longitudinal studies investigating the long-term effect of schools and teachers to modelling educational effectiveness is discussed. Findings of a longitudinal study on the progress of students (N=1681) in mathematics during their first four years at the primary school are presented. Results of this study reveal that traditional approaches of measuring educational effectiveness tend to overestimate the short-term effects of teachers and student background factors and underestimate the long-term effects of teachers and schools. Implications of findings for the theory of educational effectiveness and especially for the concepts of teacher and school effects and their stability are drawn. Finally, suggestions for establishing evaluation mechanisms to improve practice are provided. (Contains 4 tables.)

The dynamic model does not only refer to different effectiveness factors and groupings of factors operating at different levels but also supports that each factor can be defined and measured using 5 dimensions: frequency, focus, stage, quality, and differentiation. The importance of taking each dimension into account is raised in this paper. Moreover, empirical support to the model and the use of this measurement framework is provided. Specifically, the paper refers to the methods and results of a study conducted in Cyprus which investigates the validity of the model at the classroom level by measuring teacher effectiveness in mathematics, language, and religious education. It is shown that the proposed measurement framework can be used to describe each classroom-level factor. The added value of using these 5 dimensions of the classroom-level factors to explain variation on student achievement is also identified. Finally, implications for the development of the dynamic model are drawn. (Contains 4 tables and 1 note.)

This research provides policy-makers, researchers, and educators at all levels with a glimpse of the contextual influence on effective school improvement (ESI) in 8 European countries. What are the factors at the contextual level, particularly at the national level, which influence ESI? Are there any similarities or differences between the influences they exert on ESI in different countries? Can common traits be identified? These are the core questions this paper tries to explore. It has drawn on insights from 5 areas of research: school effectiveness; school improvement; curriculum; public choice (marketization); organization, organizational learning, and learning organization. This yields a "goal-pressure-support" conceptual framework accompanied by 10 contextual factors and 48 indicators. Given the original conceptual framework and the empirical support of 31 case studies contributed by 8 European countries, the findings of this study may have significant implications for policy, practice, school effectiveness, and school improvement. (Contain 1 figure and 2 tables.)

This paper argues that international studies in the area of educational effectiveness are important for different reasons. It will increase the variation with respect to input process and output and it will show contextual differences between countries with respect to educational effectiveness. Furthermore, in international studies knowledge and experience in research with respect to the development of instruments, design, methodology, and statistical techniques can be shared. It is argued that international research especially needs a theoretical framework. This frame can be used not only to design research but also to understand the results and to explain them. In this way, international comparative research is not restricted to interesting pictures of education in several countries but can contribute to further understanding about what works in education and why.

The purpose of this study is to examine whether peer relations within classrooms were related to students' academic progress, and if so, whether this can be explained by students' relatedness and engagement, in line with Connell and Wellborn's self-system model. We analyzed data of 18,735 students in 796 school classes in Dutch junior high schools, using multilevel analysis. Academic progress, conceptualized as regular promotion to the next year versus grade retention, moving upward, and moving downward in the track system, was measured at the time of transition between Grades 1 and 2 (equivalent to US Grades 7 and 8). The results indicated that students who were accepted by their peers had lower probabilities to retain a grade or to move downward in the track system. Although peer acceptance was associated with relatedness and engagement, these variables did not explain why peer acceptance was associated to academic progress. Furthermore, peer acceptance and relatedness were more strongly related in classes with more negative class climates.

School effectiveness and school improvement have different origins: School effectiveness is more directed to finding out "what works" in education and "why"; school improvement is practice and policy oriented and intended to change education in the desired direction. However, in their orientation to outcomes, input, processes, and context in education, they also have much in common. In the project Effective School Improvement (ESI), the merger of the 2 traditions has been pursued. In the theoretical part, different orientations have been analysed and combined in a model for effective school improvement. Based on this analysis, an evaluation framework was developed for the analysis of the case studies of school improvement projects in the participating countries. The theoretical model and the results of the analyses of the case studies were combined in a framework of effective school improvement.

The comprehensive framework was developed in the Effective School Improvement Project. The initial framework was based on an analysis of a range of theories and an additional analysis of case studies in the field of school improvement. A revision took place after an analytic confrontation of the initial framework with successful improvement projects. Also, country conferences for groups of researchers, practitioners, and policy-makers contributed to the revised version of the framework. The framework builds on earlier work in the field of school effectiveness and school improvement. (Contains 2 tables and 1 figure.)

Describes the project "Effective School Improvement," designed to investigate the relationship between effectiveness and improvement in eight European countries. Presents a framework for the analysis of the case studies on school improvement projects in this special issue. (SLD)

Dutch 7th grade teachers were trained to apply either cognitive apprenticeship or direct instruction models in reading comprehension lessons. They received teaching guides with adaptations of their current reading curriculum. Control group teachers used the same curriculum with no teaching guides or training. In both experimental conditions, teachers successfully changed their behavior, though they did not implement all characteristics of the instructional model offered in their training. (SM)

School-effectiveness research (SER) has an instrumental orientation. Although critics claim otherwise, SER researchers usually consider students'"innate" background characteristics when studying schools. Theory formation, foundational issues, and research viability are being addressed. The field is definitely alive and kicking, despite numerous challenges and gatekeepers' changing predilections. (Contains 71 references.) (MLH)

Introduces the concept of vision as a potential solution for problems in educational effectiveness theory and research. Relates ideas and behavior more strongly than earlier concepts such as expectations and beliefs because it emphasized causal relationships between educational goals and means. Discusses cultural values, educational leadership, school climate, and teacher beliefs. (Contains 71 references.) (Author/LRW)

Tests an educational-effectiveness model by reanalyzing a large-scale dataset containing (Dutch) elementary school data of subsequent student cohorts, their teachers, and their schools. Researchers found some expected positive achievement effects of individual classroom and school factors, but these were unstable across school subjects and student cohorts. (27 references) (MLH)