Search

We study the adoption and implementation of a new mobile communication application (app) among a sample of 132 New York City public schools. The app provides a platform for sharing general announcements and news, as well as engaging in personalized two-way communication with individual parents. We provide participating schools with free access to the app and randomize schools to receive intensive support (training, guidance, monitoring, and encouragement) for maximizing the efficacy of the app. Although user supports led to higher levels of communication within the app in the treatment year, overall usage remained low and declined in the following year when treatment schools no longer received intensive supports. We find few subsequent effects on perceptions of communication quality or student outcomes. We leverage rich internal user data to explore how take-up and usage patterns varied across staff and school characteristics. These analyses help to identify early adopters and reluctant users, revealing both opportunities and obstacles to engaging parents through new communication technology.

We examine the dynamic nature of teacher skill development using panel data on principals’ subjective performance ratings of teachers. Past research on teacher productivity improvement has focused primarily on one important but narrow measure of performance: teachers’ value‐added to student achievement on standardized tests. Unlike value‐added, subjective performance ratings provide detailed information about specific skill dimensions and are available for teachers in non‐tested grades and subjects. Using a within‐teacher returns‐to‐experience framework, we find, on average, large and rapid improvements in teachers’ instructional practices throughout their first 10 years on the job as well as substantial differences in improvement rates across individual teachers. We also document that subjective performance ratings contain important information about teacher effectiveness. In the district we study, principals appear to differentiate teacher performance throughout the full distribution instead of just in the tails. Furthermore, prior performance ratings and gains in these ratings provide additional information about teachers’ ability to improve test scores that is not captured by prior value‐added scores. Taken together, our study provides new insights on teacher performance improvement and variation in teacher development across instructional skills and individual teachers.

In this thought experiment, we explore how to make access to individualized instruction and academic mentoring more equitable by taking tutoring to scale as a permanent feature of the U.S. public education system. We first synthesize the tutoring and mentoring literature and characterize the landscape of existing tutoring programs. We then outline a blueprint for integrating federally funded and locally delivered tutoring into the school day. High school students would serve as tutors/mentors in elementary schools via an elective class, college students in middle schools via federal work-study, and 2- and 4-year college graduates in high schools via AmeriCorps. We envision an incremental, demand-driven expansion process with priority given to high-needs schools. Our blueprint highlights a range of design tradeoffs, implementation challenges, and program costs. We estimate that targeted approaches to scaling school-wide tutoring nationally, such as focusing on K–8 Title I schools, would cost between $5 and $16 billion annually.

The purpose of this paper is to outline what we believe to be promising a strategy for developing a scalable behavioral intervention to encourage teachers to adopt teaching practices that support a growth-mindset classroom culture. We first briefly review the most widely-implemented current policies and programs aimed at influencing teachers' instructional practices and consider, based on the available research, how effective those approaches are likely to be for encouraging growth mindset-supportive teaching practices. We then lay out what we believe to be the most important psychological forces currently at play, either facilitating or hindering teachers’ adoption of such practices. On the basis of this analysis of existing psychological forces, and drawing ideas from the research literature in four complementary disciplines, we propose an “intervention toolkit”—candidate intervention ideas that we suggest should be considered for inclusion as components of a larger intervention. Throughout, we identify additional issues for consideration in designing the intervention and important questions for future research.

Teacher coaching has emerged as a promising alternative to traditional models of professional development. We review the empirical literature on teacher coaching and conduct meta-analyses to estimate the mean effect of coaching programs on teachers’ instructional practice and students’ academic achievement. Combining results across 60 studies that employ causal research designs, we find pooled effect sizes of 0.49 standard deviations (SD) on instruction and 0.18 SD on achievement. Much of this evidence comes from literacy coaching programs for prekindergarten and elementary school teachers in the United States. Although these findings affirm the potential of coaching as a development tool, further analyses illustrate the challenges of taking coaching programs to scale while maintaining effectiveness. Average effects from effectiveness trials of larger programs are only a fraction of the effects found in efficacy trials of smaller programs. We conclude by discussing ways to address scale-up implementation challenges and providing guidance for future causal studies.

The vast differences in summer learning activities among children present a substantial challenge to providing equal educational opportunity in the United States. Most initiatives aimed at reversing summer learning loss focus on school- or center-based programs. This study explores the potential of enabling parents to provide literacy development opportunities at home as a low-cost alternative. We conduct a randomized field trial of a summer text-messaging pilot program for parents focused on promoting literacy skills among first through fourth graders. We find positive effects on reading comprehension among third and fourth graders, with effect sizes of .21 to .29 standard deviations, but no effects for first and second graders. Texts also increased attendance at parent-teacher conferences but not at other school-related activities. Evidence to inform future efforts to reverse summer learning loss is provided by parents’ responses to a follow-up survey.

In recent years, states and districts have responded to federal incentives and pressure to institute major reforms to their teacher evaluation systems. The passage of the Every Student Succeeds Act in 2015 now provides state policymakers with even greater autonomy to redesign existing evaluation systems. Yet, little evidence exists to inform decisions about two key system design features: teacher performance measure weights and performance ratings thresholds. Using data from the Measures of Effective Teaching study, we conduct simulation-based analyses that illustrate the critical role that performance measure weights and ratings thresholds play in determining teachers’ summative evaluation ratings and the distribution of teacher proficiency rates. These findings offer insights to policymakers and administrators as they refine and possibly remake teacher evaluation systems.

Teacher teams are increasingly common in urban schools. In this study, we analyze teachers’ responses to teams in six high-poverty schools. Teachers used two criteria to assess teams’ goodness of fit in meeting the demands of their work: whether their teams helped them teach better and whether the team contributed to a better school. Their responses differed notably by school, depending largely on the principal’s approach to implementation. In the three schools where teachers assessed teams favorably, principals set a meaningful purpose for teachers’ collaborative work, provided structural support and professional expertise for their deliberations, and established safe environments for teachers’ on-the-job growth.

We study the relationship between school organizational contexts, teacher turnover, and student achievement in New York City (NYC) middle schools. Using factor analysis, we construct measures of four distinct dimensions of school climate captured on the annual NYC School Survey. We identify credible estimates by isolating variation in organizational contexts within schools over time. We find that improvements in school leadership especially, as well as in academic expectations, teacher relationships, and school safety are all independently associated with corresponding reductions in teacher turnover. Increases in school safety and academic expectations also correspond with student achievement gains. These results are robust to a range of threats to validity suggesting that our findings are consistent with an underlying causal relationship.

Purpose: New teacher evaluation systems have expanded the role of principals as instructional leaders, but little is known about principals’ ability to promote teacher development through the evaluation process. We conducted a case study of principals’ perspectives on evaluation and their experiences implementing observation and feedback cycles to better understand whether principals feel as though they are able to promote teacher development as evaluators. Research Method: We conducted interviews with a stratified random sample of 24 principals in an urban district that recently implemented major reforms to its teacher evaluation system. We analyzed these interviews by drafting thematic summaries, coding interview transcripts, creating data-analytic matrices, and writing analytic memos. Findings: We found that the evaluation reforms provided a common framework and language that helped facilitate principals’ feedback conversations with teachers. However, we also found that tasking principals with primary responsibility for conducting evaluations resulted in a variety of unintended consequences which undercut the quality of evaluation feedback they provided. We analyze five broad solutions to these challenges: strategically targeting evaluations, reducing operational responsibilities, providing principal training, hiring instructional coaches, and developing peer evaluation systems. Implications: The quality of feedback teachers receive through the evaluation process depends critically on the time and training evaluators have to provide individualized and actionable feedback. Districts that task principals with primary responsibility for conducting observation and feedback cycles must attend to the many implementation challenges associated with this approach in order for next-generation evaluation systems to successfully promote teacher development.

Narrative accounts of classroom instruction suggest that external interruptions, such as intercom announcements and visits from staff, are a regular occurrence in U.S. public schools. We study the frequency, nature, duration, and consequences of external interruptions in the Providence Public School District (PPSD) using original data from a district-wide survey and classroom observations. We estimate that a typical classroom in the PPSD is interrupted more than 2,000 times per year and that these interruptions and the disruptions they cause result in the loss of between 10 and 20 days of instructional time. Several findings suggest that there exists substantial scope for reducing interruptions. Administrators appear to systematically underestimate the frequency and negative consequences of interruptions. Furthermore, interruptions vary widely across schools and are largely caused by school staff. Schools might reduce disruptions to the learning environment by creating a culture that prioritizes instructional time, instituting better communication protocols, and addressing the challenges posed by student tardiness.

Researchers commonly interpret effect sizes by applying benchmarks proposed by Jacob Cohen over a half century ago. However, effects that are small by Cohen’s standards are large relative to the impacts of most field-based interventions. These benchmarks also fail to consider important differences in study features, program costs, and scalability. In this article, I present five broad guidelines for interpreting effect sizes that are applicable across the social sciences. I then propose a more structured schema with new empirical benchmarks for interpreting a specific class of studies: causal research on education interventions with standardized achievement outcomes. Together, these tools provide a practical approach for incorporating study features, costs, and scalability into the process of interpreting the policy importance of effect sizes.

We used self-report surveys to gather information on a broad set of non-cognitive skills from 1,368 eighth graders. At the student level, scales measuring conscientiousness, self-control, grit, and growth mindset are positively correlated with attendance, behavior, and test-score gains between fourth grade and eighth grade. Conscientiousness, self-control, and grit are unrelated to test-score gains at the school level, however, and students attending over-subscribed charter schools score lower on these scales than do students attending district schools. Exploiting admissions lotteries, we find positive impacts of charter school attendance on achievement and attendance but negative impacts on these non-cognitive skills. We provide suggestive evidence that these paradoxical results are driven by reference bias or the tendency for survey responses to be influenced by social context.

This article analyzes a coaching model focused on classroom management skills and instructional practices across grade levels and subject areas. We describe the design and implementation of MATCH Teacher Coaching among an initial cohort of 59 teachers working in New Orleans charter schools. We evaluate the effect of the program on teachers’ instructional practices using a block randomized trial and find that coached teachers scored 0.59 standard deviations higher on an index of effective teaching practices comprised of observation scores, principal evaluations, and student surveys. We discuss implementation challenges and make recommendations for researcher–practitioner partnerships to address key remaining questions.

Although previous research has shown that teacher coaching can improve teaching practices and student achievement, little is known about specific features of effective coaching programs. We estimate the impact of MATCH Teacher Coaching (MTC) on a range of teacher practices using a blocked randomized trial and explore how changes in the coaching model across two cohorts are related to program effects. Findings indicate large positive effects in Cohort 1 but no effects in Cohort 2. After ruling out explanations related to the research design, a set of exploratory analyses suggest that differential treatment effects may be attributable to differences in coach effectiveness, coaching dosage, and the focus of coaching across cohorts.

Parental involvement is correlated with student performance, though the causal relationship is less well established. This experiment examined an intervention that delivered weekly one-sentence individualized messages from teachers to the parents of high school students in a credit recovery program. Messages decreased the percentage of students who failed to earn course credit from 15.8% to 9.3%—a 41% reduction. This reduction resulted primarily from preventing drop-outs, rather than from reducing failure or dismissal rates. The intervention shaped the content of parent–child conversations with messages emphasizing what students could improve, versus what students were doing well, producing the largest effects. We estimate the cost of this intervention per additional student credit earned to be less than one-tenth the typical cost per credit earned for the district. These findings underscore the value of educational policies that encourage and facilitate teacher-to-parent communication to empower parental involvement in their children's education.

Research has focused predominantly on how teachers affect students’ achievement on standardized tests despite evidence that a broad range of attitudes and behaviors are equally important to their long-term success. We find that upper-elementary teachers have large effects on self-reported measures of students’ self-efficacy in math, and happiness and behavior in class. Students’ attitudes and behaviors are predicted by teaching practices most proximal to these measures, including teachers’ emotional support and classroom organization. However, teachers who are effective at improving test scores often are not equally effective at improving students’ attitudes and behaviors. These findings lend empirical evidence to well-established theory on the multidimensional nature of teaching and the need to identify strategies for improving the full range of teachers’ skills.

Background/ContextMany strategies to improve failing urban schools rest on efforts to improve leadership within the school. Effective school-based leadership depends not only on the activities of the principal, but also on teachers’ efforts to address school-wide challenges. Research has shown that the principal is pivotal in such ventures, but we know little about how teachers conceive of their role in leadership, how they respond to opportunities provided or denied by their principal, or how they initiate leadership on their own.PurposeWe studied how teachers in six high-poverty urban schools participate in leadership beyond their classroom. We asked: What role do teachers in high-poverty urban schools play in their school's improvement? How do principals conceive of teachers’ potential for leadership and how do they act on it? How do teachers respond to the opportunities and constrains they encounter as they seek to exercise leadership in their schools?Research DesignWe interviewed 95 teachers and administrators in six high-poverty schools of one large urban district (two elementary schools, one K–8 school, one middle school, and two high schools). The schools, which served large proportions of low-income and minority students, had varying records of student performance.Data Collection and AnalysisIn each school, we interviewed the principal, other administrators, and a broad sample of teachers. We reviewed documents and observed day-to-day practices. After writing a structured, thematic summary for each respondent and school, we coded all transcripts and analyzed themes and practices within and across schools.FindingsTeachers were willing and ready to address their school's challenges. They conditionally granted their principal discretion in setting the agenda, based on the perceived authority and expertise of the principal and teachers’ opportunities for engagement as partners. When the principal took an instrumental approach to their contributions, teachers resented it, withdrew to their classrooms, and considered leaving the school. When the principal took an inclusive approach, demonstrating genuine interest in their views and contributions, teachers invested in school-wide reforms.Conclusions/RecommendationAlthough a principal may develop a strategic plan for improvement, that plan cannot simply be “rolled out.” Doing so without teachers’ contributions and endorsement likely means that the plan is incomplete and will be rejected outright or adopted perfunctorily. District administrators should select and develop principals who take an inclusive approach to teacher leadership. Policy makers and researchers should go beyond assessing the success of specific reforms and study the process of change within schools as reforms are developed and implemented.

ContextIn the past two years, states have implemented sweeping reforms to their teacher evaluation systems in response to Race to the Top legislation and, more recently, NCLB waivers. With these new systems, policymakers hope to make teacher evaluation both more rigorous and more grounded in specific job performance domains such as teaching quality and contributions to student outcomes. Attaching high stakes to teacher scores has prompted an increased focus on the reliability and validity of these scores. Teachers unions have expressed strong concerns about the reliability and validity of using student achievement data to evaluate teachers and the potential for subjective ratings by classroom observers to be biased. The legislation enacted by many states also requires scores derived from teacher observations and the overall systems of teacher evaluation to be valid and reliable.Focus of the StudyIn this paper, we explore how state education officials and their district and local partners plan to implement and evaluate their teacher evaluation systems, focusing in particular on states’ efforts to investigate the reliability and validity of scores emerging from the observational component of these systems.Research DesignThrough document analysis and interviews with state education officials, we explore several issues that arise in observational systems, including the overall generalizability of teacher scores; the training, certification, and reliability of observers; and specifications regarding the sampling and number of lessons observed per teacher.FindingsRespondents’ reports suggest that states are attending to the reliability and validity of scores, but inconsistently; in only a few states does there appear to be a coherent strategy regarding reliability and validity in place.ConclusionsThere remain a variety of system design and implementation decisions that states can optimize to increase the reliability and validity of their teacher evaluation scores. While a state may engage in auditing scores, for instance, it may miss the gains to reliability and validity that would accrue from periodic rater retraining and recertification, a stiff program of rater monitoring, and the use of multiple raters per teacher. Most troublesome are decisions about which and how many lessons to sample, which are either mandated legislatively, result from practical concerns or negotiations between stakeholders, or, at best case, rest on broad research not directly related to the state context. This suggests that states should more actively investigate the number of lessons and lesson sampling designs required to yield high-quality scores.

In this study, we evaluate the efficacy of teacher communication with parents and students as a means of increasing student engagement. We estimate the causal effect of teacher communication by conducting a randomized field experiment in which sixth- and ninth-grade students were assigned to receive a daily phone call home and a text/written message during a mandatory summer school program. We find that frequent teacher–family communication immediately increased student engagement as measured by homework completion rates, on-task behavior, and class participation. On average, teacher–family communication increased the odds that students completed their homework by 40%, decreased instances in which teachers had to redirect students’ attention to the task at hand by 25%, and increased class participation rates by 15%. Drawing upon surveys and interviews with participating teachers and students, we identify three primary mechanisms through which communication likely affected engagement: stronger tea...

Background/Context Educational policy makers have begun to recognize the challenges posed by teacher turnover. Schools and students pay a price when new teachers leave the profession after only 2 or 3 years, just when they have acquired valuable teaching experience. Persistent turnover also disrupts efforts to build a strong organizational culture and to sustain coordinated instructional programs throughout the school. Retaining effective teachers is a particular challenge for schools that serve high proportions of low-income and minority students. Although some interpret these turnover patterns as evidence of teachers’ discontent with their students, recent large-scale quantitative studies provide evidence that teachers choose to leave schools with poor work environments and that these conditions are most common in schools that minority and low-income students typically attend. Thus, mounting evidence suggests that the seeming relationship between student demographics and teacher turnover is driven not by teachers’ responses to their students, but by the conditions in which they must teach and their students are obliged to learn. Purpose/Objective/Research Question/Focus of Study We build on this body of work by further examining how working conditions predict both teachers’ job satisfaction and their career plans. We use a broad conception of the context of teachers’ work, paying attention not only to narrowly defined working conditions but also to the interpersonal and organizational contexts in which teachers work. We also extend Ladd's analysis describing the relationship between the work context and student achievement. Advancing our understanding of this relationship is particularly important, given the increasing emphasis legislators place on evidence of student achievement when evaluating education policy. Specifically, we ask three research questions: (1) Do the conditions of work in Massachusetts public schools affect teachers’ satisfaction with their jobs and their career plans? (2) Are schools with better conditions of work more successful in raising student performance than schools with less supportive working conditions? (3) If the conditions of work are important, what elements of the work environment matter the most? Research Design In this article, we combine a statewide survey of school working conditions (MassTeLLS) with demographic and student achievement data from Massachusetts. We examine three primary outcomes: teacher satisfaction, teacher career intentions, and student achievement growth. From different items on the MassTeLLS, we construct a set of nine key elements that reflect the broad-based conditions in which teachers work. We fit standard regression models that describe the relationship between each outcome and both overall conditions of work and each element separately, modeling this relationship according to the properties of our outcome variables. Findings/Results We found that measures of the school environment explain away much of the apparent relationship between teacher satisfaction and student demographic characteristics. The conditions in which teachers work matter a great deal to them and, ultimately, to their students. Teachers are more satisfied and plan to stay longer in schools that have a positive work context, independent of the school's student demographic characteristics. Furthermore, although a wide range of working conditions matter to teachers, the specific elements of the work environment that matter the most to teachers are not narrowly conceived working conditions such as clean and well-maintained facilities or access to modern instructional technology. Instead, it is the social conditions—the school's culture, the principal's leadership, and relationships among colleagues—that predominate in predicting teachers’ job satisfaction and career plans. More important, providing a supportive context in which teachers can work appears to contribute to improved student achievement. We found that favorable conditions of work predict higher rates of student academic growth, even when we compare schools serving demographically similar groups of students. Conclusions/Recommendations In short, we found that the conditions of teachers’ work matter a great deal. These results align with a growing body of work examining the organizational characteristics of the schools in which teachers work. Together, these studies suggest strongly that the high turnover rates of teachers in schools with substantial populations of low-income and minority students are driven largely by teachers fleeing the dysfunctional and unsupportive work environments in the schools to which low-income and minority students are most likely to be assigned. If public education is to provide effective teachers for all students, then the schools those students attend must become places that support effective teaching and learning across all classrooms.

These 10 simple techniques can help you turn an unruly class into a productive one.

Although wide variation in teacher effectiveness is well established, much less is known about differences in teacher improvement over time. We document that average returns to teaching experience mask large variation across individual teachers and across groups of teachers working in different schools. We examine the role of school context in explaining these differences using a measure of the professional environment constructed from teachers responses to state-wide surveys. Our analyses show that teachers working in more supportive professional environments improve their effectiveness more over time than teachers working in less supportive contexts. On average, teachers working in schools at the 75th percentile of professional environment ratings improved 38% more than teachers in schools at the 25th percentile after 10 years.

Cognitive skills predict academic performance, so schools that improve academic performance might also improve cognitive skills. To investigate the impact schools have on both academic performance and cognitive skills, we related standardized achievement-test scores to measures of cognitive skills in a large sample (N = 1,367) of eighth-grade students attending traditional, exam, and charter public schools. Test scores and gains in test scores over time correlated with measures of cognitive skills. Despite wide variation in test scores across schools, differences in cognitive skills across schools were negligible after we controlled for fourth-grade test scores. Random offers of enrollment to oversubscribed charter schools resulted in positive impacts of such school attendance on math achievement but had no impact on cognitive skills. These findings suggest that schools that improve standardized achievement-test scores do so primarily through channels other than improving cognitive skills., Bill & Melinda Gates Foundation, National Institutes of Health (U.S.) (National Research Service Award)