Search

The COVID-19 pandemic caused tremendous upheaval in schooling. In addition to devasting effects on students, these disruptions had consequences for researchers conducting studies on education programs and policies. Given the likelihood of future large-scale disruptions, it is important for researchers to plan resilient studies and think critically about adaptations when such turbulence arises. In this article, we utilize qualitative analysis of interviews with research study leaders to illuminate practical and methodological challenges, as well as promising practices that arose during the pandemic period. We find that researchers made pivots to address practical challenges and protect the feasibility of their studies. We also find that researchers took precautions, where possible, to understand and bolster internal validity. However, these pivots frequently surfaced additional threats to construct and external validity. We conclude with recommendations for future studies conducted in times of prolonged unplanned school closures or other large-scale disruptions.

School accountability and improvement policy are on the precipice of a paradigm shift. While the multiple-measure dashboard accountability approach holds great promise for promoting more meaningful learning opportunities for all students, our research indicates that this can come with substantial challenges in practice. We reflect upon the lessons learned from our recent research on the CORE districts’ use of multiple-measure data dashboards. Our research indicated that a shift to greater flexibility and locally determined capacity building efforts brings its own set of challenges. Building on this foundation and drawing upon the expertise of a central practitioner-leader, we explore these issues through one promising case: the use of these multiple-measure accountability systems in one CORE district, Oakland Unified School District (OUSD). OUSD’s approach suggests that districts have substantial agency to help modify the mindsets of practitioners and the community, by modeling the values of inquiry, openness, and flexibility. By loosening the reigns, districts can give school stakeholders the space and authority to meaningfully manage their own accountability and improvement.