Search

The goal of Smithsonian Science for North and South Carolina Classrooms was to provide teachers with ongoing, differentiated professional development and research-based curricular materials to improve elementary student achievement in science, mathematics, and reading. This work used an inquiry-based science curriculum, Smithsonian Science for the Classroom, which is aligned with the Next Generation Science Standards (NGSS), and was implemented in Grades 3-5 within predominantly rural North and South Carolina school districts serving high-needs students. The Center for Research in Educational Policy (CREP) at the University of Memphis, a State of Tennessee Center of Excellence, was the independent third-party evaluator. CREP implemented a Randomized Controlled Trial (RCT) to collect and analyze data using a rigorous, mixed-methods approach, including quantitative analyses of student achievement data from the Stanford-10 and state assessments, and qualitative analyses of classroom observation data, as well as teacher feedback from professional development surveys, module logs, and focus groups. For this study, 36 schools (including one split cohort being treated as one school) in seven districts within North and South Carolina were randomly assigned to treatment and comparison groups. The study cohort, followed over three academic years (2020-21 through 2022-23), was composed of more than 1,600 third grade (2020-21) students in these schools. In the comparison condition, schools used their business-as-usual science curricula and teacher professional development and did not receive Smithsonian Science curricular materials or professional development. As the pretests for achievement outcomes, students took the Abbreviated Battery of the Stanford Achievement Test Series, Tenth Edition (Stanford-10) in Reading and Math in spring of 2021 (the cohort's third grade year). The main findings and posttests included the combined sample (i.e., both states combined) for (a) the Stanford-10 Science subtest, which was administered in the spring of 2023 (the cohort's fifth grade year), and (b) spring 2023 standardized state assessment scores in Reading and Math. Using a hierarchical linear model (HLM) with school as a random effect, the analysis of the effect of Smithsonian Science for the three main findings after several years of disruptions from the COVID-19 pandemic was (a) positive (g = 0.18) and statistically significant (p = 0.032) on the Stanford-10 science assessment and (b) positive for both Reading (g = 0.10) and Math (g = 0.16), meaning students in the treatment group performed better than the control group, but the effects were not statistically significant. Teachers were generally positive in terms of the professional development provided, and feedback on the module logs largely supported the effectiveness of the professional development and fidelity of implementation. Classroom observations further supported the effectiveness of the professional development and fidelity to inquiry-based practices in treatment classrooms (e.g., use of experiential hands-on learning and level of class time dedicated to inquiry-based science). With instructional time for science lagging other subject areas, and as learning recovery in reading and math after COVID-19 receive national attention, the results demonstrate that ongoing, differentiated, high-quality professional learning and high-quality instructional materials for science instruction can support student achievement in science, math, and reading.

High-quality decodable books enhance literacy by providing children with focused practice opportunities to break down sounds they have learned and apply their decoding skills. Just Right Reader (JRR) hired LXD Research to measure its impact during a pilot study in the Spring of 2024 to determine the effect of their decodable books on literacy outcomes. Conducted in four schools in an urban Texas school district, the six-week study included 93 JRR and 111 non-JRR students, with 69 students submitting implementation logs that were used to track dosage. Key findings reveal meaningful progress for JRR students from the mid-year to end-of-year assessments, outperforming Non-JRR students. JRR students showed a MAP Growth Percentile improvement of 33 points (34 to 67), compared to 23 points in Non-JRR students (31 to 54). Additionally, JRR students excelled in DIBELS ORF accuracy, with the median percentile rising from 46 to 62, while Non-JRR improved from 42 to 44. Due to the small sample, these changes were not statistically significant. Notably, the 45% of JRR students who read for 3+ hours at home (i.e., High Dosage implementation) demonstrated remarkable growth, improving from below the 14th percentile to above the 72nd percentile. Overall, the JRR program meaningfully boosted literacy development.

Mastery learning -- the process by which students must demonstrate proficiency with a single topic before moving on -- is well recognized as one of the best ways to learn, yet many teachers struggle or remain unsure about how to implement it into a classroom setting. This study leverages two field experiments to test the efficacy of a program designed to encourage greater mastery learning through technology and proactive continuous teacher support. Focusing on elementary and middle school mathematics, teachers receive weekly coaching in how to use Computer Assisted Learning (CAL) for students to follow a customized roadmap of incremental progress. Results indicate significant intent-to-treat effects on math performance of 0.12-0.22 standard deviations. Further analysis shows that these gains are concentrated among students in classrooms with at least an average of 35 minutes of practice per week. Teachers able to achieve high-dosage practice have a high degree of initial buy-in, a clear implementation strategy for when practice occurs, and a willingness to closely monitor progress and follow-up with struggling students. [The Wilson Sheehan Lab for Economic Opportunities (LEO) at Notre Dame provided additional support for this research.]

The focus of this report is on mental health interventions delivered in K-12 neighborhood public schools. A vast array of commercially available programs, conceptual frameworks, and approaches to school-based mental health are not unanimously recommended, applied, or agreed upon. This poses a challenge to any comprehensive description or evaluation of school-based mental health. Key findings include: (1) There is a lack of high-quality evidence to support school-based mental health initiatives. Rigorous evaluations of universal programs on mental health literacy, awareness, prevention, and screening--and of many social-emotional learning programs--find neither reduced rates of mental health conditions nor improved academic outcomes; (2) The concept of school-based mental health, as currently delivered in typical neighborhood public schools, is incoherent because it primarily serves youth who are not specifically in need of mental health treatment, while insufficiently serving those with mental disorders; (3) While some youth can benefit from high-quality mental health services, universal mental health programs carry underestimated potential harms: directly, through poor-quality care, overdiagnosis, and misallocated spending; and indirectly, through wasted class time and reduced accountability in the mental health and education systems; and (4) Federal agencies responsible for school-based mental health programs provide no meaningful or coordinated guidance on essential questions such as what it means for a program to be effective, what expectations exist in "mental health deserts," and how schools should sort through numerous overlapping initiatives.

This study examined the impact of COVID-19 on academic "redshirting" in kindergarten, the practice of holding a child back for a year and enrolling them in kindergarten at age 6, using student-level data on all Delaware kindergarten students from fall 2014 through fall 2022. The rate of redshirting declined by 40% in fall 2020, then increased by 44% (relative to pre-pandemic baseline) in fall 2021, and more for some subgroups of children traditionally less likely to redshirt. Further, redshirting was not restricted to children with summer birthdays, as in previous years, with growth seen across the age distribution. Redshirting had not returned to pre-pandemic baseline by fall 2022. These findings point to changes in the motivations for redshirting kindergarten students since the pandemic.

The use of four-day school weeks (4dsw) in the United States has expanded rapidly over the past two decades. Previous work examines the impact of 4dsw on student outcomes, but little research to date examines the effect on school employees even though schools in some locales have adopted 4dsw to recruit and retain staff. This paper examines the effect of 4dsw adoption in Oregon, a state with widespread 4dsw use, on teacher and other school staff retention by leveraging a staggered roll-out of the schedule using a difference-in-differences design. We find that adopting a four-day week increased turnover among teachers, but that turnover among non-teaching staff was largely unaffected. The findings suggest that policymakers interested in implementing 4dsw for improved school employee retention should exercise caution and be attentive to the full set of incentives offered to staff.

This brief continues ongoing research by NWEA® examining the degree to which the COVID-19 pandemic, and its associated school closures, influenced student learning. Prior research focused on math and reading and found that the pandemic's negative impact steadily accumulated during the 2020-2021 school year, with significant disparities in achievement and growth compared to prepandemic trends (Lewis, Kuhfeld, Ruzek, & McEachin, 2021). Although there were modest rebounds in reading and math during the 2021-2022 school year, progress toward pandemic recovery largely stalled in 2022-2023 and 2023-2024, with achievement and growth trends still trailing behind prepandemic levels (Kuhfeld & Lewis, 2022; Lewis & Kuhfeld, 2023; Lewis & Kuhfeld, 2024). Building on previous research series focused on math and reading achievement, this brief explores how the pandemic influenced student achievement in science. It examines science test scores across seven school years to understand how COVID-19 influenced science achievement.

The purpose of this technical appendix is to share detailed results and more fully describe the sample and methods used to produce the research brief, "COVID's Impact on Science Achievement: Trends from 2019 through 2024. We investigated three main research questions in this brief: 1) How did science achievement in 2021 and 2024 compare to achievement in 2019, before the pandemic? 2) How much additional schooling was required in spring 2021 and spring 2024 to return to spring 2019 levels? 3) How do these patterns differ by race/ethnicity?

Purpose: The purpose of the study was to evaluate the implementation and impact of the IDEA Public Schools' Mathematics Curriculum Redesign (MCR) effort, funded by an Innovation and Research (EIR) grant. Methods: The study used a quasi-experimental matching design to examine the effect of MCR on student achievement outcomes. The study compared outcomes between the two cohorts of students at IDEA Public Schools that piloted the MCR and matched cohorts of students in IDEA schools that had delayed implementation of MCR. Results:?The study found statistically significant differences in IDEA Geometry test scores (ES = 0.39) between treatment and comparison group students in Grade 9 and on AP Calculus exam scores between treatment and comparison group students in Grade 12 (ES = 0.57). The study also found that the MCR program met the evaluation threshold for fidelity of implementation for the two out of three key program components (development of redesigned math curriculum and teacher use of math curriculum) in some years. The program did not meet the evaluation threshold for fidelity of implementation for the third key program components (teacher training and professional development to use redesigned math curriculum) in any of the years. Implications:?Because curriculum development and implementation are ongoing and iterative, realizing all of the benefits is not immediate and may take more time to achieve desired results. Continuous improvement of the curriculum and consistent supports to teachers will contribute to continued benefits for teachers and students while moving toward reaching anticipated student outcomes.

Project Catch-Up is an ESEA Title I reading and math laboratory project for kindergarten through sixth-grade students, operating in Southern California's Newport-Mesa Unified School District. Its philosophy is that students having difficulty in reading and math can catch up with other students. Teachers take responsibility for the achievement gains of 18 low-achieving elementary students, and aides for the gains of 10 low-achieving elementary students. Staff members are free to use whatever techniques they choose and to purchase instructional materials, which they match to clearly defined objectives. Teachers and aides plan a variety of activities for each child focused on two or three specific skills that the child needs to work on. It is recommended that Project Catch-Up should be selected for a particular school district only if it can meet project requirements in the areas of instruction, management, and communication, and organization, and if resources in the following areas are available: (1) personnel, (2) material/equipment, and, (3) facilities. Project Catch-Up is one of six projects which have been selected by the U.S. Office of Education as unusually successful for teaching reading and/or math to underachieving students in low-income areas. (Author/AM)

The cards in this file are representative samples of the types of activities developed by teachers involved in a Title I funded learning center of multi-cultural classroom activities for elementary school students. The five cultures that are stuoied are those of blacks, Asian Americans, native Americans, Mexican Americans, and Anglos. A multi-media approach is used in the classroom, and the activities described on these cards are part of a program which includes films, filmstrips, tapes, field trips, etc. Activities are divided into five areas: reading and language arts, cooking, arts and crafts, math, and music and dance. Listed under these five areas are thirty-eight activities, some of which include puzzles, types of poetry, how to make groundnut soup, early American recipes, food for the pioneers, African beads, Indian pottery, Japanese carp kits, Oriental block prints, counting triangles, the limbo dance, the Mexican national folk dance, the China poblana costume, and others. (Author/AM)

Structural integrity of a measure is defined in terms of its replicability, constancy, invariance, and stability. Work completed in the development and validation of the Self Observation Scales (SOS) Primary Level (Stenner and Katzenmeyer, 1973) serves to illustrate one method of establishing structural integrity. The name of each scale of the SOS is a construct: an abbreviated thesis about the nature of the underlying variable which determines the configuration of indicants (questions) comprising the scale. SOS constructs (self acceptance, social maturity, school affiliation, and self security) are analyzed for different student groups. Traditional psychometrics assumes that the same questions measure the same underlying variables in all respondents; the validity of interperson and intergroup comparisons rests on this assumption. However, ample evidence suggests that this assumption is frequently in error. Procedures outlined in this paper provide a method for assessing the validity of this assumption, and a basis for developing reliable and valid instruments. (Author/MV)

The research question investigated was: What relationship, if any, exists between teacher personality characteristics associated with self-actualization and the test anxiety levels of their students. Teacher personality characteristics in 6 schools were assessed with the Shostrom Personal Orientation Inventory. The Sarason Test Anxiety Scale for Children was administered to their pupils. Students in grades 4 through 8 were the subjects of the research. At the junior high school level it was found that a significant relationship existed between teachers with high spontaneity in combination with high self-regard and relatively low test anxiety in their students. Results approached significance for elementary school students. The implications of these findings for education and selection of teachers for the junior high level are considered. (JD)

High-achieving minority students have fewer friends than their majority counterparts. Exploring patterns of friendship formation in the Add Health data, we find strong racial homophily in friendship formations as well as strong achievement homophily within race. However, we find that achievement matters less in cross-racial friendships. As a result, high-achieving Black students lose Black friends as they move away from the mean achievement of their group, but do not gain high-achieving White friends in offsetting fashion. We find that high-achieving Black students have 0.9 fewer friends, mainly attributable to the fact that they are exposed to fewer high-achieving peers within their own race. We find that this could account for as much as 5 to 9 percent of the racial wage gap observed among high achievers.

This study provides the first large-scale quantitative exploration of mathematical language use in upper elementary U.S. classrooms. Our approach employs natural language processing techniques to describe variation in teachers' and students' use of mathematical language in 1,657 fourth and fifth grade lessons in 317 classrooms in four districts over three years. Students' exposure to mathematical language varies substantially across lessons and between teachers. Results suggest that teacher modeling, defined as the density of mathematical terms in teacher talk, does not substantially cause students to uptake mathematical language, but that teachers may encourage student use of mathematical vocabulary by means other than mere modeling or exposure. However, we also find that teachers who use more mathematical language are more effective at raising student test scores. These findings reveal that teachers who use more mathematical vocabulary are more effective math teachers.

The immediate impacts of COVID-19 on K12 schooling are well known. Over nearly 18 months, students' academic performance and mental health deteriorated dramatically. This study aims to identify if and how the pandemic led to longer-term changes in core aspects of schooling. Drawing on semi-structured interviews with 31 teachers and administrators across 12 districts in two states, we find that schools today look quite different in several areas including the availability and use of instructional technology, instructional practice, parent-teacher communication, and the balance between academics and social-emotional well-being. We interpret these findings through the lens of institutional theory, and discuss implications of the changes for practitioners and policymakers.

In August 2017, the Houston area was ravaged by one of the costliest natural disasters in history--Hurricane Harvey. In this brief, the first in a two-part series, the authors examine the effects of Harvey on student homelessness in the Houston Independent School District (Houston ISD). The authors find that student homelessness in Houston ISD quadrupled due to Harvey, and most students experiencing homelessness lived, at least temporarily, in unsheltered contexts, such as sleeping in a car or on the street. Unlike other high-profile storms such as Hurricane Katrina, students who became homeless due to Harvey tended to be broadly representative of the district in terms of their demographic characteristics. However, they differed systematically from students who experienced homelessness for conventional, economic reasons such as job loss and medical debt, who were particularly likely to be Black. The authors conclude with implications of these findings for educational stakeholders in preparation for both generational and "everyday" homelessness crises.

Catholic schools have seen more than a 30% decline in enrollment over the past 20 years. While some of the decline in enrollment may have been spurred by secular trends or the Church abuse scandal, the increase in schools of choice, principally public charter schools, may explain at least some of this decline. In this paper we estimate the effect of the opening of charter schools in proximity to Catholic schools across the entire U.S. We find that the opening of a nearby charter school has a negative impact on Catholic school enrollment and increases the likelihood that the school will close. We also find that charter openings induce greater racial isolation. Findings are especially pronounced in K8 schools, rather than high schools.

A digital information explosion has transformed cities' residential and educational markets in ways that are still being uncovered. Although urban stratification scholars have increasingly scrutinized whether emerging digital platforms disrupt or reproduce longstanding segregation patterns, direct links between one theoretically important form of digital information--school quality data--and neighborhood and school segregation are rarely drawn. To clarify these dynamics, we leverage an exogenous digital information shock, in which the Los Angeles Times' website revealed measures of a particularly important school quality proxy--schools' value-added effectiveness--for nearly all elementary schools in the Los Angeles Unified School District. Results suggest that although the information shock had no detectable effects on residential sorting or neighborhood racial segregation, it did exert modest effects on school sorting--particularly for Latino and Asian students--albeit not in ways that materially diminished school racial segregation because the racial compositions of high and low value-added schools were broadly similar both before and after the information shock. We conclude that the urban stratification implications of digital information may be more nuanced than often appreciated, with effects shaped by racial heterogeneity in both constraints and preferences vis-à-vis specific types of information and operating through mechanisms beyond residential segregation.

This study analyzed Pennsylvania School Climate Survey data from students and staff in the 2021/22 school year to assess the validity and reliability of the elementary school student version of the survey; approaches to scoring the survey in individual schools at all grade levels; and perceptions of school climate across student, staff, and school groups. The survey encourages data-informed efforts in participating Pennsylvania schools to foster supportive learning environments that promote social and emotional wellness for students and staff. The study validated the elementary school student survey but found that one domain--safe and respectful school climate--did not meet the reliability threshold and thus suggests that revisions are needed. At all grade levels noninstructional staff had the most positive perceptions of school climate, followed by classroom teachers then students. The study found that different approaches to combining the school climate scores of students, teachers, and noninstructional staff within schools yielded slightly different distributions of school climate summary index scores. It also found that different performance category thresholds resulted in similar distributions of schools across categories. Scores calculated using simple averages were strongly and positively correlated with scores calculated using a more complex approach (Rasch models), suggesting that both approaches deliver similar information. School climate scores varied across student groups (defined by race/ethnicity, gender, and grade level) within schools and across school groups. Larger schools and schools with higher percentages of Black students tended to have lower school climate scores than other schools. The findings can inform the Pennsylvania Department of Education's decisionmaking on revisions to the elementary school student survey, approaches to scoring and reporting survey results, and efforts to increase participation in future survey administrations.

These are the appendixes for the report, "Strengthening the Pennsylvania School Climate Survey to Inform School Decisionmaking." This study analyzed Pennsylvania School Climate Survey data from students and staff in the 2021/22 school year to assess the validity and reliability of the elementary school student version of the survey; approaches to scoring the survey in individual schools at all grade levels; and perceptions of school climate across student, staff, and school groups. The three appendixes in the document include: (1) Data and methods; (2) Supplemental findings; and (3) Additional findings.

The "Examining Implementation and Outcomes of the Project On-Track High-Dosage Literacy Tutoring Program" study describes the characteristics of students who participated in a full year of Project On-Track, a high-dosage, small-group literacy tutoring program for students in grade 1-3. Its online adaptive program, Amplify Reading, groups students by skill level and generates mini-lessons aligned to the science of reading that are delivered by tutors. Although the content of the tutoring sessions is highly structured, Project On-Track offers schools flexibility in how they implement the program, including when they provide tutoring, who provides tutoring, in which grade levels they offer tutoring, and how they identify students within a grade level for tutoring. This flexibility can make it easier for schools to adopt the program, particularly rural schools, which may face greater challenges in hiring tutors or delivering tutoring outside of school hours. It also examined how schools implemented the program, with a focus on three implementation features: when and how frequently tutoring is offered and who provides it. This document presents the following three appendixes that accompany the study: (1) Methods; (2) Qualitative case studies; and (3) Supporting analyses.

School districts in northeastern Tennessee have had persistently low proficiency rates in grade 3 English language arts, which were exacerbated by disruptions in schooling due to the Covid-19 pandemic. In response, the Niswonger Foundation, a technical assistance provider that supports these districts, developed Project On-Track, a high-dosage, small-group literacy tutoring program for students in grade 1-3. Its online adaptive program, Amplify Reading, groups students by skill level and generates mini-lessons aligned to the science of reading that are delivered by tutors. Although the content of the tutoring sessions is highly structured, Project On-Track offers schools flexibility in how they implement the program, including when they provide tutoring, who provides tutoring, in which grade levels they offer tutoring, and how they identify students within a grade level for tutoring. This flexibility can make it easier for schools to adopt the program, particularly rural schools, which may face greater challenges in hiring tutors or delivering tutoring outside of school hours. However, variation in implementation may also affect program effectiveness. To inform future implementation of the program, this study describes the characteristics of students who participated in a full year of Project On-Track and how schools implemented the program, with a focus on three implementation features: when and how frequently tutoring is offered and who provides it. By reporting on the association between variations in implementation and student literacy scores, the study offers important insights to inform future program implementation. The study found no differences in student literacy scores based on timing or frequency of tutoring. Most schools (66 percent) offered tutoring during school and more than twice a week (64 percent). Rural schools were more likely to offer tutoring during school (92 percent) than were nonrural schools (47 percent). Most tutors were current teachers (55 percent) or retired teachers (12 percent). This study does not provide evidence of differences in student literacy scores based on tutor qualifications. More than half the students who participated in a full year of Project On-Track tutoring started the year with literacy assessment scores identifying them as most at risk for reading difficulties, and 42 percent of them improved to a lower risk category after one year of tutoring. Although this study uses descriptive methods and cannot assess effectiveness, the findings suggest that schools and districts using a highly structured tutoring program like Project On-Track might be able to exercise flexibility in when and how often tutoring is offered and by whom without compromising program quality and benefits to students.

Combatting learning loss in schools is as much a mental health issue as an academic one. With one in four students suffering from poor mental health since the onset of the COVID-19 pandemic, the need for Tier I and Tier II resilience solutions is critical. Addressing these challenges requires comprehensive strategies focusing on academic recovery and prioritizing students' mental, emotional, and psychological well-being. EmpowerU is a Multi-Tiered System of Support (MTSS) program that delivers durable social-emotional skills and support at both Tier I and Tier II/III levels and is designed to build student resilience, coping skills and academic persistence. This program was framed using the Transtheoretical Model (TTM) of behavioral change constructed by Prochaska and DiClemente (1986) to measure pre- to post-student progress on goals students set themselves to improve their well-being, resilience, and motivation. This study focuses on the impact of EmpowerU's Tier I foundational prevention program that allows classroom teachers and other school support staff to deliver proactive instructional interventions that reduce at-risk behaviors, improve academic engagement/motivation, and enhance students' well-being so they can focus and learn. This quasi-mixed measure design with comparison groups (Johnson & Onwuegbuzie, 2004) was performed in a small rural school district in the U.S. Midwest (n=75; 38 fifth graders and 37 eighth graders) and suggested a decrease in at-risk behaviors after receiving the EmpowerU curriculum, as measured by the Social, Academic, and Emotional Behavior Risk Screener (SAEBRS) behavior screening tool. The EmpowerU-Starting Point Self-Reflection Assessment (SPA) tool, a vital part of the Tier I curriculum, was administered to classrooms in a phased implementation of students to compare key resilience indicator improvements of students who had not yet received EmpowerU instruction to those students who had received EmpowerU instruction. The comparison data from the pre-post SPA indicates a significant improvement in behavior among 5th graders (Cohen d= 0.783), and among 8th graders (Cohen d= 0.6634), when compared to their respective control groups. EmpowerU instruction positively impacts students' goals and well-being. However, it is recommended that a more robust experimental design be completed with rigorous statistical analysis to further confirm these preliminary results.

Math fact fluency--the ability to quickly and accurately recall basic addition, subtraction, multiplication, and division facts--is a foundational mathematical skill. "Zaner-Bloser Building Fact Fluency (BFF)" was designed to build students' conceptual understanding of arithmetic operations and increase procedural fluency among elementary school students, with the goal of strengthening math learning. LXD Research conducted a study to examine Grade 3 students' math proficiency levels on the standardized Iowa Statewide Assessment of Student Progress (ISASP) across five "Building Fact Fluency" participating schools and 20 similar Iowa comparison schools from spring 2021-spring 2023. One "Building Fact Fluency" pilot school began the program in fall 2021, and four additional schools began the program in fall of 2022. The pilot "Building Fact Fluency" school, Year 2-only "Building Fact Fluency" schools, and comparison schools had a similar percentage of students on grade level at baseline. However, Grade 3 students in "Building Fact Fluency" schools showed consistently greater improvements in the percentage of Grade 3 students on grade level in math.