Search

This paper reviews overall student performance as well as the performance of student subgroups on the assessment system developed in response to the Massachusetts Education Reform Act of 1993 (MERA), the Massachusetts Comprehensive Assessment System (MCAS). Comparing students in Massachusetts to students in the rest of the United States or against students in other countries can not only confirm the rigor of the MCAS, but the comparison can also provide meaning to MCAS scores and ensure that they accurately measure student performance. There are two primary international exams given at regular intervals: (1) the Trends in International Math and Science Study (TIMSS); and (2) the Program for International Student Assessment (PISA). The strong performance on the international exams across several years and subjects, especially on TIMSS, confirmed the quality of Massachusetts K-12 schools.

Most states responded to the onset of the pandemic by temporarily granting teachers Emergency licenses. These licenses allowed teachers to work in classrooms without passing the typical licensure exams. Since then, several states have extended their use of Emergency licenses, raising questions about how these policies impact the composition of the teacher workforce and student outcomes. In this paper, we examine the result of these policies using data on multiple cohorts of Emergency licensed teachers (ELTs) who taught in Massachusetts between 2021 and 2023. We find that ELTs were slightly more likely to remain in the same school and in the teaching workforce than teachers from other entry routes. However, ELTs' students scored significantly lower on standardized tests in math and science than other students in the same school and same year. Our findings are at odds with earlier, more positive assessments of Emergency licensure in Massachusetts. Our updated results appear to be driven by more recent cohorts of ELTs, rather than the teachers who received Emergency licenses at the start of the pandemic. Overall, this study suggests policymakers should be cautious when drawing sweeping conclusions about the impacts of teacher licensure based solely on the earliest cohort of teachers who obtained pandemic-era Emergency licenses.

Departmentalized instruction, in which teachers specialize in one or more core subjects and instruct multiple groups of students in a day, has become increasingly prominent in elementary schools. Using 8 years of data from Massachusetts and a difference-in-differences design, we estimate the effects of departmentalization on student achievement. We find that departmentalization has positive effects in English language arts (ELA) and science and mixed evidence of positive effects in math. These positive effects are not driven by teacher productivity improvements: Consistent with prior findings on teacher specialization, teachers are less effective when specializing in math and no more effective in ELA than when teaching self-contained classrooms. Rather, consistent with the theoretical underpinnings for specialization, departmentalized schools tend to assign teachers to their stronger subjects.

In 1993, the Commonwealth of Massachusetts dramatically overhauled its K-12 education system and created a new school finance formula, building an educational accountability structure to ensure every child has access to a high-quality education. The Massachusetts Education Reform Act (MERA) established academic standards in core subjects, mandated assessments to measure student outcomes on those standards, and established a system for holding schools accountable when students failed to meet basic expectations. This system has helped Massachusetts' public schools become the highest performing in the country. Student outcomes in all tested subjects and across demographic groups have improved steadily over time, but disparities in achievement and attainment exist between the Commonwealth's most privileged students and their less privileged counterparts, many of whom are black or Hispanic. Without the MERA and its requirement to assess every student and publish aggregate academic outcomes, policymakers may not understand the extent of disparity or how to address it as student outcomes data are integral to understanding where Massachusetts' public schools have been, where they are going, and how they can get there. This paper illustrates the importance of the Massachusetts Education Reform Act and how it has positively impacted students over time. It explains why the current accountability system evolved as it did and why preserving the most important aspects of that system is critical if the state is going to fulfill its constitutional obligation to educate all children to a high common standard.

Graduates of special education teacher education programs can teach in a range of special education settings, raising the potential that their training can occur in very different settings than where they find their first jobs. We follow 263 completers of Moderate Disabilities programs in Massachusetts from their field placements to their early-career teaching positions and study the characteristics of their field placements and the degree to which these are aligned with their early-career teaching positions. We also assess the degree to which alignment is associated with early-career teacher turnover. We found that many of these teachers student-taught in an inclusive setting but were hired into a self-contained special education setting and vice versa, and teachers who experienced this misalignment were more likely to leave the workforce early in their careers. Teachers who student taught with a supervising practitioner without a special education license were also more likely to leave early. Findings suggest that teachers training to educate students with learning disabilities should student teach in a setting that is aligned with where they are likely to be hired, and with a supervising practitioner who is trained in special education.

Emotional, behavioral, and mental health challenges make it difficult for many children and adolescents to engage and succeed at school. Research indicates that at least 20% of all children and adolescents have been diagnosed with one more mental health disorders. Behavioral problems, anxiety, and depression are the most diagnosed mental health issues, and they often co-occur. Moreover, these conditions are being diagnosed at increasingly younger ages. In the past several years there has been a rise in the number of adolescents and young adults with serious mental health issues such as major depression and suicidal ideation, and the COVID-19 pandemic has exacerbated mental health problems for children and adolescents. Schools offer promise for providing intensive clinical support to the most at-risk students, and schools are necessary environment to explore the implementation of multi-modal youth mental health services. This paper provides an analysis of an intensive, in-school mental health services model developed and implemented by Effective School Solutions (ESS), a New Jersey based provider of high acuity school based mental health services for K-12 students. We analyze this multi-modal model for its effectiveness in improving educational outcomes for over 3,000 students identified as requiring intensive clinical mental health support across the 2021-22 school year. This analysis reveals that those students receiving High- versus Low-fidelity programming (i.e., multiple sessions per week for at least half of the school year versus for less than half of the school year) had better educational outcomes. Students receiving High-fidelity programming had greater improvements in grade point average (GPA) and greater reductions in absences across the school year. A higher number of in-school clinical sessions per week significantly predicted a greater increase in GPA and a greater reduction in total disciplinary incidents (including out of school suspensions) across the school year. This report provides initial promising evidence that in-school intensive mental health clinical services yield positive effects on students' educational outcomes. Though future research is needed to validate and extend these findings, schools may consider implementing such services onsite to meet students where they are and to optimize students' mental, behavioral, and educational well-being. [This white paper report was published by the Yale Child Study Center."]

The United States has been cultivating STEM talent for decades with great success, but that robust talent pipeline is threatened by a growing STEM teacher shortage. Left unaddressed, that shortage could curtail employment in STEM professions and the many related careers that increasingly require some degree of scientific and technological literacy. While the STEM teacher shortage is a national problem, the effects are likely to be felt more acutely in a state such as Massachusetts with a high concentration of STEM jobs. This paper provides an overview of the causes of the STEM teacher shortage and offers three recommendations to address it.

Since 2020, the federal government has distributed almost $2 billion to American school districts to mitigate the effects of COVID-19 pandemic school closures. Released in three separate tranches through the Elementary and Secondary School Emergency Relief (ESSER) fund, the Trump and Biden administrations outlined parameters for spending this unprecedented amount of money and ensured that most of it went directly to local school districts, with a comparative sliver going to state education agencies. This report gives an overview of the most common ESSER expenditures to date and assesses the factors that might influence whether district ESSER investments will make a difference for students. It also provides recommendations for how stakeholders should evaluate the ESSER experiment once it officially ends.

The growth of homeschooling from a somewhat fringe movement during the 1970s and 1980s to a more widespread and socially accepted approach in recent decades has provided a strong foundation of flexible learning models. When Florida's school choice expansion, House Bill 1, was introduced in January 2023, one of its goals was to allow more homeschoolers to participate in the education savings account (ESA) program. But many homeschoolers and homeschool advocacy groups balked at the proposal. Having worked hard to achieve independence, they were loath to be linked to government funding. Even if the program were optional, they feared that associated regulations would eventually extend to traditional homeschoolers. In the end, the bill passed with new language that satisfied traditional homeschoolers by creating a new option for parents to educate their children at home. As states continue to enact and expand education savings accounts, Colleen Hroncich argues that it is crucial that policymakers craft bills in a way that maximizes freedom and minimizes roadblocks.

In 2008 and 2012, Pioneer Institute published reports documenting declines in enrollment in Massachusetts' public schools. At the time, enrollment had fallen by about 35,000 students over a decade, or roughly 0.5 percent per year, with especially large drops in western Massachusetts and parts of Cape Cod. This paper examines enrollment trends since that time in three main sections. The first section continues the analysis from the prior papers and describes changes in enrollment during the 2010s. The second section evaluates the impact of COVID, using data from 2020 through this school year that the Department of Elementary and Secondary Education (DESE) published in December 2022. The final section offers cautious predictions for the next decade.

Anecdotal evidence points to the importance of school principals, but the limited existing research has neither provided consistent results nor indicated any set of essential characteristics of effective principals. This paper exploits extensive student-level panel data across six states to investigate both variations in principal performance and the relationship between effectiveness and key certification factors. While principal effectiveness varies widely across states, there is little indication that regulation of the background and training of principals yields consistently effective performance. Having prior teaching or management experience is not related to our estimates of principal value-added.

Despite a strong track record of success and parent demand, charter school growth has slowed considerably in recent years in Massachusetts and nationwide. In the Commonwealth's large urban school districts--especially Boston--this lack of growth is attributable to charter school caps that prevent the state from authorizing new charter school seats. But some school districts in the Commonwealth have room to grow. They have space available for charter expansion under the state's net school spending (NSS) cap and demand for charter schools in the form of waiting lists. A number of those districts are in Gateway Cities, "midsize urban centers that anchor regional economies around the state." The following paper provides data on the Gateway Cities with room to expand under the NSS cap. It also provides examples of how the politics of charter schooling-- both state and local--have prevented high quality operators from serving students and families who desire a charter school education. Finally, this paper concludes with recommendations to change state charter statute as well as processes and procedures related to charter school authorizing in the Commonwealth. These recommendations would make it more difficult for the state or any locality to deny families the charter school options they desire.

We use administrative panel data from seven states covering nearly 3 million students to document and explore variation in "academic mobility," a term we use to describe the extent to which students' ranks in the distribution of academic performance change during their public schooling careers. On average, we show that student ranks are highly persistent during elementary and secondary education--that is, academic mobility is limited in U.S. schools as a whole. Still, there is non-negligible variation in the degree of upward mobility across some student subgroups as well as individual school districts. On average, districts that exhibit the greatest upward academic mobility serve more socioeconomically advantaged populations and have higher value-added to student achievement.

We investigate two research questions using a recent statewide transition from paper to computer-based testing: first, the extent to which test mode effects found in prior studies can be eliminated in large-scale administration; and second, the degree to which online and paper assessments offer different information about underlying student ability. In contrast to the first test transition in Massachusetts, we find very small mode effects for a more recent transition, which may be attributable to an additional step matching on observable characteristics in the equating process. Second, we investigate the predictive evidence of validity for paper and online tests for predictions of future test scores and grades. We generally find minimal differences for the extent to which scores on paper tests can differentially predict future online versus paper test scores. Finally, online and paper test scores are similarly predictive of future grade point average. We conclude that the online test penalty can vary substantially by test and that extreme care should be taken when administering online tests to some students and paper tests to others.

This report focuses highlights turnarounds at two Massachusetts schools, Worcester Technical High School and the Roger L. Putnam Vocational Technical Academy in Springfield, that were once known for high dropout rates and low graduation rates. The report shows that these schools now excel due to new leadership, community investment, and committed teachers. The report analyzes how Worcester Tech and Putnam Academy -- schools with high numbers of low-income and special needs students -- leapt from the bottom of Massachusetts voc-tech rankings to become leaders among local schools. The Pioneer paper includes interviews with administrators and presents several recommendations that could help transform struggling voc-tech schools.

Prepared for the Boston Foundation and signed onto by nearly two dozen representatives from across the political spectrum, "Unlocking College: Strengthening Massachusetts' Commitment to College in Prison" explores the landscape of educational opportunities in Massachusetts prisons. The report finds that despite evidence that educational opportunities improve racial equity and reduce recidivism, Massachusetts program face systemic challenges that have prevented program expansion. Addressing these issues is a moral and economic imperative - and it is a path a number of other states with both liberal and conservative leaders have already taken. The second half of the report explores lessons Massachusetts could take from these other states to create a broader system that complements the state's notable efforts to reduce the overall prison population statewide. Allowing college-in-prison programs to grow within the Massachusetts Department of Corrections would be the first, best step in the process, saving money and unlocking greater opportunities for thousands of people in the state.

Student-teacher relationships are at the core of student experiences in schools and, arguably, fundamental to influencing student outcomes. Using a statewide, student-level school climate survey from Massachusetts, we investigate teachers' contributions to school climate, which we refer to as climate value added (VA), and how it varies by student race/ethnicity. We first show that climate VA contributes to student learning: Teachers whose students report positive feelings about climate also contribute more to student test scores and to an aggregate of nontest student outcomes (student absences, suspensions, and grade progression). And teachers identified by students of color as contributing to better school climate have outsize effects on learning gains for these students. Differences in teachers' climate effects across racial/ethnic groups are largest on topics aligned with cultural competency, school participation, and comfort with faculty. Lastly, we find that Black students assigned to Black teachers report better school climate than Black students assigned to other teachers.

We examine how different measures of teacher quality are related to students' long-run trajectories. Comparing teachers' "test-based" value-added to "nontest" value-added -- based on contributions to student absences and grades -- we find that test and nontest value-added have similar effects on the average quality of colleges that students attend. However, test-based teacher quality measures have more explanatory power for outcomes relevant for students at the top of the achievement distribution such as attending a more selective college, while nontest measures have more explanatory power for whether students graduate from high school and enroll in college at all.

METCO, the Metropolitan Council for Educational Opportunity, enables over 3,000 mostly African-American and Hispanic students from Boston and Springfield to attend schools in three dozen surrounding communities. The program has been remarkably stable for decades, with enrollment rarely falling below 3,100 or rising above 3,300, and most suburban districts continue to participate each year. The primary funding for METCO is through a state grant. Through evaluation of data that is presented in this report, it was found that several minor changes could make the program even better. The authors recommend that the state simplify the grant formula, incorporate current enrollment figures, and publish information about Chapter 70 funds generated by METCO students. The legislature should also provide additional funds to support late afternoon transportation and cover the special education costs of METCO students. Some of these changes, such as basing the grant on current enrollment and covering special education costs, would also make it easier to expand METCO. To expand, the legislature should provide the METCO managers additional funds to cover the immediate costs of expansion and commit to providing adequate ongoing grant support for a larger program. A relatively small investment of education funds could allow the successful program to serve additional students and their families.

This report finds that Massachusetts provides fewer options for students to be educated outside their assigned school districts than most other states do, and educational savings accounts (ESAs) offer an effective tool for giving students additional opportunities. Author Cara Candal proposes two potential ESA programs for Massachusetts.

This paper focuses on the increase in families who have chosen to homeschool their children in grades K-12 since the rise of the COVID-19 pandemic. This update includes interviews with families who opted to homeschool their children in the conventional approach, rather than continue with the hasty remote learning that educators tried to transfer from the classroom in March of 2020 and then the blended approach of online learning/classrooms-with-masks format that many districts used during the 2020-2021 school year. This report follows a study authored in June of 2017, "Homeschooling: The Ultimate School Choice," also published by the Pioneer Institute. It covered the history of homeschooling, demographics on homeschoolers, the economics around homeschooling and legislation affecting homeschooling. The authors of this report include several recommendations on how policy makers and education administrators can accommodate the growth in homeschooling and assist families who chose this manner of education for their children. The authors also urge policy makers and education officials to do more to acknowledge homeschooling as a viable educational choice. Districts and states can do more to provide direction and information for parents who are considering non-traditional options. [Foreword written by Kerry McDonald. For "Homeschooling: The Ultimate School Choice," see ED588847.]

Prior work has documented a substantial penalty associated with taking the Partnership for Assessment of Readiness for College and Careers (PARCC) online relative to on paper (Backes & Cowan, 2019). However, this penalty does not necessarily make online tests less useful. For example, it could be the case that computer literacy skills are correlated with students' future ability to navigate high school coursework, and thus more predictive of later outcomes. Using a statewide implementation of PARCC in Massachusetts, we test the relative predictive validity of online and paper tests. We are unable to detect a difference between the two and in most cases can rule out even modest differences. Finally, we estimate mode effects for the new Massachusetts statewide assessment. In contrast to the first years of PARCC implementation, we find very small mode effects, showing that it is possible to implement online assessments at scale without large online penalties.

States are responsible for setting and evaluating the standards that teacher preparation programs (TPPs) must meet for accreditation. Despite the considerable investment that states make in this process, no prior research has linked the ratings of TPPs generated by program reviews to inservice teacher performance. In this paper, we describe analyses of program review ratings from Massachusetts and their relationship to formal inservice teacher evaluation ratings and the value-added effectiveness of teachers. When comparisons are made across all schools and districts in the state, we find that a TPP's review scores are positively predictive of both inservice teacher evaluations and value added of TPP graduates, particularly when scores are aggregated within specific categories like partnerships and field-based practices. These relationships, however, become more modest for teacher evaluations and statistically insignificant for value added when the relationships are identified based on comparisons between TPP graduates who are teaching in the same schools and districts. It is not possible to separate whether these differences are due to the TPPs, the schools and districts themselves, or the connections between them, so future work is necessary to further validate TPP review scores in this setting and others.

There is empirical evidence of substantial heterogeneity in economic mobility across geographic areas and the efficacy of schools has been suggested as an explanatory factor. Using administrative microdata from seven states covering nearly 3 million students, we explore the potential role of schools in promoting economic mobility by estimating cross-district variation in "academic mobility"--a term we use to describe the extent to which students' ranks in the distribution of academic performance change during their schooling careers. We show that there exists considerable heterogeneity in academic mobility across school districts. However, after aggregating our district-level measures of academic mobility to the commuting-zone level and merging them with geographically matched external estimates of economic mobility, we find little scope for geographic differences in academic mobility to meaningfully account for differences in economic mobility.

The Individuals with Disabilities Education Act (IDEA) provides services to students who have disabilities. These IDEA-funded services are afforded to students between the ages of 3 and 21 who attend not only public schools (including charter schools), but also private schools. IDEA contains comprehensive guidelines on 3 processes which, by design, are meant to ensure that IDEA-funded services are granted without prejudice to any private school student who may by law be eligible to receive them. These processes IDEA refers to as "child find," "consultation," and "proportionate share." For a variety of reasons, the execution of these processes has been decidedly flawed. As a result, tens of thousands of private school students with disabilities have been denied the services to which IDEA, as a federal law, entitles them. Relying on raw data from certain public-school districts and state departments of education regarding their respective execution of the "child-find" process, the authors assess the extent to which, nationwide, private school students' (and their teachers') fair and full access to IDEA-funded services has been systemically denied. Based on this assessment, the authors offer recommendations on how, in the short-term, the current IDEA statute and regulations might be better enforced and IDEA's regulations might be improved. In view of IDEA's anticipated re-authorization, the authors also offer recommendations on how Congressionally approved statutory changes to the current law would ensure that, in the future, private school students will finally be able to freely and fully participate in IDEA.

Educational inequality due to family socioeconomic status (SES) has been the focus of both public dialogue and education research in the United States for many years. The current study aims to understand how educational inequality due to family SES has changed in the United States. Specifically, the study focuses on the changes in achievement gaps between high and low SES students between 2003 and 2017 and the changes in the performance of low-SES students over time. Data from the National Assessment of Educational Progress (NAEP) grade 8 mathematics assessment were used for the analyses. Results show that the SES achievement gap at the national level has remained the same over time. State-level results suggest that 34 of the 50 states' SES achievement gaps experienced no significant change between 2003 and 2017, 14 gaps widened, and only two SES gaps narrowed. In addition, at the national level, more low-SES students achieved at the NAEP Basic and at the NAEP Proficient levels over time with a majority of states improving their low-SES students' performance. In conclusion, the study contributes to the existing literature not only by reflecting on U.S. national trends using an effective SES index, but also by providing state-level results. It also collects trend data on states' macro-level indicators, including economic growth, social inequality, and educational expenditures, allowing state-specific findings to be presented in the context of changes in macro-level context. Initial explorations of relationships between state SES achievement gap trends and macroeconomic factors are presented to motivate future research. The trends in SES achievement gaps and the specific policy contexts are presented in greater detail for 13 states/jurisdictions.

Individual teachers, administrators, and parents made tremendous efforts to continue educating the Commonwealth's children between March and June of this year. But no amount of dedicated individual effort could have overcome fundamental challenges: weak guidance to districts from the Department of Elementary and Secondary Education (DESE) against a backdrop of deficient knowledge and sophistication statewide with regard to virtual learning. Digital education has been empirically proven to be most successful when schools prepare and follow best distance learning practices. However, the Commonwealth lacks even the minimum technological infrastructure for virtual learning, as exemplified by districts scrambling to obtain electronic devices and internet connections during the school closure. It is encouraging that Governor Baker and the DESE have described a fall 2020 return to brick-and-mortar schooling--with appropriate health measures to maximize safety--as a significant priority. The present challenge is how to implement this much-needed return to school, optimally balancing the importance of in-person schooling with the countervailing importance of protecting against the virus. The following paper contributes important insights, based upon careful review of other countries that have already successfully reopened their schools. [Foreword written by David S. Clancy and Dr. John G. Flores.]

In the fall of 2019, well before the appearance of COVID-19, there was heightened concern among U.S. business leaders, economists and investors about a global economic slowdown and the possibility of a recession in 2020. But a downturn in the technology sector was not prominent among their worries. In the decade from 2018 to 2028 computer and information technology (CIT) occupations were expected to grow by 12 percent, adding more than half a million new jobs, well above the average for all occupations, according to the federal Bureau of Labor Statistics. In May of 2018, the median annual wage in CIT occupations was $86,320, well above the median annual wage of $38,640 for all occupations. One reaction to the promising labor market was a leap in undergraduate enrollments in computer science (CS) courses and degree programs at U.S. colleges and universities. The number of bachelor's degrees awarded nationally in computer and information science had increased by 74 percent at not-for-profit institutions between 2009 and 2015, compared to a 16 percent increase in bachelor's degrees produced overall. This paper reports on the findings in terms of how CS education is implemented and promoted across the United States, yet it takes no position on the actual need or usefulness of teaching computer science in K-12. Less than half the high schools in the United States teach CS. Girls and students of color are underrepresented in computer science classes. There's a need for more certified computer science teachers and more states to create CS learning standards. Even as computer science has accelerated research in health care, climate change and communications, it still finds itself behind the traditional disciplines of chemistry, biology, and physics within many high schools.

Although many programs remotely disseminate information to students about the college application process, there is little evidence as to how students experience these programs. This paper examines a large-scale remote counseling program in which college counselors initiated interactions with 15,000 high school seniors via text message to support them through the college application process. Given the passive nature of text messaging, not all of the counselors' prompts elicited similar responses from students. I use text-as-data methods (combining qualitative coding and supervised machine learning) to measure which interactions lead to productive engagement between counselors and students, and which do not. I show that interactions about financial aid offers and financial aid applications are much more likely to generate productive engagement than interactions about college lists. This finding may help to explain why recent remote counseling interventions that have sought to influence students' college lists have been ineffective.

This topic paper details how dual and concurrent enrollment programs can help states overcome workforce readiness and postsecondary access and completion challenges and how governors can strengthen these programs by using their bully pulpit, agenda setting authority and budgetary authority to do so. It concludes with a number of examples of how governors are acting to strengthen equity and access to these programs. It also includes a number of resources for interested policy makers.

We use teacher candidate test scores on the Massachusetts Tests for Educator Licensure (MTEL), linked to student and teacher outcomes in the state, to investigate the predictive validity of these teacher licensure tests. We find that MTEL scores are positive and statistically significant predictors of teachers' in-service performance ratings and contributions to student test scores (i.e., value added) once they enter the workforce. We then explore whether these relationships vary for candidates and teachers of color. We find that teacher candidates of color have lower first-time pass rates and are also less likely to retake licensure tests if they fail than are White teacher candidates, but we do not find consistent evidence that MTEL scores are less predictive of value added for teachers of color. Finally, we find that MTEL scores are more predictive of teacher performance ratings for teachers of color than for White teachers.

The Massachusetts Department of Elementary and Secondary Education (DESE) has solicited public comment on pandemic-related revisions to its important "Learning Time" regulation, 603 CMR 27.00. The revisions establish baseline procedural and substantive requirements for in-person, hybrid, and remote learning. Appreciating that the regulation is meant to set forth only the most fundamental matters, with many other matters contained in a parallel guidance document. The revised regulation states that remote learning must be "aligned to state standards." This policy brief responds to the DESE's solicitation of public comments on the regulation. The Pioneer Institute for Public Policy Research continues to advocate for those recommendations, and for maximum preparedness and rigor in the actual delivery of remote learning. At this moment, Pioneer emphasizes these important areas: training for teachers and parents, which addresses both technical and substantive aspects of remote learning; highly accessible lines of communication between school personnel and families--such as online or audio hotlines--so technological and other problems can be resolved quickly and during as much of the day as reasonably possible; and a constant process of critical self-evaluation, resolving problems and making improvements wherever possible.

With Massachusetts' school closure extending until the end of the 2019-20 academic year, Pioneer Institute urges that Massachusetts schools offer meaningful online and virtual learning programs, doing everything possible to eliminate problematic inconsistencies across Bay State school districts. Pioneer further urges Massachusetts to develop and distribute for timely public comment two plans, one that will remedy this semester's educational gaps during the 2020-21 school year, and another to address future extended school closures, if and when they might occur. Relatedly, after this crisis passes, Massachusetts should take steps toward generally improving its knowledge and capabilities with respect to online learning, which Pioneer, Bay State lawmakers, and nationally-recognized experts on digital learning have long identified as a significant area of weakness in Massachusetts' K-12 education system.

Testing students and using test information to hold schools and, in some cases, teachers accountable for student achievement has arguably been the primary national strategy for school improvement over the past decade and a half. Tests are also intended to be used as a diagnostic tool to identify individual student needs, so that students can be set on a trajectory for long-term academic success. We use panel data from three states -- North Carolina, Massachusetts and Washington State -- to investigate how accurate early measures of achievement are in predicting later high school outcomes. We contribute to the literature in three distinct ways. First, the long panels we employ allow us to quantify the accuracy of models predicting how early (3rd and 4th grade) measures of student background and achievement predict several later schooling outcomes: 8th grade test achievement, high school course-taking, and high school graduation. Second, we test the extent to which predictions based on distinct segments of student data (e.g. grades 3 to 8, then 8 to 12) sacrifice forecast accuracy; this is of particular policy relevance for states or localities that do not yet have long administrative data panels. Finally, we test the degree to which the use of parameter estimates from models predicting schooling outcomes derived from one state diminish the accuracy of predicting outcomes in other states.

This study finds that, breaking with decades of slow improvement, U.S. reading and math scores on the National Assessment of Educational Progress (NAEP) and other assessments have seen historic declines since most states implemented national Common Core English and math curriculum standards six years ago. This descriptive analysis is designed to be understood by a general, non-technical readership. It primarily compares student achievement gains on the NAEP after implementation of Common Core to student achievement gains in the years preceding implementation of Common Core. Since test score results, by their nature, tend to "bounce" somewhat from one year to the next and gains are rarely perfectly smooth, a significant part of the analysis determines the average annual gain since implementation of Common Core and compares that to the average annual gain before implementation of Common Core. This report also includes a section addressing defenses by Common Core advocates denying responsibility for the poor results. The following state samples are included: (1) California; (2) Florida; (3) Georgia; (4) Illinois; (5) Kentucky; (6) Massachusetts; and (7) New York.

This paper looks at the popularity of after-school mathematics by focusing on the Kumon and Russian School of Mathematics models. In 1954, Toru Kumon, a high school math teacher in Japan, designed a series of math worksheets to help improve the test scores of his son Takeshi, a second grader. Toru's goal was to teach Takeshi how to learn independently through the worksheets and improve his calculation skills prior to reaching high school. By working every day on the problems, Takeshi was able to reach the level of differential and integral calculus when he was just a few months into the sixth grade. The Kumon model is based on four elements: (1) Individualized instruction; (2) Self-learning; (3) Small-step worksheets; and (4) Kumon instructors. Parents who want to give their children a head start in math before elementary school can enroll them in Kumon as young as age 3. From that age they can stay with the program through high school or until they complete the program. In the U.S. alone, Kumon has grown from more than 182,000 students and nearly 1,300 centers in 2008 to more than 279,000 students and more than 1500 centers in 2018. While the Kumon method involves repeating mathematical processes until students over-learn them to automaticity, the Russian School of Mathematics (RSM) promotes itself as believing in just the opposite. The RSM model was founded by Inessa Rifkin in 1997 with Irina Khavinson, a friend, educator, and fellow Russian immigrant, after concluding that her son Ilya was not receiving the same mathematics education that she received as a student in the Soviet Union. Their goal was to translate their own experiences with specialized Russian math programs into a school that offered the same opportunity to American children. Two decades later about 25,000 students are enrolled with RSM today, in 40 locations in 11 states and Canada. Russian School of Mathematics students attend a classroom once per week for varying lengths of time, depending on grade: 90 minutes for kindergarten through third grade; two hours for grades four through six; and two-and-a-half hours for grades seven and above. Algebra and geometry are on separate tracks starting in the sixth grade, though students may enroll in both. This paper reviews each model's methods, highlights their best practices, and shows how they complement or run parallel with mathematics taught in traditional classrooms.

In this paper we compare two approaches to measuring the average rate at which students learn in a given school or district. One type of measure--longitudinal growth measures--relies on student-level longitudinal data. A second type--cohort growth measures--relies only on repeated aggregated, cross-sectional data. Because student-level data is often not readily available, cohort growth measures are sometimes the only type available. The estimated school and district learning rates reported in the Stanford Education Data Archive (SEDA), for example, are cohort growth measures based on aggregated data. Understanding how much researchers and policymakers can rely on these cohort growth estimates requires one to know how well, and under what conditions, the estimates obtained from this approach align with those based on longitudinal data. In this report we address these questions. We do so by using longitudinal student data from three states (Massachusetts, Michigan, and Tennessee) to construct both average gain score measures (longitudinal growth) and change-in-average measures (cohort growth) for each public school district and school serving students in any of grades 3-8 in the three states. We then compare the two sets of estimates in order to assess how well the latter replicates the former. We do this separately for districts and schools. We find that the longitudinal and cohort growth measures are generally highly correlated in these three states. On average, the cohort growth measures largely rank schools and districts similarly to longitudinal growth measures. The correlations at the district-level (r=0.87) are somewhat higher than the school-level correlations (r=0.80), which reflects the fact that there is less student mobility among districts than among schools. Additionally, in cases where student mobility in and out of schools or districts is high, the measures are less well aligned. Mobility rates are higher, on average, in small schools and districts, schools with long grade spans, and in charter schools. As a result the alignment of the two measures is weaker in these cases. We conclude that the cohort growth measures are useful proxies for longitudinal growth measures in most, but not all cases. [This work was completed in collaboration with Michigan's Center for Educational Performance and Information (CEPI) and the Tennessee Education Research Alliance (TERA).]

In 2010, the Massachusetts Legislature lifted the cap on the number of charter schools that the Board of Elementary and Secondary Education (BESE) can authorize in low-performing school districts. The "smart cap" requires the Department of Elementary and Secondary Education (DESE) to rank district performance (based on student outcomes) annually. Districts that fall into the lowest 10 percent of those rankings are eligible for an increase in the amount of tuition that they can pay to charter schools. Whereas the law limits district tuition payments to charter schools at 9 percent of net school spending, the smart cap raises that limit to 18 percent of net school spending in the Commonwealth's lowest performing districts. Until 2015, the Commonwealth ranked district performance solely according to the number of students scoring proficient in core subject areas on the Massachusetts Comprehensive Assessment System (MCAS) tests. In 2015, BESE amended the smart cap regulations and began using an additional measure, the student growth percentile (SGP), as 25 percent of the formula for determining district rankings. This paper presents data on the relationship between enrollment and SGP and its impact on determining the lowest performing districts in Massachusetts. Based on these data, the authors recommend that the Commonwealth stop using SGP as a factor in determining eligibility for an increase in the charter school cap and revert to a formula that uses absolute proficiency as the sole measure. The Commonwealth should also separate determinations about increases in the net school spending cap from its overall accountability system. Other recommendations include mitigating the negative impacts of the current formula for existing and prospective charter operators and increasing transparency around the purpose and use of SGP more broadly. [This report was written with Bruce Bean & Rebekah Paxton.]

Fintech describes new technology aimed at improving and automating the delivery of financial services. The term encompasses a wide variety of finance industry segments, such as crowdfunding, peer-to-peer lending, payments, data collection, cryptocurrency, credit scoring, cybersecurity for finance, thematic investing, algorithmic asset management, stock and bond investing, private securities transactions and more. New technologies compete with traditional finance models and change the internal processes of financial companies. Universities around the world are beginning to examine fintech preparedness and some are attempting to create coursework to fill the skills gap. Characteristically, the majority of university fintech programs in existence have focused on regulation, security considerations and understanding the impact of technology on the market. This high-level approach does not go into depth about individual technologies, leaving students to learn on the job or pursue additional elective coursework. This white paper recommends some ways public universities can prepare students in fintech. For example, public universities in Massachusetts can strive to offer coursework that gives a broad overview of fintech and regulation by examining in-demand skills as well as the pioneering efforts of early movers in academic fintech. For students, a key goal of fintech education is to develop the tools to think ahead of the curve. In addition, Massachusetts public universities can begin a process of examining their elective coursework across disciplines, identifying areas of opportunity for business students to gain further fintech-related skills. University administrators could consider expanding some elective course opportunities, setting up new tracks for business majors or developing certificate programs for business students to package their additional course experiences for potential employers. Also while business students may feel the impacts of fintech growth most directly in their chosen field, computer science students at Massachusetts public universities may find themselves working for companies providing fintech software or within existing financial services companies doing software design, development and configuration. Academic leaders can begin -- or expand -- a process of assessing current coursework and degree paths, potentially creating new prerequisites or entirely new avenues to degree completion for business and computer science students. By working to understand shifts in the market brought on by fintech and their implications for job skills demand, public universities can endeavor to better prepare undergraduate and graduate students for the future and strengthen one of the core industries of Massachusetts.

We evaluate the predictive validity of the Massachusetts Candidate Assessment of Performance (CAP), a practice-based assessment of teaching skills that is typically taken during a candidate's student teaching placement and is a requirement for teacher preparation program completion in Massachusetts. We find that candidates' performance on the CAP predicts their in-service summative performance evaluations the following year and provides a signal of future teacher effectiveness beyond what is already captured by the state's traditional licensure tests. Our findings add to a growing literature demonstrating that it is possible to collect information about the skills of "prospective" teachers during their teacher preparation experience that are predictive of the "in-service" outcomes of teachers.

As state leaders consider needed updates to the Commonwealth's school funding formula, they should remember just how well the approach taken by Tom Birmingham, former Massachusetts state Senate president, and co-author of the 1993 Education Reform Act worked. Beginning in 1993, Massachusetts' SAT scores rose for 13 consecutive years. The state's scores on the National Assessment of Educational Progress (NAEP) shot up, too. By 2005, Massachusetts students became the first to score best in the nation in all four major NAEP categories (fourth- and eighth-grade reading and math). Since then, they have repeated the feat on every subsequent administration of NAEP except one. While American students as a whole lag behind their international peers, the 2007 and 2011 Trends in International Mathematics and Science Study results showed that Massachusetts students were competitive with their counterparts in places like Japan, Korea, and Singapore. In 2007, the Bay State's eighth graders even tied for first place internationally in science. The current formula for funding K-12 public education calculates a "foundation budget," which is the minimum needed for a school district to provide its students with a quality education. Another formula determines how much each district can afford to contribute, and the state fills the gap between that amount and the foundation budget. Some wealthier districts contribute more than is required, but every district receives a minimum annual state contribution of about $1,750 per student. State funding, known as Chapter 70, jumped by 227.4 percent per pupil between 1993 and 2019, rising from $1.592 billion to $5.212 billion (see figure 1). This rate of increase exceeded the rate of increase in per pupil net school spending by municipalities (excluding Chapter 70 funding) of 156.8 percent, rising from $3.704 billion to $9.513 billion during that time frame. It also exceeded growth in statewide enrollment, which rose by 16.3 percent, from 809,496 to 941,411 over that period. It also exceeded the rate of increase of the consumer price index for all urban consumers in Boston-Cambridge-Newton, MA which rose by 83.7 percent over that time period. As legislators contemplate the financial needs of local school districts, they should keep in mind that they face an enormous parallel funding challenge over the next 17 years. Unlike in some other states, the Commonwealth--not municipalities--is responsible for the unfunded liability of two pension funds that serve municipal employees: the Massachusetts Teachers Retirement System (MTRS) and the Boston Teachers Retirement System BTRS). Massachusetts currently faces a combined $41.26 billion unfunded liability for the pension systems of state employees, Massachusetts teachers and Boston teachers. Of that, (figure 5) shows nearly two thirds, or 65.6 percent of the total obligation is attributable to unfunded local teacher pensions. Legislators would be wise to keep these pension and other post-employment benefits (OPEB) obligations in mind as they fashion updates to Chapter 70. As mentioned previously, the foundation funding formula has been revised and updated several times in recent years. Some additional tweaking is warranted, but the fact remains that wholesale changes are not in order. The communities left behind are the older industrialized cities and towns, such as listed in Figure 8, from Worcester and Orange to Springfield and Lawrence. Lawmakers should focus on the fiscal needs of these communities. They should also tie this additional investment to a policy strategy that is most likely to lead to better educational accountability and student outcomes in those key cities and towns. Whatever new funding comes from the state should be tied to reform. Over the last decade, Massachusetts has retreated from some of the key reforms that drove significant progress on student achievement for all students, e.g., adoption of weaker academic standards in English Language Arts (ELA), math, science, and history, the transition to the watered down (Minnesota Comprehensive Assessments) MCAS 2.0, the loss of an independent district accountability agency, and the erosion of legislative support for proven school reform innovations, including charter schools. Over that time, the Commonwealth has experienced declining MCAS and SAT scores, and Massachusetts is among a minority of states in which National Assessment of Education Progress (NAEP) scores have fallen between 2011 and 2017. The opportunity for change that comes with significant new money should not be lost. To ensure that additional resources provide a return on taxpayer investment, Pioneer offers eight recommendations in this report.

In just the last 18 months, Massachusetts has seen the closure of small private liberal arts colleges Mount Ida and Newbury Colleges. The pressures on these types of institutions include technological disruption, changing student demands, and ever-escalating costs. To address this, the Massachusetts Board of Higher Education (BHE) and Department of Higher Education (DHE) have proposed creating a new state agency, called the Office of Student Protection (OSP), that would be granted unilateral authority to order colleges to notify students and other stakeholders by December 1st of any academic year where a meaningful risk exists that the college cannot complete the current school year and the next one. Under the proposal, OSP would be empowered to order a December 1st notification even if the college has a current satisfactory Financial Responsibility Composite Score from the U.S. Department of Education, qualifying its students to receive federal financial aid and loans, and even if the college is currently accredited by the U.S. DOE's approved regional accrediting agency, the New England Commission of Higher Education (NECHE). On March 6, 2019, Governor Baker filed Senate Bill 2183, which proposes giving BHE authority to request information from private higher education institutions "to accurately and fairly determine the institution's financial condition and to monitor such condition over time" and "to impose sanctions on institutions that do not comply in a timely manner." The legislation also proposes giving BHE authority to compel higher education institutions "to prepare and submit to [BHE], for its approval, a contingency closure plan which shall include a process for providing enrolled and admitted students and staff with timely notification of the institution's financial condition" and "arrangements for enabling students to complete their programs of study" if BHE identifies the institution as having liabilities or risks that may result in imminent closure or jeopardize the institution's ability to fulfill its obligations to current and admitted students. Under the proposed legislation, such contingency closure plans would be subject to BHE approval. The proposed legislation would exempt information submitted by institutions of higher education at BHE's request from the Massachusetts public records law. The proposed legislation also directs BHE to establish regulations interpreting and applying this new section of law, following consultation with representatives of public and private colleges and universities. The stated goal of BHE's proposal is to protect students from sudden, unexpected closings such as what happened with Mount Ida College. According to BHE and DHE, their proposal would provide an earlier warning of potential college closures than has historically been provided by USDOE and NECHE. In this report, Pioneer Institute identifies 10 serious problems with the BHE/DHE proposal.

Sixty-seven school finance reforms (SFRs) in 26 states have taken place since 1990; however, there is little empirical evidence on the heterogeneity of SFR effects. We provide a comprehensive description of how individual reforms affected resource allocation to low- and high-income districts within states, including both financial and non-financial outcomes. After summarizing the heterogeneity of individual SFR impacts, we then examine its correlates, identifying both policy and legislative/political factors. Taken together, this research aims to provide a rich description of variation in states' responses to SFRs, as well as explanation of this heterogeneity as it relates to contextual factors.

This white paper presents a selection of model schools who all have, to some degree, fostered deeper learning. Schools were selected by internet search, or through references in "deeper learning" reports and documents. It should be noted that information in these reviews is based on information from school web-sites, in some cases the web sites of state education agencies, media reports and ratings, such as those published by "US News and World Report" or "Newsweek." It is hoped that this paper will serve as a resource directory of sorts, giving interested parties the opportunity to read more widely about these schools, consult the referenced documents, or to contact the schools directly. [For "Innovation and Deeper Learning: Volume 2," see ED604592.]

Serious history instruction in K-12 U.S. schools has been in decline for decades. History education in Massachusetts has, until now, fared somewhat better than in the nation at large. In 1993 the commonwealth enacted the Massachusetts Education Reform Act--a bipartisan plan to improve education--which mandated core standards and assessments in history and social science, among other disciplines. The Massachusetts History and Social Science Curriculum Framework (the 2003 Framework) produced under this mandate contained strong, flexible grade-by-grade standards for core essential knowledge. In 2009, the Board of Elementary and Secondary Education (the State Board) suspended the 2003 Framework, and it never went into effect. In 2016, the Massachusetts Department of Elementary and Secondary Education (DESE) instead launched a rewrite of the 2003 Framework, in good measure to realign Massachusetts history education around service-learning and civic engagement. In 2017 the DESE presented the revisions to the State Board, which approved them to be posted for public comment in January 2018. This paper contends that the January 2018 Public Comment Draft of the Massachusetts History and Social Science Curriculum Framework (2018 Revision) eviscerates the 2003 Framework. Among other things, the 2018 Revision eliminates the standards-based and curricular linkage to the already developed Massachusetts Comprehensive Assessment System (MCAS) test for U.S. history, while substituting meaningless expectations for each grade. This paper recommends that the Massachusetts State Board reject the 2018 Revision in its entirety and immediately put into effect both the 2003 Framework and its accompanying MCAS test. [Preface By Paul Reid, co-author with William Manchester.]

The fiscal and educational consequences of charter expansion for non-charter students are central issues in the debate over charter schools. Do charter schools drain resources and high-achieving peers from non-charter schools? This paper answers these questions using an empirical strategy that exploits a 2011 reform that lifted caps on charter schools for underperforming districts in Massachusetts. We use complementary synthetic control instrumental variables (IV-SC) and differences-in-differences instrumental variables (IV-DiD) estimators. The results suggest greater charter attendance increases per-pupil expenditures in traditional public schools and induces them to shift expenditure from support services to instruction and salaries. At the same time, charter expansion has a small positive effect on non-charter students' achievement.

For awhile thousands of children in the Commonwealth of Massachusetts have been denied in fact (de facto) the special education services to which they, according to Federal Civil Rights Law (de jure), are entitled. According to the Massachusetts' Department of Elementary and Secondary Education (DESE), private schools are not entitled to federal funds for their special needs students. Should a private school student need services, they are to receive them at their local public school. As a result, they would have to travel to receive services, meaning a student would miss considerable school time and parents would have to take significant time off from work to transport the student. The authors of the white paper: (1) present how and why this state of affairs has persisted for so long; and (2) offer recommendations which, if implemented, would correct these wrongs that so negatively impact in Massachusetts thousands of private school students.

Nearly two dozen states now administer online exams. These tests have real consequences: their results feed into accountability systems, which have been used for more than a decade to hold schools and districts accountable for their students' learning. We examine the rollout of computer-based testing in Massachusetts over 2 years to investigate test mode effects. Crucial to the study design is the fact that the state administers the same exam (PARCC) in online and offline formats each year during the transitional period. We find mode effects of about 0.10 standard deviations in math and 0.25 standard deviations in English language arts (ELA). Our preferred estimates of the effects of online testing in the second year of administration suggest that mode effects for second-time test takers were about one third as large as the first year in math and about half as large in ELA. There is little evidence of systematic variation in mode effects by student demographic groups, although on ELA tests they are larger for students scoring at the bottom of the achievement distribution.