Search

This paper assesses the reliability and validity of cognitive and socioemotional skills measures and investigates the correlation between schooling, skills acquisition, and labor earnings. The primary data from Pakistan incorporates two innovations related to measurement and sampling. On measurement, the paper develops and implements a battery of instruments intended to capture cognitive and socioemotional skills among young adults. On sampling, the paper uses a panel that follows respondents from their original rural locations in 2003 to their residences in 2018, a period over which 38 percent of the respondents left their native villages. In terms of their validity and reliability, our skills measures compare favorably to previous measurement attempts in low- and middle-income countries. The following are documented in the data: (a) more years of schooling are correlated with higher cognitive and socioemotional skills; (b) labor earnings are correlated with cognitive and socioemotional skills as well as years of schooling; and (c) the earnings-skills correlations depend on respondents' migration status. The magnitudes of the correlations between schooling and skills on the one hand and earnings and skills on the other are consistent with a widespread concern that such skills are under-produced in the schooling system. [This report was prepared by the World Bank Group's Development Research Group, Development Economics. Funding was provided by RISE and World Bank's Strategic Research Program Fund.]

This report presents a holistic approach to understanding and comparing vocational education and training (VET) systems. The approach has been developed jointly by a group of interdisciplinary VET researchers over a 5-year period as part of Cedefop's research on the future of VET and has been reviewed several times. The framework introduces 50 dimensions for analysing VET systems, as well as parts of them, structured according to three overlapping main perspectives: epistemological and pedagogical, education system, and socioeconomic or labour market. The framework is particularly suited to 'clearing the ground' for policy work and provides a model for how research can support policy. This model can be flexibly adapted and applied in any comparative research or international policy learning activity related to VET. [The research was carried out by a consortium led by 3s Unternehmungsberatung (Austria). The consortium includes Ockham IPS (the Netherlands) and the Fondazione Giacomo Brodolino (Italy). The German Federal Institute of Vocational Education and Training (BIBB) supports the project as sub-contractor. For "The Changing Nature and Role of Vocational Education and Training in Europe. Volume 1: Conceptions of Vocational Education and Training--An Analytical Framework. Cedefop Research Paper. No 63," see ED586251.]

The purpose of this occasional paper is to compare point estimates and trends included in the Monitoring the Future (MTF) Panel Study annual report: "National Data on Substance Use among Adults Ages 19 to 60, 1976-2021" prepared using historical post-stratification weights, with the same point estimates and trends obtained when using MTF age-specific panel analysis weights. The current report is organized into four sections: (1) Part 1: Overview of Old and New Weighting Methods; (2) Comparison Approach and Summary; (3) Differences Observed Between Old and New Weighting Approaches, by Substance; and (4) Updated Panel Report Figures and Tables. Evaluating the impact of the new MTF panel analysis weights on point estimates and trends reported in the MTF panel annual report for 1976-2021 indicates that, overall, 63.1% of all point estimate comparisons exhibited less than a |5%| mean change between weighting approaches. Further, no trend comparisons indicated a sign flip, and 87.1% were substantively unchanged in regards to trend significance. [For "National Data on Substance Use among Adults Ages 19 to 60, 1976-2021," see ED623992.]

While the Pell Grant covers a substantial proportion of college tuition for low-income students, it has covered only two full-time semesters per year and has not included any support for summer courses through most of its history. As research has shown that continuous enrollment throughout the year increases college persistence and completion, the summer Pell (SP) program was added during the summer of 2009 and allowed eligible low-income students to receive an additional grant for summer tuition and eligible costs. The SP was eliminated in 2011 and then restored in 2017. Using administrative data on community college students in New York City, our difference-indifferences analysis results from both periods show that SP-eligible students had a higher retention rate in the fall of the second year, had higher associate and bachelor's degree attainment rates, and had higher earnings gains up to nine years from college entry compared to SP-ineligible students. Heterogeneous analysis indicates that the SP benefits were driven by Black students and older students.

India has the second largest higher education system in terms of institutions worldwide, despite having only 26.3% Gross Enrollment Ratio (GER), including vocational education. It aspires to achieve a target of 50% GER by 2035. It means it would require a larger number of higher education institutions (HEIs), public and private, in addition to huge fiscal resources. At present about 75% of the HEIs are privately managed with about 66% of student enrolment. Though there is no provision of for-profit higher education institutions in India, many non-profit private HEIs are actually working as for-profit. They are growing fast and are visible too. Therefore, it is high time now to think seriously about the pros and cons, causes and consequences of for-profit and nonprofit private HEIs in India. India provides a big market for non-profit and for-profit higher education to domestic and foreign stakeholders. Already 160 foreign universities are working in collaboration with public or private limited companies in India. This essay provides an analysis of issues related to for-profit and nonprofit HEIs, including desirability, size, funding, transparency, accountability, quality, feasibility and sustainability, government policies, regulation, foreign collaborations, private investments, and incentives. The methodology adopted is analytical, comparative, and empirical.

Measures of student disadvantage--or risk--are critical components of equity-focused education policies. However, the risk measures used in contemporary policies have significant limitations, and despite continued advances in data infrastructure and analytic capacity, there has been little innovation in these measures for decades. We develop a new measure of student risk for use in education policies, which we call Predicted Academic Performance (PAP). PAP is a flexible, data-rich indicator that identifies students at risk of poor academic outcomes. It blends concepts from emerging "early warning" systems with principles of incentive design to balance the competing priorities of accurate risk measurement and suitability for policy use. PAP is more effective than common alternatives at identifying students who are at risk of poor academic outcomes and can be used to target resources toward these students--and students who belong to several other associated risk categories--more efficiently.

Countries and cities around the world increasingly rely on centralized systems to assign students to schools. Two algorithms, deferred acceptance (DA) and immediate acceptance (IA), are widespread. The latter is often criticized for harming disadvantaged families who fail to get access to popular schools. This paper investigates the effect of the national ban of the IA mechanism in England in 2008. Before the ban, 49 English local authorities used DA and 16 used IA. All IA local authorities switched to DA afterwards, giving rise to a cross-market difference-in-differences research design. Our results show that the elimination of IA reduces measures of school quality for low-SES students more than high-SES students. After the ban, low-SES students attend schools with lower value-added and more disadvantaged and low-achieving peers. This effect is primarily driven by a decrease in low-SES admissions at selective schools. Our findings point to an unintended consequence of the IA to DA transition: by encouraging high-SES parents to report their preferences truthfully, DA increases competition for top schools, which crowds out low-SES students.

Has the gap in average standardized test scores between students from high- and low-income families widened, narrowed, or remained stable over the last 3 decades? The question is important both because the achievement gap is measure of how (un)equally educational opportunities are distributed in the US, and because the disparity in educational outcomes is a leading indicator of the degree of economic mobility. If the gap is widening, it suggests that children's educational experiences and opportunities in early and middle childhood -- in their homes, neighborhoods, childcare and preschool programs, and K-12 schools -- are becoming increasingly unequal, a sign that the growing economic inequality in the US has led to a parallel growth in educational inequality. A narrowing gap, however, would suggest the opposite: changes in early childhood or K-12 schooling have been equity-enhancing, even in the face of increased economic inequality among families. And because test scores and the skills they measure are valued in college admissions and the labor market, the trend in the test score gap may predict the trend in economic mobility several decades later.

In recent ACT mode comparability studies, students testing on laptop or desktop computers earned slightly higher scores on average than students who tested on paper, especially on the ACT® reading and English tests (Li et al., 2017). Equating procedures adjust for such "mode effects" to make ACT scores comparable regardless of testing mode. However, it remains possible that the mode effects are different for different groups of students. For example, differences in performance between paper and online testing may be different for groups with different levels of comfort taking tests on computers. Thus, a general mode adjustment may be inappropriate. The purpose of this study was to explore the possibility of differential mode effects by gender, race/ethnicity, and ability using data from three recent mode comparability studies (Steedle, Pashley, & Cho, 2020). Results indicated that mode effects in English, reading, math, and science did not vary significantly between genders or race/ethnicity groups. Analyses detected significant interactions between mode effects and ability because mode effects tended to be smaller for lower ability examinees. Fortunately, equating processes appropriately adjust scores for differential mode effects by ability.

Do Americans hold a consistent set of opinions about their public schools and how to improve them? From 2013 to 2018, over 5,000 unique respondents participated in more than one consecutive iteration of the annual, nationally representative "Education Next" poll, offering an opportunity to examine individual-level attitude stability on education policy issues over a six-year period. The proportion of participants who provide the same response to the same question over multiple consecutive years greatly exceeds the amount expected to occur by chance alone. We also find that teachers offer more consistent responses than their non-teaching peers. By contrast, we do not observe similar differences in attitude stability between parents of school-age children and their counterparts without children.

Prior work has documented a substantial penalty associated with taking the Partnership for Assessment of Readiness for College and Careers (PARCC) online relative to on paper (Backes & Cowan, 2019). However, this penalty does not necessarily make online tests less useful. For example, it could be the case that computer literacy skills are correlated with students' future ability to navigate high school coursework, and thus more predictive of later outcomes. Using a statewide implementation of PARCC in Massachusetts, we test the relative predictive validity of online and paper tests. We are unable to detect a difference between the two and in most cases can rule out even modest differences. Finally, we estimate mode effects for the new Massachusetts statewide assessment. In contrast to the first years of PARCC implementation, we find very small mode effects, showing that it is possible to implement online assessments at scale without large online penalties.

This paper estimates private and social returns to investment in education in Azerbaijan, using the 2015 Azerbaijan Monitoring Survey for Social Welfare. The private rate of return to education is 6 percent; this is the first estimate of returns to schooling in Azerbaijan since 1995. The returns to schooling are 6 percent for men and 8 percent for women, even controlling for selection. In addition, the paper estimates the returns for higher education; for this level, the rate of return is 9 percent. Finally, using the full discount method, the private rate of return to tertiary education is 9 percent, and the social rate of return is 8 percent. One policy implication is to re-examine the funding of higher education and for its expansion. [This paper is a product of the Education Global Practice.]

Teachers play a critical role in establishing classroom and school environments that contribute to students' social and emotional development. This paper explores whether we can estimate a classroom-level measure of student growth in SEL by applying value-added models to students' [social-emotional learning] SEL. We analyze data from the 2016 and 2017 administrations of student self-report surveys, which contain responses from roughly 40,000 students in Grade 5 within five of California's CORE Districts. We estimate separate value-added models for each of the four SEL constructs assessed--growth mindset, self-efficacy, self-management, and social awareness--and for math and [English language arts] ELA academic growth. We find across-classroom-within-school variance of students' SEL outcomes, even after accounting for school-level variance. The magnitude of classroom-level impacts on students' growth in SEL appears similar to impacts on students' growth in ELA and math, although the growth models of SEL do not perform as well as growth models of academic outcomes. Results suggest that across-classroom-within-school impacts may be larger in magnitude than across-school impacts on students' SEL growth. Finally, we show that there are generally low correlations between classroom-level growth in SEL and classroom-level growth in ELA or math; however, growth mindset stands apart from the other three SEL constructs in that there is a moderately strong relationship. By assessing whether we can develop a sound approach for measuring classroom-level impacts on students' SEL, we aim to contribute to the growing body of knowledge about appropriate and innovative uses of data on students' non-cognitive and social-emotional learning. [For the policy brief, "Can We Measure Classroom Supports for Social-Emotional Learning?," see ED600449.]

This study finds that, breaking with decades of slow improvement, U.S. reading and math scores on the National Assessment of Educational Progress (NAEP) and other assessments have seen historic declines since most states implemented national Common Core English and math curriculum standards six years ago. This descriptive analysis is designed to be understood by a general, non-technical readership. It primarily compares student achievement gains on the NAEP after implementation of Common Core to student achievement gains in the years preceding implementation of Common Core. Since test score results, by their nature, tend to "bounce" somewhat from one year to the next and gains are rarely perfectly smooth, a significant part of the analysis determines the average annual gain since implementation of Common Core and compares that to the average annual gain before implementation of Common Core. This report also includes a section addressing defenses by Common Core advocates denying responsibility for the poor results. The following state samples are included: (1) California; (2) Florida; (3) Georgia; (4) Illinois; (5) Kentucky; (6) Massachusetts; and (7) New York.

We study the effects of exposure to non-resident students on the outcomes of undergraduate in-state students during a period of high non-resident enrollment growth at the University of Missouri-Columbia. Our models leverage within-major, cross-time variation in nonresident exposure for identification. We find no evidence that increased exposure to domestic non-residents affects in-state student outcomes and our null results are precisely estimated. We find evidence of modest negative impacts on in-state students when their exposure to foreign students increases using our preferred specification. However, the identifying variation in exposure to foreign students in our data is limited and this result is not robust in all of our models.

This study compares the differences in the mismatch between the education and occupations of immigrants in Canada and the United States, operationalized by over-education. It further explores how the cross-country differences may be related to the supply of and demand for university-educated immigrants and the way they are selected. Using comparable data and three measures of over-education, this study found that university-educated recent immigrants in Canada were much more likely to be overeducated than their U.S. peers. The over-education rate gap between recent immigrants and the native-born was much more pronounced in Canada than in the United States. In addition, while labour market demand was associated with a lower level of over-education in both countries, a greater supply of university-educated recent immigrants was positively associated with a likelihood of over-education among recent immigrants in Canada, but not in the United States. Furthermore, in Canada, the over-education rate was significantly lower among immigrants who were admitted through some form of employer selection (e.g., immigrants who worked in skilled jobs in Canada before immigration) than those who were admitted directly from abroad. Overall, this study provides insight into how the immigration system interacts with broader aspects of the labour market to shape the labour market outcomes of immigrants.

This paper presents new benefit-cost estimates for the Tulsa universal preschool program. These calculations are based on estimated effects from previous papers of Tulsa pre-K on high school graduation rates and college attendance rates of students who were enrolled in kindergarten in Tulsa Public Schools in the fall of 2006. In this paper, educational effects from these prior papers are used to infer lifetime earnings effects and are compared with program costs. Our conservative estimates of earnings effects suggest that per pre-K participant, the present value of earnings effects in 2021 dollars is $25,533, compared with program costs of $9,628, for a benefit-cost ratio of 2.65. Compared to prior benefit-cost studies of Tulsa pre-K, this benefit-cost ratio is below what was predicted from Tulsa pre-K's estimated effects on kindergarten test scores, but above what was predicted from Tulsa pre-K's estimated effects on grade retention by ninth grade. This fading and recovery of predicted pre-K effects as children go through K-12 and then enter adulthood is consistent with prior research. It attests to the importance of the "soft skill" effects of pre-K and reminds us that short-term studies of pre-K provide useful information for public-policy decisions.

In low-income countries, private schools are perceived as superior alternatives to the public sector, often improving achievement at a fraction of the cost. It is unclear whether private schools are as effective in middle-income countries where the public sector has relatively more resources. To address this gap, this paper takes advantage of lottery-based admissions in first grade for a Mexico City private school that targets and subsidizes attendance for low-income children. Over three years, selected students via lottery scored 0.21 standard deviation higher than those not selected in literacy tests, corresponding to a normalized gain of one-half of a grade level every two years. Lottery winners also statistically outperformed those not selected in math, but the gains were more modest. Relative to the control group, parents of selected students were more satisfied with their school and had higher educational expectations for their children. Unlike findings from low-income countries, these gains came at increased cost--twice as much on a per pupil basis relative to public schools. Additional analyses indicate gains made by the lowest income students in the sample help explain the school's impact. This suggests private schools could bring down persistent achievement gaps in these countries, but puts into question the validity of implementation at scale. [This paper is a product of the Education Global Practice.]

Charter schools enroll a growing share of public school students, leading to concerns about the financial implications of charter schools for traditional public schools (TPSs). Using detailed expenditure data for school districts in California, I exploit variation in charter school enrollment across time and between districts to evaluate how district spending and overall financial health change as nearby charter sectors expand. I find that larger charter enrollment shares are associated with lower levels of per-pupil spending and reduced fiscal health in TPSs. However, these relationships in some cases exhibit significant nonlinearities and are much smaller in magnitude than what has been observed in other states. Consequently, larger charter enrollment shares are not associated with differences in the proportion of expenditures allocated to various activities, goods, or services. Differences between these results and those from similar analyses in other states may be explicable in terms of California's economic and policy context, providing lessons for policymakers.

EPortfolios can showcase students' learning progression, achievements, and abilities through the purposeful collection of their work. The implementation of ePortfolios within curricula can also demonstrate institutional accountability and serve as primary evidence for accreditation. The authors explore the current available ePortfolio platforms that are utilized in academic settings. They developed a set of evaluation matrices to review current ePortfolio platforms, consisting of (a) learning activities/goals, (b) competency tracking, (c) collaboration ability, (d) access, (e) user-friendliness, (f) customization, and (g) retrospection/concept mapping. Although no ePortfolio platform satisfies all these criteria completely, each possesses individual advantages that make it uniquely useful in particular academic situations. The authors provide a rubric to guide faculty or administrators when choosing an ePortfolio platform, which considers the platform's purpose and how it will be integrated into existing curricula. [This work is supported by the Academic Innovation Funds sponsored by the Office of Academic Innovation at the University of Michigan.]

Community colleges are a large sector of postsecondary education. In 2016-2017, the United States had nearly 1,000 public 2-year postsecondary institutions (community colleges), serving almost nine million students, representing 39% of all undergraduates. The majority of entering community college students require developmental (or remedial) math. Success rates in the developmental math course sequence and college more broadly are discouragingly low. Policymakers, practitioners, and researchers alike are eagerly searching for reforms to improve success rates, but there is a dearth of causal evidence on the effectiveness of most proposed reforms. We sought to answer the following question: What effect does a modularized, computer-assisted, self-paced approach to developmental math (compared with a more "traditional" direct-instruction course alternative) have on students' likelihood of completing the developmental math course sequence? Findings from a randomized controlled trial (n = 1,403) are presented. The program was well implemented; however, we did not find evidence that this approach was superior to the "traditional" math class. Although these results are disappointing, they are important because modularization and self-paced computer-assisted instruction are popular reforms.

School authorities, universities, and employers often schedule multiple tests on the same day or week, causing overlapping exam preparation and a dense testing schedule. This multitask learning can be intense, under pressure, and challenge the student's mental and physical perseverance. As a result, it can compromise performance relative to a more 'relaxed' schedule. This paper examines the consequences of multitasking for test scores and cheating in exams and its implications for the ability and gender cognitive gap. The empirical context is high-stakes exit exams in Israel, done at the end of high school. I leverage the empirical setting on two natural experiments to estimate the causal effect of this multitasking learning. The first exploits random variation in the number of weekly tests--the second hinges on days with multiple exams versus days with a single exam. The results show several important regularities. First, the number of exams in a day or a week harms test performance. Second, these effects are evidenced for high and low-ability students, boys and girls. They are much more extensive for immigrants than natives. Third, the harm of such multitasking is larger in tests later in the schedule, daily or weekly. Fourth, these effects are larger in tests of STEM subjects. Fifth, dense exams schedule increase the likelihood of students behaving dishonestly in exams.

This paper summarises the evolution of student contributions in Australia since 1989, exploring system redesigns that commenced in 1997, 2005 and 2021. Public and private benefits are recurring themes in setting student contributions, both as high-level justifications for government policy and in pricing specific disciplines. Professor Andrew Norton evaluates five different rationales used by successive Australian governments to satisfy competing policy and political considerations: course costs, private benefits, public benefits, increasing resources per student place, and incentivising course choices. Professor Norton argues that despite using student contributions to guide course choices being central to current funding policy it is never likely to be effective. Student contributions do, however, have practical consequences that seem to be given little consideration by the government. These include how long it takes to repay student debt, how much of that debt the government will eventually write off, and university incentives to enrol students. As the new government reviews the Job-ready Graduates policy, the paper provides a useful basis for discussion, offering lessons from history in what works and what does not, and guiding policymakers towards student contribution systems that minimise problems for students, government and universities.

International students are critical to the competitiveness of American higher education in terms of financial, intercultural, and educational contributions. However, recent data indicates that the U.S institutions enrolled 31,520 fewer international students in Fall 2017 as compared to Fall 2016. At average tuition and fees of US$ 25,000, higher education institutions are likely to lose potential revenue of US$ 788 million for the first year of studies alone. This paper examines the shifting landscape of international enrollment from the lens of three overlapping Waves spread over seven years and takes a deeper dive into implications for American universities. Wave I was shaped by the terrorist attacks in September 2001 and resulted in slower overall growth in international student enrollment of 11% between 1999 and 2006. Wave II has its origins in the global financial crisis which prompted universities to search for self-funded students and experienced overall robust growth of 44 percent in international student enrollment between 2006 and 2013. Finally, Wave III is shaped by the new political order and intensified competition from English-taught programs in Europe and Asia which will slow down the pace of projected growth in international enrollment to 18 percent between 2013 and 2020. In this current Wave of intensified global competition, overall international student enrollment is likely to flatten or decline for most universities. While the reputation and quality of American higher education is admired and emulated around the world, resting on its past laurels will not be sufficient for attracting international students in the Third Wave. This means that universities must get proactive and strategic in reaching, engaging and supporting international students throughout their educational lifecycle. Demand for studying abroad among international students remains robust, however, increasing competition and expectations for value for money will requires proactive and concerted efforts to maintain the global competitiveness of American higher education.

Capitalizing on the findings in our preceding study of a purely theoretical model, this paper aims to empirically examine whether and to what extent public universities' institutional missions have transformed in recent years in the States of California and New York by quantifying a degree of functional diversification of universities. We focus on research funding and productivity, and public service activities, and have developed a Concentration Equality Index (CEI) to help in this analysis. We then apply the CEI over time to a selected group of public university-system campuses within the State University of New York (SUNY) system, the City University of New York (CUNY), and the California State University (CSU) and the University of California (UC) systems. Among our findings: a select group of CSU campuses which all have roles at teaching-intensive schools, have gained increasingly versatile roles with rapidly expanded spending capacity in research and public service. These focal shifts resulted in some CSU campuses transforming into "UC-like universities", that is, a trend toward an institution with multi-functional operations of equally weighted instruction, research, and public service. In contrast, several campuses of both SUNY and CUNY systems have come to place varied weights on chosen missions rather than evening out their roles in instruction, research, and public service.

This report presents the results of RTI International Education's study on teachers' guides across 13 countries and 19 projects. Using quantitative and qualitative methods, we examine how teachers' guides across the projects differ and find substantial variation in the design and structure of the documents. We develop a scripting index so that the scripting levels of the guides can be compared across projects. The impact results of the programs that use teachers' guides show significant impacts on learning outcomes, associated with approximately an additional half year of learning, showing that structured teachers' guides contribute to improved learning outcomes. During observations, we find that teachers make a variety of changes in their classroom instruction from how the guides are written, showing that the utilization of structured teachers' guides do not create robotic teachers unable to use their own professional skills to teach children. Unfortunately, many changes that teachers make reduce the amount of group work and interactivity that was described in the guides, suggesting that programs should encourage teachers to more heavily utilize the instructional routines designed in the guide. The report includes a set of research-based guidelines that material developers can use to develop teachers' guides that will support effective instructional practices and help improve learning outcomes. The key takeaway from the report is that structured teachers' guides improve learning outcomes, but that overly scripted teachers' guides are somewhat less effective than simplified teachers' guides that give specific guidance to the teacher but are not written word for word for each lesson in the guide.