Search

Principals (policy makers) have debated the progress in U.S. student performance for a half century or more. Informing these conversations, survey agents have administered seven million psychometrically linked tests in math and reading in 160 waves to national probability samples of selected cohorts born between 1954 and 2007. This study is the first to assess consistency of results by agency. We find results vary by agent, but consistent with Flynn effects, gains are larger in math than reading, except for the most recent period. Non-whites progress at a faster pace. Socio-economically disadvantaged white, black, and Hispanic students make greater progress when tested in elementary school, but that advantage attenuates and reverses itself as students age. We discuss potential moderators.

The worldwide school closures in early 2020 led to losses in learning that will not easily be made up for even if schools quickly return to their prior performance levels. These losses will have lasting economic impacts both on the affected students and on each nation unless they are effectively remediated. While the precise learning losses are not yet known, existing research suggests that the students in grades 1-12 affected by the closures might expect some 3 percent lower income over their entire lifetimes. For nations, the lower long-term growth related to such losses might yield an average of 1.5 percent lower annual GDP for the remainder of the century. These economic losses would grow if schools are unable to re-start quickly. The economic losses will be more deeply felt by disadvantaged students. All indications are that students whose families are less able to support out-of-school learning will face larger learning losses than their more advantaged peers, which in turn will translate into deeper losses of lifetime earnings. The present value of the economic losses to nations reach huge proportions. Just returning schools to where they were in 2019 will not avoid such losses. Only making them better can. While a variety of approaches might be attempted, existing research indicates that close attention to the modified re-opening of schools offers strategies that could ameliorate the losses. Specifically, with the expected increase in video-based instruction, matching the skills of the teaching force to the new range of tasks and activities could quickly move schools to heightened performance. Additionally, because the prior disruptions are likely to increase the variations in learning levels within individual classrooms, pivoting to more individualised instruction could leave all students better off as schools resume. As schools move to re-establish their programmes even as the pandemic continues, it is natural to focus considerable attention on the mechanics and logistics of safe re-opening. But the long-term economic impacts also require serious attention, because the losses already suffered demand more than the best of currently considered re-opening approaches.

This paper explores the impact of test-taking conditions on the quality of the Programme for the International Assessment of Adult Competencies (PIAAC) assessment. Interviewers record information about the room of assessment and interruptions that occurred during each interview. These observations, along with information on interviewer assignment size and a careful look at interviewer effects, provide insights into the quality of the assessment. This working paper first describes the variations in test-taking conditions among participating countries. Second, it examines interviewer assignment sizes and the frequency of interruptions, finding that both vary markedly among countries (contrary to the room of assessment). The paper then looks at the relationship between these variations and response rates and engagement measures. While neither the room of assessment nor the recorded interruptions impact quality differences among countries, interviewer assignment size and interviewer effects may have a mild impact on results.

Differences in teacher quality are commonly cited as a key determinant of the huge international student performance gaps. However, convincing evidence on this relationship is still lacking, in part because it is unclear how to measure teacher quality consistently across countries. We use unique international assessment data to investigate the role of teacher cognitive skills as one main dimension of teacher quality in explaining student outcomes. Our main identification strategy exploits exogenous variation in teacher cognitive skills attributable to international differences in relative wages of nonteacher public sector employees. Using student-level test score data, we find that teacher cognitive skills are an important determinant of international differences in student performance. Results are supported by fixed-effects estimation that uses within-country between-subject variation in teacher skills.

Numeracy and literacy skills have become increasingly important in modern labour markets. The large gender differences that several studies have identified have therefore sparked considerable attention among researchers and policy makers. Little is known about the moment in which such gaps emerge, how they evolve and if their evolution differs across countries. We use data from large-scale international assessments to follow representative samples of birth-cohorts over time, and analyse how gender gaps in numeracy and literacy evolve from age 10 to age 27. Our results suggest that, across the countries examined, males' advantage in numeracy is smallest at age 10 and largest at age 27. The growth in magnitude of the gender gap is particularly pronounced between the age of 15 and 27. Such evolution stands in sharp contrast with the evolution of the gender gap in literacy, which is small at age 10, large and in favour of females at age 15, and negligible by age 27.

We assess the relationship between general literacy skills and health status by analysing data from the Programme for the International Assessment of Adult Competencies (PIAAC), an international survey of about 250,000 adults aged 16-65 years conducted by the Organisation for Economic Co-operation and Development (OECD) from 2011-15 in 33 countries/national sub-regions. Across countries, there seems to be a strong and consistent association between general literacy proficiency and self-rated poor health, independent of prior socio-economic status and income. General literacy proficiency also appears to be a mediator of the association between self-education and self-rated poor health. While the literacy-health association is robust over time, it varies in magnitude across countries. It is strongest for those with a tertiary or higher degree and does not appear to exist among young adults (ages 25 to 34 years). Future studies are required to understand the contextual factors that modify the general literacy proficiency-health association.

In this study, we investigated how empirical indicators of test-taking engagement can be defined, empirically validated, and used to describe group differences in the context of the Programme of International Assessment of Adult Competences (PIAAC). The approach was to distinguish between disengaged and engaged response behavior by means of response time thresholds. Constant thresholds of 3000 ms and 5000 ms were considered, as well as item-specific thresholds based on the visual inspection of (bimodal) response time distributions (VI method) and the proportion correct conditional on response time (P+>0% method). Overall, the validity checks comparing the proportion correct of engaged and disengaged response behavior by domain and by item showed that the P+>0% method performed slightly better than the VI method and the methods assuming constant thresholds. The results for Literacy and Numeracy by module revealed that there was an increase from Module 1 to Module 2 in the proportion of disengaged responses, suggesting a drop in test-taking engagement. The investigation of country differences in test-taking engagement by domain using the P+>0% method showed that the proportion of responses classified as disengaged was quite low. For Literacy, the proportion was well below 5% for the majority of countries; in Numeracy, the proportion was even smaller than 1% for almost all countries; while for Problem solving, the proportion of disengaged responses was more than 5% but usually well below 10%. There were significant differences in test-taking engagement between countries; the obtained effect sizes were small to medium. Population differences in test-taking engagement were highly correlated between the three domains, suggesting that test-taking engagement can be conceived as a consistent characteristic. Furthermore, there was a clear negative association between test-taking disengagement and proficiency in Literacy, Numeracy and Problem solving, respectively. Finally, subgroup differences for gender, age, educational attainment, and language proved to be insignificant or very small. Results suggest that males tend to be more disengaged, that disengagement increases with age in Problem solving, with lower educational attainment and when the test language is not the same as a testee's native language. Appended are: (1) Country differences in test-taking engagement; and (2) Subgroup differences in test-taking engagement.

Using the 2012 PIAAC data, our analysis confirms that there are significantly higher earnings and employment returns to "both" increasing levels of formally recognised education, and to increasing levels of numeracy, literacy and information and communication technologies (ICT) skills proficiencies controlling for the level of education. Unsurprisingly, the labour market returns to changes in formally recognised levels of education in general exceed the labour market returns associated with increasing levels of skills proficiency. In the case of literacy and numeracy proficiencies, improved literacy and numeracy skills narrow the labour market outcomes gap between individuals with different levels of formally recognised education, but do not close it completely. The analysis demonstrates more substantial returns to ICT skills. Furthermore, possession of higher levels of ICT skills and lower levels of formally recognised qualification are often associated with higher returns compared to individuals with higher levels of formally recognised education but lower ICT proficiency levels. In other words, ICT skills proficiencies often entirely compensate for lower formally recognised qualifications in the labour market. Contains the following annexes: (1) Country Literacy and Numeracy Profiles; and (2) Demographic Control Variables.

This report presents data on peer-reviewed S&E journals and conference proceedings reflecting the rapidly expanding volume of research activity, the involvement and scientific capabilities different countries, and the expanding research ecosystem demonstrated through international collaborations. Publication output grew about 4% annually over the past 10 years. China and India grew more than the world average, while the United States and European Union grew less than the world average. Research papers from the United States and EU countries had higher impact scores. International collaborations have increased over the past 10 years. [SRI International, Center for Innovation Strategy and Policy assisted with report preparation.]

In this brief, authors Michael Ettlinger, Jordan Hensley, and Julia Vieira analyze how much the governments of different countries spend, and on what, to illuminate the range of fiscal policy options available and provide a basis for determining which approaches work best. They report that the United States ranks twenty-fourth in government spending as a share of GDP out of twenty-nine countries for which recent comparable data are available. The key determinant of where countries rank in overall government spending is the amount spent on social protection. The United States ranks last in spending on social protection as a share of GDP and twenty-second in per capita spending. The United States ranks at or near the top in military, health care, education, and law enforcement spending. Measuring government spending by different methods and including tax expenditures does not appear to significantly alter the conclusion that the United States is a low-tax, low-spending country relative to the other countries examined, particularly when compared to its fellow higher-income countries. [This paper is an evolution of a previous work, "Comparing Public Spending and Priorities Across OECD Countries" (ED606844).]

Early childhood education and school readiness is essential to preparing children to succeed in an increasingly competitive global economy. Compared to other countries, however, the United States lags far behind on preschool, trailing a number of other countries in enrollment, investment, and quality. In February 2013, however, President Barack Obama put forth a bold plan to significantly expand access to preschool. His plan would invest $75 billion in high-quality preschool, helping the nation catch up with other countries. On almost every element (preschool participation, typical age children begin early-childhood programs, teacher-to-child ratio in early childhood-education programs, and total investment in early childhood-education programs) the United States ranks behind most of the other countries in the Organisation for Economic Co-operation and Development, or OECD. This paper shows how far behind the United States is on preschool, making it evident that the president's plan needs to be implemented. Each of these elements is explored and compared with other countries' numbers. If the United States is to train a world-class workforce, it is imperative that it catches up to the rest of the world on pre-K.