Search

Intersectionality highlights that different aspects of individuals' identities are not independent of each other. Instead, they interact to create unique identities and experiences, which cannot be understood by analysing each identity dimension separately or in isolation from their social and historical contexts. Intersectional approaches in this way question the common classification of individuals into groups (male vs. female, immigrant vs. native etc.), which raises important implications for the policy-making process. In education, analyses with an intersectional lens have the potential to lead to better tailored and more effective policies and interventions related to participation, learning outcomes, students' attitudes towards the future, identification of needs, and socio-emotional well-being. Consequently, as elaborated in this paper, some countries have adjusted their policies in the areas of governance, resourcing, developing capacity, promoting school-level interventions and monitoring, to account for intersectionality. Gaps and challenges related to intersectional approaches are also highlighted.

Principals (policy makers) have debated the progress in U.S. student performance for a half century or more. Informing these conversations, survey agents have administered seven million psychometrically linked tests in math and reading in 160 waves to national probability samples of selected cohorts born between 1954 and 2007. This study is the first to assess consistency of results by agency. We find results vary by agent, but consistent with Flynn effects, gains are larger in math than reading, except for the most recent period. Non-whites progress at a faster pace. Socio-economically disadvantaged white, black, and Hispanic students make greater progress when tested in elementary school, but that advantage attenuates and reverses itself as students age. We discuss potential moderators.

The worldwide school closures in early 2020 led to losses in learning that will not easily be made up for even if schools quickly return to their prior performance levels. These losses will have lasting economic impacts both on the affected students and on each nation unless they are effectively remediated. While the precise learning losses are not yet known, existing research suggests that the students in grades 1-12 affected by the closures might expect some 3 percent lower income over their entire lifetimes. For nations, the lower long-term growth related to such losses might yield an average of 1.5 percent lower annual GDP for the remainder of the century. These economic losses would grow if schools are unable to re-start quickly. The economic losses will be more deeply felt by disadvantaged students. All indications are that students whose families are less able to support out-of-school learning will face larger learning losses than their more advantaged peers, which in turn will translate into deeper losses of lifetime earnings. The present value of the economic losses to nations reach huge proportions. Just returning schools to where they were in 2019 will not avoid such losses. Only making them better can. While a variety of approaches might be attempted, existing research indicates that close attention to the modified re-opening of schools offers strategies that could ameliorate the losses. Specifically, with the expected increase in video-based instruction, matching the skills of the teaching force to the new range of tasks and activities could quickly move schools to heightened performance. Additionally, because the prior disruptions are likely to increase the variations in learning levels within individual classrooms, pivoting to more individualised instruction could leave all students better off as schools resume. As schools move to re-establish their programmes even as the pandemic continues, it is natural to focus considerable attention on the mechanics and logistics of safe re-opening. But the long-term economic impacts also require serious attention, because the losses already suffered demand more than the best of currently considered re-opening approaches.

This paper explores the impact of test-taking conditions on the quality of the Programme for the International Assessment of Adult Competencies (PIAAC) assessment. Interviewers record information about the room of assessment and interruptions that occurred during each interview. These observations, along with information on interviewer assignment size and a careful look at interviewer effects, provide insights into the quality of the assessment. This working paper first describes the variations in test-taking conditions among participating countries. Second, it examines interviewer assignment sizes and the frequency of interruptions, finding that both vary markedly among countries (contrary to the room of assessment). The paper then looks at the relationship between these variations and response rates and engagement measures. While neither the room of assessment nor the recorded interruptions impact quality differences among countries, interviewer assignment size and interviewer effects may have a mild impact on results.

Differences in teacher quality are commonly cited as a key determinant of the huge international student performance gaps. However, convincing evidence on this relationship is still lacking, in part because it is unclear how to measure teacher quality consistently across countries. We use unique international assessment data to investigate the role of teacher cognitive skills as one main dimension of teacher quality in explaining student outcomes. Our main identification strategy exploits exogenous variation in teacher cognitive skills attributable to international differences in relative wages of nonteacher public sector employees. Using student-level test score data, we find that teacher cognitive skills are an important determinant of international differences in student performance. Results are supported by fixed-effects estimation that uses within-country between-subject variation in teacher skills.

Numeracy and literacy skills have become increasingly important in modern labour markets. The large gender differences that several studies have identified have therefore sparked considerable attention among researchers and policy makers. Little is known about the moment in which such gaps emerge, how they evolve and if their evolution differs across countries. We use data from large-scale international assessments to follow representative samples of birth-cohorts over time, and analyse how gender gaps in numeracy and literacy evolve from age 10 to age 27. Our results suggest that, across the countries examined, males' advantage in numeracy is smallest at age 10 and largest at age 27. The growth in magnitude of the gender gap is particularly pronounced between the age of 15 and 27. Such evolution stands in sharp contrast with the evolution of the gender gap in literacy, which is small at age 10, large and in favour of females at age 15, and negligible by age 27.

This study uses the PIAAC data to examine the relationships between education system characteristics (e.g. early tracking and vocational education orientation) and distributions of adult numeracy skills. It also investigates the effects of postponing the tracking age and easing university access for students on a vocational track on the average skills and different percentiles of the skills distribution. Correlational analysis suggests that education systems with more students enrolled in vocational tracks have on average higher levels of numeracy skills and more compressed skills distributions between the 50th and 90th percentiles. Further analysis suggests that postponing the tracking age among 14 European countries does not have a significant effect on the average skills of the population. However, it increases skills for individuals at the 10th, 20th, and 30th percentiles of the skill distribution. Expanding university access is associated with an increase in numeracy skills, particularly for individuals at the bottom three deciles of the distribution.

This paper looks at the importance of mechanisms that give formal recognition to vocational skills acquired through work-based learning and how such mechanisms might be developed. It describes how skill recognition can benefit individuals, employers and society as a whole, and identifies in which contexts skill recognition has the highest potential to bring benefits. The focus is on three tools that are commonly used to shorten the path to a formal qualification: admission into a programme, reduced programme duration and qualification without a mandatory programme. For each of these tools, this paper sets out country approaches, discusses common challenges that arise in their implementation and advances policy messages to support policy design and implementation.

Resilience refers to the capacity of individuals to prosper despite encountering adverse circumstances. This paper defines academic resilience as the ability of 15-year-old students from disadvantaged backgrounds to perform at a certain level in the Programme for International Student Assessment (PISA) in reading, mathematics and science that enables them to play an active role in their communities and prepares them to make the most of lifelong-learning opportunities. Using data from the most recent PISA cycles, this paper explores changes in the share of resilient students over time (2006-2015); highlights the importance of school environments and resources in mitigating the risk of low achievement for disadvantaged students; and identifies school-level factors that are associated with the likelihood of academic resilience among socio-economically disadvantaged students. Analyses reveal that several countries were able to increase the share of resilient students over time, reflecting improvements in the average performance of students, or a weaker relationship between socio-economic status and performance. In the vast majority of education systems examined, the likelihood of academic resilience among disadvantaged students is lower in schools where students report a negative classroom climate. The paper concludes by exploring school policies and practices that are associated with a positive classroom climate. [This work was supported by a contribution to the PISA programme of work from Vodafone Germany Foundation.]

The paper examines between-country differences in the mechanisms through which education could promote generalised trust using data from 29 countries participating in the OECD's Survey of Adult Skills (PIAAC). Results indicate that education is strongly associated with generalised trust and that a large part of this association is mediated by individuals' literacy skills, income and occupational prestige. However, education gradients in levels of generalised trust and in the extent to which they are due to social stratification mechanisms or cognitive skills mechanisms vary across countries. Differences across countries in birthplace diversity and income inequality are correlated with how strongly education is associated with trust in different countries, as well as in the relative magnitude of direct and indirect associations. In particular, the relationship between literacy skills and generalised trust is stronger in the presence of greater birthplace diversity but is weaker in the presence of greater income inequality.

We assess the relationship between general literacy skills and health status by analysing data from the Programme for the International Assessment of Adult Competencies (PIAAC), an international survey of about 250,000 adults aged 16-65 years conducted by the Organisation for Economic Co-operation and Development (OECD) from 2011-15 in 33 countries/national sub-regions. Across countries, there seems to be a strong and consistent association between general literacy proficiency and self-rated poor health, independent of prior socio-economic status and income. General literacy proficiency also appears to be a mediator of the association between self-education and self-rated poor health. While the literacy-health association is robust over time, it varies in magnitude across countries. It is strongest for those with a tertiary or higher degree and does not appear to exist among young adults (ages 25 to 34 years). Future studies are required to understand the contextual factors that modify the general literacy proficiency-health association.

This paper presents a comprehensive analysis of the link between age and proficiency in information-processing skills, based on information drawn from the Survey of Adult Skills (PIAAC). The data reveal significant age-related differences in proficiencies, strongly suggesting that proficiency tends to "naturally" decline with age. Age differences in proficiency are, at first sight, substantial. On average across the OECD countries participating in PIAAC, adults aged 55 to 65 score some 30 points less than adults aged 25 to 34 on the PIAAC literacy scale, which is only slightly smaller than the score point difference between tertiary educated and less-than-upper-secondary educated individuals. However, despite their lower levels of proficiency, older individuals do not seem to suffer in terms of labour market outcomes. In particular, they generally earn higher wages, and much of the available empirical evidence suggests that they are not less productive than younger workers. Older and more experienced individuals seem therefore able to compensate the decline in information processing skills with the development of other skills, generally much more difficult to measure. On the other hand, proficiency in information-processing skills remain a strong determinant of important outcomes at all ages: this makes it important to better understand which factors are the most effective in preventing such age-related decline in proficiency, which does not occur to the same extent in all countries and for all individuals. Two broad interventions seem to be particularly promising in this respect. First, it is important to ensure that there is adequate and effective investment in skills development early in the life-cycle: as skills beget skills, starting off with a higher stock of human capital seems also to ensure smaller rates of proficiency decline. Second, it is equally important that policies are in place that provide incentives to individuals (and firms) to invest in skills across the entire working life. In this respect, changes in retirement policies can not only have the short-term effect of providing some reliefs to public finance, but have the potential to radically reshape incentives to stay active, to practice their skills and to invest more in training, thus helping to maintain high levels of proficiency. One table, Age Differences and Age Effects, is appended.

In this study, we investigated how empirical indicators of test-taking engagement can be defined, empirically validated, and used to describe group differences in the context of the Programme of International Assessment of Adult Competences (PIAAC). The approach was to distinguish between disengaged and engaged response behavior by means of response time thresholds. Constant thresholds of 3000 ms and 5000 ms were considered, as well as item-specific thresholds based on the visual inspection of (bimodal) response time distributions (VI method) and the proportion correct conditional on response time (P+>0% method). Overall, the validity checks comparing the proportion correct of engaged and disengaged response behavior by domain and by item showed that the P+>0% method performed slightly better than the VI method and the methods assuming constant thresholds. The results for Literacy and Numeracy by module revealed that there was an increase from Module 1 to Module 2 in the proportion of disengaged responses, suggesting a drop in test-taking engagement. The investigation of country differences in test-taking engagement by domain using the P+>0% method showed that the proportion of responses classified as disengaged was quite low. For Literacy, the proportion was well below 5% for the majority of countries; in Numeracy, the proportion was even smaller than 1% for almost all countries; while for Problem solving, the proportion of disengaged responses was more than 5% but usually well below 10%. There were significant differences in test-taking engagement between countries; the obtained effect sizes were small to medium. Population differences in test-taking engagement were highly correlated between the three domains, suggesting that test-taking engagement can be conceived as a consistent characteristic. Furthermore, there was a clear negative association between test-taking disengagement and proficiency in Literacy, Numeracy and Problem solving, respectively. Finally, subgroup differences for gender, age, educational attainment, and language proved to be insignificant or very small. Results suggest that males tend to be more disengaged, that disengagement increases with age in Problem solving, with lower educational attainment and when the test language is not the same as a testee's native language. Appended are: (1) Country differences in test-taking engagement; and (2) Subgroup differences in test-taking engagement.

Using the 2012 PIAAC data, our analysis confirms that there are significantly higher earnings and employment returns to "both" increasing levels of formally recognised education, and to increasing levels of numeracy, literacy and information and communication technologies (ICT) skills proficiencies controlling for the level of education. Unsurprisingly, the labour market returns to changes in formally recognised levels of education in general exceed the labour market returns associated with increasing levels of skills proficiency. In the case of literacy and numeracy proficiencies, improved literacy and numeracy skills narrow the labour market outcomes gap between individuals with different levels of formally recognised education, but do not close it completely. The analysis demonstrates more substantial returns to ICT skills. Furthermore, possession of higher levels of ICT skills and lower levels of formally recognised qualification are often associated with higher returns compared to individuals with higher levels of formally recognised education but lower ICT proficiency levels. In other words, ICT skills proficiencies often entirely compensate for lower formally recognised qualifications in the labour market. Contains the following annexes: (1) Country Literacy and Numeracy Profiles; and (2) Demographic Control Variables.

This paper explores the impact of policies and institutions on employment and unemployment of OECD countries in the past decades. Reduced-form unemployment equations, consistent with standard wage setting/price-setting models, are estimated using cross-country/time-series data from 21 OECD countries over the period 1982-2003. In the "average" OECD country, high and long-lasting unemployment benefits, high tax wedges and stringent anticompetitive product market regulation are found to increase aggregate unemployment. By contrast, highly centralised and/or coordinated wage bargaining systems are estimated to reduce unemployment. These findings are robust across specifications, datasets and econometric methods. As policies and institutions affect employment not only via their impact on aggregate unemployment but also through their effects on labour market participation -- particularly for those groups "at the margin" of the labour market, group-specific employment rate equations are also estimated. In the "average" OECD country, high unemployment benefits and high tax wedges are found to be associated with lower employment prospects for all groups studied, namely prime-age males, females, older workers and youths. There is also evidence that group-specific policy determinants matter, such as targeted fiscal incentives. The paper also finds significant evidence of interactions across policies and institutions, as well as between institutions and macroeconomic conditions. Consistent with theory, structural reforms appear to have mutually reinforcing effects: the impact of a given policy reform is greater the more employment-friendly the overall policy and institutional framework. Certain more specific interactions across policies and institutions are found to be particularly robust, notably between unemployment benefits and public spending on active labour market programmes as well as between statutory minimum wages and the tax wedge. Finally, it is shown that macroeconomic conditions also matter for unemployment patterns, with their impact being shaped by policies. (A bibliography is included. Contains 144 footnotes, 9 figures, 3 boxes and 27 tables.)

The contribution of higher education institutions to regional development is a theme that has attracted growing attention in recent years. Knowledge institutions are increasingly expected not only to conduct education and research, but also to play an active role in the economic, social and cultural development of their regions. The extent to which higher education institutions are able to play this role depends on a number of circumstances: the characteristics of the institutions, the regions in which they are located and the policy frameworks are all significant. At the same time, there are signs of more fundamental conceptual and strategic confusion. The discussions in this domain are frequently characterised by slogans and popular metaphors. This literature review was prepared to support the OECD project entitled 'Supporting the Contribution of Higher Education Institutions to Regional Development', which was conducted by the OECD Programme on Institutional Management in Higher Education (IMHE) in collaboration with the Directorate of Public Governance and Territorial Development. Drawing mainly from a selection of European and North American publications, the report takes an overall view on the development of higher education institutions in the regional context. It focuses on the evolution and discourses of higher education and research, the regional aspects of higher education policies, the various functions and roles that the institutions play, measures taken to link the universities with their regional partners, and the conditions which favour or hamper stronger regional engagement. (A bibliography is included. Contains 9 figures.)

Innovation is essential for the education sector. The ways in which curriculum decision making is organised reflects different implicit approaches on how educational systems pertain to promote innovation in education. Curriculum holds an outstanding place when seeking to promote innovation in education, as it reflects the vision for education by indicating knowledge, skills and values to be taught to students. It may express not only "what" should be taught to students, but also "how" the students should be taught. Curriculum innovations can include new subjects, combinations of old subjects or cross-cutting learning objectives. They may also take a form of new content, concepts, sequencing, time allocation or pedagogy. This paper characterises two contrasted approaches to curriculum decision making and bringing about innovations in education. At one extreme, a prescriptive central curriculum implicitly places the initiative for educational innovations at the level of the central administration. This approach provides strong incentives for schools and teachers to adapt innovations that would not otherwise take place. Innovations, supported by policy measures and informed by research, are brought within the reach of all schools and teachers in an equitable manner. The challenge is then to accommodate local needs and ensure the commitment to and implementation of innovations by schools and teachers. At the other extreme, decentralised curriculum decision making provides schools--and perhaps even teachers--with room to create their own educational innovations. This approach allows for experimentation relevant to individual students and local communities. Innovations are meant to spread through horizontal networks of schools and teachers. The challenge is then to provide incentives for individual schools and teachers to innovate or adapt innovations and ensure that they have equal capacity to do so. The paper provides an overview of various possible approaches linking curriculum policy to educational innovation, it shows that OECD countries can mix these approaches and it discusses elements that can affect those innovations in reality. Focusing on public lower-secondary education, it draws on various OECD and UNESCO data. First, the paper suggests that OECD education systems differ clearly when looking at formal curriculum decision making, although no system relies on a purely central or school-based approach to curriculum innovations. Second, several elements can reduce the "innovation power" of the central curriculum and the "innovation flexibility" of the decentralised curriculum. Third, stakeholders--such as experts, teachers and parents--are able to influence curriculum innovations differently at central and school levels. Innovations in central-level curriculum appear to have widespread possibilities to rely on expert knowledge with consultation with practitioners, parents and the wider public. School level curriculum innovations appear to build mainly on principals and teachers' knowledge with an indirect influence from experts and parents. Annexed are: (1) Emerging Curriculum Themes in OECD Countries; (2) Approaches to Bringing About Competence-Based Curriculum; (3) Central Level Curriculum in OECD Countries; (4) Details on the Implicit Approaches to Curriculum Innovations; and (5) Roles of Parents in Decision Making on Education Policy. (Contains 13 tables, 4 charts, 5 boxes and 20 notes.)

This literature review on school choice analyses the impact of choice schemes on students and on school systems focusing on equity. Reviewing the evidence can be difficult, as the literature is often fragmented and inconclusive, and the political importance of this research often results in high-profile attention given to individual studies rather than systemically understanding collected from a larger empirical base (Berends, Cannata and Goldring, 2011). Different political groups use evidence that supports their positions in favour or against school choice, and their positions relative to school choice are largely based on their ideologies, rather than on empirical work and evidence of effectiveness (Levin and Belfield, 2004). This report steps away from the ideological debate and provides research-based evidence on the impact of choice on disadvantaged students and schools. As "only with data on the consequences of different plans for school choice will we be able to reach sensible judgements rooted in experience (Fuller and Elmore, 1996, p. 8)". It uses analysis and statements that are supported empirically and attempts to cover the widest possible scope of research, and provide responses to the key question of how to balance choice with equity considerations. (Contains 7 tables, 4 figures, 5 boxes and 13 footnotes.)

This paper discusses the most relevant issues concerning teacher evaluation in primary and secondary education by reviewing the recent literature and analysing current practices within the OECD countries. First, it provides a conceptual framework highlighting key features of teacher evaluation schemes. In particular, it emphasises the importance of clarifying the purposes of teacher appraisal, whether summative when designed to assure that the practices enhancing student learning are undertaken or formative when conducted for further professional development objectives. It also encompasses the diverse criteria and instruments commonly used to assess teachers as well as the actors generally involved in the process and potential consequences for teachers' professional life. Second, it deals with a number of contentious points, including the question of the use of student outcomes to measure teaching performance, the advantages and drawbacks of different approaches given the purpose emphasised and resource restrictions, the implementation difficulties resulting from different stakeholders' interests and possible ways to overcome these obstacles. Finally, it provides an account of current empirical evidence, pointing out mixed results stemming from difficulties in assessing the effects of such evaluation schemes on teaching quality, teachers' motivation and student learning. It concludes by considering the circumstances under which teacher evaluation systems seem to be more effective, fair and reliable. Developing a comprehensive approach to evaluate teachers is critical to make demands for educational best practice compatible with teachers' appropriation of the process as well as to enhance the decisive attractiveness and recognition of the teaching profession. (Contains 1 table.)

This paper reviews recent measurement work on User-Created Content (UCC) undertaken in OECD countries. It shows that UCC is emerging as a significant area of economic and social activity worthy of consideration for official measurement and discusses the implications for the OECD Model Survey on ICT Access and Use by Households and Individuals. (Study summary and questionnaires are annexed. Contains 10 footnotes, 6 figures and 1 table.)

Do some forms of student (and school) assessment hinder the introduction of innovative educational practices and the development of innovation skills in education systems? This report focuses on the impact of high-stake summative assessment on innovation and argues that it is possible to reconcile high-stakes assessments and examinations through innovative approaches to testing. While necessary, assessment based on high-stake examinations often acts as an incentive to teach or study "to the test". It may thus limit risk-taking by teachers, students and parents, for instance. The problem may be amplified if a system of accountability and incentives uses the results of these examinations and tests to assess teachers and schools. What should be done to ensure that the systems used to assess education systems do not stifle the risk-taking inherent to innovation--and that they foster innovation skills in students? This study proposes three main ways of combining assessment and innovation: 1) developing a wide range of performance measurements for both students and schools; 2) rethinking the alignment of standards and assessment; 3) measuring the impact of assessments on teaching and learning. One way of influencing teaching and learning might be to modify high-stake testing. Systems will adapt to this, and both teaching and learning will focus on acquiring the right skills. Rather than testing the content of learning, standards could relate to cognitive skills such as problem-solving, communicating and reasoning--with test/examination developers adapting those skills to subjects such as mathematics, science or literary analysis. Similarly, more use might be made of innovative assessment methods based on information and communication technologies, inasmuch as these may feature simulation or interactivity, for instance, at a reasonable cost. Focusing the assessment on cognitive processes rather than content would leave more scope for teachers to put in place innovative teaching/learning strategies. This does, however, assume a high standard of professionalism in teachers and an adequate system of continuing training and knowledge management. As a single type of assessment cannot fully capture student learning, one effective strategy might also be to multiply the number of measurements and thus relieve the pressure on students and teachers to perform well in a single, high-visibility, high-stake test. At the same time, this larger number of measurements could provide the necessary input for systems based on accountability, diagnosis and assessment of the effectiveness of innovative practice. Finally, assessing the technical standard of tests and examinations is an integral part of their development, but it is less common to address the impact they have on teaching/learning or the validity of how their results are used. Since assessment is an integral part of the education process, it is just as important to assess tests and examinations as it is other educational practices in order to achieve improvements and innovation in educational assessment, but also in educational practice. (Contains 12 notes.)

School systems aspire to provide equal opportunity for all, irrespective of socio-economic status (SES). Much of the criticism of recent school reforms that introduce accountability, autonomy, and choice emphasizes their potentially negative consequences for equity. This report provides new evidence on how national features of accountability, autonomy, and choice are related to the equality of opportunity across countries. We estimate whether student achievement depends more or less on SES in school systems employing these institutional features. The rigorous micro-econometric analyses are based on the PISA 2003 data for more than 180,000 students from 27 OECD countries. The main empirical result is that rather than harming disadvantaged students, accountability, autonomy, and choice appear to be tides that lift all boats. The additional choice created by public funding for private schools in particular is associated with a strong reduction in the dependence of student achievement on SES. External exit exams have a strong positive effect for all students that is slightly smaller for low-SES students. The positive effect of regularly using subjective teacher ratings to assess students is substantially larger for low-SES students. The effect of many other accountability devices does not differ significantly by student SES. School autonomy in determining course content is associated with higher equality of opportunity, while equality of opportunity is lower in countries where more schools have autonomy in hiring teachers. Autonomy in formulating the budget and in establishing starting salaries is not associated with the equity of student outcomes. Inequality of opportunity is substantially higher in school systems that track students at early ages. (Contains 19 footnotes, 6 figures and 9 tables.)

Using data from the Program for the International Assessment of Adult Competencies, this paper compares the earnings premium and employment share of jobs in Science, Technology, Engineering and Mathematics (STEM) across 11 member countries of the Organisation for Economic Co-operation and Development. The results reveal that the STEM wage premium is higher in the United States than in any of the other comparison countries, despite the fact that the U.S. has a larger share of workers in STEM jobs. We also find evidence that the premium varies significantly across STEM sub-fields and education levels, and that the premium tends to be higher in countries with lower unionization rates, less employment protection, or a larger share of employment in the public sector. [This is the online first version of an article published in "New Horizons in Adult Education and Human Resource Development."]

This report presents data on peer-reviewed S&E journals and conference proceedings reflecting the rapidly expanding volume of research activity, the involvement and scientific capabilities different countries, and the expanding research ecosystem demonstrated through international collaborations. Publication output grew about 4% annually over the past 10 years. China and India grew more than the world average, while the United States and European Union grew less than the world average. Research papers from the United States and EU countries had higher impact scores. International collaborations have increased over the past 10 years. [SRI International, Center for Innovation Strategy and Policy assisted with report preparation.]

Automation and advanced technologies have increased the need for a better understanding of the skills necessary to have a globally competitive workforce. This study used data from the Program for the International Assessment of Adult Competencies to compare problem solving skills in technology rich environments among adults in South Korea, Germany, Singapore, Japan, Canada, Estonia, the United Kingdom, the United States, and Australia. Overall, the United States had the lowest scores among all countries, and in all countries scores declined with age. The United States had higher proportions of survey participants in the lowest skill category and lower proportions in the top skill categories. The results of this study suggest changes in the United States educational and lifelong learning systems and policies may be necessary to ensure all adults have the necessary skills in a competitive workforce. [The paper will be published in "Adult Learning".]