Search

This report presents the findings of the 2023 EUA Learning & Teaching Thematic Peer Group "Development and strategic benefits of learning and teaching centres", beginning with a presentation of the centres represented in the group and proceeding by presenting a virtuous cycle model for the continuous advancement of centres. Recommendations accompany each of the model's elements and, where possible, are illustrated through real-world practices.

This synthesis report is based on a survey carried out during 2022 with Cedefop's reporting network ReferNet. It makes an important contribution to understanding the magnitude of early leaving from VET (ELVET) in those European countries where relevant data are available, and the mechanisms and support measures countries employ to measure and monitor the phenomenon at national and regional levels. The report puts special focus on the main factors leading to early leaving from initial VET as reported by EU Member States, Norway and Iceland. It details the support measures teachers, trainers, school principals and companies providing work-based learning received to overcome the challenges society faced due to the COVID-19 pandemic and the war in Ukraine. This research is part of Cedefop's pioneering work within the VET for youth team to support policy-makers and VET practitioners tackling early leaving from VET in Europe. For more than a decade, Cedefop has led research, promoted peer learning through its policy learning fora, and developed and managed online toolkits to benefit learners at risk of dropping out, early leavers from VET and young NEETs. The VET toolkit for tackling early leaving and the VET toolkit for empowering NEETs offer a platform of intervention approaches, good practices and interactive tools designed for both policy-makers and VET teachers and trainers. The community of ambassadors tackling early leaving from VET, created and coordinated by Cedefop since 2017, plays a vital role in enriching and disseminating the toolkit resources. The findings of this survey feed into Cedefop's project on Tackling early leaving from VET. It aims to support EU Member States and the European Commission in the implementation of the Council recommendation on pathways to school success (Council of the European Union, 2022) and the achievement of Education and training 2030 strategic target to lower the rates of early leaving from education and training (Council of the European Union, 2021).

European higher education institutions (HEIs) are facing increasing demands for more flexible learning and flexibility in learning paths. This report from a 2023 European University Association Learning & Teaching Thematic Peer Group on "Flexible learning and teaching" explores the complexity of implementing flexible learning at HEIs, starting by defining what it means and entails for the institution, and its members and entities (staff, students, leadership, faculties). With the view that the development of flexible learning is an essential condition for the future of learning at universities, the group identified challenges and examples of practice, and offered recommendations for institutions to reflect on their strategy and build capacity for flexible learning.

Intersectionality highlights that different aspects of individuals' identities are not independent of each other. Instead, they interact to create unique identities and experiences, which cannot be understood by analysing each identity dimension separately or in isolation from their social and historical contexts. Intersectional approaches in this way question the common classification of individuals into groups (male vs. female, immigrant vs. native etc.), which raises important implications for the policy-making process. In education, analyses with an intersectional lens have the potential to lead to better tailored and more effective policies and interventions related to participation, learning outcomes, students' attitudes towards the future, identification of needs, and socio-emotional well-being. Consequently, as elaborated in this paper, some countries have adjusted their policies in the areas of governance, resourcing, developing capacity, promoting school-level interventions and monitoring, to account for intersectionality. Gaps and challenges related to intersectional approaches are also highlighted.

Module A of the OECD Higher Education Policy Survey (HEPS) 2022 elicited information on policies to promote digitalisation of higher education in OECD member and accession countries. In total, 30 jurisdictions responded, providing comparative information on various areas of digitalisation policy, from regulation and governance to financial and human resources. The survey results provide insight into the role of public authorities in guiding, coordinating and resourcing the digital transformation of higher education institutions. The analysis and comparative tables in this working paper provide insights that can support the development of strategic digitalisation policies.

Calls for increased monitoring and evaluation of education policies and practices have not, so far, included widespread and consistent assessments of the inclusiveness of education settings. Measuring inclusion in education has proven to be a challenging exercise, due not only to the complexity and different uses of the concept, but also to its holistic nature. Indeed, measuring inclusion implies analysing a variety of policy areas within education systems, while also considering the different roles of the system, the school and the classroom. This paper discusses the application of the input-process-outcome model to the measurement of inclusion in education, and key indicators that can be adopted by education systems and schools to this end. It makes considerations relevant to policy makers when designing indicators to measure inclusion, such as the extent of their application, the constraints related to data disaggregation and the relevance of intersectional approaches to inclusion.

This research paper is one in a series produced as part of the Cedefop project The changing nature and role of VET (2016-18). The aim of the paper is to provide an overview of how CVET is conceptualised in various international level policy documents and how it is referred to across countries. It discusses national conceptions of CVET, the providers, participation by IVET graduates in non-formal education and training (NFE), and participation of adults in VET education institutions in European Union Member States, Iceland and Norway. The paper describes how the provision of CVET by different types of provider has changed over the past two decades, discussing the main drivers of this change and speculating about possible future trends. One of the main findings is that there are many dominant conceptions of CVET across Europe and the use of this term is not consistent, sometimes not even within countries. [The research was carried out by a consortium led by 3s Unternehmensberatung GmbH, led by Dr Jorg Markowitch; the consortium includes the Danish Technological Institute, the Institute of Employment Research (University of Warwick), the Institute of International and Social Studies (Tallinn University) and Fondazione Giacomo Brodolini. The Federal Institute for Vocational Education and Training (BIBB) in Germany is supporting the project as a subcontractor.]

The OECD Future of Education and Skills 2030 (E2030) project's overall goal is that of looking to the future in terms of how school curricula should evolve given the technological advances and other changes that societies are now facing. Towards that end, the E2030 project centres on the idea that education needs to equip students with the knowledge, skills, attitudes and values they need to become active, responsible and engaged citizens. Mathematics is considered a highly relevant subject for achieving the above stated goals, as such it requires further and more detailed analysis. As a result, it has been chosen as one of the E2030 project's subject-specific analyses. The project has been named the Mathematics Curriculum Document Analysis (MCDA) study as per the request of participating countries. This working paper presents the findings of the MCDA study, which involves participants from 19 countries and jurisdictions.

Across OECD countries, the increasing demand for evidence-based policy making has further led governments to design policies jointly with clear measurable objectives, and to define relevant indicators to monitor their achievement. This paper discusses the importance of such indicators in supporting the implementation of education policies. Building on the OECD education policy implementation framework, the paper reviews the role of indicators along each of the dimensions of the framework, namely smart policy design, inclusive stakeholder engagement, and conducive environment. It draws some lessons to improve the contribution of indicators to the implementation of education policies, while taking into account some of their perennial challenges pertaining to the unintended effects of accountability. This paper aims to provide insights to policy makers and various education stakeholders, to initiate a discussion on the use and misuse of indicators in education, and to guide future actions towards a better contribution of indicators to education policy implementation.

This paper quantifies the learning gain that accrues to 15-year-old students over one year of schooling in 18 countries and economies, where the cohort eligible to sit the OECD Programme for International Student Assessment (PISA)ISA test overlaps with two distinct school cohorts. School-entry regulations are used as an exogenous source of variation for grade levels in an instrumental- variables framework. The focus on the joint effect of schooling and age, together with (local) linearity assumptions, make it possible to account for differences in school-starting age across students who are expected to be in different grades. On average, students' test scores increase by about one-fifth of a standard deviation over a school year. While estimates of the grade gain for individual countries and economies come with wide confidence intervals, this study also shows the annual learning gain of students around the age of 15 tends to be larger in high-income countries compared to middle-income countries.

This research paper is the fifth in a series produced as part of the Cedefop project The changing nature and role of VET (2016-18). Based on comparative analysis of labour force survey data from 2014, the report analyses the vocational effect on labour market and education outcomes, asking whether any advantages conferred by vocational qualifications in early career would be offset by disadvantages later in life. The report explores the functioning of the safety net and the diversion effects across countries, demonstrating how these vary considerably with the specific institutional structure of schooling and work-based training. The results indicate that VET graduates are potentially sacrificing the longer-term gains associated with further education in favour of short-term benefits. [This research was carried out by a consortium led by 3s Unternehmensberatung GmbH and including the Danish Technological Institute, the Institute of Employment Research (University of Warwick), the Institute of International and Social Studies (Tallinn University) and Fondazione Giacomo Brodolini. The Federal Institute for Vocational Education and Training (BIBB) in Germany is supporting the project as a subcontractor.]

In a highly competitive global landscape, occupations are transformed, new jobs are created and the skills needed for the labour market are constantly changing. European countries are looking at redefining VET [vocational education and training] to respond promptly to such challenges and take advantage of the opportunities ahead. They are reforming to modernise their VET systems and strengthen the relevance of their national qualifications in an international context. This publication explores national responses to globalisation in 15 countries and five economic sectors. It aims to understand how European and international initiatives help VET renewal across Europe. It shows how countries' reactions are embedded in their national traditions but also depend on their interactions with European, sectoral and multinational players that provide training and award qualifications. [The research was carried out by a consortium led by IBE Educational research institute and 3s Unternehmensberatung GmbH.]

Countries consider curriculum reform as an important and necessary measure to make schools enter the 21st century and respond to a fast-changing world. In recent years, many OECD countries have engaged in curriculum reform as a way to equip children with the knowledge, skills and competences needed for tomorrow. However, how to initiate such change in the most suitable and effective way remains somewhat challenging. In other words, there is a missing step between the intention, and the realisation of this curriculum renewal, crystallising what has been coined in the literature "the implementation gap". This paper analyses the curriculum reform literature through the lens of the OECD proposed implementation framework that promotes, among others, inclusive stakeholder engagement. Curriculum reform has indeed long been considered from a "top-down" perspective, but has progressively shifted towards a more "bottom-up" approach, emphasising the central role of teachers in the process. The analysis is enriched with successful practices and examples from different countries, and concludes with a specific resource for countries to make the lessons learned actionable through the planning of a coherent curriculum implementation strategy.

Governments recognise that careers guidance, underpinned by accurate labour market information, can help learners make post-secondary education choices that match their interests, aptitudes and abilities, and lead to rewarding employment. For this reason, they have invested in building linked education/employment information systems and other information resources which are displayed on websites targeted to learners and their families. However, researchers and governments agree that these efforts are often ineffective in informing learners' decisions -- access to information is not sufficient to provide effective support to student choice. Drawing upon the insights of behavioural economics, this paper examines how learners access and use information, and what this implies for the design of public study and career choice websites that aim to effectively support student choice. The report also takes stock of the career guidance websites in use in the majority of OECD countries, and sets out to provide actionable advice for policy makers to guide the design of effective information policy levers that support student choice.

The worldwide school closures in early 2020 led to losses in learning that will not easily be made up for even if schools quickly return to their prior performance levels. These losses will have lasting economic impacts both on the affected students and on each nation unless they are effectively remediated. While the precise learning losses are not yet known, existing research suggests that the students in grades 1-12 affected by the closures might expect some 3 percent lower income over their entire lifetimes. For nations, the lower long-term growth related to such losses might yield an average of 1.5 percent lower annual GDP for the remainder of the century. These economic losses would grow if schools are unable to re-start quickly. The economic losses will be more deeply felt by disadvantaged students. All indications are that students whose families are less able to support out-of-school learning will face larger learning losses than their more advantaged peers, which in turn will translate into deeper losses of lifetime earnings. The present value of the economic losses to nations reach huge proportions. Just returning schools to where they were in 2019 will not avoid such losses. Only making them better can. While a variety of approaches might be attempted, existing research indicates that close attention to the modified re-opening of schools offers strategies that could ameliorate the losses. Specifically, with the expected increase in video-based instruction, matching the skills of the teaching force to the new range of tasks and activities could quickly move schools to heightened performance. Additionally, because the prior disruptions are likely to increase the variations in learning levels within individual classrooms, pivoting to more individualised instruction could leave all students better off as schools resume. As schools move to re-establish their programmes even as the pandemic continues, it is natural to focus considerable attention on the mechanics and logistics of safe re-opening. But the long-term economic impacts also require serious attention, because the losses already suffered demand more than the best of currently considered re-opening approaches.

Are teachers and principals aligned in their perceptions of the core components of the theory of Leadership for Learning across countries, or are there subgroups of schools in which there is misalignment? The purpose of this study is to examine the extent to which a congruency-typology model of leadership for learning is distributed across countries/economies using the TALIS 2018 dataset through examining the interaction of significantly different subgroups of teacher and principal responders through using multilevel latent class analysis (LCA) with a cross-level interaction. I analyse data from lower secondary schools of n=152 635 teachers in 9 079 schools and their principals across 47 countries/economies. Currently in the research literature on school leadership, leadership for learning has emerged as a framework to bring together managerial, transformational, distributed, and instructional leadership. Yet little is known about leadership for learning across national contexts. This study 1) maps the TALIS 2018 survey items to the current literature and surveys for leadership for learning, 2) then details the methods and analysis framework to examine if there are multiple significantly different types of teachers, principals, and schools from a leadership for learning theory framework. The final model 3) identifies a three-group teacher typology and a three-group principal typology, linking these types to school context, covariates, as well as teacher and principal training and experience. Results relate directly to the intersection of research, policy, and practice for training and capacity of school leaders across 47 countries/economies globally.

The recent refugee crisis has put many Organisation for Economic Cooperation and Development (OECD) countries under considerable pressure to accommodate and integrate large numbers of refugees. Refugee students are a particularly vulnerable group due to their forced displacement, but their needs are not always met by education systems, which can hinder the integration potential of these students. This poses considerable challenges as the integration of refugee students in education systems is important for their academic outcomes as well as their social and emotional well-being. The success (or lack of) integration in schools can also affect the future labour market and social integration potential of these children and youth. While there is a growing body of research on the integration of immigrants, policy-relevant research on refugee children and youth from an educational perspective is rather limited, fragmented and case specific. Detailed surveys and research projects focusing on the current wave of refugees that allow for cross-country comparisons are not yet available. Drawing on research from previous refugee waves, the paper examines key needs of refugee students and factors that promote their integration. It proposes a holistic model of integration in education that responds to the learning, social and emotional needs of refugee students. Furthermore, the paper examines what type of policies and practices are in place in OECD countries that support the integration of refugee students. Nonetheless, evaluations of practices and policies are often missing, which makes it difficult to assess whether they are successful. The paper finishes with some policy pointers on how to promote the integration of refugee students.

This study addresses qualifications at level 5 of the European qualifications framework (EQF) in 15 countries (Belgium (Flanders), the Czech Republic, Denmark, Estonia, Ireland, France, Croatia, Latvia, Lithuania, Luxembourg, Malta, the Netherlands, Austria, Portugal, the United Kingdom (EWNI and Scotland) that had linked their national qualification levels to the EQF by June 2012. EQF level 5 qualifications play an important role in providing access to employment and career advancement as well as enabling further learning and progression to higher education. This double function makes them attractive to learners and employers. Although the extent to which countries use qualifications at EQF level 5 differs, their importance is growing in all countries investigated for several reasons. First, they are developed as response to increased needs for advanced technical and/or management skills. Second, they seem to be especially attractive to students with VET background and those already in employment. They also contribute to lifelong learning by being accessible and attractive for adults and non-traditional learners. The following are appended: (1) List of working definitions; (2) List of interviewees; (3) Available data on EQF level 5 qualifications; (4) Key purposes and functions of qualifications; (5) Further material on learning outcome descriptions of qualifications; and (6) Duration and mode of delivery. A bibliography is also included. [The research was carried out by Panteia in consortium with 3S under Cedefop service contract AO/ECVL/JBSPEV/Qualifications_EQF_level_5/001/12.]

Differences in teacher quality are commonly cited as a key determinant of the huge international student performance gaps. However, convincing evidence on this relationship is still lacking, in part because it is unclear how to measure teacher quality consistently across countries. We use unique international assessment data to investigate the role of teacher cognitive skills as one main dimension of teacher quality in explaining student outcomes. Our main identification strategy exploits exogenous variation in teacher cognitive skills attributable to international differences in relative wages of nonteacher public sector employees. Using student-level test score data, we find that teacher cognitive skills are an important determinant of international differences in student performance. Results are supported by fixed-effects estimation that uses within-country between-subject variation in teacher skills.

A strong VET system is increasingly seen as essential to overcoming the current economic crisis in Europe. VET is seen as a powerful tool to assist in balancing labour market inefficiencies, increasing youth employment possibilities, and reducing skills mismatch. Its inherent flexibility and closeness to the labour market place VET in a good position to contribute to a faster economic recovery and long-term sustainable development. However, crucial for this role is continuous and systematic VET renewal that assures its relevance for the labour market. This publication explores 15 European national approaches to feedback mechanisms between VET and the labour market. It illustrates the diversity of solutions currently applied across Europe and how they are embedded in national traditions and education philosophy. The study asks three fundamental questions: how inclusive are national mechanisms for feedback between the VET system and the labour market; how responsive are existing mechanisms; and how transparent? Three annexes provide: (1) Case Studies; (2) List of interviewees; and (3) List of experts responsible for the country overviews. Bibliography and references are included. [This paper is the result of a team effort reflecting the work of a research consortium led by Jörg Markowitsch from 3s Research Laboratory who together with Tanja Bacher, Carol Costley, David Etherington, Gerhard Geiger, Günter Hefler, Jelena Helemäe, Triin Roosalu, Ellu Saar, Auni Tamm, and Odd Bjørn Ure conducted the research and fieldwork and drafted the report. This work was carried out under Cedefop's service contract No 2011-0161/AO/ECVL/JB-IPS/Cooperation Labour market--VET/007/11.]

This paper explores the impact of test-taking conditions on the quality of the Programme for the International Assessment of Adult Competencies (PIAAC) assessment. Interviewers record information about the room of assessment and interruptions that occurred during each interview. These observations, along with information on interviewer assignment size and a careful look at interviewer effects, provide insights into the quality of the assessment. This working paper first describes the variations in test-taking conditions among participating countries. Second, it examines interviewer assignment sizes and the frequency of interruptions, finding that both vary markedly among countries (contrary to the room of assessment). The paper then looks at the relationship between these variations and response rates and engagement measures. While neither the room of assessment nor the recorded interruptions impact quality differences among countries, interviewer assignment size and interviewer effects may have a mild impact on results.

This paper looks at the importance of mechanisms that give formal recognition to vocational skills acquired through work-based learning and how such mechanisms might be developed. It describes how skill recognition can benefit individuals, employers and society as a whole, and identifies in which contexts skill recognition has the highest potential to bring benefits. The focus is on three tools that are commonly used to shorten the path to a formal qualification: admission into a programme, reduced programme duration and qualification without a mandatory programme. For each of these tools, this paper sets out country approaches, discusses common challenges that arise in their implementation and advances policy messages to support policy design and implementation.

This paper reviews evidence on the interplay between professional standards for teachers, the content of teacher education and educational sciences, and provides three case studies to illustrate these interactions from Estonia, Australia and Singapore. In particular, it investigates what aligning teacher education programmes to standards really mean; and what conception of educational sciences is reflected in the standards and the curriculum. Analyses suggest that alignment, as an explicit, direct and consistent correspondence, is difficult to achieve, in part due to different conceptualisations of professional knowledge. However, this paper argues that the main value of standards as policy tools lies in their capacity to create mutual dialogue between different artefacts (standards' requirements, curriculum, course descriptions, accreditation standards, etc.), as well as among stakeholders. Regularly renegotiating the standards as a result of such dialogue and reflections should be a crucial part of the policy process.

This study uses the PIAAC data to examine the relationships between education system characteristics (e.g. early tracking and vocational education orientation) and distributions of adult numeracy skills. It also investigates the effects of postponing the tracking age and easing university access for students on a vocational track on the average skills and different percentiles of the skills distribution. Correlational analysis suggests that education systems with more students enrolled in vocational tracks have on average higher levels of numeracy skills and more compressed skills distributions between the 50th and 90th percentiles. Further analysis suggests that postponing the tracking age among 14 European countries does not have a significant effect on the average skills of the population. However, it increases skills for individuals at the 10th, 20th, and 30th percentiles of the skill distribution. Expanding university access is associated with an increase in numeracy skills, particularly for individuals at the bottom three deciles of the distribution.

Resilience refers to the capacity of individuals to prosper despite encountering adverse circumstances. This paper defines academic resilience as the ability of 15-year-old students from disadvantaged backgrounds to perform at a certain level in the Programme for International Student Assessment (PISA) in reading, mathematics and science that enables them to play an active role in their communities and prepares them to make the most of lifelong-learning opportunities. Using data from the most recent PISA cycles, this paper explores changes in the share of resilient students over time (2006-2015); highlights the importance of school environments and resources in mitigating the risk of low achievement for disadvantaged students; and identifies school-level factors that are associated with the likelihood of academic resilience among socio-economically disadvantaged students. Analyses reveal that several countries were able to increase the share of resilient students over time, reflecting improvements in the average performance of students, or a weaker relationship between socio-economic status and performance. In the vast majority of education systems examined, the likelihood of academic resilience among disadvantaged students is lower in schools where students report a negative classroom climate. The paper concludes by exploring school policies and practices that are associated with a positive classroom climate. [This work was supported by a contribution to the PISA programme of work from Vodafone Germany Foundation.]

The paper examines between-country differences in the mechanisms through which education could promote generalised trust using data from 29 countries participating in the OECD's Survey of Adult Skills (PIAAC). Results indicate that education is strongly associated with generalised trust and that a large part of this association is mediated by individuals' literacy skills, income and occupational prestige. However, education gradients in levels of generalised trust and in the extent to which they are due to social stratification mechanisms or cognitive skills mechanisms vary across countries. Differences across countries in birthplace diversity and income inequality are correlated with how strongly education is associated with trust in different countries, as well as in the relative magnitude of direct and indirect associations. In particular, the relationship between literacy skills and generalised trust is stronger in the presence of greater birthplace diversity but is weaker in the presence of greater income inequality.

We assess the relationship between general literacy skills and health status by analysing data from the Programme for the International Assessment of Adult Competencies (PIAAC), an international survey of about 250,000 adults aged 16-65 years conducted by the Organisation for Economic Co-operation and Development (OECD) from 2011-15 in 33 countries/national sub-regions. Across countries, there seems to be a strong and consistent association between general literacy proficiency and self-rated poor health, independent of prior socio-economic status and income. General literacy proficiency also appears to be a mediator of the association between self-education and self-rated poor health. While the literacy-health association is robust over time, it varies in magnitude across countries. It is strongest for those with a tertiary or higher degree and does not appear to exist among young adults (ages 25 to 34 years). Future studies are required to understand the contextual factors that modify the general literacy proficiency-health association.

What is the nature of teachers' pedagogical knowledge? The Innovative Teaching for Effective Learning Teacher Knowledge Survey (ITEL TKS) set out to answer this question in a pilot study that ran in five countries: Estonia, Greece, Hungary Israel, and the Slovak Republic. Using convenience samples, the pilot assessed the pedagogical knowledge base of teachers, teacher candidates and teacher educators. Pedagogical knowledge was broken down into the domains of assessment, instructional processes and learning processes. The link between teachers' knowledge and characteristics of teacher education systems, opportunities to learn and motivational characteristics was also examined. The ITEL TKS pilot demonstrated the feasibility of researching teachers' pedagogical knowledge profiles across countries, and validated an innovative instrument for assessing general pedagogical knowledge in an internationally comparative way. It also allowed for reflection on potential adaptations to strengthen the design of future work. The results serve as a template for a larger-scale study to explore teacher knowledge and competences in nationally representative samples.

This paper presents a comprehensive analysis of the link between age and proficiency in information-processing skills, based on information drawn from the Survey of Adult Skills (PIAAC). The data reveal significant age-related differences in proficiencies, strongly suggesting that proficiency tends to "naturally" decline with age. Age differences in proficiency are, at first sight, substantial. On average across the OECD countries participating in PIAAC, adults aged 55 to 65 score some 30 points less than adults aged 25 to 34 on the PIAAC literacy scale, which is only slightly smaller than the score point difference between tertiary educated and less-than-upper-secondary educated individuals. However, despite their lower levels of proficiency, older individuals do not seem to suffer in terms of labour market outcomes. In particular, they generally earn higher wages, and much of the available empirical evidence suggests that they are not less productive than younger workers. Older and more experienced individuals seem therefore able to compensate the decline in information processing skills with the development of other skills, generally much more difficult to measure. On the other hand, proficiency in information-processing skills remain a strong determinant of important outcomes at all ages: this makes it important to better understand which factors are the most effective in preventing such age-related decline in proficiency, which does not occur to the same extent in all countries and for all individuals. Two broad interventions seem to be particularly promising in this respect. First, it is important to ensure that there is adequate and effective investment in skills development early in the life-cycle: as skills beget skills, starting off with a higher stock of human capital seems also to ensure smaller rates of proficiency decline. Second, it is equally important that policies are in place that provide incentives to individuals (and firms) to invest in skills across the entire working life. In this respect, changes in retirement policies can not only have the short-term effect of providing some reliefs to public finance, but have the potential to radically reshape incentives to stay active, to practice their skills and to invest more in training, thus helping to maintain high levels of proficiency. One table, Age Differences and Age Effects, is appended.

In this study, we investigated how empirical indicators of test-taking engagement can be defined, empirically validated, and used to describe group differences in the context of the Programme of International Assessment of Adult Competences (PIAAC). The approach was to distinguish between disengaged and engaged response behavior by means of response time thresholds. Constant thresholds of 3000 ms and 5000 ms were considered, as well as item-specific thresholds based on the visual inspection of (bimodal) response time distributions (VI method) and the proportion correct conditional on response time (P+>0% method). Overall, the validity checks comparing the proportion correct of engaged and disengaged response behavior by domain and by item showed that the P+>0% method performed slightly better than the VI method and the methods assuming constant thresholds. The results for Literacy and Numeracy by module revealed that there was an increase from Module 1 to Module 2 in the proportion of disengaged responses, suggesting a drop in test-taking engagement. The investigation of country differences in test-taking engagement by domain using the P+>0% method showed that the proportion of responses classified as disengaged was quite low. For Literacy, the proportion was well below 5% for the majority of countries; in Numeracy, the proportion was even smaller than 1% for almost all countries; while for Problem solving, the proportion of disengaged responses was more than 5% but usually well below 10%. There were significant differences in test-taking engagement between countries; the obtained effect sizes were small to medium. Population differences in test-taking engagement were highly correlated between the three domains, suggesting that test-taking engagement can be conceived as a consistent characteristic. Furthermore, there was a clear negative association between test-taking disengagement and proficiency in Literacy, Numeracy and Problem solving, respectively. Finally, subgroup differences for gender, age, educational attainment, and language proved to be insignificant or very small. Results suggest that males tend to be more disengaged, that disengagement increases with age in Problem solving, with lower educational attainment and when the test language is not the same as a testee's native language. Appended are: (1) Country differences in test-taking engagement; and (2) Subgroup differences in test-taking engagement.

Using the 2012 PIAAC data, our analysis confirms that there are significantly higher earnings and employment returns to "both" increasing levels of formally recognised education, and to increasing levels of numeracy, literacy and information and communication technologies (ICT) skills proficiencies controlling for the level of education. Unsurprisingly, the labour market returns to changes in formally recognised levels of education in general exceed the labour market returns associated with increasing levels of skills proficiency. In the case of literacy and numeracy proficiencies, improved literacy and numeracy skills narrow the labour market outcomes gap between individuals with different levels of formally recognised education, but do not close it completely. The analysis demonstrates more substantial returns to ICT skills. Furthermore, possession of higher levels of ICT skills and lower levels of formally recognised qualification are often associated with higher returns compared to individuals with higher levels of formally recognised education but lower ICT proficiency levels. In other words, ICT skills proficiencies often entirely compensate for lower formally recognised qualifications in the labour market. Contains the following annexes: (1) Country Literacy and Numeracy Profiles; and (2) Demographic Control Variables.

Innovation is essential for the education sector. The ways in which curriculum decision making is organised reflects different implicit approaches on how educational systems pertain to promote innovation in education. Curriculum holds an outstanding place when seeking to promote innovation in education, as it reflects the vision for education by indicating knowledge, skills and values to be taught to students. It may express not only "what" should be taught to students, but also "how" the students should be taught. Curriculum innovations can include new subjects, combinations of old subjects or cross-cutting learning objectives. They may also take a form of new content, concepts, sequencing, time allocation or pedagogy. This paper characterises two contrasted approaches to curriculum decision making and bringing about innovations in education. At one extreme, a prescriptive central curriculum implicitly places the initiative for educational innovations at the level of the central administration. This approach provides strong incentives for schools and teachers to adapt innovations that would not otherwise take place. Innovations, supported by policy measures and informed by research, are brought within the reach of all schools and teachers in an equitable manner. The challenge is then to accommodate local needs and ensure the commitment to and implementation of innovations by schools and teachers. At the other extreme, decentralised curriculum decision making provides schools--and perhaps even teachers--with room to create their own educational innovations. This approach allows for experimentation relevant to individual students and local communities. Innovations are meant to spread through horizontal networks of schools and teachers. The challenge is then to provide incentives for individual schools and teachers to innovate or adapt innovations and ensure that they have equal capacity to do so. The paper provides an overview of various possible approaches linking curriculum policy to educational innovation, it shows that OECD countries can mix these approaches and it discusses elements that can affect those innovations in reality. Focusing on public lower-secondary education, it draws on various OECD and UNESCO data. First, the paper suggests that OECD education systems differ clearly when looking at formal curriculum decision making, although no system relies on a purely central or school-based approach to curriculum innovations. Second, several elements can reduce the "innovation power" of the central curriculum and the "innovation flexibility" of the decentralised curriculum. Third, stakeholders--such as experts, teachers and parents--are able to influence curriculum innovations differently at central and school levels. Innovations in central-level curriculum appear to have widespread possibilities to rely on expert knowledge with consultation with practitioners, parents and the wider public. School level curriculum innovations appear to build mainly on principals and teachers' knowledge with an indirect influence from experts and parents. Annexed are: (1) Emerging Curriculum Themes in OECD Countries; (2) Approaches to Bringing About Competence-Based Curriculum; (3) Central Level Curriculum in OECD Countries; (4) Details on the Implicit Approaches to Curriculum Innovations; and (5) Roles of Parents in Decision Making on Education Policy. (Contains 13 tables, 4 charts, 5 boxes and 20 notes.)

This literature review on school choice analyses the impact of choice schemes on students and on school systems focusing on equity. Reviewing the evidence can be difficult, as the literature is often fragmented and inconclusive, and the political importance of this research often results in high-profile attention given to individual studies rather than systemically understanding collected from a larger empirical base (Berends, Cannata and Goldring, 2011). Different political groups use evidence that supports their positions in favour or against school choice, and their positions relative to school choice are largely based on their ideologies, rather than on empirical work and evidence of effectiveness (Levin and Belfield, 2004). This report steps away from the ideological debate and provides research-based evidence on the impact of choice on disadvantaged students and schools. As "only with data on the consequences of different plans for school choice will we be able to reach sensible judgements rooted in experience (Fuller and Elmore, 1996, p. 8)". It uses analysis and statements that are supported empirically and attempts to cover the widest possible scope of research, and provide responses to the key question of how to balance choice with equity considerations. (Contains 7 tables, 4 figures, 5 boxes and 13 footnotes.)

Do some forms of student (and school) assessment hinder the introduction of innovative educational practices and the development of innovation skills in education systems? This report focuses on the impact of high-stake summative assessment on innovation and argues that it is possible to reconcile high-stakes assessments and examinations through innovative approaches to testing. While necessary, assessment based on high-stake examinations often acts as an incentive to teach or study "to the test". It may thus limit risk-taking by teachers, students and parents, for instance. The problem may be amplified if a system of accountability and incentives uses the results of these examinations and tests to assess teachers and schools. What should be done to ensure that the systems used to assess education systems do not stifle the risk-taking inherent to innovation--and that they foster innovation skills in students? This study proposes three main ways of combining assessment and innovation: 1) developing a wide range of performance measurements for both students and schools; 2) rethinking the alignment of standards and assessment; 3) measuring the impact of assessments on teaching and learning. One way of influencing teaching and learning might be to modify high-stake testing. Systems will adapt to this, and both teaching and learning will focus on acquiring the right skills. Rather than testing the content of learning, standards could relate to cognitive skills such as problem-solving, communicating and reasoning--with test/examination developers adapting those skills to subjects such as mathematics, science or literary analysis. Similarly, more use might be made of innovative assessment methods based on information and communication technologies, inasmuch as these may feature simulation or interactivity, for instance, at a reasonable cost. Focusing the assessment on cognitive processes rather than content would leave more scope for teachers to put in place innovative teaching/learning strategies. This does, however, assume a high standard of professionalism in teachers and an adequate system of continuing training and knowledge management. As a single type of assessment cannot fully capture student learning, one effective strategy might also be to multiply the number of measurements and thus relieve the pressure on students and teachers to perform well in a single, high-visibility, high-stake test. At the same time, this larger number of measurements could provide the necessary input for systems based on accountability, diagnosis and assessment of the effectiveness of innovative practice. Finally, assessing the technical standard of tests and examinations is an integral part of their development, but it is less common to address the impact they have on teaching/learning or the validity of how their results are used. Since assessment is an integral part of the education process, it is just as important to assess tests and examinations as it is other educational practices in order to achieve improvements and innovation in educational assessment, but also in educational practice. (Contains 12 notes.)