Search

Calls for increased monitoring and evaluation of education policies and practices have not, so far, included widespread and consistent assessments of the inclusiveness of education settings. Measuring inclusion in education has proven to be a challenging exercise, due not only to the complexity and different uses of the concept, but also to its holistic nature. Indeed, measuring inclusion implies analysing a variety of policy areas within education systems, while also considering the different roles of the system, the school and the classroom. This paper discusses the application of the input-process-outcome model to the measurement of inclusion in education, and key indicators that can be adopted by education systems and schools to this end. It makes considerations relevant to policy makers when designing indicators to measure inclusion, such as the extent of their application, the constraints related to data disaggregation and the relevance of intersectional approaches to inclusion.

This report summarises the findings of the 2022 EUA Thematic Peer Group which explored collaborative teaching practice (CTP) in higher education in detail. Based on a shared understanding of the theme agreed on by the group members, it outlines the key opportunities and potential challenges higher education institutions face in embedding CTP and provides examples of practice from the group members. Given the many inter-institutional, national and international collaborations developed during the pandemic, the group regarded the use of digital technologies as a key feature of collaborative teaching, and it therefore became a key focus of their discussions. The report identifies the various ways in which the group's members collaborate as part of their learning and teaching activities, highlights the key challenges that higher education institutions face in implementing collaborative teaching and suggests a set of recommendations for individuals, institutions and national and European-level bodies to overcome those challenges identified. The group was organised in the context of the "Supporting European universities in their strategic approaches to digital learning" (DIGI-HE) project and EUA's Learning & Teaching activities.

The feedback between vocational education and training (VET) and the labour market can provide important input for the review and renewal of qualifications. A feedback loop that is based on learning outcomes helps provide deeper insights into what is required on the labour market, what is offered in training provisions and assessed at the end of a learning programme. The aim of this study is to contribute to strengthening the quality and relevance of qualifications and completing the feedback loop between education and the labour market. It examines methods of collecting data on the match/mismatch between qualifications and labour market requirements, including analysis of how achieved learning outcomes are applied and perceived in the labour market (for example methods of collecting the experience of employers with holders of these qualifications). This report addresses the following two questions: (1) which data already exist in the countries, providing insight into the relevance of qualifications to employees, employers and other labour market stakeholders?; and (2) how can survey methodology be designed to systematically capture the experiences and appreciations of employers as regards the content and profile of qualifications? To what extent, based on limited testing, can scalability of the methodology be achieved?

Governments recognise that careers guidance, underpinned by accurate labour market information, can help learners make post-secondary education choices that match their interests, aptitudes and abilities, and lead to rewarding employment. For this reason, they have invested in building linked education/employment information systems and other information resources which are displayed on websites targeted to learners and their families. However, researchers and governments agree that these efforts are often ineffective in informing learners' decisions -- access to information is not sufficient to provide effective support to student choice. Drawing upon the insights of behavioural economics, this paper examines how learners access and use information, and what this implies for the design of public study and career choice websites that aim to effectively support student choice. The report also takes stock of the career guidance websites in use in the majority of OECD countries, and sets out to provide actionable advice for policy makers to guide the design of effective information policy levers that support student choice.

This paper explores the impact of test-taking conditions on the quality of the Programme for the International Assessment of Adult Competencies (PIAAC) assessment. Interviewers record information about the room of assessment and interruptions that occurred during each interview. These observations, along with information on interviewer assignment size and a careful look at interviewer effects, provide insights into the quality of the assessment. This working paper first describes the variations in test-taking conditions among participating countries. Second, it examines interviewer assignment sizes and the frequency of interruptions, finding that both vary markedly among countries (contrary to the room of assessment). The paper then looks at the relationship between these variations and response rates and engagement measures. While neither the room of assessment nor the recorded interruptions impact quality differences among countries, interviewer assignment size and interviewer effects may have a mild impact on results.

This paper looks at the importance of mechanisms that give formal recognition to vocational skills acquired through work-based learning and how such mechanisms might be developed. It describes how skill recognition can benefit individuals, employers and society as a whole, and identifies in which contexts skill recognition has the highest potential to bring benefits. The focus is on three tools that are commonly used to shorten the path to a formal qualification: admission into a programme, reduced programme duration and qualification without a mandatory programme. For each of these tools, this paper sets out country approaches, discusses common challenges that arise in their implementation and advances policy messages to support policy design and implementation.

Numeracy and literacy skills have become increasingly important in modern labour markets. The large gender differences that several studies have identified have therefore sparked considerable attention among researchers and policy makers. Little is known about the moment in which such gaps emerge, how they evolve and if their evolution differs across countries. We use data from large-scale international assessments to follow representative samples of birth-cohorts over time, and analyse how gender gaps in numeracy and literacy evolve from age 10 to age 27. Our results suggest that, across the countries examined, males' advantage in numeracy is smallest at age 10 and largest at age 27. The growth in magnitude of the gender gap is particularly pronounced between the age of 15 and 27. Such evolution stands in sharp contrast with the evolution of the gender gap in literacy, which is small at age 10, large and in favour of females at age 15, and negligible by age 27.

This study uses the PIAAC data to examine the relationships between education system characteristics (e.g. early tracking and vocational education orientation) and distributions of adult numeracy skills. It also investigates the effects of postponing the tracking age and easing university access for students on a vocational track on the average skills and different percentiles of the skills distribution. Correlational analysis suggests that education systems with more students enrolled in vocational tracks have on average higher levels of numeracy skills and more compressed skills distributions between the 50th and 90th percentiles. Further analysis suggests that postponing the tracking age among 14 European countries does not have a significant effect on the average skills of the population. However, it increases skills for individuals at the 10th, 20th, and 30th percentiles of the skill distribution. Expanding university access is associated with an increase in numeracy skills, particularly for individuals at the bottom three deciles of the distribution.

A strong VET system is increasingly seen as essential to overcoming the current economic crisis in Europe. VET is seen as a powerful tool to assist in balancing labour market inefficiencies, increasing youth employment possibilities, and reducing skills mismatch. Its inherent flexibility and closeness to the labour market place VET in a good position to contribute to a faster economic recovery and long-term sustainable development. However, crucial for this role is continuous and systematic VET renewal that assures its relevance for the labour market. This publication explores 15 European national approaches to feedback mechanisms between VET and the labour market. It illustrates the diversity of solutions currently applied across Europe and how they are embedded in national traditions and education philosophy. The study asks three fundamental questions: how inclusive are national mechanisms for feedback between the VET system and the labour market; how responsive are existing mechanisms; and how transparent? Three annexes provide: (1) Case Studies; (2) List of interviewees; and (3) List of experts responsible for the country overviews. Bibliography and references are included. [This paper is the result of a team effort reflecting the work of a research consortium led by Jörg Markowitsch from 3s Research Laboratory who together with Tanja Bacher, Carol Costley, David Etherington, Gerhard Geiger, Günter Hefler, Jelena Helemäe, Triin Roosalu, Ellu Saar, Auni Tamm, and Odd Bjørn Ure conducted the research and fieldwork and drafted the report. This work was carried out under Cedefop's service contract No 2011-0161/AO/ECVL/JB-IPS/Cooperation Labour market--VET/007/11.]

Resilience refers to the capacity of individuals to prosper despite encountering adverse circumstances. This paper defines academic resilience as the ability of 15-year-old students from disadvantaged backgrounds to perform at a certain level in the Programme for International Student Assessment (PISA) in reading, mathematics and science that enables them to play an active role in their communities and prepares them to make the most of lifelong-learning opportunities. Using data from the most recent PISA cycles, this paper explores changes in the share of resilient students over time (2006-2015); highlights the importance of school environments and resources in mitigating the risk of low achievement for disadvantaged students; and identifies school-level factors that are associated with the likelihood of academic resilience among socio-economically disadvantaged students. Analyses reveal that several countries were able to increase the share of resilient students over time, reflecting improvements in the average performance of students, or a weaker relationship between socio-economic status and performance. In the vast majority of education systems examined, the likelihood of academic resilience among disadvantaged students is lower in schools where students report a negative classroom climate. The paper concludes by exploring school policies and practices that are associated with a positive classroom climate. [This work was supported by a contribution to the PISA programme of work from Vodafone Germany Foundation.]

The paper examines between-country differences in the mechanisms through which education could promote generalised trust using data from 29 countries participating in the OECD's Survey of Adult Skills (PIAAC). Results indicate that education is strongly associated with generalised trust and that a large part of this association is mediated by individuals' literacy skills, income and occupational prestige. However, education gradients in levels of generalised trust and in the extent to which they are due to social stratification mechanisms or cognitive skills mechanisms vary across countries. Differences across countries in birthplace diversity and income inequality are correlated with how strongly education is associated with trust in different countries, as well as in the relative magnitude of direct and indirect associations. In particular, the relationship between literacy skills and generalised trust is stronger in the presence of greater birthplace diversity but is weaker in the presence of greater income inequality.

We assess the relationship between general literacy skills and health status by analysing data from the Programme for the International Assessment of Adult Competencies (PIAAC), an international survey of about 250,000 adults aged 16-65 years conducted by the Organisation for Economic Co-operation and Development (OECD) from 2011-15 in 33 countries/national sub-regions. Across countries, there seems to be a strong and consistent association between general literacy proficiency and self-rated poor health, independent of prior socio-economic status and income. General literacy proficiency also appears to be a mediator of the association between self-education and self-rated poor health. While the literacy-health association is robust over time, it varies in magnitude across countries. It is strongest for those with a tertiary or higher degree and does not appear to exist among young adults (ages 25 to 34 years). Future studies are required to understand the contextual factors that modify the general literacy proficiency-health association.

A study investigated the effectiveness of tandem second language learning using electronic mail (e-mail). Tandem language learning refers to a partnership between two learners, each learning the other's native language. The underlying principles of reciprocity and learner autonomy are explored, use of asynchronous communication between individuals for language learning is discussed, and theory on communicative language learning and the role of writing in language learning is examined, and the study is presented. Subjects were seven dyads of native English- and native Spanish-speaking adults of varied second-language proficiency levels, located in Ireland, Denmark, and Spain. Data were drawn from analysis of e-mail messages and a survey of participants. Analysis focuses on choice of language, type of language used, nature of cultural exchange, style and quality of peer feedback, development of language usage awareness, communication strategies, and students' comments and attitudes. Conclusions and areas for further research are discussed. Contains 53 references. (MSE)

This paper presents a comprehensive analysis of the link between age and proficiency in information-processing skills, based on information drawn from the Survey of Adult Skills (PIAAC). The data reveal significant age-related differences in proficiencies, strongly suggesting that proficiency tends to "naturally" decline with age. Age differences in proficiency are, at first sight, substantial. On average across the OECD countries participating in PIAAC, adults aged 55 to 65 score some 30 points less than adults aged 25 to 34 on the PIAAC literacy scale, which is only slightly smaller than the score point difference between tertiary educated and less-than-upper-secondary educated individuals. However, despite their lower levels of proficiency, older individuals do not seem to suffer in terms of labour market outcomes. In particular, they generally earn higher wages, and much of the available empirical evidence suggests that they are not less productive than younger workers. Older and more experienced individuals seem therefore able to compensate the decline in information processing skills with the development of other skills, generally much more difficult to measure. On the other hand, proficiency in information-processing skills remain a strong determinant of important outcomes at all ages: this makes it important to better understand which factors are the most effective in preventing such age-related decline in proficiency, which does not occur to the same extent in all countries and for all individuals. Two broad interventions seem to be particularly promising in this respect. First, it is important to ensure that there is adequate and effective investment in skills development early in the life-cycle: as skills beget skills, starting off with a higher stock of human capital seems also to ensure smaller rates of proficiency decline. Second, it is equally important that policies are in place that provide incentives to individuals (and firms) to invest in skills across the entire working life. In this respect, changes in retirement policies can not only have the short-term effect of providing some reliefs to public finance, but have the potential to radically reshape incentives to stay active, to practice their skills and to invest more in training, thus helping to maintain high levels of proficiency. One table, Age Differences and Age Effects, is appended.

Using the 2012 PIAAC data, our analysis confirms that there are significantly higher earnings and employment returns to "both" increasing levels of formally recognised education, and to increasing levels of numeracy, literacy and information and communication technologies (ICT) skills proficiencies controlling for the level of education. Unsurprisingly, the labour market returns to changes in formally recognised levels of education in general exceed the labour market returns associated with increasing levels of skills proficiency. In the case of literacy and numeracy proficiencies, improved literacy and numeracy skills narrow the labour market outcomes gap between individuals with different levels of formally recognised education, but do not close it completely. The analysis demonstrates more substantial returns to ICT skills. Furthermore, possession of higher levels of ICT skills and lower levels of formally recognised qualification are often associated with higher returns compared to individuals with higher levels of formally recognised education but lower ICT proficiency levels. In other words, ICT skills proficiencies often entirely compensate for lower formally recognised qualifications in the labour market. Contains the following annexes: (1) Country Literacy and Numeracy Profiles; and (2) Demographic Control Variables.

This paper explores the impact of policies and institutions on employment and unemployment of OECD countries in the past decades. Reduced-form unemployment equations, consistent with standard wage setting/price-setting models, are estimated using cross-country/time-series data from 21 OECD countries over the period 1982-2003. In the "average" OECD country, high and long-lasting unemployment benefits, high tax wedges and stringent anticompetitive product market regulation are found to increase aggregate unemployment. By contrast, highly centralised and/or coordinated wage bargaining systems are estimated to reduce unemployment. These findings are robust across specifications, datasets and econometric methods. As policies and institutions affect employment not only via their impact on aggregate unemployment but also through their effects on labour market participation -- particularly for those groups "at the margin" of the labour market, group-specific employment rate equations are also estimated. In the "average" OECD country, high unemployment benefits and high tax wedges are found to be associated with lower employment prospects for all groups studied, namely prime-age males, females, older workers and youths. There is also evidence that group-specific policy determinants matter, such as targeted fiscal incentives. The paper also finds significant evidence of interactions across policies and institutions, as well as between institutions and macroeconomic conditions. Consistent with theory, structural reforms appear to have mutually reinforcing effects: the impact of a given policy reform is greater the more employment-friendly the overall policy and institutional framework. Certain more specific interactions across policies and institutions are found to be particularly robust, notably between unemployment benefits and public spending on active labour market programmes as well as between statutory minimum wages and the tax wedge. Finally, it is shown that macroeconomic conditions also matter for unemployment patterns, with their impact being shaped by policies. (A bibliography is included. Contains 144 footnotes, 9 figures, 3 boxes and 27 tables.)

The contribution of higher education institutions to regional development is a theme that has attracted growing attention in recent years. Knowledge institutions are increasingly expected not only to conduct education and research, but also to play an active role in the economic, social and cultural development of their regions. The extent to which higher education institutions are able to play this role depends on a number of circumstances: the characteristics of the institutions, the regions in which they are located and the policy frameworks are all significant. At the same time, there are signs of more fundamental conceptual and strategic confusion. The discussions in this domain are frequently characterised by slogans and popular metaphors. This literature review was prepared to support the OECD project entitled 'Supporting the Contribution of Higher Education Institutions to Regional Development', which was conducted by the OECD Programme on Institutional Management in Higher Education (IMHE) in collaboration with the Directorate of Public Governance and Territorial Development. Drawing mainly from a selection of European and North American publications, the report takes an overall view on the development of higher education institutions in the regional context. It focuses on the evolution and discourses of higher education and research, the regional aspects of higher education policies, the various functions and roles that the institutions play, measures taken to link the universities with their regional partners, and the conditions which favour or hamper stronger regional engagement. (A bibliography is included. Contains 9 figures.)

Innovation is essential for the education sector. The ways in which curriculum decision making is organised reflects different implicit approaches on how educational systems pertain to promote innovation in education. Curriculum holds an outstanding place when seeking to promote innovation in education, as it reflects the vision for education by indicating knowledge, skills and values to be taught to students. It may express not only "what" should be taught to students, but also "how" the students should be taught. Curriculum innovations can include new subjects, combinations of old subjects or cross-cutting learning objectives. They may also take a form of new content, concepts, sequencing, time allocation or pedagogy. This paper characterises two contrasted approaches to curriculum decision making and bringing about innovations in education. At one extreme, a prescriptive central curriculum implicitly places the initiative for educational innovations at the level of the central administration. This approach provides strong incentives for schools and teachers to adapt innovations that would not otherwise take place. Innovations, supported by policy measures and informed by research, are brought within the reach of all schools and teachers in an equitable manner. The challenge is then to accommodate local needs and ensure the commitment to and implementation of innovations by schools and teachers. At the other extreme, decentralised curriculum decision making provides schools--and perhaps even teachers--with room to create their own educational innovations. This approach allows for experimentation relevant to individual students and local communities. Innovations are meant to spread through horizontal networks of schools and teachers. The challenge is then to provide incentives for individual schools and teachers to innovate or adapt innovations and ensure that they have equal capacity to do so. The paper provides an overview of various possible approaches linking curriculum policy to educational innovation, it shows that OECD countries can mix these approaches and it discusses elements that can affect those innovations in reality. Focusing on public lower-secondary education, it draws on various OECD and UNESCO data. First, the paper suggests that OECD education systems differ clearly when looking at formal curriculum decision making, although no system relies on a purely central or school-based approach to curriculum innovations. Second, several elements can reduce the "innovation power" of the central curriculum and the "innovation flexibility" of the decentralised curriculum. Third, stakeholders--such as experts, teachers and parents--are able to influence curriculum innovations differently at central and school levels. Innovations in central-level curriculum appear to have widespread possibilities to rely on expert knowledge with consultation with practitioners, parents and the wider public. School level curriculum innovations appear to build mainly on principals and teachers' knowledge with an indirect influence from experts and parents. Annexed are: (1) Emerging Curriculum Themes in OECD Countries; (2) Approaches to Bringing About Competence-Based Curriculum; (3) Central Level Curriculum in OECD Countries; (4) Details on the Implicit Approaches to Curriculum Innovations; and (5) Roles of Parents in Decision Making on Education Policy. (Contains 13 tables, 4 charts, 5 boxes and 20 notes.)

This paper discusses the most relevant issues concerning teacher evaluation in primary and secondary education by reviewing the recent literature and analysing current practices within the OECD countries. First, it provides a conceptual framework highlighting key features of teacher evaluation schemes. In particular, it emphasises the importance of clarifying the purposes of teacher appraisal, whether summative when designed to assure that the practices enhancing student learning are undertaken or formative when conducted for further professional development objectives. It also encompasses the diverse criteria and instruments commonly used to assess teachers as well as the actors generally involved in the process and potential consequences for teachers' professional life. Second, it deals with a number of contentious points, including the question of the use of student outcomes to measure teaching performance, the advantages and drawbacks of different approaches given the purpose emphasised and resource restrictions, the implementation difficulties resulting from different stakeholders' interests and possible ways to overcome these obstacles. Finally, it provides an account of current empirical evidence, pointing out mixed results stemming from difficulties in assessing the effects of such evaluation schemes on teaching quality, teachers' motivation and student learning. It concludes by considering the circumstances under which teacher evaluation systems seem to be more effective, fair and reliable. Developing a comprehensive approach to evaluate teachers is critical to make demands for educational best practice compatible with teachers' appropriation of the process as well as to enhance the decisive attractiveness and recognition of the teaching profession. (Contains 1 table.)

Education plays an essential role in preparing the children of immigrants for participation in the labour market and society. Giving these children opportunities to fully develop their potential is vital for future economic growth and social cohesion in OECD countries. But migrant students in most OECD countries tend to have lower education outcomes than their native peers. Extensive previous research has described the system level, school level and individual level factors that influence the education outcomes of migrant students. Building on such previous research, this paper looks at the ways in which "education policies" can influence these factors to help provide better educational opportunities for migrant students. (Contains 7 footnotes.) [This review was prepared for the OECD Thematic Review on Migrant Education. It was presented and discussed at the Second Meeting of the Group of National Experts on the Education of Migrants in Paris on 13-14 October 2008.]

Do some forms of student (and school) assessment hinder the introduction of innovative educational practices and the development of innovation skills in education systems? This report focuses on the impact of high-stake summative assessment on innovation and argues that it is possible to reconcile high-stakes assessments and examinations through innovative approaches to testing. While necessary, assessment based on high-stake examinations often acts as an incentive to teach or study "to the test". It may thus limit risk-taking by teachers, students and parents, for instance. The problem may be amplified if a system of accountability and incentives uses the results of these examinations and tests to assess teachers and schools. What should be done to ensure that the systems used to assess education systems do not stifle the risk-taking inherent to innovation--and that they foster innovation skills in students? This study proposes three main ways of combining assessment and innovation: 1) developing a wide range of performance measurements for both students and schools; 2) rethinking the alignment of standards and assessment; 3) measuring the impact of assessments on teaching and learning. One way of influencing teaching and learning might be to modify high-stake testing. Systems will adapt to this, and both teaching and learning will focus on acquiring the right skills. Rather than testing the content of learning, standards could relate to cognitive skills such as problem-solving, communicating and reasoning--with test/examination developers adapting those skills to subjects such as mathematics, science or literary analysis. Similarly, more use might be made of innovative assessment methods based on information and communication technologies, inasmuch as these may feature simulation or interactivity, for instance, at a reasonable cost. Focusing the assessment on cognitive processes rather than content would leave more scope for teachers to put in place innovative teaching/learning strategies. This does, however, assume a high standard of professionalism in teachers and an adequate system of continuing training and knowledge management. As a single type of assessment cannot fully capture student learning, one effective strategy might also be to multiply the number of measurements and thus relieve the pressure on students and teachers to perform well in a single, high-visibility, high-stake test. At the same time, this larger number of measurements could provide the necessary input for systems based on accountability, diagnosis and assessment of the effectiveness of innovative practice. Finally, assessing the technical standard of tests and examinations is an integral part of their development, but it is less common to address the impact they have on teaching/learning or the validity of how their results are used. Since assessment is an integral part of the education process, it is just as important to assess tests and examinations as it is other educational practices in order to achieve improvements and innovation in educational assessment, but also in educational practice. (Contains 12 notes.)

School systems aspire to provide equal opportunity for all, irrespective of socio-economic status (SES). Much of the criticism of recent school reforms that introduce accountability, autonomy, and choice emphasizes their potentially negative consequences for equity. This report provides new evidence on how national features of accountability, autonomy, and choice are related to the equality of opportunity across countries. We estimate whether student achievement depends more or less on SES in school systems employing these institutional features. The rigorous micro-econometric analyses are based on the PISA 2003 data for more than 180,000 students from 27 OECD countries. The main empirical result is that rather than harming disadvantaged students, accountability, autonomy, and choice appear to be tides that lift all boats. The additional choice created by public funding for private schools in particular is associated with a strong reduction in the dependence of student achievement on SES. External exit exams have a strong positive effect for all students that is slightly smaller for low-SES students. The positive effect of regularly using subjective teacher ratings to assess students is substantially larger for low-SES students. The effect of many other accountability devices does not differ significantly by student SES. School autonomy in determining course content is associated with higher equality of opportunity, while equality of opportunity is lower in countries where more schools have autonomy in hiring teachers. Autonomy in formulating the budget and in establishing starting salaries is not associated with the equity of student outcomes. Inequality of opportunity is substantially higher in school systems that track students at early ages. (Contains 19 footnotes, 6 figures and 9 tables.)

We consider the question whether pupils from the lower social strata perform better in private government-dependent schools than in public or private-independent schools, using the PISA 2000 data on European high schools. In the eighty's, Coleman and Hoffer (1987) found in the USA that the performance of these pupils was better at religious schools than at comparable public schools. Dronkers and Robert (2003) found in PISA-data for 19 comparable countries that private government-dependent schools are more effective then comparable public schools, also after controlled for characteristics of pupils and parents and the social composition of the school. The main explanation appeared to be a better school climate in private government-dependent schools. Private independent schools were less effective than comparable public schools, but only after controlling for the social composition of the school. As a follow-up we now investigate, again with the PISA-data of these 19 countries, whether this positive effect of private government-dependent schools differs between pupils from different strata. We use various indicators to measure social strata: social, cultural and economic. We expect that the thesis of Coleman & Hoffer does hold for private government-dependent schools, because in these 19 countries they are mostly religious schools, which have more opportunities to form functional communities and create social capital. But for private independent schools, which due to their commercial foundation are less often functional communities, this relation is not expected to hold. However, the results show that public and private schools have mostly the same effects for the same kind of pupils and thus mostly not favor one kind of pupils above another kind of pupils. But private government-dependent schools are slightly more effective for pupils with less cultural capital. However, private independent schools are also more effective for pupils from large families or low status families. (Contains 4 tables, 12 notes and a list of 25 Literature Resources .)