Search

This paper explores the impact of test-taking conditions on the quality of the Programme for the International Assessment of Adult Competencies (PIAAC) assessment. Interviewers record information about the room of assessment and interruptions that occurred during each interview. These observations, along with information on interviewer assignment size and a careful look at interviewer effects, provide insights into the quality of the assessment. This working paper first describes the variations in test-taking conditions among participating countries. Second, it examines interviewer assignment sizes and the frequency of interruptions, finding that both vary markedly among countries (contrary to the room of assessment). The paper then looks at the relationship between these variations and response rates and engagement measures. While neither the room of assessment nor the recorded interruptions impact quality differences among countries, interviewer assignment size and interviewer effects may have a mild impact on results.

This paper looks at the importance of mechanisms that give formal recognition to vocational skills acquired through work-based learning and how such mechanisms might be developed. It describes how skill recognition can benefit individuals, employers and society as a whole, and identifies in which contexts skill recognition has the highest potential to bring benefits. The focus is on three tools that are commonly used to shorten the path to a formal qualification: admission into a programme, reduced programme duration and qualification without a mandatory programme. For each of these tools, this paper sets out country approaches, discusses common challenges that arise in their implementation and advances policy messages to support policy design and implementation.

In 2011, CASE founded the Center for Community College Advancement to provide training and resources to help community colleges build and sustain effective fundraising, alumni relations and communications and marketing programs. This white paper summarizes the results of a groundbreaking survey on alumni relations programs at community colleges across the United States and Canada. The purpose of the survey was to help community college staff members benchmark their experiences and programs in alumni relations with their peers. The survey was conducted by the CASE research office in conjunction with CASE's Center for Community College Advancement. Survey questions are appended. [For the follow up White Paper, "Benchmarking Alumni Relations in Community Colleges: Findings from a 2015 CASE Survey. CASE White Paper," see ED571307.]

The Monitoring the Future (MTF) project reports annually on levels and trends in self-reported substance use by secondary school students (e.g., Johnston, O'Malley, Bachman, & Schulenberg, 2009). The reports include subgroup comparisons, and these have revealed substantial differences among race/ethnicity groups, as well as some differences linked to parental education (as the available indicator of socioeconomic level). These comparisons are complicated by the substantial differences in racial/ethnic composition across levels of parental education. The present paper disentangles the confounding of race/ethnicity with parental education by examining the three largest race/ethnicity groups separately, showing and comparing how parental education is related to three common forms of substance use/abuse among adolescents. The authors show important interaction effects: The negative relationship between parental education and substance use is more pronounced among White adolescents than among those who are African American or Hispanic. They also unmask relationships between parental education and substance use that are clearer for White adolescents than for the total sample. Furthermore, the appendix to this occasional paper compares product-moment correlations and linear regression results for five-year intervals (1999-2003 vs. 2004-2008), and shows that very few regression coefficients differ significantly. This appendix is titled, "Use of Various Drugs by Grade among All Male Respondents, 1999-2008." (Contains 1 table and 10 figures.)

The opportunity to study abroad is broadly hailed as a route for young people to develop a wide range of knowledge and skills, including intercultural understanding, interpersonal skills, and language learning, among many others. Universities around the world are investing significant resources in developing a variety of study abroad programmes, ranging from short or long term in duration, and from guided to independent study. These may have a number of aims, including to promote individual student learning and development and to enhance student mobility and employability, particularly in the context of a rapid and changeable global employment market. The terms 'global citizen', 'global graduate', 'global skills' and 'global mindset' have all taken on increased significance within this context. Limited research has been conducted, however, to explore students' own perspectives of these terms. This small scale study therefore set out to explore the perspectives of students on UCL's BASc programme and especially to better understand where and how the learning they gained during study abroad resonates with UCL's global citizenship and student mobility strategies. [Funding was provided by the UCL Global Engagement Office (GEO).]

Differences in teacher quality are commonly cited as a key determinant of the huge international student performance gaps. However, convincing evidence on this relationship is still lacking, in part because it is unclear how to measure teacher quality consistently across countries. We use unique international assessment data to investigate the role of teacher cognitive skills as one main dimension of teacher quality in explaining student outcomes. Our main identification strategy exploits exogenous variation in teacher cognitive skills attributable to international differences in relative wages of nonteacher public sector employees. Using student-level test score data, we find that teacher cognitive skills are an important determinant of international differences in student performance. Results are supported by fixed-effects estimation that uses within-country between-subject variation in teacher skills.

Numeracy and literacy skills have become increasingly important in modern labour markets. The large gender differences that several studies have identified have therefore sparked considerable attention among researchers and policy makers. Little is known about the moment in which such gaps emerge, how they evolve and if their evolution differs across countries. We use data from large-scale international assessments to follow representative samples of birth-cohorts over time, and analyse how gender gaps in numeracy and literacy evolve from age 10 to age 27. Our results suggest that, across the countries examined, males' advantage in numeracy is smallest at age 10 and largest at age 27. The growth in magnitude of the gender gap is particularly pronounced between the age of 15 and 27. Such evolution stands in sharp contrast with the evolution of the gender gap in literacy, which is small at age 10, large and in favour of females at age 15, and negligible by age 27.

This study uses the PIAAC data to examine the relationships between education system characteristics (e.g. early tracking and vocational education orientation) and distributions of adult numeracy skills. It also investigates the effects of postponing the tracking age and easing university access for students on a vocational track on the average skills and different percentiles of the skills distribution. Correlational analysis suggests that education systems with more students enrolled in vocational tracks have on average higher levels of numeracy skills and more compressed skills distributions between the 50th and 90th percentiles. Further analysis suggests that postponing the tracking age among 14 European countries does not have a significant effect on the average skills of the population. However, it increases skills for individuals at the 10th, 20th, and 30th percentiles of the skill distribution. Expanding university access is associated with an increase in numeracy skills, particularly for individuals at the bottom three deciles of the distribution.

It is well-known that there are large disparities in academic achievement between children of different socio-economic status (SES) backgrounds. This study examines the evolution of disparities in literacy skills between adults of different SES backgrounds. It compares countries' patterns in the evolution of disparities in literacy by SES background as cohorts age and asks which patterns of educational and labour force participation predict a narrowing rather than a widening of these disparities. Since there is no international longitudinal study of skills across the entire adult life span, this study uses three cross-sectional international adult studies (International Adult Literacy Survey, Adult Literacy and Lifeskills and Programme for the International Assessment of Adult Competencies) and matches birth years to create synthetic cohorts. Results indicate that there is large cross-national variation in the evolution of skills disparities associated with SES background. Disparities in literacy proficiency tend to widen when SES disparities in high school completion, professional and blue-collar employment increase. Disparities narrow when workers exit the labour force, a finding that is explained by the large inequalities in the employment experiences of individuals from different SES backgrounds, measured by differences in use of literacy skills at work. These results help to explain cross-national variation in the evolution of skills disparities by SES background, which has implications for policies aimed at closing skills gaps over the life course. [Funding from the OECD Thomas J. Alexander Fellowship Programme.]

The debate about the performance of US students on international assessments of educational achievement routinely fails to account for one consistently stark result: US achievement is bifurcated between a group of high-performing Asian and white students and an exceptionally low-performing group of black and Hispanic students. By summarizing results across 20 major international tests conducted since 1995, this research paper shows that when US racial and ethnic groups are separately compared with other countries, Asian and white students regularly perform at or near the top of international rankings, while black and Hispanic students typically rank at or near the bottom. Furthermore, the United States has a substantially larger minority population than all other developed countries, and minority status is not synonymous with internationally comparable factors such as socioeconomic level or immigrant status. The fact that overall US scores are disproportionately influenced by race and ethnicity suggests that researchers and reformers must reconsider how they use and interpret the results of international achievement tests. The research paper recommends providing and analyzing cross-national data separately by ethnic groups to inform approaches to improving education for all students. (Contains 1 figure, 3 tables, and 8 footnotes.)

Resilience refers to the capacity of individuals to prosper despite encountering adverse circumstances. This paper defines academic resilience as the ability of 15-year-old students from disadvantaged backgrounds to perform at a certain level in the Programme for International Student Assessment (PISA) in reading, mathematics and science that enables them to play an active role in their communities and prepares them to make the most of lifelong-learning opportunities. Using data from the most recent PISA cycles, this paper explores changes in the share of resilient students over time (2006-2015); highlights the importance of school environments and resources in mitigating the risk of low achievement for disadvantaged students; and identifies school-level factors that are associated with the likelihood of academic resilience among socio-economically disadvantaged students. Analyses reveal that several countries were able to increase the share of resilient students over time, reflecting improvements in the average performance of students, or a weaker relationship between socio-economic status and performance. In the vast majority of education systems examined, the likelihood of academic resilience among disadvantaged students is lower in schools where students report a negative classroom climate. The paper concludes by exploring school policies and practices that are associated with a positive classroom climate. [This work was supported by a contribution to the PISA programme of work from Vodafone Germany Foundation.]

In this paper, we survey the UK-based literature on school structures and school autonomy to identify settings in which alternative and more autonomous school arrangements can improve the educational attainments of pupils in the bottom tail of the achievement distribution. We also present new evidence on the effect of school academies on the age-16 GCSE attainment of students of different abilities up to 2009, before the Coalition Government changed the nature of the Labour academy programme. Within the UK education system, academies enjoy substantial autonomy in terms of management of their staff, taught curriculum, length of the school day and other aspects of their day-to-day functioning. Our results show that schools that converted to academies between 2002 and 2007 improved their overall age-16 GCSEs results by further raising the attainments of students in the top half of the ability distribution, and in particular pupils in the top 20% tail. Conversely, we find little evidence that academies helped pupils in the bottom 10% and 20% of the ability distribution. Finally, we find little evidence that late converters (2008 and 2009) had any beneficial effects on pupils of any ability. We conclude our research by comparing the experience of UK academies to that of US charter schools and Swedish free schools, and by providing some insights into the reasons why UK academies did not serve "the tail" as is the case for some US charter schools. An appendix presents Table 1: Academies and GCSE Performance--Teh Effect of Academy Conversion on Pupils of Different Abilities.

This paper examines the effects of policies that increase the number of students who take the first course in algebra in 8th grade, rather than waiting until 9th grade. Extending previous research that focused on the Charlotte-Mecklenburg school system, we use data for the 10 largest districts in North Carolina. We identify the effects of accelerating the timetable for taking algebra by using data on multiple cohorts grouped by decile of prior achievement and exploiting the fact that policy-induced shifts in the timing of algebra occur at different times in different districts to different deciles of students. The expanded data make it possible to examine heterogeneity across students in the effect of taking algebra early. We find negative effects among students in the bottom 60% of the prior achievement distribution. In addition, we find other sources of heterogeneity in effects.

In January 2011, the Lumina Foundation published its Degree Qualifications Profile (DQP) to challenge faculty and academic leaders in the U.S. to think deeply and concretely about aligning expectations for student learning outcomes across higher education. Since then, the DQP has kindled extensive discussions about what the postsecondary degrees granted by American colleges and universities really mean with respect to what graduates know and can do. But the text of the DQP itself provides only limited guidance to stakeholders with respect to assessment. In order to render the Profile's potential real, institutions and their faculties will need to develop consistent and systematic ways to gather evidence that the competencies that the DQP describes are actually being mastered at the levels claimed. In this paper, I explore some of what needs to be done in this area and provide a few tools and techniques (some of which are already in widespread use) that may help us move forward. In offering them, I invite faculties at all our colleges and universities to carefully examine what the DQP asks us to do in designing more aligned and integrated approaches to teaching, learning, and determining student competence--as well as to actively experiment with these ideas and techniques with their colleagues. (Contains 13 footnotes.) [Foreword by George Kuh and Stan Ikenberry and Afterword by Carol Geary Schneider.]

The purpose of this research paper is to look at the definition of academic freedom and how it has evolved over time. Canada's definition of academic freedom grew out of the influences of Britain, Germany, and the United States. The paper begins with a historic look at these three sources. It then focuses on the Canadian definition of academic freedom in relation to Canadian history. Important academic freedom cases are described, and their influences on the definition of academic freedom are discussed. An overview of current trends, including tenure, unions, political correctness, private funding, and accountability mandates, threatening academic freedom are discussed. History has revealed that the concept of academic freedom has been modified and refined as it journeyed through each generation. Each generation has fought for different pieces of the academic freedom puzzle, from religious freedom, to political freedom, to cultural freedom, and it is only by looking back over history one can finally understand what academic freedom truly defends. The fight for academic freedom has been waged so that all academics could enjoy freedom to pursue their research and teaching free from public sanctions. (Contains 34 references.) (Author/SLD)

This paper traces the history of two reform movements organized more than two decades ago to improve teaching and learning in U.S. colleges and universities: the teaching reform movement, led by the liberal philanthropies, and the accountability movement, led by the states and, later, the regional accreditors. The paper concludes that the teaching reform movement helped to dislodge research as the accepted center of academic life and helped to spread progressive education methods throughout academe. Both of these changes are consistent with continuing low levels of student effort and limited student learning in college. The accountability movement, by contrast, has had little impact thus far due to frequent changes in accountability and institutional assessment mechanisms, and the tendency of universities to comply only minimally with the demands of accreditors for increased accountability and institutional assessment. (Contains 18 notes.)

In the United States, developing "human capital" for both economic and social benefit is an idea as old as the nation itself and led to the emergence of world's first mass higher education system. Now most other nations are racing to expand access to universities and colleges and to expand their role in society. Higher education is growing markedly in its importance for building a culture of aspiration and, in turn, the formation of human capital, the promotion of socioeconomic mobility, and the determination of national economic competitiveness. This paper outlines a convergence of approaches toward building what I call "Structured Opportunity Markets" (SOM) in higher education--including diversified providers and expanding enrollment and program capacity. Increasingly, higher education systems in developed and developing nations, and in some cases, supranational entities such as the European Union and emerging cooperation among nations in South East Asia, will move to most if not all of the components of SOM, in part influenced by a global process of policy transfer. Those nations and regions that do not pursue major components of SOM will be compelled to present rational arguments in both domestic and international forums as to why they are not adopting some aspects of the model. The paper concludes by arguing that while the US offers structural and operational models for many evolving national higher education systems, the EU offers important insights on how to pursue higher education reform in the modern and increasingly competitive global context. (Contains 6 footnotes.)

The "Policy Matters" project provides coherent, comprehensive information regarding the strength and adequacy of state policies affecting children, families, and communities. The project seeks to establish consensus among policy experts and state leaders regarding the mix of policies believed to offer the best opportunity for improving key child and family results. The paper that follows presents a framework for policy options aimed at achieving a core result: safety and well-being for children with permanent families. Although there are many systems, policies, and programs that affect this outcome, this paper focuses primarily on state child welfare agencies and their partners, which include the courts and systems responsible for health, mental health, education and other related services. In Section I, the paper provides background on the challenges faced by children and families involved with the child welfare systems, and the challenges these systems face in trying to serve them. Section II of this report provides a conceptual framework and logic model that illustrate the connection between the desired outcomes for children and the policy recommendations in this report. Section III defines these policy recommendations in detail, including the available research and practice evidence that informs these recommendations. Taken together, the authors believe that the policies identified here present a powerful and compelling policy agenda for improving child safety and well-being as part of permanent families. Over time, they will continue to improve the recommendations as additional research and practice evidence is available. Future policy options may be modified to allow consistent tracking of state progress and to overcome data limitations. Thus, this paper presents a preliminary set of policy options. A goal of the "Policy Matters" work is to assess states' progress toward recommended policy options. The framework helps states think strategically about policy decisions that improve the safety, permanence, and well-being of families, and is designed to provide policy support and feedback to those interested in promoting improved outcomes for children and families. (Contains 431 endnotes.)

The place of women in the manual trades is examined in this paper, which sets out strategies for encouraging them to study and work in areas such as building and construction. Such strategies include introductory and pre-apprenticeships courses, clustering female students, and support from teachers in opening up job opportunities. This paper is the result of a 2008 NCVER New Researcher Award. (Contains 2 tables.)

Research universities throughout the world are part of a larger effort by nation-states to bolster science and technological innovation and compete economically. The US remains highly competitive as a source of High Tech (HT) innovation because of a number of market positions, many the result of long term investments in institutions such as research universities and in R&D funding, and more broadly influenced by a political culture that has tended to support entrepreneurs and risk taking. In essence, the US was the first mover in pursuing the nexus of science and economic policy. The following essay places universities within this larger political and policy environment by discussing market factors that have influenced knowledge accumulation and HT innovation in the US, their current saliency in the face of globalization, and the growing market position of competitors, such as the EU. The paper also provides observations on major US state-based HT initiatives intended to create or sustain Knowledge Based Economic Areas (KBEAs). Thirteen variables are used to assess the overall comparative ability for creating KBEAs, including the vitality of regional and national research universities, patterns of R&D investment, access to venture capital, intellectual property laws, educational attainment levels of the workforce, access and retention of global labor force, and political interest and forms of government support for promoting science and technology. Among the papers conclusions: There is a large disconnect in US policy related to promoting KBEAs and national competitiveness. Few policymakers, or even the higher education community are aware of stagnant and, in some states, real declines in higher education access and graduation rates relative to economic competitors, that the US is no longer a net importer of high tech goods, or that the US is no longer the number one destination for international students. Combined with global changes in the market for S&T talent, and the significant and increasingly successful effort of competitors to increase the educational attainment of their population, the US's HT advantage is eroding--although there remain a number of strengths, chiefly related to an entrepreneurial culture, more conducive tax advantages for business, a cadre of elite research universities, and the highest concentration of venture capital in the world. But even here, these advantages may wane over the next decade as the world becomes more economically, and educationally, competitive. The US generally lacks a broadly conceived strategy for retaining America's high tech advantage. "A Sample of the Frenzy of State Initiatives: 2007" is appended. (Contains 17 figures and 37 notes.) [A version of this working paper was presented at the OECD conference, "Globally Competitive, Locally Engaged: Higher Education and Regions" (Valencia, Spain, September 20, 2007).]

This paper builds on earlier reviews by the author of the changing roles and identities of contemporary professional staff in UK higher education (Whitchurch, 2004; 2006a; 2006b), and describes an empirical study that was undertaken between 2004 and 2007. It progresses the argument that the generic terms "administration" and "management" no longer do justice to the activities of these staff, and uses the concept of identity to develop four categories of "bounded," "cross-boundary," "unbounded" and "blended professionals." Via these categories it is shown how individuals are not only interpreting their given roles more actively, but are also moving laterally across boundaries to create new professional spaces, knowledges and relationships. The paper goes on to introduce the concept of "third space" as an emergent territory between academic and professional domains, in which "unbounded" and "blended professionals," particularly, are likely to work. It considers the implications of these developments for both institutions and individuals, and makes some comparisons with parallel groups of staff in Australia and the United States. Finally, it proposes that "third space" working is suggestive of future trends in professional identities, which may increasingly coalesce with those of academic colleagues who undertake project- and management oriented roles. (Contains 3 figures.) [An earlier version of this paper was presented at the Conference of the Society for Research into Higher Education (Brighton, UK, December 11-13, 2007). The study it describes was supported by a grant from the UK Leadership Foundation for Higher Education.]

This paper examines how higher education can contribute to Africa's transformation, reviews the challenges and priorities for higher education institution building, and introduces a proposed partnership program among African and U.S. higher education institutions to strengthen African higher education. In July of 2007 the National Association of State Universities and Land-Grant Colleges (NASULGC) and the Partnership to Cut Hunger and Poverty in Africa, and the Forum for Agricultural Research in Africa (FARA) in partnership with Higher Education for Development (HED), and the American Distance Education Consortium (ADEC) came together to form an initiative to strengthen African higher education capacity in science end technology for development in partnership with U.S. institutions of higher education. At this stage, the Initiative has identified several broad goals and capacity building priorities based on initial research and stakeholder consultations with leaders in Africa and the United States. The primary goals of the Africa-U.S. Higher Education Collaboration Initiative are to enhance and empower higher education institutions in Africa and the U.S. to contribute more effectively to African development and transformation and to increase the competency of U.S. higher education institutions in global affairs related to Africa. (Contains 2 tables and 11 footnotes.)

American universities, we are often told, are the best in the world. Rankings of schools worldwide done by organizations in both China and Great Britain consistently are dominated by U.S. institutions. More than half of the top 100 schools (and eight of the top 10) in the Shanghai rankings, for example, are American schools. A huge portion of Nobel Prize award winners are individuals with close associations with American universities. Foreign students flock to America to derive the benefits of U.S. institutions of higher education. College graduates, on average, command significant pay premiums over those with lesser education. On the surface, it seems like we have a great high education system that works beautifully. But below the surface, there are a large number of flaws in the system. In this paper, the author addresses what can be called the "12 inconvenient truths about American higher education." These truths are: (1) High Costs; (2) Not Engine for Growth; (3) College Degrees Don't Guarantee Success; (4) College Students Work and Learn Little, Party Hard; (5) Undergraduate Students Are Often Neglected; (6) Most Students Do Not Graduate On Time; (7) Colleges Hide Vital Information from Consumers; (8) Freedom of Expression Is Curtailed; (9) Colleges Are Not a Force for Income Equality; (10) Colleges Are Run to Benefit Staff, Not Students; (11) Federal Student Financial Aid Doesn't Work; and (12) Intercollegiate Athletics Is Costly and Corrupt. (Contains 2 tables, 5 figures, and 14 notes.)