Search

Computer-based test (CBT) and paper-based test (PBT) are two test modes to the test takers that have been widely adopted in the field of language testing or assessment over the last few decades. Due to the rapid development of science and technology, it is a trend for universities and educational institutions striving rather hard to deliver the test on a computer. Therefore, research on the comparison between these two test modes has attracted much attention to investigate whether the PBT could be completely replaced. At the same time, task difficulty is always a key element to reflect test takers' performances. Numerous studies have laid a solid foundation and guidance about the comparative study of test takers' performance on CBT and PBT, but there still remains a scarcity from the perspective of task difficulties with different Common European Framework of Reference for Languages (CEFR) task levels in particular. This study, therefore, compared the test takers' performance on both CBT and PBT across tasks with different CEFR levels. A total of 289 principal recommended high school test takers from Macau took the pilot Test of Academic English (TAE) at a local university. The results indicated that there was a difference between test takers' performance on different test modes across different CEFR levels, but only CEFR A2 level showed a statistically difference between CBT and PBT. And since science and technology are continuously developing, it is essential for the university to consider switching the test mode from PBT to CBT.

In this study we compare the titles of scientific letters and those of research papers published in the field of astrophysics in order to identify the possible differences and/or similarities between both genres in terms of several linguistic and extra-linguistic variables (length, lexical density, number of prepositions, number of compound groups, number of authors and number of countries mentioned in the paper bylines). We also carry out a cross-genre and cross-journal analysis of the referred six variables. Our main findings may be summarized as follows: (1) When compared to research paper titles, scientific letter titles are usually shorter, they have a lower lexical density, they include a higher number of prepositions per number of words and a lower number of compound groups per number of words, although they have more up to 4-word compound groups, i.e. the simplest ones. As a consequence, scientific letter titles include less information, which is also less condensed, than research paper titles. (2) The predominance of compound adjectives over compound nouns in the titles of both genres highlights the scientificity of astrophysical discourse. (3) In general terms, our data show a positive correlation between title length and the number of countries mentioned in the bylines for both genres. The positive correlation between title length and number of authors is only met in the case of research papers. In light of these findings, it may be concluded that scientific letters are a clear example of a timeliness and more "immediate" science, whereas research papers are connected to a more timeless and "elaborate" science. It may also be concluded that two different collaboration scenarios are intertwining on the basis of three separate geographic and linguistic publication contexts (Mainland Europe, The United Kingdom and The United States of North America).

In this paper, we present an activity to introduce the idea of public-key cryptography and to make pre-service STEM teachers explore fundamental informatics and mathematical concepts and methods. We follow the Theory of Didactical Situations within the Didactical Engineering methodology (both widely used in mathematics education research) to design and analyse a didactical situation about asymmetric cryptography using graphs. Following the phases of Didactical Engineering, after the preliminary analysis of the content, the constraints and conditions of the teaching context, we conceived and analysed the situation a priori, with a particular focus on the milieu (the set of elements students can interact with) and on the choices for the didactical variables. We discuss their impact on the problem-solving strategies the participants need to elaborate to decrypt an encrypted message. We implemented our situation and collected qualitative data. We then analysed a posteriori the different strategies that participants used. The comparison of the a posteriori analysis with the a priori analysis showed the learning potential of the activity. To elaborate on different problem-solving strategies, the participants need to explore and understand several concepts and methods from mathematics, informatics, and the frontier of the two disciplines, also moving between different semiotic registers.

This research was carried out to add to the current literature on learning styles by explaining various understandings of the topic and the previous research on it. Studies and information on learning styles and strategies are abundant, and the need for more research stems from the recent move towards student-centered classes. This paper is an attempt to do more specific research on the subject and answer the question of what the correlations are between learning styles and different factors such as gender and learner's cultural background. This study was conducted at the University of Nottingham. Seventy students have participated in the survey, 34 males and 36 females. The participants' nationalities were mixed, which was essential for the study; Kurdish (20%), British (40%), European States (10%) and Asian (17.1%). The questionnaire results were analysed by using IBM SPSS Statistics 21 software. Frequency tests, Correlation analysis, T-Tests, and One-way ANOVA test of the available data were studied. The findings show that Kurdish learners are auditory learners compared to other nationalities. Also, the study showed that language learners are more visually inclined learners than learners from the other majors. Finally, future researchers may expand on the findings of this paper by getting a larger sample.

Since it was first published by the Council of Europe in 2001, the Common European Framework of Reference for Languages (CEFR) has become one of the most widely referenced documents in language education, particularly in English language teaching and assessment (Savski, in press). The recently released CEFR Companion Volume (2020), with its new descriptions of plurilingual and pluricultural competence and mediation, has done much to extend the potential of the framework, as it provides a more concrete foundation for using CEFR to support heteroglossic pedagogies. In this way, CEFR has acquired a greater level of potential relevance to innovative pedagogies in English language education, such as Global Englishes Language Teaching (GELT), which seeks to equip learners with communicative skills and dispositions needed for success in a world where the target interlocutors are linguistically and culturally diverse (Rose & Galloway, 2019). In this paper, we examine the prospects for using CEFR to support heteroglossic pedagogies like GELT, highlighting points of convergence between descriptions of competence in CEFR and current scholarship in Global Englishes, as well as points of divergence between the two. We underline the need to embed CEFR in decentralizing educational reforms, in which the framework is used to facilitate teacher agency, rather than to impose objectives and methods upon them.

Post-secondary institutions spend considerable resources on programs, such as study abroad and international work-integrated learning, which involve students' participation in international experiences. One significant impetus for these programs is the hope that through exposing students to international settings these students will be better prepared to be successful in global workplaces upon graduation, in essence be more "global-ready". However, simply having an international experience does not necessarily lead to the development of capabilities that result in global workplace success. In addition to the knowledge, skills and abilities required for any workplace, being successful in these global workplaces also requires intercultural effectiveness. This paper presents the findings of a study that examined the development of cultural intelligence (CQ), the ability to be effective in intercultural encounters, in students participating in a Canadian-European exchange program (CANEU-COOP) where the European students had a study term in Canada and the Canadian students had a co-op work term in Europe. The study found that while both groups of students developed CQ, there were differences between the groups. These findings reaffirm the importance of intentionally structuring international experiences to include curriculum about and assessment of intercultural effectiveness. [Paper presented at the World Association for Cooperative and Work-Integrated Education, International Research Symposium on Cooperative and Work-Integrated Education, (2nd, Victoria, British Columbia, Canada, 2016).]

Purpose: Recognising the importance of universities in the achievement of social and global objectives, this paper aims to study the relevance of the global reporting initiative (GRI) methodology for reporting University Social Responsibility (USR) activities, taking into account the specificity of higher education institutions (HEI). Design/methodology/approach: After a review of the literature and background, the European HEI reports prepared according to the latest version of GRI standards are selected and a comparative study is carried out. The analysis focusses on comparing to what extent the standards are responding to the information needs generated in the field of higher education. Findings: General issues, common to all types of organisations, are adequately reported by HEIs, but difficulties are encountered in integrating a vision that incorporates the role of their missions in standards related to economic, social and environmental aspects. Research limitations/implications: There are few GRI reports with this format and further research is encouraged as the number of reports increase. So far, major limitations have been found by HEIs to account for their societal missions when using the GRI. Practical implications: The debates on USR are promoting an increase in the number of reports on sustainability. This paper provides some examples of the use of disclosures that can be adapted in this context, to move towards the systematisation of these practices. Originality/value: This is, to the authors' knowledge, the first comparative study on the application of GRI to sustainability reports at a European level, focussing on the adequacy between disclosures and missions.

The calibration of test materials generally involves the interaction between empirical analysis and expert judgement. This paper explores the extent to which scale familiarity might affect expert judgement as a component of test validation in the calibration process. It forms part of a larger study that investigates the alignment of the LanguageCert suite of tests, Common European Framework of Reference (CEFR), the China Standards of English (CSE) and China's College English Test (CET). In the larger study, Year 1 students at a prestigious university in China were administered two tests--one with items based on China's College English Test (CET), and the other a CEFR-aligned test developed by LanguageCert--the LanguageCert Test of English (LTE). Comparable sections of the CET and the LTE involved sets of discrete items targeting lexico-grammatical competence. In order to ascertain whether expert judges were equally comfortable placing test items on either scale (CET or CEFR), a group of professors from the university in China who set the CET-based test, were asked to expert judge the CET items against the nine CSE levels with which they were very familiar. They were then asked to judge the LTE items against the six CEFR levels, with which they were less familiar. Both sets of expert ratings and the test taker responses on both tests were then calibrated within a single frame of reference and located on the LanguageCert scale. In the analysis of the expert ratings, the CSE-familiar raters exhibited higher levels of agreement with the empirically-derived score levels for the CET items than they did with the equivalent LTE items. This supports the proposition that expert judgement may be used in the calibration process where the experts in question have a strong knowledge of both the test material and the standards against which the test material is to be judged.

The introduction of the CEFR was welcomed by researchers and practitioners in language education, given its potential for increasing transparency of test results and the meaningfulness of test scores. In this paper, I reflect on Glenn Fulcher's (2004, 2016) critical take on the use of the CEFR in the context of mapping (linking or aligning) test scores to the CEFR proficiency levels and the implications for score interpretation and use. I argue that although mapping test scores to the CEFR levels can enhance score interpretation, the field of language assessment needs to address misinterpretations of score mapping as sufficient evidence of quality of test design or comparability of scores of different tests.

A range of different factors drive student decision-making with respect to studying abroad, they are called push and pull factors. They influence in the (non)-mobility experience of students. This paper focuses on the international student experience, predominantly focusing on: credit-degree mobility and bachelor -- master students. The aim of this paper is to identify enablers and obstacles within the process of going abroad according to service provision along the international student lifecycle. By applying an innovative method -- Latent Dirichlet Allocation (LDA) -- to employ new techniques when looking for hidden structures in large numbers of texts (73,715 reviews from international students), we conclude that they exist significant differences between degree and credit mobility students, and not when comparing bachelor and master students. As a result, both groups of students place importance on three main aspects during their international experience: offerings of the city, social life and academics.

This paper examines the sources of authority behind the Bologna and ASEM secretariats' technocratic appearance and administrative routines, and argues that they are transnational policy actors in their own right. By drawing on principal-agent theory and the concept of "authority," it offers an alternative framework for understanding the various forms of authority. The case studies generate three important insights. First, it shows how the secretariats derive their authority from the "tasks delegated by states," the "moral values" and social purpose they uphold, and the "expertise" they possess. Second, it compares how the different governance structures of the Bologna and ASEM education processes impact on the secretariats' authority. Third, it highlights how the secretariats exercise their respective authorities and exert their discernible influence at different stages of higher education policy-making and region-building processes. [The paper was presented at the European Consortium for Political Research (ECPR) conference in Prague.]

This paper uses data from the OECD's 2015 PISA and an endogenous treatment effects model to investigate the impact of different intensities of digital device use for academic purposes on science learning outcomes. When we do not differentiate the location of device use, we find that greater use can help students improve their science scores in most of the countries. When we consider school and outside-of-school use separately, we find the above positive results are driven by outside-of-school digital device use and that there are more negative results of increased device use at school.

This paper argues that the progressive, revisionist reaction within Catholic education and schooling, as well as within Catholicism at large, to the challenge of modernity is a mistake. In view of modernity's malaises, it advocates instead the affirmation or reaffirmation of the ideal of traditional Catholicism as the only authentic response for Catholics to modern progress. In order to justify the distinctiveness of a traditional Catholic identity and educational project, the paper offers an outline of a distinctively Thomistic educational philosophy. Its defense of the (re)affirmation of the ideal of traditional Catholic education and schooling in secularized society is neither ultra-conservative nor romantic.

Student learning outcomes assessment examines whether programs cover the material stated in their learning goals, whether students are learning the material, and the impact on student retention, graduation, post-graduation outcomes, and institutional accreditation, with the aim of providing faculty with data that can be used to help programs evolve or improve. While there is a plethora of research regarding effective methods of assessment used in the United States, little has been written regarding cross-national comparisons of assessment methodologies. This paper examines the current state of assessment in several nations and regions, and draws parallels in practices across countries. A literature search using the term "outcomes assessment" yielded 228 articles, of which, only 35 described practices outside the United States. Generally, searches on the terms "outcomes assessment" and "global" tend to return studies of outcomes assessment of teaching about global issues as it is practiced in the United States, rather than results about outcomes assessment practices used in other countries.

The analyses described in this paper permitted an evaluation of whether capacity-building professional development practices were related to early childhood intervention practitioners' reported use of capacity-building family-centered practices. This was ascertained by structural equation modeling for two different types of family-centered practices (participatory and relational) where the two models were compared to determine the better fitting model and the sizes of effects for the relationships among the variables in the models. Results provided converging evidence that capacity-building professional development engenders practitioners' use of capacity-building family-centered practices. Implications for practice are described.

Purpose: The article gives a brief introduction to the Council of Europe Charter on Education for Democratic Citizenship and Human Rights Education (EDC/HRE) and illustrates the review process of its implementation. Focusing on the second review cycle of 2016, it stresses that the Council of Europe fell short of a thorough analysis of the discrepancy in perceptions between governments and NGOs with respect to the effective implementation of EDC/HRE. Design/methodology/approach: Looking at the 2017 Report resulting from the second review cycle, the paper analyses analogies and discrepancies between responses received from governments and civil society organisations to the surveys organised by the Council of Europe. Findings: Through the selection of answers analysed, it is shown that there are areas in which responses from governments and civil society organisations are similar and aligned, for example on the issues for EDC/HRE to address and on the little priority given to make financial support available. However, there are other areas in which considerable discrepancy can be highlighted. The article draws a reflection on the way in which the Report has been put together and argues that, in order to build a more accurate analysis, the Council of Europe should have connected the responses received from governments and civil society organisations and make them dialogue, rather than providing two unrelated summaries on the state of citizenship and human rights education without merging analogies and questioning discrepancies between responses received from different stakeholders.

The paper focuses on the comparative analysis of professional competences development in public management and administration university programmes and the possibilities of implementation of international experience in Ukraine. Using the methods of comparative and system-functional analysis, synthesis and generalisation, the authors concentrate on the features of curriculums in public administration field taking into account the current realities of social development. The most common methods of training in the field of public administration and their practical focus are analysed. Particular attention is paid to the methods of problem-based learning in public administration, including case studies, case scenarios, and simulation games as part of the education gamification. The authors carried out an essential comparison of competences adopted in the European public administration training and those defined in the Ukrainian Standard of Higher Education in this area and revealed that the Ukrainian Standard lacks a pool of competencies related to the development and analysis of public policy.

One of the important positions of the last curricular reform in Slovenia, which included systemic issues of education (White Paper on Education, 2011) and curricula for compulsory subjects in primary school, is the fact that Slovenia has been integrated into Europe, and thus education should also include the development of core European competences. One such competence is cultural awareness and expression, which until now has been an issue more in the context of cultural policies than school policies in Slovenia. The purpose of the present article is to critically analyse the curricular reform of art education (i.e., visual art education), through which, in terms of certain components of the competence of cultural awareness and expression, it is foreseen that the student will gain a knowledge of art, develop an ability to experience works of art and develop a creative attitude towards art and heritage. Because the starting point and goal of curricular change is the curriculum, our analysis is derived from curriculum theories, and not from the art theories and pedagogical theories that have predominantly framed previous attempts at curriculum analysis. Critical consideration of the curricular reform of art education in primary school in terms of certain components of the competence of cultural awareness and expression was undertaken by comparing curricula in the field of aesthetic education. We compared art education with music education and literature within the Slovenian language curriculum. Qualitative analysis showed that, despite the reform, the curriculum for arts education does not realise selected components of the competence of cultural awareness and expression, largely due to the curriculum's conceptual structure. Art education is centred principally on art-making activities, with an obvious neglect of appreciation. The integration of arts subjects at school, as proposed by the White Paper, is therefore not possible, due to the existing model of art education. From a practical point of view, the analysis also raised the question of the knowledge and competences of teachers.

The paper aims to contribute to the assessment of the contextual relevance of various educational policies through an analysis of three aspects of the performance profiles of European countries: participation, the quality of learning outcomes and the equity of learning outcomes. Comparative analysis of international student achievement assessment surveys and statistical data reveals three European performance patterns: the compensative education systems of North and Northwest Europe, the selective education systems of Central Europe and the attritional education systems of Southeast Europe. On the basis of the identified performance patterns, the paper provides a brief outline of major trends within the Central and Southeast European regions, shares reflections on the alignment of policies that fit the distinct context of the two regions and offers a conceptual framework for further comparative research.

To what extent are differently 'Europeanising' school forms programmatically geared towards building transnational solidarities, as their ethoses might suggest? This study draws on an analysis of discursive constructions of solidarity in the curricula for social studies and humanities at secondary level of two forms of schooling promoting a European ethos: the supranationally organised "Schola Europaea" and state-organised schools with a European profile in Germany (Europaschulen). I argue that solidarity is anchored in universalising ideals of humanitarianism, intercultural harmony, and political participation centred around the individual and her skills rather than a sense of a 'thick' pan-European community. The 'transnational' scale of solidarity manifests as interpersonal relationships beyond national affiliations, based on affective, religious, and ethical commitments to vulnerable others or on rational political action to ensure human and civil rights. Meanings and scales of solidarity are decoupled from the Europeanising ethos of the schools and from the different organisational logics in which they are embedded; instead, they reflect the disciplinary logics of the school subjects and curricular contexts where they are most often mobilised: religion, ethics, and politics. The paper ends with a discussion of these findings within broader debates on transnational solidarities and Europeanisation in education.

Mobile-based micro-learning has gained a lot of attention lately, especially for work-based and corporate training. It combines features of mobile learning and micro-learning to deliver small learning units and short-term learning activities. The current study uses the lens of the Self-Determination Theory of motivation and proposes a series of Mobile-Based micro-Learning and Assessment (MBmLA) homework activities to improve high school students' motivation and learning performance in science. An experiment was conducted to evaluate the effectiveness of the proposed approach. One hundred and eight students of a senior-level high school in Europe were randomly assigned into either a control condition (conventional paper-based homework approach) or an experimental (MBmLA approach) condition. The study carried out for a period of 5 weeks. From the experimental results, it was found that, in comparison to the conventional paper-based approach, the proposed MBmLA approach enhanced students' basic psychological needs of self-perceived autonomy, competence, and relatedness and improved students' exam performance in terms of factual knowledge. Moreover, students self-reported greater learning satisfaction with the mobile-based microassessment and micro-learning homework tasks. Implications on educational practices as well as future research are discussed.

Purpose: The study of the problems hindering improvement of the system of training through standardization of qualification requirements is relevant because, in a globalized system of teaching staff and high rates of migration, not only national but also international requirements for employees should be considered. This increases the competitiveness of university and college graduates in different countries. The purpose of this paper is to develop recommendations for the creation of a system of lifelong learning through the application of professional standards. Design/methodology/approach: The leading method in the study of this problem is the comparative analysis of the experiences of different countries to improve the training system based on the use of qualification frameworks. Findings: The paper offers science-based measures of integration and the international experience of lifelong learning, through the application of standards of World Skills International, as well as the requirements of professional standards. Originality/value: The authors formulate the conceptual directions for the application of professional standards in not only the continuous training and qualification of personnel, which allows identifying "gaps" in the competences, but also building individual educational trajectory. Article submissions are of practical value to the organization, personnel training as well as scientists engaged in the study of international best practice using standardization requirements for the qualification of personnel in education.

Suprasegmental features are essential in conveying meaning; however, they are one of the neglected topics in teaching Turkish as a foreign/second language. This paper aims to examine read speech by Arabic students learning Turkish as a second language and describe their read speech in terms of stress and pause. Within this framework, 34 Syrian students enrolled in Gaziantep University Turkish Teaching Application and Research Center (TÖMER) at B2 level were asked to read a text chosen from one of the books prepared in accordance with the European language portfolio B2 level. Voice recordings were analyzed using Praat and Cool Edit software programs. Students' stress and pause durations were compared and contrasted according to the criteria set by experts. The results showed that students' stress and pause patterns showed statistically significant deviations from those criteria.

This study aims at discovering the relevance of general competence of Turkish and Arab learners who have an A1 level of English proficiency in preparatory school of University of Turkish Aeronautical Association (UTAA) to their speaking skill in terms of syntax by analyzing the recordings of speaking exams in the first semester. One can ask why learners could ever perform a great variety in syntactic structure in spoken performance while the university ensures that all learners get a standardized language education based on the same syllabus and course books to succeed their future academic studies. The answer may seem easy; however, it is difficult to get out thoroughly. Therefore, the paper will try to explain this connection between better performances in terms of syntactic structures in spoken performance comparing to Common European Framework of Reference (CEFR) A1 level expectations and these learners' attitudes, motivation, background of education, and world knowledge. During the process, the information falling within the scope of general competence (declarative knowledge and existential competence) is held by one-to-one interviews with 22 randomly chosen learners. The results mainly showed that the learners who invested in developing general competence have their own independent "wordrobe" and a higher level and variety of syntactic structures in their speaking whereas the rest and also the majority of the learners who are not as competent regarding declarative knowledge and existential competence (attitude and motivation) show a standard level of syntax (commonly used structures as defined in ALTE) in speaking.

Recent advances in machine learning have made automated scoring of learner speech widespread, and yet validation research that provides support for applying automated scoring technology to assessment is still in its infancy. Both the educational measurement and language assessment communities have called for greater transparency in describing scoring algorithms and research evidence about the reliability of automated scoring. This paper reports on a study that investigated the reliability of an automarker using candidate responses produced in an online oral English test. Based on 'limits of agreement' and multi-faceted Rasch analyses on automarker scores and individual examiner scores, the study found that the automarker, while exhibiting excellent internal consistency, was slightly more lenient than examiner fair average scores, particularly for low-proficiency speakers. Additionally, it was found that an automarker uncertainty measure termed Language Quality, which indicates the confidence of speech recognition, was useful for predicting automarker reliability and flagging abnormal speech.

This paper presents a comparative analysis of the effect of different educational orientations at the upper-secondary level on labour market outcomes across European countries. The study separates safety net effect and the diversion effect of Vocational Education and Training (VET). Using PIAAC data, we show cross-national differences in the early career advantages of vocational qualifications. The results indicate that vocational effects vary according to outcome. In general, negative effects on occupational status are consistent with earlier research. The safety net function of VET is only observable in a few countries. We also studied the impact of different institutional level characteristics. The analysis of the impact of macro-level characteristics reveals VET's safety net effect is observable only in countries with the highest occupational specificity of VET. At the same time, work-based VET is increasing its diversion effect. Crucial issues are the differences in general competencies between graduates of VET and general upper-secondary school graduates. The major differences are the simultaneous weakening of VET's safety net effect and the strengthening of the diversion effect.

For the past 14 years the Social Ecological Responsibility in Science and Engineering Education (SERSEE) Network has discussed the challenging but necessary task of teaching social and ecological responsibility to science and engineering students. Identifying, sharing and developing best practices, pedagogical materials and tools as well as a strategy for promoting it at universities can aid and promote this endeavour. This paper presents the central concepts and pedagogical methods that have emerged during the informal network's meetings, and compares these concepts and methods to trends in the research literature.

Multicultural European societies increasingly demand internationally oriented citizens, who are willing to actively participate in civic life and able to successfully access the labour market. The European dimension in education supposedly endows youngsters with civic values, multiculturalist attitudes and plurilingual competences which ultimately lead to raising awareness of their Europeanness. Formative years at university, pivotal to students' individual life course and projects, are a decisive stage in the development of supranational, collective identity-formation. Similarly, pan-European study programmes are aimed at inspiring a sense of European citizenship and identity, the most renowned of which within the Higher Education context is Erasmus+. By conducting focus group interviews, this paper probes Andalusian university students' understanding of their European identity and verifies the causal dynamics between European identity-taking and foreign country sojourns, comparing the perceptions expressed by returnees to those by students who have not had the opportunity to participate in international study programmes (ISP) at higher education yet. Results evidence students' apparent supranational orientation, general awareness of commonalities across Europe and utilitarian outlooks on the EU, although not a clear discernment of its institutions or a marked European identity.

The Ocean Literacy movement began in the U.S. in the early 2000s, and has recently become an international effort. The focus on marine environmental issues and marine education is increasing, and yet it has been difficult to show progress of the ocean literacy movement, in part, because no widely adopted measurement tool exists. The International Ocean Literacy Survey (IOLS) aims to serve as a community-based measurement tool that allows the comparison of levels of ocean knowledge across time and location. The IOLS has already been subjected to two rounds of field testing. The results from the second testing, presented in this paper, provide evidence that the IOLS is psychometrically valid and reliable, and has a single factor structure across 17 languages and 24 countries. The analyses have also guided the construction of a third improved version that will be further tested in 2018.

This paper uses representative student data from St. Petersburg, Russia to analyze school segregation by parental socioeconomic status and student academic performance. The proposed systematic segregation indices account for ordinal variables and take expected segregation into account. We decompose segregation by school type, school, and classes and compare the results to results obtained from PISA for urban areas in Russia and six European countries. Segregation by socioeconomic status is moderate in St. Petersburg and Russia, as compared to other European countries. Segregation between schools and school types reflects parental choice, whereas within-school segregation along the lines of student performance reflects school policies.

Universities have to cope with scarce resources and nevertheless are expected to achieve excellent results in research, teaching, and third mission. Therefore, efficient resource use is of great importance. This paper explains emerging concepts and requirements of efficiency analysis, connecting it to university rankings. In order to achieve efficiency improvements, dynamic timeseries analyses are important and helpful in order to understand developments and effects in university processes and structures. The longitudinal efficiency analysis technique DEA Malmquist index is presented as application example with THE and Leiden ranking data for 68 European universities 2011-2016. Results demonstrate an improvement potential of up to one-third and a very diverse distribution of dynamic efficiency changes among institutions.

Background: Although teachers of English are required to assess students' speaking proficiency in the Common European Framework of Reference for Languages (CEFR), their ability to rate is seldom evaluated. The application of descriptors in the assessment of English speaking on CEFR in the context of English as a foreign language has not often been investigated, either. Methods: The present study first introduced a form of rater standardization training. Two trained raters then assessed the speaking proficiency of 100 learners by means of actual corpus data. The study then compared their rating results to evaluate inter-rater reliability. Next, ten samples of exact/adjacent agreement between Raters 1 and 2 were rated by six teachers of English in tertiary education. Two of them had attended rater standardization training with Raters 1 and 2, while the other four had not received any relevant training. Results: The two raters agreed exactly in 44% of cases. The rating results between the two trained raters were closely correlated ([rho] = 0.893). Cross-tabulation showed that in one third of the samples, Rater 2 scored higher than Rater 1 and they agreed more often at the higher levels. The better rating performance of Teachers 1 and 2 suggested that rater standardization training may have helped enhance their performance. The unsatisfactory proportion of correctly assigned levels in teachers' ratings overall was probably due to the high input of subjective judgment based on vague CEFR descriptors. Conclusions: Regarding assessment, it is shown that the attendance of rater standardization training is of help in assessing learners' speaking proficiency in CEFR. This study provides a model for assessing data from spoken learner corpora, which adds an important attribute to future studies of learner corpora. The paper also raises doubts about teachers' ability to evaluate students' speaking proficiency in CEFR. As CEFR has been widely adopted in the relevant fields of English language teaching and assessment, it is suggested that the rating training framework established in this study, which uses learner corpus data, be offered to (prospective) teachers of English in tertiary education.

The discussion takes up the common theme across the seven contributions of this special issue, namely the CEFR's suitability as a basis for setting university entrance standards. The special issue allows insights into this theme from a multitude of contexts, languages and perspectives, including data from stakeholders, students, tests and their documentations, as well as student performances and teacher judgements. The contributions of the seven papers are first discussed with a view to examining current practices of setting entrance requirements and the suitability of the CEFR as a means of comparison between different tests and contexts. The discussion then moves on to acknowledge that the CEFR alone cannot guarantee that different institutions and stakeholders will use it in a comparable way and come to comparable interpretations when employing and interpreting its proficiency scales. In order to overcome these challenges, possible ways of dealing with discrepancies when comparing different tests and contexts that are suggested by the seven contributions in this special issue are discussed, with a particular view on how these contributions answer earlier calls for further research. Finally, the discussion outlines ways forward to improve practices and stimulate future research in the realm of setting university entrance requirements.

In contrast to the continued decline and bleak future of liberal arts education and liberal arts colleges in Europe and America, there has been a revival of the liberal arts model in Asian countries in recent years. This paper compares the liberal arts tradition of education in the West and Confucian tradition of education in the East, in the aspects of educational goal, curriculum, and pedagogy, as well as the way both traditions are institutionalized. It makes connections between these humanistic approaches to demonstrate the common ground for the education of mankind: human beings need to develop meaning for life and to be able to relate to others in order to have a fulfilling life, and highlights the importance of such humanistic approaches as liberal arts education and the Confucian tradition in an increasingly utilitarian and vocation-oriented world.

Student evaluations of teaching (SETs) are widely used to measure teaching quality in higher education and compare it across different courses, teachers, departments and institutions. Indeed, SETs are of increasing importance for teacher promotion decisions, student course selection, as well as for auditing practices demonstrating institutional performance. However, survey response is typically low, rendering these uses unwarranted if students who respond to the evaluation are not randomly selected along observed and unobserved dimensions. This paper is the first to fully quantify this problem by analyzing the direction and size of selection bias resulting from both observed and unobserved characteristics for over 3000 courses taught in a large European university. We find that course evaluations are upward biased, and that correcting for selection bias has non-negligible effects on the average evaluation score and on the evaluation-based ranking of courses. Moreover, this bias mostly derives from selection on unobserved characteristics, implying that correcting evaluation scores for observed factors such as student grades does not solve the problem. However, we find that adjusting for selection only has small impacts on the measured effects of observables on SETs, validating a large related literature which considers the observable determinants of evaluation scores without correcting for selection bias.