Search

The aim of the study is to illustrate a comprehensive approach to item bias in cross-cultural research by integrating quantitative and qualitative data in a mixed methods design. We studied responses and response processes of Dutch and Spanish participants to quality of life items from five international studies. Item bias was evaluated by analyzing differential item functioning (DIF) with several statistical procedures. Statistical results were combined with qualitative evidence of response processes from cognitive interviewing (CI). These integrated results yielded a coherent picture of bias sources. Nonuniform DIF was linked to differences in the response processes, whereas uniform DIF was associated with differential meaning of the item contents. We conclude that the mixed methods approach holds important promise for understanding bias.

This article analyses the intercultural competence of students from Turkey who participated in the EuRopean Community Action Scheme for the Mobility of University Students (Erasmus). Intercultural competence is an important aspect of 21st-century skills and lifelong learning. The study presented here also considered antecedent factors such as participants' cultural capital and home--host domains as well as identity-related issues. It aimed to understand the dynamics of relating to the new destination/culture: awareness of one's own culture/society/surroundings; availability of social networks and support; approach to learning (language, practical matters, relevant cultural information, etc.), and communication. The researchers' findings demonstrate constructive change in terms of learning, communication-connection, self-management and cultural awareness. They confirm the importance of various layers of friendship networks (but not necessarily ethnic ties), as well as a balanced composition of home and host domain resources. Regarding identity issues, students were observed to cling to universal identities, such as being an international/exchange student, and/or strategic personal ones, rather than religious, ethnic and national identities. The sojourn period can be defined as an academic but more notably a sociocultural engagement towards becoming more conversant in daily routines and personal gains in a transnational space. This highlights the importance of informal educational experiences.

We examined Differential Item Functioning (DIF) and the size of cross-cultural performance differences in the Programme for International Student Assessment (PISA) 2012 mathematics data before and after application of propensity score matching. The mathematics performance of Indonesian, Turkish, Australian, and Dutch students on released items was compared. Matching variables were gender, an index of economic, social and cultural status, and opportunity to learn, in exact, nearest neighbor, and optimal matching. Logistic regression and structural equation modeling were used to identify DIF. If propensity scores were used in the DIF analyses as performance predictors, much less DIF was found than in the original data; similarly, when in tests of country differences in mathematics performance, propensity scores were used as covariates, effect sizes of tests of country differences were reduced substantially. We concluded that propensity scoring provided us with a new tool to better control sources of DIF and country differences in PISA mathematics performance.

The few studies on the achievement differences of mainstream and immigrant primary school students in large-scale assessments point to an achievement gap in many subject areas, with immigrant students trailing mainstream students. A recurrent methodological problem of these studies is that the two student groups do not come from comparable backgrounds. This study examined the Trends in International Mathematics and Science Study (TIMSS) math achievement of 4th grade mainstream and immigrant students in various European countries. Results showed that there was no systematic difference between first- and second-generation immigrants' mathematics achievement levels. It was found that after statistically matching the background resources of the mainstream and immigrant students, both groups revealed comparable levels in mathematics. Finally, related to country characteristics that were associated with educational achievement, it was found that immigrant students in countries which had higher human development indicators showed higher educational performance.

We investigated how the knowledge and usage of two languages relate to sociocultural adjustment in bilingual adolescent samples from three ethnic groups in Indonesia (214 Javanese, 108 Toraja, and 195 Chinese adolescents; 272 females; M[subscript age] = 14.33 years). We tested a model specifying that the vocabulary knowledge of each language mediates the relation between language usage and sociocultural adjustment (here combining strongly correlated measures of adjustment to the ethnic and national culture). The results revealed the same partial mediation model in all groups; bilingualism is important for sociocultural adjustment in all ethnic groups. There were substantial group differences in ethnic language vocabulary scores, but the correlations between ethnic language usage with sociocultural adjustment were the same across groups. Results also showed that ethnic language usage matters more than ethnic language knowledge, and national language knowledge matters more than ethnic language knowledge for sociocultural adjustment. Moreover, our findings confirm that there is a language shift going on in Indonesia because Bahasa Indonesia as national language, which was the second language in the past, has become the dominant language across ethnic groups in Indonesia.

As schools are becoming more culturally diverse, it is crucial to understand how they can approach this diversity in ways that allow all students to feel included and do well. We focus on the manifestation of two related but distinct approaches to cultural diversity, namely "equality and inclusion" (i.e., promoting positive intergroup contact) and "cultural pluralism" (i.e., embracing students' diverse cultural backgrounds as a resource), in the perceived classroom climate. Specifically, we test a model in which the link of cultural diversity climate at school and student outcomes (achievement, academic self-concept and general life satisfaction) is mediated by sense of school belonging, both at the individual and classroom level. Analyses are based on 1,971 students (61% of immigrant background; M[subscript age] = 11.53, SD[subscript age] = 0.73, 52% male) in 88 culturally diverse classrooms in southwest Germany after their first year at secondary school. Individual- and classroom-level results suggest that both perceived equality and inclusion as well as cultural pluralism are positively associated with outcomes and this link is mediated by school belonging. There were no differences in the effects of (perceived) cultural diversity climate and school belonging between students of immigrant and nonimmigrant background, suggesting that dealing with cultural diversity in a constructive way is beneficial for all students attending multiethnic schools.

In this commentary on the special issue, it is argued that the studies presented illustrate three pivotal characteristics of a new, evolving paradigm to study the consequences of prolonged intercultural encounters, such as globalization. The first refers to the topics studied and involves the need to delineate more distal, universal, and more proximal, culture-specific elements in intercultural encounters in these topics. The second is the need to deal with variation in intensity and focus of intercultural contact, ranging from casual contact to immersion. The third involves the need to delineate the psychological mechanisms involved in intercultural contact (and their consequences). The studies in the special issue illustrate the importance of including contextual features in the study of globalization. Challenges of the evolving paradigm are described.

This study illustrates how the cognitive interviewing (CI) method can provide qualitative evidence of item, construct, and method bias in cross-cultural research. CI was conducted with participants from the Netherlands and Spain, who responded to quality-of-life (QoL) items included in international survey research projects. Qualitative findings indicate that, at the construct level, Spanish participants were more affected by the particular wording of the item stems, which made them modify their understanding of the intended constructs while answering, whereas Dutch participants were more focused on being consistent in their responses. At the item level, differences in the interpretation of key terms in QoL items were mainly related to translation and cultural issues. Method bias was manifested in the differential use of response options and anchor labels. Results of the study support the contribution and usefulness of CI to informing about the three types of bias from a qualitative approach.

We set out to address the adequacy of dyslexia screening in Dutch and non-western immigrant children, using the Dutch Dyslexia Screening Test (DST-NL) and outcomes of the Dutch dyslexia protocol, both of which are susceptible to cultural bias. Using the protocol as standard, we conducted an ROC (Receiver Operating Characteristics) analysis in Dutch and immigrant third, fifth, and seventh graders, combining a cross-sectional and longitudinal design. Sensitivity and specificity increased with grade, but were non-significant for various subtests in the lowest grade, suggesting considerable non-convergence between the two measures. Effective subtests in all grades, presumably not strongly influenced by Cultural Background or Word Lexicon, were One-Minute Reading, Non-Word Reading, and Nonsense Passage Reading. In a multilevel analysis, cultural background, dyslexia diagnosis, parental education, and grade of first assessment were predictors of subtest performance. In a second analysis, Word Lexicon was added as a proxy of knowledge of the Dutch language and culture. After controlling for Word Lexicon, cultural background became significant for most subtests, suggesting the presence of cultural bias. Subtests assessing technical literacy, such as One-Minute-Reading, Non-Word-Reading, One-Minute-Writing, or Two-Minutes-Spelling, showed more convergence between the two assessments. Less-effective subtests were Naming Pictures, Backward Digit Span, and Verbal and Semantic Fluency. It is concluded that the DST-NL and the standard protocol do not show complete convergence, notably in the lower grades in the multilingual pupil group of our cohort, mainly because dyslexia and literacy difficulties are hard to disentangle.

Navigating between cultures in addition to developmental changes and challenges in early adolescence can be difficult. We investigated school, family, and ethnic group as conditions for acculturation and school adjustment among early-adolescent boys and girls. Analyses were based on 860 mostly second- and third-generation immigrant students from 71 countries (50% male; M[subscript age] = 11.59 years), attending German secondary schools. Perceived support for inclusion and integration in school and family were associated with a stronger orientation toward both cultures (integration) and better adjustment (e.g., higher school marks, more well-being). Perceived cultural distance and ethnic discrimination were associated with a stronger ethnic and weaker mainstream orientation (separation), and lower adjustment. Boys perceived contextual conditions more negatively, had a weaker mainstream orientation, and showed more behavioral problems but did not differ from girls in the associations between contextual conditions and acculturation and adjustment. Implications for research, policy, and practice are discussed.

We examined the importance of parental culture maintenance behaviour, bilingualism, ethnic identity, and national identity for the well-being of adolescents in multicultural Indonesia. We tested a mediation model in which the link between (perceived) parental culture maintenance behaviour and well-being is mediated through speaking Bahasa at home and national identity on the one hand and speaking the ethnic language at home and ethnic identity on the other hand. Participants were 448 adolescents (261 females) from four Indonesian ethnic groups (Chinese from Java, Chinese from North Sumatra, Batak, and Javanese), aged between 12 and 19 years (M[subscript age] = 15.92 years). We found support that parental culture maintenance was positively related to both ethnic and national identity, was correlated to the usage of ethnic language at home, but not correlated to usage of Bahasa Indonesia at home, language usage was not associated with identity; there was no link between parental culture maintenance behaviour and usage of languages at home with well-being, but both national and ethnic identity were positively associated with children's well-being across groups. We conclude that parental culture maintenance, ethnic identity, and national identity are important for the well-being of adolescents, whereas speaking the language is independent from well-being and ethnic identity.