Search

Background: Although research on mathematics learning programs has taken off in recent years, little is known about how different person characteristics are related to practice behaviour with such programs. When implementing a mathematics learning program in the classroom, it might be important to know whether students with specific characteristics need more encouragement to make use of this learning opportunity. Objectives: Using a supply-use model, we analysed the predictive power of students' cognitive characteristics (prior mathematics knowledge), personality traits (conscientiousness), motivational-affective characteristics (mathematics self-concept and mathematics anxiety), and family background characteristics (socioeconomic status and migration background) for practising with an adaptive arithmetic learning program. Methods: We used longitudinal data from 203 fifth graders from seven non-academic-track schools in Germany. Practice behaviour, measured by completed tasks in the learning program, was recorded weekly for every student over a period of 22 weeks. Results and Conclusions: The results of our multilevel analyses showed that mathematics anxious students practised less with the program. We did not find any relationship with the other characteristics. Takeaways: Our results suggest that mathematics anxious students need more encouragement when practising with a mathematics learning program; otherwise, they do not get the chance to benefit from the use.

This article examines the extent to which normative beliefs on acculturation constitute (a) individual resources and risk factors for adolescents facing developmental tasks and (b) institutional norms that define developmental milieus in secondary schools. To what extent do egalitarianism, multiculturalism, assimilationism, and segregationism help or hinder academic and psychosocial adjustment in mid-adolescence? We examined how both individually endorsed beliefs and socially shared beliefs at the 10th-grade cohort level relate to students' academic performance, educational and occupational aspirations, motivational and emotional attachment to school, self-esteem, and life satisfaction. Data came from a random sample of 15- to 17-year-olds in Berlin, Germany, assessed at the end of Grades 9 and 10 (N = 1,992). Multivariate analyses identified egalitarianism and multiculturalism as the most prevalent acculturation beliefs, forming a combined belief pattern that pairs recognition of equality with respect for diversity. At the individual level, this belief pattern was positively related to academic and psychosocial adjustment. Assimilationism beliefs were associated with higher motivational and emotional attachment to school in both minority and majority students. Segregationism beliefs were associated with higher self-esteem in all adolescents regardless of background, but with lower levels of academic performance in immigrant youth. At the grade cohort level, a single bipolar factor (egalitarianism/multiculturalism vs. assimilationism/segregationism) described the institutional diversity culture. An environment characterized by egalitarianism/multiculturalism beliefs was positively associated with motivational and emotional attachment to school but not related to academic adjustment or psychological well-being.

Background: Many empirical investigations focus on how personality traits and academic motivation are related to academic achievement. Regarding the personality traits described in the five-factor model, prior research has shown associations between openness to experience and language achievement in particular. Following the principle of trait activation, associations with intrinsic value can explain these domain-specific relationships of openness with achievement. Aims: This study investigated whether intrinsic value mediates the associations of openness to experience with language achievement to understand these associations more closely. Based on the principle of trait activation, we combined openness to experience with intrinsic value as a motivational construct more proximal to behaviour. Samples: We capitalized on two large-scale longitudinal data sets (N = 1994; M = 16.8 years; 51% female; and N = 2722; M = 17.34 years; 58% female) of German-speaking students in upper secondary education with two points of measurement, respectively. Methods: We assessed achievement using report card grades and standardized test scores, capturing three language subskills: reading and listening, measured by standardized tests, and writing competencies, measured by essay assignments. We conducted mediation analysis using bootstrapped confidence intervals and robust standard errors to account for dependencies in the data due to students clustered within classrooms. Results and Conclusions: Overall, our results show that intrinsic value mediated the relationship between openness and achievement in English as a foreign language. The results remained stable when controlling for prior achievement, predicting achievement gains. Our investigation provides empirical insights into the manifestations of personality in academic contexts. We discuss the limitations of our approach, with a focus on the use of a mediation analysis in this research design.

The German Physics Olympiad is an extracurricular science contest for students. Here, they have the opportunity to compete against other talented students, can do physics outside of school, and take a first step to more engagement in the domain. Yet, female students participate in the competition in fewer numbers and are disproportionally more likely to drop out of the contest earlier than the male students. The present study hence explored the question to which extent the German Physics Olympiad provides a threatening environment for female contestants' intentions of persisting in physics. A total of 298 participants (28% female) were surveyed with respect to stereotype and social identity threat, as well as gender identification and sense of belonging as predictors of success expectations for and value of choosing to study physics. Success expectations and value of choosing to study physics were used as a measure for career intentions within the expectancy-value model. The results support the conclusion that the contest presents an equally supporting environment for female and male participants. We found no gender differences in success expectations for and value of studying physics. Sense of belonging and gender identification significantly predicted success expectations but not value of choosing to study physics. Female participants in the German Physics Olympiad were also neither affected by stereotype threat nor by social identity threat in their sense of belonging or gender identification.

Private supplementary tutoring is a widespread phenomenon. However, evidence that private tutoring has positive effects on academic achievement or about the specific conditions of successful private tutoring is rare. Adapting Carroll's (1963) model for school learning to private tutoring, we expected to find positive effects of tutoring duration, tutoring intensity, and students' motivation to attend private tutoring. In a sample of eighth-grade students in German secondary schools (N = 8510, 18.6% currently being tutored), we conducted regression analyses with multiple covariates and did not find a positive main effect of private tutoring attendance in any of the school subjects examined. Moreover, within the subsamples of tutored students, we were not able to identify positive effects of tutoring duration, tutoring intensity, tutoring content (such as a focus on homework completion, test preparation, or study behavior), or students' motivation to attend private tutoring. Given these disillusioning findings, we primarily derive suggestions for future research.

In this research report, we describe the design and empirical findings for a large-scale study of essay writing ability with approximately 2,500 high school students in Germany and Switzerland on the basis of 2 tasks with 2 associated prompts, each from a standardized writing assessment whose scoring involved both human and automated components. For the human scoring aspect, we describe the methodology for training and monitoring human raters as well as for collecting their ratings within a customized platform. For the automated scoring aspect, we describe the methodology for training, evaluating, and selecting appropriate automated scoring models as well as correlational patterns of resulting task scores with scores from secondary measures. Analyses show that the human ratings were highly reliable and that effective prompt-specific automated scoring models could be built with state-of-the-art features and machine learning methods, which resulted in correlational patterns with secondary measures that were in line with general expectations. In closing, we discuss the methodological implications for conducting this kind of work at scale in the future.

Background: Although many studies have suggested that students' externalizing (aggressive and rule-breaking) behaviour is detrimental to their academic achievement, the underlying mechanisms have rarely been investigated. Aims: We conducted a longitudinal investigation of whether the negative relation between externalizing behaviour and academic achievement operationalized as grades and test scores is mediated by students' task-focused behaviour while controlling for the effects of initial achievement and general cognitive abilities. We conducted separate analyses for different rating perspectives (i.e., parents and teachers) on students' externalizing behaviour to investigate the robustness of effects and determined whether gender moderated the mediation. Sample: Participants were N = 1,039 students in 55 classes from different school types who were followed from fifth to ninth grade. Method: In fifth grade, parents and teachers rated students' externalizing behaviour, and students were administered standardized tests in mathematics, German, and general cognitive abilities. In seventh grade, teachers rated students' task-focused behaviour. In ninth grade, students were again administered standardized tests in mathematics and German, and their grades were obtained from school registries. Results: Structural equation models consistently revealed indirect effects of externalizing behaviour via task-focused behaviour on grades and test scores beyond effects of initial achievement and general cognitive abilities. Result patterns were similar for parents' and teachers' ratings of externalizing behaviour and male and female students. Conclusions: This study extends knowledge about the negative relation between externalizing behaviour and academic achievement in adolescents by showing that there is an indirect relation through task-focused behaviour. Implications are discussed.

Throughout Europe, there is a growing trend for students to start learning foreign languages at elementary school. Although policymakers expect early-start programs to boost second language skills, empirical findings are mixed; recent studies have raised many questions. In this large-scale study, we aimed to close some of these gaps. We examined the effects of early-start English on receptive language proficiency in a random sample of 19,858 students from 1,431 Year 9 classes in Germany, comparing the reading and listening comprehension of early starters (English from Year 1), a middle group (Year 3), and late starters (Year 5), and analyzing to what extent foreign language instruction at secondary level builds on students' existing knowledge. By Year 9, the proficiency levels of the three groups differed only slightly. We provide evidence that this lack of long-term impact may be attributable to English teaching at secondary level being insufficiently adaptive to students' prior knowledge.

Background: A considerable proportion of secondary school students gets additional support from private tutoring lessons. Empirical findings on the effectiveness of private tutoring are inconclusive. The instructional quality of the tutoring lessons might influence their effectiveness. Aims: We analysed (1) whether students privately tutored in the subjects German or mathematics outperformed their non-tutored counterparts; (2) whether the instructional quality of the tutoring lessons can be described with the three dimensions, structure, challenge, and support; and (3) the effects of these quality dimensions on the students' academic achievement and their global satisfaction with their school and family situation. Sample: We used data from the German National Educational Panel Study (NEPS). From a total sample of N = 11,358 10th-grade secondary school students, subsamples provided information about tutoring quality in mathematics (n[subscript M] = 1,714), German (n[subscript G] = 148), and English (n[subscript E] = 490). Methods: The model of three correlated dimensions of tutoring quality was evaluated with confirmatory factor analyses, and the effects on student outcomes were tested in a structural equation modelling framework. Results: Analyses revealed neither global effects of private tutoring nor effects of its instructional quality on students' grades in mathematics or German. However, the support dimension was positively related to students' satisfaction with their school situation. Conclusions: Private tutoring cannot be recommended as a generally effective strategy to improve academic achievement in school, but might be helpful to relieve the stress level induced by insufficient achievement in school.

The present study examined the four sources of self-efficacy (mastery experience, vicarious experience, verbal and social persuasion, and physiological state) and how these predict academic self-efficacy over time in N = 1597 (t[subscript 1]) and N = 1373 (t[subscript 2]) 7th-grade students. We simultaneously differentiated three different educationally relevant socialization contexts: the family, peers, and school. Although existing measures to assess sources of academic self-efficacy have considered different socialization contexts, they have done this neither systematically nor for all sources. Confirmatory factor analysis of the four sources in three socialization contexts showed a good fit to the data. Results of structural equation models at t[subscript 1] showed differential patterns of substantial impact on academic self-efficacy in each socialization context. Over time, the impact decreased when controlling for SES. Results deliver only partial support for Bandura's theoretical approach and indicate the need to revise social-cognitive theory.

In times of climate change, worldwide diseases, and the question of sustainable energy, scientific literacy has never been more important. The acquisition of scientific literacy starts in early childhood and depends on children's experiences in learning environments such as the parental home and kindergarten. The Starting Cohort 2 of the German National Educational Panel Study offers longitudinal data on the scientific literacy of 2,937 children from kindergarten to the third grade of primary school. We used linear latent growth curve models to analyse the data. The results show that the scientific literacy of kindergarten children grew over time and that kindergarten children already differed in their scientific literacy. Especially children from non-German-speaking homes or whose parents had lower levels of education or who came from homes with low cultural capital had a significantly lower level of scientific literacy in kindergarten. A scientific focus in kindergarten, on the other hand, had a positive effect on the scientific literacy of kindergarten children. Moreover, our study did not reveal any interindividual differences in the growth of scientific literacy over time. Thus, our study did not find any evidence to indicate that school had closed the initial gap in children's scientific literacy.

What drives socioeconomic success within a society? This study analyzes how late childhood intelligence, parental socioeconomic background, and gender relate to multiple dimensions of adult socioeconomic success (i.e., education, occupational status, and income). A particular focus is placed on education, which is considered as both an indicator of socioeconomic success and a mediator of the relationships with the other dimensions. Randomly sampled participants (N = 5,292) in a German prospective longitudinal study were assessed for the first time at age 12 years in 1991 and for the last time as adults in 2009-10. Comparison of the effects of childhood intelligence and parental socioeconomic background revealed childhood intelligence to be the more powerful predictor of the 3 dimensions of later adult socioeconomic success. Education was the strongest predictor of both later adult occupational status and later adult income, and mediated most of the effects of childhood intelligence and parental socioeconomic background on later adult occupational status and later adult income. A gender income gap was apparent, with men reporting higher income, even when childhood factors and education were controlled. Education barely mediated any gender differences, but family-related structural factors (i.e., working part time and having children) explained much of the gender gap in income.

The 2I/E model is an extension of Marsh's (1986) classical internal/external frame of reference (I/E) model. Whereas the classical I/E model describes the formation of academic self-concept by the joint operation of social (external) and dimensional (internal) comparisons, the 2I/E model integrates temporal comparisons as an additional internal comparison process. In the 2I/E model, paths from achievement levels to self-concepts in the same subject are assumed to represent social comparisons, paths from achievement levels to self-concepts in another subject are assumed to represent dimensional comparisons, and paths from achievement changes to self-concepts in the same subject are assumed to represent temporal comparisons. The present research validated the 2I/E model in six empirical studies with a total of more than 20,000 students. Generally, there were strong positive social comparison paths, moderate negative dimensional comparison paths, and small positive temporal comparison paths. Furthermore, the relations of the 2I/E model were replicated with both grades and standardized test scores as achievement indicators (Study 1 and Study 2). Dimensional comparison effects were stronger between dissimilar subjects, like math and German, than between similar subjects, like German and English (Study 2 and Study 3). Also, the relations of the 2I/E model were shown when prior self-concepts were controlled for (Study 4). Overall, the 2I/E model seems to have the potential to enrich future theory and research on self-concept formation and comparison processes.

In 2009, John Hattie first published his extensive metasynthesis concerning determinants of student achievement. It provides an answer to the question: "What works in school?" The present study examines how this question is answered by pre- and in-service teachers, how their beliefs correspond to the current state of research and whether they differ according to the teachers' level of expertise. Thus, it takes on a novel approach as it draws on data from two sources in the field of education--empirical research and teachers' beliefs--and examines their similarities and differences. The teachers' beliefs were elicited by asking N = 729 participants to estimate the effect sizes of several determinants of student achievement. Those were compared to the empirical effect sizes found by Hattie (2009). Profile correlations showed that expert teachers' beliefs are more congruent with current research findings than those of novice teachers. We further examined where expert and novice teachers' beliefs differ substantially from each other by using confirmatory factor analysis (CFA) and comparing group means in latent variables. Our findings suggest that teachers' beliefs about school effectiveness are related to professional experience: Expert teachers showed a stronger overall congruence with empirical evidence, scoring higher in achievement-related variables and lower in variables concerning surface- and infrastructural conditions of schooling as well as student-internal factors. Results are discussed with regard to teacher-education practices that emphasize research findings and challenge existing beliefs of (prospective) teachers.

Tests administered in studies of student achievement often have a certain amount of not-reached items (NRIs). The propensity for NRIs may depend on the proficiency measured by the test and on additional covariates. This article proposes a semiparametric model to study such relationships. Our model extends Glas and Pimentel's item response theory model for NRIs by (1) including a semiparametric representation of the distribution of the onset of NRIs, (2) modeling the relationships of NRIs with proficiency via a flexible multinomial logit regression, and (3) including additional covariates to predict NRIs. We show that Glas and Pimentel's and our model have close connections to event history analysis, thereby making it possible to apply tools developed in this context to the analysis of NRIs. Our model was applied to a timed low-stakes test of mathematics achievement. Our model fitted the data better than Glas and Pimentel's model, and allowed for a more fine-grained assessment of the onset of NRIs. The results of a simulation study showed that our model accurately recovered the relationships of proficiency and covariates with the onset of NRIs, and reduced bias in the estimates of item parameters, proficiency distributions, and covariate effects on proficiency.

Background: Stakeholders' interpretations of the findings of large-scale educational assessments can influence important decisions. In the context of educational assessment, standard-setting remains an especially critical element, because it is complex and largely unstandardized. Instruments established by means of standard-setting procedures such as proficiency levels (PL) therefore appear to be arbitrary to some degree. Owing to the significance such results take on, when they are communicated to stakeholders or the public, a thorough validation of this process seems crucial. In our study, ministry stakeholders intended to use PL established in an assessment of science abilities to obtain information about students' strengths and weaknesses regarding science abilities in general and specifically about the extent to which they were prepared for future science studies. The aim of our study was to investigate the validity arguments regarding these two intended interpretations. Methods: Based on a university science test administered to 3641 upper secondary students (Grade 13), a panel of nine experts set four cut scores using two variations of the Angoff method, the Yes/No Angoff method (multiple choice items) and the extended Angoff method (complex multiple choice items). We carried out t-tests, repeated measures ANOVA, G-studies and regression analyses to support the procedural, internal, external, and consequential validity elements regarding the aforementioned interpretations of the cut scores. Results: Our t-tests and G-studies showed that the intended use of the cut scores was valid regarding procedural and internal aspects of validity. These findings were called into question by the experts' lack of confidence in the established cut scores. Regression analyses including number of lessons taught and intended and pursued science-related studies showed good external and poor consequential validity. Conclusion: The cut scores can be used as an indicator of 13th graders' strengths and weaknesses in science. They should not be used as an indicator for preparedness for science university studies. Since assessment formats are continually evolving and consequently leading to more complex designs, further research needs to be conducted on the application of new standard-setting methods to meet the challenges arising from this development.

Most English-medium programs at European universities require prospective students to take standardised tests for English as a foreign language (EFL) to be admitted. However, there are contexts in which individual teachers' judgements serve the same function, thus having high-stakes consequences for the higher education entrance of their students. The present study investigates the accuracy of CEFR-based judgements of upper secondary school EFL teachers in Germany and compares it to the accuracy of conventional grading. Seventy-three teachers located each of the students in their EFL class onto a CEFR level. Teachers' judgements were compared to the CEFR levels estimated from the TOEFL ITP using level, differentiation, and ranking component as indicators of judgement accuracy. Findings show that while CEFR-based judgements of relative EFL proficiency within classes (rank component) are rather appropriate, teachers substantially overestimate the total level of their students' achievement (level component). Compared to conventional grading, however, CEFR-based judgements lead to more accurate estimations of variance between students in a class (differentiation component). The findings are discussed with particular reference to the consequences for higher education entrance policy concerning CEFR levels B2 and C1 as relevant benchmarks.

To support prospective teachers' professional development, teacher education should be characterised by conditions that help to prevent burnout and facilitate satisfaction. This study investigates predictors of burnout and satisfaction in teacher education by drawing on universities with different teacher education programme structures and assumed different learning conditions. Programme structure and student characteristics were conceived as antecedents of perceived learning conditions; burnout dimensions and student satisfaction were hypothesised to be consequences of both the distal and more proximal variables. Data were collected at four time points from N = 3,892 students enrolled in teacher education at 13 universities. Structural equation modelling revealed favourable effects of autonomy support, competence support, and social relatedness on the core burnout dimensions and satisfaction. Effects of programme structure on these outcomes were small and mediated by autonomy support and difficulty of demands. Study self-efficacy emerged as a broad personal resource. Implications for teacher education are discussed.

The internal/external frame of reference model (I/E model) posits that individuals' achievement-related self-concepts are formed through social comparisons (e.g., self vs. peers) within academic domains and dimensional comparisons (e.g., math vs. verbal) between distinct domains. A large body of research has supported the theorized pattern of positive within-domain and negative cross-domain effects of achievement on self-concept. However, research on moderators of these effects has been scarce. In this article, we report results from 2 samples of 7th graders (N[subscript sample1] = 1,045 and N[subscript sample2] = 1,966) in which we investigated whether students' perceptions of teachers' domain-specific competence in judging students' achievement moderated the relation between teacher-assigned grades and students' self-concepts in the I/E model. Structural equation modeling was used to estimate the I/E model, which also included teachers' perceived diagnostic competence in each domain (i.e., math and verbal) and 4 latent interaction variables derived from that competence and from school grades in both domains. Both studies found support for the predictions of the I/E model. The cross-domain effect on math self-concept was consistently moderated in both studies: The lower students perceived their teachers' competence in diagnosing math achievement, the stronger the negative path from verbal grade to math self-concept. Furthermore, the results tentatively imply that the positive within-domain effect of verbal grade on verbal self-concept is stronger when students' perceptions of teachers' diagnostic competence in judging verbal achievement are higher. The results extend knowledge on the conditions of academic self-concept formation and provide valuable insights into possible ramifications of teachers' judgment accuracy.