Search

Background: Retrieval practice promotes retention of learned information more than restudying the information. However, benefits of multiple-choice testing over restudying in real-world educational contexts and the role of practically relevant moderators such as feedback and learners' ability to retrieve tested content from memory (i.e., retrievability) are still underexplored. Objective: The present research examines the benefits of multiple-choice questions with an experimental design that maximizes internal validity, while investigating the role of feedback and retrievability in an authentic educational setting of a university psychology course. Method: After course sessions, students answered multiple-choice questions or restudied course content and afterward could choose to revisit learning content and obtain feedback in a self-regulated way. Results: Participants on average obtained corrective feedback for 9% of practiced items when practicing course content. In the criterial test, practicing retrieval was not superior to reading summarizing statements in general but a testing effect emerged for questions that targeted information that participants could easily retrieve from memory. Conclusion: Feedback was rarely sought. However, even without feedback, participants profited from multiple-choice questions that targeted easily retrievable information.

Research suggests that children suffering from different types of disorders (learning disorders, behavioral disorders, or intellectual disabilities) are sometimes evaluated differently simply due to the presence of a diagnostic label. We conducted a multilevel meta-analysis of experimental studies (based on data from 8,295 participants and on 284 effects nested in 60 experiments) to examine the magnitude and robustness of such label effects and to explore the impact of potential moderators (type of evaluation, diagnostic category, expertise, student's gender, and amount and type of information). We found a moderately negative overall label effect (Hedges' g = -0.42), which was robust across several types of evaluation, different samples, and different diagnostic categories. There was no indication that expertise and the gender of the child moderated the effect. Presenting participants with only a label yielded the strongest negative effect of g = -1.26, suggesting that the effect was dependent on the amount of information being presented to participants. We conclude that labeling a child can exacerbate negative academic evaluations, behavioral evaluations, evaluations of personality, and overall assessments of the child. Further implications for theory and future research are discussed.

Inhibitory control is a core executive function that develops during childhood and is measured with tasks that require the inhibition of a dominant response. The current study examined the diagnostic value of using response accuracy and latency in a simple inhibitory control test, the computerized Pointing-Stroop Task (cPST), for kindergarten children. The cPST was completed by 135 children, ages 3 through 6 years with diverse national and cultural backgrounds. In explanatory response models, item difficulties and time intensities could be predicted very reliably by congruency and item position, with incongruent responses causing more errors and longer response latency. Moreover, the prediction of fluid intelligence (a close correlate of inhibitory control) from children's performance in the cPST was enhanced by using response accuracy and response latency, which had a multiplicative effect, indicating that efficient (accurate and fast) inhibitory control is related to fluid intelligence. These results suggest that measuring the efficiency of inhibitory control in young children is a more appropriate assessment than using either response accuracy or response latency.

Teacher's evaluation of students is sometimes negatively affected by diagnostic labels. We explored such negative effects caused by the labels 'dyscalculia', 'dyslexia', and 'ADHD' in teacher students. In Experiment 1, we varied the presence of the dyscalculia and dyslexia label in vignettes between participants. The dyslexia but not the dyscalculia label had a negative effect on participant's academic expectations. In our preregistered Experiment 2, the presence of the ADHD label in vignettes was manipulated within participants. To understand the cognitive mechanisms driving label effects, we explored participants' attributions regarding the students' problems. Furthermore, a short dissonance-based intervention for counteracting negative label effects was implemented. Unexpectedly, we found both negative and positive label effects. The label led to more positive performance expectations and to more negative ratings of problem stability and problem control. The dissonance-based intervention led to more positive evaluations regardless of whether the ADHD label was mentioned or not. Overall, our findings suggest that learning-disorder labels affect teachers' expectations in different ways., Author(s): David J. Franz [sup.1] , Wolfgang Lenhard [sup.1] , Peter Marx [sup.1] , Tobias Richter [sup.1] Author Affiliations: (1) grid.8379.5, 0000 0001 1958 8658, Department of Psychology IV, University [...]

Research Findings: The home literacy environment and particularly shared reading are central determinants of children's emergent literacy skills and predictors of their later reading development. Although the importance of frequent shared reading is well established, there is little knowledge about the age at which reading to children starts having beneficial effects. Accordingly, we synthesize five experimental studies (N = 643) to estimate links between retrospectively reported shared-reading onset age, current shared-reading frequency, and a range of emergent literacy skills (expressive and receptive vocabulary, grammatical knowledge, phonological awareness, and oral narrative skill), controlling for child and family characteristics. Retrospective reports of shared-reading onset significantly correlated with current shared-reading frequency and emergent literacy skills. In hierarchical multiple regression analyses, shared-reading onset age predicted grammatical knowledge, receptive and expressive vocabulary, after controlling for child and family characteristics and current shared-reading frequency. However, incremental effects were generally small. Practice or Policy: Findings indicate that early book reading may help to develop emergent literacy skills, even when shared reading begins before the end of children's first year of life. Thus, we encourage parents to engage in frequent, early book reading activities with their children.

Reading fluency is a major determinant of reading comprehension but depends on moderating factors such as auditory working memory (AWM), word recognition and sentence reading skills. We investigated how word and sentence reading skills relate to reading comprehension differentially across the first 6 years of schooling and tested which reading variable best predicted teacher judgements. We conducted our research in a rather transparent language, namely, German, drawing on two different data sets. The first was derived from the normative sample of a reading comprehension test (ELFE-II), including 2056 first to sixth graders with readings tests at the word, sentence and text level. The second sample included 114 students from second to fourth grade. The latter completed a series of tests that measured word and sentence reading fluency, pseudoword reading, AWM, reading comprehension, self-concept and teacher ratings. We analysed the data via hierarchical regression analyses to predict reading comprehension and teacher judgements. The impact of reading fluency was strongest in second and third grade, afterwards superseded by sentence comprehension. AWM significantly contributed to reading comprehension independently of reading fluency, whereas basic decoding skills disappeared after considering fluency. Students' AWM and reading comprehension predicted teacher judgements on reading fluency. Reading comprehension judgements depended both on the students' self-concept and reading comprehension. Our results underline that the role of word reading accuracy for reading comprehension quickly diminishes during elementary school and that teachers base their assessments mainly on the current reading comprehension skill.

The interpretation of psychometric test results is usually based on norm scores. We compared semiparametric continuous norming (SPCN) with conventional norming methods by simulating results for test scales with different item numbers and difficulties via an item response theory approach. Subsequently, we modeled the norm scores based on random samples with varying sizes either with a conventional ranking procedure or SPCN. The norms were then cross-validated by using an entirely representative sample of N = 840,000 for which different measures of norming error were computed. This process was repeated 90,000 times. Both approaches benefitted from an increase in sample size, with SPCN reaching optimal results with much smaller samples. Conventional norming performed worse on data fit, age-related errors, and number of missings in the norm tables. The data fit in conventional norming of fixed subsample sizes varied with the granularity of the age brackets, calling into question general recommendations for sample sizes in test norming. We recommend that test norms should be based on statistical models of the raw score distributions instead of simply compiling norm tables via conventional ranking procedures.

Steadily increasing ethnic and cultural diversity in the United States has led employers to see intercultural competence as a valuable and necessary trait for those entering the workforce, including students studying psychology. One high-impact practice that may increase students' multicultural awareness is study abroad. The current research examined the effectiveness of a cultural scavenger hunt offered during two short-term study abroad programs to increase participants' intercultural competencies. Cultural competence was assessed in Study 1 (N = 10) using the Miville-Guzman Universality-Diversity Scale--Short Form. Results indicated a statistically significant increase across all subscales. In Study 2 (N = 16), the Cross-Cultural Adaptability Inventory was utilized. Results from Study 2 demonstrated statistically significant improvements in the Emotional Resilience subscale. These findings suggest that a cultural scavenger hunt may assist participants in actively engaging in the local culture and facilitate the initial development of intercultural competencies.

Retrieval practice promotes retention more than restudying (i.e., the "testing effect") and is applied to many educational settings. However, little research has investigated means to enhance this effect in educational settings. Theoretical accounts assume retrieval practice to be the most effective whenever retrieval is difficult but successful. Therefore, we developed a novel retrieval practice procedure, which adapts to learners' abilities and can be applied irrespective of learning content. This adaptive procedure aims to make retrieval gradually easier whenever students provide an incorrect answer. In a field experiment, students read book chapters as part of a weekly university course. In three consecutive weeks, they then practiced reading assignments by (a) adaptive testing, (b) non-adaptive testing and (c) restudy. In Week 4, a surprise criterial test took place. Restudy outperformed both testing conditions, whereas adaptive testing performed equally well as non-adaptive testing. However, exploratory analyses revealed that with increasing retention intervals, the superiority of restudy disappeared. Furthermore, whenever participants fully read the assignments and retention intervals increased, adaptive testing outperformed non-adaptive testing. In sum, adaptive retrieval practice did not prove to be generally superior, but retention interval and students' preparation for class might be conditions rendering adaptive retrieval useful in educational settings.

Children with mathematical difficulties need to spend more time than typically achieving children on solving even simple equations. Since these tasks already require a larger share of their cognitive resources, additional demands imposed by the need to switch between tasks may lead to a greater decline of performance in children with mathematical difficulties. We explored differential task switch costs with respect to switching between addition versus subtraction with a tablet-based arithmetic verification task and additional standardized tests in German elementary school children in Grades 1 to 4. Two independent studies were conducted. In Study 1, we assessed the validity of a newly constructed tablet-based arithmetic verification task in a controlled classroom-setting (n = 165). Then, effects of switching between different types of arithmetic operations on accuracy and response latency were analyzed through generalized linear mixed models in an online-based testing (Study 2; n = 3,409). Children with mathematical difficulties needed more time and worked less accurately overall. They also exhibited a stronger performance decline when working in a task-switching condition, when working on subtraction (vs. addition) items and in operations with two-digit (vs. one-digit) operations. These results underline the value of process data in the context of assessing mathematical difficulties. [ABSTRACT FROM AUTHOR]

AbstractWhile a rich methodology for analyzing response patterns for accuracy and time-on-task is at hand via Item Response Theory (IRT), tests with time cutoffs are so far harder to handle. Given that this test mode is widely applied, especially in the context of paper-and-pencil testing, there is a lack of psychometric techniques for a relevant number of tests. In this context, the original work of Rasch and his Rasch Poisson Counts model indeed offers an approach for this scenario that is adequate to solve the problem but which leads to model violations in many cases. Recent developments in statistical modeling – the so-called Conway Maxwell Poisson Counts Model (CMPCM) – can solve the problem of under- and overdispersion. We apply this model to the norm data of the ELFE II reading comprehension test and analyze patterns of over- and underdispersion with regard to speededness and mode effects. CMPCM with subtest-specific dispersion was adequate to model the raw test data, with underdispersion occurring mainly in highly speeded subtests with low difficulty and overdispersion in less speeded subtests with high difficulty. Thus, the CMPCM could contribute to psychometric methodology to appropriately model tests with time cutoffs on the subtest level. [ABSTRACT FROM AUTHOR]

Shared reading represents an established practice to foster preschool vocabulary development, particularly when coupled with explicit instruction in word meanings. However, a question remains as to whether explicit word definitions detract from story delivery and hence language learning. Accordingly, this study compared explicit versus story-focused, elaborative storytelling in a 2 × 2 pre-posttest randomized and counterbalanced mixed design with 63 preschoolers. Children were told two fairytales daily across three sessions in either explicit or elaborative conditions, whereby target words were accompanied with either an explicit (e.g., definition, question) or elaborative (e.g., gesture, metaphor, rhetorical question) word learning technique. Stories were either read aloud or freely told by experimenters. Both conditions resulted in similarly large gains in target vocabulary and performance on a story retelling. Some differential effects were found, with there being a larger difference between explained versus incidental words in the explicit condition. Furthermore, children in the elaborative condition were less restless during storytelling. The findings suggest that both elaborative as well as explicit approaches promote vocabulary growth and provide some evidence of differential effects for child behavior during storytelling.

This chapter discusses the higher education system in Germany and presents findings on the use of the Teacher Behavior Checklist to examine those qualities and corresponding behaviors that German university students identified in ideal teachers.

Shared-book reading is a well-established intervention to foster vocabulary development. Factors influencing its effectiveness are, however, less well studied, particularly with regard to story-delivery. We contrasted a read-aloud with a free storytelling approach and tested effects on vocabulary learning. In the first study, 83 preschoolers aged three to six were told six stories in a randomised, single-blind and counterbalanced design. Stories were either read aloud or told freely and included rare target-words. Measures of target-word acquisition, receptive vocabulary, phonological working memory and speech comprehension were administered. There was a small to moderate learning gain (d = 0.37), but no effect of story-delivery. In a second study, 24 of the youngest and 24 of the oldest participants were tested again, using the same procedure but with stories designed to be more intrinsically motivating and age-appropriate. Results indicated negligible vocabulary gains (d = 0.08) and no effect of story-delivery, except for small differences in child behaviour during storytelling.

Proctored remote testing of cognitive abilities in the private homes of test-takers is becoming an increasingly popular alternative to standard psychological assessments in test centers or classrooms. Because these tests are administered under less standardized conditions, differences in computer devices or situational contexts might contribute to measurement biases that impede fair comparisons between test-takers. Because it is unclear whether cognitive remote testing might be a feasible assessment approach for young children, the present study (N = 1,590) evaluated a test of reading comprehension administered to children at the age of 8 years. To disentangle mode from setting effects, the children finished the test either in the classroom on paper or computer or remotely on tablets or laptops. Analyses of differential response functioning found notable differences between assessment conditions for selected items. However, biases in test scores were largely negligible. Only for children with below-average reading comprehension small setting effects between on-site and remote testing were observed. Moreover, response effort was higher in the three computerized test versions, among which, reading on tablets most strongly resembled the paper condition. Overall, these results suggest that, on average, even for young children remote testing introduces little measurement bias. [ABSTRACT FROM AUTHOR]

Writing essays and receiving feedback can be useful for fostering students' learning and motivation. When faced with large class sizes, it is desirable to identify students who might particularly benefit from feedback. In this article, we tested the potential of Latent Semantic Analysis (LSA) for identifying poor essays. A total of 14 teaching assistants evaluated a sample of N = 60 German essays. Using the human graders' evaluations as the standard of comparison, more of the poor essays were correctly identified by LSA than by random sampling (i.e., selecting essays by chance). By contrast, selection by text length did not perform better than random sampling. When three different teaching assistants evaluated another sample of N = 94 essays, the results largely replicated those found in the first sample. We conclude that LSA can help university teachers to identify poorly performing students. Additional analyses were computed to investigate the potential of combining the methods in different ways.

As reading and reading assessment become increasingly implemented on electronic devices, the question arises whether reading on screen is comparable with reading on paper. To examine potential differences, we studied reading processes on different proficiency and complexity levels. Specifically, we used data from the standardization sample of the German reading comprehension test ELFE II (n = 2,807), which assesses reading at word, sentence, and text level with separate speeded subtests. Children from grades 1 to 6 completed either a test version on paper or via computer under time constraints. In general, children in the screen condition worked faster but at the expense of accuracy. This difference was more pronounced for younger children and at the word level. Based on our results, we suggest that remedial education and interventions for younger children using computer-based approaches should likewise foster speed and accuracy in a balanced way.

We investigated whether the accuracy of normed test scores derived from non-demographically representative samples can be improved by combining continuous norming methods with compensatory weighting of test results. To this end, we introduce Raking, a method from social sciences, to psychometrics. In a simulated reference population, we modeled a latent cognitive ability with a typical developmental gradient, along with three demographic variables that were correlated to varying degrees with the latent ability. We simulated five additional populations representing patterns of non-representativeness that might be encountered in the real world. We subsequently drew smaller normative samples from each population and used an one-parameter logistic Item Response Theory (IRT) model to generate simulated test results for each individual. Using these simulated data, we applied norming techniques, both with and without compensatory weighting. Weighting reduced the bias of the norm scores when the degree of non-representativeness was moderate, with only a small risk of generating new biases. [ABSTRACT FROM AUTHOR]

Essays that are assigned as homework in large classes are prone to cheating via unauthorized collaboration. In this study, we compared the ability of a software tool based on Latent Semantic Analysis (LSA) and student teaching assistants to detect plagiarism in a large group of students. To do so, we took two approaches: the first approach was in vivo; that is, we observed whether LSA and the teaching assistants could detect plagiarism during the term. The second approach was in vitro; that is, we had 14 teaching assistants and LSA evaluate, after the term had ended, a sample of N?=?60 essays of which two essays were identical. Results showed that the responsible teaching assistant did not detect the duplicates during the term (in vivo) and that the majority of the teaching assistants did not notice that they had read two identical essays (in vitro). Some of them even scored the duplicates in markedly different ways. However, the duplicates were easily identified and evaluated as equally good by LSA. We conclude that using LSA can improve assessment at universities in terms of detecting plagiarism.

When capacity constraints hinder university instructors’ ability to give feedback, software tools might provide a remedy. We analyzed students’ acceptance of automatic assessments and the development of learning-related characteristics such as motivation, achievement aspirations, and subjective learning. We randomly assigned university students to four groups that differed with regard to the real and assumed source of assessment of students’ texts (i.e., teaching assistant or software tool). Data from N = 300 students were analyzed. Assessments were less accepted when presumably coming from the software tool. Students mostly preferred human graders over computers in teaching in general, but this preference was weakened for some situations when students assumed they were being assessed by the software tool. Nevertheless, students saw some general merits to assessment by computers, and the development of learning-related characteristics was not affected by the real or assumed source of assessment. Thus, combining feedback from software tools and human graders seems to be a feasible way to expand feedback capacities in higher education.

Beginning readers in shallow orthographies acquire word reading skills more quickly than in deep orthographies like English. In addition to extending this evidence base by comparing reading acquisition in English with the more transparent German, we conducted a longitudinal study and investigated whether different early reading skills made different contributions to word reading as a function of orthography. Children (n = 133) were recruited from the first year of primary school in New Zealand (age 5;8) and Germany (age 7;2) and from kindergartens in Germany (age 5;0) to provide both age- and schooling-matched samples. Parallel measures of phonemic awareness, vocabulary, decoding skill, and word reading (accuracy) were administered at two time points, 1 year apart. An advantage for orthography and school attendance existed for reading development. Vocabulary made a greater contribution to word reading in English than in German as did decoding skill. Findings underscore the relative importance of vocabulary and decoding skills for early reading in English.

Diagnostic information is a centrepiece of educational decision making. Far-reaching decisions like placements within multi-tiered school systems may have a huge long-term impact on the achieved level of education. Therefore, such decisions should be substantiated or complemented by objective and prognostically valid information. To this end, we assessed academic self-concept, reading comprehension, orthographic abilities, and geometric and problem-solving skills prior to the selection of subsequent school forms in Grade 4 in order to model the pedagogical decisions of the teachers (Lenhard, Hasselhorn, & Schneider, 2011). The article describes the longitudinal results of an independent sample of 76 students and how well their academic performance was predicted 18 months later by the psychometric approach compared to teacher recommendations. Standardized tests had a high prognostic validity and predicted the choice of higher educational levels in subsequent school years. Teachers were more successful in determining grouping decisions for students with lower educational attainments.

Both reading and language experiences contribute to vocabulary development, but questions remain as to what effect each has and when. This article investigates the effects that reading, telling and sharing a story have on vocabulary acquisition. Children (N = 37) were told nine stories in a randomized, single-blind and counterbalanced 2 × 3 mixed design. The between-subjects variable was grade (2 vs 4) and the within-subjects factor was the story condition, being either read (adult read aloud) or told (free story telling) to the children, or read silently by the children (independent reading). Each story contained two rare target words that were unlikely to have been previously known to the children. Measures of receptive vocabulary, decoding, reading comprehension and target vocabulary acquisition from the story were also administered. Children in grade 4 performed better on the vocabulary acquisition test and there was a main effect for story condition; children learnt the least number of words when reading the stories independently and the most from the free story telling condition. Implications for vocabulary learning and the importance of oral language exposure--even for established readers in primary school--are discussed.

There are many established reading strategy training programmes, which explicitly teach strategic and meta-cognitive knowledge to improve reading comprehension. Although instruction in strategy knowledge leads to improvements in meta-cognitive skills, the effects do not always transfer to reading comprehension. Therefore, to investigate preconditions for knowledge transfer, two different strategy training programmes were implemented in nine classes of Grade 6 students ("N" = 148) over the course of one school year. One programme involved teacher-directed instruction of declarative meta-cognitive knowledge ("Reading Detectives"; Ruhl & Souvignier, 2006). The other aimed at improving executive meta-cognition by guided practice: students worked with a computer program based on latent semantic analysis (LSA) ("conText") and received immediate feedback on written summaries. Although both groups improved their strategy knowledge to the same extent, the "conText" group showed a greater improvement in reading comprehension. These findings suggest that guided practice, which is characterised by intensive practice and individualised corrective feedback, is superior to explicitly teaching strategy knowledge. (Contains 4 tables and 3 figures.)

Students with intellectual disabilities (ID) display an extremely wide variety of skills in the field of literacy, and the ability to read and write are central learning aims in the education of students with ID. It is vital to gain detailed knowledge on the literacy skills of students with ID in order to plan instruction, create learning environments, implement educational policies or funding models and specify future fields of research. However, there has been little research into the prevalence and variation of their reading skills. The present study assessed the reading stages of 1629 school-aged students with ID regardless of aetiology (age 6-21) in Bavaria, one of the largest regions in Germany within a randomly chosen and representative sample. Teachers described the reading and writing stages of their students in a questionnaire following the developmental model of Frith. Results indicate that 29.3% do not read at all, 6.8% read at a logographic stage, 31.9% at an alphabetic and 32% at an orthographic level. Writing achievements are lower on average. We analyze and discuss the determinants of literacy in this sample with regard to the sociocultural background of students with ID and draw conclusions for teaching and school policies. (Contains 4 figures and 4 tables.)