Search

The awarding organizations that create and administer high-stakes assessments for beginner-to-low-intermediate 16-year-old learners of French, German, and Spanish in England provide optional topic-driven word lists as guides for teachers and textbook writers. Given that these lists are developed by the awarding organizations, they exert a powerful washback effect on teaching and learning. However, we do not know how much of these lists have actually been used in exams. We therefore analyzed the extent to which these lists have been used when developing the General Certificate of Secondary Education listening and reading exams, a corpus totaling 116,647 words. One key finding showed that approximately half of the awarding organizations' lists had never been used in any of the exams to date. Given recent changes to curriculum policy, we also investigated how word list type--frequency-informed versus the awarding organizations' topic-driven lists--affected lexical coverage of the exams. Overall, our findings suggested that using the topic-driven lists was likely to be a suboptimal use of lesson time, as they did not provide learners with enough words to understand any given text with ease. Frequency-informed word lists, however, seemed to better prepare learners for the exams.

Open research practices are relevant to all stages of research, from conceptualization through dissemination. Here, we discuss key facets of open research, highlighting its rationales, infrastructures, behaviors, and challenges. Part I conceptualizes open research and its rationales. Part II identifies challenges such as the speed and cost of open research, the usability of open data and materials, the difficulties of conducting replication research, and the economics and sustainability of open access and open research generally. In discussing these challenges, we have sought to provide examples of good practice, describe and evaluate emerging innovations, and envision change. Part III considers ongoing coevolutions of culture, infrastructure, and behaviors and acknowledges the limitations of our review and of open research practices. We argue that open research is indeed a large part of our future, and most--if not all--challenges are surmountable, but doing so requires significant changes for many aspects of the research process.

Language teachers report having limited direct contact with research and research findings despite generally positive perceptions of research (Borg 2009; Marsden and Kasprowicz 2017; Nassaji 2012). Key reasons teachers give are 1) practical - a lack of time and access, and 2) conceptual - academic papers can be difficult to read (Plavén-Sigray et al. 2017). In turn, researchers worry their research is not (or does not need to be) relevant to pedagogy. This paper reports on one large-scale initiative to bridge some research-pedagogy divides: Open Accessible Summaries in Language Studies (OASIS; oasis-database.org). OASIS aims to facilitate interaction between research and pedagogy, by making research into language learning, language teaching, and multilingualism physically and conceptually accessible. The freely available, one-page OASIS summaries, written in non-technical language, provide information about what the study was about, its importance, what the researcher(s) did and found. Four major international journals now require authors to write these summaries, and many others encourage their authors to write them. We discuss how and why OASIS was established, how the initiative has been received, and how summaries have contributed to professional development activities. We also and highlight some of the challenges we have encountered and discuss future directions.

There is currently much interest in the role of prediction in language processing, both in L1 and L2. For language acquisition researchers, this has prompted debate on the role that predictive processing may play in both L1 and L2 language learning, if any. In this conceptual review, we explore the role of prediction and prediction error as a potential learning aid. We examine different proposed prediction mechanisms and the empirical evidence for them, alongside the factors constraining prediction for both L1 and L2 speakers. We then review the evidence on the role of prediction in learning languages. We report computational modeling that underpins a number of proposals on the role of prediction in L1 and L2 learning, then lay out the empirical evidence supporting the predictions made by modeling, from research into priming and adaptation. Finally, we point out the limitations of these mechanisms in both L1 and L2 speakers.

Prediction error is known to enhance priming effects for familiar syntactic structures; it also strengthens the formation of new declarative memories. Here, we investigate whether violating expectations may aid the acquisition of new abstract syntactic structures, too, by enhancing memory for individual instances which can then form the basis for abstraction. In a cross-situational artificial language learning paradigm, participants were exposed to novel syntactic structures in ways that either violated their expectations (Surprisal group) or that conformed to them (Control group). Results from a delayed post-test show that participants in the Surprisal group developed stronger representations of the structures’ form-meaning mappings and were better able to generalize them to new instances, relative to the Control group.

In 1988 and 2006, "Applied Linguistics" published Low's and Littlemore and Low's seminal theoretical accounts of second language (L2) metaphoric competence (MC). Meanwhile, attempts to elicit metaphor-related skills/competences have been mixed. Instrumentation has varied in reliability, been limited in scope, and used arguably flawed reliability coefficients (McNeish 2018). Factor analysis, used in first language (L1) MC and other areas of L2 research (Loewen et al. 2009; Plonsky and Gonulal 2015), has not been used to explore latent L2 MC variables. To address these issues, we developed a large battery of MC tests to elicit Low/Littlemore's constructs, administering it to 112 L1 Mandarin speakers of L2 English and 31 L1 English speakers. Data cleaning revealed some operationalization challenges, but resulting overall reliability was high and demonstrated innovative use of ordinal omega as a powerful alternative to Cronbach's alpha, the most common instrument reliability index in L2 research (Plonsky and Derrick 2016). Exploratory factor analysis suggested four latent L2 MC variables: Productive Illocutionary MC, Metaphor Language Play, Topic/Vehicle Acceptability, and Grammatical MC, broadly supporting Low/Littlemore's proposals.

Vocabulary knowledge strongly predicts second language reading, listening, writing, and speaking. Yet, few tests have been developed to assess vocabulary knowledge in French. The primary aim of this pilot study was to design and initially validate the Context-Aligned Two Thousand Test (CA-TTT), following open research practices. The CA-TTT is a test of written form–meaning recognition of high-frequency vocabulary aimed at beginner-to-low intermediate learners of French at the end of their fifth year of secondary education. Using an argument-based validation framework, we drew on classical test theory and Rasch modeling, together with correlations with another vocabulary size test and proficiency measures, to assess the CA-TTT's internal and external validity. Overall, the CA-TTT showed high internal and external validity. Our study highlighted the decisive role of the curriculum in determining vocabulary knowledge in instructed, low-exposure contexts. We discuss how this might contribute to under- or over-estimations of vocabulary size, depending on the relations between the test and curriculum content. Further research using the tool is openly invited, particularly with lower proficiency learners in this context. Following further validation, the test could serve as a tool for assessing high-frequency vocabulary knowledge at beginner-to-low intermediate levels, with due attention paid to alignment with curriculum content. [ABSTRACT FROM AUTHOR]

Tests of Aptitude for Language Learning (TALL) is an openly accessible internet-based battery to measure the multifaceted construct of foreign language aptitude, using language domain–specific instruments and L1-sensitive instructions and stimuli. This brief report introduces the components of this theory-informed battery and methodological considerations for developing it into an open research instrument. It also presents the preliminary results from the initial validation of TALL carried out on data collected from Chinese L1 participants (n = 165) from a university setting who took two rounds of tests (with counterbalanced test items) with a minimum 30-day interval. The results of data analyses at subtest, item, and battery levels suggest that, in general, TALL has satisfactory reliability and can be used to measure aptitude conceptualized in the theoretical frameworks on which it has been developed. This report also highlights the value of TALL as a convenient data collection tool openly accessible to any researcher for free, its potential for facilitating an open data pool for high-quality syntheses of aptitude-related research findings, and its implications for Open Research practices in testing language-related constructs. [ABSTRACT FROM AUTHOR]

Judgment tasks (JTs, often called acceptability or grammaticality judgment tasks) are found extensively throughout the history of second language (L2) research. Data from such instruments have been used to investigate a range of hypotheses and phenomena, from generativist theories to instructional effectiveness. Though popular and convenient, JTs have engendered considerable controversy, with concerns often centered on their construct validity in terms of the type of representations they elicit, such as implicit or explicit knowledge. A number of studies have also examined the impact of JT conditions such as timed vs. untimed, oral vs. written. This article presents a synthesis of the use of JTs and a meta-analysis of the effects of task conditions on learner performance. Following a comprehensive search, 385 JTs were found in 302 individual studies. Each report was coded for features related to study design as well as methodological, procedural, and psychometric properties of the JTs. These data were synthesized in order to understand how this type of instrument has been implemented and reported. In addition to observing a steady increase in the use of JTs over the last four decades, we also found many of the features of JTs, when reported, varied substantially across studies. In terms of the impact of JT design, whereas modality was not found to have a strong or stable effect on learner performance (median d = 0.14; interquartile range = 1.04), scores on untimed JTs tended to be substantially higher than when timed (d = 1.35; interquartile range = 1.74). In examining these features and their links to findings, this article builds on a growing body of methodological syntheses of L2 research instrumentation and makes a number of empirically grounded recommendations for future studies involving JTs.

Despite extensive theoretical and empirical research, we do not have estimations of the magnitude of sensitivity to grammatical information during L2 online processing. This is largely due to reliance on null hypothesis significance testing (Plonsky, 2015). The current meta-analysis draws on data from one elicitation technique, self-paced reading, across 57 studies (N = 3,052), to estimate sensitivity to L2 morphosyntax and how far L1 background moderates this. Overall, we found a reliable sensitivity to L2 morphosyntax at advanced proficiencies (d = 0.20, 95% CIs 0.15, 0.25), with some evidence that this was reliably lower than for native speakers (NSs). These patterns were not generally moderated by linguistic feature or sentence region. However, effects for anomaly detection were larger among NSs than L2 learners and the effects among L2 learners appeared to show a trend toward L1 influence. Finding smaller effects than in other subdomains, we provide an initial framework of reference for L2 reading time effect sizes.

This study advances previous research about the effects of explicit instruction on second language (L2) development by examining learners' use of verbal morphology following different types of explicit information (EI) and comprehension practice. We investigated the extent to which additional EI about the first language (L1) can reduce the effects of crosslinguistic influence in L2 oral production. Sixty-nine English-speaking learners of L2 French undertook either: (a) a 'core' treatment of EI about the L2 with L2 comprehension practice, (b) the same L2 core + L1 comprehension practice, (c) the same L2 core + L1 comprehension practice + EI about L1, or (d) outcome tests only. Results showed that providing additional EI about the L1 benefitted the accuracy of oral production immediately after the instruction and then 6 weeks later. These results suggest that tailoring instruction, specifically the nature of the EI, to the nature of the learning problem can facilitate L2 learning. In particular, EI about L1 can facilitate L2 learning by increasing learners' awareness of similarities and differences in how L1 and L2 express the same meanings.

Within limited-input language classrooms, understanding the effect of distribution of practice (spacing between practice) on learning is critical, yet evidence is conflicting and of limited relevance for young learners. For second language (L2) grammar learning, some studies reveal advantages for spacing of 7 days or more, but others for shorter spacing. Further, little is known about the role of cognitive individual differences (e.g., language analytic ability; LAA) in mediating practice distribution effects for L2 grammatical knowledge development and retention. To address this gap, this classroom-based study investigated whether distribution of practice and LAA moderated the effectiveness of explicit, input-based grammar instruction for young first language (L1) English learners of French (aged 8 to 11). The study revealed minimal differences between longer (7-day) versus shorter (3.5-day) spacing of practice for learning a French verb inflection subsystem, at either posttest or delayed posttest. Minimal group-level gains and substantial within-group variation in performance at posttests were observed. Accuracy of practice during training and LAA were significantly associated with posttest performance under both practice schedules. These findings indicated that within an ecologically valid classroom context, differences in distribution of practice had limited impact on learner performance on our tests; rather, individual learner differences were more critical in moderating learning. This highlights the importance of considering individual learner differences in the development of resources and the potential of digital tools for dynamically adapting instruction to suit individuals.

Aims Previous neuroimaging research in alcohol use disorder (AUD) has found altered functional connectivity in the brain's salience, default mode, and central executive (CEN) networks (i.e. the triple network model), though their specific associations with AUD severity and heavy drinking remains unclear. This study utilized resting-state fMRI to examine functional connectivity in these networks and measures of alcohol misuse. Methods Seventy-six adult heavy drinkers completed a 7-min resting-state functional MRI scan during visual fixation. Linear regression models tested if connectivity in the three target networks was associated with past 12-month AUD symptoms and number of heavy drinking days in the past 30 days. Exploratory analyses examined correlations between connectivity clusters and impulsivity and psychopathology measures. Results Functional connectivity within the CEN network (right and left lateral prefrontal cortex [LPFC] seeds co-activating with 13 and 15 clusters, respectively) was significantly associated with AUD symptoms (right LPFC: β  = .337, p -FDR = .016; left LPFC: β  = .291, p -FDR = .028) but not heavy drinking (p -FDR > .749). Post-hoc tests revealed six clusters co-activating with the CEN network were associated with AUD symptoms—right middle frontal gyrus, right inferior parietal gyrus, left middle temporal gyrus, and left and right cerebellum. Neither the default mode nor the salience network was significantly associated with alcohol variables. Connectivity in the left LPFC was correlated with monetary delay discounting (r =  .25, p  = .03). Conclusions These findings support previous associations between connectivity within the CEN network and AUD severity, providing additional specificity to the relevance of the triple network model to AUD. [ABSTRACT FROM AUTHOR]

We conducted a multisite replication study with aspects of preregistration in order to explore the feasibility of such an approach in second language (L2) research. To this end, we addressed open questions in a line of research that has examined whether having learners attend to form while reading or listening to a L2 passage interferes with comprehension. Our results are consistent with findings from the specific paradigm that we replicated in that no effects on comprehension were detected in analyses conducted over all sites. However, further investigation is warranted due to site-specific effects and methodological limitations. We found all aspects of the multisite registered replication approach to be useful although the registration component itself appeared to be an especially feasible and valuable first step toward increasing the robustness and generalizability of findings in our field.

Despite its critical role for the development of the field, little is known about replication in second language (L2) research. To better understand replication practice, we first provide a narrative review of challenges related to replication, drawing on recent developments in psychology. This discussion frames and motivates a systematic review, building on syntheses of replication in psychology, education, and L2 research. We coded 67 self-labeled L2 replication studies found across 26 journals for 136 characteristics. We estimated a mean rate of 1 published replication study for every 400 articles, with a mean of 6.64 years between initial and replication studies and a mean of 117 citations of the initial study before a replication was published. Replication studies had an annual mean of 7.3 citations, much higher than averages in linguistics and education. Overlap in authorship between initial and replication studies and the availability of the initial materials both increased the likelihood of a replication supporting the initial findings. Our sample contained no direct (exact) replication attempts, and changes made to initial studies were numerous and wide ranging, which likely obscured, if not undermined, the interpretability of replication studies. To improve the amount and quality of L2 replication research, we propose 16 recommendations relating to rationale, nomenclature, design, infrastructure, and incentivization for collaboration and publication.

This study partially replicates McManus and Marsden (2017), who found that providing L1 explicit information (EI) plus task-essential practice led L2 learners to make more accurate and faster interpretations of French morphosyntax. The current study removed the original study's L1 EI component to examine the role of the L1 practice. This design tested whether providing L1 task-essential practice only (alongside a core treatment of L2 EI plus L2 practice) resulted in similar online and offline learning gains compared to the original study's L1 EI plus L1 practice. We used the same online and offline tests, with a similar population of English-speaking learners of L2 French (n = 19). For accuracy and speed of online and offline L2 processing, the findings suggest that additional L1 practice without L1 EI was no more beneficial than L2 EI plus L2 practice alone, indicating that the original study's combination of additional L1 EI with L1 practice appeared to contribute to previously observed learning benefits.

This study investigated the effectiveness of providing L1 explicit information (EI) with practice for making more accurate and faster interpretations of L2 French "Imparfait" (IMP). Two treatments were investigated: (a) "L2-only," providing EI about the L2 with L2 interpretation practice, and (b) "L2+L1," providing the exact same L2-only treatment and including EI about the L1 (English) with practice interpreting L1 features that are equivalent to the IMP. Fifty L2 French learners were randomly assigned to either L2-only, L2+L1, or a control group. Online (self-paced reading) and offline (context-sentence matching) measures from pretest, posttest, and delayed posttests showed that providing additional L1 EI and practice improved not only offline L2 accuracy, but also the speed of online L2 processing. To our knowledge, this makes original and significant contributions about the nature of EI with practice and the role of the L1 (Tolentino & Tokowicz, 2014), and it extends a recent line of research examining EI effects in online sentence processing (Andringa & Curcic, 2015).

This article reports on 2 connected studies that provide data about the flow of research to foreign language (FL) educators in majority Anglophone contexts. The first study investigated exposure to research among FL educators in the United Kingdom using 2 surveys (n = 391; n = 183). The data showed (a) some limited exposure to research via professional association publications and events, (b) negligible "direct" exposure to publications in the Social Science Citation Index (SSCI), (c) barriers to exposure caused by poor physical and conceptual access, despite generally positive perceptions of research, and (d) the importance of university-based teacher educators for research-practice interfaces. The second study investigated the potential for "indirect" exposure to research from 7 professional publications over 5 years in Australia, the United Kingdom, and the United States. We systematically reviewed the extent to which these professional publications referenced 29 SSCI journals that aim to publish pedagogy-relevant research. In our corpus of 8,516 references in 284 articles in professional journals, the mean proportion of references to all 29 SSCI journals, combined, was 12.43% per professional article. The overall mean number of references to each SSCI journal was 0.17 per professional article. The emerging picture is rather bleak, and we propose action from academic journals and researchers to promote a more international, systematic, and sustainable flow of research.

The use of home languages has previously been advocated in highly multilingual UK classrooms. However, drawing on the home languages and cultural insight of children who use English as an Additional Language (EAL) may also have important social and academic benefits in contexts where monolingualism is the norm. Conducted in a small local authority in England with low numbers of children who use EAL, this study investigated (1) primary teachers' views on implementing language awareness activities, using pupils who speak languages other than English as a linguistic and cultural resource, via interviews and questionnaires and (2) the amount and nature of references made to home languages during classroom observations. Although the teachers did not refer to or use home languages on a day-to-day basis, they generally showed willingness to consider implementing certain activities which incorporated them. However, largely, the teachers had not previously contemplated such practice. They did not reference any academic benefits to promoting linguistic diversity but were more aware of the potential social benefits. They also lacked confidence in particular areas (e.g. linguistic knowledge) as well as showing a strong awareness of issues such as the importance of English.

Inverse probability adaptation effects (the finding that encountering a verb in an unexpected structure increases long-term priming for that structure) have been observed in both L1 and L2 speakers. However, participants in these studies all had established representations of the syntactic structures to be primed. It therefore remains an open question whether inverse probability adaptation effects could take place with newly encountered L2 structures. In a pre-registered experiment, we exposed participants (n = 84) to an artificial language with active and passive constructions. Training on Day 1 established expectations for specific co-occurrence patterns between verbs and structures. On Day 2, established patterns were violated for the surprisal group (n = 42), but not for the control group (n = 42). We observed no immediate priming effects from exposure to high-surprisal items. On Day 3, however, we observed an effect of input variation on comprehension of verb meaning in an auditory grammaticality judgment task. The surprisal group showed higher accuracy for passive structures in both tasks, suggesting that experiencing variation during learning had promoted the recognition of optionality in the target language. [ABSTRACT FROM AUTHOR]