Search

Answering calls to map college-level proficiency development (Modern Language Association, 2007) and longitudinally chart language learning (Barkaoui, 2014; Ortega & Byrnes, 2008), we mapped the oral proficiency growth of 1,922 lower-division college students of Chinese, French, Russian, and Spanish (in the second, third, or fourth semester of their programs), using the Oral Proficiency Interview--computer (OPIc). We recorded students' gender, heritage-learner status, high school language experience, interest in learning the target language, perceived importance of speaking, and outside-of-class second language (L2) contact, in order to differentiate growth. Latent growth curve analyses showed that learners' oral proficiency progressed at an average rate of one sublevel per year on the scale of the American Council on the Teaching of Foreign Languages (2012), following a nonlinear developmental path that was mildly accelerating over time. Students' proficiency development had a significant relationship with the language being learned, heritage-learner status, high school language experience, interest in learning, and perceived importance of speaking. No unique effects were found for gender or out-of-class L2 contact.

Language tests are useful for many purposes, including monitoring language learning progress and evaluating language programs. This study investigated the interpretations and usefulness of the American Council on the Teaching of Foreign Languages (ACTFL) Oral Proficiency Interview -- Computer (OPIc) scores across four languages at a large US public university, focusing on (1) the influence of learner backgrounds on oral proficiency variation and growth and (2) patterns in growth across languages. Two years of OPIc score data from 814 students studying Chinese (n = 143), French (n = 251), Spanish (n = 374), and Russian (n = 46) were collected, together with survey data on language learning experiences and motivation. Each participant had two to four OPIc scores. A growth curve analysis using mixed-effect modeling revealed that language learning experience and motivation explained approximately 43% of variation in initial proficiency and 23% of variation in rates of change over time. The target language had no unique effects on initial proficiency or change over time. On average, learners gained roughly one-third of an ACTFL sublevel per semester of study (while controlling for differences in their backgrounds). Findings are informative for appropriate interpretations and uses of OPIc scores in tertiary educational settings, but also question individual growth-tracking suitability on a semester-by-semester basis.

Captions provide a useful aid to language learners for comprehending videos and learning new vocabulary, aligning with theories of multimedia learning. Multimedia learning predicts that a learner's working memory (WM) influences the usefulness of captions. In this study, we present two eye-tracking experiments investigating the role of WM in captioned video viewing behavior and comprehension. In Experiment 1, Spanish-as-a-foreign-language learners differed in caption use according to their level of comprehension and to a lesser extent, their WM capacities. WM did not impact comprehension. In Experiment 2, English-as-a-second-language learners differed in comprehension according to their WM capacities. Those with high comprehension and high WM used captions less on a second viewing. These findings highlight the effects of potential individual differences and have implications for the integration of multimedia with captions in instructed language learning. We discuss how captions may help neutralize some of working memory's limiting effects on learning.

This study represents program-level action research. A U.S. university Spanish language program had a goal for students to reach the ACTFL (2012) Intermediate Mid level after 2 years. An empirical question that resulted after regular end-of-year testing was whether the students were doing their best on assessments. To investigate this, 253 end-of-second-year students were divided into two experimental conditions: (a) 95 students received up to 10% of their final grade based on meeting the speaking goal, and (b) 73 students received up to 5% of their grade on the same criterion. Eighty-five students formed a control group with no grading incentive. All took ACTFL tests in speaking (the Oral Proficiency Interview-computerized [OPIc]), listening (Listening Proficiency Test), and reading (Reading Proficiency Test). The group whose OPIc score counted for 10% performed significantly higher than other two groups. Females were more positively affected by the incentivization. Programs with language goals should consider incentivized proficiency-based exit tests to motivate their students (Chalhoub-Deville, 1997).

This study investigated whether raters' second language (L2) background and the first language (L1) of test takers taking the TOEFL iBT® Speaking test were related through scoring. After an initial 4-hour training period, a group of 107 raters (mostly of learners of Chinese, Korean, and Spanish), listened to a selection of 432 speech samples that 72 test takers (native speakers of Chinese, Korean, and Spanish) produced. We analyzed the rating data using a multifaceted Rasch measurement approach to uncover potential biases in the rating process. In addition, 26 of the raters participated in stimulated recall sessions, during which they watched videos of themselves rating. Using the video as a prompt, we asked them to discuss and explain their rating processes at the time of rating. The results from our bias interaction analyses revealed that matches between the raters' L2 and the test takers' L1 resulted in some of the raters assigning ratings that were significantly higher than expected. As a whole, raters with Spanish as an L2 were significantly more lenient toward test takers who had Spanish as an L1, and raters with Chinese as an L2 were significantly more lenient toward test takers who had Chinese as an L1. Analyses of the qualitative data, assisted by the program QSR NVivo 8, revealed information concerning the raters' awareness of their biases.

This study investigates whether raters' knowledge of test takers' first language (L1) affects how the raters orient themselves to the task of rating oral speech. The authors qualitatively investigated the effects of accent familiarity on raters' score assignment processes. Twenty-six trained raters with a second language of Mandarin Chinese, Korean, or Spanish rated English speech samples from 72 English language learners from three L1 backgrounds (Mandarin Chinese, Korean, and Spanish). Afterward, raters watched videos of themselves rating and discussed their rating processes. Analyses of data, assisted by the qualitative analysis software package QSR NVivo 8, revealed that some raters attended to and were influenced by test-taker accent and L1. Raters who were heritage language learners discussed how their personal heritage status influenced how they thought about the speech samples from speakers whose L1 matched their heritage language. Although sensitivity to test-taker accents seemed to occur naturally in the rating process, findings suggest that when raters have learned or know, to varying degrees, the test takers' L1, they tend to orient themselves to the speech in a biased way, compromising test reliability.

Based on evidence that listeners may favor certain foreign accents over others (Gass & Varonis, 1984; Major, Fitzmaurice, Bunta, & Balasubramanian, 2002; Tauroza & Luk, 1997) and that language-test raters may better comprehend and/or rate the speech of test takers whose native languages (L1s) are more familiar on some level (Carey, Mannell, & Dunn, 2011; Fayer & Krasinski, 1987; Scales, Wennerstrom, Richard, & Wu, 2006), we investigated whether accent familiarity (defined as having learned the test takers' L1) leads to rater bias. We examined 107 raters' ratings on 432 TOEFL iBT[TM] speech samples from 72 test takers. The raters of interest were L2 speakers of Spanish, Chinese, or Korean, while the test takers comprised three native-speaker groups (24 each) of Spanish, Chinese, and Korean. We analyzed the ratings using a multifaceted Rasch measurement approach. Results indicated that L2 Spanish raters were significantly more lenient with L1 Spanish test takers, as were L2 Chinese raters with L1 Chinese test takers. We conclude by concurring with Xi and Mollaun (2009, 2011) and Carey et al. that rater training should address raters' linguistic background as a potential rater effect. Furthermore, we discuss the importance of recognizing rater L2 as a possible source of bias. (Contains 5 tables, 1 figure and 3 notes.)

This study investigates caption-reading behavior by foreign language (L2) learners and, through eye-tracking methodology, explores the extent to which the relationship between the native and target language affects that behavior. Second-year (4th semester) English-speaking learners of Arabic, Chinese, Russian, and Spanish watched 2 videos differing in content familiarity, each dubbed and captioned in the target language. Results indicated that time spent on captions differed significantly by language: Arabic learners spent more time on captions than learners of Spanish and Russian. A significant interaction between language and content familiarity occurred: Chinese learners spent less time on captions in the unfamiliar content video than the familiar, while others spent comparable times on each. Based on dual-processing and cognitive load theories, we posit that the Chinese learners experienced a split-attention effect when verbal processing was difficult and that, overall, captioning benefits during the 4th semester of language learning are constrained by L2 differences, including differences in script, vocabulary knowledge, concomitant L2 proficiency, and instructional methods. Results are triangulated with qualitative findings from interviews. (Contains 4 tables, 2 figures, and 9 notes.)

This study investigated the effects of captioning during video-based listening activities. Second- and fourth-year learners of Arabic, Chinese, Spanish, and Russian watched three short videos with and without captioning in randomized order. Spanish learners had two additional groups: one watched the videos twice with no captioning, and another watched them twice with captioning. After the second showing of the video, learners took comprehension and vocabulary tests based on the video. Twenty-six learners participated in interviews following the actual experiment. They were asked about their general reactions to the videos (captioned and noncaptioned). Results from t-tests and two-way ANOVAs indicated that captioning was more effective than no captioning. Captioning during the first showing of the videos was more effective for performance on aural vocabulary tests. For Spanish and Russian, captioning first was generally more effective than captioning second; while for Arabic and Chinese, there was a trend toward captioning second being more effective. The interview data revealed that learners used captions to increase their attention, improve processing, reinforce previous knowledge, and analyze language. Learners also reported using captions as a crutch. (Contains 1 figure, 4 tables and 13 notes.)

Students' computer access and literacy in the context of CALL has seen very little empirical investigation. This study surveyed 911 students in basic college foreign language programs to estimate their readiness for hybrid language instruction. The questions on the survey covered issues concerning students' ownership and accessibility of technology tools, their level of ability to perform computer-based tasks, their personal and academic/professional use of multimedia tools, and their interests in hybrid language instruction. We found that students tend not to have adequate access to or literacy in using specialized tools that are often necessary for CALL, tools that students normally do not use or need access to in their daily personal and/or academic computer use. Training is needed not because students do not have computer access or literacy or because they are unable to transfer their computer skills that they have acquired in their personal lives--as other CALL researchers have reported--but because of the specialized nature of CALL tasks. We conclude the article by discussing how administrators and teachers need to consider their own students' computer access and literacy before implementing fully online or hybrid language learning programs. (Contains 7 tables and 12 notes.)

The NCSSFL-ACTFL Can-Do Statements describe what language learners can do at the various ACTFL proficiency sublevels. Unlike the European equivalent of the Can-Do Statements (the Common European Framework of Reference for Languages), few researchers have assessed the construct validity of the NCSSFL-ACTFL statements. Concerns have included whether the difficulty levels of the skills described in the statements match the statements' assigned proficiency levels and whether each statement accurately indicates the underlying construct: language proficiency on the ACTFL subscales. This study addressed those two concerns. Undergraduate Spanish learners at an American university (N = 382) self-assessed their speaking proficiency by responding to a selection of 50 NCSSFL-ACTFL Can-Do Statements. A Rasch analysis revealed 15 misfitting items that did not fit the model. The suspected reasons for the misfit were that the statements were vague, described experiences that the learners may not have had, or assessed multiple skills in a single statement. However, 35 statements fit the model. Discussed are how the NCSSFL-ACTFL Can-Do Statements can be used to self-assess proficiency and how the statements should be assessed for content validity and psychometric value. [ABSTRACT FROM AUTHOR]