Search

Among the variety of selected response formats used in L2 reading assessment, multiple-choice (MC) is the most commonly adopted, primarily due to its efficiency and objectiveness. Given the impact of assessment results on teaching and learning, it is necessary to investigate the degree to which the MC format reliably measures learners' L2 reading comprehension in the classroom context. While researchers have claimed that the longer the reading test (i.e., more test items and passages), the higher its overall reliability, few studies have investigated the optimal number of items and passages required for reliable classroom-based L2 reading assessment. To address this research gap, I adopted generalizability (G) theory to investigate the score reliability of the MC format in classroom-based L2 reading tests. A total of 108 ESL students at an American college completed an English reading test that included four passages, each of which was accompanied by five MC comprehension questions. The results showed that the score reliability of the L2 reading test was critically influenced by the number of items and passages, inasmuch as a different combination of the number of passages and items altered the degree of reliability. Implications for practitioners and educational researchers are discussed.

Cohesion plays an important role in science texts as their comprehension depends much on structural and textual signalling, which demonstrates the organisation of the text, the logical links of ideas, and the intended purpose of the writer. Particularly, research has shown that English learners (ELs) rely more on cohesive markers than their English-speaking peers during the reading process. To promote students' reading comprehension in science, understanding how cohesion features are used to construct texts and providing pertinent instructions are important for practitioners. This study investigated a series of cohesion features commonly adopted in middle school science texts in the U.S. -- in digital and printed texts respectively, through Coh-Metrix -- and compared their frequency using Hotelling's T-Squared test. This study is one of the pioneer studies that incorporated digital texts for cohesion analysis. Inclusion of the digital texts is meaningful as the pandemic facilitated technology uses in the U.S public school and elsewhere. Results showed that (1) commonly used cohesion features included additive connectives, 2nd person pronouns, and local referential cohesion, and (2) compared with the printed version of science texts, the digital version presented higher cohesion as indicated by index scores. The instructional implications for practitioners are discussed.

As integrated writing tasks in large-scale and classroom-based writing assessments have risen in popularity, research studies have increasingly concentrated on providing validity evidence. Given the fact that most of these studies focus on adult second language learners rather than younger ones, this study examined the relationship between written discourse features, vocabulary support, and integrated listening-to-write scores for adolescent English learners. The participants of this study consisted of 198 Taiwanese high school students who completed two integrated listening-to-write tasks. Prior to each writing task, a list of key vocabulary was provided to aid the students' comprehension of the listening passage. Their written products were coded and analyzed for measures of discourse features and vocabulary use, including complexity, accuracy, fluency, organization, vocabulary use ratio, and vocabulary use accuracy. We then adopted descriptive statistics and hierarchical linear regression analyses to investigate the extent to which such measures were predictive of integrated listening-to-write test scores. The results showed that fluency, organization, grammatical accuracy, and vocabulary use accuracy were significant predictors of the writing test scores. Moreover, the results revealed that providing vocabulary support may not necessarily jeopardize the validity of integrated listening-to-write tasks. The implications for research and test development were also discussed. [ABSTRACT FROM AUTHOR]