Search

Individual Education Plans (IEPs) and 504 Plans often recommend the use of accommodations to facilitate the learning of classroom material by students with disabilities. Since the Individuals with Disabilities Education Act (IDEA) in 1997, students with disabilities are expected to participate in state and district-wide assessments, using appropriate accommodations. Large-scale assessment assumes the use of standardized testing conditions to allow for comparability of test scores; however, some students with disabilities are better able to demonstrate their knowledge when allowed to use accommodations that offset the effect of their disability on the construct tested. For these students, de-standardizing the test conditions is the only meaningful way to obtain an accurate estimate of achievement. In 1999 the Special Education Elementary Longitudinal Study (SEELS) began to examine the experience of elementary age students in schools, and pertinent to this report, their experience in testing situations, particularly the use of accommodations. In this paper, using data from SEELS, the authors examine accommodation use across different educational conditions, comparing IEP and 504 Plan accommodations to what students reportedly received in the classroom and on standardized tests. Results suggest a lack of alignment in accommodation use among IEP/504 plans, classroom conditions, and state testing situations. Additionally, there is some variability in what happens for students with different categorical labels. Since the data for this report was obtained from an early administration of the SEELS (Wave 2), monitoring of the alignment issue should continue. (Contains 11 figures and 1 table.)

Finding ways to improve the design of large-scale tests is a timely issue. Recent changes in Federal legislation (including the No Child Left Behind Act of 2001) have placed greater emphasis on accountability via large-scale tests. Students who have previously been exempted from large-scale assessments, including students with disabilities and English language learners, are now expected to reach achievement levels comparable to their non-disabled or English proficient peers. Schools are held accountable for their performance, and their scores are reported publicly. With such high stakes placed on large-scale assessment, there is a critical need for states to have valid information about how the design of assessments affects student test performance. This report provides information on the use of "think aloud methods" to detect design issues in large-scale assessments. Various design problems may introduce construct-irrelevant variance or hinder students from showing what they know on assessments. Research included a variety of students, including students with learning disabilities, students with hearing impairments, students with cognitive disabilities, English language learners, and students without disabilities who were proficient in English. In this project, the authors asked students to "think out loud" when solving mathematics large-scale assessment items. The sentences that students uttered produced data that led the authors to believe that think aloud methods, under certain circumstances, can successfully detect design issues. Specifically, they found issues related to unclearly defined constructs, inaccessibility of items, unclear instructions, incomprehensible language, and illegible text and graphics. To this end, think aloud methods appear to be a useful strategy in the design and refinement of large-scale assessments. Think aloud methods, as the authors designed them, were not effective for students with cognitive disabilities. This population had great difficulty in producing the language needed to explain problem-solving processes and may require additional research accommodations to help them participate in think aloud research. All other groups sufficiently participated in research activities. Think aloud methods also did not produce informative data for very difficult mathematics items because students had difficulty verbalizing their thoughts while solving problems. Despite shortcomings found in this study, the think aloud method appears to be an effective way to determine the effects of item design for a wide variety of students (with the exception of students with cognitive disabilities) and for items with low to moderate difficulty levels. (Contains 6 tables and 2 figures.)