Assessing the validity of multiple‐choice questions for RAPP story comprehension

Background: Passage dependency (PD) is a measure of how much information is required to answer test questions based only on information provided in the relevant text (Tuiman, 1974). Prior learning, information included in other test questions or responses, and the ability to eliminate less plausible or irrelevant foils are all factors that may affect PD. The PD of the multiple‐choice questions for the auditory story comprehension task in the RAPP software environment has yet to be established. Aims: The purpose of this experiment was to investigate the validity of newly developed multiple‐choice comprehension questions for the story comprehension tasks used in the RAPP software environment. Methods & Procedures: Participants were 40 young adults without speech or language impairment, 20 of whom heard each of 12 stimulus stories and answered 10 multiple‐choice questions with 5 response choices, and 20 who answered the multiple‐choice questions but were not exposed to the stimulus stories. Questions concern...