Inquiry-Guided Learning in Statistics Education: Enhancing Student Understanding of Type I Error through the Use of an Animated Space Exploration Video

We tested the educational effectiveness of an inquiry-guided approach (Lee et al., 2004; Prince & Felder in "Journal of Engineering Education, 95," 123-138, 2006) to teaching a possible outcome of statistical hypothesis testing known as type 1 error. The approach consisted of showing participants an animated space exploration video. In the video, the commander of a spaceship set out to determine whether the concentration of carbon dioxide on a distant planet exceeded the concentration found on Earth. To make this determination, the commander conducted a series of hypothesis tests. One of the tests suggested that the concentration of carbon dioxide was significantly higher than that on Earth. However, when juxtaposed with the results of the other hypothesis tests, the lone decision to reject the null hypothesis appeared to be a type 1 error. The video's educational effectiveness was evaluated in two ways. First, participants responded to a set of multiple-choice questions on type 1 error, both before and after watching the video. Participants' scores on the multiple-choice test increased significantly from pre-test to post-test. Second, participants rated the video on a set of semantic differential items that tapped its educational effectiveness. On average, participants found the video to be educationally effective. The article concludes with an evaluation of the video's features based on established best practices in statistics education (GAISE College Report ASA Revision Committee, 2016).