Online Student Evaluation of Instruction: An Investigation of Non-Response Bias. AIR 2002 Forum Paper.

One concern about online student course evaluation, in contrast to on-class paper methods, is the potential for low student response and the likelihood of nonresponse bias. This paper provides findings from an analysis of respondents to an online versus an in-class paper method of conducting student course evaluations. The study investigated responses of 2 large classes, more than 80 students, in 2 course sections, 1 using Web-based and 1 using paper evaluations, that had the same professor. An additional class with two large sections taught by the same professor was selected from another academic term. Students from the Web-based sections of the course were asked to complete the survey by e-mail. Students in the other sections completed a paper evaluation form. Results suggest that the evaluation responses were not significantly different for Web-based or paper evaluation approaches. A few significant differences were found in the average evaluation ratings between sections of each course, but no pattern was evident to suggest that the Web-based evaluation process would generate substantially different course evaluation results. Concern regarding low response rates and the potential for nonresponse bias in Web-based courses may not be warranted. (Contains 4 tables and 10 references.) (SLD)