Search

This paper addresses speeding, that is, "too fast" responses, in web surveys. Relying on the response process model, we argue that very short response times indicate low data quality, stemming from a lack of attention on the part of respondents. To identify speeding, prior research employed case-wise procedures. Using data from nine online surveys, we demonstrate that response behavior of individual respondents varies considerably during a survey. Thus, we use case- and page-wise procedures to capture speeding behavior that taps different, although related, phenomena. Moreover, page-specific speeding measures capture aspects of data quality that traditional quality measures do not cover. Employing both page-specific and case-wise speeding measures, we examine whether removing speeders makes a difference in substantive findings. The evidence indicates that removing "too fast" responses does not alter marginal distributions, irrespective of which speeder-correction technique is employed. Moreover, explanatory models yield, by and large, negligible coefficient differences (on average about one standard error). Only in exceptional cases differences exceed two standard errors. Our findings suggest that speeding primarily adds some random noise to the data and attenuate correlations, if it makes a difference at all. The paper concludes by discussing implications and limitations. [ABSTRACT FROM AUTHOR]

One of the benefits of web-based research is the capacity to deliver video content directly to individual survey participants. However, yet to be investigated is whether the participant demographic and attitudinal characteristics are distorted when respondents are asked to view and respond to videos on their personal computers. To address this question, this research paper focuses on two potential types of selection bias introduced into web-based studies with video content: (1) that resulting from respondents’ differential ability to view videos; and (2) that resulting from demographic and motivational influences of adequate exposure to video content. Through a secondary analysis of two studies focusing on adult cigarette smokers living in the United States, this research paper investigates whether the ability to view videos differs between demographic groups, whether respondents who do not view videos for their full duration differ from those who view videos for an appropriate amount of time, and whether video characteristics influenced this relationship. Results show that age, education, sex, household internet access, and work status influence the likelihood of a respondent reporting an inability to view videos. In addition, age, employment status, and congeniality of and interest in issue topic affect adequate video viewing times. These outcomes suggest that although web-based studies offer many advantages, the inclusion of videos within these surveys has the potential to undermine the accuracy of study findings and distort the representative nature of the study sample. Recommendations for minimizing potential distortions are presented. [ABSTRACT FROM PUBLISHER]

Previous research has revealed techniques to improve response quality in open-ended questions in both paper and interviewer-administered survey modes. The purpose of this paper is to test the effectiveness of similar techniques in web surveys. Using data from a series of three random sample web surveys of Washington State University undergraduates, we examine the effects of visual and verbal answer-box manipulations (i.e., altering the size of the answer box and including an explanation that answers could exceed the size of the box) and the inclusion of clarifying and motivating introductions in the question stem. We gauge response quality by the amount and type of information contained in responses as well as response time and item nonresponse. The results indicate that increasing the size of the answer box has little effect on early responders to the survey but substantially improved response quality among late responders. Including any sort of explanation or introduction that made response quality and length salient also improved response quality for both early and late responders. In addition to discussing these techniques, we also address the potential of the web survey mode to revitalize the use of open-ended questions in self-administered surveys. [ABSTRACT FROM AUTHOR]

This paper investigates the impact of paper and email contacts on web survey response rates. We use six combinations of paper and email prenotifications and reminders to test the impact of mixed-mode contacts. In addition, we use two survey samples that differ in their relationship with the sponsoring institution to test if the impact of contact mode is conditional on relationship between respondents and the survey researchers. Contrary to previous research, we find little differences in response rates across experimental groups. [ABSTRACT FROM AUTHOR]

This paper presents results from six experiments that examine the effect of the position of an item on the screen on the evaluative ratings it receives. The experiments are based on the idea that respondents expect “good” things—those they view positively—to be higher up on the screen than “bad” things. The experiments use items on different topics (Congress and HMOs, a variety of foods, and six physician specialties) and different methods for varying their vertical position on the screen. A meta-analysis of all six experiments demonstrates a small but reliable effect of the item’s screen position on mean ratings of the item; the ratings are significantly more positive when the item appears in a higher position on the screen than when it appears farther down. These results are consistent with the hypothesis that respondents follow the “Up means good” heuristic, using the vertical position of the item as a cue in evaluating it. Respondents seem to rely on heuristics both in interpreting response scales and in forming judgments. [ABSTRACT FROM PUBLISHER]