Using video prototypes for evaluating design concepts with users : a comparison to usability testing

We present an exploratory study that compared user feedback obtained from evaluating a mobile application versus a reverse engineered video prototype of this same application. The comparison included qualitative and quantitative data analysis. Questionnaire responses regarding user acceptance (UTAUT [8]) and the overall user experience (AttrakDiff [4]) showed no differences. Qualitative analysis of the comments by potential users yielded similar results. Some differences regarding comments pertaining to the fit of the application to its context of use and appreciation of hedonic qualities, warrant investigation in future research. Usability tests seem better suited to identify issues referring to the functionality and data accessed. Overall the results confirm the validity and usefulness of video prototyping, and can help us develop a better understanding of its strengths and weaknesses.