Evaluating a Web-Based Tool for Crowdsourced Navigation Stress Tests

We present a web-based tool for evaluating the information architecture of a website. The tool allows the use of crowdsourcing platforms like Amazon's MTurk as a means for recruiting test persons, and to conduct asynchronous remote navigation stress tests (cf. Instone 2000). We also report on an evaluation study which compares our tool-based crowdsourced approach to a more traditional laboratory test setting. Results of this comparison indicate that although there are interesting differences between the two testing approaches, both lead to similar test results.