Search

Growing interest in emotional interfaces and systems motivates the need for a standard and well-accepted way to measure emotional responses. We introduce the concept of Emotional Majority Agreement: a metric to characterize affective self-report instruments. Emotional majority agreement scores describe the extent to which a sample of participants agrees with regards to their emotional responses. We present a video-watching case study where 12 participants continuously rated how they felt using three self-report prototypes. Majority agreement measures differentiated videos that elicited more or less agreement, prototypes that supported more or less agreement, and individual differences between participants. We conclude with insights gained and future work.

We present the coding tool VPAT (Verbal Protocol Analysis Tool), specifically designed to facilitate model driven analysis of users' verbal data. Such model-driven coding presents challenges in terms of efficiency and reliability. Engineers and researchers need effective means of coding with complex, hierarchical, multi-level coding schemes. VPAT allows input of customizable coding schemes, quick and easy insertion of codes into text documents with a user-friendly interface, and extraction of codes for analysis purposes. VPAT was developed for research purposes with user-centered design methods with various stakeholders. The VPAT prototype runs in conjunction with MS Access and MS Excel. Comparative task analysis breakdowns of main coding tasks in VPAT and a leading coding application are presented to demonstrate advantages and tradeoffs. A case study of coding usability data for a healthcare information retrieval system is presented to demonstrate usage and benefits. VPAT is a specific tool suited to model-based coding, and was shown to increase speed and reliability.