Digital newspaper makes my home tidier:Evaluating user experience with user-defined attributes

User experience (UX) evaluation is typically based on either open evaluation or predefined measures. In our study, we tested a new UX evaluation method by combining both approaches in a collaborative evaluation. When evaluating a digital newspaper over six weeks, the users were asked to describe the reading experience in their own words on an online platform shared among the test participants. General statements were formulated based on user-defined attributes and rated by all users on a numeric scale at different stages of the test period. This method resulted with quantitative data of even entirely new experience measures that would not have been found in predefined sets of UX categories.