Search

Usability evaluations provide software development teams with insights on the degree to which a software application enables a user to achieve his/her goals, how fast these goals can be achieved, how easy it is to learn and how satisfactory it is in use. Although usability evaluations are crucial in the process of developing software systems with a high level of usability, their use is still limited in the context of small software development companies. Several approaches have been proposed to support software development practitioners (SWPs) in conducting usability evaluations and this paper presents two in-depth empirical studies of supporting SWPs by training them to become barefoot usability evaluators. Findings show that the SWPs after 30 hours of training obtained considerable abilities in identifying usability problems and that this approach revealed a high level of downstream utility. Results also show that the SWPs created relaxed conditions for the test users when acting as test monitors but experienced problems with making users think aloud. Considering the quality of problem descriptions, we found that the SWPs were better at providing clear and precise problem descriptions than at describing the impact, cause, user actions and providing data support for observations. [ABSTRACT FROM PUBLISHER]

Coolness has recently started to be explored as a design goal for interactive products from practitioners as well as researchers within human–computer interaction (HCI), but there is still a need to further operationalise the concept and explore how we can measure it. Our contribution in this paper is the COOL questionnaire. We based the creation of the questionnaire on literature suggesting that perceived coolness is decomposed to outer cool (the style of a product) and inner cool (the personality characteristics assigned to it). In this paper, we focused on inner cool, and we identified 11 inner cool characteristics. These were used to create an initial pool of question items and 2236 participants were asked to assess 16 mobile devices. By performing exploratory and confirmatory factor analyses, we identified three factors that can measure the perceived inner coolness of interactive products: desirability, rebelliousness and usability. These factors and their underlying 16 question items comprise the COOL questionnaire. The whole process of creating the questionnaire is presented in detail in this paper and we conclude by discussing our work against related work on coolness and HCI. [ABSTRACT FROM AUTHOR]

In recent years, website aesthetics has received a fair amount of attention from the HCI community. This has led to the creation of a variety of multi-item questionnaires aimed at capturing users' aesthetic judgments. Researchers have used these questionnaires in several HCI studies to investigate the relationship between aesthetics and other evaluative constructs such as usability. However, their usefulness as evaluation tools in visual design practice remains underexplored. Lengthy multi-item questionnaires can be particularly problematic especially in studies where participants must evaluate multiple designs or when they are required to give responses repeatedly in predefined time intervals. Despite the criticism, single-item scales have been used in many past studies in which questionnaire length could be problematic. Another alternative available to practitioners/researchers are short versions of standardised multi-item questionnaires that have been created for the aesthetic evaluations of websites. In this paper, we present a study in which we compare the performance of three such condensed aesthetic questionnaires (i.e. aesthetics scale, AttrakDiff, VisAWI) during a website redesign project. The short versions of those questionnaires were used by 187 users during an evaluation of 7 alternative website designs. The questionnaires were compared on performance criteria such as reliability, validity, and predictive ability. Data analysis showed that although AttrakDiff's overall performance was better, a considerable amount of variance in aesthetic judgment could not be accounted for by any of the questionnaires. [ABSTRACT FROM AUTHOR]

This paper describes experiences with new methodological approaches utilised in early viewer evaluations of a public service television drama series. We would like to challenge self-reports as the only source of data in viewer evaluations of television drama series. Based on two viewer evaluation studies of one-hour drama series, both conducted in an applied research setting, we outline pros and cons of electroencephalography (EEG) and skin conductance (SC) measurements tested in combination with in-depth interviews and written self-reports. In conclusion, we suggest a research design consisting of skin conductance measurement with written self-reports as the preferred method for viewer evaluations of television drama series conducted in an applied research setting where time and money is an important constraint. [ABSTRACT FROM AUTHOR]

Usability and user experience (UX) methods come from academic environments, where industrial conditions such as time and resources are not of prime importance. Furthermore, usability and UX methods originate from a time when almost all software developments followed a traditional approach, such as the waterfall model. These two facts entail that existing methods often are too resource demanding and complex to apply directly into today’s agile, industrial environments. In this paper we make the claim that methods must be updated and tailored in order to be applicable within the agile, industrial development framework of today. We pursue a solution to simplify well-known methods and to train software developers to perform the UX work. To do this, three methods are modified via an iterative process together with the development of supporting materials. Software developers in three companies are trained in the methods to assess the approach. We find that it indeed is feasible to update and tailor existing usability and UX methods to fit into an agile, industrial environment. Furthermore, we show that it is possible to train developers to perform the usability and UX methods via one-day,in-situsessions using an ‘instructor’-teaching approach. The training is based on hands-on exercises and real-life tasks. This further boosts the developers’ confidence in performing UX work and promises a better consideration of UX in the development phases. We evaluate our approach through observations of the developers performing the UX tasks on their own at a later point in time. [ABSTRACT FROM PUBLISHER]

Whereas research in usability evaluation abounds, few evaluation approaches focus on utility. We present the utility inspection method (UIM), which prompts evaluators about the utility of the system they evaluate. The UIM asks whether a system uses global platforms, provides support infrastructure, is robust, gives access to rich content, allows customisation, offers symbolic value and supports companionship among users and between users and developers. We compare 47 participants’ use of UIM and heuristic evaluation (HE). The UIM helps identify more than three times as many problems as HE about the context of activities; HE helps identify 2.5 times as many problems as UIM about the interface. Usability experts consider the problems found with UIM more severe and more complex to solve compared to those found with HE. We argue that UIM complements existing usability evaluation methods and discuss future research on utility inspection. [ABSTRACT FROM AUTHOR]