Search

In this paper we investigate the consistency of answer assessment in a complex question answering task examining features of assessor consistency, types of answers and question type.

This paper presents the results of a study aimed at measuring the usefulness of presenting the results of an Information Retrieval search on WAP mobile phones. The experimentation focuses on presenting automatically-generated summaries of newspaper articles of increasing length on a mobile phone interface and in studying the differences in users' perception of relevance of the retrieved documents. The aim is to study experimentally how users' perception of relevance varies depending on the length of the summary, and in relation to the specific characteristic of the mobile interface that content is presented. Experimental results suggest that hierarchical query biased summaries are useful when dealing with small screens and assist users in making correct relevance judgments.