Supporting the analytical reasoning process in maritime anomaly detection : evaluation and experimental design

Despite the growing number of systems providing visual analytic support for investigative analysis, few empirical studies include investigations on the analytical reasoning process that needs to be supported. In this paper, we present an approach to evaluate the ability of certain visual representations from an integrated visual-computational environment to support the completion of representative tasks. The problem area studied is the detection and identification of anomalous vessels and situations while monitoring maritime traffic data. This paper presents: (1) a brief review of current evaluation methodologies within information visualization and visual analytics, (2) an analysis of operator’s analytical reasoning process (derived from field work in maritime control centers and a literature review on analytical reasoning theories), (3) a list of representative tasks for usability evaluation and (4) an approach to evaluate the use of normal behavioral models representations during the detection process.