1. Multimedia Information Seeking through Search and Hyperlinking
- Author
-
Danish Nadeem, Camille Guinaudeau, Shu Chen, Roeland Ordelman, Rik Van de Walle, Petra Galuščáková, Gareth J. F. Jones, Martha Larson, Tom De Nies, Pedro Debevere, Guillaume Gravier, Pascale Sébillot, Robin Aly, Pavel Pecina, Maria Eskevich, Centre for Next Generation Localisation (CNGL), Dublin City University [Dublin] (DCU), University of Twente, Multimedia content-based indexing (TEXMEX), Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), Université de Rennes (UR)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-Institut National de Recherche en Informatique et en Automatique (Inria)-Centre National de la Recherche Scientifique (CNRS)-Université de Rennes (UR)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-Institut National de Recherche en Informatique et en Automatique (Inria)-Centre National de la Recherche Scientifique (CNRS)-Inria Rennes – Bretagne Atlantique, Institut National de Recherche en Informatique et en Automatique (Inria), Department of Electronics and Information Systems - Ghent University (ELIS), Universiteit Gent = Ghent University (UGENT), Charles University [Prague] (CU), Delft Multimedia Information Retrieval Lab (DMIR), Delft University of Technology (TU Delft), University of Twente [Netherlands], Université de Rennes 1 (UR1), Université de Rennes (UNIV-RENNES)-Université de Rennes (UNIV-RENNES)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-Institut National des Sciences Appliquées (INSA)-Institut National de Recherche en Informatique et en Automatique (Inria)-Centre National de la Recherche Scientifique (CNRS)-Université de Rennes 1 (UR1), Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-Institut National des Sciences Appliquées (INSA)-Institut National de Recherche en Informatique et en Automatique (Inria)-Centre National de la Recherche Scientifique (CNRS)-Inria Rennes – Bretagne Atlantique, and Universiteit Gent = Ghent University [Belgium] (UGENT)
- Subjects
Computer science ,InformationSystems_INFORMATIONSTORAGEANDRETRIEVAL ,02 engineering and technology ,Multimedia information retrieval ,Crowdsourcing ,hyperlinking ,Task (project management) ,World Wide Web ,Image processing ,Web page ,0202 electrical engineering, electronic engineering, information engineering ,Information retrieval ,Multimodal search ,search ,multimedia ,business.industry ,Information seeking ,[INFO.INFO-MM]Computer Science [cs]/Multimedia [cs.MM] ,020207 software engineering ,Hyperlink ,multimedia information retrieval ,[INFO.INFO-TT]Computer Science [cs]/Document and Text Processing ,020201 artificial intelligence & image processing ,business ,Internet video ,Multimedia systems - Abstract
International audience; Searching for relevant webpages and following hyperlinks to related content is a widely accepted and effective approach to information seeking on the textual web. Existing work on multimedia information retrieval has focused on search for individual relevant items or on content linking without specific attention to search results. We describe our research exploring integrated multimodal search and hyperlinking for multimedia data. Our investigation is based on the MediaEval 2012 Search and Hyperlinking task. This includes a known-item search task using the Blip10000 internet video collection, where automatically created hyperlinks link each relevant item to related items within the collection. The search test queries and link assessment for this task was generated using the Amazon Mechanical Turk crowdsourcing platform. Our investigation examines a range of alternative methods which seek to address the challenges of search and hyperlinking using multimodal approaches. The results of our experiments are used to propose a research agenda for developing effective techniques for search and hyperlinking of multimedia content.
- Published
- 2013