Back to Search Start Over

Harmonizing Hierarchical Manifolds for Multimedia Document Semantics Understanding and Cross-Media Retrieval.

Authors :
Yi Yang
Yue-Ting Zhuang
Fei Wu
Yun-He Pan
Source :
IEEE Transactions on Multimedia; Apr2008, Vol. 10 Issue 3, p437-446, 10p
Publication Year :
2008

Abstract

In this paper, we consider the problem of multimedia document (MMD) semantics understanding and content-based cross-media retrieval. An MMD is a set of media objects of different modalities but carrying the same semantics and the content-based cross-media retrieval is a new kind of retrieval method by which the query examples and search results can be of different modalities. Two levels of manifolds are learned to explore the relationships among all the data in the level of MMD and in the level of media object respectively. We first construct a Laplacian media object space for media object representation of each modality and an MMD semantic graph to learn the MMD semantic correlations. The characteristics of media objects propagate along the MMD semantic graph and an MMD semantic space is constructed to perform cross-media retrieval. Different methods are proposed to utilize relevance feedback and experiment shows that the proposed approaches are effective. [ABSTRACT FROM PUBLISHER]

Details

Language :
English
ISSN :
15209210
Volume :
10
Issue :
3
Database :
Complementary Index
Journal :
IEEE Transactions on Multimedia
Publication Type :
Academic Journal
Accession number :
52154376
Full Text :
https://doi.org/10.1109/TMM.2008.917359