Back to Search
Start Over
Hybrid Video and Image Hashing for Robust Face Retrieval
- Source :
- FG
- Publication Year :
- 2020
- Publisher :
- IEEE, 2020.
-
Abstract
- Video face retrieval (VFR) is an appealing and practical computer vision task, which aims to search particular character from masses of videos like in TV-Series. The challenges of this task mainly lie in two aspects, i.e. faces in such videos contain complex appearance variations with uncontrollable shooting environment and searching from big data usually requires high efficiency in both space and time. To fulfill this task, current works typically proceed in a learning to hash manner by fusing single-frame features within a video to obtain the video representation and further embedding it into Hamming space to yield video binary codes. The feature fusion stage has inevitably discarded too much frame information and leads to less discriminative video codes. In this paper, we propose Hybrid Video and Image Hashing (HVIH) to learn more effective binary codes for face videos. Specifically, we fully exploit the dense frame features rather than simply discarding them after the video level fusion and jointly optimize binary codes for the video and its composed frames in adapted supervised manners. To achieve more robust video representation, we introduce a module of video center alignment to ensure the binary codes location of the video and its frames to be as compact and consistent as possible in the Hamming space, which naturally facilitates both tasks of video-to-video retrieval and image-to-video retrieval. Extensive experiments on two challenging video face databases demonstrate the superiority of our approach over the state-of-the-art.
- Subjects :
- business.industry
Computer science
Frame (networking)
Feature extraction
Hash function
ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION
02 engineering and technology
010501 environmental sciences
01 natural sciences
Facial recognition system
Robustness (computer science)
Face (geometry)
0202 electrical engineering, electronic engineering, information engineering
020201 artificial intelligence & image processing
Binary code
Computer vision
Artificial intelligence
Hamming space
business
0105 earth and related environmental sciences
Subjects
Details
- Database :
- OpenAIRE
- Journal :
- 2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020)
- Accession number :
- edsair.doi...........4741891c877f77aa5f24252dfe9f41d5