Back to Search Start Over

Memory Segment Matching Network Based Image Geo-Localization

Authors :
Jienan Chen
Yunzhi Duan
Gerald E. Sobelman
Cong Zhang
Source :
IEEE Access, Vol 7, Pp 77448-77459 (2019)
Publication Year :
2019
Publisher :
IEEE, 2019.

Abstract

Humans and other animals can easily perform self-localization by means of vision. However, that remains a challenging task for computer vision algorithms with traditional image matching methods. In this paper, we propose a memory segment matching network for image geo-localization that is inspired by the discovery of the place cell in the brain by using artificial intelligence. The place cell becomes active when an animal enters a particular location, where the external sensory information in the environment matches features stored in the hippocampus. In order to emulate the operation of the place cell, we employ a convolutional neural network (CNN) and a long-short term memory (LSTM) to extract the visual features of the environment. The extracted features are stored as segmented memory bounded with a location tag. A matching network is utilized to calculate the cross firing probability of the memory segment and the current input visual data. The final prediction of the location is obtained by sending the cross firing probability to an inference engine that uses a hidden Markov model (HMM). According to the simulation results, the localization accuracy reaches up to 95% for the datasets tested, which outperforms the state-of-the-art by 17% in localization detection accuracy.

Details

Language :
English
ISSN :
21693536
Volume :
7
Database :
Directory of Open Access Journals
Journal :
IEEE Access
Publication Type :
Academic Journal
Accession number :
edsdoj.3bfd95f4d3437d8812a33f554483f2
Document Type :
article
Full Text :
https://doi.org/10.1109/ACCESS.2019.2922378