Back to Search Start Over

Selective feature connection mechanism: Concatenating multi-layer CNN features with a feature selector.

Authors :
Du, Chen
Wang, Yanna
Wang, Chunheng
Shi, Cunzhao
Xiao, Baihua
Source :
Pattern Recognition Letters. Jan2020, Vol. 129, p108-114. 7p.
Publication Year :
2020

Abstract

• We propose a novel method termed SFCM to fuse CNNs features of different layers. • Our SFCM can be implemented by direct connection and residual connection. • Our SFCM can be used in many existing frameworks to achieve better performance. • We evaluate the SFCM on many different challenging computer vision tasks. Different layers of deep convolutional neural networks(CNNs) can encode different-level information. High-layer features always contain more semantic information, and low-layer features contain more detail information. However, low-layer features suffer from the background clutter and semantic ambiguity. During visual recognition, the feature combination of the low-layer and high-level features plays an important role in context modulation. If directly combining the high-layer and low-layer features, the background clutter and semantic ambiguity may be caused due to the introduction of detailed information. In this paper, we propose a general network architecture to concatenate CNN features of different layers in a simple and effective way, called Selective Feature Connection Mechanism (SFCM). Low-level features are selectively linked to high-level features with a feature selector which is generated by high-level features. The proposed connection mechanism can effectively overcome the above-mentioned drawbacks. We demonstrate the effectiveness, superiority, and universal applicability of this method on multiple challenging computer vision tasks, including image classification, scene text detection, and image-to-image translation. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
01678655
Volume :
129
Database :
Academic Search Index
Journal :
Pattern Recognition Letters
Publication Type :
Academic Journal
Accession number :
140935703
Full Text :
https://doi.org/10.1016/j.patrec.2019.11.015