Back to Search Start Over

RRL-GAT: Graph Attention Network-Driven Multilabel Image Robust Representation Learning

Authors :
Kehua Guo
Bin Hu
Di Zhou
Xiaokang Wang
Jian Zhang
Source :
IEEE Internet of Things Journal. 9:9167-9178
Publication Year :
2022
Publisher :
Institute of Electrical and Electronics Engineers (IEEE), 2022.

Abstract

Exploring the characterization laws of image data and improving the efficiency of image data characterization knowledge is essential to promote the development of the Internet of Things technology. Considering that images in the real world usually contain multiple objects, and the objects are closely dependent. For these reasons, it brings great challenges to the robust representation learning of multi-label images. In general, researchers model the relationship between objects based on a class activation map and use graph convolution to mine the dependencies between objects. However, graph structure data often contain noise, which means that the edges between nodes are sometimes not so reliable, and the relative importance of neighbors is also different. Based on this, our goal is to reduce noisy connections and false connections between objects, eliminate multi-label image representation bias, and learn robust representations. Therefore, we propose a Robust Representation Learning method for multi-label images driven by Graph Attention Network (RRL-GAT). Specifically, to reduce the accidental false connection of objects in the image, we propose the Class Attention Graph convolution module (C-GAT) to mine the strong association structure between categories. Besides, for the dynamic correlation between objects in the image, we propose an Adaptive Graph Attention Convolution module (A-GAT) to capture the subtle dynamic dependencies in the image. The results on two authoritative datasets show that our method is significantly better than all current state-of-the-art methods. Besides, the visualization results show that RRL-GAT can capture the semantic relationship of a specific input image and has sufficient recognizability.

Details

ISSN :
23722541
Volume :
9
Database :
OpenAIRE
Journal :
IEEE Internet of Things Journal
Accession number :
edsair.doi...........86be1635de3e4aba4e08c880dacd2216