1. Heterogeneous Few-Shot Learning for Hyperspectral Image Classification
- Author
-
Zhaokui Li, Qian Du, Ming Liu, Haibo Yang, Fei Li, Yan Wang, Yushi Chen, and Yuexin Yang
- Subjects
Source code ,Computer science ,business.industry ,Deep learning ,media_common.quotation_subject ,Supervised learning ,Pattern recognition ,Geotechnical Engineering and Engineering Geology ,Class (biology) ,Convolution ,Spatial network ,Discriminative model ,Artificial intelligence ,Electrical and Electronic Engineering ,business ,Spatial analysis ,media_common - Abstract
Deep learning has achieved great success in hyperspectral image classification. However, its success relies on the availability of sufficient training samples. Unfortunately, the collection of training samples is expensive, time-consuming, and even impossible in some cases. Natural image data sets that are different from HSI, such as Image Net and mini-ImageNet, have abundant texture and structure information. Effective knowledge transfer between two heterogeneous data sets can significantly improve the accuracy of HSI classification. In this letter, heterogeneous few-shot learning (HFSL) for HSI classification is proposed with only a few labeled samples per class. Firstly, few-shot learning is performed on the mini-ImageNet data sets to learn the transferable knowledge. Then, to make full use of the spatial and spectral information, a spectral-spatial fusion network is devised. Spectral information is obtained by the residual network with pure one-dimensional operators. Spatial information is extracted by a convolution network with pure two-dimensional operators, and the weights of the spatial network are initialized by the weights of the model trained on the mini-ImageNet data sets. Finally, few-shot learning is fine-tuned on HSI to extract discriminative spectral-spatial features and individual knowledge, which can improve the classification performance of the new classification task. Experiments conducted on two public HSI data sets demonstrate that the HFSL outperforms the existing few-shot learning methods and supervised learning methods for HSI classification with only a few labeled samples. Our source code is available at https://github.com/Li-ZK/HFSL.
- Published
- 2022
- Full Text
- View/download PDF