Search

Support Vector Machine (SVM) with the margin theory is widely used for the hyperspectral classification. However, the margin model is a single interval and does not represent the complete distribution of hyperspectral image data sets. In addition, the spatial texture information obtained by filtering in recent years has become a hot research topic for improving classification of hyperspectral images, but the spatial correlation information is often lost in the spatial texture information extraction. To solve this problem, this paper proposed an algorithm with large margin distribution machine (LDM) that combined the spatial information obtained by the bilateral filter and linear spatial correlation information (BFLSCI-LDM). First, spatial features were extracted by bilateral filter from hyperspectral image whose dimensionality was reduced by principal component analysis. Next, the linear spatial correlation information was constructed for hyperspectral images. Finally, the spatial information and original spectral information were combined for LDM. The experimental results of actual hyperspectral images indicated that the proposed BFLSCI-LDM method was superior to other classification methods, including the original SVM with the raw spectral features, the dimensionality reduction features, and spatial-spectral information, the method of edge-preserving filter and recursive filter, and the LDM-based method. [ABSTRACT FROM AUTHOR]

Hyperspectral image feature extraction generally does not consider the optimisation of structure element types, resulting in the loss of spatial correlation information. To solve this issue, this paper proposes a novel adaptive classification method (MPDTNC-SVM), in which spatial information is extracted by Morphological Profile Filter (MPF) and Domain Transform Normalised Convolution Filter (DTNCF). First, MPF extracts the spatial features on multiple principal component analysis (PCA) components of the hyperspectral image, and DTNCF works over all spectral bands to extract spatially correlated features. The two spatial features are then combined and fed into Support Vector Machine (SVM). Second, a two-step optimisation is implemented in the classification process. Specifically, the best structure of MPF is chosen for classification. Next, the optimal parameters of the structural elements are obtained through iterative classification optimisation, with the best classification performance produced in the process. Experimental results of actual hyperspectral images show that the proposed MPF and DTNCF with SVM (MPDTNC-SVM) method is superior to other classification methods, including Edge-Preserving Filter and Recursive Filter method, morphological feature-based methods, and the SVM methods with raw spectral features, reduced-dimensional and spatial-spectral information. [ABSTRACT FROM AUTHOR]

Unlike natural images, remote sensing scene images usually contain one scene label and many object labels, and many object labels are arranged dispersedly, which brings great difficulties to feature extraction of scene label. To accurately identify scene labels from remote sensing scene images with multiple object labels, it is important to fully understand the global context of the image. In order to solve the challenges of multi-label scene images and improve the classification performance, a global context feature extraction module is proposed in this paper. The module combines the semantics information of different regions through a global pooling and three different scale sub-regions pooling, which makes the module have stronger ability of global feature representation. In addition, in order to fully understand the semantic content of remote sensing images, a three branch joint feature extraction module is constructed, which consists of the global context feature module, 3 × 3 convolution branch and identity branch are fused. Finally, a lightweight convolution neural network based on joint features (LCNN-JF) is constructed using traditional convolution, depthwise separable convolution, joint feature extraction module and classifier for remote sensing scene image classification. A series of experimental results on four datasets, UCM, AID, RSSCN and NWPU, demonstrate that the proposed method has better feature representation ability and can achieve better classification of remote sensing scene images. [ABSTRACT FROM AUTHOR]

Super-resolution mapping (SRM) is a technique for exploring spatial distribution information of the land-cover classes at finer spatial resolution. The soft-then-hard super-resolution mapping (STHSRM) algorithm is a type of SRM algorithm that first estimates the soft class values for sub-pixels at the target fine spatial resolution and then predicts the hard class labels for sub-pixels. The sub-pixel shifted images from the same area can be incorporated to improve the accuracy of STHSRM algorithm. In this article, multiscale sub-pixel shifted images (MSSI) based on the fine-scale model and the coarse-scale model are utilized to increase the accuracy of STHSRM. First, class fraction images are derived from multiple sub-pixel shifted coarse spatial resolution images by soft classification. Then using the sub-pixel/sub-pixel spatial attraction model as fine-scale and the sub-pixel/pixel spatial attraction model as coarse scale, all MSSI can be derived from fraction images. The MSSI for each class are then integrated to obtain the desired fine spatial resolution images. Finally, the integrated fine spatial resolution images are used to allocate classes for sub-pixel. Experiments on two synthetic remote sensing images and a real hyperspectral remote sensing imagery show that the proposed method produces higher mapping accuracy result. [ABSTRACT FROM AUTHOR]

In recent years, convolution neural networks (CNNs) and graph convolution networks (GCNs) have been widely used in hyperspectral image classification (HSIC). CNNs can effectively extract the spatial spectral features of hyperspectral images (HSIs), while GCNs can quickly capture the structural features of HSIs, which makes the effective combination of the two is beneficial to improve classification performance of hyperspectral images. However, the high redundancy of feature information and the problem of small sample are still the major challenges of HSIC. In order to alleviate these problems, in this paper, a new graph and double pyramid attention network based on linear discrimination of spectral interclass slices (GDPA_LDSICS) is proposed. First, a linear discrimination of spectral inter class slices (LDSICS) module is designed. The LDSICS module can effectively eliminate a lot of redundancy in spectral dimension, which is conducive to subsequent feature extraction. Then, the spatial spectral deformation (SSD) module is constructed, which can effectively correlate the spatial spectral information closely. Finally, in order to alleviate the problem of small sample, a double branch structure of CNN and GCN is developed. On the CNN branch, a double pyramid attention (DPA) structure is designed to model context semantics to avoid information loss caused by long-distance feature extraction. On the GCN branch, an adaptive dynamic encoding (ADE) method is proposed, which can more effectively capture the topological structure of spatial spectral features. Experiments on four open datasets show that the GDPA_LDSICS can provide better classification performance and generalization performance than other most advanced methods. [ABSTRACT FROM AUTHOR]

Data visualization can accelerate data processing so that enormous quantities of data can be utilized effectively. Visualization of data can achieve image communication between people and data as well as between people to help observers get information hidden in data, providing a tool for discovery and understanding of scientific law. To solve the problem of multi-image and multi-modality image display in the field of remote sensing, an interactive colour visualization method for hyperspectral imagery (HSI) is proposed in this article. This method visualizes complex information of original HSI data through different fusion results of multiple images in a colour space, which is under the interactive control of the observers. By gradually determining predetermined points, observers can obtain a relatively satisfying image blending mode, output an image with clearer interested target, and obtain the corresponding mixing coefficient of images. The proposed method can also solve the problem that traditional visualization methods only display information from three bands in one image, and conduct information mining in HSI with a certain purpose based on the demands of users. In addition, this approach is also applicable for visualization of other types of multi-modal imagery. [ABSTRACT FROM PUBLISHER]

In this paper, we propose a novel residual fusion classification method for hyperspectral image using spatial–spectral information, abbreviated as RFC-SS. The RFC-SS method first uses the Gabor texture features and the non-parametric weighted spectral features to describe the hyperspectral image from both aspects of spatial and spectral information. Then it applies the residual fusion method to save the useful information from different classification methods, which can greatly improve the classification performance. Finally, the test sample is assigned to the class that has the minimal fused residuals. The RFC-SS classification method is tested on two classical hyperspectral images (i.e. Indian Pines, Pavia University). The theoretical analysis and experimental results demonstrate that the RFC-SS classification method can achieve a better performance in terms of overall accuracy, average accuracy, and the Kappa coefficient when compared to the other classification methods. [ABSTRACT FROM PUBLISHER]

Mixed pixels are widely existent in remote-sensing imagery. Although the proportion occupied by each class in mixed pixels can be determined by spectral unmixing, the spatial distribution of classes remains unknown. Sub-pixel mapping (SPM) addresses this problem and a sub-pixel/pixel spatial attraction model (SPSAM) has been introduced to realize SPM. However, this algorithm fails to adequately consider the correlation between sub-pixels. Consequently, the SPM results created by SPSAM are noisy and the accuracy is limited. In this article, a method based on particle swarm optimization is proposed as post-processing on the SPM results obtained with SPSAM. It searches the most likely spatial distribution of classes in each coarse pixel to improve the SPSAM. Experimental results show that the proposed method can provide higher accuracy and reduce the noise in the results created by SPSAM. When compared with the available modified pixel-swapping algorithm, the proposed method often yields higher accuracy results. [ABSTRACT FROM AUTHOR]

In hyperspectral remote sensing, the classification of hyperspectral imagery is an important issue of concern. However, obtaining sufficient labelled samples for the classification is hard work and consumes enormous labour and material resources. To solve this problem, many scholars make their efforts to the semi-supervised learning method. The self-training model is a popular semi-supervised learning method, which trains a classifier using a few labelled samples and many unlabelled samples in an iterative manner. Nevertheless, the self-training model may provide misclassification as adding incorrect unlabelled samples. This paper proposes a novel semi-supervised learning method, which attempts to introduce the affinity propagation and spatial constraint to self-training model. In the proposed algorithm, a self-training model is employed to expand the labelled sample set. The affinity propagation is applied to select a group of reliable unlabelled samples. To further protect the reliability of unlabelled samples, the selection process of self-training model is constrained in the spatial local area of the labelled samples. In the iteration, the reliable unlabelled samples are selected and added to the labelled sample set. After that, the classifier is trained by the updated labelled samples. The algorithm finishes as the iterations exceed the predetermined value or the labelled sample set is unchanged. Different from the traditional self-training-based semi-supervised learning method, there are mainly three improvements. First, the selection of reliable unlabelled samples is conducted by the affinity propagation, which can effectively improve the reliability of the unlabelled samples. Second, the spatial constraint is introduced to restrict the selection process of self-training model, which can protect the reliability of unlabelled samples and alleviate the computational complexity. Finally, the spectral correlation angle is applied to construct the similarity matrix of affinity propagation, so that the algorithm is more suitable for hyperspectral imagery. A comparative analysis was conducted with classical self-training semi-supervised algorithms to test the effectiveness of the method. It was found that the proposed method provided higher overall accuracy, average accuracy and kappa coefficient (κ) than the competitors. [ABSTRACT FROM AUTHOR]

Generative adversarial networks (GANs) have effectively promoted the development of hyperspectral image classification technology in generating samples. Many GAN-based models for hyperspectral image classification use deconvolution to generate fake samples, which will cause chequerboard artefacts and affect classification performance. Furthermore, the training of GANs still faces the problem of mode collapse. Aiming at the above problems, we proposed a dual hybrid convolutional generative adversarial network (DHCGAN) for hyperspectral image classification. Firstly, the combination of nearest neighbour upsampling and sub-pixel convolution is employed in the generator, which avoids the overlap of convolution domain and effectively suppresses the chequerboard artefacts caused by deconvolution. Secondly, the traditional convolution and dilated convolution are fused in the discriminator, which expands the receptive field without increasing parameters and achieves more effective feature extraction. In addition, some adaptive drop blocks are embedded into the generator and discriminator to effectively alleviate the problem of mode collapse. Experiments were performed on four hyperspectral datasets (including three classical datasets – Indian Pines, University of Pavia and Houston, a new dataset – WHU-Hi-HanChuan). Experimental results show that the proposed method can provide a certain performance improvement over some competing methods, such as the accuracy has been increased by more than 1% on the three classical datasets, and even got over 3% improvement on WHU_Hi_HanChaun dataset. [ABSTRACT FROM AUTHOR]