Search

• A global and local information based visualization framework is proposed. • Edge-preserving filtering is first adopted to visualize hyperspectral image. • Experimental results show outstanding performance compared with other methods. In this paper, an edge-preserving filtering and principal component analysis (PCA)-based visualization method is proposed for hyperspectral images, in which both global and local image information of hyperspectral images (HSIs) are taken into account in the proposed visualization framework that consists of the following major steps. First, the band number of the original image is reduced with averaging-based image fusion (AIF). Then, the edge-preserving filtering is performed on the dimension reduced image so as to decompose it into two components, i.e., the base layers which contain the large-scale boundary information, and the detail layers which contain the mid- and small-scale edges and textures. Next, the base layers are fused with the principal component analysis method, and the detail layers are fused with the weighted sum method, in which the fusion weights are determined by the transform matrix of the base layers. Finally, the fused detail layers are enhanced with histogram equalization and combined with the fused base layers to visualize the hyperspectral image. Experimental results on four real hyperspectral data sets demonstrate that the proposed approach performs the best in improving image contrast and preserving the details. In addition, compared with seven state-of-the-art visualization methods, the quantitative metrics obtained by the proposed method on four data sets have been increased by 80.45%, 69.29%, 138.61%, and 23.21% on average in terms of separability of features (SF), standard deviation (SD), average gradient (AG), and entropy (EN). [ABSTRACT FROM AUTHOR]

Hyperspectral Image (HSI) visualization, which aims at displaying as much material information of original images as possible on a trichromatic monitor with natural color, plays an important role in image interpretation and analysis. However, most of the HSI visualization methods only focus on presenting the detail information of a scene without providing natural colors and distinguishing land covers with similar colors. In order to address this problem, this article proposes a multichannel pulse-coupled neural network (MPCNN)-based HSI visualization method, which consists of the following steps. First, the MPCNN is proposed and explored to fuse the original HSI so as to obtain a fused band with rich spatial details. Then, a color mapping scheme is proposed to determine the weights of red, green, and blue (RGB) channels. Finally, the weighted RGB channels are stacked together for visualization. Experiments performed on four hyperspectral data sets demonstrate that the proposed method not only displays the HSI with nature colors but also improves the details in the image. The effectiveness of the proposed method is demonstrated in terms of both visual effect and objective indexes. [ABSTRACT FROM AUTHOR]

In this paper, a novel shift-invariant dual-tree complex shearlet transform (SIDCST) is constructed and applied to infrared and visible image fusion. Firstly, the mathematical morphology is used for the source images. Then, the images are decomposed by SIDCST to obtain the low frequency sub-band coefficients and high frequency sub-band coefficients. For the low frequency sub-band coefficients, a novel sparse representation (SR)-based fusion rule is presented. For the high frequency sub-band coefficients, a scheme based on the theory of adaptive dual-channel pulse coupled neural network (2APCNN) is presented, and the energy of edge is used for the external input of 2APCNN. Finally, the fused image is obtained by performing the inverse SIDCST. The experimental results show that the proposed approach can obtain state-of-the-art performance compared with conventional image fusion methods in terms of both objective evaluation criteria and visual quality. [ABSTRACT FROM AUTHOR]

Infrared and visible image fusion is an effective image processing technique to obtain more comprehensive information, which can help people better understand various scenarios. In this paper, a novel infrared and visible image fusion method is proposed which fully considers the attributes of objects in source images. Benefiting from the attribute and the edge-preserving filters, the prominent objects in the infrared source image are effectively extracted. Then, the weight-based Laplacian pyramid fusion strategy is adopted to get more natural fusion results. The experimental results on the public image fusion datasets and a new infrared–visible video fusion dataset show that the proposed method achieves state-of-the-art fusion performance in terms of both visual and objective evaluations. The proposed algorithm is also implemented in an infrared–visible dual sensor system, which demonstrated the practicability of our fusion method. • A novel attribute guided image fusion method is proposed. • A dual infrared and visible imaging system is constructed. • A high-quality infrared–color visible image and video dataset is established. [ABSTRACT FROM AUTHOR]

Multi-modal image fusion is widely used in various fields, especially in military, medical, industrial detection and other fields. Image fusion can integrate redundant and complementary information of two or more multi-modal images into one image, so that the fused image contains more useful information. In this paper, we construct a novel dataset for Multi-modal Image Fusion Applications (MOFA), including four modals: visible, near-infrared (NIR), long-wavelength infrared (LWIR) and polarization. The MOFA dataset contains 1062 images of 118 groups, in which 450 are indoor and 612 are outdoor. The dataset is applied to different image fusion applications, including general multi-modal image fusion, fusion based image super-resolution and image restoration. Multiple image fusion methods are compared and analyzed on this dataset with a qualitative assessment of subjective and objective metrics. Based on the experiments, the advantages and disadvantages of different methods are discussed. Moreover, the challenging problems of image fusion are concluded. • Build a multi-modal imaging device. • Construct a multi-modal dataset, including visible, NIR, LWIR and polarization. • Explore the effectiveness of the dataset for different image processing tasks. • Analyze the advantages and disadvantages of different fusion methods. [ABSTRACT FROM AUTHOR]