Search

This letter presents a novel image quality index which extends the Universal Image Quality Index for monochrome images to multispectral and hyperspectral images through hypercomplex numbers. The proposed index is based on the computation of the hypercomplex correlation coefficient between the reference and tested images, which jointly measures spectral and spatial distortions. Experimental results, both from true and simulated images, are presented on spaceborne and airborne visible/infrared images. The results prove accurate measurements of inter- and intraband distortions even when anomalous pixel values are concentrated on few bands.

In this paper, we propose an optimum algorithm, in the minimum mean-square-error (mmse) sense, for panchromatic (Pan) sharpening of very high resolution multispectral (MS) images. The solution minimizes the squared error between the original MS image and the fusion result obtained by spatially enhancing a degraded version of the MS image through a degraded version, by the same scale factor, of the Pan image. The fusion result is also optimal at full scale under the assumption of invariance of the fusion parameters across spatial scales. The following two versions of the algorithm are presented: a local mmse (lmmse) solution and a fast implementation which globally optimizes the fusion parameters with a moderate performance loss with respect to the lmmse version. We show that the proposed method is computationally practical, even in the case of local optimization, and it outperforms the best state-of-the-art Pan-sharpening algorithms, as resulted from the IEEE Data Fusion Contest 2006, on true Ikonos and QuickBird data and on simulated Pleiades data.

This paper presents an image fusion method suitable for pan-sharpening of multispectral (MS) bands, based on nonseparable multiresolution analysis (MRA). The low-resolution MS bands are resampled to the fine scale of the panchromatic (Pan) image and sharpened by injecting highpass directional details extracted from the high-resolution Pan image by means of the curvelet transform (CT). CT is a nonseparable MRA, whose basis functions are directional edges with progressively increasing resolution. The advantage of CT with respect to conventional separable MRA, either decimated or not, is twofold. Firstly, directional detail coefficients matching image edges may be preliminarily soft-thresholded to achieve a noise reduction that is better than that obtained in the separable wavelet domain. Secondly, modeling of the relationships between high-resolution detail coefficients of the MS bands and of the Pan image is more fitting, being accomplished in the directional multiresolution domain. Experiments are carried out on very-high-resolution MS + Pan images acquired by the QuickBird and Ikonos satellite systems. Fusion simulations on spatially degraded data, whose original MS bands are available for reference, show that the proposed curvelet-based fusion method performs slightly better than the state-of-the art. Fusion tests at the full scale reveal that an accurate and reliable Pan-sharpening, little affected by local inaccuracies even in the presence of complex and detailed urban landscapes, is achieved by the proposed method.

In this paper, we propose a lossless compression algorithm for hyperspectral images inspired by the distributed-source-coding (DSC) principle. DSC refers to separate compression and joint decoding of correlated sources, which are taken as adjacent bands of a hyperspectral image. This concept is used to design a compression scheme that provides error resilience, very low complexity, and good compression performance. These features are obtained employing scalar coset codes to encode the current band at a rate that depends on its correlation with the previous band, without encoding the prediction error. Iterative decoding employs the decoded version of the previous band as side information and uses a cyclic redundancy code to verify correct reconstruction. We develop three algorithms based on this paradigm, which provide different tradeoffs between compression performance, error resilience, and complexity. Their performance is evaluated on raw and calibrated AVIRIS images and compared with several existing algorithms. Preliminary results of a field-programmable gate array implementation are also provided, which show that the proposed algorithms can sustain an extremely high throughput.

In this letter, we investigate the effects of pansharpening (PS) applied to multispectral (MS) multitemporal images in change-detection (CD) applications. Although CD maps computed from pansharpened data show an enhanced spatial resolution, they can suffer from errors due to artifacts induced by the fusion process. The rationale of our analysis consists in understanding to which extent such artifacts can affect spatially enhanced CD maps. To this end, a quantitative analysis is performed which is based on a novel strategy that exploits similarity measures to rank PS methods according to their impact on CD performance. Many multiresolution fusion algorithms are considered, and CD results obtained from original MS and from spatially enhanced data are compared.

We present an experimental study on the effects of pansharp-ening on target detection from multispectral and panchromatic images acquired by very-high resolution satellite sensors. Original and spatially-enhanced image data are used to detect relatively small targets (vehicles on an airport scenario) characterized by a sufficiently well-defined spectral signature in the four MS bands. The aim of the paper is to compare different pansharpening methods by evaluating the performances of target detection on true MS and panchromatic data. Both linear and kernel-based one-class classification methods are considered for the target detection process.

In this paper we propose a lossless compression algorithm for hyperspectral images based on distributed source coding; this algorithm represents a significant improvement over our prior work on the same topic, and has been developed during a project funded by ESA-ESTEC. In particular, the algorithm achieves good compression performance with very low complexity; moreover, it also features a very good degree of error resilience. These features are obtained taking inspiration from distributed source coding, and particularly employing coset codes and CRC-based decoding. As the CRC can be used to decode blocks using a reference different from that used to compress the image, this yields error resilience. In particular, if a block is lost, decoding using the closest collocated block in the second previous band is successful about 70% of the times.

This paper presents a solution to the problem of enhancing the spatial resolution of multispectral images with high-resolution panchromatic observations. The proposed method exploits a Weighted Least Squares estimator to calculate injection parameters in the fusion model. For each pixel of the image a weight is calculated by a classification map. The classifier used in the experiments is a Support Vector Machine in order to obtain high accuracy on each land-cover type. Results are presented and discussed on very-high resolution images acquired by Quickbird and Ikonos satellite systems. Fusion simulations on spatially degraded data and fusion tests at full scale reveal that an accurate and reliable PAN-sharpening is achieved by the proposed method.

Multitemporal analysis of Synthetic Aperture Radar (SAR) images has gained an ever increasing attention due to the availability of several satellite platforms with different revisit times and to the intrinsic capability of the SAR system of producing all-weather observations. As a drawback, automated analysis in general and change detection in particular are made difficult by the inherent noisiness of SAR imagery. Even if a preprocessing step aimed at speckle reduction is adopted, most of algorithms borrowed from computer vision cannot be profitably used. In this work, a novel pixel feature suitable for change analysis is derived from information-theoretic concepts. It does not require preliminary despeckling and is capable of providing accurate change maps from a couple of SAR images. The rationale is that the negative of logarithm of the probability of an amplitude level in one image conditional to the level of the same pixel in the other image conveys an information on the amount of change occurred between the two passes. Experimental results carried out on two couples of multitemporal SAR images demonstrate that the proposed IT feature outperforms the Log-Ratio in terms of capability of discriminating either burnt or flooded areas and is less sensitive than Log-Ratio to changes in acquisition angle between the two SAR images.

This paper presents two novel image fusion methods, suitable for sharpening of hyperspectral (HS) images by means of a panchromatic (Pan) observation: the HS bands expanded to the finer scale of the Pan image are sharpened by adding the spatial details which are calculated by the PAN image. Since a direct, unconditioned injection of Pan details gives unsatisfactory results, a new injection model is proposed, which provides the optimum injection simulating fusion at degraded scale by minimizing the mean square error. Fusion tests are carried out both on spatially degraded data to objectively compare the proposed scheme to some fusion methods and on full resolution image data.

This paper presents a solution to the problem of enhancing the spatial resolution of multispectral images with high-resolution panchromatic observations. The proposed method exploits the undecimated discrete wavelet transform, which is an octave bandpass representation achieved from a conventional discrete wavelet transform by omitting all decimators and up-sampling the wavelet filter bank, and the vector multiscale Kalman filter, which is used to model the injection process of wavelet details. Kalman modelization is exploited by spatial detail analysis at coarser scales in which multispectral and panchromatic representations are known. Results are presented and discussed on very-high resolution images acquired by Quickbird satellite systems. Fusion simulations on spatially degraded data and fusion tests at the full scale reveal that an accurate and reliable PAN-sharpening is achieved by the proposed method.

Multiresolution analysis (MRA) and component substitution (CS) are the two basic frameworks to which image fusion algorithms can be reported when merging multi-spectral (MS) and panchromatic (Pan) images (Pan-sharpening). State-of-the-art algorithms add spatial details derived from the Pan image to the MS bands according to an injection model. The capability of the model to describe the relationship between the MS and Pan images is crucial for the quality of fusion results. Although context adaptive (CA) injection models have been proposed in the framework of MRA, their adoption in CS schemes has been scarcely investigated so far. In this work a CA injection model already tested for MRA algorithms is evaluated also for CS schemes. Qualitative and quantitative results reported for IKONOS high spatial resolution data show that CA injection models are more efficient than global ones.

Multi-temporal analysis of Synthetic Aperture Radar (SAR) images has gained an ever increasing attention due to the availability of several satellite platforms with different revisit times and to the intrinsic capability of the SAR system of producing all-weather observations. As a drawback, automated analysis in general and change detection in particular are made difficult by the inherent noisiness of SAR imagery. Even if a pre-processing step aimed at speckle reduction is adopted, most of algorithms borrowed from computer vision cannot be profitably used. In this work, a novel pixel feature suitable for change analysis is derived from information-theoretic concepts. It does not require preliminary de-speckling and capable of providing accurate change maps from a couple of SAR images. The rationale is that the negative of logarithm of the probability of an amplitude level in one image conditional to the level of the same pixel in the other image conveys an information on the amount of change occurred between the two passes. Experimental results carried out on two couples of multi-temporal SAR images demonstrate that the proposed IT feature outperform the Log-Ratio in terms of capability of discriminating changes.

In this work we investigate the use of Shannon's information theory for the goal of devising quality scores of image fusion results, that do not require reference originals. In particular, the mutual information between resampled original and fused MS bands is used to measure the spectral quality, while the mutual information between the Pan image and the fused bands yields a measure of spatial quality. The rationale is that the normalized mutual information calculated either between any couple of bands, or between each MS band and the Pan image, should be unchanged after fusion, i.e., when passing from the coarse scale of the MS data to the fine scale of the Pan image. Experimental results carried out on QuickBird and Ikonos data demonstrate that the results provided by the proposed information-theoretic method are in trend with analysis performed on spatially degraded data by means of such parameters as Walds's ERGAS, Wang and Bovik's QI, and the novel Q4 score index based on quaternions theory and recently proposed by the authors. However, the novel method requires no reference and is therefore directly applicable in all practical cases.

In this work we investigate the use of Shannon's information theory for the goal of devising quality scores of image fusion results that do not require reference originals. In particular, the mutual information between resampled original and fused MS bands is used to measure the spectral quality, while the mutual information between the Pan image and the fused bands yields a measure of spatial quality. The rationale is that the normalized mutual information calculated either between any couple of bands, or between each MS band and the Pan image, should be unchanged after fusion, i.e., when passing from the coarse scale of the MS data to the fine scale of the Pan image. Experimental results carried out on QuickBird and Ikonos data demonstrate that the results provided by the proposed information-theoretic method are in trend with analysis performed on spatially degraded data by means of such parameters as Walds's ERGAS, Wang and Bovik's QI, and the novel Q4 score index based on quaternions theory and recently proposed by the authors. However, the novel method requires no reference and is therefore directly applicable in all practical cases.

This paper presents a novel image fusion method, suitable for pan-sharpening of multispectral (MS) bands, based on multiresolution analysis (MRA). The low-resolution MS bands are sharpened by injecting highpass directional details extracted from the high-resolution panchromatic (Pan) image by means of the curvelet transform, which is a nonseparable MRA, whose basis function are directional edges with progressively increasing resolution. The advantage with respect to conventional separable MRA, either decimated or not, is twofold: directional detail coefficients matching image edges may be preliminarily softthresholded to achieve denoising better than in the separable wavelet domain; modeling of the relationships between highresolution detail coefficients of MS bands and of the Pan image is more fitting, being carried out in a directional wavelet domain. Experiments carried out on a very-high resolution MS + Pan QuickBird image show that the proposed curvelet method quantitatively outperforms state-of-the art image fusion methods, in terms of geometric, radiometric, and spectral fidelity.

This paper presents a novel multisensor image fusion algorithm, which extends pan-sharpening of multispectral (MS) data through intensity modulation to the integration of MS and SAR imagery. The method relies on SAR texture, extracted by ratioing a map of a SAR feature to its lowpass approximation. SAR texture is used to modulate the generalized intensity (GI) of the MS image, which is given by a linear transform extending Intensity-Hue-Saturation (IHS) transform to an arbitrary number of bands. Before modulation, the GI is enhanced by injection of highpass details extracted from the available Pan image by means of the "a-trous" wavelet decomposition. The texture-modulated pan-sharpened GI replaces the GI calculated from the resampled original MS data; then the inverse transform is applied to obtain the fusion product. Experimental results are presented on Landsat-7/ETM+ and ERS-2 images of an urban area. The results demonstrate accurate spectral preservation on vegetated regions, bare soil, and also on textured areas (buildings and road network) where SAR texture information enhances the fusion product, which can be usefully applied for both visual analysis and classification purposes.

This paper addresses the modeling of wavelet coefficients for multispectral (MS) band sharpening based on undecimated multiresolution analysis (MRA). The coarse MS bands are sharpened by injecting highpass details taken from a high-resolution panchromatic (Pan) image. Besides the MRA, crucial point is modeling the relationships between detail coefficients of a generic MS band and the Pan image at the same resolution. Once calculated at the coarser resolution, where both types of data are available, such a model shall be extrapolated to the finer resolution in order to weight the Pan details to be injected. The goal is that the merged MS images are most similar to what the MS sensor would collect if it had the same resolution as the broadband Pan imager. Three injection models embedded in an ''a trous'' wavelet decomposition will be described and compared on a test set of very high-resolution QuickBird MS+Pan data. Two models work on approximation and detail coefficients, respectively, and provide a certain degree of unmixing of coarse MS pixels. The third model is based on spectral fidelity of the merged image to the (resampled) original MS data, that is, no unmixing is attempted. It is much simpler than the other two because it does not require calculation of local statistics. Fusion comparisons on spatially degraded data, of which higher-resolution true MS data are available for reference, show that the former two models yield better results than the latter, in terms of both radiometric and spectral fidelity. The latter, however, yields a reliable sharpening unaffected by local artifacts, regardless of landscape complexity. When local statistics of wavelet coefficients are used, the model estimated on approximation yields slightly better but considerably stabler results than that calculated starting from bandpass details.

This paper critically reviews state-of-the-art and advanced methods for multispectral (MS) and panchromatic (Pan) image fusion based on either intensity-hue-saturation (IHS) transformation, or redundant multiresolution analysis (MRA). In either cases, lower-resolution MS bands are sharpened by injecting details taken from the higher-resolution Pan image. Crucial point is modeling the relationships between detail coefficients of a generic MS band and the Pan image at the same resolution. Once calculated at the coarser resolution, where both types of data are available, such a model shall be extended to the finer resolution to weight the Pan details to be injected. Two injection models embedded in an a trous wavelet decomposition will be compared on a test set of very high resolution QuickBird MS+Pan data. One works on approximations and provides a partial unmixing of coarse MS pixels via high-resolution Pan. Another is based on spectral fidelity of original and merged MS data. Fusion comparisons on spatially degraded data, whose high-resolution MS originals are available for reference, show that the former performs better than the latter, in terms of both spatial and spectral fidelity.

This paper addresses multispectral (MS) band sharpening based on undecimated multiresolution analysis (MRA). The coarse MS bands are sharpened by injecting highpass details taken from a high resolution panchromatic (Pan) image. Besides the MRA, crucial point is modeling the relationships between detail coefficients of a generic MS band and the Pan image at the same resolution. Once calculated at the coarser resolution, where both types of data are available, such a model shall be extrapolated to the finer resolution in order to weight the Pan details to be injected. The goal is that the merged MS images are most similar to what the MS sensor would collect if it had the same resolution as the broadband Pan imager. Three injection models embedded in an "`a trous" wavelet decomposition will be described and compared on a test set of very high resolution QuickBird MS + Pan data. Fusion comparisons on spatially degraded data, of which higher-resolution true MS data are available for reference, will be presented.

This paper critically reviews state-of-the-art and advanced methods for multispectral (MS) and panchromatic (Pan) image fusion based on either intensity-hue-saturation (IHS) transformation, or redundant multiresolution analysis (MRA). In either cases, lower-resolution MS bands are sharpened by injecting details taken from the higher-resolution Pan image. Crucial point is modeling the relationships between detail coefficients of a generic MS band and the Pan image at the same resolution. Once calculated at the coarser resolution, where both types of data are available, such a model shall be extended to the finer resolution to weight the Pan details to be injected. Two injection models embedded in an "à trous" wavelet decomposition will be compared on a test set of very high resolution QuickBird MS+Pan data. One works on approximations and provides a partial unmixing of coarse MS pixels via high-resolution Pan. Another is based on spectral fidelity of original and merged MS data. Fusion comparisons on spatially degraded data, whose high-resolution MS originals are available for reference, show that the former performs better than the latter, in terms of both spatial and spectral fidelity.

This paper addresses the modeling of wavelet coefficients for multispectral (MS) band sharpening based on undecimated multiresolution analysis (MRA). The coarse MS bands are sharpened by injecting highpass details taken from a high resolution panchromatic (Pan) image. Besides the MRA, crucial point is modeling the relationships between detail coefficients of a generic MS band and the Pan image at the same resolution. The goal is that the merged MS images are most similar to what the MS sensor would collect if it had the same resolution as the broadband Pan imager. Three injection models embedded in an "a trous" wavelet decomposition will be described and compared on a test set of very high resolution QuickBird MS+Pan data. Two models work on approximation and detail coefficients, respectively, and provide a certain degree of unmixing of coarse MS pixels. The third model is based on spectral fidelity of the merged image to the (resampled) original MS data, that is, no unmixing is attempted. Fusion comparisons on spatially degraded data, of which higher-resolution true MS data are available for reference, show that the former two models yield better results than the latter, in terms of both radiometric and spectral fidelity. The latter, however, yields a reliable sharpening unaffected by local artifacts, regardless of landscape complexity. When local statistics of wavelet coefficients are utilized, the model estimated on approximation yields slightly better but considerably stabler results than that calculated starting from bandpass details.