Search

The utility of sheer volumes of very high spatial resolution (VHSR) commercial imagery in mapping the Arctic region is new and actively evolving. Commercial satellite sensors typically record image data in low-resolution multispectral (MS) and high-resolution panchromatic (PAN) mode. Spatial resolution is needed to accurately describe feature shapes and textural patterns, such as ice-wedge polygons (IWPs) that are rapidly transforming surface features due to degrading permafrost, while spectral resolution allows capturing of land-use and land-cover types. Data fusion, the process of combining PAN and MS images with complementary characteristics often serves as an integral component of remote sensing mapping workflows. The fusion process generates spectral and spatial artifacts that may affect the classification accuracies of subsequent automated image analysis algorithms, such as deep learning (DL) convolutional neural nets (CNN). We employed a detailed multidimensional assessment to understand the performances of an array of eight application-oriented data fusion algorithms when applied to VHSR image scenes for DLCNN-based mapping of ice-wedge polygons. Our findings revealed the scene dependency of data fusion algorithms and emphasized the need for careful selection of the proper algorithm. Results suggested that the fusion algorithms that preserve spatial character of original PAN imagery favor the DLCNN model performances. The choice of fusion approach needs to be considered of equal importance to the required training dataset for successful applications using DLCNN on VHRS imagery in order to enable an accurate mapping effort of permafrost thaw across the Arctic region.

Remote sensing is a rapidly developing tool for mapping the abundance and distribution of Antarctic wildlife. While both panchromatic and multispectral imagery have been used in this context, image fusion techniques have received little attention. We tasked seven widely-used fusion algorithms: Ehlers fusion, hyperspherical color space fusion, high-pass fusion, principal component analysis (PCA) fusion, University of New Brunswick fusion, and wavelet-PCA fusion to resolution enhance a series of single-date QuickBird-2 and Worldview-2 image scenes comprising penguin guano, seals, and vegetation. Fused images were assessed for spectral and spatial fidelity using a variety of quantitative quality indicators and visual inspection methods. Our visual evaluation elected the high-pass fusion algorithm and the University of New Brunswick fusion algorithm as best for manual wildlife detection while the quantitative assessment suggested the Gram-Schmidt fusion algorithm and the University of New Brunswick fusion algorithm as best for automated classification. The hyperspherical color space fusion algorithm exhibited mediocre results in terms of spectral and spatial fidelities. The PCA fusion algorithm showed spatial superiority at the expense of spectral inconsistencies. The Ehlers fusion algorithm and the wavelet-PCA algorithm showed the weakest performances. As remote sensing becomes a more routine method of surveying Antarctic wildlife, these benchmarks will provide guidance for image fusion and pave the way for more standardized products for specific types of wildlife surveys.

This paper is an exploratory study, which aimed to discover the synergies of data fusion and image segmentation in the context of EO-based rapid mapping workflows. Our approach pillared on the geographic object-based image analysis (GEOBIA) focusing on multiscale, internally-displaced persons’ (IDP) camp information extraction from very high spatial resolution (VHSR) images. We applied twelve pansharpening algorithms to two subsets of a GeoEye-1 image scene that was taken over a former war-induced ephemeral settlement in Sri Lanka. A multidimensional assessment was employed to benchmark pansharpening algorithms with respect to their spectral and spatial fidelity. The multiresolution segmentation (MRS) algorithm of the eCognition Developer software served as the key algorithm in the segmentation process. The first study site was used for comparing segmentation results produced from the twelve fused products at a series of scale, shape, and compactness settings of the MRS algorithm. The segmentation quality and optimum parameter settings of the MRS algorithm were estimated by using empirical discrepancy measures. Non-parametric statistical tests were used to compare the quality of image object candidates, which were derived from the twelve pansharpened products. A wall-to-wall classification was performed based on a support vector machine (SVM) classifier to classify image objects candidates of the fused images. The second site simulated a more realistic crisis information extraction scenario where the domain expertise is crucial in segmentation and classification. We compared segmentation and classification results of the original images (non-fused) and twelve fused images to understand the efficacy of data fusion. We have shown that the GEOBIA has the ability to create meaningful image objects during the segmentation process by compensating the fused image’s spectral distortions with the high-frequency information content that has been injected during fusion. Our findings further questioned the necessity of the data fusion step in rapid mapping context. Bypassing time-intensive data fusion helps to actuate EO-based rapid mapping workflows. We, however, emphasize the fact that data fusion is not limited to VHSR image data but expands over many different combinations of multi-date, multi-sensor EO-data. Thus, further research is needed to understand the synergies of data fusion and image segmentation with respect to multi-date, multi-sensor fusion scenarios and extrapolate our findings to other remote sensing application domains beyond EO-based crisis information retrieval.

Multiresolution segmentation (MRS) has proven to be one of the most successful image segmentation algorithms in the geographic object-based image analysis (GEOBIA) framework. This algorithm is relatively complex and user-dependent; scale, shape, and compactness are the main parameters available to users for controlling the algorithm. Plurality of segmentation results is common because each parameter may take a range of values within its parameter space or different combinations of values among parameters. Finding optimal parameter values through a trial-and-error process is commonly practiced at the expense of time and labor, thus, several alternative supervised and unsupervised methods for supervised automatic parameter setting have been proposed and tested. In the case of supervised empirical assessments, discrepancy measures are employed for computing measures of dissimilarity between a reference polygon and an image object candidate. Evidently the reliability of the optimal-parameter prediction heavily relies on the sensitivity of the segmentation quality metric. The idea behind pursuing optimal parameter setting is that, for instance, a given scale setting provides image object candidates different from the other scale setting; thus, by design the supervised quality metric should capture this difference. In this exploratory study, we selected the Euclidean distance 2 (ED2) metric, a recently proposed supervised metric, whose main design goal is to optimize the geometrical discrepancy (potential segmentation error (PSE)) and arithmetic discrepancy between image objects and reference polygons (number-of segmentation ratio (NSR)) in two dimensional Euclidean space, as a candidate to investigate the validity and efficacy of empirical discrepancy measures for finding the optimal scale parameter setting of the MRS algorithm. We chose test image scenes from four different space-borne sensors with varying spatial resolutions and scene contents and systematically segmented them using the MRS algorithm at a series of parameter settings. The discriminative capacity of the ED2 metric across different scales groups was tested using non-parametric statistical methods. Our results showed that the ED2 metric significantly discriminates the quality of image object candidates at smaller scale values but it loses the sensitivity at larger scale values. This questions the meaningfulness of the ED2 metric in the MRS algorithm’s parameter optimization. Our contention is that the ED2 metric provides some notion of the optimal scale parameter at the expense of time. In this respect, especially in operational-level image processing, it is worth to re-think the trade-off between execution time of the processor-intensive MRS algorithm at series of parameter settings targeting a less-sensitive quality metric and an expert-lead trial-and-error approach.