Search

Land-cover segmentation, a fundamental task within the domain of remote sensing, boasts a broad spectrum of application potential. We address the challenges in land-cover segmentation of remote-sensing imagery and complete the following work. Firstly, to tackle the issues of foreground–background imbalance and scale variation, a module based on multi-dilated rate convolution fusion was integrated into a decoder. This module extended the receptive field through multi-dilated convolution, enhancing the model's capability to capture global features. Secondly, to address the diversity of scenes and background interference, a hybrid attention module based on large-kernel convolution was employed to improve the performance of the decoder. This module, based on a combination of spatial and channel attention mechanisms, enhanced the extraction of contextual information through large-kernel convolution. A convolution kernel selection mechanism was also introduced to dynamically select the convolution kernel of the appropriate receptive field, suppress irrelevant background information, and improve segmentation accuracy. Ablation studies on the Vaihingen and Potsdam datasets demonstrate that our decoder significantly outperforms the baseline in terms of mean intersection over union and mean F1 score, achieving an increase of up to 1.73% and 1.17%, respectively, compared with the baseline. In quantitative comparisons, the accuracy of our improved decoder also surpasses other algorithms in the majority of categories. The results of this paper indicate that our improved decoder achieves significant performance improvement compared with the old decoder in remote-sensing image-segmentation tasks, which verifies its application potential in the field of land-cover segmentation. [ABSTRACT FROM AUTHOR]

Mineral mapping from satellite images provides valuable insights into subsurface mineral alteration for geothermal exploration. In previous studies, eight fundamental algorithms were used for mineral mapping utilizing USGS spectra, a collection of reflectance spectra containing samples of minerals, rocks, and soils created by the USGS. We used an ASD FieldSpec 4 Hi-RES NG portable spectrometer to collect spectra for analyzing ASTER images of the Coso Geothermal Field. Then, we established the ground-truth information and the spectral library by analyzing 97 samples. Samples collected from the field were analyzed using the CSIRO TSG (The Spectral Geologist of the Commonwealth Scientific and Industrial Research Organization). Based on the mineralogy study, multiple high-purity spectra of geothermal alteration minerals were selected from collected data, including alunite, chalcedony, hematite, kaolinite, and opal. Eight mineral spectral target detection algorithms were applied to the preprocessed satellite data with a proposed local spectral library. We measured the highest overall accuracy of 87% for alunite, 95% for opal, 83% for chalcedony, 60% for hematite, and 96% for kaolinite out of these eight algorithms. Three, four, five, and eight algorithms were fused to extract mineral alteration with the obtained target detection results. The results prove that the fusion of algorithms gives better results than using individual ones. In conclusion, this paper discusses the significance of evaluating different mapping algorithms. It proposes a robust fusion approach to extract mineral maps as an indicator for geothermal exploration. [ABSTRACT FROM AUTHOR]

The Landsat and Sentinel series satellites contain their own quality tagging data products, marking the source image pixel by pixel with several specific semantic categories. These data products generally contain categories such as cloud, cloud shadow, land, water body, and snow. Due to the lack of mid-wave and thermal infrared bands, the accuracy of traditional cloud detection algorithm is unstable when facing Chinese Gaofen-1/6 (GF-1/6) data. Moreover, it is challenging to distinguish clouds from snow. In order to produce GF-1/6 satellite pixel-by-pixel quality tagging data products, this paper builds a training sample set of more than 100,000 image pairs, primarily using Sentinel-2 satellite data. Then, we adopt the Swin Transformer model with a self-attention mechanism for GF-1/6 satellite image quality tagging. Experiments show that the model's overall accuracy reaches the level of Fmask v4.6 with more than 10,000 training samples, and the model can distinguish between cloud and snow correctly. Our GF-1/6 quality tagging algorithm can meet the requirements of the "Analysis Ready Data (ARD) Technology Research for Domestic Satellite" project. [ABSTRACT FROM AUTHOR]

With satellite quantity and quality development in recent years, remote sensing products in vast areas are becoming widely used in more and more fields. The acquisition of large regional images requires the scientific and efficient utilization of satellite resources through imaging satellite task planning technology. However, for imaging satellite task planning in a vast area, a large number of decision variables are introduced into the imaging satellite task planning model, making it difficult for existing optimization algorithms to obtain reliable solutions. This is because the search space of the solution increases the exponential growth with the increase in the number of decision variables, which causes the search performance of optimization algorithms to decrease significantly. This paper proposes a large-scale multi-objective optimization algorithm based on efficient competition learning and improved non-dominated sorting (ECL-INS-LMOA) to efficiently obtain satellite imaging schemes for large areas. ECL-INS-LMOA adopted the idea of two-stage evolution to meet the different needs in different evolutionary stages. In the early stage, the proposed efficient competitive learning particle update strategy (ECLUS) and the improved NSGA-II were run alternately. In the later stage, only the improved NSGA-II was run. The proposed ECLUS guarantees the rapid convergence of ECL-INS-LMOA in the early evolution by accelerating particle update, introducing flight time, and proposing a binary competitive swarm optimizer BCSO. The results of the simulation imaging experiments on five large areas with different scales of decision variables show that ECL-INS-LMOA can always obtain the imaging satellite mission planning scheme with the highest regional coverage and the lowest satellite resource consumption within the limited evaluation times. The experiments verify the excellent performance of ECL-INS-LMOA in solving vast area mapping planning problems. [ABSTRACT FROM AUTHOR]

The fusion of a hyperspectral image (HSI) and multispectral image (MSI) can significantly improve the ability of ground target recognition and identification. The quality of spatial information and the fidelity of spectral information are normally contradictory. However, these two properties are non-negligible indicators for multi-source remote-sensing images fusion. The smoothing filter-based intensity modulation (SFIM) method is a simple yet effective model for image fusion, which can improve the spatial texture details of the image well, and maintain the spectral characteristics of the image significantly. However, traditional SFIM has a poor effect for edge information sharpening, leading to a bad overall fusion result. In order to obtain better spatial information, a spatial filter-based improved LSE-SFIM algorithm is proposed in this paper. Firstly, the least square estimation (LSE) algorithm is combined with SFIM, which can effectively improve the spatial information quality of the fused image. At the same time, in order to better maintain the spatial information, four spatial filters (mean, median, nearest and bilinear) are used for the simulated MSI image to extract fine spatial information. Six quality indexes are used to compare the performance of different algorithms, and the experimental results demonstrate that the LSE-SFIM based on bilinear (LES-SFIM-B) performs significantly better than the traditional SFIM algorithm and other spatially enhanced LSE-SFIM algorithms proposed in this paper. Furthermore, LSE-SFIM-B could also obtain similar performance compared with three state-of-the-art HSI-MSI fusion algorithms (CNMF, HySure, and FUSE), while the computing time is much shorter. [ABSTRACT FROM AUTHOR]

The detection of change in remote-sensing images is broadly applicable to many fields. In recent years, both supervised and unsupervised methods have demonstrated excellent capacity to detect changes in high-resolution images. However, most of these methods are sensitive to noise, and their performance significantly deteriorates when dealing with remote-sensing images that have been contaminated by mixed random noises. Moreover, supervised methods require that samples are manually labeled for training, which is time-consuming and labor-intensive. This study proposes a new unsupervised change-detection (CD) framework that is resilient to mixed random noise called self-supervised denoising network-based unsupervised change-detection coupling FCM_SICM and EMD (SSDNet-FSE). It consists of two components, namely a denoising module and a CD module. The proposed method first utilizes a self-supervised denoising network with real 3D weight attention mechanisms to reconstruct noisy images. Then, a noise-resistant fuzzy C-means clustering algorithm (FCM_SICM) is used to decompose the mixed pixels of reconstructed images into multiple signal classes by exploiting local spatial information, spectral information, and membership linkage. Next, the noise-resistant Earth mover's distance (EMD) is used to calculate the distance between signal-class centers and the corresponding fuzzy memberships of bitemporal pixels and generate a map of the magnitude of change. Finally, automatic thresholding is undertaken to binarize the change-magnitude map into the final CD map. The results of experiments conducted on five public datasets prove the superior noise-resistant performance of the proposed method over six state-of-the-art CD competitors and confirm its effectiveness and potential for practical application. [ABSTRACT FROM AUTHOR]

Remote sensing (RS) scene classification is important for RS imagery semantic interpretation. Although tremendous strides have been made in RS scene classification, one of the remaining open challenges is recognizing RS scenes in low quality variance (e.g., various scales and noises). This paper proposes a deep salient feature based anti-noise transfer network (DSFATN) method that effectively enhances and explores the high-level features for RS scene classification in different scales and noise conditions. In DSFATN, a novel discriminative deep salient feature (DSF) is introduced by saliency-guided DSF extraction, which conducts a patch-based visual saliency (PBVS) algorithm using "visual attention" mechanisms to guide pre-trained CNNs for producing the discriminative high-level features. Then, an anti-noise network is proposed to learn and enhance the robust and anti-noise structure information of RS scene by directly propagating the label information to fully-connected layers. A joint loss is used to minimize the anti-noise network by integrating anti-noise constraint and a softmax classification loss. The proposed network architecture can be easily trained with a limited amount of training data. The experiments conducted on three different scale RS scene datasets show that the DSFATN method has achieved excellent performance and great robustness in different scales and noise conditions. It obtains classification accuracy of 98.25%, 98.46%, and 98.80%, respectively, on the UC Merced Land Use Dataset (UCM), the Google image dataset of SIRI-WHU, and the SAT-6 dataset, advancing the state-of-the-art substantially. [ABSTRACT FROM AUTHOR]

The conventional fuzzy c-spherical shells (FCSS) clustering model is extended to cluster shells involving non-crisp numbers, in this paper. This is achieved by a vectorized representation of distance, between two non-crisp numbers like the crisp numbers case. Using the proposed clustering method, named vector fuzzy c-spherical shells (VFCSS), all crisp and non-crisp numbers can be clustered by the FCSS algorithm in a unique structure. Therefore, we can implement FCSS clustering over various types of numbers in a unique structure with only a few alterations in the details used in implementing each case. The relations of VFCSS applied to crisp and non-crisp (containing symbolic-interval, LR-type, TFN-type and TAN-type fuzzy) numbers are presented in this paper. Finally, simulation results are reported for VFCSS applied to synthetic LR-type fuzzy numbers; where the application of the proposed method in real life and in geomorphology science is illustrated by extracting the radii of circular agricultural fields using remotely sensed images and the results show better performance and lower cost computational complexity of the proposed method in comparison to conventional FCSS. [ABSTRACT FROM AUTHOR]

Scene classification of high-resolution remote sensing (HRRS) imagery is an important task in the intelligent processing of remote sensing images and has attracted much attention in recent years. Although the existing scene classification methods, e.g., the bag-of-words (BOW) model and its variants, can achieve acceptable performance, these approaches strongly rely on the extraction of local features and the complicated coding strategy, which are usually time consuming and demand much expert effort. In this paper, we propose a fast binary coding (FBC) method, to effectively generate efficient discriminative scene representations of HRRS images. The main idea is inspired by the unsupervised feature learning technique and the binary feature descriptions. More precisely, equipped with the unsupervised feature learning technique, we first learn a set of optimal "filters" from large quantities of randomly-sampled image patches and then obtain feature maps by convolving the image scene with the learned filters. After binarizing the feature maps, we perform a simple hashing step to convert the binary-valued feature map to the integer-valued feature map. Finally, statistical histograms computed on the integer-valued feature map are used as global feature representations of the scenes of HRRS images, similar to the conventional BOW model. The analysis of the algorithm complexity and experiments on HRRS image datasets demonstrate that, in contrast with existing scene classification approaches, the proposed FBC has much faster computational speed and achieves comparable classification performance. In addition, we also propose two extensions to FBC, i.e., the spatial co-occurrence matrix and different visual saliency maps, for further improving its final classification accuracy. [ABSTRACT FROM AUTHOR]

Urban functional area (UFA) recognition is one of the most important strategies for achieving sustainable city development. As remote-sensing and social-sensing data sources have increasingly become available, UFA recognition has received a significant amount of attention. Research on UFA recognition that uses a single dataset suffers from a low update frequency or low spatial resolution, while data fusion-based methods are limited in efficiency and accuracy. This paper proposes an integrated model to identify UFA using satellite images and taxi global positioning system (GPS) trajectories in four steps. First, blocks were generated as spatial units in the study area, and the spatiotemporal information entropy of the taxi GPS trajectory (STET) for each block was calculated. Second, a 24-hour time-frequency series was formed based on the pick-up and drop-off points extracted from taxi trajectories and used as the interpretation indicator of the blocks. The K-Means++ and k-Nearest Neighbor (kNN) algorithm were used to identify their social functions. Third, a multilabel classification method based on the residual neural network (MLC-ResNets) and "You Only Look Once" (YOLO) target detection algorithms were used to identify the features of the typical and atypical spatial textures, respectively, of the satellite images in the blocks. The confidence scores of the features of the blocks were categorized by the decision tree algorithm. Fourth, to find the best way to integrate the two sub-models for UFA identification, the 10-fold cross-validation method based on stratified random sampling was applied to determine the most optimal STET thresholds. The results showed that the average accuracy reached 82.0%, with an average kappa of 73.5%—significant improvements over most existing studies. This paper provides new insights into how the advantages of satellite images and taxi trajectories in UFA identification can be fully exploited to support sustainable city management. [ABSTRACT FROM AUTHOR]

This paper develops and validates a new fully automated procedure for shoreline delineation from high-resolution multispectral satellite images. The model is based on a new water–land index, the Direct Difference Water Index (DDWI). A new technique based on the buffer overlay method is also presented to determine the shoreline changes from different satellite images and obtain a time series for the shoreline changes. The shoreline detection model was applied to imagery from multiple satellites and validated to have sub-pixel accuracy using beach survey data that were collected from the Lake Michigan (USA) shoreline using a novel backpack-based LiDAR system. The model was also applied to 132 satellite images of a Lake Michigan beach over a three-year period and detected the shoreline accurately, with a >99% success rate. The model out-performed other existing shoreline detection algorithms based on different water indices and clustering techniques. The resolution shoreline position timeseries is the first satellite image-extracted dataset of its kind in terms of its high spatial and temporal resolution, and paves the road to obtaining other high-temporal-resolution datasets to refine models of beaches worldwide. [ABSTRACT FROM AUTHOR]

Autofocus has attracted wide attention for unmanned aerial vehicle (UAV) synthetic aperture radar (SAR) systems, because autofocus process is crucial and difficult when the phase error is spatially dependent on both range and azimuth directions. In this paper, a novel two-dimensional spatial-variant map-drift algorithm (2D-SVMDA) is developed to provide robust autofocusing performance for UAV SAR imagery. This proposed algorithm combines two enhanced map-drift kernels. On the one hand, based on the azimuth-dependent phase correction, a novel Algorithm-variant map-drift algorithm (AVMDA) is established to model the residual phase error as a linear function in the azimuth direction. Then the model coefficients are efficiently estimated by a quadratic Newton optimization with modified maximum cross-correlation. On the other hand, by concatenating the existing range-dependent map-drift algorithm (RDMDA) and the proposed AVMDA in this paper, a phase autofocus procedure of 2D-SVMDA is finally established. The proposed 2D-SVMDA can handle spatial-variance problems induced by strong phase errors. Simulated and real measured data are employed to demonstrate that the proposed algorithm compensates both the range- and azimuth-variant phase errors effectively. [ABSTRACT FROM AUTHOR]

Image segmentation plays a significant role in remote sensing image processing. Among numerous segmentation algorithms, the region-merging segmentation algorithm is widely used due to its well-organized structure and outstanding results. Many merging criteria (MC) were designed to improve the accuracy of region-merging segmentation, but each MC has its own shortcomings, which can cause segmentation errors. Segmentation accuracy can be improved by referring to the segmentation results. To achieve this, an approach for detecting and correcting region-merging image segmentation errors is proposed, and then an iterative optimization model is established. The main contributions of this paper are as follows: (1) The conflict types of matching segment pairs are divided into scale-expression conflict (SEC) and region-ownership conflict (ROC), and ROC is more suitable for optimization. (2) An equal-scale local evaluation method was designed to quantify the optimization potential of ROC. (3) A regional anchoring strategy is proposed to preserve the results of the previous iteration optimization. Three QuickBird satellite images of different land-cover types were used for validating the proposed approach. Both unsupervised and supervised evaluation results prove that the proposed approach can effectively improve segmentation accuracy. All explicit and implicit optimization modes are concluded, which further illustrate the stability of the proposed approach. [ABSTRACT FROM AUTHOR]

In this paper, we propose a new approach for sub-pixel co-registration based on Fourier phase correlation combined with the Harris detector. Due to the limitation of the standard phase correlation method to achieve only pixel-level accuracy, another approach is required to reach sub-pixel matching precision. We first applied the Harris corner detector to extract corners from both references and sensed images. Then, we identified their corresponding points using phase correlation between the image pairs. To achieve sub-pixel registration accuracy, two optimization algorithms were used. The effectiveness of the proposed method was tested with very high-resolution (VHR) remote sensing images, including Pleiades satellite images and aerial imagery. Compared with the speeded-up robust features (SURF)-based method, phase correlation with the Blackman window function produced 91% more matches with high reliability. Moreover, the results of the optimization analysis have revealed that Nelder–Mead algorithm performs better than the two-point step size gradient algorithm regarding localization accuracy and computation time. The proposed approach achieves better accuracy than 0.5 pixels and outperforms the speeded-up robust features (SURF)-based method. It can achieve sub-pixel accuracy in the presence of noise and produces large numbers of correct matching points. [ABSTRACT FROM AUTHOR]

Objects in satellite remote sensing image sequences often have large deformations, and the stereo matching of this kind of image is so difficult that the matching rate generally drops. A disparity refinement method is needed to correct and fill the disparity. A method for disparity refinement based on the results of plane segmentation is proposed in this paper. The plane segmentation algorithm includes two steps: Initial segmentation based on mean-shift and alpha-expansion-based energy minimization. According to the results of plane segmentation and fitting, the disparity is refined by filling missed matching regions and removing outliers. The experimental results showed that the proposed plane segmentation method could not only accurately fit the plane in the presence of noise but also approximate the surface by plane combination. After the proposed plane segmentation method was applied to the disparity refinement of remote sensing images, many missed matches were filled, and the elevation errors were reduced. This proved that the proposed algorithm was effective. For difficult evaluations resulting from significant variations in remote sensing images of different satellites, the edge matching rate and the edge matching map are proposed as new stereo matching evaluation and analysis tools. Experiment results showed that they were easy to use, intuitive, and effective. [ABSTRACT FROM AUTHOR]

The use of the spatiotemporal data fusion method as an effective data interpolation method has received extensive attention in remote sensing (RS) academia. The enhanced spatial and temporal adaptive reflectance fusion model (ESTARFM) is one of the most famous spatiotemporal data fusion methods, as it is widely used to generate synthetic data. However, the ESTARFM algorithm uses moving windows with a fixed size to get the information around the central pixel, which hampers the efficiency and precision of spatiotemporal data fusion. In this paper, a modified ESTARFM data fusion algorithm that integrated the surface spatial information via a statistical method was developed. In the modified algorithm, the local variance of pixels around the central one was used as an index to adaptively determine the window size. Satellite images from two regions were acquired by employing the ESTARFM and modified algorithm. Results showed that the images predicted using the modified algorithm obtained more details than ESTARFM, as the frequency of pixels with the absolute difference of mean value of six bands' reflectance between true observed image and predicted between 0 and 0.04 were 78% by ESTARFM and 85% by modified algorithm, respectively. In addition, the efficiency of the modified algorithm improved and the verification test showed the robustness of the modified algorithm. These promising results demonstrated the superiority of the modified algorithm to provide synthetic images compared with ESTARFM. Our research enriches the spatiotemporal data fusion method, and the automatic selection of moving window strategy lays the foundation of automatic processing of spatiotemporal data fusion on a large scale. [ABSTRACT FROM AUTHOR]

Accurate cloud detection using medium-resolution multispectral satellite imagery (such as Landsat and Sentinel data) is always difficult due to the complex land surfaces, diverse cloud types, and limited number of available spectral bands, especially in the case of images without thermal bands. In this paper, a novel classification extension-based cloud detection (CECD) method was proposed for masking clouds in the medium-resolution images. The new method does not rely on thermal bands and can be used for masking clouds in different types of medium-resolution satellite imagery. First, with the support of low-resolution satellite imagery with short revisit periods, cloud and non-cloud pixels were identified in the resampled low-resolution version of the medium-resolution cloudy image. Then, based on the identified cloud and non-cloud pixels and the resampled cloudy image, training samples were automatically collected to develop a random forest (RF) classifier. Finally, the developed RF classifier was extended to the corresponding medium-resolution cloudy image to generate an accurate cloud mask. The CECD method was applied to Landsat-8 and Sentinel-2 imagery to test the performance for different satellite images, and the well-known function of mask (FMASK) method was employed for comparison with our method. The results indicate that CECD is more accurate at detecting clouds in Landsat-8 and Sentinel-2 imagery, giving an average F-measure value of 97.65% and 97.11% for Landsat-8 and Sentinel-2 imagery, respectively, as against corresponding results of 90.80% and 88.47% for FMASK. It is concluded, therefore, that the proposed CECD algorithm is an effective cloud-classification algorithm that can be applied to the medium-resolution optical satellite imagery. [ABSTRACT FROM AUTHOR]

Thunderstorms in southeastern South America (SESA) stand out in satellite observations as being among the strongest on Earth in terms of satellite-based convective proxies, such as lightning flash rate per storm, the prevalence for extremely tall, wide convective cores and broad stratiform regions. Accurately quantifying when and where strong convection is initiated presents great interest in operational forecasting and convective system process studies due to the relationship between convective storms and severe weather phenomena. This paper generates a novel methodology to determine convective initiation (CI) signatures associated with extreme convective systems, including extreme events. Based on the well-established area-overlapping technique, an adaptive brightness temperature threshold for identification and backward tracking with infrared data is introduced in order to better identify areas of deep convection associated with and embedded within larger cloud clusters. This is particularly important over SESA because ground-based weather radar observations are currently limited to particular areas. Extreme rain precipitation features (ERPFs) from Tropical Rainfall Measurement Mission are examined to quantify the full satellite-observed life cycle of extreme convective events, although this technique allows examination of other intense convection proxies such as the identification of overshooting tops. CI annual and diurnal cycles are analyzed and distinctive behaviors are observed for different regions over SESA. It is found that near principal mountain barriers, a bimodal diurnal CI distribution is observed denoting the existence of multiple CI triggers, while convective initiation over flat terrain has a maximum frequency in the afternoon. [ABSTRACT FROM AUTHOR]

Meteorological satellites are usually operated at high temporal resolutions, but the spatial resolutions are too poor to identify ground content. Super-resolution is an economic way to enhance spatial details, but the feasibility is not validated for meteorological images due to the absence of benchmarking data. In this work, we propose the FY4ASRgray and FY4ASRcolor datasets to assess super-resolution algorithms on meteorological applications. The features of cloud sensitivity and temporal continuity are linked to the proposed datasets. To test the usability of the new datasets, five state-of-the-art super-resolution algorithms are gathered for contest. Shift learning is used to shorten the training time and improve the parameters. Methods are modified to deal with the 16-bit challenge. The reconstruction results are demonstrated and evaluated regarding the radiometric, structural, and spectral loss, which gives the baseline performance for detail enhancement of the FY4A satellite images. Additional experiments are made on FY4ASRcolor for sequence super-resolution, spatiotemporal fusion, and generalization test for further performance test. [ABSTRACT FROM AUTHOR]

An efficient satellite image segmentation method based on a hybrid grasshopper optimization algorithm (GOA) and minimum cross entropy (MCE) is proposed in this paper. The proposal is known as GOA–jDE, and it merges GOA with self-adaptive differential evolution (jDE) to improve the search efficiency, preserving the population diversity especially in the later iterations. A series of experiments is conducted on various satellite images for evaluating the performance of the algorithm. Both low and high levels of the segmentation are taken into account, increasing the dimensionality of the problem. The proposed approach is compared with the standard color image thresholding methods, as well as the advanced satellite image thresholding techniques based on different criteria. Friedman test and Wilcoxon's rank sum test are performed to assess the significant difference between the algorithms. The superiority of the proposed method is illustrated from different aspects, such as average fitness function value, peak signal to noise ratio (PSNR), structural similarity index (SSIM), feature similarity index (FSIM), standard deviation (STD), convergence performance, and computation time. Furthermore, natural images from the Berkeley segmentation dataset are also used to validate the strong robustness of the proposed method. [ABSTRACT FROM AUTHOR]

This paper presents an automatic procedure for the geometric corrections of very-high resolution (VHR) optical panchromatic satellite images. The procedure is composed of three steps: an automatic ground control point (GCP) extraction algorithm that matches the linear features that were extracted from the satellite image and reference data; a geometric model that applies a rational function model; and, the orthorectification procedure. Accurate geometric corrections can only be achieved if GCPs are employed to precisely correct the geometric biases of images. Due to the high resolution and the varied acquisition geometry of images, we propose a fast, segmentation based method for feature extraction. The research focuses on densely populated urban areas, which are very challenging in terms of feature extraction and matching. The proposed algorithm is capable of achieving results with a root mean square error of approximately one pixel or better, on a test set of 14 panchromatic Pléiades images. The procedure is robust and it performs well in urban areas, even for images with high off-nadir angles. [ABSTRACT FROM AUTHOR]

Automatic building extraction using a single data type, either 2D remotely-sensed images or light detection and ranging 3D point clouds, remains insufficient to accurately delineate building outlines for automatic mapping, despite active research in this area and the significant progress which has been achieved in the past decade. This paper presents an effective approach to extracting buildings from Unmanned Aerial Vehicle (UAV) images through the incorporation of superpixel segmentation and semantic recognition. A framework for building extraction is constructed by jointly using an improved Simple Linear Iterative Clustering (SLIC) algorithm and Multiscale Siamese Convolutional Networks (MSCNs). The SLIC algorithm, improved by additionally imposing a digital surface model for superpixel segmentation, namely 6D-SLIC, is suited for building boundary detection under building and image backgrounds with similar radiometric signatures. The proposed MSCNs, including a feature learning network and a binary decision network, are used to automatically learn a multiscale hierarchical feature representation and detect building objects under various complex backgrounds. In addition, a gamma-transform green leaf index is proposed to truncate vegetation superpixels for further processing to improve the robustness and efficiency of building detection, the Douglas–Peucker algorithm and iterative optimization are used to eliminate jagged details generated from small structures as a result of superpixel segmentation. In the experiments, the UAV datasets, including many buildings in urban and rural areas with irregular shapes and different heights and that are obscured by trees, are collected to evaluate the proposed method. The experimental results based on the qualitative and quantitative measures confirm the effectiveness and high accuracy of the proposed framework relative to the digitized results. The proposed framework performs better than state-of-the-art building extraction methods, given its higher values of recall, precision, and intersection over Union (IoU). [ABSTRACT FROM AUTHOR]

Road network extraction from remote sensing images has played an important role in various areas. However, due to complex imaging conditions and terrain factors, such as occlusion and shades, it is very challenging to extract road networks with complete topology structures. In this paper, we propose a learning-based road network extraction framework via a Multi-supervised Generative Adversarial Network (MsGAN), which is jointly trained by the spectral and topology features of the road network. Such a design makes the network capable of learning how to "guess" the aberrant road cases, which is caused by occlusion and shadow, based on the relationship between the road region and centerline; thus, it is able to provide a road network with integrated topology. Additionally, we also present a sample quality measurement to efficiently generate a large number of training samples with a little human interaction. Through the experiments on images from various satellites and the comprehensive comparisons to state-of-the-art approaches on the public datasets, it is demonstrated that the proposed method is able to provide high-quality results, especially for the completeness of the road network. [ABSTRACT FROM AUTHOR]

Technical resources are currently supporting and enhancing the ability of precision agriculture techniques in crop management. The accuracy of prescription maps is a key aspect to ensure a fast and targeted intervention. In this context, remote sensing acquisition by unmanned aerial vehicles (UAV) is one of the most advanced platforms to collect imagery of the field. Besides the imagery acquisition, canopy segmentation among soil, plants and shadows is another practical and technical aspect that must be fast and precise to ensure a targeted intervention. In this paper, algorithms to be applied to UAV imagery are proposed according to the sensor used that could either be visible spectral or multispectral. These algorithms, called HSV-based (Hue, Saturation, Value), DEM (Digital Elevation Model) and K-means, are unsupervised, i.e., they perform canopy segmentation without human support. They were tested and compared in three different scenarios obtained from two vineyards over two years, 2017 and 2018 for RGB (Red-Green-Blue) and NRG (Near Infrared-Red-Green) imagery. Particular attention is given to the unsupervised ability of these algorithms to identify vines in these different acquisition conditions. This ability is quantified by the introduction of over- and under- estimation indexes, which are the algorithm's ability to over-estimate or under-estimate vine canopies. For RGB imagery, the HSV-based algorithms consistently over-estimate vines, and never under-estimate them. The k-means and DEM method have a similar trend of under-estimation. While for NRG imagery, the HSV is the more stable algorithm and the DEM model slightly over-estimates the vines. HSV-based algorithms and the DEM algorithm have comparable computation time. The k-means algorithm increases computational demand as the quality of the DEM decreases. The algorithms developed can isolate canopy vegetation data, which is useful information about the current vineyard state, and can be used as a tool to be efficiently applied in the crop management procedure within precision viticulture applications. [ABSTRACT FROM AUTHOR]

Hyperspectral pansharpening is an effective technique to obtain a high spatial resolution hyperspectral (HS) image. In this paper, a new hyperspectral pansharpening algorithm based on homomorphic filtering and weighted tensor matrix (HFWT) is proposed. In the proposed HFWT method, open-closing morphological operation is utilized to remove the noise of the HS image, and homomorphic filtering is introduced to extract the spatial details of each band in the denoised HS image. More importantly, a weighted root mean squared error-based method is proposed to obtain the total spatial information of the HS image, and an optimized weighted tensor matrix based strategy is presented to integrate spatial information of the HS image with spatial information of the panchromatic (PAN) image. With the appropriate integrated spatial details injection, the fused HS image is generated by constructing the suitable gain matrix. Experimental results over both simulated and real datasets demonstrate that the proposed HFWT method effectively generates the fused HS image with high spatial resolution while maintaining the spectral information of the original low spatial resolution HS image. [ABSTRACT FROM AUTHOR]

Pansharpening is the process of integrating a high spatial resolution panchromatic image with a low spatial resolution multispectral image to obtain a multispectral image with high spatial and spectral resolution. Over the last decade, several algorithms have been developed for pansharpening. In this paper, a technique, called enhanced back-projection (EBP), is introduced and applied as postprocessing on the pansharpening. The proposed EBP first enhances the spatial details of the pansharpening results by histogram matching and high-pass modulation, followed by a back-projection process, which takes into account the modulation transfer function (MTF) of the satellite sensor such that the pansharpening results obey the consistency property. The EBP is validated on four datasets acquired by different satellites and several commonly used pansharpening methods. The pansharpening results achieve substantial improvements by this postprocessing technique, which is widely applicable and requires no modification of existing pansharpening methods. [ABSTRACT FROM AUTHOR]

Multispectral remote sensing data may contain component images that are heavily corrupted by noise and the pre-filtering (denoising) procedure is often applied to enhance these component images. To do this, one can use reference images—component images having relatively high quality and that are similar to the image subject to pre-filtering. Here, we study the following problems: how to select component images that can be used as references (e.g., for the Sentinel multispectral remote sensing data) and how to perform the actual denoising. We demonstrate that component images of the same resolution as well as component images of a better resolution can be used as references. To provide high efficiency of denoising, reference images have to be transformed using linear or nonlinear transformations. This paper proposes a practical approach to doing this. Examples of denoising tests and real-life images demonstrate high efficiency of the proposed approach. [ABSTRACT FROM AUTHOR]

As an important part of maritime traffic, ships play an important role in military and civilian applications. However, ships' appearances are susceptible to some factors such as lighting, occlusion, and sea state, making ship classification more challenging. This is of great importance when exploring global and detailed information for ship classification in optical remote sensing images. In this paper, a novel method to obtain discriminative feature representation of a ship image is proposed. The proposed classification framework consists of a multifeature ensemble based on convolutional neural network (ME-CNN). Specifically, two-dimensional discrete fractional Fourier transform (2D-DFrFT) is employed to extract multi-order amplitude and phase information, which contains such important information as profiles, edges, and corners; completed local binary pattern (CLBP) is used to obtain local information about ship images; Gabor filter is used to gain the global information about ship images. Then, deep convolutional neural network (CNN) is applied to extract more abstract features based on the above information. CNN, extracting high-level features automatically, has performed well for object classification tasks. After high-feature learning, as the one of fusion strategies, decision-level fusion is investigated for the final classification result. The average accuracy of the proposed approach is 98.75% on the BCCT200-resize data, 92.50% on the original BCCT200 data, and 87.33% on the challenging VAIS data, which validates the effectiveness of the proposed method when compared to the existing state-of-art algorithms. [ABSTRACT FROM AUTHOR]

Compositing is a fundamental pre-processing for remote sensing images. Landsat series optical satellite images are influenced by cloud coverage, acquisition time, sensor types, and seasons, which make it difficult to obtain continuous cloud-free observations. It limits the potential use and analysis of time series images. Therefore, global change researchers urgently need to 'composite' multi-sensor and multi-temporal images. Many previous studies have used isolated pixel-based algorithms to composite Landsat images; however, this study is different and develops a batch pixel-based algorithm for composing continuous cloud-free Landsat images. The algorithm chooses the best scene as the reference image using the user-specified image ID or related parameters. Further, it accepts all valid pixels in the reference image as the main part of the result and develops a priority coefficient model. Development of this model is based on the criteria of five factors including cloud coverage, acquisition time, acquisition year, observation seasons, and sensor types to select substitutions for the missing pixels in batches and to merge them into the final composition. This proposed batch pixel-based algorithm may provide reasonable compositing results on the basis of the experimental test results of all Landsat 8 images in 2019 and the visualization results of 12 locations in 2020. In comparison with the isolated pixel-based algorithms, our algorithm eliminates band dispersion, requires fewer images, and enhances the composition's pixel concentration considerably. The algorithm provides a complete and practical framework for time series image processing for Landsat series satellites, and has the potential to be applied to other optical satellite images as well. [ABSTRACT FROM AUTHOR]

Atmospheric correction of remote sensing imagery over optically complex waters is still a challenging task. Even algorithms showing a good accuracy for moderate and extremely turbid waters need to be tested when being used for eutrophic inland basins. Such a test was carried out in this study on the example of a Sentinel-3/OLCI image of the productive waters of the Gorky Reservoir during the period of intense blue-green algal bloom using data on the concentration of chlorophyll a and remote sensing reflectance measured from the motorboat at many points of the reservoir. The accuracy of four common atmospheric correction (AC) algorithms was examined. All of them showed unsatisfactory accuracy due to incorrect determination of atmospheric aerosol parameters and aerosol radiance. The calculated aerosol optical depth (AOD) spectra varied widely (AOD(865) = 0.005 − 0.692) even over a small area (up to 10 × 10 km) and correlated with the measured chlorophyll a. As a result, a part of the high water-leaving signal caused by phytoplankton bloom was taken as an atmosphere signal. A significant overestimation of atmospheric aerosol parameters, as a consequence, led to a strong underestimation of the remote sensing reflectance and low accuracy of the considered AC algorithms. To solve this problem, an algorithm with a fixed AOD was proposed. The fixed AOD spectrum was determined in the area with relatively "clean" water as 5 percentiles of AOD in all water pixels. The proposed algorithm made it possible to obtain the remote sensing reflectance with high accuracy. The slopes of linear regression are close to 1 and the intercepts tend to zero in almost all spectral bands. The determination coefficients are more than 0.9; the bias, mean absolute percentage error, and root-mean-square error are notably lower than for other AC algorithms. [ABSTRACT FROM AUTHOR]

Atmospheric correction of satellite optical imagery over inland waters is a key remaining challenge in aquatic remote sensing. This is due to numerous confounding factors such as the complexity of water optical properties, the surface glint, the heterogeneous nature of atmospheric aerosols, and the proximity of bright land surfaces. This combination of factors makes it difficult to retrieve accurate information about the system observed. Moreover, the impact of radiance coming from adjacent land (adjacency effects) in complex geometries further adds to this challenge, especially for small lakes. In this study, ten atmospheric correction algorithms were evaluated for high-resolution multispectral imagery of Landsat-8 Operational Land Imager and Sentinel-2 MultiSpectral Instrument using in situ optical measurements from ~300 lakes across Canada. The results of the validation show that the performance of the algorithms varies by spectral band and evaluation metrics. The dark spectrum fitting algorithm had the best performance in terms of similarity angle (spectral shape), while the neural network-based models showed the lowest errors and bias per band. However, none of the tested atmospheric correction algorithms meet a 30% retrieval accuracy target across all the visible bands, likely due to uncorrected adjacency effects. To quantify this process, three-dimensional radiative transfer simulations were performed and compared to satellite observations. These simulations show that up to 60% of the top of atmosphere reflectance in the near-infrared bands over the lake was from the adjacent lands covered with green vegetation. The significance of these adjacency effects on atmospheric correction has been analyzed qualitatively, and potential efforts to improve the atmospheric correction algorithms are discussed. [ABSTRACT FROM AUTHOR]

The masking of cloud shadows in optical satellite imagery is an important step in automated processing chains. A new method (the TIP method) for cloud shadow detection in multi-spectral satellite images is presented and compared to current methods. The TIP method is based on the evaluation of thresholds, indices and projections. Most state-of-the-art methods solemnly rely on one of these evaluation steps or on a complex working mechanism. Instead, the new method incorporates three basic evaluation steps into one algorithm for easy and accurate cloud shadow detection. Furthermore the performance of the masking algorithms provided by the software packages ATCOR ("Atmospheric Correction") and PACO ("Python-based Atmospheric Correction") is compared with that of the newly implemented TIP method on a set of 20 Sentinel-2 scenes distributed over the globe, covering a wide variety of environments and climates. The algorithms incorporated in each piece of masking software use the class of cloud shadows, but they employ different rules and class-specific thresholds. Classification results are compared to the assessment of an expert human interpreter. The class assignment of the human interpreter is considered as reference or "truth". The overall accuracies for the class cloud shadows of ATCOR and PACO (including TIP) for difference areas of the selected scenes are 70.4% and 76.6% respectively. The difference area encompasses the parts of the classification image where the classification maps disagree. User and producer accuracies for the class cloud shadow are strongly scene-dependent, typically varying between 45% and 95%. The experimental results show that the proposed TIP method based on thresholds, indices and projections can obtain improved cloud shadow detection performance. [ABSTRACT FROM AUTHOR]

The traditional mine remote sensing information pre-survey is mainly based on manual interpretation, and interpreters delineate the mine boundary shape. This work is difficult and susceptible to subjective judgment due to the large differences in the characteristics of mining complex within individuals and small differences between individuals. CondInst-VoV and BlendMask-VoV, based on VoVNet-v2, are two improved instance segmentation models proposed to improve the efficiency of mine remote sensing pre-survey and minimize labor expenses. In Hubei Province, China, Gaofen satellite fusion images, true-color satellite images, false-color satellite images, and Tianditu images are gathered to create a Key Open-pit Mine Acquisition Areas (KOMMA) dataset to assess the efficacy of mine detection models. In addition, regional detection was carried out in Daye Town. The result shows that the performance of improved models on the KOMMA dataset exceeds the baseline as well as the verification accuracy of manual interpretation in regional mine detection tasks. In addition, CondInst-VoV has the best performance on Tianditu image, reaching 88.816% in positioning recall and 98.038% in segmentation accuracy. [ABSTRACT FROM AUTHOR]

The paper aims to present the results obtained in the development of a system allowing for the detection and monitoring of forest fires and the continuous comparison of their intensity when several events occur simultaneously—a common occurrence in European Mediterranean countries during the summer season. The system, called SFIDE (Satellite FIre DEtection), exploits a geostationary satellite sensor (SEVIRI, Spinning Enhanced Visible and InfraRed Imager, on board of MSG, Meteosat Second Generation, satellite series). The algorithm was developed several years ago in the framework of a project (SIGRI) funded by the Italian Space Agency (ASI). This algorithm has been completely reviewed in order to enhance its efficiency by reducing false alarms rate preserving a high sensitivity. Due to the very low spatial resolution of SEVIRI images (4 × 4 km2 at Mediterranean latitude) the sensitivity of the algorithm should be very high to detect even small fires. The improvement of the algorithm has been obtained by: introducing the sun elevation angle in the computation of the preliminary thresholds to identify potential thermal anomalies (hot spots), introducing a contextual analysis in the detection of clouds and in the detection of night-time fires. The results of the algorithm have been validated in the Sardinia region by using ground true data provided by the regional Corpo Forestale e di Vigilanza Ambientale (CFVA). A significant reduction of the commission error (less than 10%) has been obtained with respect to the previous version of the algorithm and also with respect to fire-detection algorithms based on low earth orbit satellites. [ABSTRACT FROM AUTHOR]

Scene classification, aiming to identify the land-cover categories of remotely sensed image patches, is now a fundamental task in the remote sensing image analysis field. Deep-learning-model-based algorithms are widely applied in scene classification and achieve remarkable performance, but these high-level methods are computationally expensive and time-consuming. Consequently in this paper, we introduce a knowledge distillation framework, currently a mainstream model compression method, into remote sensing scene classification to improve the performance of smaller and shallower network models. Our knowledge distillation training method makes the high-temperature softmax output of a small and shallow student model match the large and deep teacher model. In our experiments, we evaluate knowledge distillation training method for remote sensing scene classification on four public datasets: AID dataset, UCMerced dataset, NWPU-RESISC dataset, and EuroSAT dataset. Results show that our proposed training method was effective and increased overall accuracy (3% in AID experiments, 5% in UCMerced experiments, 1% in NWPU-RESISC and EuroSAT experiments) for small and shallow models. We further explored the performance of the student model on small and unbalanced datasets. Our findings indicate that knowledge distillation can improve the performance of small network models on datasets with lower spatial resolution images, numerous categories, as well as fewer training samples. [ABSTRACT FROM AUTHOR]

The Amery Ice Shelf (AIS) dynamics and mass balance caused by iceberg calving and basal melting are significant in the ocean climate system. Using satellite imagery from Sentinel-1 SAR, we monitored the temporal and spatial variability of the frontal positions on the Amery Ice Shelf, Antarctica, from 2015 to 2021. In this paper, we propose an automatic algorithm based on the SO-CFAR strategy and a profile cumulative method for frontal line extraction. To improve the accuracy of the extracted frontal lines, we developed a framework combining the Constant False Alarm Rate (CFAR) and morphological image-processing strategies. A visual comparison between the proposed algorithm and state-of-the-art algorithm shows that our algorithm is effective in these cases including rifts, icebergs, and crevasses as well as ice-shelf surface structures. We present a detailed analysis of the temporal and spatial variability of fronts on AIS that we find, an advance of the AIS frontal line before the D28 calving event, and a continuous advance after the event. The study reveals that the AIS extent has been advanced at the rate of 1015 m/year. Studies have shown that the frontal location of AIS has continuously expanded. From March 2015 to May 2021, the frontal location of AIS expanded by 6.5 km; while the length of the AIS frontal line is relatively different after the D28 event, the length of the frontal line increased by about 7.5% during 2015 and 2021 (255.03 km increased to 273.5 km). We found a substantial increase in summer advance rates and a decrease in winter advance rates with the seasonal characteristics. We found this variability of the AIS frontal line to be in good agreement with the ice flow velocity. [ABSTRACT FROM AUTHOR]

As speckle seriously restricts the applications of remote sensing images in many fields, the ability to efficiently and effectively suppress speckle in a coherent imaging system is indispensable. In order to overcome the over-smoothing problem caused by the speckle suppression algorithm based on classical sparse representation, we propose a non-local speckle suppression algorithm that combines the non-local prior knowledge of the image into the sparse representation. The proposed algorithm first applies shearlet to sparsely represent the input image. We then incorporate the non-local priors as constraints into the image sparse representation de-noising problem. The denoised image is obtained by utilizing an alternating minimization algorithm to solve the corresponding constrained de-noising problem. The experimental results show that the proposed algorithm can not only significantly remove speckle noise, but also improve the visual effect and retain the texture information of the image better. [ABSTRACT FROM AUTHOR]

Hyperspectral sensors are able to provide information that is useful for many different applications. However, the huge amounts of data collected by these sensors are not exempt of drawbacks, especially in remote sensing environments where the hyperspectral images are collected on-board satellites and need to be transferred to the earth's surface. In this situation, an efficient compression of the hyperspectral images is mandatory in order to save bandwidth and storage space. Lossless compression algorithms have been traditionally preferred, in order to preserve all the information present in the hyperspectral cube for scientific purposes, despite their limited compression ratio. Nevertheless, the increment in the data-rate of the new-generation sensors is making more critical the necessity of obtaining higher compression ratios, making it necessary to use lossy compression techniques. A new transform-based lossy compression algorithm, namely Lossy Compression Algorithm for Hyperspectral Image Systems (HyperLCA), is proposed in this manuscript. This compressor has been developed for achieving high compression ratios with a good compression performance at a reasonable computational burden. An extensive amount of experiments have been performed in order to evaluate the goodness of the proposed HyperLCA compressor using different calibrated and uncalibrated hyperspectral images from the AVIRIS and Hyperion sensors. The results provided by the proposed HyperLCA compressor have been evaluated and compared against those produced by the most relevant state-of-the-art compression solutions. The theoretical and experimental evidence indicates that the proposed algorithm represents an excellent option for lossy compressing hyperspectral images, especially for applications where the available computational resources are limited, such as on-board scenarios. [ABSTRACT FROM AUTHOR]

Phenological metrics extracted from satellite data (phenometrics) have been increasingly used to access timely, spatially explicit information on crop phenology, but have rarely been calibrated and validated with field observations. In this study, we developed a calibration procedure to make phenometrics more comparable to ground-based phenological stages by optimising the settings of Best Index Slope Extraction (BISE) and smoothing algorithms together with thresholds. We used a six-year daily Moderate Resolution Imaging Spectrometer (MODIS) Normalized Difference Vegetation Index (NDVI) time series and 211 ground-observation records from four major crop species (winter wheat/barley, oilseed rape, and sugar beet) in central Germany. Results showed the superiority of the Savitzky–Golay algorithm in combination with BISE. The satellite-derived senescence dates matched ripeness stages of winter crops and the dates with maximum NDVI were closely related to the field-observed heading stage of winter cereals. We showed that the emergence of winter crops corresponded to the dates extracted with a threshold of 0.1, which translated into 8.89 days of root-mean-square error (RMSE) improvement compared to the standard threshold of 0.5. The method with optimised settings and thresholds can be easily transferred and applied to areas with similar growing conditions. Altogether, the results improve our understanding of how satellite-derived phenometrics can explain in situ phenological observations. [ABSTRACT FROM AUTHOR]

The accurate monitoring of forest cover and its changes are essential for environmental change research, but current satellite products for forest coverage carry many uncertainties. This study used 30-m Landsat-8 data, and aggregated 1-m GaoFen-2 (GF-2) satellite images to construct the training samples and used multiple machine learning algorithms (MLAs) to estimate the fractional forest cover (FFC) in China's Three North Region (TNR). In this study, multiple MLAs were merged to construct stacked generalization (SG) models based on the idea of SG, and the performances of the MLAs in the FFC estimation were evaluated. The results of the 10-fold cross-validation showed that all non-linear algorithms had a good performance, with an R2 value of greater than 0.8 and a root-mean square error (RMSE) of less than 0.05. In the bagging ensemble, the random forest (RF) (R2 = 0.993, RMSE = 0.020) model performed the best and in the boosting ensemble, the light gradient boosted machine (LGBM) (R2 = 0.992, RMSE = 0.022) performed the best. Although the evaluation index of the RF is slightly better than that of the LGBM, the independent validation results show that the two models have similar performances. The model evaluation results of the independent datasets showed that, in the SG model, the performance of the SG(LGBM) (R2 = 0.991, RMSE = 0.034) was better than that of the single or non-ensemble model. Comparing the FFC estimates of our model with those of existing datasets showed that our model exhibited more forest spatial distribution details and higher accuracy in complex landscapes. Overall, in this study, the method of using high-resolution remote sensing (RS) images to extract samples for FFC estimation is feasible. Our results demonstrate the potential of the ensemble MLAs to map the FFC. The research results also show that among many MALs, the RF algorithm is the most suitable algorithm for estimating FFC, which provides a reference for future research. [ABSTRACT FROM AUTHOR]

Masking of clouds, cloud shadow, water and snow/ice in optical satellite imagery is an important step in automated processing chains. We compare the performance of the masking provided by Fmask ("Function of mask" implemented in FORCE), ATCOR ("Atmospheric Correction") and Sen2Cor ("Sentinel-2 Correction") on a set of 20 Sentinel-2 scenes distributed over the globe covering a wide variety of environments and climates. All three methods use rules based on physical properties (Top of Atmosphere Reflectance, TOA) to separate clear pixels from potential cloud pixels, but they use different rules and class-specific thresholds. The methods can yield different results because of different definitions of the dilation buffer size for the classes cloud, cloud shadow and snow. Classification results are compared to the assessment of an expert human interpreter using at least 50 polygons per class randomly selected for each image. The class assignment of the human interpreter is considered as reference or "truth". The interpreter carefully assigned a class label based on the visual assessment of the true color and infrared false color images and additionally on the bottom of atmosphere (BOA) reflectance spectra. The most important part of the comparison is done for the difference area of the three classifications considered. This is the part of the classification images where the results of Fmask, ATCOR and Sen2Cor disagree. Results on difference area have the advantage to show more clearly the strengths and weaknesses of a classification than results on the complete image. The overall accuracy of Fmask, ATCOR, and Sen2Cor for difference areas of the selected scenes is 45%, 56%, and 62%, respectively. User and producer accuracies are strongly class- and scene-dependent, typically varying between 30% and 90%. Comparison of the difference area is complemented by looking for the results in the area where all three classifications give the same result. Overall accuracy for that "same area" is 97% resulting in the complete classification in overall accuracy of 89%, 91% and 92% for Fmask, ATCOR and Sen2Cor respectively. [ABSTRACT FROM AUTHOR]

The evaluation of remote sensing imagery segmentation results plays an important role in the further image analysis and decision-making. The search for the optimal segmentation method for a particular data set and the suitability of segmentation results for the use in satellite image classification are examples where the proper image segmentation quality assessment can affect the quality of the final result. There is no extensive research related to the assessment of the segmentation effectiveness of the images. The designed objective quality assessment metrics that can be used to assess the quality of the obtained segmentation results usually take into account the subjective features of the human visual system (HVS). A novel approach is used in the article to estimate the effectiveness of satellite image segmentation by relating and determining the correlation between subjective and objective segmentation quality metrics. Pearson's and Spearman's correlation was used for satellite images after applying a k-means++ clustering algorithm based on colour information. Simultaneously, the dataset of the satellite images with ground truth (GT) based on the "DeepGlobe Land Cover Classification Challenge" dataset was constructed for testing three classes of quality metrics for satellite image segmentation. [ABSTRACT FROM AUTHOR]

The spatial fragmentation of high-resolution remote sensing images makes the segmentation algorithm put forward a strong demand for noise immunity. However, the stronger the noise immunity, the more serious the loss of detailed information, which easily leads to the neglect of effective characteristics. In view of the difficulty of balancing the noise immunity and effective characteristic retention, an adaptive distance-weighted Voronoi tessellation technology is proposed for remote sensing image segmentation. The distance between pixels and seed points in Voronoi tessellation is established by the adaptive weighting of spatial distance and spectral distance. The weight coefficient used to control the influence intensity of spatial distance is defined by a monotone decreasing function. Following the fuzzy clustering framework, a fuzzy segmentation model with Kullback–Leibler (KL) entropy regularization is established by using multivariate Gaussian distribution to describe the spectral characteristics and Markov Random Field (MRF) to consider the neighborhood effect of sub-regions. Finally, a series of parameter optimization schemes are designed according to parameter characteristics to obtain the optimal segmentation results. The proposed algorithm is validated on many multispectral remote sensing images with five comparing algorithms by qualitative and quantitative analysis. A large number of experiments show that the proposed algorithm can overcome the complex noise as well as better ensure effective characteristics. [ABSTRACT FROM AUTHOR]

Image segmentation is a cost-effective way to obtain information about the sizes and structural composition of agricultural parcels in an area. To accurately obtain such information, the parameters of the segmentation algorithm ought to be optimized using supervised or unsupervised methods. The difficulty in obtaining reference data makes unsupervised methods indispensable. In this study, we evaluated an existing unsupervised evaluation metric that minimizes a global score (GS), which is computed by summing up the intra-segment uniformity and inter-segment dissimilarity within a segmentation output. We modified this metric and proposed a new metric that uses absolute difference to compute the GS. We compared this proposed metric with the existing metric in two optimization approaches based on the Multiresolution Segmentation (MRS) algorithm to optimally delineate agricultural parcels from Sentinel-2 images in Lower Saxony, Germany. The first approach searches for optimal scale while keeping shape and compactness constant, while the second approach uses Bayesian optimization to optimize the three main parameters of the MRS algorithm. Based on a reference data of agricultural parcels, the optimal segmentation result of each optimization approach was evaluated by calculating the quality rate, over-segmentation, and under-segmentation. For both approaches, our proposed metric outperformed the existing metric in different agricultural landscapes. The proposed metric identified optimal segmentations that were less under-segmented compared to the existing metric. A comparison of the optimal segmentation results obtained in this study to existing benchmark results generated via supervised optimization showed that the unsupervised Bayesian optimization approach based on our proposed metric can potentially be used as an alternative to supervised optimization, particularly in geographic regions where reference data is unavailable or an automated evaluation system is sought. [ABSTRACT FROM AUTHOR]

Digital Elevation Models (DEMs) are widely used as a proxy for bathymetric data and several studies have attempted to improve DEM accuracy for hydrodynamic (HD) modeling. Most of these studies attempted to quantitatively improve estimates of channel conveyance (assuming a non-braided morphology) rather than accounting for the actual channel planform. Accurate representation of river conveyance and planform in a DEM is critical to HD modeling and can be achieved with a combination of remote sensing (e.g., satellite image) and field data, such as water surface elevation (WSE). Therefore, the objectives of this study are (i) to develop an algorithm for predicting channel conveyance and characterizing planform via satellite images and in situ WSE and (ii) to estimate discharge using the predicted conveyance via an HD model. The algorithm is named River Bathymetry via Satellite Image Compilation (RiBaSIC) and uses Landsat satellite imagery, Shuttle Radar Topography Mission (SRTM) DEM, Multi-Error-Removed Improved-Terrain (MERIT) DEM, and observed WSE. The algorithm is tested on four study areas along the Willamette River, Kushiyara River, Jamuna River, and Solimoes River. Channel slope and predicted hydraulic radius are subsequently estimated for approximating Manning's roughness factor. Two-dimensional HD models using DEMs modified by the RiBaSIC algorithm and corresponding Manning's roughness factors are employed for discharge estimation. The proposed algorithm can represent river planform and conveyance in single-channeled, meandering, wandering, and braided river reaches. Additionally, the HD models estimated discharge within 14–19% relative root mean squared error (RRMSE) in simulation of five years period. [ABSTRACT FROM AUTHOR]

With the development of effective deep learning algorithms, it became possible to achieve high accuracy when conducting remote sensing analyses on very high-resolution images (VHRS), especially in the context of building detection and classification. In this article, in order to improve the accuracy of building detection and classification, we propose a Faster Edge Region Convolutional Neural Networks (FER-CNN) algorithm. This proposed algorithm is trained and evaluated on different datasets. In addition, we propose a new method to improve the detection of the boundaries of detected buildings. The results of our algorithm are compared with those of other methods, such as classical Faster Region Convolution Neural Network (Faster R-CNN) with the original VGG16 and the Single-Shot Multibox Detector (SSD). The experimental results show that our methods make it possible to obtain an average detection accuracy of 97.5% with a false positive classification rate of 8.4%. An additional advantage of our method is better resistance to shadows, which is a very common issue for satellite images of urban areas. Future research will include designing and training the neural network to detect small buildings, as well as irregularly shaped buildings that are partially obscured by shadows or other occlusions. [ABSTRACT FROM AUTHOR]

Linear dunes and human fingerprints share many characteristics. Both have ridges, valleys, and defects (minutiae) in the form of bifurcations and termination of ridgeline features. For dunes, determining how defects vary across linear and transverse dunefields is critical to understanding the physics of their formative processes and the physical forcing mechanisms that produce dunefields. Unfortunately, manual extraction of defect locations and higher order characteristics (type, orientation, and quality) from remotely sensed imagery is both time-consuming and inconsistent. This problem is further exacerbated when, in the case of imagery from sensors in orbit around Mars, we are unable to field check interpretations. In this research, we apply a novel technique for extracting defects from multiple imagery sources utilizing a robust and well-documented fingerprint minutiae detection and extraction software (MINDTCT: MINutiae DecTeCTion) developed by the National Institute of Standards and Technology (NIST). We apply our 'fingerprinting' approach to Transverse Aeolian Ridges (TARs), relict aeolian features commonly seen on the surface of Mars, whose depositional and formative processes are poorly understood. Our algorithmic approach demonstrates that automating the rapid extraction of defects from orbitally-derived high-resolution imagery of Mars is feasible and produces maps that allow the quantification and analysis of these features. [ABSTRACT FROM AUTHOR]

Land-cover map production using remote-sensing imagery is governed by data availability. In our case, data sources are two-fold: on one hand, optical data provided regularly by satellites such as Sentinel-2, and on the other hand, reference data which allow calibrating mapping methods or validating the results. The lengthy delays due to reference data collection and cleansing are one of the main issues for applications. In this work, the use of Optimal Transport (OT) is proposed. OT is a Domain Adaptation method that uses past data, both images and reference data, to produce the land-cover map of the current period without updated reference data. Seven years of Formosat-2 image time series and the corresponding reference data are used to evaluate two OT algorithms: conventional EMD transport and regularized transport based on the Sinkhorn distance. The contribution of OT to a classification fusion strategy is also evaluated. The results show that with a 17-class nomenclature the problem is too complex for the Sinkhorn algorithm, which provides maps with an Overall Accuracy (OA) of 30%. In contrast, with the EMD algorithm, an OA close to 70% is obtained. One limitation of OT is the number of classes that can be considered at the same time. Simplification schemes are proposed to reduce the number of classes to be transported. Cases of improvement are shown when the problem is simplified, with an improvement in OA varying from 5% and 20%, producing maps with an OA near 79%. As several years are available, the OT approaches are compared to standard fusion schemes, like majority voting. The gain in voting strategies with OT use is lower than the gain obtained with standard majority voting (around 5%). [ABSTRACT FROM AUTHOR]

This work presents an approach to road network extraction in remote sensing images. In our earlier work, we worked on the extraction of the road network using a multi-agent approach guided by Volunteered Geographic Information (VGI). The limitation of this VGI-only approach is its inability to update the new road developments as it only follows the VGI. In this work, we employ a deep learning approach to update the road network to include new road developments not captured by the existing VGI. The output of the first stage is used to train a Convolutional Neural Network (CNN) in the second stage to generate a general model to classify road pixels. Post-processing is used to correct the undesired artifacts such as buildings, vegetation, occlusions, etc. to generate a final road map. Our proposed method is tested on the satellite images acquired over Abu Dhabi, United Arab Emirates and the aerial images acquired over Massachusetts, United States of America, and is observed to produce accurate results. [ABSTRACT FROM AUTHOR]

Coastal land cover classification is a significant yet challenging task in remote sensing because of the complex and fragmented nature of coastal landscapes. However, availability of multitemporal and multisensor remote sensing data provides opportunities to improve classification accuracy. Meanwhile, rapid development of deep learning has achieved astonishing results in computer vision tasks and has also been a popular topic in the field of remote sensing. Nevertheless, designing an effective and concise deep learning model for coastal land cover classification remains problematic. To tackle this issue, we propose a multibranch convolutional neural network (MBCNN) for the fusion of multitemporal and multisensor Sentinel data to improve coastal land cover classification accuracy. The proposed model leverages a series of deformable convolutional neural networks to extract representative features from a single-source dataset. Extracted features are aggregated through an adaptive feature fusion module to predict final land cover categories. Experimental results indicate that the proposed MBCNN shows good performance, with an overall accuracy of 93.78% and a Kappa coefficient of 0.9297. Inclusion of multitemporal data improves accuracy by an average of 6.85%, while multisensor data contributes to 3.24% of accuracy increase. Additionally, the featured fusion module in this study also increases accuracy by about 2% when compared with the feature-stacking method. Results demonstrate that the proposed method can effectively mine and fuse multitemporal and multisource Sentinel data, which improves coastal land cover classification accuracy. [ABSTRACT FROM AUTHOR]