Search

Hyperspectral imaging (HSI) has emerged as a promising, advanced technology in remote sensing and has demonstrated great potential in the exploitation of a wide variety of data. In particular, its capability has expanded from unmixing data samples and detecting targets at the subpixel scale to finding endmembers, which generally cannot be resolved by multispectral imaging. Accordingly, a wealth of new HSI research has been conducted and reported in the literature in recent years. The aim of this Special Issue "Advances in Hyperspectral Data Exploitation" is to provide a forum for scholars and researchers to publish and share their research ideas and findings to facilitate the utility of hyperspectral imaging in data exploitation and other applications. With this in mind, this Special Issue accepted and published 19 papers in various areas, which can be organized into 9 categories, including I: Hyperspectral Image Classification, II: Hyperspectral Target Detection, III: Hyperspectral and Multispectral Fusion, IV: Mid-wave Infrared Hyperspectral Imaging, V: Hyperspectral Unmixing, VI: Hyperspectral Sensor Hardware Design, VII: Hyperspectral Reconstruction, VIII: Hyperspectral Visualization, and IX: Applications. [ABSTRACT FROM AUTHOR]

In complex environments a single visible image is not good enough to perceive the environment, this paper proposes a novel dual-stream real-time detector designed for target detection in extreme environments such as nighttime and fog, which is able to efficiently utilise both visible and infrared images to achieve Fast All-Weatherenvironment sensing (FAWDet). Firstly, in order to allow the network to process information from different modalities simultaneously, this paper expands the state-of-the-art end-to-end detector YOLOv8, the backbone is expanded in parallel as a dual stream. Then, for purpose of avoid information loss in the process of network deepening, a cross-modal feature enhancement module is designed in this study, which enhances each modal feature by cross-modal attention mechanisms, thus effectively avoiding information loss and improving the detection capability of small targets. In addition, for the significant differences between modal features, this paper proposes a three-stage fusion strategy to optimise the feature integration through the fusion of spatial, channel and overall dimensions. It is worth mentioning that the cross-modal feature fusion module adopts an end-to-end training approach. Extensive experiments on two datasets validate that the proposed method achieves state-of-the-art performance in detecting small targets. The cross-modal real-time detector in this study not only demonstrates excellent stability and robust detection performance, but also provides a new solution for target detection techniques in extreme environments. [ABSTRACT FROM AUTHOR]

This paper addresses the problem of mapping land cover types in Senegal and recognition of vegetation systems in the Saloum River Delta on the satellite images. Multi-seasonal landscape dynamics were analyzed using Landsat 8-9 OLI/TIRS images from 2015 to 2023. Two image classification methods were compared, and their performance was evaluated in the GRASS GIS software (version 8.4.0, creator: GRASS Development Team, original location: Champaign, Illinois, USA, currently multinational project) by means of unsupervised classification using the k-means clustering algorithm and supervised classification using the Support Vector Machine (SVM) algorithm. The land cover types were identified using machine learning (ML)-based analysis of the spectral reflectance of the multispectral images. The results based on the processed multispectral images indicated a decrease in savannas, an increase in croplands and agricultural lands, a decline in forests, and changes to coastal wetlands, including mangroves with high biodiversity. The practical aim is to describe a novel method of creating land cover maps using RS data for each class and to improve accuracy. We accomplish this by calculating the areas occupied by 10 land cover classes within the target area for six consecutive years. Our results indicate that, in comparing the performance of the algorithms, the SVM classification approach increased the accuracy, with 98% of pixels being stable, which shows qualitative improvements in image classification. This paper contributes to the natural resource management and environmental monitoring of Senegal, West Africa, through advanced cartographic methods applied to remote sensing of Earth observation data. [ABSTRACT FROM AUTHOR]

Snow detection is imperative in remote sensing for various applications, including climate change monitoring, water resources management, and disaster warning. Recognizing the limitations of current deep learning algorithms in cloud and snow boundary segmentation, as well as issues like detail snow information loss and mountainous snow omission, this paper presents a novel snow detection network based on Swin-Transformer and U-shaped dual-branch encoder structure with geographic information (SD-GeoSTUNet), aiming to address the above issues. Initially, the SD-GeoSTUNet incorporates the CNN branch and Swin-Transformer branch to extract features in parallel and the Feature Aggregation Module (FAM) is designed to facilitate the detail feature aggregation via two branches. Simultaneously, an Edge-enhanced Convolution (EeConv) is introduced to promote snow boundary contour extraction in the CNN branch. In particular, auxiliary geographic information, including altitude, longitude, latitude, slope, and aspect, is encoded in the Swin-Transformer branch to enhance snow detection in mountainous regions. Experiments conducted on Levir_CS, a large-scale cloud and snow dataset originating from Gaofen-1, demonstrate that SD-GeoSTUNet achieves optimal performance with the values of 78.08%, 85.07%, and 92.89% for I o U _ s , F 1 _ s , and M P A , respectively, leading to superior cloud and snow boundary segmentation and thin cloud and snow detection. Further, ablation experiments reveal that integrating slope and aspect information effectively alleviates the omission of snow detection in mountainous areas and significantly exhibits the best vision under complex terrain. The proposed model can be used for remote sensing data with geographic information to achieve more accurate snow extraction, which is conducive to promoting the research of hydrology and agriculture with different geospatial characteristics. [ABSTRACT FROM AUTHOR]

Hyperspectral and multispectral image databases, urban area imagery dataset, point cloud data, aerial video, thermal imaging, and SAR data have been used in experiments. In detail, the authors propose a multi-scaled column-spatial correction network (CSCNet) where the local structural characteristic of the noise and the image global contextual information are jointly exploited at multiple feature scales. The authors have proposed an LST reconstruction method that combines data decomposition with data prediction to obtain spatially and temporally continuous LST data. The peculiarity of the paper is that the authors consider deep neural network-based models, with special attention being focused upon generative adversarial networks, and taking into account the fact that HS images possess abundant spectral information. [Extracted from the article]

One of the ideas behind vegetation monitoring is the ability to identify different vegetation units, such as species, communities, habitats, or vegetation types. Remote sensing data allow for obtaining such information remotely, which is especially valuable in areas that are difficult to explore (such as mountains or wetlands). At the same time, such techniques allow for limiting field research, which is particularly important in this context. Remote sensing has been utilized for vegetation inventories for many decades, using airborne and spaceborne platforms. Developing newer tools, algorithms and sensors is conducive to more new applications in the vegetation identification field. The Special Issue "Remote Sensing Applications in Vegetation Classification" is an overview of the applications of remote sensing data with different resolutions for the identification of vegetation at different levels of detail. In 14 research papers, the most frequent different types of crops were analysed. In three cases, the authors recognised different types of grasslands, whereas trees were the object of the studies in two papers. The most commonly used sensors were Copernicus Sentinel-1 and Sentinel-2; however, to a lesser extent, MODIS, airborne hyperspectral and multispectral data, as well as LiDAR products, were also utilised. There were articles that tested and compared different combinations of datasets, different terms of data acquisition, or different classifiers in order to achieve the highest classification accuracy. These accuracies were assessed quite satisfactorily in each publication; the overall accuracy (OA) for the best result varied from 72% to 98%. In all of the research papers, at least one of the two commonly used machine learning algorithms, random forest (RF) and support vector machines (SVM), was applied. Additionally, one paper presented software ARTMO's machine-learning classification algorithms toolbox, which allows for the testing of 13 different classifiers. The studies published in this Special Issue can be used by the vegetation research teams and practitioners to conduct deeper analysis via the utilization of the proposed solutions. [ABSTRACT FROM AUTHOR]

This paper proposes an efficient and high-fidelity image fusion method based on adaptive smoothing filtering for panchromatic (PAN) and multispectral (MS) image fusion. The scale ratio reflects the ratio of spatial resolution between the panchromatic image and the multispectral image. When facing a multiscale fusion task, traditional methods are unable to simultaneously handle the problems of spectral resolution loss resulting from high scale ratios and the issue of reduced spatial resolution due to low scale ratios. To adapt to the fusion of panchromatic and multispectral satellite images of different scales, this paper improves the problem of the insufficient filtering of high-frequency information of remote sensing images of different scales by the classic filter-based intensity modulation (SFIM) model. It uses Gaussian convolution kernels instead of traditional mean convolution kernels and builds a Gaussian pyramid to adaptively construct convolution kernels of different scales to filter out high-frequency information of high-resolution images. It can adaptively process panchromatic multispectral images of different scales, iteratively filter the spatial information in panchromatic images, and ensure that the scale transformation is consistent with the definition of multispectral images. Using 15 common fusion methods, this paper compares the experimental results of ZY-3 with scale ratio 2.7 and SV-1 with scale ratio 4 data. The results show that the method proposed in this paper retains good spatial information for image fusion at different scales and has good spectral preservation. [ABSTRACT FROM AUTHOR]

An accurate estimation of canopy cover can provide an important basis for forest ecological management by understanding the forest status and change patterns. The aim of this paper is to investigate the four methods of the random forest (RF), support vector regression (SVR), k-nearest neighbor (KNN), and k-nearest neighbor with fast iterative features selection (KNN-FIFS) for modeling forest canopy cover, and to evaluate three mainstream optical data sources—Landsat8 OLI, Sentinel-2A, Gaofen-1 (GF-1)—and three types of data combined comparatively by selecting the optimal modeling method. The paper uses the Daxinganling Ecological Station of Genhe City, Inner Mongolia, as the research area, and is based on three types of multispectral remote sensing data, extracting spectral characteristics, textural characteristics, terrain characteristics; the Kauth–Thomas transform (K-T transform); and color transformation characteristics (HIS). The optimal combination of features was selected using three feature screening methods, namely stepwise regression, RF, and KNN-FIFS, and the four methods: RF, SVR KNN, and KNN-FIFS, were combined to carry out the evaluation analysis regarding the accuracy of forest canopy cover modeling: (1) In this study, a variety of remote sensing features were introduced, and the feature variables were selected by different parameter preference methods and then employed in modeling. Based on the four modeling inversion methods, the KNN-FIFS model achieves the best accuracy: the Landsat8 OLI with R2 = 0.60, RMSE = 0.11, and RMSEr = 14.64% in the KNN-FIFS model; the Sentinel-2A with R2 = 0.80, RMSE = 0.08, and RMSEr = 11.63% in the KNN-FIFS model; the GF-1 with R2 = 0.55, RMSE = 0.12, and RMSEr = 15.04% in the KNN-FIFS model; and the federated data with R2 = 0.82, RMSE = 0.08, and RMSEr = 10.40% in the KNN-FIFS model; (2) the three multispectral datasets have the ability to estimate forest canopy cover, and the modeling accuracy superior under the combination of multi-source data features; (3) under different optical data, KNN- FIFS achieves the best accuracy in the established nonparametric model, and its feature optimization method is better than that of the random forest optimization method. For the same model, the estimation result of the joint data is better than the single optical data; thus, the KNN-FIFS model, with specific parameters, can significantly improve the inversion accuracy and efficiency of forest canopy cover evaluation from different data sources. [ABSTRACT FROM AUTHOR]

When it comes to forest management and protection, knowledge is key. Therefore, forest mapping is crucial to obtain the required knowledge towards profitable resource exploitation and increased resilience against wildfires. Within this context, this paper presents a literature review on tree classification and segmentation using data acquired by unmanned aerial vehicles, with special focus on the last decade (2013–2023). The latest research trends in this field are presented and analyzed in two main vectors, namely: (1) data, where used sensors and data structures are resumed; and (2) methods, where remote sensing and data analysis methods are described, with particular focus on machine learning approaches. The study and review methodology filtered 979 papers, which were then screened, resulting in the 144 works included in this paper. These are systematically analyzed and organized by year, keywords, purpose, sensors, and methods used, easily allowing the readers to have a wide, but at the same time detailed, view of the latest trends in automatic tree classification and segmentation using unmanned aerial vehicles. This review shows that image processing and machine learning techniques applied to forestry and segmentation and classification tasks are focused on improving the accuracy and interpretability of the results by using multi-modal data, 3D information, and AI methods. Most works use RGB or multispectral cameras, or LiDAR scanners, individually. Classification is mostly carried out using supervised methods, while segmentation mostly uses unsupervised machine learning techniques. [ABSTRACT FROM AUTHOR]

The yield and quality of rice are closely related to field management. The automatic identification of field abnormalities, such as diseases and pests, based on computer vision currently mainly relies on high spatial resolution (HSR) images obtained through manual field inspection. In order to achieve automatic and efficient acquisition of HSR images, based on the capability of high-throughput field inspection of UAV remote sensing and combining the advantages of high-flying efficiency and low-flying resolution, this paper proposes a method of "far-view and close-look" autonomous field inspection by unmanned aerial vehicle (UAV) to acquire HSR images of abnormal areas in the rice canopy. First, the UAV equipped with a multispectral camera flies high to scan the whole field efficiently and obtain multispectral images. Secondly, abnormal areas (namely areas with poor growth) are identified from the multispectral images, and then the geographical locations of identified areas are positioned with a single-image method instead of the most used method of reconstruction, sacrificing part of positioning accuracy for efficiency. Finally, the optimal path for traversing abnormal areas is planned through the nearest-neighbor algorithm, and then the UAV equipped with a visible light camera flies low to capture HSR images of abnormal areas along the planned path, thereby acquiring the "close-look" features of the rice canopy. The experimental results demonstrate that the proposed method can identify abnormal areas, including diseases and pests, lack of seedlings, lodging, etc. The average absolute error (AAE) of single-image positioning is 13.2 cm, which can meet the accuracy requirements of the application in this paper. Additionally, the efficiency is greatly improved compared to reconstruction positioning. The ground sampling distance (GSD) of the acquired HSR image can reach 0.027 cm/pixel, or even smaller, which can meet the resolution requirements of even leaf-scale deep-learning classification. The HSR image can provide high-quality data for subsequent automatic identification of field abnormalities such as diseases and pests, thereby offering technical support for the realization of the UAV-based automatic rice field inspection system. The proposed method can also provide references for the automatic field management of other crops, such as wheat. [ABSTRACT FROM AUTHOR]

The airborne hyperspectral remote sensing systems (AHRSSs) acquire images with high spectral resolution, high spatial resolution, and high temporal dimension. While the AHRSS captures more detailed information from the terrain objects, the computational complexity of data processing is greatly increased. As an important application technology in the hyperspectral domain, anomaly detection (AD) processing must be real-time and high-precision in many cases, such as post-disaster rescue, military battlefield search, and natural disaster detection. In this paper, the real-time AD technology for the push-broom AHRSS is studied, the mathematical model is established, and a novel implementation framework is proposed. Firstly, the optimized kernel minimum noise fraction (OP-KMNF) transformation is employed to extract informative and discriminative features between the background and anomalies. Secondly, the Nyström method is introduced to reduce the computational complexity of OP-KMNF transformation by decomposing and extrapolating the sub-kernel matrix to estimate the eigenvector of the entire kernel matrix. Thirdly, the extracted features are transferred to hard disks for data storage. Then, taking the extracted features as input data, the background separation model-based CEM anomaly detector (BSM-CEMAD) is imported to detect anomalies. Finally, graphics processing unit (GPU) parallel computing is utilized in the Nyström-based OP-KMNF (NOP-KMNF) transformation and the BSM-CEMAD to improve the execution efficiency, and the real-time AD for the push-broom AHRSS could be realized. To test the feasibility of the implementation framework proposed in this paper, the experiment is carried out with the Airborne Multi-Modular Imaging Spectrometer (AMMIS) developed by the Shanghai Institute of Technical Physics as the data acquisition platform. The experimental results show that the proposed method outperforms many other state-of-the-art AD methods in anomalies detection and background suppression. Moreover, under the condition that the downlink data could retain most of the hyperspectral data information, the proposed method achieves real-time detection of pixel-level anomalies, with the initial delay not exceeding 1 s, the false alarm rate (FAR) less than 5%, and the true positive rate (TPR) close to 98%. [ABSTRACT FROM AUTHOR]

Spatial and spectral information are essential sources of information in remote sensing applications, and the fusion of panchromatic and multispectral images effectively combines the advantages of both. Due to the existence of two main classes of fusion methods—component substitution (CS) and multi-resolution analysis (MRA), which have different advantages—mixed approaches are possible. This paper proposes a fusion algorithm that combines the advantages of generalized intensity–hue–saturation (GIHS) and non-subsampled shearlet transform (NSST) with principal component analysis (PCA) technology to extract more spatial information. Therefore, compared with the traditional algorithms, the algorithm in this paper uses PCA transformation to obtain spatial structure components from PAN and MS, which can effectively inject spatial information while maintaining spectral information with high fidelity. First, PCA is applied to each band of low-resolution multispectral (MS) images and panchromatic (PAN) images to obtain the first principal component and to calculate the intensity of MS. Then, the PAN image is fused with the first principal component using NSST, and the fused image is used to replace the original intensity component. Finally, a fused image is obtained using the GIHS algorithm. Using the urban, plants and water, farmland, and desert images from GeoEye-1, WorldView-4, GaoFen-7 (GF-7), and Gaofen Multi-Mode (GFDM) as experimental data, this fusion method was tested using the evaluation mode with references and the evaluation mode without references and was compared with five other classic fusion algorithms. The results showed that the algorithms in this paper had better fusion performances in both spectral preservation and spatial information incorporation. [ABSTRACT FROM AUTHOR]

Pansharpening refers to enhancing the spatial resolution of multispectral images through panchromatic images while preserving their spectral features. However, existing traditional methods or deep learning methods always have certain distortions in the spatial or spectral dimensions. This paper proposes a remote sensing spatial–spectral fusion method based on a multi-scale dual-stream convolutional neural network, which includes feature extraction, feature fusion, and image reconstruction modules for each scale. In terms of feature fusion, we propose a multi cascade module to better fuse image features. We also design a new loss function aim at enhancing the high degree of consistency between fused images and reference images in terms of spatial details and spectral information. To validate its effectiveness, we conduct thorough experimental analyses on two widely used remote sensing datasets: GeoEye-1 and Ikonos. Compared with the nine leading pansharpening techniques, the proposed method demonstrates superior performance in multiple key evaluation metrics. [ABSTRACT FROM AUTHOR]

Multispectral remote sensing images contain abundant information about the distribution and reflectance of ground objects, playing a crucial role in target detection, environmental monitoring, and resource exploration. However, due to the complexity of the imaging process in multispectral remote sensing, image blur is inevitable, and the blur kernel is typically unknown. In recent years, many researchers have focused on blind image deblurring, but most of these methods are based on single-band images. When applied to CASEarth satellite multispectral images, the spectral correlation is unutilized. To address this limitation, this paper proposes a novel approach that leverages the characteristics of multispectral data more effectively. We introduce an inter-band gradient similarity prior and incorporate it into the patch-wise minimal pixel (PMP)-based deblurring model. This approach aims to utilize the spectral correlation across bands to improve deblurring performance. A solution algorithm is established by combining the half-quadratic splitting method with alternating minimization. Subjectively, the final experiments on CASEarth multispectral images demonstrate that the proposed method offers good visual effects while enhancing edge sharpness. Objectively, our method leads to an average improvement in point sharpness by a factor of 1.6, an increase in edge strength level by a factor of 1.17, and an enhancement in RMS contrast by a factor of 1.11. [ABSTRACT FROM AUTHOR]

In response to the limitations of meteorological conditions in global rice growing areas and the high cost of annotating samples, this paper combines the Vertical-Vertical (VV) polarization and Vertical-Horizontal (VH) polarization backscatter features extracted from Sentinel-1 synthetic aperture radar (SAR) images and the NDVI, NDWI, and NDSI spectral index features extracted from Sentinel-2 multispectral images. By leveraging the advantages of an optimized Semi-Supervised Generative Adversarial Network (optimized SSGAN) in combining supervised learning and semi-supervised learning, rice extraction can be achieved with fewer annotated image samples. Within the optimized SSGAN framework, we introduce a focal-adversarial loss function to enhance the learning process for challenging samples; the generator module employs the Deeplabv3+ architecture, utilizing a Wide-ResNet network as its backbone while incorporating dropout layers and dilated convolutions to improve the receptive field and operational efficiency. Experimental results indicate that the optimized SSGAN, particularly when utilizing a 3/4 labeled sample ratio, significantly improves rice extraction accuracy, leading to a 5.39% increase in Mean Intersection over Union (MIoU) and a 2.05% increase in Overall Accuracy (OA) compared to the highest accuracy achieved before optimization. Moreover, the integration of SAR and multispectral data results in an OA of 93.29% and an MIoU of 82.10%, surpassing the performance of single-source data. These findings provide valuable insights for the extraction of rice information in global rice-growing regions. [ABSTRACT FROM AUTHOR]

As we take stock of the contemporary issue, remote sensing images are gradually advancing towards hyperspectral–high spatial resolution (H2) double-high images. However, high resolution produces serious spatial heterogeneity and spectral variability while improving image resolution, which increases the difficulty of feature recognition. So as to make the best of spectral and spatial features under an insufficient number of marking samples, we would like to achieve effective recognition and accurate classification of features in H2 images. In this paper, a cross-hop graph network for H2 image classification(H2-CHGN) is proposed. It is a two-branch network for deep feature extraction geared towards H2 images, consisting of a cross-hop graph attention network (CGAT) and a multiscale convolutional neural network (MCNN): the CGAT branch utilizes the superpixel information of H2 images to filter samples with high spatial relevance and designate them as the samples to be classified, then utilizes the cross-hop graph and attention mechanism to broaden the range of graph convolution to obtain more representative global features. As another branch, the MCNN uses dual convolutional kernels to extract features and fuse them at various scales while attaining pixel-level multi-scale local features by parallel cross connecting. Finally, the dual-channel attention mechanism is utilized for fusion to make image elements more prominent. This experiment on the classical dataset (Pavia University) and double-high (H2) datasets (WHU-Hi-LongKou and WHU-Hi-HongHu) shows that the H2-CHGN can be efficiently and competently used in H2 image classification. In detail, experimental results showcase superior performance, outpacing state-of-the-art methods by 0.75–2.16% in overall accuracy. [ABSTRACT FROM AUTHOR]

Earth observation missions such as Sentinel and Landsat support the large-scale identification of agricultural crops by providing free radar and multispectral satellite images. The extraction of representative image information as well as the combination of different image sources for improved feature selection still represent a major challenge in the field of remote sensing. In this paper, we propose a novel three-dimensional (3D) deep learning U-Net model to fuse multi-level image features from multispectral and synthetic aperture radar (SAR) time series data for seasonal crop-type mapping at a regional scale. For this purpose, we used a dual-stream U-Net with a 3D squeeze-and-excitation fusion module applied at multiple stages in the network to progressively extract and combine multispectral and SAR image features. Additionally, we introduced a distinctive method for generating patch-based multitemporal multispectral composites by selective image sampling within a 14-day window, prioritizing those with minimal cloud cover. The classification results showed that the proposed network provided the best overall accuracy (94.5%) compared to conventional two-dimensional (2D) and three-dimensional U-Net models (2D: 92.6% and 3D: 94.2%). Our network successfully learned multi-modal dependencies between the multispectral and SAR satellite images, leading to improved field mapping of spectrally similar and heterogeneous classes while mitigating the limitations imposed by persistent cloud coverage. Additionally, the feature representations extracted by the proposed network demonstrated their transferability to a new cropping season, providing a reliable mapping of spatio-temporal crop type patterns. [ABSTRACT FROM AUTHOR]

Contemporary land administration (LA) systems incorporate the concepts of cadastre and land registration. Conceptually, LA is part of a global land management paradigm incorporating LA functions such as land value, land tenure, land development, and land use. The implementation of land-related policies integrated with well-maintained spatial information reflects the aim set by the United Nations to deliver tenure security for all (Sustainable Development Goal target 1.4, amongst many others). Innovative methods for data acquisition, processing, and maintaining spatial information are needed in response to the global challenges of urbanization and complex urban infrastructure. Current technological developments in remote sensing and geo-spatial information science provide enormous opportunities in this respect. Over the past decade, the increasing usage of unmanned aerial vehicles (UAVs), satellite and airborne-based acquisitions, as well as active remote sensing sensors such as LiDAR, resulted in high spatial, spectral, radiometric, and temporal resolution data. Moreover, significant progress has also been achieved in automatic image orientation, surface reconstruction, scene analysis, change detection, classification, and automatic feature extraction with the help of artificial intelligence, spatial statistics, and machine learning. These technology developments, applied to LA, are now being actively demonstrated, piloted, and scaled. This Special Issue hosts papers focusing on the usage and integration of emerging remote sensing techniques and their potential contribution to the LA domain. [ABSTRACT FROM AUTHOR]

For many remote sensing applications, the instantaneous waterline on the image is critical boundary information to separate land and water and for other purposes. Accurate waterline extraction from satellite images is a desirable feature in such applications. Due to the complex topography of low tidal flats and their indistinct spatial and spectral characteristics on satellite imagery, the waterline extraction for tidal flats (especially at low tides) from remote sensing images has always been a technically challenging problem. We developed a novel method to extract waterline from satellite images, assuming that the waterline's elevation is level. This paper explores the utilization of bathymetry during waterline extraction and presents a novel approach to tackle the waterline extraction issue, especially for low tidal flats, using remote sensing images at mid/high tide, when most of the tidal flat area is filled with seawater. Repeated optical satellite images are easily accessible in the current days; the proposed approach first generates the bathymetry map using the mid/high-tide satellite image, and then the initial waterline is extracted using traditional methods from the low-tide satellite image; the isobath (depth contour lines of bathymetry), which corresponds to the initial waterline is robustly estimated, and finally an area-based optimization algorithm is proposed and applied to both isobath and initial waterline to obtain the final optimized waterline. A series of experiments using Sentinel-2 multispectral images are conducted on Jibei Island of Penghu Archipelago and Chongming Island to demonstrate this proposed strategy. The results from the proposed approach are compared with the Normalized Difference Water Index (NDWI) and Support Vector Machine (SVM) methods. The results indicate that more accurate waterlines can be extracted using the proposed approach, and it is very suitable for waterline extraction for tidal flats, especially at low tides. [ABSTRACT FROM AUTHOR]

In large-scale remote sensing scenarios characterized by intricate terrain, the straightforward road imaging features in synthetic aperture radar (SAR) images make them susceptible to interference from other elements such as ridges, compromising the robustness of conventional SAR image road extraction methods. This paper introduces a method that integrates Gaofen-3 (GF-3) with a resolution of 3.0 m, Digital Elevation Models (DEMs), and Gaofen-2 (GF-2) remote sensing image data with a resolution of 4.0 m, aiming to improve the performance of road extraction in complex terrain. Leveraging DEMs, this study addresses the limitations in feature-based SAR algorithms, extending their application to complex remote sensing scenarios. Decision-level fusion, integrating SAR and multispectral images, further refines road extraction precision. To overcome issues related to terrain interference, including fragmented road segments, an adaptive rotated median filter and graph-theory-based optimization are introduced. These advancements collectively enhance road recognition accuracy and topological precision. The experimental results validate the effectiveness of the multi-source remote sensing image fusion and optimization methods. Compared to road extraction from multispectral images, the F1-score of the proposed method on the test images increased by 2.18%, 4.22%, and 1.4%, respectively. [ABSTRACT FROM AUTHOR]

In Central Europe, the extent of bark beetle infestation in spruce stands due to prolonged high temperatures and drought has created large areas of dead trees, which are difficult to monitor by ground surveys. Remote sensing is the only possibility for the assessment of the extent of the dead tree areas. Several options exist for mapping individual dead trees, including different sources and different processing techniques. Satellite images, aerial images, and images from UAVs can be used as sources. Machine and deep learning techniques are included in the processing techniques, although models are often presented without proper realistic validation.This paper compares methods of monitoring dead tree areas using three data sources: multispectral aerial imagery, multispectral PlanetScope satellite imagery, and multispectral Sentinel-2 imagery, as well as two processing methods. The classification methods used are Random Forest (RF) and neural network (NN) in two modalities: pixel- and object-based. In total, 12 combinations are presented. The results were evaluated using two types of reference data: accuracy of model on validation data and accuracy on vector-format semi-automatic classification polygons created by a human evaluator, referred to as real Ground Truth. The aerial imagery was found to have the highest model accuracy, with the CNN model achieving up to 98% with object classification. A higher classification accuracy for satellite imagery was achieved by combining pixel classification and the RF model (87% accuracy for Sentinel-2). For PlanetScope Imagery, the best result was 89%, using a combination of CNN and object-based classifications. A comparison with the Ground Truth showed a decrease in the classification accuracy of the aerial imagery to 89% and the classification accuracy of the satellite imagery to around 70%. In conclusion, aerial imagery is the most effective tool for monitoring bark beetle calamity in terms of precision and accuracy, but satellite imagery has the advantage of fast availability and shorter data processing time, together with larger coverage areas. [ABSTRACT FROM AUTHOR]

Pansharpening, a pivotal task in remote sensing, involves integrating low-resolution multispectral images with high-resolution panchromatic images to synthesize an image that is both high-resolution and retains multispectral information. These pansharpened images enhance precision in land cover classification, change detection, and environmental monitoring within remote sensing data analysis. While deep learning techniques have shown significant success in pansharpening, existing methods often face limitations in their evaluation, focusing on restricted satellite data sources, single scene types, and low-resolution images. This paper addresses this gap by introducing PanBench, a high-resolution multi-scene dataset containing all mainstream satellites and comprising 5898 pairs of samples. Each pair includes a four-channel (RGB + near-infrared) multispectral image of 256 × 256 pixels and a mono-channel panchromatic image of 1024 × 1024 pixels. To avoid irreversible loss of spectral information and achieve a high-fidelity synthesis, we propose a Cascaded Multiscale Fusion Network (CMFNet) for pansharpening. Multispectral images are progressively upsampled while panchromatic images are downsampled. Corresponding multispectral features and panchromatic features at the same scale are then fused in a cascaded manner to obtain more robust features. Extensive experiments validate the effectiveness of CMFNet. [ABSTRACT FROM AUTHOR]

Small landscape features (i.e., trees outside forest, small woody features) and linear vegetation such as hedgerows, riparian vegetation, and green lanes are vital ecological structures in agroecosystems, enhancing the biodiversity, landscape diversity, and protecting water bodies. Therefore, their monitoring is fundamental to assessing a specific territory's arrangement and verifying the effectiveness of strategies and financial measures activated at the local or European scale. The size of these elements and territorial distribution make their identification extremely complex without specific survey campaigns; in particular, remote monitoring requires data of considerable resolution and, therefore, is very costly. This paper proposes a methodology to map these features using a combination of open-source or low-cost high-resolution orthophotos (RGB), which are typically available to local administrators and are object-oriented classification methods. Additionally, multispectral satellite images from the Sentinel-2 platform were utilized to further characterize the identified elements. The produced map, compared with the other existing layers, provided better results than other maps at the European scale. Therefore, the developed method is highly effective for the remote and wide-scale assessment of SWFs, making it a crucial tool for defining and monitoring development policies in rural environments. [ABSTRACT FROM AUTHOR]

This paper provides a comprehensive review of the available literature on the observation and characterization of river ice using remote sensing technologies. Through an analysis of 200 publications spanning from 1919 to June 2024, we reviewed different observation technologies deployed on in situ, aerial and satellite platforms for their utility in monitoring and characterizing river ice covers. River ice information, captured by 51 terms extracted from the literature, holds significant value in enhancing infrastructure resilience in the face of climate change. Satellite technologies, in particular the multispectral optical and multi-polarimetric synthetic aperture radar (SAR), provide a number of advantages, such as ice features discrimination, better ice characterization, and reliable delineation of open water and ice, with both current and upcoming sensors. The review includes data analysis methods employed for the monitoring and characterization of river ice, including ice information retrieval methods and corresponding accuracies. The need for further research on artificial intelligence and, in particular, deep learning (DL) techniques has been recognized as valuable for enhancing the accuracy of automated systems. The growing availability of freely available and commercial satellites, UAVs, and in situ data with improved characteristics suggests significant operational potential for river ice observation in the near future. Our study also identifies gaps in the current capabilities for river ice observation and provides suggestions for improved data analysis and interpretation. [ABSTRACT FROM AUTHOR]

On a global scale, wetlands are suffering from a steady decline in surface area and environmental quality. Protecting them is essential and requires a careful spatialisation of their natural habitats. Traditionally, in our study area, species discrimination for floristic mapping has been achieved through on-site field inventories, but this approach is very time-consuming in these difficult-to-access environments. Usually, the resulting maps are also not spatially exhaustive and are not frequently updated. In this paper, we propose to establish a complete map of the study area using remote sensors and set up a long-term and regular observatory of environmental changes to monitor the evolution of a major French wetland. This methodology combines three dataset acquisition technologies, airborne hyperspectral and WorldView-3 multispectral images, supplemented by LiDAR images, which we compared to evaluate the difference in performances. To do so, we applied the Random Forest supervised classification methods using ground reference areas and compared the out-of-bag score (OOB score) as well as the matrix of confusion resulting from each dataset. Thirteen habitats were discriminated at level 4 of the European Nature Information System (EUNIS) typology, at a spatial resolution of around 1.2 m. We first show that a multispectral image with 19 variables produces results which are almost as good as those produced by a hyperspectral image with 58 variables. The experiment with different features also demonstrates that the use of four bands derived from LiDAR datasets can improve the quality of the classification. Invasive alien species Ludwigia grandiflora and Crassula helmsii were also detected without error which is very interesting when applied to these endangered environments. Therefore, since WV-3 images provide very good results and are easier to acquire than airborne hyperspectral data, we propose to use them going forward for the regular observation of the Brière marshes habitat we initiated. [ABSTRACT FROM AUTHOR]

Aerial and remote sensing archaeology are tools for identifying marks on images of archaeological remains covered by soil. In other words, they are archaeological prospection tools that fall into the category of non-destructive research methods. In this paper, a short review of these valuable research tools is carried out, presenting the way marks appear, and also the categories of aerial and remote sensing archaeology, depending on the medium of storage of images and the type of platform of transfer of sensors. The timing of the emergence of each category is determined and examples of relevant surveys are presented. Focusing on the use of an Unmanned Aircraft System (UAS) with a multispectral sensor (aerial remote sensing archaeology), their partial utilization is revealed for collecting images in areas outside of the visible spectrum, aiming at the identification of covered archaeological remains. To this end, examples of the use of UAS with different sensors are presented and indexes that have been used so far in respective applications are gathered. Aerial remote sensing archaeology took place in two areas of particular interest in Northern Greece. UAS WingtraOne GEN II was used to collect multispectral images. In both study areas, soil and vegetation or crop marks were detected, possibly covered archaeological remains, initially in RGB orthophotomosaics and then more clearly in the index maps, such as the normalized difference vegetation index, simple ratio, brightness index, second brightness index, and anthocyanin reflectance index 2b. [ABSTRACT FROM AUTHOR]

Due to advent of sensor technology, hyperspectral imaging has become an emerging technology in remote sensing. Many problems, which cannot be resolved by multispectral imaging, can now be solved by hyperspectral imaging. The aim of this Special Issue "Hyperspectral Imaging and Applications" is to publish new ideas and technologies to facilitate the utility of hyperspectral imaging in data exploitation and to further explore its potential in different applications. This Special Issue has accepted and published 25 papers in various areas, which can be organized into 7 categories, Data Unmixing, Spectral variability, Target Detection, Hyperspectral Image Classification, Band Selection, Data Fusion, Applications. [ABSTRACT FROM AUTHOR]

As a crucial computer vision task, multi-objective semantic segmentation has attracted widespread attention and research in the field of remote sensing image analysis. This technology has important application value in fields such as land resource surveys, global change monitoring, urban planning, and environmental monitoring. However, multi-target semantic segmentation of remote sensing images faces challenges such as complex surface features, complex spectral features, and a wide spatial range, resulting in differences in spatial and spectral dimensions among target features. To fully exploit and utilize spectral feature information, focusing on the information contained in spatial and spectral dimensions of multi-spectral images, and integrating external information, this paper constructs the CD-MQANet network structure, where C represents the Channel Creator module and D represents the Dual-Path Encoder. The Channel Creator module (CCM) mainly includes two parts: a generator block and a spectral attention module. The generator block aims to generate spectral channels that can expand different ground target types, while the spectral attention module can enhance useful spectral information. Dual-Path Encoders include channel encoders and spatial encoders, intended to fully utilize spectrally enhanced images while maintaining the spatial information of the original feature map. The decoder of CD-MQANet is a multitasking decoder composed of four types of attention, enhancing decoding capabilities. The loss function used in the CD-MQANet consists of three parts, which are generated by the intermediate results of the CCM, the intermediate results of the decoder, and the final segmentation results and label calculation. We performed experiments on the Potsdam dataset and the Vaihingen dataset. Compared to the baseline MQANet model, the CD-MQANet network improved mean F1 and OA by 2.03% and 2.49%, respectively, on the Potsdam dataset, and improved mean F1 and OA by 1.42% and 1.25%, respectively, on the Vaihingen dataset. The effectiveness of CD-MQANet was also proven by comparative experiments with other studies. We also conducted a thermographic analysis of the attention mechanism used in CD-MQANet and analyzed the intermediate results generated by CCM and LAM. Both modules generated intermediate results that had a significant positive impact on segmentation. [ABSTRACT FROM AUTHOR]

The land surface temperature (LST) images obtained by thermal infrared remote sensing sensors are of great significance for numerous fields of research. However, the low spatial resolution is a drawback of LST images. Downscaling is an effective way to solve this problem. The traditional downscaling methods, however, have various drawbacks, including their low temporal and spectral resolutions, difficult processes, numerous errors, and single downscaling factor. They also rely on two or more separate satellite platforms. These drawbacks can be partially compensated for by the Sentinel-3 satellite's ability to acquire LST and multispectral images simultaneously. This paper proposes a downscaling model based on Sentinel-3 satellite and ASTER GDEM images—D-DisTrad—and compares the effects of the D-DisTrad model with DisTrad model and TsHARP model over four sites and four seasons. The mean bias (MB) range of the D-DisTrad model is −0.001–0.017 K, the mean absolute error (MAE) range is 0.103–0.891 K, and the root mean square error (RMSE) range is 0.220–1.235 K. The Pearson correlation coefficient (PCC) and R2 ranges are 0.938–0.994 and 0.889–0.989, respectively. The D-DisTrad model has the smallest error, the highest correlation, and the best visual effect, and can eliminate some "mosaic" effects in the original image. This paper shows that the D-DisTrad model can improve the spatial resolution and visual effects of LST images while maintaining high temporal resolution, and discusses the influence of the terrain and land cover on LST data. [ABSTRACT FROM AUTHOR]

Synthetic aperture radar (SAR) is an important remote sensing sensor whose application is becoming more and more extensive. Compared with traditional optical sensors, it is not easy to be disturbed by the external environment and has a strong penetration. Limited by its working principles, SAR images are not easily interpreted, and fusing SAR images with optical multispectral images is a good solution to improve the interpretability of SAR images. This paper presents a novel image fusion method based on non-subsampled shearlet transform and activity measure to fuse SAR images with multispectral images, whose aim is to improve the interpretation ability of SAR images easily obtained at any time, rather than producing a fused image containing more information, which is the pursuit of previous fusion methods. Three different sensors, together with different working frequencies, polarization modes and spatial resolution SAR datasets, are used to evaluate the proposed method. Both visual evaluation and statistical analysis are performed, the results show that satisfactory fusion results are achieved through the proposed method and the interpretation ability of SAR images is effectively improved compared with the previous methods. [ABSTRACT FROM AUTHOR]

Traditionally, the assessment of heavy metal concentrations using remote sensing technology is sample-intensive, with expensive model development. Using a mining area case study of Daxigou, China, we propose a cross-time-domain transfer learning model to monitor heavy metal pollution using samples collected from different time domains. Specifically, spectral indices derived from Landsat 8 multispectral images, terrain, and other auxiliary data correlative to soil heavy metals were prepared. A cross time-domain sample transfer learning model proposed in the paper based on the TrAdaBoost algorithm was used for the Cu content mapping in the topsoil by selective use of soil samples acquired in 2017 and 2019. We found that the proposed model accurately estimated the concentration of Cu in the topsoil of the mining area in 2019 and performed better than the traditional TrAdaBoost algorithms. The goodness of fit (R2) of the test set increased from 0.55 to 0.66; the relative prediction deviation (RPD) increased from 1.37 to 1.76; and finally, the root-mean-square deviation (RMSE), decreased from 8.33 to 7.24 mg·kg−1. The proposed model is potentially applicable to more accurate and inexpensive monitoring of heavy metals, facilitating remediation-related efforts. [ABSTRACT FROM AUTHOR]

Remote sensing datasets usually have a wide range of spatial and spectral resolutions. They provide unique advantages in surveillance systems, and many government organizations use remote sensing multispectral imagery to monitor security-critical infrastructures or targets. Artificial Intelligence (AI) has advanced rapidly in recent years and has been widely applied to remote image analysis, achieving state-of-the-art (SOTA) performance. However, AI models are vulnerable and can be easily deceived or poisoned. A malicious user may poison an AI model by creating a stealthy backdoor. A backdoored AI model performs well on clean data but behaves abnormally when a planted trigger appears in the data. Backdoor attacks have been extensively studied in machine learning-based computer vision applications with natural images. However, much less research has been conducted on remote sensing imagery, which typically consists of many more bands in addition to the red, green, and blue bands found in natural images. In this paper, we first extensively studied a popular backdoor attack, BadNets, applied to a remote sensing dataset, where the trigger was planted in all of the bands in the data. Our results showed that SOTA defense mechanisms, including Neural Cleanse, TABOR, Activation Clustering, Fine-Pruning, GangSweep, Strip, DeepInspect, and Pixel Backdoor, had difficulties detecting and mitigating the backdoor attack. We then proposed an explainable AI-guided backdoor attack specifically for remote sensing imagery by placing triggers in the image sub-bands. Our proposed attack model even poses stronger challenges to these SOTA defense mechanisms, and no method was able to defend it. These results send an alarming message about the catastrophic effects the backdoor attacks may have on satellite imagery. [ABSTRACT FROM AUTHOR]

Hyperspectral remote sensing images typically have mixed rather than pure pixels. Endmember extraction aims to find a group of endmembers to represent the original image. In fact, the amount of endmembers is not easily determined in the existing endmember extraction studies.It requires several separate and laborious runs in order to produce results for endmember extraction with varying numbers of endmembers. There is also a correlation between the individual runs, which should be taken into account to accelerate algorithm convergence and improve accuracy. In this paper, an evolutionary competition multitasking optimization method (CMTEE) is proposed to achieve endmember extraction. In the proposed method, endmember extraction problems with different numbers of endmembers are considered as a group of optimization tasks. Specially, these tasks are assumed to be competitive. Then, online resource allocation is employed to assign suitable computational resources to the considered tasks. Experiments on simulated and real hyperspectral datasets demonstrated the effectiveness of the proposed evolutionary competition multitasking optimization method for endmember extraction. [ABSTRACT FROM AUTHOR]

Although the fusion of multispectral (MS) and hyperspectral (HS) images in remote sensing has become relatively mature, and different types of fusion methods have their own characteristics in terms of fusion effect, data dependency, and computational efficiency, few studies have focused on the impact of radiance extreme areas, which widely exist in real remotely sensed scenes. To this end, this paper proposed a novel method called radiance extreme area compensation fusion (RECF). Based on the architecture of spectral unmixing fusion, our method uses the reconstruction of error map to construct local smoothing constraints during unmixing and utilizes the nearest-neighbor multispectral data to achieve optimal replacement compensation, thereby eliminating the impact of overexposed and underexposed areas in hyperspectral data on the fusion effect. We compared the RECF method with 11 previous published methods on three sets of airborne hyperspectral datasets and HJ2 satellite hyperspectral data and quantitatively evaluated them using 5 metrics, including PSNR and SAM. On the test dataset with extreme radiance interference, the proposed RECF method achieved well in the overall evaluation results; for instance, the PSNR metric reached 47.6076 and SAM reached 0.5964 on the Xiong'an dataset. In addition, the result shows that our method also achieved better visual effects on both simulation and real datasets. [ABSTRACT FROM AUTHOR]

The accurate estimation of forest aboveground biomass is of great significance for forest management and carbon balance monitoring. Remote sensing instruments have been widely applied in forest parameters inversion with wide coverage and high spatiotemporal resolution. In this paper, the capability of different remote-sensed imagery was investigated, including multispectral images (GaoFen-6, Sentinel-2 and Landsat-8) and various SAR (Synthetic Aperture Radar) data (GaoFen-3, Sentinel-1, ALOS-2), in aboveground forest biomass estimation. In particular, based on the forest inventory data of Hangzhou in China, the Random Forest (RF), Convolutional Neural Network (CNN) and Convolutional Neural Networks Long Short-Term Memory Networks (CNN-LSTM) algorithms were deployed to construct the forest biomass estimation models, respectively. The estimate accuracies were evaluated under the different configurations of images and methods. The results show that for the SAR data, ALOS-2 has a higher biomass estimation accuracy than the GaoFen-3 and Sentinel-1. Moreover, the GaoFen-6 data is slightly worse than Sentinel-2 and Landsat-8 optical data in biomass estimation. In contrast with the single source, integrating multisource data can effectively enhance accuracy, with improvements ranging from 5% to 10%. The CNN-LSTM generally performs better than CNN and RF, regardless of the data used. The combination of CNN-LSTM and multisource data provided the best results in this case and can achieve the maximum R2 value of up to 0.74. It was found that the majority of the biomass values in the study area in 2018 ranged from 60 to 90 Mg/ha, with an average value of 64.20 Mg/ha. [ABSTRACT FROM AUTHOR]

Light Detection and Ranging (LiDAR) is a well-established active technology for the direct acquisition of 3D data. In recent years, the geometric information collected by LiDAR sensors has been widely combined with optical images to provide supplementary spectral information to achieve more precise results in diverse remote sensing applications. The emergence of active Multispectral LiDAR (MSL) systems, which operate on different wavelengths, has recently been revolutionizing the simultaneous acquisition of height and intensity information. So far, MSL technology has been successfully applied for fine-scale mapping in various domains. However, a comprehensive review of this modern technology is currently lacking. Hence, this study presents an exhaustive overview of the current state-of-the-art in MSL systems by reviewing the latest technologies for MSL data acquisition. Moreover, the paper reports an in-depth analysis of the diverse applications of MSL, spanning across fields of "ecology and forestry", "objects and Land Use Land Cover (LULC) classification", "change detection", "bathymetry", "topographic mapping", "archaeology and geology", and "navigation". Our systematic review uncovers the potentials, opportunities, and challenges of the recently emerged MSL systems, which integrate spatial–spectral data and unlock the capability for precise multi-dimensional (nD) mapping using only a single-data source. [ABSTRACT FROM AUTHOR]

The current image generative models have achieved a remarkably realistic image quality, offering numerous academic and industrial applications. However, to ensure these models are used for benign purposes, it is essential to develop tools that definitively detect whether an image has been synthetically generated. Consequently, several detectors with excellent performance in computer vision applications have been developed. However, these detectors cannot be directly applied as they areto multi-spectral satellite images, necessitating the training of new models. While two-class classifiers generally achieve high detection accuracies, they struggle to generalize to image domains and generative architectures different from those encountered during training. In this paper, we propose a one-class classifier based on Vector Quantized Variational Autoencoder 2 (VQ-VAE 2) features to overcome the limitations of two-class classifiers. We start by highlighting the generalization problem faced by binary classifiers. This was demonstrated by training and testing an EfficientNet-B4 architecture on multiple multi-spectral datasets. We then illustrate that the VQ-VAE 2-based classifier, which was trained exclusively on pristine images, could detect images from different domains and generated by architectures not encountered during training. Finally, we conducted a head-to-head comparison between the two classifiers on the same generated datasets, emphasizing the superior generalization capabilities of the VQ-VAE 2-based detector, wherewe obtained a probability of detection at a 0.05 false alarm rate of 1 for the blue and red channels when using the VQ-VAE 2-based detector, and 0.72 when we used the EfficientNet-B4 classifier. [ABSTRACT FROM AUTHOR]

The ecological environment is the basis of human survival and development. Effective methods to monitor the ecological environment are essential for the healthy development of human settlements. At present, methods based on remote sensing images and other basic data have played key roles in ecological environment monitoring, providing support for decision-making on local ecological environment protection. However, these data and methods have obvious limitations. On the one hand, they cannot reflect the feelings of human beings about the ecological environment in which they live. On the other hand, it is difficult to capture more detailed information about the ecological environment. Non-professional observation data represented by social media describe the ecological environment from the perspective of the public, which can be a powerful supplement to traditional data. However, these different data sources have their own characteristics and forms, and it is difficult to achieve efficient integration. Therefore, in this paper, we proposed a framework that comprehensively considers social media, remote sensing, and other data to monitor the ecological environment of a study area. First, the framework extracted the ecological environment-related information contained in social media data, including public sentiment information and topic keyword information, by integrating algorithms such as natural language processing and machine learning. Then, we constructed a social semantic network related to the ecological environment based on the extracted information. We used a remote sensing image and other basic data to analyze the ecological sensitivity in the study area. Finally, based on the keyword with spatial location attribute contained in the social semantic network, we established the link between the constructed network and the results of ecological sensitivity analysis to comprehensively analyze the ecological environment in the study area. The comprehensive analysis results not only reflect the distribution of ecological vulnerability in the study area, but also help identify specific areas worthy of attention and the ecological problems faced by these areas. We used the city of Sanya in China as a case study to verify the effectiveness of the method in this paper. [ABSTRACT FROM AUTHOR]

In deep learning-based hyperspectral remote sensing image classification tasks, random sampling strategies are typically used to train model parameters for testing and evaluation. However, this approach leads to strong spatial autocorrelation between the training set samples and the surrounding test set samples, and some unlabeled test set data directly participate in the training of the network. This leaked information makes the model overly optimistic. Models trained under these conditions tend to overfit to a single dataset, which limits the range of practical applications. This paper analyzes the causes and effects of information leakage and summarizes the methods from existing models to mitigate the effects of information leakage. Specifically, this paper states the main issues in this area, where the issue of information leakage is addressed in detail. Second, some algorithms and related models used to mitigate information leakage are categorized, including reducing the number of training samples, using spatially disjoint sampling strategies, few-shot learning, and unsupervised learning. These models and methods are classified according to the sample-related phase and the feature extraction phase. Finally, several representative hyperspectral image classification models experiments are conducted on the common datasets and their effectiveness in mitigating information leakage is analyzed. [ABSTRACT FROM AUTHOR]

Building change detection is an important task in the remote sensing field, and the powerful feature extraction ability of the deep neural network model shows strong advantages in this task. However, the datasets used for this study are mostly three-band high-resolution remote sensing images from a single data source, and few spectral features limit the development of building change detection from multisource remote sensing images. To investigate the influence of spectral and texture features on the effect of building change detection based on deep learning, a multisource building change detection dataset (MS-HS BCD dataset) is produced in this paper using GF-1 high-resolution remote sensing images and Sentinel-2B multispectral remote sensing images. According to the different resolutions of each Sentinel-2B band, eight different multisource spectral data combinations are designed, and six advanced network models are selected for the experiments. After adding multisource spectral and texture feature data, the results show that the detection effects of the six networks improve to different degrees. Taking the MSF-Net network as an example, the F1-score and IOU improved by 0.67% and 1.09%, respectively, compared with high-resolution images, and by 7.57% and 6.21% compared with multispectral images. [ABSTRACT FROM AUTHOR]

This article aims to present the methods of the radiometric correction of multispectral images—a short review of the existing techniques. The role of radiometric correction is essential to many applications, especially in precision farming, forestry, and climate analysis. Moreover, this paper presents a new relative approach, which considers the angle of inclination of the terrain and the angle of incidence of electromagnetic radiation on the imaged objects when obtaining the baseline data. This method was developed for data obtained from low altitudes—for imagery data acquired by sensors mounted on UAV platforms. The paper analyses the effect of the correction on the spectral information, i.e., the compatibility of the spectral reflection characteristics obtained from the image with the spectral reflection characteristics obtained in the field. The developed method of correction for multispectral data obtained from low altitudes allows for the mapping of spectral reflection characteristics to an extent that allows for the classification of terrestrial coverage with an accuracy of over 95%. In addition, it is possible to distinguish objects that are very similar in terms of spectral reflection characteristics. This research presents a new method of correction of each spectral channel obtained by the multispectral camera, increasing the accuracy of the results obtained, e.g., based on SAM coefficients or correlations, but also when distinguishing land cover types during classification. The results are characterized by high accuracy (over 94% in classification). [ABSTRACT FROM AUTHOR]

Marine oil spills can cause serious damage to marine ecosystems and biological species, and the pollution is difficult to repair in the short term. Accurate oil type identification and oil thickness quantification are of great significance for marine oil spill emergency response and damage assessment. In recent years, hyperspectral remote sensing technology has become an effective means to monitor marine oil spills. The spectral and spatial features of oil spill images at different levels are different. To accurately identify oil spill types and quantify oil film thickness, and perform better extraction of spectral and spatial features, a multilevel spatial and spectral feature extraction network is proposed in this study. First, the graph convolutional neural network and graph attentional neural network models were used to extract spectral and spatial features in non-Euclidean space, respectively, and then the designed modules based on 2D expansion convolution, depth convolution, and point convolution were applied to extract feature information in Euclidean space; after that, a multilevel feature fusion method was developed to fuse the obtained spatial and spectral features in Euclidean space in a complementary way to obtain multilevel features. Finally, the multilevel features were fused at the feature level to obtain the oil spill information. The experimental results show that compared with CGCNN, SSRN, and A2S2KResNet algorithms, the accuracy of oil type identification and oil film thickness classification of the proposed method in this paper is improved by 12.82%, 0.06%, and 0.08% and 2.23%, 0.69%, and 0.47%, respectively, which proves that the method in this paper can effectively extract oil spill information and identify different oil spill types and different oil film thicknesses. [ABSTRACT FROM AUTHOR]

The fusion of hyperspectral imagery (HSI) and light detection and ranging (LiDAR) data for classification has received widespread attention and has led to significant progress in research and remote sensing applications. However, existing common CNN architectures suffer from the significant drawback of not being able to model remote sensing images globally, while transformer architectures are not able to capture local features effectively. To address these bottlenecks, this paper proposes a classification framework for multisource remote sensing image fusion. First, a spatial and spectral feature projection network is constructed based on parallel feature extraction by combining HSI and LiDAR data, which is conducive to extracting joint spatial, spectral, and elevation features from different source data. Furthermore, in order to construct local–global nonlinear feature mapping more flexibly, a network architecture coupling together multiscale convolution and a multiscale vision transformer is proposed. Moreover, a plug-and-play nonlocal feature token aggregation module is designed to adaptively adjust the domain offsets between different features, while a class token is employed to reduce the complexity of high-dimensional feature fusion. On three open-source remote sensing datasets, the performance of the proposed multisource fusion classification framework improves about 1% to 3% over other state-of-the-art algorithms. [ABSTRACT FROM AUTHOR]

Ionospheric scintillation often occurs in the polar and equator regions, and it can affect the signals of the Global Navigation Satellite System (GNSS). Therefore, the ionospheric scintillation detection applied to the polar and equator regions is of vital importance for improving the performance of satellite navigation. GNSS radio occultation is a remote sensing technique that primarily utilizes GNSS signals to study the Earth's atmosphere, but its measurement results are susceptible to the effects of ionospheric scintillation. In this study, we propose an ionospheric scintillation detection algorithm based on the Sparrow-Search-Algorithm-optimized Extreme Gradient Boosting model (SSA-XGBoost), which uses power spectral densities of the raw signal intensities from GNSS occultation data as input features to train the algorithm model. To assess the performance of the proposed algorithm, we compare it with other machine learning algorithms such as XGBoost and a Support Vector Machine (SVM) using historical ionospheric scintillation data. The results show that the SSA-XGBoost method performs much better compared to the SVM and XGBoost models, with an overall accuracy of 97.8% in classifying scintillation events and a miss detection rate of only 12.9% for scintillation events with an unbalanced GNSS RO dataset. This paper can provide valuable insights for designing more robust GNSS receivers. [ABSTRACT FROM AUTHOR]

Multispectral image (MSI) and hyperspectral image (HSI) fusion (MHIF) aims to address the challenge of acquiring high-resolution (HR) HSI images. This field combines a low-resolution (LR) HSI with an HR-MSI to reconstruct HR-HSIs. Existing methods directly utilize transformers to perform feature extraction and fusion. Despite the demonstrated success, there exist two limitations: (1) Employing the entire transformer model for feature extraction and fusion fails to fully harness the potential of the transformer in integrating the spectral information of the HSI and spatial information of the MSI. (2) HSIs have a strong spectral correlation and exhibit sparsity in the spatial domain. Existing transformer-based models do not optimize this physical property, which makes their methods prone to spectral distortion. To accomplish these issues, this paper introduces a novel framework for MHIF called a Sparse Mix-Attention Transformer (SMAformer). Specifically, to fully harness the advantages of the transformer architecture, we propose a Spectral Mix-Attention Block (SMAB), which concatenates the keys and values extracted from LR-HSIs and HR-MSIs to create a new multihead attention module. This design facilitates the extraction of detailed long-range information across spatial and spectral dimensions. Additionally, to address the spatial sparsity inherent in HSIs, we incorporated a sparse mechanism within the core of the SMAB called the Sparse Spectral Mix-Attention Block (SSMAB). In the SSMAB, we compute attention maps from queries and keys and select the K highly correlated values as the sparse-attention map. This approach enables us to achieve a sparse representation of spatial information while eliminating spatially disruptive noise. Extensive experiments conducted on three synthetic benchmark datasets, namely CAVE, Harvard, and Pavia Center, demonstrate that the SMAformer method outperforms state-of-the-art methods. [ABSTRACT FROM AUTHOR]

This paper presents the MSSFF (multistage spectral–spatial feature fusion) framework, which introduces a novel approach for semantic segmentation from hyperspectral imagery (HSI). The framework aims to simplify the modeling of spectral relationships in HSI sequences and unify the architecture for semantic segmentation of HSIs. It incorporates a spectral–spatial feature fusion module and a multi-attention mechanism to efficiently extract hyperspectral features. The MSSFF framework reevaluates the potential impact of spectral and spatial features on segmentation models and leverages the spectral–spatial fusion module (SSFM) in the encoder component to effectively extract and enhance these features. Additionally, an efficient Transformer (ET) is introduced in the skip connection part of deep features to capture long-term dependent features and extract global spectral–spatial information from the entire feature map. This highlights the significant potential of Transformers in modeling spectral–spatial feature maps within the context of hyperspectral remote sensing. Moreover, a spatial attention mechanism is adopted in the shallow skip connection part to extract local features. The framework demonstrates promising capabilities in hyperspectral remote sensing applications. The conducted experiments provide valuable insights for optimizing the model depth and the order of feature fusion, thereby contributing to the advancement of hyperspectral semantic segmentation research. [ABSTRACT FROM AUTHOR]

Deep learning (DL) has become increasingly popular in recent years, with researchers and businesses alike successfully applying it to a wide range of tasks. However, one challenge that DL faces in certain domains, such as remote sensing (RS), is the difficulty of creating large, well-annotated training datasets. This is due to the high cost of acquiring and labeling RS data. This challenge significantly limits the development of DL in RS. RS data can come from multiple sources, such as satellites, airplanes, and drones, and use different sensor technologies. Training DL models on data from one source may not produce the same accuracy on data from other sources, even if they cover the same region. Transfer learning (TL) can help to address this challenge by relaxing the requirement for large training datasets. Specifically, TL allows us to train a model on data from one source and then adapt it to data from another source, even with fewer training data. This makes TL a promising approach for solving both the problem of multisource adaptation and the problem of insufficient training data in the target domain. This paper evaluates the homogenous and heterogeneous TL approach that addresses model transfer across different domains. Transfer gain is measured through specific statistical metrics such as precision, kappa, recall, and F1-score, and a positive gain is empirically shown in the vast majority of cases. The proposed method is evaluated on the challenging task of Multispectral RS image (MSI) classification due to the complexity and variety of natural scenes. This work is examined in terms of its social, economic, and environmental consequences. Additionally, potential future directions for research and the achievement of established goals are explored. [ABSTRACT FROM AUTHOR]

Maize is one of the important grain crops grown globally, and growth will directly affect its yield and quality, so it is important to monitor maize growth efficiently and non-destructively. To facilitate the use of unmanned aerial vehicles (UAVs) for maize growth monitoring, comprehensive growth indicators for maize monitoring based on multispectral remote sensing imagery were established. First of all, multispectral image data of summer maize canopy were collected at the jointing stage, and meanwhile, leaf area index (LAI), relative chlorophyll content (SPAD), and plant height (VH) were measured. Then, the comprehensive growth monitoring indicators CGMICV and CGMICR for summer maize were constructed by the coefficient of variation method and the CRITIC weighting method. After that, the CGMICV and CGMICR prediction models were established by the partial least-squares (PLSR) and sparrow search optimization kernel extremum learning machine (SSA-KELM) using eight typical vegetation indices selected. Finally, a comparative analysis was performed using ground-truthing data, and the results show: (1) For CGMICV, the R2 and RMSE of the model built by SSA-KELM are 0.865 and 0.040, respectively. Compared to the model built by PLSR, R2 increased by 4.5%, while RMSE decreased by 0.3%. For CGMICR, the R2 and RMSE of the model built by SSA-KELM are 0.885 and 0.056, respectively. Compared to the other model, R2 increased by 4.6%, and RMSE decreased by 2.8%. (2) Compared to the models by single indicator, among the models constructed based on PLSR, the CGMICR model had the highest R2. In the models constructed based on SSA-KELM, the R2 of models by the CGMICR and CGMICV were larger than that of the models by SPAD (R2 = 0.837), while smaller than that of the models by LAI (R2 = 0.906) and models by VH (R2 = 0.902). In summary, the comprehensive growth monitoring indicators prediction model established in this paper is effective and can provide technical support for maize growth monitoring. [ABSTRACT FROM AUTHOR]

Geochemical data can reflect geological features, making it one of the basic types of geodata that have been widely used in mineral exploration, environmental assessment, resource potential analysis and other research. However, final decisions regarding activities are often limited by the spatial accuracy of geochemical data. Geochemical sampling is sometimes difficult to conduct because of harsh natural and geographic conditions (e.g., mountainous areas with high altitude and complex terrain), meaning that only medium/low-precision survey data could be obtained, which may not be adequate for regional geochemical mapping and exploration. Modern techniques such as remote sensing could be used to address this issue. In recent decades, the development of remote sensing technology has provided a huge amount of earth observation data with high spatial, temporal and spectral resolutions. The advantage of rapid acquisition of spatial and spectral information of large areas has promoted the broad use of remote sensing data in geoscientific research. Remote sensing data can help to differentiate various ground features by recording the electromagnetic response of the surface to solar radiation. Many problems that occur during the process of fusing remote sensing and geochemical data have been reported, such as the feasibility of existing fusion methods and low fusion accuracies that are less useful in practice. In this paper, a new strategy for integrating geochemical data and remote sensing data (referred to as ASTER data) is proposed; this strategy is achieved through linear regression as well as random forest and support vector regression algorithms. The results show that support vector regression can obtain better results for the available data sets and prove that the strategy currently proposed can effectively support the fusion of high-spatial-resolution remote sensing data (15 m) and low-spatial-resolution geochemical data (2000 m) in wide-range accurate geochemical applications (e.g., lithological identification and geochemical exploration). [ABSTRACT FROM AUTHOR]

Corn is an important food crop worldwide, and its yield is directly related to Chinese food security. Accurate remote sensing extraction of corn can realize the rational application of land resources, which is of great significance to the sustainable development of modern agriculture. In the field of large-scale crop remote sensing classification, single-period optical remote sensing images often cannot achieve high-precision classification. To improve classification accuracy, multiple time series image combinations have gradually been adopted. However, due to the influence of cloudy and rainy weather, it is often difficult to obtain complete time series optical images. Synthetic aperture radar (SAR) data are imaged by microwaves, which have strong penetrating power and are not affected by clouds. A critical way to solve this problem is to use SAR images to compensate for the lack of optical images and obtain a complete time series image in the corn-growing season. However, SAR images have limited wavelengths and cannot provide important wavelengths, such as visible light bands and near-infrared information. To solve this problem, this study took Zhaodong City, a vital corn-planting base in China, as the research area; took GF-6/GF-3 and Sentinel-1/Sentinel-2 as remote sensing data sources; designed12 classification scenarios; analyzed the best classification period and the best time series combination of corn classification; studied the influence of SAR images on the classification results of time series images; and compared the classification differences between GF-6/GF-3 and Sentinel-1/Sentinel-2. The results show that the classification accuracy of time series combinations is much higher than that of single-period images. The polarization characteristics of SAR images can improve the classification accuracy with time series images. The classification accuracy of GF series images from China is obviously higher than that of Sentinel series images. The research performed in this paper can provide a reference for agricultural classification by using remote sensing data. [ABSTRACT FROM AUTHOR]