Search

This document is a summary of a special issue on advanced machine learning and deep learning techniques for remote sensing. The issue includes 16 research papers that cover a range of topics, including hyperspectral image classification, moving point target detection, radar echo extrapolation, and remote sensing object detection. Each paper introduces a novel approach or model and provides extensive testing and evaluation to demonstrate its effectiveness. The insights shared in this special issue are expected to contribute to future advancements in artificial intelligence-based remote sensing research. [Extracted from the article]

Side-scan sonar plays a crucial role in underwater exploration, and the autonomous detection of side-scan sonar images is vital for detecting unknown underwater environments. However, due to the complexity of the underwater environment, the presence of a few highlighted areas on the targets, blurred feature details, and difficulty in collecting data from side-scan sonar, achieving high-precision autonomous target recognition in side-scan sonar images is challenging. This article addresses this problem by improving the You Only Look Once v7 (YOLOv7) model to achieve high-precision object detection in side-scan sonar images. Firstly, given that side-scan sonar images contain large areas of irrelevant information, this paper introduces the Swin-Transformer for dynamic attention and global modeling, which enhances the model's focus on the target regions. Secondly, the Convolutional Block Attention Module (CBAM) is utilized to further improve feature representation and enhance the neural network model's accuracy. Lastly, to address the uncertainty of geometric features in side-scan sonar target features, this paper innovatively incorporates a feature scaling factor into the YOLOv7 model. The experiment initially verified the necessity of attention mechanisms in the public dataset. Subsequently, experiments on our side-scan sonar (SSS) image dataset show that the improved YOLOv7 model has 87.9% and 49.23% in its average accuracy ( m A P 0.5 ) and ( m A P 0.5:0.95), respectively. These results are 9.28% and 8.41% higher than the YOLOv7 model. The improved YOLOv7 algorithm proposed in this paper has great potential for object detection and the recognition of side-scan sonar images. [ABSTRACT FROM AUTHOR]

Visual object tracking is a key technology that is used in unmanned aerial vehicles (UAVs) to achieve autonomous navigation. In recent years, with the rapid development of deep learning, tracking algorithms based on Siamese neural networks have received widespread attention. However, because of complex and diverse tracking scenarios, as well as limited computational resources, most existing tracking algorithms struggle to ensure real-time stable operation while improving tracking performance. Therefore, studying efficient and fast-tracking frameworks, and enhancing the ability of algorithms to respond to complex scenarios has become crucial. Therefore, this paper proposes a cross-parallel attention and efficient match transformer for aerial tracking (SiamEMT). Firstly, we carefully designed the cross-parallel attention mechanism to encode global feature information and to achieve cross-dimensional interaction and feature correlation aggregation via parallel branches, highlighting feature saliency and reducing global redundancy information, as well as improving the tracking algorithm's ability to distinguish between targets and backgrounds. Meanwhile, we implemented an efficient match transformer to achieve feature matching. This network utilizes parallel, lightweight, multi-head attention mechanisms to pass template information to the search region features, better matching the global similarity between the template and search regions, and improving the algorithm's ability to perceive target location and feature information. Experiments on multiple drone public benchmark tests verified the accuracy and robustness of the proposed tracker in drone tracking scenarios. In addition, on the embedded artificial intelligence (AI) platform AGX Xavier, our algorithm achieved real-time tracking speed, indicating that our algorithm can be effectively applied to UAV tracking scenarios. [ABSTRACT FROM AUTHOR]

Generative adversarial networks (or GANs) are a specific deep learning architecture often used for different usages, such as data generation or image-to-image translation. In recent years, this structure has gained increased popularity and has been used in different fields. One area of expertise currently in vogue is the use of GANs to produce synthetic aperture radar (SAR) data, and especially expand training datasets for SAR automatic target recognition (ATR). In effect, the complex SAR image formation makes these kind of data rich in information, leading to the use of deep networks in deep learning-based methods. Yet, deep networks also require sufficient data for training. However, contrary to optical images, we generally do not have a substantial number of available SAR images because of their acquisition and labelling cost; GANs are then an interesting tool. Concurrently, how to improve explainability for SAR ATR deep neural networks and how to make their reasoning more transparent have been increasingly explored as model opacity deteriorates trust of users. This paper aims at reviewing how GANs are used with SAR images, but also giving perspectives on how GANs could be used to improve interpretability and explainability of SAR classifiers. [ABSTRACT FROM AUTHOR]

Floods are among the most common disasters, causing loss of life and enormous damage to private property and public infrastructure. Monitoring systems that detect and predict floods help respond quickly in the pre-disaster phase to prevent and mitigate flood risk and damages. Thus, this paper presents a deep neural network (DNN)-based real-time flood monitoring system for embedded Internet of Things (IoT) edge devices. The proposed system fuses long-wave infrared (LWIR) and RGB cameras to overcome a critical drawback of conventional RGB camera-based systems: severe performance deterioration at night. This system recognizes areas occupied by water using a DNN-based semantic segmentation network, whose input is a combination of RGB and LWIR images. Flood warning levels are predicted based on the water occupancy ratio calculated by the water segmentation result. The warning information is delivered to authorized personnel via a mobile message service. For real-time edge computing, the heavy semantic segmentation network is simplified by removing unimportant channels while maintaining performance by utilizing the network slimming technique. Experiments were conducted based on the dataset acquired from the sensor module with RGB and LWIR cameras installed in a flood-prone area. The results revealed that the proposed system successfully conducts water segmentation and correctly sends flood warning messages in both daytime and nighttime. Furthermore, all of the algorithms in this system were embedded on an embedded IoT edge device with a Qualcomm QCS610 System on Chip (SoC) and operated in real time. [ABSTRACT FROM AUTHOR]

Forest biomass estimation is undoubtedly one of the most pressing research subjects at present. Combining multi-source remote sensing information can give full play to the advantages of different remote sensing technologies, providing more comprehensive and rich information for aboveground biomass (AGB) estimation research. Based on Landsat 8, Sentinel-2A, and ALOS2 PALSAR data, this paper takes the artificial coniferous forests in the Saihanba Forest of Hebei Province as the object of study, fully explores and establishes remote sensing factors and information related to forest structure, gives full play to the advantages of spectral signals in detecting the horizontal structure and multi-dimensional synthetic aperture radar (SAR) data in detecting the vertical structure, and combines environmental factors to carry out multivariate synergistic methods of estimating the AGB. This paper uses three variable selection methods (Pearson correlation coefficient, random forest significance, and the least absolute shrinkage and selection operator (LASSO)) to establish the variable sets, combining them with three typical non-parametric models to estimate AGB, namely, random forest (RF), support vector regression (SVR), and artificial neural network (ANN), to analyze the effect of forest structure on biomass estimation, explore the suitable AGB of artificial coniferous forests estimation of machine learning models, and develop the method of quantifying saturation value of the combined variables. The results show that the horizontal structure is more capable of explaining the AGB compared to the vertical structure information, and that combining the multi-structure information can improve the model results and the saturation value to a great extent. In this study, different sets of variables can produce relatively superior results in different models. The variable set selected using LASSO gives the best results in the SVR model, with an R 2 values of 0.9998 and 0.8792 for the training and the test set, respectively, and the highest saturation value obtained is 185.73 t/ha, which is beyond the range of the measured data. The problem of saturation in biomass estimation in boreal medium- and high-density forests was overcome to a certain extent, and the AGB of the Saihanba area was better estimated. [ABSTRACT FROM AUTHOR]

The accurate prediction of heavy precipitation in convective environments is crucial because such events, often occurring in Italy during the summer and fall seasons, can be a threat for people and properties. In this paper, we analyse the impact of satellite-derived surface-rainfall-rate data assimilation on the Weather Research and Forecasting (WRF) model's precipitation prediction, considering 15 days in summer 2022 and 17 days in fall 2022, where moderate to intense precipitation was observed over Italy. A 3DVar realised at CNR-ISAC (National Research Council of Italy, Institute of Atmospheric Sciences and Climate) is used to assimilate two different satellite-derived rain rate products, both exploiting geostationary (GEO), infrared (IR), and low-Earth-orbit (LEO) microwave (MW) measurements: One is based on an artificial neural network (NN), and the other one is the operational P-IN-SEVIRI-PMW product (H60), delivered in near-real time by the EUMETSAT HSAF (Satellite Application Facility in Support of Operational Hydrology and Water Management). The forecast is verified in two periods: the hours from 1 to 4 (1–4 h phase) and the hours from 3 to 6 (3–6 h phase) after the assimilation. The results show that the rain rate assimilation improves the precipitation forecast in both seasons and for both forecast phases, even if the improvement in the 3–6 h phase is found mainly in summer. The assimilation of H60 produces a high number of false alarms, which has a negative impact on the forecast, especially for intense events (30 mm/3 h). The assimilation of the NN rain rate gives more balanced predictions, improving the control forecast without significantly increasing false alarms. [ABSTRACT FROM AUTHOR]

Deep neural networks have achieved remarkable results in the field of polarimetric synthetic aperture radar (PolSAR) image classification. However, PolSAR is affected by speckle imaging, resulting in PolSAR images usually containing a large amount of speckle noise, which usually leads to the poor spatial consistency of classification results and insufficient classification accuracy. Semantic segmentation methods based on deep learning can realize the task of image segmentation and classification at the same time, producing fine-grained and smooth classification maps. However, these approaches require enormous labeled data sets, which are laborious and time-consuming. Due to these issues, a new multi-modal contrastive fully convolutional network, named MCFCN, is proposed for PolSAR image classification in this paper, which combines multi-modal features of the same pixel as inputs to the model based on a fully convolutional network and accomplishes the classification task using only a small amount of labeled data through contrastive learning. In addition, to describe the PolSAR terrain targets more comprehensively and enhance the robustness of the classifier, a pixel overlapping classification strategy is proposed, which can not only improve the classification accuracy effectively but also enhance the stability of the method. The experiments demonstrate that compared with existing classification methods, the classification results of the proposed method for three real PolSAR datasets have higher classification accuracy. [ABSTRACT FROM AUTHOR]

In recent years, the detection performance of SAR-GMTI (synthetic aperture radar-ground moving target indication) algorithm based on deep learning has always been limited by insufficient measured data due to the heavy operation complexity and high cost of real SAR systems. To solve this problem, this paper proposes an overall DT-based implementation framework for SAR ground moving target intelligent detection tasks. In particular, by virtue of a SAR imaging algorithm, a high-fidelity twin replica of SAR moving targets is established in digital space through parameter traversal based on the prior target characteristics of the obtained measured datasets. Then, the constructed SAR twin datasets is fed into the neural network model to train an intelligent detector by fully learning features of the moving targets and preset the SAR scene in the twin space, which can realize the robust detection of ground moving targets in related practical scenarios with no need for multiple and complex field experiments. Moreover, the effectiveness of the proposed framework is verified on the MiniSAR measured system, and a comparison with traditional CFAR detection method is given simultaneously. [ABSTRACT FROM AUTHOR]

Efficient and effective radar emitter recognition is critical for electronic support measurement (ESM) systems. However, in complex electromagnetic environments, intercepted pulse trains generally contain substantial data noise, including spurious and missing pulses. Currently, radar emitter recognition methods utilizing traditional artificial neural networks (ANNs) like CNNs and RNNs are susceptible to data noise and require intensive computations, posing challenges to meeting the performance demands of modern ESM systems. Spiking neural networks (SNNs) exhibit stronger representational capabilities compared to traditional ANNs due to the temporal dynamics of spiking neurons and richer information encoded in precise spike timing. Furthermore, SNNs achieve higher computational efficiency by performing event-driven sparse addition calculations. In this paper, a lightweight spiking neural network is proposed by combining direct coding, leaky integrate-and-fire (LIF) neurons, and surrogate gradients to recognize radar emitters. Additionally, an improved SNN for radar emitter recognition is proposed, leveraging the local timing structure of pulses to enhance adaptability to data noise. Simulation results demonstrate the superior performance of the proposed method over existing methods. [ABSTRACT FROM AUTHOR]

In this paper, a technology named SCM−ANN combining physical scattering mechanisms and artificial intelligence is proposed to realize radar cross-section (RCS) extrapolation of non-cooperative conductor targets with higher efficiency. Firstly, an adaptive scattering center (SC) extraction algorithm is used to construct the scattering center model (SCM) for non-cooperative targets from radar echoes in the low-frequency band (LFB). Secondly, an artificial neural network (ANN) is constructed to capture the nonlinear relationship between the real LFB echoes and those reconstructed from the SCM. Finally, the SCM is used to reconstruct echoes in the high-frequency band (HFB), and these reconstructions, together with the trained ANN, optimize the extrapolated HFB RCS. For the SCM−ANN technology, physical mechanistic modes are used for trend prediction, and artificial intelligence is used for regression optimization based on trend prediction. Simulation results show that the proposed method can achieve a 50% frequency extrapolation range, with an average prediction error reduction of up to 40% compared with the traditional scheme. By incorporating physical mechanisms, this proposed approach offers improved accuracy and an extended extrapolation range compared with the RCS extrapolation techniques relying solely on numerical prediction. [ABSTRACT FROM AUTHOR]

As the demand for spatial positioning continues to grow, positioning methods based on inertial measurement units (IMUs) are emerging as a promising research topic due to their low cost and robustness against environmental interference. These methods are particularly well suited for global navigation satellite system (GNSS)-denied environments and challenging visual scenarios. While existing algorithms for position estimation using IMUs have demonstrated some effectiveness, there is still significant room for improvement in terms of estimation accuracy. Current approaches primarily treat IMU data as simple time series, neglecting the frequency-domain characteristics of IMU signals. This paper emphasizes the importance of frequency-domain information in IMU signals and proposes a novel neural network, WINNet (Wavelet Inertial Neural Network), which integrates time- and frequency-domain signals using a wavelet transform for spatial positioning with inertial sensors. Additionally, we collected ground-truth data using a LiDAR setup and combined it with the TLIO dataset to form a new IMU spatial positioning dataset. The experimental results demonstrate that our proposed method outperforms the current state-of-the-art inertial neural network algorithms in terms of the ATE, RTE, and drift error metrics overall. [ABSTRACT FROM AUTHOR]

The anthropogenic climate crisis results in the gradual loss of tree species in locations where they were previously able to grow. This leads to increasing workloads and requirements for foresters and arborists as they are forced to restructure their forests and city parks. The advancements in computer vision (CV)—especially in supervised deep learning (DL)—can help cope with these new tasks. However, they rely on large, carefully annotated datasets to produce good and generalizable models. This paper presents BAMFORESTS: a dataset with 27,160 individually delineated tree crowns in 105 ha of very-high-resolution UAV imagery gathered with two different sensors from two drones. BAMFORESTS covers four areas of coniferous, mixed, and deciduous forests and city parks. The labels contain instance segmentations of individual trees, and the proposed splits are balanced by tree species and vitality. Furthermore, the dataset contains the corrected digital surface model (DSM), representing tree heights. BAMFORESTS is annotated in the COCO format and is especially suited for training deep neural networks (DNNs) to solve instance segmentation tasks. BAMFORESTS was created in the BaKIM project and is freely available under the CC BY 4.0 license. [ABSTRACT FROM AUTHOR]

The measurement of sea surface height (SSH), which is of great importance in the field of oceanography, can be obtained through the innovative technique of GNSS-R for remote sensing. This research utilizes the dataset from spaceborne GNSS-R platforms, the Cyclone Global Navigation Satellite System (CYGNSS) and FengYun-3E (FY-3E), as the primary source of data for retrieving sea surface height (SSH). The utilization of artificial neural networks (ANNs) allows for the accurate estimation of ocean surface height with a precision of meter-level accuracy throughout the period of 1–17 August 2022. As a traditional machine learning method, an ANN is employed to extract pertinent data features, facilitating the acquisition of precise sea surface height estimations. Additionally, separate models are devised for both GNSS-R platforms, one based on constant velocity (CV) and the other on constant acceleration (CA). The Interactive Multiple Model (IMM) is utilized as the main method to combine the four models and convert the likelihood of each model. The transition between the models allows the filters to effectively adapt to dynamic changes and complex environments. This approach relies on the fundamental notion of the Kalman filter (KF), which showcases robust noise handling capabilities in predicting the SSH, separately. The results demonstrate that the model interaction technology is capable of efficiently filtering and integrating SSH data, yielding a Root Mean Square Error (RMSE) of 1.03 m. This corresponds to a 9.84% enhancement compared to the retrieved height from CYGNSS and a 37.19% enhancement compared to the retrieved height from FY-3E. The model proposed in this paper provides a potential scheme for the GNSS-R data fusion of multiple platforms and multiple models. In the future, more data sources and more models can be added to achieve more accurate adaptive fusion. [ABSTRACT FROM AUTHOR]

In recent years, the use of deep neural network in effective network feature extraction and the design of efficient and high-precision hyperspectral image classification algorithms has gradually become a research hotspot for scholars. However, due to the difficulty of obtaining hyperspectral images and the high cost of annotation, the training samples are very limited. In order to cope with the small sample problem, researchers often deepen the network model and use the attention mechanism to extract features; however, as the network model continues to deepen, the gradient disappears, the feature extraction ability is insufficient, and the computational cost is high. Therefore, how to make full use of the spectral and spatial information in limited samples has gradually become a difficult problem. In order to cope with such problems, this paper proposes two-branch multiscale spatial–spectral feature aggregation with a self-attention mechanism for a hyperspectral image classification model (FHDANet); the model constructs a dense two-branch pyramid structure, which can achieve the high efficiency extraction of joint spatial–spectral feature information and spectral feature information, reduce feature loss to a large extent, and strengthen the model's ability to extract contextual information. A channel–space attention module, ECBAM, is proposed, which greatly improves the extraction ability of the model for salient features, and a spatial information extraction module based on the deep feature fusion strategy HLDFF is proposed, which fully strengthens feature reusability and mitigates the feature loss problem brought about by the deepening of the model. Compared with five hyperspectral image classification algorithms, SVM, SSRN, A2S2K-ResNet, HyBridSN, SSDGL, RSSGL and LANet, this method significantly improves the classification performance on four representative datasets. Experiments have demonstrated that FHDANet can better extract and utilise the spatial and spectral information in hyperspectral images with excellent classification performance under small sample conditions. [ABSTRACT FROM AUTHOR]

In this paper, we propose a method for efficient target classification based on the spatial features of the point cloud generated by using a high-resolution radar sensor. The frequency-modulated continuous wave radar sensor can estimate the distance and velocity of a target. In addition, the azimuth and elevation angle of the target can be estimated by using a multiple-input and multiple-output antenna system. Using the estimated distance, velocity, and angle, the 3D point cloud of target can be generated. From the generated point cloud, we extract the point cloud for each individual target using the density-based spatial clustering of application with noise method and a camera mounted on the radar sensor. Then, we define the convex hull boundaries that enclose these point clouds in both 3D and 2D spaces obtained by orthogonally projecting onto the x y , y z , and z x planes. Using the vertices of convex hull, we calculate the volume of the targets and the areas in 2D spaces. Several feature points, including the calculated spatial information, are numerized and configured into feature vectors. We design an uncomplicated deep neural network classifier based on minimal input information to achieve fast and efficient classification performance. As a result, the proposed method achieved an average accuracy of 97.1%, and the time required for training was reduced compared to the method using only point cloud data and the convolutional neural network-based method. [ABSTRACT FROM AUTHOR]

Water bodies can offer local microclimates that have the potential to attenuate the effects of urban heat islands by reducing local temperature. This capability is shaded when the river is channelized. In such cases, the river temperature rises during hot periods, leading to negative impacts on the water quality. The main aim of this paper is to develop a local simple model to predict the temperature of the Dâmbovița River at its exit from Bucharest City, the capital of Romania. The location is chosen based on the historical critical impacts, in terms of extreme heatwaves that took place during hot summers, as well as future possible risks due to climate change. The water temperature prediction model is based on an artificial neural network that uses the Levenberg–Marquardt algorithm, due to its stability and rapid convergence capabilities. The model forecasts, with an accuracy of ±1 °C, the water temperature in an ungauged, downstream location, as a function of measured air and upstream water temperatures. The proposed model represents a first attempt to provide water managers in Bucharest City with a useful tool that will allow them to take timely measures to counteract the unwanted effects that can be generated by high water temperatures. [ABSTRACT FROM AUTHOR]

In this paper, a lightweight deep neural network (DNN) for direction of arrival (DOA) estimation is proposed, of which the input vector is designed to remove data redundancy as well as remaining DOA information. By exploring the Vandermonde property of the steering vector of a uniform linear array (ULA), the size of the newly designed input vector is greatly reduced. Furthermore, the DOA estimation is designed as a regression problem instead of a classification problem; that is, the lightweight DNN designs the output vector as the estimated DOAs of sources, of which the size is much shorter than that of the spatial spectrum used as the output vector in the conventional DNN. The reductions in the sizes of input and output vectors lead to a reduction in the sizes of hidden layers, achieving lightweightness of the neural network. The analysis illustrates that when the number of sensors is 22, the number of parameters in the lightweight DNN is three orders of magnitude less than that in the conventional DNN. The simulation results demonstrate the lightweight DNN can provide high DOA estimation accuracy with the shortest testing time. It performs better than the conventional DNN. Furthermore, it is superior to traditional solutions such as the multiple signal classification (MUSIC) method and conventional beamforming (CBF) method in harsh conditions like low signal-to-noise ratios (SNRs), closely spaced sources, and few snapshots. [ABSTRACT FROM AUTHOR]

Oceanic targets, including ripples, islands, vessels, and coastlines, display distinct sparse characteristics, rendering the ocean a significant arena for sparse Synthetic Aperture Radar (SAR) imaging rooted in sparse signal processing. Deep neural networks (DNNs), a current research emphasis, have, when integrated with sparse SAR, attracted notable attention for their exceptional imaging capabilities and high computational efficiency. Yet, the efficiency of traditional unfolding techniques is impeded by their architecturally inefficient design, which curtails their information transmission capacity and consequently detracts from the quality of reconstruction. This paper unveils a novel Memory-Augmented Deep Unfolding Network (MADUN) for SAR imaging in marine environments. Our methodology harnesses the synergies between deep learning and algorithmic unfolding, enhanced with a memory component, to elevate SAR imaging's computational precision. At the heart of our investigation is the incorporation of High-Throughput Short-Term Memory (HSM) and Cross-Stage Long-Term Memory (CLM) within the MADUN framework, ensuring robust information flow across unfolding stages and solidifying the foundation for deep, long-term informational correlations. Our experimental results demonstrate that our strategy significantly surpasses existing methods in enhancing the reconstruction of sparse marine scenes. [ABSTRACT FROM AUTHOR]

In synthetic aperture radar (SAR) imaging, intelligent object detection methods are facing significant challenges in terms of model robustness and application security, which are posed by adversarial examples. The existing adversarial example generation methods for SAR object detection can be divided into two main types: global perturbation attacks and local perturbation attacks. Due to the dynamic changes and irregular spatial distribution of SAR coherent speckle backgrounds, the attack effectiveness of global perturbation attacks is significantly reduced by coherent speckle. In contrast, by focusing on the image objects, local perturbation attacks achieve targeted and effective advantages over global perturbations by minimizing interference from the SAR coherent speckle background. However, the adaptability of conventional local perturbations is limited because they employ a fixed size without considering the diverse sizes and shapes of SAR objects under various conditions. This paper presents a framework for region-adaptive local perturbations (RaLP) specifically designed for SAR object detection tasks. The framework consists of two modules. To address the issue of coherent speckle noise interference in SAR imagery, we develop a local perturbation generator (LPG) module. By filtering the original image, this module reduces the speckle features introduced during perturbation generation. It then superimposes adversarial perturbations in the form of local perturbations on areas of the object with weaker speckles, thereby reducing the mutual interference between coherent speckles and adversarial perturbation. To address the issue of insufficient adaptability in terms of the size variation in local adversarial perturbations, we propose an adaptive perturbation optimizer (APO) module. This optimizer adapts the size of the adversarial perturbations based on the size and shape of the object, effectively solving the problem of adaptive perturbation size and enhancing the universality of the attack. The experimental results show that RaLP reduces the detection accuracy of the YOLOv3 detector by 29.0%, 29.9%, and 32.3% on the SSDD, SAR-Ship, and AIR-SARShip datasets, respectively, and the model-to-model and dataset-to-dataset transferability of RaLP attacks are verified. [ABSTRACT FROM AUTHOR]

Hyperspectral remote sensing images (HSIs) have both spectral and spatial characteristics. The adept exploitation of these attributes is central to enhancing the classification accuracy of HSIs. In order to effectively utilize spatial and spectral features to classify HSIs, this paper proposes a method for the spatial feature extraction of HSIs based on a mutually guided image filter (muGIF) and combined with the band-distance-grouped principal component. Firstly, aiming at the problem that previously guided image filtering cannot effectively deal with the inconsistent information structure between the guided and target information, a method for extracting spatial features using muGIF is proposed. Then, aiming at the problem of the information loss caused by a single principal component as a guided image in the traditional GIF-based spatial–spectral classification, a spatial feature-extraction framework based on the band-distance-grouped principal component is proposed. The method groups the bands according to the band distance and extracts the principal components of each set of band subsets as the guide map of the current band subset to filter the HSIs. A deep convolutional neural network model and a generative adversarial network model for the filtered HSIs are constructed and then trained using samples for HSIs' spatial–spectral classification. Experiments show that compared with the traditional methods and several popular spatial–spectral HSI classification methods based on a filter, the proposed methods based on muGIF can effectively extract the spatial–spectral features and improve the classification accuracy of HSIs. [ABSTRACT FROM AUTHOR]

Optical remote sensing videos, as a new source of remote sensing data that has emerged in recent years, have significant potential in remote sensing applications, especially national defense. In this paper, a tracking pipeline named TDNet (tracking while detecting based on a neural network) is proposed for optical remote sensing videos based on a correlation filter and deep neural networks. The pipeline is used to simultaneously track ships and planes in videos. There are many target tracking methods for general video data, but they suffer some difficulties in remote sensing videos with low resolution and those influenced by weather conditions. The tracked targets are usually misty. Therefore, in TDNet, we propose a new multi-target tracking method called MT-KCF and a detecting-assisted tracking (i.e., DAT) module to improve tracking accuracy and precision. Meanwhile, we also design a new target recognition (i.e., NTR) module to recognise newly emerged targets. In order to verify the performance of TDNet, we compare our method with several state-of-the-art tracking methods on optical video remote sensing data sets acquired from the Jilin No. 1 satellite. The experimental results demonstrate the effectiveness and the state-of-the-art performance of the proposed method. The proposed method can achieve more than 90% performance in terms of precision for single-target tracking tasks and more than 85% performance in terms of MOTA for multi-object tracking tasks. [ABSTRACT FROM AUTHOR]

This paper presents a method for predicting atmospheric duct conditions from a clutter power spectrum using deep learning. To accurately predict the duct conditions, deep learning with a binary classification is applied to the proposed refractivity from the clutter (RFC) method. The input data set is the artificial clutter data that are generated via the Advanced Refractive Prediction System (AREPS) simulation software Ver. 3.6 in conjunction with random atmospheric refractive indices. The output of the RFC method is then predicted via binary classification, indicating whether the atmospheric conditions are duct or non-duct. For the cross-validation, the clutter power spectrum data are generated based on real atmospheric refractivity data. The results show that the DNN trained with 5600 pieces of data (validation accuracy of 95.99%) exhibits a binary classification accuracy of 98.36%. The deep neural network (DNN) trained with 28,000 pieces of data (validation accuracy of 98.20%) achieves a binary classification accuracy of 99.06% with an F1-score of 0.9921. [ABSTRACT FROM AUTHOR]

Due to the complex interaction of urban and mountainous floods, assessing flood susceptibility in mountainous urban areas presents a challenging task in environmental research and risk analysis. Data-driven machine learning methods can evaluate flood susceptibility in mountainous urban areas lacking essential hydrological data, utilizing remote sensing data and limited historical inundation records. In this study, two ensemble learning algorithms, Random Forest (RF) and XGBoost, were adopted to assess the flood susceptibility of Kunming, a typical mountainous urban area prone to severe flood disasters. A flood inventory was created using flood observations from 2018 to 2022. The spatial database included 10 explanatory factors, encompassing climatic, geomorphic, and anthropogenic factors. Artificial Neural Network (ANN) and Support Vector Machine (SVM) were selected for model comparison. To minimize the influence of expert opinions on model training, this study employed a strategy of uniformly random sampling in historically non-flooded areas for negative sample selection. The results demonstrated that (1) ensemble learning algorithms offer higher accuracy than other machine learning methods, with RF achieving the highest accuracy, evidenced by an area under the curve (AUC) of 0.87, followed by XGBoost at 0.84, surpassing both ANN (0.83) and SVM (0.82); (2) the interpretability of ensemble learning highlighted the differences in the potential distribution of the training data's positive and negative samples. Feature importance in ensemble learning can be utilized to minimize human bias in the collection of flooded-site samples, more targeted flood susceptibility maps of the study area's road network were obtained; and (3) ensemble learning algorithms exhibited greater stability and robustness in datasets with varied negative samples, as evidenced by their performance in F1-Score, Kappa, and AUC metrics. This paper further substantiates the superiority of ensemble learning in flood susceptibility assessment tasks from the perspectives of accuracy, interpretability, and robustness, enhances the understanding of the impact of negative samples on such assessments, and optimizes the specific process for urban flood susceptibility assessment using data-driven methods. [ABSTRACT FROM AUTHOR]

Cones are among the significant and controversial landforms on Mars. Martian cones exhibit various morphological characteristics owing to their complex origin, and their precise origin remains an active research topic. A limited number of cones have been manually mapped from high-resolution images in local areas, and existing detection methods are only applicable to a single type of cone that has a similar morphology and spatial distribution, leading to the vast majority remaining unidentified. In this paper, a novel cone identification approach is proposed that is specially designed for adequately recognizing cones from different regions in high-resolution planetary images. First, due to the lack of a publicly available cone database for reference, we annotated 3681 cones according to the literature on manual interpretation and the cone information provided by the Lunar and Planetary Laboratory (IRL) in HiRISE images. Then, the cone identification problem was converted into an instance segmentation task, i.e., a cone identification approach was designed based on deep neural networks. The Feature Pyramid Network-equipped Mask R-CNN was utilized as the detection and segmentation model. Extensive experiments were conducted for fine recognition of Martian cones with HiRISE. The results show that the proposed approach achieves high performance; it especially efficiently detects multiple types of cones while generating accurate segmentation to describe the geometry contour of cones. Finally, a Martian cone dataset with deep learning-based instance segmentation (DL-MCD) was built, containing 3861 cones for exploring geological processes on the surface of Mars. [ABSTRACT FROM AUTHOR]

The integration of deep neural networks into sparse synthetic aperture radar (SAR) imaging is explored to enhance SAR imaging performance and reduce the system's sampling rate. However, the scarcity of training samples and mismatches between the training data and the SAR system pose significant challenges to the method's further development. In this paper, we propose a novel SAR imaging approach based on deep image prior powered by RED (DeepRED), enabling unsupervised SAR imaging without the need for additional training data. Initially, DeepRED is introduced as the regularization technique within the sparse SAR imaging model. Subsequently, variable splitting and the alternating direction method of multipliers (ADMM) are employed to solve the imaging model, alternately updating the magnitude and phase of the SAR image. Additionally, the SAR echo simulation operator is utilized as an observation model to enhance computational efficiency. Through simulations and real data experiments, we demonstrate that our method maintains imaging quality and system downsampling rate on par with deep-neural-network-based sparse SAR imaging but without the requirement for training data. [ABSTRACT FROM AUTHOR]

This article compilation explores the use of artificial intelligence (AI), machine learning (ML), and data analytics in marine, oceanic, and climate change monitoring. The featured applications cover a range of topics, including sea-surface temperature prediction, Sargassum detection, cloud classification, chlorophyll-a concentration modeling, oceanic light models, subsurface ocean temperature prediction, near-surface humidity monitoring, and sea-surface salinity correction. These advancements in AI and ML techniques have the potential to enhance our understanding and management of marine and climate dynamics. The article concludes by emphasizing the need for continued research and advancements in these areas. [Extracted from the article]

Space–time adaptive processing (STAP) based on sparse recovery achieves excellent clutter suppression and target detection performance, even with a limited number of available training samples. However, most of these methods face performance degradation due to grid mismatch, which impedes their application in bistatic clutter suppression. Some gridless methods, such as atomic norm minimization (ANM), can effectively address grid mismatch issues, yet they are sensitive to parameter settings and array errors. In this article, the authors propose a data and model-driven algorithm that unfolds the iterative process of atomic norm minimization into a deep network. This approach establishes a concrete and systematic link between iterative algorithms, extensively utilized in signal processing, and deep neural networks. This methodology not only addresses the challenges associated with parameter settings in traditional optimization algorithms, but also mitigates the lack of interpretability issues commonly found in deep neural networks. Moreover, due to more rational parameter settings, the proposed algorithm achieves effective clutter suppression with fewer iterations, thereby reducing computational time. Finally, extensive simulation experiments demonstrate the effectiveness of the proposed algorithm in clutter suppression for airborne bistatic radar. [ABSTRACT FROM AUTHOR]

Point cloud registration is a critical problem because it is the basis of many 3D vision tasks. With the popularity of deep learning, many scholars have focused on leveraging deep neural networks to address the point cloud registration problem. However, many of these methods are still sensitive to partial overlap and differences in density distribution. For this reason, herein, we propose a method based on rotation-invariant features and using a sparse-to-dense matching strategy for robust point cloud registration. Firstly, we encode raw points as superpoints with a network combining KPConv and FPN, and their associated features are extracted. Then point pair features of these superpoints are computed and embedded into the transformer to learn the hybrid features, which makes the approach invariant to rigid transformation. Subsequently, a sparse-to-dense matching strategy is designed to address the registration problem. The correspondences of superpoints are obtained via sparse matching and then propagated to local dense points and, further, to global dense points, the byproduct of which is a series of transformation parameters. Finally, the enhanced features based on spatial consistency are repeatedly fed into the sparse-to-dense matching module to rebuild reliable correspondence, and the optimal transformation parameter is re-estimated for final alignment. Our experiments show that, with the proposed method, the inlier ratio and registration recall are effectively improved, and the performance is better than that of other point cloud registration methods on 3DMatch and ModelNet40. [ABSTRACT FROM AUTHOR]

This study assessed the impacts of the land use/cover (LULC) and climate changes on the runoff and sediment flows in the Megech watershed. The Geospatial Water Erosion Prediction Project (GeoWEPP) was used to assess LULC and climate changes' impact on runoff, soil loss, and sediment yield. The QGIS 2.16.3 plugin module for land use change evaluation (MOLUSCE) tool with the cellular automata artificial neural network (CA-ANN) was used for LULC prediction based on historical data and exploratory maps. Two commonly used representative concentration pathways (RCPs)—4.5 and 8.5—were used for climate projection in the 2030s, 2050s, and 2070s. The LULC prediction analysis showed an expansion of cropland and settlement areas, with the reduction in the forest and rangelands. The climate projections indicated an increase in maximum temperatures and altered precipitation patterns, particularly with increased wet months and reduced dry periods. The average annual soil loss and sediment yield rates were estimated to increase under both the RCP4.5 and RCP8.5 climate scenarios, with a more noticeable increase under RCP8.5. By integrating DEM, soil, land use, and climate data, we evaluated runoff, soil loss, and sediment yield changes on only land use/cover, only climate, and the combined impacts in the watershed. The results revealed that, under all combined scenarios, the sediment yield in the Megech Reservoir was projected to substantially increase by 23.28–41.01%, showing a potential loss of reservoir capacity. This study recommends strong climate adaptation and mitigation measures to alleviate the impact on land and water resources. It is possible to lessen the combined impacts of climate and LULC change through implementing best-management practices and adaptation strategies for the identified scenarios. [ABSTRACT FROM AUTHOR]

The integration of Synthetic Aperture Radar (SAR) imaging technology with deep neural networks has experienced significant advancements in recent years. Yet, the scarcity of high-quality samples and the difficulty of extracting prior information from SAR data have experienced limited progress in this domain. This study introduces an innovative sparse SAR imaging approach using a self-supervised non-local asymmetric pixel-shuffle blind spot network. This strategy enables the network to be trained without labeled samples, thus solving the problem of the scarcity of high-quality samples. Through asymmetric pixel-shuffle downsampling (AP) operation, the spatial correlation between pixels is broken so that the blind spot network can adapt to the actual scene. The network also incorporates a non-local module (NLM) into its blind spot architecture, enhancing its capability to analyze a broader range of information and extract more comprehensive prior knowledge from SAR data. Subsequently, Plug and Play (PnP) technology is used to integrate the trained network into the sparse SAR imaging model to solve the regularization term problem. The optimization of the inverse problem is achieved through the Alternating Direction Method of Multipliers (ADMM) algorithm. The experimental results of the unlabeled samples demonstrate that our method significantly outperforms traditional techniques in reconstructing images across various regions. [ABSTRACT FROM AUTHOR]

Ground hazards are a significant problem in the global economy, costing millions of dollars in damage each year. Railroad tracks are vulnerable to ground hazards like flooding since they traverse multiple terrains with complex environmental factors and diverse human developments. Traditionally, flood-hazard assessments are generated using models like the Hydrological Engineering Center–River Analysis System (HEC-RAS). However, these maps are typically created for design flood events (10, 50, 100, 500 years) and are not available for any specific storm event, as they are not designed for individual flood predictions. Remotely sensed methods, on the other hand, offer precise flood extents only during the flooding, which means the actual flood extents cannot be determined beforehand. Railroad agencies need daily flood extent maps before rainfall events to manage and plan for the parts of the railroad network that will be impacted during each rainfall event. A new approach would involve using traditional flood-modeling layers and remotely sensed flood model outputs such as flood maps created using the Google Earth Engine. These new approaches will use machine-learning tools in flood prediction and extent mapping. This new approach will allow for determining the extent of flood for each rainfall event on a daily basis using rainfall forecast; therefore, flooding extents will be modeled before the actual flood, allowing railroad managers to plan for flood events pre-emptively. Two approaches were used: support vector machines and deep neural networks. Both methods were fine-tuned using grid-search cross-validation; the deep neural network model was chosen as the best model since it was computationally less expensive in training the model and had fewer type II errors or false negatives, which were the priorities for the flood modeling and would be suitable for developing the automated system for the entire railway corridor. The best deep neural network was then deployed and used to assess the extent of flooding for two floods in 2020 and 2022. The results indicate that the model accurately approximates the actual flooding extent and can predict flooding on a daily temporal basis using rainfall forecasts. [ABSTRACT FROM AUTHOR]

Over several decades, high-frequency (HF) radars have been employed for remotely measuring various ocean surface parameters, encompassing surface currents, waves, and winds. Wind direction and speed are usually estimated from both first-order and second-order Bragg-resonant scatter from two or more HF radars monitoring the same area of the ocean surface. This limits the observational domain to the common area where second-order scatter is available from at least two radars. Here, we propose to estimate wind direction and speed from the first-order scatter of a single HF radar, yielding the same spatial coverage as for surface radial currents. Wind direction is estimated using the ratio of the positive and negative first-order Bragg peaks intensity, with a new simple algorithm to remove the left/right directional ambiguity from a single HF radar. Wind speed is estimated from wind direction and de-tided surface radial currents using an artificial neural network which has been trained with in situ wind speed observations. Radar-derived wind estimations are compared with in situ observations in the Lower Saint-Lawrence Estuary (Quebec, Canada). The correlation coefficients between radar-estimated and in situ wind directions range from 0.84 to 0.95 for Wellen Radars (WERAs) and from 0.79 to 0.97 for Coastal Ocean Dynamics Applications Radars (CODARs), while the root mean square differences range from 8° to 12° for WERAs and from 10° to 19° for CODARs. Correlation coefficients between the radar-estimated and the in situ wind speeds range from 0.89 to 0.93 for WERAs and from 0.81 to 0.93 for CODARs, while the root mean square differences range from 1.3 m.s−1 to 2.3 m.s−1 for WERAs and from 1.6 m.s−1 to 3.9 m.s−1 for CODARs. [ABSTRACT FROM AUTHOR]

Milk vetch (Astragalus sinicus L.) is a winter-growing plant that can enhance soil fertility and provide essential nutrients for subsequent season crops. The fertilizing capacity of milk vetch is closely related to its above-ground biomass. Compared to the manual measurement methods of milk vetch biomass, remote sensing-based estimation methods have the advantages of rapid, noninvasive, and large-scale measurement. However, few studies have been conducted on remote sensing-based estimation of milk vetch biomass. To address this shortcoming, this study proposes combining unmanned aerial vehicle (UAV)-based hyperspectral imagery and machine learning algorithms for accurate estimation of milk vetch biomass. Through the analysis of hyperspectral images and feature selection based on the Pearson correlation and principal component analysis, vegetation indices (VIs), including near-infrared reflectance (NIR), red-edge spectral transform index (RE), and difference vegetation index (DVI), are selected as estimation metrics of the model development process. Four machine learning methods, including random forest (RF), multiple linear regression (MLR), deep neural network (DNN), and support vector machine (SVM), are used to construct the biomass models. The results show that the RF estimation model exhibits the highest coefficient of determination (R2) of 0.950 and the lowest relative root-mean-squared error (RRMSE) of 14.86% among all the models. Notably, the DNN model demonstrates promising performance on the test set, with the R2 and RRMSE values slightly superior and inferior to those of the RF, respectively. The proposed method based on UAV imagery and machine learning can provide an accurate and reliable large-scale estimation of milk vetch biomass. [ABSTRACT FROM AUTHOR]

Forest canopy height is a fundamental parameter of forest structure, and plays a pivotal role in understanding forest biomass allocation, carbon stock, forest productivity, and biodiversity. Spaceborne LiDAR (Light Detection and Ranging) systems, such as GEDI (Global Ecosystem Dynamics Investigation), provide large-scale estimation of ground elevation, canopy height, and other forest parameters. However, these measurements may have uncertainties influenced by topographic factors. This study focuses on the calibration of GEDI L2A and L1B data using an airborne LiDAR point cloud, and the combination of Sentinel-2 multispectral imagery, 1D convolutional neural network (CNN), artificial neural network (ANN), and random forest (RF) for upscaling estimated forest height in the Guangxi Gaofeng Forest Farm. First, various environmental (i.e., slope, solar elevation, etc.) and acquisition parameters (i.e., beam type, Solar elevation, etc.) were used to select and optimize the L2A footprint. Second, pseudo-waveforms were simulated from the airborne LiDAR point cloud and were combined with a 1D CNN model to calibrate the L1B waveform data. Third, the forest height extracted from the calibrated L1B waveforms and selected L2A footprints were compared and assessed, utilizing the CHM derived from the airborne LiDAR point cloud. Finally, the forest height data with higher accuracy were combined with Sentinel-2 multispectral imagery for an upscaling estimation of forest height. The results indicate that through optimization using environmental and acquisition parameters, the ground elevation and forest canopy height extracted from the L2A footprint are generally consistent with airborne LiDAR data (ground elevation: R2 = 0.99, RMSE = 4.99 m; canopy height: R2 = 0.42, RMSE = 5.16 m). Through optimizing, ground elevation extraction error was reduced by 45.5% (RMSE), and the canopy height extraction error was reduced by 30.3% (RMSE). After training a 1D CNN model to calibrate the forest height, the forest height information extracted using L1B has a high accuracy (R2 = 0.84, RMSE = 3.13 m). Compared to the optimized L2A data, the RMSE was reduced by 2.03 m. Combining the more accurate L1B forest height data with Sentinel-2 multispectral imagery and using RF and ANN for the upscaled estimation of the forest height, the RF model has the highest accuracy (R2 = 0.64, RMSE = 4.59 m). The results show that the extrapolation and inversion of GEDI, combined with multispectral remote sensing data, serve as effective tools for obtaining forest height distribution on a large scale. [ABSTRACT FROM AUTHOR]

This study introduces an advanced ensemble methodology employing lightweight neural network models for identifying severe convective clouds from FY-4B geostationary meteorological satellite imagery. We have constructed a FY-4B based severe convective cloud dataset by a combination of algorithms and expert judgment. Through the ablation study of a model ensembling combination of multiple specialized lightweight architectures—ENet, ESPNet, Fast-SCNN, ICNet, and MobileNetV2—the optimal EFNet (ENet- and Fast-SCNN-based network) not only achieves real-time processing capabilities but also ensures high accuracy in severe weather detection. EFNet consistently outperformed traditional, heavier models across several key performance indicators: achieving an accuracy of 0.9941, precision of 0.9391, recall of 0.9201, F1 score of 0.9295, and computing time of 18.65 s over the test dataset of 300 images (~0.06 s per 512 × 512 pic). ENet shows high precision but misses subtle clouds, while Fast-SCNN has high sensitivity but lower precision, leading to misclassifications. EFNet's ensemble approach balances these traits, enhancing overall predictive accuracy. The ensemble method of lightweight models effectively aggregates the diverse strengths of the individual models, optimizing both speed and predictive performance. [ABSTRACT FROM AUTHOR]

Earth observation imaging technologies, particularly multispectral sensors, produce extensive high-dimensional data over time, thus offering a wealth of information on global dynamics. These data encapsulate crucial information in essential climate variables, such as varying levels of soil moisture and temperature. However, current cutting-edge machine learning models, including deep learning ones, often overlook the treasure trove of multidimensional data, thus analyzing each variable in isolation and losing critical interconnected information. In our study, we enhance conventional convolutional neural network models, specifically those based on the embedded temporal convolutional network framework, thus transforming them into models that inherently understand and interpret multidimensional correlations and dependencies. This transformation involves recasting the existing problem as a generalized case of N-dimensional observation analysis, which is followed by deriving essential forward and backward pass equations through tensor decompositions and compounded convolutions. Consequently, we adapt integral components of established embedded temporal convolutional network models, like encoder and decoder networks, thus enabling them to process 4D spatial time series data that encompass all essential climate variables concurrently. Through the rigorous exploration of diverse model architectures and an extensive evaluation of their forecasting prowess against top-tier methods, we utilize two new, long-term essential climate variables datasets with monthly intervals extending over four decades. Our empirical scrutiny, particularly focusing on soil temperature data, unveils that the innovative high-dimensional embedded temporal convolutional network model-centric approaches markedly excel in forecasting, thus surpassing their low-dimensional counterparts, even under the most challenging conditions characterized by a notable paucity of training data. [ABSTRACT FROM AUTHOR]

In recent years, a growing number of sensors that provide imagery with constantly increasing spatial resolution are being placed on the orbit. Contemporary Very-High-Resolution Satellites (VHRS) are capable of recording images with a spatial resolution of less than 0.30 m. However, until now, these scenes were acquired in a static way. The new technique of the dynamic acquisition of video satellite imagery has been available only for a few years. It has multiple applications related to remote sensing. However, in spite of the offered possibility to detect dynamic targets, its main limitation is the degradation of the spatial resolution of the image that results from imaging in video mode, along with a significant influence of lossy compression. This article presents a methodology that employs Generative Adversarial Networks (GAN). For this purpose, a modified ESRGAN architecture is used for the spatial resolution enhancement of video satellite images. In this solution, the GAN network generator was extended by the Uformer model, which is responsible for a significant improvement in the quality of the estimated SR images. This enhances the possibilities to recognize and detect objects significantly. The discussed solution was tested on the Jilin-1 dataset and it presents the best results for both the global and local assessment of the image (the mean values of the SSIM and PSNR parameters for the test data were, respectively, 0.98 and 38.32 dB). Additionally, the proposed solution, in spite of the fact that it employs artificial neural networks, does not require a high computational capacity, which means it can be implemented in workstations that are not equipped with graphic processors. [ABSTRACT FROM AUTHOR]

The global navigation satellite system reflectometry (GNSS-R) technique has shown promise in retrieving sea levels using signal-to-noise ratio (SNR) data. However, its accuracy and performance are often limited compared to conventional tide gauges, particularly due to constraints in satellite elevation angles. To address these limitations, we propose a methodology integrating Long Short-Term Memory Deep Neural Networks (LSTM-DNN) models, utilising SNR residual sequences as key feature inputs. Our study focuses on the SC02 station, examining elevation angles ranging from 5° to 10°, 5° to 15°, and 5° to 20°. Results reveal notable reductions in root mean square errors (RMSE) of 2.855%, 17.519%, and 15.756%, respectively, showcasing improvements in accuracy across varying elevation angles. Of particular significance is the enhancement in precision observed at higher elevation angles. This underscores the valuable contribution of our approach to nearshore sea level wave height retrieval, promising advancements in the GNSS-R technique. [ABSTRACT FROM AUTHOR]

The sea surface temperature (SST) is one of the most important parameters that characterize the thermal state of the ocean surface, directly affecting the heat exchange between the ocean and the atmosphere, climate change, and weather generation. Generally, due to factors such as the weather, satellite scanning orbit range, and satellite sensor malfunction, there are large areas of missing satellite remote sensing SST data, greatly reducing data utilization. In this situation, how to use effective data or avenues to rebuild missing SST data has become a research hotspot in the field of ocean remote sensing. Based on the SST data from an FY-3C visible and infrared radiometer with a spatial resolution of 5 km (FY-3C VIRR), an improved data interpolation convolutional autoencoder (I-DINCAE) was used to reconstruct the missing SST data. Through cross-validation, the accuracy of the reconstruction results was quantitatively evaluated with an RMSE of 0.36 °C and an MAE of 0.24 °C. The results showed that the I-DINCAE algorithm outperformed the original DINCAE algorithm greatly. For further optimization, a deep neural network (DNN) was chosen to adjust the error between the reconstructed SST and the in situ data. The RMSE of the final adjusted SST and in situ data is 0.466 °C, and the MAE is 0.296 °C. Compared to the in situ data, the accuracy of the adjusted data has shown a significant improvement over the reconstructed data. This method successfully applies deep-learning technology to the reconstruction of SST data, achieving the full coverage and high accuracy of SST products, which can provide more reliable and complete SST data for marine scientific research. [ABSTRACT FROM AUTHOR]

This article focuses on developing models that estimate suspended sediment concentrations (SSCs) for the Lower Brazos River, Texas, U.S. Historical samples of SSCs from gauge stations and satellite imagery from Landsat Missions and Sentinel Mission 2 were utilized to develop models to estimate SSCs for the Lower Brazos River. The models used in this study to accomplish this goal include support vector machines (SVMs), artificial neural networks (ANNs), extreme learning machines (ELMs), and exponential relationships. In addition, flow measurements were used to develop rating curves to estimate SSCs for the Brazos River as a baseline comparison of the models that used satellite imagery to estimate SSCs. The models were evaluated using a Taylor Diagram analysis on the test data set developed for the Brazos River data. Fifteen of the models developed using satellite imagery as inputs performed with a coefficient of determination R2 above 0.69, with the three best performing models having an R2 of 0.83 to 0.85. One of the best performing models was then utilized to estimate the SSCs before, during, and after Hurricane Harvey to evaluate the impact of this storm on the sediment dynamics along the Lower Brazos River and the model's ability to estimate SSCs. [ABSTRACT FROM AUTHOR]

Although deep neural networks have made significant progress in tasks related to remote sensing image scene classification, most of these tasks assume that the training and test data are independently and identically distributed. However, when remote sensing scene classification models are deployed in the real world, the model will inevitably encounter situations where the distribution of the test set differs from that of the training set, leading to unpredictable errors during the inference and testing phase. For instance, in the context of large-scale remote sensing scene classification applications, it is difficult to obtain all the feature classes in the training phase. Consequently, during the inference and testing phases, the model will categorize images of unidentified unknown classes into known classes. Therefore, the deployment of out-of-distribution (OOD) detection within the realm of remote sensing scene classification is crucial for ensuring the reliability and safety of model application in real-world scenarios. Despite significant advancements in OOD detection methods in recent years, there remains a lack of a unified benchmark for evaluating various OOD methods specifically in remote sensing scene classification tasks. We designed different benchmarks on three classical remote sensing datasets to simulate scenes with different distributional shift. Ten different types of OOD detection methods were employed, and their performance was evaluated and compared using quantitative metrics. Numerous experiments were conducted to evaluate the overall performance of these state-of-the-art OOD detection methods under different test benchmarks. The comparative results show that the virtual-logit matching methods without additional training outperform the other types of methods on our benchmarks, suggesting that additional training methods are unnecessary for remote sensing image scene classification applications. Furthermore, we provide insights into OOD detection models and performance enhancement in real world. To the best of our knowledge, this study is the first evaluation and analysis of methods for detecting out-of-distribution data in remote sensing. We hope that this research will serve as a fundamental resource for future studies on out-of-distribution detection in remote sensing. [ABSTRACT FROM AUTHOR]

This document provides an overview of the importance of road extraction and distress assessment using remote sensing technology. It discusses various methods and techniques used in this field, such as image classification and object detection. The document introduces a special issue of the journal Remote Sensing that focuses on road extraction and distress assessment, summarizing 12 articles published in the issue. These articles cover topics such as rural road extraction, crack detection, and object recognition. The document emphasizes the potential of remote sensing technology in assessing road pavement health conditions and suggests the need for further research in this area. [Extracted from the article]

Ground-penetrating radar (GPR) faces complex challenges in identifying underground rock formations and lithological structures. The diversity, intricate shapes, and electromagnetic properties of subsurface rock formations make their accurate detection difficult. Additionally, the heterogeneity of subsurface media, signal scattering, and non-linear propagation effects contribute to the complexity of signal interpretation. To address these challenges, this study fully considers the unique advantages of convolutional neural networks (CNNs) in accurately identifying underground rock formations and lithological structures, particularly their powerful feature extraction capabilities. Deep learning models possess the ability to automatically extract complex signal features from radar data, while also demonstrating excellent generalization performance, enabling them to handle data from various geological conditions. Moreover, deep learning can efficiently process large-scale data, thereby improving the accuracy and efficiency of identification. In our research, we utilized deep neural networks to process GPR signals, using radar images as inputs and generating structure-related information associated with rock formations and lithological structures as outputs. Through training and learning, we successfully established an effective mapping relationship between radar images and lithological label signals. The results from synthetic data indicate a rock block identification success rate exceeding 88%, with a satisfactory continuity identification of lithological structures. Transferring the network to measured data, the trained model exhibits excellent performance in predicting data collected from the field, further enhancing the geological interpretation and analysis. Therefore, through the results obtained from synthetic and measured data, we can demonstrate the effectiveness and feasibility of this research method. [ABSTRACT FROM AUTHOR]

Mapping benthic habitats with bathymetric, acoustic, and spectral data requires georeferenced ground-truth information about habitat types and characteristics. New technologies like autonomous underwater vehicles (AUVs) collect tens of thousands of images per mission making image-based ground truthing particularly attractive. Two types of machine learning (ML) models, random forest (RF) and deep neural network (DNN), were tested to determine whether ML models could serve as an accurate substitute for manual classification of AUV images for substrate type interpretation. RF models were trained to predict substrate class as a function of texture, edge, and intensity metrics (i.e., features) calculated for each image. Models were tested using a manually classified image dataset with 9-, 6-, and 2-class schemes based on the Coastal and Marine Ecological Classification Standard (CMECS). Results suggest that both RF and DNN models achieve comparable accuracies, with the 9-class models being least accurate (~73–78%) and the 2-class models being the most accurate (~95–96%). However, the DNN models were more efficient to train and apply because they did not require feature estimation before training or classification. Integrating ML models into benthic habitat mapping process can improve our ability to efficiently and accurately ground-truth large areas of benthic habitat using AUV or similar images. [ABSTRACT FROM AUTHOR]

To achieve automatic recognition of lightning images, which cannot easily be handled using the existing methods and still requires significant human resources, we propose a lightning image dataset and a preprocessing method. The lightning image data over five months were collected using a camera based on two optical observation stations, and then a series of batch labeling methods were applied, which greatly reduced the workload of subsequent manual labeling, and a dataset containing more than 30,000 labeled samples was established. Considering that lightning varies rapidly over time, we propose a time sequence composite (TSC) preprocessing method that inputs lightning's time-varying characteristics into a model for better recognition of lightning images. The TSC method was evaluated through an experiment on four backbones, and it was found that this preprocessing method enhances the classification performance by 40%. The final trained model could successfully distinguish between the "lightning" and "non-lightning" samples, and a recall rate of 86.5% and a false detection rate of 0.2% were achieved. [ABSTRACT FROM AUTHOR]

Enhancing the reliability of inversion results has always been a prominent issue in the field of geophysics. In recent years, data-driven inversion methods leveraging deep neural networks (DNNs) have gained prominence for their ability to address non-uniqueness issues and reduce computational costs compared to traditional physically model-driven methods. In this study, we propose a GMNet machine learning method, i.e., a CNN-based inversion method for gravity and magnetic field data. This method relies more on data-driven training, and in the prediction phase after the model is trained, it does not heavily depend on a priori assumptions, unlike traditional methods. By forward modeling gravity and magnetic fields, we obtain a substantial dataset to train the CNN model, enabling the direct mapping from field data to subsurface property distribution. Applying this method to synthetic data and one-field data yields promising inversion results. [ABSTRACT FROM AUTHOR]

We explore to what extent data-driven prediction models have skills in forecasting daily sea-surface temperature (SST), which are comparable to or perform better than current physics-based operational systems over long-range forecast horizons. Three hybrid deep learning-based models are developed within the South China Sea (SCS) basin by integrating deep neural networks (back propagation, long short-term memory, and gated recurrent unit) with traditional empirical orthogonal function analysis and empirical mode decomposition. Utilizing a 40-year (1982–2021) satellite-based daily SST time series on a 0.25° grid, we train these models on the first 32 years (1982–2013) of detrended SST anomaly (SSTA) data. Their predictive accuracies are then validated using data from 2014 and tested over the subsequent seven years (2015–2021). The models' forecast skills are assessed using spatial anomaly correlation coefficient (ACC) and root-mean-square error (RMSE), with ACC proving to be a stricter metric. A forecast skill horizon, defined as the lead time before ACC drops below 0.6, is determined to be 50 days. The models are equally capable of achieving a basin-wide average ACC of ~0.62 and an RMSE of ~0.48 °C at this horizon, indicating a 36% improvement in RMSE over climatology. This implies that on average the forecast skill horizon for these models is beyond the available forecast length. Analysis of one model, the BP neural network, reveals a variable forecast skill horizon (5 to 50 days) for each individual day, showing that it can adapt to different time scales. This adaptability seems to be influenced by a number of mechanisms arising from the evident regional and global atmosphere–ocean coupling variations on time scales ranging from intraseasonal to decadal in the SSTA of the SCS basin. [ABSTRACT FROM AUTHOR]

Accurately simulating glacier mass balance (GMB) data is crucial for assessing the impacts of climate change on glacier dynamics. Since physical models often face challenges in comprehensively accounting for factors influencing glacial melt and uncertainties in inputs, machine learning (ML) offers a viable alternative due to its robust flexibility and nonlinear fitting capability. However, the effectiveness of ML in modeling GMB data across diverse glacier types within High Mountain Asia has not yet been thoroughly explored. This study addresses this research gap by evaluating ML models used for the simulation of annual glacier-wide GMB data, with a specific focus on comparing maritime glaciers in the Niyang River basin and continental glaciers in the Manas River basin. For this purpose, meteorological predictive factors derived from monthly ERA5-Land datasets, and topographical predictive factors obtained from the Randolph Glacier Inventory, along with target GMB data rooted in geodetic mass balance observations, were employed to drive four selective ML models: the random forest model, the gradient boosting decision tree (GBDT) model, the deep neural network model, and the ordinary least-square linear regression model. The results highlighted that ML models generally exhibit superior performance in the simulation of GMB data for continental glaciers compared to maritime ones. Moreover, among the four ML models, the GBDT model was found to consistently exhibit superior performance with coefficient of determination ( R 2 ) values of 0.72 and 0.67 and root mean squared error ( R M S E ) values of 0.21 m w.e. and 0.30 m w.e. for glaciers within Manas and Niyang river basins, respectively. Furthermore, this study reveals that topographical and climatic factors differentially influence GMB simulations in maritime and continental glaciers, providing key insights into glacier dynamics in response to climate change. In summary, ML, particularly the GBDT model, demonstrates significant potential in GMB simulation. Moreover, the application of ML can enhance the accuracy of GMB modeling, providing a promising approach to assess the impacts of climate change on glacier dynamics. [ABSTRACT FROM AUTHOR]

Deep learning has dramatically enhanced remote sensing change detection. However, existing neural network models often face challenges like false positives and missed detections due to factors like lighting changes, scale differences, and noise interruptions. Additionally, change detection results often fail to capture target contours accurately. To address these issues, we propose a novel transformer-based hybrid network. In this study, we analyze the structural relationship in bi-temporal images and introduce a cross-attention-based transformer to model this relationship. First, we use a tokenizer to express the high-level features of the bi-temporal image into several semantic tokens. Then, we use a dual temporal transformer (DTT) encoder to capture dense spatiotemporal contextual relationships among the tokens. The features extracted at the coarse scale are refined into finer details through the DTT decoder. Concurrently, we input the backbone's low-level features into a contour-guided graph interaction module (CGIM) that utilizes joint attention to capture semantic relationships between object regions and the contour. Then, we use the feature pyramid decoder to integrate the multi-scale outputs of the CGIM. The convolutional block attention modules (CBAMs) employ channel and spatial attention to reweight feature maps. Finally, the classifier discriminates change pixels and generates the final change map of the difference feature map. Several experiments have demonstrated that our model shows significant advantages over other methods in terms of efficiency, accuracy, and visual effects. [ABSTRACT FROM AUTHOR]