Search

Ocean sound speed is important for underwater acoustic applications, such as communications, navigation and localization, where the assumption of uniformly distributed sound speed profiles (SSPs) is generally used and greatly degrades the performance of underwater acoustic systems. The acquisition of SSPs is necessary for the corrections of the sound ray propagation paths. However, the inversion of SSPs is challenging due to the intricate relations of interrelated physical ocean elements and suffers from the high costs of calculations and hardware deployments. This paper proposes a novel sound speed inversion method based on multi-source ocean remote sensing observations and machine learning, which adapts to large-scale sea regions. Firstly, the datasets of SSPs are generated utilizing the Argo thermohaline profiles and the empirical formulas of the sound speed. Then, the SSPs are analyzed utilizing the empirical orthogonal functions (EOFs) to reduce the dimensions of the feature space as well as the computational load. Considering the nonlinear regression relations of SSPs and the observed datasets, a general framework for sound speed inversion is formulated, which combines the designed machine learning models with the reduced-dimensional feature representations, multi-source ocean remote sensing observations and water temperature data. After being well trained, the proposed machine learning models realize the accurate inversion of the targeted ocean region by inputting the real-time ocean environmental data. The experiments verify the advantages of the proposed method in terms of the accuracy and effectiveness compared with conventional methods. [ABSTRACT FROM AUTHOR]

The current image generative models have achieved a remarkably realistic image quality, offering numerous academic and industrial applications. However, to ensure these models are used for benign purposes, it is essential to develop tools that definitively detect whether an image has been synthetically generated. Consequently, several detectors with excellent performance in computer vision applications have been developed. However, these detectors cannot be directly applied as they areto multi-spectral satellite images, necessitating the training of new models. While two-class classifiers generally achieve high detection accuracies, they struggle to generalize to image domains and generative architectures different from those encountered during training. In this paper, we propose a one-class classifier based on Vector Quantized Variational Autoencoder 2 (VQ-VAE 2) features to overcome the limitations of two-class classifiers. We start by highlighting the generalization problem faced by binary classifiers. This was demonstrated by training and testing an EfficientNet-B4 architecture on multiple multi-spectral datasets. We then illustrate that the VQ-VAE 2-based classifier, which was trained exclusively on pristine images, could detect images from different domains and generated by architectures not encountered during training. Finally, we conducted a head-to-head comparison between the two classifiers on the same generated datasets, emphasizing the superior generalization capabilities of the VQ-VAE 2-based detector, wherewe obtained a probability of detection at a 0.05 false alarm rate of 1 for the blue and red channels when using the VQ-VAE 2-based detector, and 0.72 when we used the EfficientNet-B4 classifier. [ABSTRACT FROM AUTHOR]

This document explores the significance of remote sensing in monitoring maritime activities and identifying vessels. It emphasizes the need for surveillance to ensure safety, security, and emergency management, given the increasing number of vessels worldwide. The document highlights the use of technologies like the Automatic Identification System (AIS) and remote sensing in situations where collaborative systems are not reliable. It also discusses the integration of data from different sensors and the application of data science techniques for a comprehensive assessment of maritime traffic. The document concludes by summarizing research papers on ship detection, tracking, and classification using various sensors and data processing techniques. [Extracted from the article]

Three-dimensional reconstruction is a key technology employed to represent virtual reality in the real world, which is valuable in computer vision. Large-scale 3D models have broad application prospects in the fields of smart cities, navigation, virtual tourism, disaster warning, and search-and-rescue missions. Unfortunately, most image-based studies currently prioritize the speed and accuracy of 3D reconstruction in indoor scenes. While there are some studies that address large-scale scenes, there has been a lack of systematic comprehensive efforts to bring together the advancements made in the field of 3D reconstruction in large-scale scenes. Hence, this paper presents a comprehensive overview of a 3D reconstruction technique that utilizes multi-view imagery from large-scale scenes. In this article, a comprehensive summary and analysis of vision-based 3D reconstruction technology for large-scale scenes are presented. The 3D reconstruction algorithms are extensively categorized into traditional and learning-based methods. Furthermore, these methods can be categorized based on whether the sensor actively illuminates objects with light sources, resulting in two categories: active and passive methods. Two active methods, namely, structured light and laser scanning, are briefly introduced. The focus then shifts to structure from motion (SfM), stereo matching, and multi-view stereo (MVS), encompassing both traditional and learning-based approaches. Additionally, a novel approach of neural-radiance-field-based 3D reconstruction is introduced. The workflow and improvements in large-scale scenes are elaborated upon. Subsequently, some well-known datasets and evaluation metrics for various 3D reconstruction tasks are introduced. Lastly, a summary of the challenges encountered in the application of 3D reconstruction technology in large-scale outdoor scenes is provided, along with predictions for future trends in development. [ABSTRACT FROM AUTHOR]

Hyperspectral imaging captures detailed spectral data for remote sensing. However, due to the limited spatial resolution of hyperspectral sensors, each pixel of a hyperspectral image (HSI) may contain information from multiple materials. Although the hyperspectral unmixing (HU) process involves estimating endmembers, identifying pure spectral components, and estimating pixel abundances, existing algorithms mostly focus on just one or two tasks. Blind source separation (BSS) based on nonnegative matrix factorization (NMF) algorithms identify endmembers and their abundances at each pixel of HSI simultaneously. Although they perform well, the factorization results are unstable, require high computational costs, and are difficult to interpret from the original HSI. CUR matrix decomposition selects specific columns and rows from a dataset to represent it as a product of three small submatrices, resulting in interpretable low-rank factorization. In this paper, we propose a new blind HU framework based on CUR factorization called CUR-HU that performs the entire HU process by exploiting the low-rank structure of given HSIs. CUR-HU incorporates several techniques to perform the HU process with a performance comparable to state-of-the-art methods but with higher computational efficiency. We adopt a deterministic sampling method to select the most informative pixels and spectrum components in HSIs. We use an incremental QR decomposition method to reduce computation complexity and estimate the number of endmembers. Various experiments on synthetic and real HSIs are conducted to evaluate the performance of CUR-HU. CUR-HU performs comparably to state-of-the-art methods for estimating the number of endmembers and abundance maps, but it outperforms other methods for estimating the endmembers and the computational efficiency. It has a 9.4 to 249.5 times speedup over different methods for different real HSIs. [ABSTRACT FROM AUTHOR]

Oriented object detection for remote sensing images poses formidable challenges due to arbitrary orientation, diverse scales, and densely distributed targets (e.g., across terrain). Current investigations in remote sensing object detection have primarily focused on improving the representation of oriented bounding boxes yet have neglected the significant orientation information of targets in remote sensing contexts. Recent investigations point out that the inclusion and fusion of orientation information yields substantial benefits in training an accurate oriented object system. In this paper, we propose a simple but effective orientation information integrating (OII) network comprising two main parts: the orientation information highlighting (OIH) module and orientation feature fusion (OFF) module. The OIH module extracts orientation features from those produced by the backbone by modeling the frequency information of spatial features. Given that low-frequency components in an image capture its primary content, and high-frequency components contribute to its intricate details and edges, the transformation from the spatial domain to the frequency domain can effectively emphasize the orientation information of images. Subsequently, our OFF module employs a combination of a CNN attention mechanism and self-attention to derive weights for orientation features and original features. These derived weights are adopted to adaptively enhance the original features, resulting in integrated features that contain enriched orientation information. Given the inherent limitation of the original spatial attention weights in explicitly capturing orientation nuances, the incorporation of the introduced orientation weights serves as a pivotal tool to accentuate and delineate orientation information related to targets. Without unnecessary embellishments, our OII network achieves competitive detection accuracy on two prevalent remote sensing-oriented object detection datasets: DOTA (80.82 mAP) and HRSC2016 (98.32 mAP). [ABSTRACT FROM AUTHOR]

Hyperspectral target detection (HTD) is a crucial aspect of remote sensing applications, aiming to identify targets in hyperspectral images (HSIs) based on their known prior spectral signatures. However, the spectral variability resulting from various imaging conditions in multi-temporal hyperspectral images poses a challenge to both classical and deep learning (DL) methods. To overcome the limitations imposed by spectral variability, an implicit contrastive learning-based target detector (ICLTD) is proposed to exploit in-scene spectra in an unsupervised way. First, only prior spectra are utilized for explicit supervision, while an implicit contrastive learning module (ICLM) is designed to normalize the feature distributions of prior and in-scene spectra. This paper theoretically demonstrates that the ICLM can transfer the gradients from prior spectral features to those of in-scene spectra based on their feature similarities and differences. Because of transferred gradient signals, the ICLTD is regularized to extract similar representations for the prior and in-scene target spectra, while augmenting feature differences between the target and background spectra. Additionally, a local spectral similarity constraint (LSSC) is proposed to enhance the capability of scene adaptation by leveraging the spectral similarities among in-scene targets. To validate the performance of the ICLTD under spectral variability, multi-temporal HSIs captured under various imaging conditions are collected to generate prior spectra and in-scene spectra. Comparative evaluations against several DL detectors and classical methods reveal the superior performance of the ICLTD in achieving a balance between target detectability and background suppressibility under spectral variability. [ABSTRACT FROM AUTHOR]

Optical remote sensing videos, as a new source of remote sensing data that has emerged in recent years, have significant potential in remote sensing applications, especially national defense. In this paper, a tracking pipeline named TDNet (tracking while detecting based on a neural network) is proposed for optical remote sensing videos based on a correlation filter and deep neural networks. The pipeline is used to simultaneously track ships and planes in videos. There are many target tracking methods for general video data, but they suffer some difficulties in remote sensing videos with low resolution and those influenced by weather conditions. The tracked targets are usually misty. Therefore, in TDNet, we propose a new multi-target tracking method called MT-KCF and a detecting-assisted tracking (i.e., DAT) module to improve tracking accuracy and precision. Meanwhile, we also design a new target recognition (i.e., NTR) module to recognise newly emerged targets. In order to verify the performance of TDNet, we compare our method with several state-of-the-art tracking methods on optical video remote sensing data sets acquired from the Jilin No. 1 satellite. The experimental results demonstrate the effectiveness and the state-of-the-art performance of the proposed method. The proposed method can achieve more than 90% performance in terms of precision for single-target tracking tasks and more than 85% performance in terms of MOTA for multi-object tracking tasks. [ABSTRACT FROM AUTHOR]

Heterogeneous change detection (CD) is widely applied in various fields such as urban planning, environmental monitoring, and disaster management. It enhances the accuracy and comprehensiveness of surface change monitoring by integrating multi-sensor remote sensing data. Scholars have proposed many graph-based methods to address the issue of incomparable heterogeneous images caused by imaging differences. However, these methods often overlook the influence of changes in vertex status on the graph structure, which limits their ability to represent image structural features. To tackle this problem, this paper presents an unsupervised heterogeneous CD method based on enhanced graph structure representation (EGSR). This method enhances the representation capacity of the graph structure for image structural features by measuring the unchanged probabilities of vertices, thereby making it easier to detect changes in heterogeneous images. Firstly, we construct the graph structure using image superpixels and measure the structural graph differences of heterogeneous images in the same image domain. Then, we calculate the unchanged probability of each vertex in the structural graph and reconstruct the graph structure using this probability. To accurately represent the graph structure, we adopt an iterative framework for enhancing the representation of the graph structure. Finally, at the end of the iteration, the final change map (CM) is obtained by binary segmentation of the graph vertices based on their unchanged probabilities. The effectiveness of this method is validated through experiments on four sets of heterogeneous image datasets and two sets of homogeneous image datasets. [ABSTRACT FROM AUTHOR]

The ecological quality of large-scale farms is a critical determinant of crop growth. In this paper, an ecological assessment procedure suitable for agricultural regions should be developed based on an improved remote sensing ecological index (IRSEI), which introduces an integrated salinity index (ISI) tailored to the salinized soil characteristics in farming areas and incorporates ecological indices such as the greenness index (NDVI), the humidity index (WET), the dryness index (NDBSI), and the heat index (LST). The results indicate that between 2013 and 2022, the mean IRSEI increasing from 0.500 in 2013 to 0.826 in 2020 before decreasing to 0.646 in 2022. From 2013 to 2022, the area of the farm that experienced slight to significant improvements in ecological quality reached 1419.91 km2, accounting for 71.94% of the total farm area. An analysis of different land cover types revealed that the IRSEI performed more reliably than did the original RSEI method. Correlation analysis based on crop yields showed that the IRSEI method was more strongly correlated with yield than was the RSEI method. Therefore, the proposed IRSEI method offers a rapid and effective new means of monitoring ecological quality for agricultural planting areas characterized by soil salinization, and it is more effective than the traditional RSEI method. [ABSTRACT FROM AUTHOR]

Cross-view geo-localization aims to locate street-view images by matching them with a collection of GPS-tagged remote sensing (RS) images. Due to the significant viewpoint and appearance differences between street-view images and RS images, this task is highly challenging. While deep learning-based methods have shown their dominance in the cross-view geo-localization task, existing models have difficulties in extracting comprehensive meaningful features from both domains of images. This limitation results in not establishing accurate and robust dependencies between street-view images and the corresponding RS images. To address the aforementioned issues, this paper proposes a novel and lightweight neural network for cross-view geo-localization. Firstly, in order to capture more diverse information, we propose a module for extracting multi-scale features from images. Secondly, we introduce contrastive learning and design a contrastive loss to further enhance the robustness in extracting and aligning meaningful multi-scale features. Finally, we conduct comprehensive experiments on two open benchmarks. The experimental results have demonstrated the superiority of the proposed method over the state-of-the-art methods. [ABSTRACT FROM AUTHOR]

As the number and variety of remote sensing satellites continue to grow, user demands are becoming increasingly complex and diverse. Concurrently, there is an escalating requirement for timeliness in satellite observations, thereby augmenting the complexity of task processing and resource allocation. In response to these challenges, this paper proposes an innovative method for dynamic task planning in multi-source remote sensing satellite cooperative observations tailored to complex scenarios. In the task processing phase, this study develops a preprocessing model suitable for various types of targets, enabling the decomposition of complex scenes into multiple point targets for independent satellite observation, thereby reducing the complexity of the problem. In the resource allocation phase, a dynamic task planning algorithm for multi-satellite cooperative observation is designed to achieve dynamic and optimized scheduling of the processed point targets, catering to the needs of multi-source remote sensing satellites. Empirical validation demonstrated that this method effectively implements dynamic adjustment plans for point targets, comprehensively optimizing the number of observation targets, computation time, task priority, and satellite resource utilization, significantly enhancing the dynamic observation efficiency of remote sensing satellites. [ABSTRACT FROM AUTHOR]

The paper evaluates the usability of remote satellite-based and proximal ground-based agrometeorological data sources for precision agriculture and crop production in Croatia. The compared agrometeorological datasets stem from the open-access data sources Copernicus CDS and the Agri4Cast portal, and commercial in situ agrometeorological stations (PinovaMeteo) which monitor environmental parameters relevant to the physiological state of crops. The study compares relevant parameters for 10 different locations in Croatia for three consecutive years (2019, 2020, and 2021) to investigate whether model-based data from ERA5-Land and Agri4Cast are well-correlated with ground measurements from independent in situ stations (PinovaMeteo) for specific agrometeorological parameters (air and soil temperature, and precipitation). Our results indicate the following: both the ERA5-Land and Agri4Cast datasets show mostly strong positive correlations with ground observations for air temperature, modest correlations for soil temperature, but modest or even low correlations for precipitation. Analysis of the residuals indicates higher overall residual values, especially in areas with complex topography and near large bodies of water or the sea, and deviations of residuals that may limit the usability of satellite- and model-based data for decision-making in agriculture. [ABSTRACT FROM AUTHOR]

Change detection in remote sensing enables identifying alterations in surface characteristics over time, underpinning diverse applications. However, conventional pixel-based algorithms encounter constraints in terms of accuracy when applied to medium- and high-resolution remote sensing images. Although object-oriented methods offer a step forward, they frequently grapple with missing small objects or handling complex features effectively. To bridge these gaps, this paper proposes an unsupervised object-oriented change detection approach empowered by hierarchical multi-scale segmentation for generating binary ecosystem change maps. This approach meticulously segments images into optimal sizes and leverages multidimensional features to adapt the Iteratively Reweighted Multivariate Alteration Detection (IRMAD) algorithm for GaoFen WFV data. We rigorously evaluated its performance in the Yellow River Source Region, a critical ecosystem conservation zone. The results unveil three key strengths: (1) the approach achieved excellent object-level change detection results, making it particularly suited for identifying changes in subtle features; (2) while simply increasing object features did not lead to a linear accuracy gain, optimized feature space construction effectively mitigated dimensionality issues; and (3) the scalability of our approach is underscored by its success in mapping the entire Yellow River Source Region, achieving an overall accuracy of 90.09% and F-score of 0.8844. Furthermore, our analysis reveals that from 2015 to 2022, changed ecosystems comprised approximately 1.42% of the total area, providing valuable insights into regional ecosystem dynamics. [ABSTRACT FROM AUTHOR]

In this paper, multi-source observation, such as aircraft, ground-based remote sensing, and satellite-retrieved data, has been utilized to compare and analyze the vertical characteristics of aerosol optical properties and the planetary boundary layer height (HPBL) over the North China Plain (NCP) region during May–June 2016. Aircraft observations show the vertical profiles of aerosol absorption coefficients (σabs), scattering coefficients (σsca), and extinction coefficients (σext) gradually decrease with altitude, with their maximum values near HPBL. The vertical profiles of σext depended most on the vertical distribution of measured σsca, indicating a significant contribution of scattering aerosols. In addition, the prominent characteristic of the inverse relationship between σext and moisture profile could serve as a reference for predicting air quality in the NCP region. The lower layer pollution during the field experiment was likely caused by the accumulation of fine-mode aerosols, characterized by the vertical distribution of the Ångström exponent and the Aerosol Robotic Network (AERONET) products. Typically, HPBL derived from aircraft and surface Micro Pulse Lidar (MPL) was approximate, while the predicted HPBL by meteorological data indicates an underestimation of ~192 m. Aerosol optical depth (AOD) calculated from aircraft and ground-based remote sensing (such as MPL and AERONET) experienced a strong correlation, and both of them exhibited a similar tendency. However, the AOD retrieved from satellites was significantly larger than that from aircraft and ground-based remote sensing. Overall, the inversion algorithm, cloud identification algorithm, representativeness of the space, and time of the observation may lead to an overestimation or underestimation of AOD under certain circumstances. This study may serve as a re-evaluation of AOD retrieved from multi-source observations and provide a reference to uncover the actual atmospheric environment in the NCP regions. [ABSTRACT FROM AUTHOR]

Lakes are an important component of global water resources. In order to achieve accurate lake extractions on a large scale, this study takes the Tibetan Plateau as the study area and proposes an Automated Lake Extraction Workflow (ALEW) based on the Google Earth Engine (GEE) and deep learning in response to the problems of a low lake identification accuracy and low efficiency in complex situations. It involves pre-processing massive images and creating a database of examples of lake extraction on the Tibetan Plateau. A lightweight convolutional neural network named LiteConvNet is constructed that makes it possible to obtain spatial–spectral features for accurate extractions while using less computational resources. We execute model training and online predictions using the Google Cloud platform, which leads to the rapid extraction of lakes over the whole Tibetan Plateau. We assess LiteConvNet, along with thresholding, traditional machine learning, and various open-source classification products, through both visual interpretation and quantitative analysis. The results demonstrate that the LiteConvNet model may greatly enhance the precision of lake extraction in intricate settings, achieving an overall accuracy of 97.44%. The method presented in this paper demonstrates promising capabilities in extracting lake information on a large scale, offering practical benefits for the remote sensing monitoring and management of water resources in cloudy and climate-differentiated regions. [ABSTRACT FROM AUTHOR]

Change detection (CD) stands out as a pivotal yet challenging task in the interpretation of remote sensing images. Significant developments have been witnessed, particularly with the rapid advancements in deep learning techniques. Nevertheless, challenges such as incomplete detection targets and unsmooth boundaries remain as most CD methods suffer from ineffective feature fusion. Therefore, this paper presents a multi-scale gated fusion network (MSGFNet) to improve the accuracy of CD results. To effectively extract bi-temporal features, the EfficientNetB4 model based on a Siamese network is employed. Subsequently, we propose a multi-scale gated fusion module (MSGFM) that comprises a multi-scale progressive fusion (MSPF) unit and a gated weight adaptive fusion (GWAF) unit, aimed at fusing bi-temporal multi-scale features to maintain boundary details and detect completely changed targets. Finally, we use the simple yet efficient UNet structure to recover the feature maps and predict results. To demonstrate the effectiveness of the MSGFNet, the LEVIR-CD, WHU-CD, and SYSU-CD datasets were utilized, and the MSGFNet achieved F1 scores of 90.86%, 92.46%, and 80.39% on the three datasets, respectively. Furthermore, the low computational costs and small model size have validated the superior performance of the MSGFNet. [ABSTRACT FROM AUTHOR]

This paper presents a methodology to detect the coastal erosion and progradation effects in the 'Atrato River' delta, located in the Gulf of Urabá in Colombia, using SAR (Synthetic Aperture Radar) images. Erosion is the physical–mechanical loss of the soil that affects its functions and ecosystem services while producing a reduction in its productive capacity. Progradation is the deposition of layers in the basinward direction while moving coastward. Other studies have investigated these two phenomena using optical images, encountering difficulties due to the persistent presence of clouds in this region. In order to avoid the cloud effects, in this study, we used 16 Sentinel 1 SAR images with two different polarizations between 2016 and 2023. First, each image was rescaled from 0 to 255, then the image was despeckled by a deep learning (DL) model. Afterwards, a single RGB image was composed with the filtered polarizations. Next, a classifier with 99% accuracy based on Otsu's method was used to determine whether each pixel was water or not. Then, the classified image was registered to a reference one using Oriented FAST and Rotated BRIEF (ORB) descriptor. Finally, a multitemporal analysis was performed by comparing every image to the previous one to identify the studied phenomena, calculating areas. Also, all images were integrated to obtain a heatmap that showed the overall changes across eight years (2016–2023) in a single image. The multitemporal analysis performed found that the newly created mouth is the most active area for these processes, coinciding with other studies. In addition, a comparison of these findings with the Oceanic Niño Index (ONI) showed a relative delayed coupling to the erosion process and a coupling of progradation with dry and wet seasons. [ABSTRACT FROM AUTHOR]

Mountainous terrains are typical over southeast China, with complex and diverse topography, large terrain undulations, rich geographic features, and meteorological variations. Previous studies show that ERA5 meteorological variables are generally accurate with respect to large plains or urban agglomerations, while their applicability to mountainous areas remains inconclusive. In this paper, using high-precision measurements probed by ground-based remote sensing instruments in May–July 2023 at a typical mountainous Shanghuang site in southeast China, the vertical accuracy of the ERA5 reanalysis datasets were comparatively evaluated. Our findings depict that the horizontal wind speeds of the ERA5 reanalysis data show a good performance compared to the Doppler lidar observations. In quantitative terms, ERA5 horizontal wind speeds are about 8% higher than the observed values below a height of 400 m, while above 400 m, an increasing negative bias is observed along as altitude increases. Differing from the horizontal wind speeds, there is a large discrepancy in the vertical wind speeds between the ERA5 and the observations, with a deviation of −150% to 40%. In terms of the thermal variables, the temperature extracted from ERA5 are consistent with the measurements in the low troposphere. Nevertheless, large systematic errors occur at 2000–3000 m, and the overall presentation shows that the errors gradually increase with the increase in altitude. Concerning the relative humidity, the general trend in ERA5 is similar to that observed by the microwave radiometer, but the relative errors from 500 to 2500 m range from 40% to 100%. This study also reveals that ERA5 is poorly representative and requires further improvements during extreme weather events such as rainstorms and typhoons. In particular, the horizontal wind speeds at the middle and lower levels deviate strongly from the observations. Given the importance of atmospheric thermodynamic stratifications in terms of both environmental and climatic issues, the results expand the application of the ERA5 reanalysis datasets in the mountainous areas of southeast China. More importantly, it provides credible reference data for the meteorological predictions and climate modelings in the southeast China mountainous region. [ABSTRACT FROM AUTHOR]

The Bidirectional Reflectance Distribution Function (BRDF) is a critical spatial distribution parameter in the quantitative research of remote sensing and has a wide range of applications in radiometric correction, elemental inversion, and surface feature estimation. As a new means of BRDF modeling, UAV push-broom hyperspectral imaging is limited by the push-broom imaging method, and the multi-angle information is often difficult to obtain. In addition, the random variation of solar illumination during UAV low-altitude flight makes the irradiance between different push-broom hyperspectral rows and different airstrips inconsistent, which significantly affects the radiometric consistency of BRDF modeling and results in the difficulty of accurately portraying the three-dimensional spatial reflectance distribution in the UAV model. These problems largely impede the application of outdoor BRDF. Based on this, this paper proposes a fast multi-angle information acquisition scheme with a high-accuracy BRDF modeling method considering illumination variations, which mainly involves a lightweight system for BRDF acquisition and three improved BRDF models considering illumination corrections. We adopt multi-rectangular nested flight paths for multi-gray level targets, use multi-mode equipment to acquire spatial illumination changes and multi-angle reflectivity information in real-time, and introduce the illumination correction factor K through data coupling to improve the kernel, Hapke, and RPV models, and, overall, the accuracy of the improved model is increased by 20.83%, 11.11%, and 31.48%, respectively. The results show that our proposed method can acquire multi-angle information quickly and accurately using push-broom hyperspectral imaging, and the improved model eliminates the negative effect of illumination on BRDF modeling. This work is vital for expanding the multi-angle information acquisition pathway and high-efficiency and high-precision outdoor BRDF modeling. [ABSTRACT FROM AUTHOR]

Several deep learning and transformer models have been recommended in previous research to deal with the classification of hyperspectral images (HSIs). Among them, one of the most innovative is the bidirectional encoder representation from transformers (BERT), which applies a distance-independent approach to capture the global dependency among all pixels in a selected region. However, this model does not consider the local spatial-spectral and spectral sequential relations. In this paper, a dual-dimensional (i.e., spatial and spectral) BERT (the so-called D2BERT) is proposed, which improves the existing BERT model by capturing more global and local dependencies between sequential spectral bands regardless of distance. In the proposed model, two BERT branches work in parallel to investigate relations among pixels and spectral bands, respectively. In addition, the layer intermediate information is used for supervision during the training phase to enhance the performance. We used two widely employed datasets for our experimental analysis. The proposed D2BERT shows superior classification accuracy and computational efficiency with respect to some state-of-the-art neural networks and the previously developed BERT model for this task. [ABSTRACT FROM AUTHOR]

The fusion of hyperspectral imagery (HSI) and light detection and ranging (LiDAR) data for classification has received widespread attention and has led to significant progress in research and remote sensing applications. However, existing common CNN architectures suffer from the significant drawback of not being able to model remote sensing images globally, while transformer architectures are not able to capture local features effectively. To address these bottlenecks, this paper proposes a classification framework for multisource remote sensing image fusion. First, a spatial and spectral feature projection network is constructed based on parallel feature extraction by combining HSI and LiDAR data, which is conducive to extracting joint spatial, spectral, and elevation features from different source data. Furthermore, in order to construct local–global nonlinear feature mapping more flexibly, a network architecture coupling together multiscale convolution and a multiscale vision transformer is proposed. Moreover, a plug-and-play nonlocal feature token aggregation module is designed to adaptively adjust the domain offsets between different features, while a class token is employed to reduce the complexity of high-dimensional feature fusion. On three open-source remote sensing datasets, the performance of the proposed multisource fusion classification framework improves about 1% to 3% over other state-of-the-art algorithms. [ABSTRACT FROM AUTHOR]

With the emergence of the Smart City concept, the rapid advancement of urban three-dimensional (3D) reconstruction becomes imperative. While current developments in the field of 3D reconstruction have enabled the generation of 3D products such as Digital Surface Models (DSM), challenges persist in accurately reconstructing shadows, handling occlusions, and addressing low-texture areas in very-high-resolution remote sensing images. These challenges often lead to difficulties in calculating satisfactory disparity maps using existing stereo matching methods, thereby reducing the accuracy of 3D reconstruction. This issue is particularly pronounced in urban scenes, which contain numerous super high-rise and densely distributed buildings, resulting in large disparity values and occluded regions in stereo image pairs, and further leading to a large number of mismatched points in the obtained disparity map. In response to these challenges, this paper proposes a method to refine the disparity in urban scenes based on open-source GIS data. First, we register the GIS data with the epipolar-rectified images since there always exists unignorable geolocation errors between them. Specifically, buildings with different heights present different offsets in GIS data registering; thus, we perform multi-modal matching for each building and merge them into the final building mask. Subsequently, a two-layer optimization process is applied to the initial disparity map based on the building mask, encompassing both global and local optimization. Finally, we perform a post-correction on the building facades to obtain the final refined disparity map that can be employed for high-precision 3D reconstruction. Experimental results on SuperView-1, GaoFen-7, and GeoEye satellite images show that the proposed method has the ability to correct the occluded and mismatched areas in the initial disparity map generated by both hand-crafted and deep-learning stereo matching methods. The DSM generated by the refined disparity reduces the average height error from 2.2 m to 1.6 m, which demonstrates superior performance compared with other disparity refinement methods. Furthermore, the proposed method is able to improve the integrity of the target structure and present steeper building facades and complete roofs, which are conducive to subsequent 3D model generation. [ABSTRACT FROM AUTHOR]

Autonomous Unmanned Aerial Vehicles (UAVs) have possible applications in wildlife monitoring, disaster monitoring, and emergency Search and Rescue (SAR). Autonomous capabilities such as waypoint flight modes and obstacle avoidance, as well as their ability to survey large areas, make UAVs the prime choice for these critical applications. However, autonomous UAVs usually rely on the Global Navigation Satellite System (GNSS) for navigation and normal visibility conditions to obtain observations and data on their surrounding environment. These two parameters are often lacking due to the challenging conditions in which these critical applications can take place, limiting the range of utilisation of autonomous UAVs. This paper presents a framework enabling a UAV to autonomously navigate and detect targets in GNSS-denied and visually degraded environments. The navigation and target detection problem is formulated as an autonomous Sequential Decision Problem (SDP) with uncertainty caused by the lack of the GNSS and low visibility. The SDP is modelled as a Partially Observable Markov Decision Process (POMDP) and tested using the Adaptive Belief Tree (ABT) algorithm. The framework is tested in simulations and real life using a navigation task based on a classic SAR operation in a cluttered indoor environment with different visibility conditions. The framework is composed of a small UAV with a weight of 5 kg, a thermal camera used for target detection, and an onboard computer running all the computationally intensive tasks. The results of this study show the robustness of the proposed framework to autonomously explore and detect targets using thermal imagery under different visibility conditions. Devising UAVs that are capable of navigating in challenging environments with degraded visibility can encourage authorities and public institutions to consider the use of autonomous remote platforms to locate stranded people in disaster scenarios. [ABSTRACT FROM AUTHOR]

Image captioning is a technique that enables the automatic extraction of natural language descriptions about the contents of an image. On the one hand, information in the form of natural language can enhance accessibility by reducing the expertise required to process, analyze, and exploit remote sensing images, while on the other, it provides a direct and general form of communication. However, image captioning is usually restricted to a single sentence, which barely describes the rich semantic information that typically characterizes remote sensing (RS) images. In this paper, we aim to move one step forward by proposing a captioning system that, mimicking human behavior, adopts dialogue as a tool to explore and dig for information, leading to more detailed and comprehensive descriptions of RS scenes. The system relies on a questions–answers scheme fed by a query image and summarizes the dialogue content with ChatGPT. Experiments carried out on two benchmark remote sensing datasets confirm the potential of such an approach in the context of semantic information mining. Strengths and weaknesses are highlighted and discussed, as well as some possible future developments. [ABSTRACT FROM AUTHOR]

High dynamic range imaging (HDRI) is an essential task in remote sensing, enhancing low dynamic range (LDR) remote sensing images and benefiting downstream tasks, such as object detection and image segmentation. However, conventional frame-based HDRI methods may encounter challenges in real-world scenarios due to the limited information inherent in a single image captured by conventional cameras. In this paper, an event-based remote sensing HDR imaging framework is proposed to address this problem, denoted as ERS-HDRI, which reconstructs the remote sensing HDR image from a single-exposure LDR image and its concurrent event streams. The proposed ERS-HDRI leverages a coarse-to-fine framework, incorporating the event-based dynamic range enhancement (E-DRE) network and the gradient-enhanced HDR reconstruction (G-HDRR) network. Specifically, to efficiently achieve dynamic range fusion from different domains, the E-DRE network is designed to extract the dynamic range features from LDR frames and events and perform intra- and cross-attention operations to adaptively fuse multi-modal data. A denoise network and a dense feature fusion network are then employed for the generation of the coarse, clean HDR image. Then, the G-HDRR network, with its gradient enhancement module and multiscale fusion module, performs structure enforcement on the coarse HDR image and generates a fine informative HDR image. In addition, this work introduces a specialized hybrid imaging system and a novel, real-world event-based remote sensing HDRI dataset that contains aligned remote sensing LDR images, remote sensing HDR images, and concurrent event streams for evaluation. Comprehensive experiments have demonstrated the effectiveness of the proposed method. Specifically, it improves state-of-the-art PSNR by about 30% and the SSIM score by about 9% on the real-world dataset. [ABSTRACT FROM AUTHOR]

As rainfall exhibits high spatiotemporal variability, accurate and real-time rainfall monitoring is vitally important in fields such as hydrometeorological research, agriculture and disaster prevention and control. Nevertheless, the current dedicated rain sensors cannot fulfill the requirement for comprehensive precipitation observation, owing to their respective limitations. Within the last two decades, the utilization of commercial microwave links (CMLs) for rainfall estimation, as an opportunistic sensing method, has generated considerable attention. Relying on CML networks deployed and maintained by mobile network operators can provide near-surface precipitation information over large areas at a low cost. Although scholars have developed several algorithms for obtaining rainfall estimates from CML data, the rainfall estimation technique based on CMLs remains challenging due to the complex effect in the microwave radiation transmission process. In this paper, we provide a comprehensive review of the technical principles, developments and workflows for this technology, alongside its application in environmental monitoring and hydrological modeling. Furthermore, this paper outlines the current challenges and future research directions, which will hopefully draw the attention of researchers and provide valuable guidance. [ABSTRACT FROM AUTHOR]

In this paper, we investigate deep-learning-based image inpainting techniques for emergency remote sensing mapping. Image inpainting can generate fabricated targets to conceal real-world private structures and ensure informational privacy. However, casual inpainting outputs may seem incongruous within original contexts. In addition, the residuals of original targets may persist in the hiding results. A Residual Attention Target-Hiding (RATH) model has been proposed to address these limitations for remote sensing target hiding. The RATH model introduces the residual attention mechanism to replace gated convolutions, thereby reducing parameters, mitigating gradient issues, and learning the distribution of targets present in the original images. Furthermore, this paper modifies the fusion module in the contextual attention layer to enlarge the fusion patch size. We extend the edge-guided function to preserve the original target information and confound viewers. Ablation studies on an open dataset proved the efficiency of RATH for image inpainting and target hiding. RATH had the highest similarity, with a 90.44 % structural similarity index metric (SSIM), for edge-guided target hiding. The training parameters had 1 M fewer values than gated convolution (Gated Conv). Finally, we present two automated target-hiding techniques that integrate semantic segmentation with direct target hiding or edge-guided synthesis for remote sensing mapping applications. [ABSTRACT FROM AUTHOR]

Lanzhou City is located in the semi-arid region of northwest China, which experiences serious desertification. Moreover, the high intensity of land development, with the accelerated industrialization and urbanization, causes increasingly aggravated conflict between humans and the environment. Exploring the response of the ecological environment quality to the natural environment and anthropogenic activities is important to protect the sustainable development of urban economic construction and the environment. Based on the Google Earth Engine (GEE) platform, this paper constructed a modified Remote Sensing Ecological Index (MRSEI) model which could reflect the ecological environment quality by integrating the desertification index (DI) into the Remote Sensing Ecological index (RSEI) model. This paper explores the spatiotemporal variation in the environmental quality from 2000 to 2020 in Lanzhou, China, and analyzes the natural and anthropogenic factors affecting the environment quality in terms of temperature, precipitation, gross domestic product (GDP), land use, night lighting, and population. The results showed that the mean value of MRSEI ranged from 0.254 to 0.400. The area undergoing fast growth in ecological quality was in the northwestern part of Lanzhou, and the area of decrease was in the central part. Various factors have different degrees of influence on the ecosystem, with temperature, precipitation, and land use having a greater impact, and GDP and population having a limited impact. Precipitation and temperature showed a strong impact when interacting with other factors, demonstrating that precipitation and temperature were also key factors affecting MRSEI. Overall, climate change and the implementation of ecological restoration projects have led to an improvement in the quality of the ecological environment in Lanzhou. This study provides a reference for understanding the spatiotemporal changes in the ecological environment in semi-arid Lanzhou and is conducive to formulating proper protection strategies. [ABSTRACT FROM AUTHOR]

Data processing of low-altitude remote sensing visible images from UAVs is one of the hot research topics in precision agriculture aviation. In order to solve the problems of large model size with slow detection speed that lead to the inability to process images in real time, this paper proposes a lightweight target detector CURI-YOLOv7 based on YOLOv7tiny which is suitable for individual citrus tree detection from UAV remote sensing imagery. This paper augmented the dataset with morphological changes and Mosica with Mixup. A backbone based on depthwise separable convolution and the MobileOne-block module was designed to replace the backbone of YOLOv7tiny. SPPF (spatial pyramid pooling fast) was used to replace the original spatial pyramid pooling structure. Additionally, we redesigned the neck by adding GSConv and depth-separable convolution and deleted its input layer from the backbone with a size of (80, 80) and its output layer from the head with a size of (80, 80). A new ELAN structure was designed, and the redundant convolutional layers were deleted. The experimental results show that the GFLOPs = 1.976, the parameters = 1.018 M, the weights = 3.98 MB, and the mAP = 90.34% for CURI-YOLOv7 in the UAV remote sensing imagery of the citrus trees dataset. The detection speed of a single image is 128.83 on computer and 27.01 on embedded devices. Therefore, the CURI-YOLOv7 model can basically achieve the function of individual tree detection in UAV remote sensing imagery on embedded devices. This forms a foundation for the subsequent UAV real-time identification of the citrus tree with its geographic coordinates positioning, which is conducive to the study of precise agricultural management of citrus orchards. [ABSTRACT FROM AUTHOR]

In recent years, there has been a growing interest in remote sensing image–text cross-modal retrieval due to the rapid development of space information technology and the significant increase in the volume of remote sensing image data. Remote sensing images have unique characteristics that make the cross-modal retrieval task challenging. Firstly, the semantics of remote sensing images are fine-grained, meaning they can be divided into multiple basic units of semantic expression. Different combinations of basic units of semantic expression can generate diverse text descriptions. Additionally, these images exhibit variations in resolution, color, and perspective. To address these challenges, this paper proposes a multi-task guided fusion encoder (MTGFE) based on the multimodal fusion encoding method, the progressiveness of which has been proved in the cross-modal retrieval of natural images. By jointly training the model with three tasks: image–text matching (ITM), masked language modeling (MLM), and the newly introduced multi-view joint representations contrast (MVJRC), we enhance its capability to capture fine-grained correlations between remote sensing images and texts. Specifically, the MVJRC task is designed to improve the model's consistency in joint representation expression and fine-grained correlation, particularly for remote sensing images with significant differences in resolution, color, and angle. Furthermore, to address the computational complexity associated with large-scale fusion models and improve retrieval efficiency, this paper proposes a retrieval filtering method, which achieves higher retrieval efficiency while minimizing accuracy loss. Extensive experiments were conducted on four public datasets to evaluate the proposed method, and the results validate its effectiveness. [ABSTRACT FROM AUTHOR]

Object detection in remote sensing images (RSIs) has become crucial in recent years. However, researchers often prioritize detecting small objects, neglecting medium- to large-sized ones. Moreover, detecting objects hidden in shadows is challenging. Additionally, most detectors have extensive parameters, leading to higher hardware costs. To address these issues, this paper proposes a multi-scale and high-precision lightweight object detector named MHLDet. Firstly, we integrated the SimAM attention mechanism into the backbone and constructed a new feature-extraction module called validity-neat feature extract (VNFE). This module captures more feature information while simultaneously reducing the number of parameters. Secondly, we propose an improved spatial pyramid pooling model, named SPPE, to integrate multi-scale feature information better, enhancing the model to detect multi-scale objects. Finally, this paper introduces the convolution aggregation crosslayer (CACL) into the network. This module can reduce the size of the feature map and enhance the ability to fuse context information, thereby obtaining a feature map with more semantic information. We performed evaluation experiments on both the SIMD dataset and the UCAS-AOD dataset. Compared to other methods, our approach achieved the highest detection accuracy. Furthermore, it reduced the number of parameters by 12.7% compared to YOLOv7-Tiny. The experimental results illustrated that our proposed method is more lightweight and exhibits superior detection accuracy compared to other lightweight models. [ABSTRACT FROM AUTHOR]

The lack of high-resolution training sets for intelligent landslide recognition using high-resolution remote sensing images is a major challenge. To address this issue, this paper proposes a method for reconstructing low-resolution landslide remote sensing images based on a Super-Resolution Generative Adversarial Network (SRGAN) to fully utilize low-resolution images in the process of constructing high-resolution landslide training sets. First, this paper introduces a novel Enhanced Depth Residual Block called EDCA, which delivers stable performance compared to other models while only slightly increasing model parameters. Secondly, it incorporates coordinated attention and redesigns the feature extraction module of the network, thus boosting the learning ability of image features and the expression of high-frequency information. Finally, a residual stacking-based landslide remote sensing image reconstruction strategy was proposed using EDCA residual blocks. This strategy employs residual learning to enhance the reconstruction performance of landslide images and introduces LPIPS for evaluating the test images. The experiment was conducted using landslide data collected by drones in the field. The results show that compared with traditional interpolation algorithms and classic deep learning reconstruction algorithms, this approach performs better in terms of SSIM, PSNR, and LPIPS. Moreover, the network can effectively handle complex features in landslide scenes, which is beneficial for subsequent target recognition and disaster monitoring. [ABSTRACT FROM AUTHOR]

Accurate building extraction for high-resolution remote sensing images is critical for topographic mapping, urban planning, and many other applications. Its main task is to label each pixel point as a building or non-building. Although deep-learning-based algorithms have significantly enhanced the accuracy of building extraction, fully automated methods for building extraction are limited by the requirement for a large number of annotated samples, resulting in a limited generalization ability, easy misclassification in complex remote sensing images, and higher costs due to the need for a large number of annotated samples. To address these challenges, this paper proposes an improved interactive building extraction model, ARE-Net, which adopts a deep interactive segmentation approach. In this paper, we present several key contributions. Firstly, an adaptive-radius encoding (ARE) module was designed to optimize the interaction features of clicks based on the varying shapes and distributions of buildings to provide maximum a priori information for building extraction. Secondly, a two-stage training strategy was proposed to enhance the convergence speed and efficiency of the segmentation process. Finally, some comprehensive experiments using two models of different sizes (HRNet18s+OCR and HRNet32+OCR) were conducted on the Inria and WHU building datasets. The results showed significant improvements over the current state-of-the-art method in terms of N o C 90 . The proposed method achieved performance enhancements of 7.98% and 13.03% with HRNet18s+OCR and 7.34% and 15.49% with HRNet32+OCR on the WHU and Inria datasets, respectively. Furthermore, the experiments demonstrated that the proposed ARE-Net method significantly reduced the annotation costs while improving the convergence speed and generalization performance. [ABSTRACT FROM AUTHOR]

The airborne hyperspectral remote sensing systems (AHRSSs) acquire images with high spectral resolution, high spatial resolution, and high temporal dimension. While the AHRSS captures more detailed information from the terrain objects, the computational complexity of data processing is greatly increased. As an important application technology in the hyperspectral domain, anomaly detection (AD) processing must be real-time and high-precision in many cases, such as post-disaster rescue, military battlefield search, and natural disaster detection. In this paper, the real-time AD technology for the push-broom AHRSS is studied, the mathematical model is established, and a novel implementation framework is proposed. Firstly, the optimized kernel minimum noise fraction (OP-KMNF) transformation is employed to extract informative and discriminative features between the background and anomalies. Secondly, the Nyström method is introduced to reduce the computational complexity of OP-KMNF transformation by decomposing and extrapolating the sub-kernel matrix to estimate the eigenvector of the entire kernel matrix. Thirdly, the extracted features are transferred to hard disks for data storage. Then, taking the extracted features as input data, the background separation model-based CEM anomaly detector (BSM-CEMAD) is imported to detect anomalies. Finally, graphics processing unit (GPU) parallel computing is utilized in the Nyström-based OP-KMNF (NOP-KMNF) transformation and the BSM-CEMAD to improve the execution efficiency, and the real-time AD for the push-broom AHRSS could be realized. To test the feasibility of the implementation framework proposed in this paper, the experiment is carried out with the Airborne Multi-Modular Imaging Spectrometer (AMMIS) developed by the Shanghai Institute of Technical Physics as the data acquisition platform. The experimental results show that the proposed method outperforms many other state-of-the-art AD methods in anomalies detection and background suppression. Moreover, under the condition that the downlink data could retain most of the hyperspectral data information, the proposed method achieves real-time detection of pixel-level anomalies, with the initial delay not exceeding 1 s, the false alarm rate (FAR) less than 5%, and the true positive rate (TPR) close to 98%. [ABSTRACT FROM AUTHOR]

The main task of remote sensing image target detection is to locate and classify the targets of interest in remote sensing images, which plays an important role in intelligence investigation, disaster relief, industrial application, and other fields. However, the targets in the remote sensing image scene have special problems such as special perspective, scale diversity, multi-direction, small targets, and high background complexity. In this paper, the YOLOv5 target detection algorithm is improved according to the above characteristics. Aiming at the problem of large target size span in remote sensing images, this paper uses K-Means++ clustering algorithm to eliminate the problem in which the original clustering algorithm is sensitive to initial position, noise, and outliers, and optimizes the instability caused by K-Means clustering to obtain preset anchor frames. Aiming at the redundancy of background information around the location of remote sensing image targets, the large number of small targets, and the denseness of targets, a double IoU-aware decoupling head (DDH) is introduced at the output end to replace the coupled yolo head, which eliminates the interference caused by different task sharing parameters. At the same time, the correlation between positioning accuracy and classification accuracy is improved by the IoU-aware method. The attention mechanism is introduced into the backbone network to optimize the detection and small target detection in complex backgrounds. The mAP of the improved YOLOv5 algorithm is improved by 9%, and the detection effect of small targets and dense targets is significantly improved. At the same time, the paper has achieved good results through the verification of the DIOR remote sensing data set and has also achieved good performance advantages in comparison with other models. [ABSTRACT FROM AUTHOR]

Deep learning has gained widespread interest in the task of building semantic segmentation modelling using remote sensing images; however, neural network models require a large number of training samples to achieve better classification performance, and the models are more sensitive to error patches in the training samples. The training samples obtained in semi-supervised classification methods need less reliable weakly labelled samples, but current semi-supervised classification research puts the generated weak samples directly into the model for applications, with less consideration of the impact of the accuracy and quality improvement of the weak samples on the subsequent model classification. Therefore, to address the problem of generating and optimising the quality of weak samples from training data in deep learning, this paper proposes a semi-supervised building classification framework. Firstly, based on the test results of the remote sensing image segmentation model and the unsupervised classification results of LiDAR point cloud data, this paper quickly generates weak image samples of buildings. Secondly, in order to improve the quality of the spots of the weak samples, an iterative optimisation strategy of the weak samples is proposed to compare and analyse the weak samples with the real samples and extract the accurate samples from the weak samples. Finally, the real samples, the weak samples, and the optimised weak samples are input into the semantic segmentation model of buildings for accuracy evaluation and analysis. The effectiveness of this paper's approach was experimentally verified on two different building datasets, and the optimised weak samples improved by 1.9% and 0.6%, respectively, in the test accuracy mIoU compared to the initial weak samples. The results demonstrate that the semi-supervised classification framework proposed in this paper can be used to alleviate the model's demand for a large number of real-labelled samples while improving the ability to utilise weak samples, and it can be used as an alternative to fully supervised classification methods in deep learning model applications that require a large number of training samples. [ABSTRACT FROM AUTHOR]

Currently, there is a wealth of data and expert knowledge available on monitoring agro-meteorological disasters. However, there is still a lack of technical means to organically integrate and analyze heterogeneous data sources in a collaborative manner. This paper proposes a method for monitoring agro-meteorological disasters based on a spatio-temporal knowledge graph. It employs a semantic ontology framework to achieve the organic fusion of multi-source heterogeneous data, including remote sensing data, meteorological data, farmland data, crop information, etc. And it formalizes expert knowledge and computational models into knowledge inference rules, thereby enabling monitoring, early warning, and disaster analysis of agricultural crops within the observed area. The experimental area for this research is the wheat planting region in three counties in Henan Province. The method is tested using simulation monitoring, early warning, and impact calculation of the past two occurrences of dry hot wind disasters. The experimental results demonstrate that the proposed method can provide more specific and accurate warning information and post-disaster analysis results compared to raw records. The statistical results of NDVI decline also validate the correlation between the severity of wheat damage caused by dry hot winds and the intensity and duration of their occurrences. Regarding remote sensing data, this paper proposes a method that directly incorporates remote sensing data into spatio-temporal knowledge inference calculations. By integrating remote sensing data into the regular monitoring process, the advantages of remote sensing data granted by continuous observation are utilized. This approach represents a beneficial attempt to organically integrate remote sensing and meteorological data for monitoring, early warning, and evaluation analysis of agro-meteorological disasters. [ABSTRACT FROM AUTHOR]

In order to obtain high-quality images, the application of low-illumination image enhancement techniques plays a vital role in enhancing the overall visual appeal. However, it is particularly difficult to enhance an image while maintaining the original information of the scene. The augmentation method based on Retinex theory is widely considered as one of the representative techniques for such problems, but this method still has some limitations. First of all, noise is easily ignored in the process of model building, and the robustness of the model needs to be improved. Secondly, the image decomposition is less effective, so that part of the image information is not effectively presented. Finally, the optimization procedure is computationally complicated. This paper introduces a novel approach for enhancing low-illumination images by utilizing the relative deviation of local gradients. The proposed method aims to address the challenges associated with low-illumination images and offers a solution to these issues. In this paper, local gradient relative deviation is used as a constraint term and a noise term is added to highlight the image texture and structure and improve the robustness of the models, considering that L P achieves piecewise smoothing with better sparsity compared to the sum norm commonly used by L 1 and L 2 norms. In this paper, the L 2 − L P norm is used to constrain the model, which smooths the illumination component and better preserves the details of the reflectance component. In addition, to efficiently solve the optimization problem, the alternating direction multiplier method is chosen to transform the optimization process into the solution of several sub-problems. In comparison to traditional Retinex models, the proposed method excels in its ability to simultaneously enhance the image and suppress noise effectively. The experimental outcomes demonstrate the effectiveness of the proposed model in enhancing both simulated and real data. This approach can be applied to low-illumination remote sensing images to obtain high-quality remote sensing image data. [ABSTRACT FROM AUTHOR]

At present, a variety of global remote sensing surface downwelling longwave radiation (SDL) products are used for atmospheric science research; however, there are few studies on the quantitative evaluation of differences among different SDL products. In order to evaluate the differences among different SDL products quantitatively, we have selected three commonly used SDL products—Clouds and the Earth's Radiant Energy System-Synoptic Radiative Fluxes and Clouds (CERES-SYN), the European Centre for Medium Range Weather Forecasts-Surface Radiation Budget (ECMWF-SRB) and the Global Energy and Water Exchanges Project-Surface Radiation Budget (GEWEX-SRB)—to comprehensively study in this paper. The results show that there are significant differences among the three SDL products in some areas, such as in the Arctic, the Antarctic, the Sahara, the Tibet Plateau, and Greenland. The maximum absolute root mean square error (RMSEab) in these areas is greater than 20 Wm−2, the maximum relative root mean square error (RMSEre) is greater than 20%, the maximum and minimum absolute mean bias error (MBEab) are about 20 Wm−2 and −20 Wm−2, respectively, and the maximum and minimum relative mean bias error (MBEre) are about 10% and −10%, respectively. Among the three SDL products, the difference between the ECMWF-SRB and GEWEX-SRB is the most significant. In addition, this paper also analyzed the differences among different SDL products based on three aspects. Firstly, the differences among the three SDL products show that there is significant seasonality, and the differences among different months may vary greatly. However, the differences are not sensitive to years. Secondly, there are some differences in cloud-forcing radiative fluxes (CFRFs) of different SDL products, which is also an important factor affecting the difference between different SDL products. Finally, in the process of converting high temporal resolution SDL products into monthly SDL products, data processing also affects the difference between different SDL products. [ABSTRACT FROM AUTHOR]

Earth observation (EO) techniques have significantly evolved over time, covering a wide range of applications in different domains. The scope of this study is to review the research conducted on EO in the Eastern Mediterranean, Middle East, and North Africa (EMMENA) region and to identify the main knowledge gaps. We searched through the Web of Science database for papers published between 2018 and 2022 for EO studies in the EMMENA. We categorized the papers in the following thematic areas: atmosphere, water, agriculture, land, disaster risk reduction (DRR), cultural heritage, energy, marine safety and security (MSS), and big Earth data (BED); 6647 papers were found with the highest number of publications in the thematic areas of BED (27%) and land (22%). Most of the EMMENA countries are surrounded by sea, yet there was a very small number of studies on MSS (0.9% of total number of papers). This study detected a gap in fundamental research in the BED thematic area. Other future needs identified by this study are the limited availability of very high-resolution and near-real-time remote sensing data, the lack of harmonized methodologies and the need for further development of models, algorithms, early warning systems, and services. [ABSTRACT FROM AUTHOR]

Forest fires are one of the most devastating natural disasters, and technologies based on remote sensing satellite data for fire prevention and control have developed rapidly in recent years. Early forest fire smoke in remote sensing images, on the other hand, is thin and tiny in area, making it difficult to detect. Satellites with high spatial resolution sensors can collect high-resolution photographs of smoke, however the impact of the satellite's repeat access time to the same area means that forest fire smoke cannot be detected in time. Because of their low spatial resolution, photos taken by satellites with shorter return durations cannot capture small regions of smoke. This paper presents an early smoke detection method for forest fires that combines a super-resolution reconstruction network and a smoke segmentation network to address these issues. First, a high-resolution remote sensing multispectral picture dataset of forest fire smoke was created, which included diverse years, seasons, areas, and land coverings. The rebuilt high-resolution images were then obtained using a super-resolution reconstruction network. To eliminate data redundancy and enhance recognition accuracy, it was determined experimentally that the M11 band (2225–2275 nm) is more sensitive to perform smoke segmentation in VIIRS images. Furthermore, it has been demonstrated experimentally that improving the accuracy of reconstructed images is more effective than improving perceptual quality for smoke recognition. The final results of the super-resolution image segmentation experiment conducted in this paper show that the smoke segmentation results have a similarity coefficient of 0.742 to the segmentation results obtained using high-resolution satellite images, indicating that our method can effectively segment smoke pixels in low-resolution remote sensing images and provide early warning of forest fires. [ABSTRACT FROM AUTHOR]

Multi-class geospatial object detection in high-resolution remote sensing images has significant potential in various domains such as industrial production, military warning, disaster monitoring, and urban planning. However, the traditional process of remote sensing object detection involves several time-consuming steps, including image acquisition, image download, ground processing, and object detection. These steps may not be suitable for tasks with shorter timeliness requirements, such as military warning and disaster monitoring. Additionally, the transmission of massive data from satellites to the ground is limited by bandwidth, resulting in time delays and redundant information, such as cloud coverage images. To address these challenges and achieve efficient utilization of information, this paper proposes a comprehensive on-board multi-class geospatial object detection scheme. The proposed scheme consists of several steps. Firstly, the satellite imagery is sliced, and the PID-Net (Proportional-Integral-Derivative Network) method is employed to detect and filter out cloud-covered tiles. Subsequently, our Manhattan Intersection over Union (MIOU) loss-based YOLO (You Only Look Once) v7-Tiny method is used to detect remote-sensing objects in the remaining tiles. Finally, the detection results are mapped back to the original image, and the truncated NMS (Non-Maximum Suppression) method is utilized to filter out repeated and noisy boxes. To validate the reliability of the scheme, this paper creates a new dataset called DOTA-CD (Dataset for Object Detection in Aerial Images-Cloud Detection). Experiments were conducted on both ground and on-board equipment using the AIR-CD dataset, DOTA dataset, and DOTA-CD dataset. The results demonstrate the effectiveness of our method. [ABSTRACT FROM AUTHOR]

Antarctica is of great importance in terms of global warming, the sustainability of resources, and the conservation of biodiversity. However, due to 99.66% of the continent being covered in ice and snow, geological research and geoscientific study in Antarctica face huge challenges. Geophysical surveys play a crucial role in enhancing comprehension of the fundamental structure of Antarctica. This study used bibliometric analysis to analyze citation data retrieved from the Web of Science for the period from 1982 to 2022 with geophysical research on Antarctica as the topic. According to the analysis results, the amount of Antarctic geophysical research has been steadily growing over the past four decades as related research countries/regions have become increasingly invested in issues pertaining to global warming and sustainability, and international cooperation is in sight. Moreover, based on keyword clustering and an analysis of highly cited papers, six popular research topics have been identified: Antarctic ice sheet instability and sea level change, Southern Ocean and Sea Ice, tectonic activity of the West Antarctic rift system, the paleocontinental rift and reorganization, magmatism and volcanism, and subglacial lakes and subglacial hydrology. This paper provides a detailed overview of these popular research topics and discusses the applications and advantages of the geophysical methods used in each field. Finally, based on keywords regarding abrupt changes, we identify and examine the thematic evolution of the nexus over three consecutive sub-periods (i.e., 1990–1995, 1996–2005, and 2006–2022). The relevance of using geophysics to support numerous and diverse scientific activities in Antarctica becomes very clear after analyzing this set of scientific publications, as is the importance of using multiple geophysical methods (satellite, airborne, surface, and borehole technology) to revolutionize the acquisition of new data in greater detail from inaccessible or hard-to-reach areas. Many of the advances that they have enabled be seen in the Antarctic terrestrial areas (detailed mapping of the geological structures of West and East Antarctica), ice, and snow (tracking glaciers and sea ice, along with the depth and features of ice sheets). These valuable results help identify potential future research opportunities in the field of Antarctic geophysical research and aid academic professionals in keeping up with recent advances. [ABSTRACT FROM AUTHOR]

The rapid advancement of remote sensing technology has significantly enhanced the temporal resolution of remote sensing data. Multitemporal remote sensing image classification can extract richer spatiotemporal features. However, this also presents the challenge of mining massive data features. In response to this challenge, deep learning methods have become prevalent in machine learning and have been widely applied in remote sensing due to their ability to handle large datasets. The combination of remote sensing classification and deep learning has become a trend and has developed rapidly in recent years. However, there is a lack of summary and discussion on the research status and trends in multitemporal images. This review retrieved and screened 170 papers and proposed a research framework for this field. It includes retrieval statistics from existing research, preparation of multitemporal datasets, sample acquisition, an overview of typical models, and a discussion of application status. Finally, this paper discusses current problems and puts forward prospects for the future from three directions: adaptability between deep learning models and multitemporal classification, prospects for high-resolution image applications, and large-scale monitoring and model generalization. The aim is to help readers quickly understand the research process and application status of this field. [ABSTRACT FROM AUTHOR]

In recent years, the tensor completion algorithm has played a vital part in the reconstruction of missing elements within high-dimensional remote sensing image data. Due to the difficulty of tensor rank computation, scholars have proposed many substitutions of tensor rank. By introducing the smooth rank function (SRF), this paper proposes a new tensor rank nonconvex substitution function that performs adaptive weighting on different singular values to avoid the performance deficiency caused by the equal treatment of all singular values. On this basis, a novel tensor completion model that minimizes the SRF as the objective function is proposed. The proposed model is efficiently solved by adding the hot start method to the alternating direction multiplier method (ADMM) framework. Extensive experiments are carried out in this paper to demonstrate the resilience of the proposed model to missing data. The results illustrate that the proposed model is superior to other advanced models in tensor completeness. [ABSTRACT FROM AUTHOR]

Hyperspectral image (HSI) classification is one of the hotspots in remote sensing, and many methods have been continuously proposed in recent years. However, it is still challenging to achieve high accuracy classification in applications. One of the main reasons is the lack of labeled data. Due to the limitation of spatial resolution, manual labeling of HSI data is time-consuming and costly, so it is difficult to obtain a large amount of labeled data. In such a situation, many researchers turn their attention to the study of HSI classification with small samples. Focusing on this topic, this paper provides a systematic review of the research progress in recent years. Specifically, this paper contains three aspects. First, considering that the taxonomy used in previous review articles is not well-developed and confuses the reader, we propose a novel taxonomy based on the form of data utilization. This taxonomy provides a more accurate and comprehensive framework for categorizing the various approaches. Then, using the proposed taxonomy as a guideline, we analyze and summarize the existing methods, especially the latest research results (both deep and non-deep models) that were not included in the previous reviews, so that readers can understand the latest progress more clearly. Finally, we conduct several sets of experiments and present our opinions on current problems and future directions. [ABSTRACT FROM AUTHOR]

In deep learning-based hyperspectral remote sensing image classification tasks, random sampling strategies are typically used to train model parameters for testing and evaluation. However, this approach leads to strong spatial autocorrelation between the training set samples and the surrounding test set samples, and some unlabeled test set data directly participate in the training of the network. This leaked information makes the model overly optimistic. Models trained under these conditions tend to overfit to a single dataset, which limits the range of practical applications. This paper analyzes the causes and effects of information leakage and summarizes the methods from existing models to mitigate the effects of information leakage. Specifically, this paper states the main issues in this area, where the issue of information leakage is addressed in detail. Second, some algorithms and related models used to mitigate information leakage are categorized, including reducing the number of training samples, using spatially disjoint sampling strategies, few-shot learning, and unsupervised learning. These models and methods are classified according to the sample-related phase and the feature extraction phase. Finally, several representative hyperspectral image classification models experiments are conducted on the common datasets and their effectiveness in mitigating information leakage is analyzed. [ABSTRACT FROM AUTHOR]

In the solar reflective band, an on-board calibration method based on a solar diffuser (SD) can realize full aperture, full field of view, and end-to-end absolute radiometric calibration of optical remote sensors. The SD's bidirectional reflectance distribution function (BRDF) is a key parameter that affects the accuracy of the on-board calibration. High-accuracy measurement of the SD BRDF is required in the laboratory before launch. Due to the uncertainty of the goniometer system, polarization effects, and other factors, the measurement uncertainty of the SD BRDF at large incident angles is much higher than that at a 0° incident zenith angle and 45° reflection zenith angle. In this paper, an absolute BRDF measurement facility is reported. The goniometric system consists of a high-brightness integrating sphere as a radiation source, a six-axis robot arm, and a large rotation stage. The measurement wavelength range was from 350 nm to 2400 nm. An improved data processing method based on the reciprocity theorem was proposed to reduce the measurement uncertainty of the SD BRDF at large incident angles. At an incident zenith angle of 75°, the improved data processing method reduced the measurement uncertainty of the SD BRDF by 52% at 410 nm to 480 nm, by 70% at 480 nm to 1000 nm, and by 20% at other bands compared to the absolute measurement method. The influence of the radiation source, goniometer system, detection system, and other factors on the measurement uncertainty are analyzed in this paper. The results show that the measurement uncertainty (coverage factor k = 2) of the SD BRDF was better than 1.04% at 350 nm to 410 nm, 0.60% at 410 nm to 480 nm, 0.43% at 480 nm to 1000 nm, and 0.86% at 1000 nm to 2400 nm. [ABSTRACT FROM AUTHOR]

Over the past two decades, advances in remote sensing methods and technology have enabled larger and more sophisticated datasets to be collected. Due to these advances, the need to effectively and efficiently communicate and visualize data is becoming increasingly important. We demonstrate that the use of mixed- (MR) and virtual reality (VR) systems has provided very promising results, allowing the visualization of complex datasets with unprecedented levels of detail and user experience. However, as of today, such visualization techniques have been largely used for communication purposes, and limited applications have been developed to allow for data processing and collection, particularly within the engineering–geology field. In this paper, we demonstrate the potential use of MR and VR not only for the visualization of multi-sensor remote sensing data but also for the collection and analysis of geological data. In this paper, we present a conceptual workflow showing the approach used for the processing of remote sensing datasets and the subsequent visualization using MR and VR headsets. We demonstrate the use of computer applications built in-house to visualize datasets and numerical modelling results, and to perform rock core logging (XRCoreShack) and rock mass characterization (EasyMineXR). While important limitations still exist in terms of hardware capabilities, portability, and accessibility, the expected technological advances and cost reduction will ensure this technology forms a standard mapping and data analysis tool for future engineers and geoscientists. [ABSTRACT FROM AUTHOR]