Search

In recent years, low-rank sparse representation (LRR) schemes have been applied to the field of hyperspectral image (HSI) anomaly detection (AD) and received attention. However, it is often accompanied by a small amount of noise in the AD, which leads to a high false alarm rate of detection results. In this paper, the HSI-AD algorithm is proposed to address this problem. First, the HSI is unmixed using the deep network to obtain the endmembers and abundance, and the abundance matrix is fused with the HSI to obtain the mixed data, which to a certain extent complements the spatial information of the HSI because the abundance matrix can reflect the subpixel-level information of the target image elements. Then, the mixed data are decomposed based on the model proposed in this paper. To overcome the situation that the sparse part of the traditional model is prone to mix with a small amount of noise, the sparse decomposition of the mixed data into anomaly and noise is used to remove the small amount of noise from the sparse part. A joint dictionary consisting of background and anomaly is used in the above model. In addition, to address the problem of information loss caused by the uniform accumulation of kernel norm over all singular values in the process of model decomposition, this paper designs the γ norm decomposition method to replace the general kernel norm decomposition for a more effective extraction of useful information. [ABSTRACT FROM AUTHOR]

In the context of global carbon emission reduction, solar photovoltaic (PV) technology is experiencing rapid development. Using high-resolution remote sensing images to accurately obtain PV information over a large region, including location and size, has the advantages of high statistical efficiency and timely data update for the PV energy management. Due to the intra-class diversity of PV panels and the intricate variability in their deployment environments, existing semantic segmentation methods often have problems such as under-segmentation and mis-segmentation. To alleviate these problems, this paper proposes an improved DeepLabv3+ semantic segmentation network to more accurately extract PV panels from high-resolution remote sensing images. With the aim of alleviating under-segmentation, a multi-level context aggregation module is developed. This module can enhance the model's ability to learn the characteristics of PV panels and their surrounding environment by aggregating rich contextual information from multi-scale and semantic levels. To alleviate the problem of mis-segmentation, a hybrid attention module is introduced. This module sequentially and adaptively adjusts the weight distribution in both the channel and spatial dimensions, thus enabling the model to focus more on the feature information and spatial positions of PV objects. Experiments conducted on a self-constructed Beijing PV segmentation dataset show that the method in this paper has advantages of completeness and accuracy in extracting PV panels compared to the baseline model and current mainstream semantic segmentation network. In addition, the results of experiments on extracting PV panels in real region show that our model also has good stability and generalization capability. [ABSTRACT FROM AUTHOR]

Point cloud registration is the process of aligning and merging multiple point clouds into a same coordinate system. It has many applications in computer vision, robotics, 3D reconstruction, augmented reality, and autonomous driving. Despite its wide-ranging utility, traditional algorithms grapple with challenges such as substantial noise, outliers, limited overlap, motion distortions, and handling large scenes. These complexities impede the effective deployment of point cloud registration in practical real-world scenarios. This paper conducts a comprehensive inquiry into the domain of deep learning-based point cloud registration. It synthesizes recent advancements in algorithms about point cloud registration grounded in deep learning. The exposition delineates insights from four distinct perspectives: multi-layer perceptron, deep neural network, graph convolutional network, and attention mechanism. Furthermore, the paper systematically reviews prevalent datasets and evaluation metrics associated with deep learning-based point cloud registration. A discussion on the existing challenges in point cloud registration and a forward-looking exploration of potential research directions are included. [ABSTRACT FROM AUTHOR]

Leaf area index (LAI) assessment methods relying on physical and empirical models are considered to be the most commonly used method at present, but their estimation efficiency and accuracy are deficient. Although the hybrid model of these two methods can address these issues, a poor coupling mechanism can easily occur. Given that, a PROSAIL model coupling particle swarm optimization (PSO) neural network (NN) algorithm (PSO-NN-PROSAIL model) was introduced to invert the winter wheat LAI (WWLAI) at five distinct growth stages. The Xiangfu District in the east of Kaifeng City, Henan Province was served as the study region. Based on the measured WWLAI data at varying stages and GF-1 WFV satellite images, the initial analysis focused on assessing the PROSAIL model's sensitivity in simulating vegetation canopy reflectance. It then calculated six vegetation index models according to the wavelength reflectance of GF-1 WFV and analysed their correlation with LAI to select the input parameters that could be used in the model. Normalized differential vegetation Index (NDVI) and ratio vegetation Index (RVI) as well as vegetation canopy reflectance were employed as input parameters to invert the WWLAI by adopting the PSO-NN-PROSAIL model. The experimental results showed the following: (1) In the vegetation index model, the determination coefficient (R2) of NDVI and RVI was greater than 0.68, implying that NDVI and RVI might serve as input factors for the proposed model in this paper; (2) LAI and chlorophyll a + b content (Cab) were most sensitive to the PROSAIL model in near-infrared and visible light bands; and (3) the PSO-NN-PROSAIL model possessed better LAI inversion accuracy. In summary, the model proposed in this paper provided a technical reference for rapid and accurate remote sensing monitoring of WWLAI. The optimization technology of particle swarm optimization algorithm is integrated into the neural network, and the weight of the neural network is adjusted by its fitness function transformation and inertia weight. By integrating prior knowledge into the inversion of crop leaf area index constructed by machine learning and radiative transfer model, the ill-posed problem of physical model inversion has been improved. [ABSTRACT FROM AUTHOR]

Seagrass beds play a vital ecological role by regulating climate, maintaining biodiversity, and sequestering carbon. Achieving accurate classification of seagrass beds across both time and space is of significant importance for efficient monitoring. This paper addresses the challenges of seagrass bed classification in remote sensing imagery and the difficulty of achieving temporal and spatial transferability of classification model. Leveraging a long-term Landsat satellite image time series spanning from 1976 to 2022 in the Yellow River Delta, we enhance the DeepLab V3+ network and propose a cross-temporal-spatial domain seagrass bed transfer learning classification approach. We utilize selectively chosen images from a few years in partial regions for training, introduce freeze-training and-unfreeze-training during the model training phase, and then transfer the model to achieve cross-temporal and cross-temporal-spatial domain classification on images from other years and regions. Additionally, we discuss the factors influencing the classification results. The research results indicate that: (1)The method we proposed has shown good results, achieving classification accuracy of 83.17% and 80.99% for seagrass beds in both cross-temporal and cross-temporal-spatial domains. (2) The classification results indicate that this method achieves an average classification accuracy higher by 16.18% compared to networks such as UNet, PSPNet, HRNet, UNet++, SegFormer, etc. under cross-temporal conditions and higher by 17.56% under cross-spatiotemporal conditions for seagrass bed classification. (3) Based on the classification results, it is observed that from 1973 to 1986, the overall area of seagrass beds in the Yellow River Delta had an initial growth trend, with the largest seagrass bed area recorded in 1986, reaching 4281.289 hectares. Subsequently, the seagrass beds showed an overall decreasing trend, and by 2019 they had almost completely disappeared. The cross-temporal-spatial domain seagrass bed transfer learning classification method proposed in this paper can provide valuable support for the monitoring, restoration, management, and utilization of seagrass ecosystems. [ABSTRACT FROM AUTHOR]

Classification of hyperspectral image (HSI) is an essential step in various remote sensing tasks. Currently, transformer-based models have made significant contributions to HSI classification due to their remarkable ability to model the relation among long-range sequence data. However, HSI data exhibit strong nonlinear coupling and strong correlation, leading to a decrease in the classification performance of transformer-based models. The SpectralFormer network has achieved excellent performance in HSI classification, but its cross-layer adaptive fusion mechanism cannot effectively highlight critical information, affecting the representation ability of spectral-spatial features. To address the above issues, this paper proposes an HSI classification method based on local feature decoupling and SpectralFormer with a hybrid attention module (HAMSF) network. Specifically, this paper first uses the histogram of oriented gradient algorithm to preprocess HSI coupled data and achieve preliminary nonlinear decoupling of HSI data. Secondly, the hybrid attention module is embedded in a cross-layer adaptive fusion mechanism, generating refined neighbouring information before each information fusion to improve the spectral-spatial feature representation ability. Finally, the processed data are input into the HAMSF network for the final decoupling and classification of HSI. The experiment is carried out on three benchmark hyperspectral datasets, and the experimental results confirm that the proposed method has better classification performance compared to several transformer-based and classical HSI classification methods. [ABSTRACT FROM AUTHOR]

Initialization plays an important role in the accuracy of endmember extraction algorithms (EEAs) in linear hyperspectral unmixing (LHU). Random initialization can lead to varying endmembers generated by EEAs. To address this challenge, an initialization strategy has been introduced, encompassing vertex component analysis (VCA), automatic target generation process (ATGP), among others. These techniques significantly contribute to enhancing the accuracy of EEAs. However, complex initialization is sometimes less preferable, prompting the unexplored question of whether there exists an EEA robust to initialization. This paper focuses on analyzing this issue within the context of minimum simplex volume-based (MV) methods, which have received considerable attention in the past two decades due to their robustness against the absence of pure pixels. MV methods typically formulate LHU as an optimization problem, most of which includes a non-convex volume term. Additionally, many MV methods use VCA as an initialization strategy. Firstly, this paper demonstrates that the variable splitting augmented Lagrangian approach (SISAL), as a representative non-convex MV method, heavily depends on initialization. To our knowledge, the impact of initialization for MV methods has not been thoroughly analyzed before. Furthermore, this paper proposes an initially robust MV method by introducing a new convex MV term. Numerical experiments conducted on simulated and real datasets demonstrate its outstanding performance in accuracy and robustness to initialization. Throughout the experiments the proposed method proves to be the most stable, which is crucial in real scene where the ground truth is unknown beforehand. [ABSTRACT FROM AUTHOR]

Classification with a few samples of training set has been a long-standing issue in the field of polarimetric synthetic aperture radar (PolSAR) image analysis and processing. In fact, one of the most important challenges of the PolSAR image classification task is the number of labelled samples. In essence, training network by utilizing just few numbers of training samples cannot be led to the reliable result since the neural network is so sensitive to the number of training samples. In addition, in the real PolSAR image classification task, the huge number of training samples is not accessible. On the other hand, classification performance using just small number of labelled samples is not an accurate result. So, in this paper, aiming at the small number of training samples of the PolSAR image classification task, a novel ensemble self-supervised feature-learning (ESSFL) model is designed. The designed ESSFL can automatically extract PolSAR features conducive to PolSAR image classification with a small number of training samples. In addition, it can significantly decrease the dependence of neural network algorithms on large labelled samples of training set. First, to utilize the spatial–polarimetric features of PolSAR data perfectly, the EfficientNet-B0 is presented and utilized as the main section of the deep learning (DL) model to extract DL features of PolSAR data. Then, using an optimization function that constrains the cross-correlation matrix of various distortions of each sample to the identity matrix, the designed deep learning model can obtain the effective features of homogeneous samples gathering together and heterogeneous samples separating from each other in a self-supervised manner. Moreover, two ensemble learning (EL) models, feature-level and view-level ensemble, are proposed to increase the feature extraction capability and classification result by jointly using spatial features at different scales and polarimetric information at different bands. Finally, the stack of the obtained features and the main polarimetric information of PolSAR data can be input into classifier for the classification of PolSAR data. In this paper we use two different classifiers, the first one is the Random Forest (RF) classifier and the second one is the Support Vector Machine (SVM) classifier. The advantages of SVM include that it can be used to avoid the difficulties of using linear functions in the high-dimensional feature space, and the optimization problem is transformed into dual convex quadratic programs that are so usable for an actual image classification task. In addition, among all the available classification methods, random forests provide one of the highest accuracies. The random forest technique can also handle big data with numerous variables running into thousands. In fact, it can automatically balance data sets when a class is more infrequent than other classes in the data that is so important for a real PolSAR image classification task. Experimental results on three well-known PolSAR data sets illustrate that the designed ESSFL can extract more discriminant features using the designed deep learning model. In the end, the experiments prove that the designed ESSFL has a significant classification performance compared with different deep learning models in the case of small number of training samples, and also it can achieve a better result in the case of large number of training samples by comparison with the most of the deep learning models. [ABSTRACT FROM AUTHOR]

The 2-D compact variational mode decomposition (2-D-C-VMD) has potential research significance in data mining of hyperspectral images (HSIs). The paper proposes a method of concatenation of features. First, the 2-D-C-VMD technique is used to decompose the HSIs to obtain smooth and clear boundary sub-band images when the 2-D-C-VMD takes the most preferred a priori parameter K ×. Second, the optimal low-frequency component features of the image and the optimal high-frequency component constructed features are concatenated first and last, and the structure of the concatenation is constructed into a new fused data. Finally, in order to avoid the redundancy of the fused data band information from affecting the classification result, combine a recently developed simple and practical superpixelwise principal component analysis (SuperPCA) dimensionality reduction method to effectively reduce the dimensionality of the fused data. By comparing the analysis with relying only on the optimal low-frequency image feature information and with the direct linear superposition fusion that has been employed, it is verified that the concatenation of features approach proposed in this paper can obtain better recognition results. [ABSTRACT FROM AUTHOR]

Multilabel remote sensing image classification (MLRSIC) has received increasing research interest. Taking the co-occurrence relationship of multiple labels as additional information helps to improve the overall performance. However, current methods only focus on using it to constrain the final feature which is output from a convolutional neural network (CNN). On the one hand, these methods need to exploit the potential of label correlation in feature representation fully. On the other hand, they increase the label noise sensitivity of the system, resulting in poor robustness. In this paper, a novel method called 'Semantic Interleaving Global chaNnel Attention' (SIGNA) is proposed for MLRSIC. First, the label co-occurrence graph is obtained according to the statistical information of the training set and fed into a graph neural network (GNN) to generate optimal semantic feature representations of each label. Next, the semantic features are interleaved with visual features which are extracted by CNNs to guide the overall features of the input image transform from the original feature space to the semantic feature space with embedded label relations. Then, global attention triggered by semantic interleaving is used to emphasize visual features in important channels. Finally, to make SIGNA easier to use and more optimized, multihead SIGNA-based feature adaptive weighting networks are proposed as plug-in blocks to plug into any layers of a CNN. For remote sensing images, better classification performance can be achieved by inserting the plug-in blocks into the shallow layers of CNNs. We conducted extensive experimental comparisons on three data sets: UCM, AID and DFC15. Experimental results demonstrate that the proposed SIGNA achieves superior classification performance compared to state-of-the-art (SOTA) methods. Notes that the codes of this paper will be open to the community for reproducibility research. [ABSTRACT FROM AUTHOR]

Building roofs are crucial elements that must be extracted from satellite images for use in services like updating geodatabases, risk analysis and rescue maps. The diversity and complexity of the building structures present challenges for accurate and efficient building rooftop extraction from very high resolution (VHR) images. The significance of building extraction from satellite imagery in various applications has attracted the attention of the research community in this domain. In this paper, the progression of the research in building extraction is presented based on two streams, such as Traditional building extraction techniques and Evolving DL-based building extraction techniques. Furthermore, the categorization of traditional techniques into transform-based techniques, indices-based methodologies and machine learning-based methodologies are summarized. An enhanced comprehension of the challenges associated with extracting buildings from aerial images using DL models is given. A performance analysis of the popular Deep Learning models used for building extraction, such as UNet, SegNet, ResUNet, UNet++, ENRUNet and Dilated ResUNet, in terms of Accuracy, IoU and Dice Loss is presented. We hope that this paper will improve researchers' understanding of the problems associated with extraction of buildings from images and ultimately to develop new models with better performance. [ABSTRACT FROM AUTHOR]

In this paper, sea surface waves during complex sea state (i.e. tropical cyclones (TCs) and Kuroshio current) are inverted from dual-polarized (vertical – vertical (VV) and vertical – horizontal (VH)) synthetic aperture radar (SAR) images using an existing algorithm, namely, the parameterized first-guess spectrum method (PFSM). In particular, the wind term is included in two modulation transfer functions (MTFs), i.e. tilt modulation and velocity bunching. More than 3000 Sentinel (S-1) images acquired in interferometric wide (IW) mode and extra wide (EW) mode are collected, and the operational CyclObs wind product provided by the French Research Institute for Exploitation of the Oceans (IFREMER) is collected corresponding to the TC images. Note that these images are located within 500 km away from TC eyes. The wave spectra during the TCs are then inverted using the PFSM algorithm and the SAR-derived wind product. Simultaneously, the 0.05° gridded wave spectra collocated with these images are simulated using a third-generation numeric wave model, called WAVEWATCH-III (WW3), in which the reconstructed wind based on the European Centre for Medium-Range Weather Forecasts (ECMWF), the Copernicus Marine Environment Monitoring Service (CMEMS) current, and the CMEMS sea level are treated as the forcing field. Comparison of the SAR wave retrievals and simulations reveals that the root mean square errors (RMSEs) of the significant wave height (SWH) and mean wave period (MWP) are 0.55 m and 0.43 s, their correlation coefficients (COR) are 0.94 and 0.92, and their scatter index (SI) values are 0.17 and 0.07. These results demonstrate the better performance of the PFSM algorithm using theoretical MTFs, i.e. an RMSE of 0.68 m and COR of 0.90 for the SWH and an RMSE of 0.60 s and a COR of 0.87 for the MWP. Although the accuracy of the wave retrieval from the SAR image under complex sea state is improved when implementing the tilt and velocity bunching MTFs with the strong wind term, SWH retrievals by algorithm PFSM suffer saturation problem at SWH > 8 m. [ABSTRACT FROM AUTHOR]

The intelligent segmentation of high-resolution remote sensing (HRS) image, also called as dense prediction task for HRS image, has been and will continue to be important research in the remote sensing community. In recent years, the growing wave of artificial intelligence (AI) technology has introduced innovative paradigms to this domain, yielding outstanding results and overcoming many challenges with conventional segmentation techniques. This paper provides a comprehensive review of these intelligent segmentation methodologies, including traditional pattern recognition, convolution neural network (CNN)-based, and Transformer-based techniques. However, the explosive but incomplete development of intelligent segmentation techniques also poses more challenges for earth observation experts, the most of which is the technical interpretability. Consequently, we consider these segmentation techniques in the aspect of explainable artificial intelligence (XAI). Data-centric XAI thinks the practical applications of the segmentation model while model-centric XAI will facilitate the understanding of decision-making processes and the adjustment of structural features. Moreover, this review identifies novel research questions and provides constructive insights and recommendations to HRS image segmentation tasks, which may shed new light on the intelligent segmentation methods within the remote sensing image understanding community. [ABSTRACT FROM AUTHOR]

Land-cover classification based on remote sensing technology has been adopted for decision-making concerning agricultural development, urban planning, and ecosystem protection in arid oasis zones. The semantic segmentation method based on deep learning, as a new paradigm, can effectively overcome the limitations of traditional pixel-based and object-based methods and obtain good classification results from high spatial resolution (HSR) remote sensing images. However, how to extract the exact category boundary and realize the high precision mapping is still a problem. This paper proposes a novel high-resolution feature pyramid attention network (HRFPANet) for land-cover classification. It effectively integrates the advantages of multi-scale feature extraction, attention mechanism, and feature fusion and alleviates boundary inconsistency, roughness, and category fragmentation associated with previous semantic segmentation models. The experimental results show that the mIoU score of HRFPANet is 79.5%, which is 11.5% and 2.6% higher than that of PSPNet and UPerNet, respectively. It proves the proposed model can be used for qualified land-cover mapping in arid oasis zones. Our source code is available at . [ABSTRACT FROM AUTHOR]

Marine mucilage, also known as sea-snot, is an environmental disaster with ecological, economical, and public health-related impacts, which is occurring with increasing frequency and severity worldwide. One of the latest mucilage occurrences, the mucilage outbreak of Spring 2021 in the Sea of Marmara, lasted for well over three months and covered more than area of 1160 $k{m^2}$ k m 2 , and was repeated in 2022, although to a smaller extent in terms of duration, coverage area, and severity. Remotely sensed images acquired by Earth observation sensors provide a convenient and promising alternative for environmental monitoring of marine mucilage, with respect to field and laboratory work which are costly, require expert knowledge, and which have to be conducted in a small time-window and have limited generalizability due to the under-sampling of a large medium with a highly dynamic character. This work presents an unmixing-based approach using nonnegative matrix factorization for marine mucilage monitoring from remotely sensed hyperspectral data. The proposed method enables to identify the spectral signature of mucilage, and its variants where applicable, and the precise detection and estimation of mucilage concentrations in affected regions. Additionally, the proposed approach facilitates monitoring the temporal variations of mucilage presence, distribution, and accumulation, between data acquired from the same region at different dates or times. This enables quantitative spatio-temporal mapping of distributions and the potential of assessing the severity of outbreaks, without the requirement of manually prepared ground truth maps or carefully selected thresholds. Real hyperspectral data acquired by the PRISMA mission are used to validate the proposed approach qualitatively and quantitatively. The paper also discusses future directions and recommendations to enhance the performance and applicability of the proposed approach for marine mucilage analysis, and environmental monitoring in general. [ABSTRACT FROM AUTHOR]

The use of deep learning-based high resolution remote sensing image sea and land segmentation method has become prevalent in various fields such as environmental monitoring, resource assessment, and urban planning. However, the segmentation process faces challenges due to the complex coastline and the similarity in spectral colour difference between the sea and land in certain areas. The remote sensing images obtained from satellites often exhibit unclear boundaries between the sea and land, as well as intricate coastlines. Consequently, the segmentation of sea and land becomes a difficult task. The existing sea-land segmentation methods have limitations in accurately segmenting long and narrow waters, as well as areas with low differentiation between sea and land. In this paper, we propose a new sea-land segmentation method called SRMA (Swin-Res-Multi-Attention). SRMA performs parallel feature extraction using a dual-branch parallel: Swin-Transformer branch and ResNet branch. The combination of Swin-Transformer's self-attention and ResNet's residual design helps reduce the loss of feature information, thereby avoiding incorrect segmentation in regions with low distinctness. To improve overall stability, we introduce the MCA (Multiscale channel attention module) module, which combines feature information from different scales. The multi-scale pyramid design of MCA module ensures stability and improves segmentation accuracy in narrow waters. Experimental results on a public dataset demonstrate that our model outperforms existing methods. Additionally, we evaluate the model's performance in complex scenarios by creating a new dataset that includes a complex urban water body and cloud interference. The results showcase the robustness and superiority of our model. [ABSTRACT FROM AUTHOR]

This paper addresses the challenge of training deep learning models for fire smoke scene detection from multi-sensor, multi-spectral satellite imagery, where spectral bands vary and training data is scarce, especially for new sensors. We introduce a novel cross-sensor transfer learning approach enhanced by spectral pattern extraction, notably aided by a deep learning (DL) module called Input Amplification (IA). Our contribution includes the creation of two datasets, Landsat_smk2770 and Sentinel2_smk, with varying spectral bands. We employ a model named IA_VIB_SD which incorporates IA and is designed specifically for fire smoke scene detection. We investigated the transferability of the Landsat_smk2770-trained IA_VIB_SD model to the Sentinel2_smk dataset using various transfer learning techniques, and compared the performance of the transferred model with the benchmark IA_VIB_SD model exclusively trained on pure Sentinel2_smk data. Our proposed transfer learning approach resulted in a transferred model with an average accuracy 5% higher than the benchmark model. Notably, Our proposed transfer learning approach outperformed existing transfer learning methods by more than 1% in terms of the accuracy, even when trained on a mere 10% of the Sentinel2_smk dataset. This research advances fire smoke scene detection from multi-sensor, multi-spectral satellite imagery. [ABSTRACT FROM AUTHOR]

Remote sensing detection is a difficult task that requires not only identifying objects with complex background, quality, and angle issues, but also being lightweight enough to be carried by edge devices. In real remote sensing scenarios, achieving accurate, fast, and low-resource-consumption automated detection remains a significant challenge. Therefore, this paper proposes an efficient balanced network (EB-Net) for real remote sensing devices. First, a dynamic sparse attention (DSA) mechanism is proposed and has been proven with high performance via the complexity analysis. In addition, a new dynamic sparse transformer (DSFormer) is constructed using DSA, which enhances feature information and adapts to image resolution by self-attention and multi-headed attention, and achieves more flexible computation by random sampling. Then, three versions of discrete distribution IoU (DDIoU) are defined for adapting various scenarios and tasks in remote sensing, and this loss function makes the model achieve high accuracy and more lightweight. Finally, to make the model more lightweight, a cropped SPPF (CroSPPF) is presented, which significantly improves the computational efficiency by the lightweight of the sequence structure and activation function. Ablation experiments are conducted on the NWPU VHR-10 dataset, and demonstrate the effectiveness of the proposed methods. Numerous comparisons with state-of-the-art detectors are conducted on the NWPU VHR-10, RSOD and DOTA datasets. The experiments show that EB-Net outperforms state-of-the-art remote sensing detection models in comprehensive performance and achieves end-to-end accurate and lightweight detection. [ABSTRACT FROM AUTHOR]

In this paper, an improving spatiotemporal image fusion (STIF) incorporating unmixing step by considering the point spread function (PSF) effect model (CPSF) is proposed to address the problem that unmixing accuracy in STIF models incorporating unmixing step is vulnerable to the PSF effect. First, an unsupervised clustering algorithm is used to cluster the fine image at previous date into a land cover map, and the coarse class fraction matrix is generated from this land cover map. Second, the fine class fraction matrix uncontaminated by the PSF effect is calculated by upsampling the coarse class fraction matrix using the Area-to-Point Kriging (ATPK) method under the PSF constraint. Third, this fine class fraction matrix is convolved with the ideal square wave filter to downsample, and then normalized to obtain the coarse class fraction matrix without the influence of the PSF effect. Finally, the CPSF-processed class fraction matrix is used to replace the original one in the following unmixing and prediction process to generate the fine resolution image at the prediction date. Experiments on two remote sensing data sets show that the proposed method can effectively improve the accuracy of spatiotemporal image fusion methods incorporating unmixing step. [ABSTRACT FROM AUTHOR]

The development of the modern urban economy is closely tied to road construction, with roads being one of the most crucial components in urban development. The use of high-resolution remote sensing images to monitor the road conditions in cities and surrounding towns has become a highly emphasized research focus in recent years. However, due to the complexity of the environment, this task still faces significant challenges. For instance, urban road structures are intricate, which involve multiple lanes, intersections, building obstructions, etc. Rural roads may consist of narrow paths or irregular dirt roads. In addressing these issues, this paper proposes a road extraction algorithm based on a Dual-Encoder-Decoder U- Net (DEDU-Net). The algorithm leverages a dual encoder-decoder network to extract multi-scale information from the image. It then employs a dual decoder network to restore the feature map to the original image, achieving precise road extraction. Additionally, a new module, the Global Fusion Module (GFM), is introduced. This module achieves global context information fusion by weighting features. In the experimental section, two publicly available datasets were used for testing: the CHN6-CUG dataset and the Gansu Mountain Road dataset. For example, for the Gansu Mountain Road and CHN6-CUG mixed dataset, the model achieved an Overall Accuracy (OA) of 94.947% and a mean Intersection over Union (mIoU) of 70.971%. The results indicate that compared to traditional methods, this proposed method exhibits higher accuracy and robustness. It can adapt to both urban and rural roads, delivering outstanding performance even in complex scenarios. [ABSTRACT FROM AUTHOR]

Advances in hardware capabilities and big data technologies over the past decade have enabled the application of deep learning techniques to address the challenge of super-resolution in remote-sensing images. Recently, while deep-learning-based methods have outperformed traditional methods, the abundance of information in remote-sensing images creates an imbalance between performance and computational resource consumption in current deep-learning-based methods. This paper introduces a stable super-resolution algorithm based on parameter reconstructive optimization to address these issues. First, based on the stable super-resolution generative adversarial network (SSRGAN), the algorithm employs a generator with networks using residual connections to reconstruct images with enhanced resolution. Next, it extracts content, adversarial, and regularization losses using the discriminator from a stable super-resolution generative adversarial network, which in turn guides the training of the network. Finally, upon completion of training, structural re-parameterization is conducted to optimize the multi-branch trained network into a plain inference network. This inference network can serve as an individual new generator. The results of qualitative and quantitative experimental comparisons with the models Bicubic, super-resolution convolutional neural network, very deep super-resolution convolutional network, deep recursive residual network, super-resolution generative adversarial network (SRGAN), enhanced SRGAN, and stable SRGAN on the Gaofen-5 AHSI satellite dataset suggest that this algorithm achieves improved evaluation indices with a 4× magnification ratio, reaching a peak signal-to-noise ratio of 30.7207 dB and structural similarity index measure of 0.8178. Compared with the trained but unconverted generator, which can also work independently, implementing re-parameterization results in approximately a 10% reduction in the number of parameters, indicating lower resource consumption, while the reconstruction effect is minimally influenced. Furthermore, the super-resolution results exhibit richer detail, increased contrast, and better scene adaptability. [ABSTRACT FROM AUTHOR]

Multiple kernel learning (MKL) is an efficient way to improve hyperspectral image classification with few training samples by integrating spectral and spatial features. Nonetheless, presenting a MKL algorithm to capture significant information and eliminate redundancy is indispensable. In this paper, a novel graph-based MKL method (GMKL) is introduced to enhance the performance of the MKL algorithm and achieve high discriminative features, resulting in maximum separability. To do so, an informative low-rank graph is determined via a new algorithm called block diagonal representation that takes into account both local and global data structures. Then, in lieu of a time-consuming search for finding the optimal combination of the basic kernels, unlike the prior works, an optimal projective direction is acquired using graph theory. Various basic kernels generated from superpixels and attribute profiles are projected to produce a discriminative combination of kernels. Eventually, the optimum kernel is given to the support vector machine classifier. Experiments have been conducted on two popular hyperspectral datasets (Indian Pines and Pavia University). For the datasets, the proposed algorithm gained 90.43% and 99.28% overall accuracy, respectively, using only 1% training samples, which is much better than the state-of-the-art MKL algorithm and deep learning-based approaches with lower computational time. [ABSTRACT FROM AUTHOR]

L-band spaceborne polarimetric synthetic aperture radar (PolSAR) data has been well used for the high-resolution retrieval of the ionospheric Faraday rotation (FR). A vast majority of these retrievals were, however, conducted on PolSAR data of lands, with only a very few over oceans. For the global imaging of the Earth's ionosphere, the retrieval of oceanic ionosphere is indispensable. This paper aims to furnish a deep insight into the FR retrieval on oceans using the widely used Bickel-Bates estimator based on the two cross-circular polarizations ${Z_{12}}$ Z 12 and ${Z_{21}}$ Z 21 . The FR estimates (FRE) on oceans are evaluated in detail by comparing with those on lands on four ALOS PALSAR datasets. The achieved oceanic FRE are shown to possess comparable or even better quality than those on lands. It occurs in three of the four scenes that the selected ocean sub-area holds a smaller standard deviation (STD) of FRE (less than 0.7000°) than all the selected land sub-areas. Especially, the quality of FRE is shown to be closely linked to the dispersed degree of the magnitude of the conjugate product of ${Z_{12}}$ Z 12 and ${Z_{21}}$ Z 21 via the analysis of coefficient of variation (CV), according to which the unusual occurrence of larger magnitude level corresponding to larger STD of FRE can be explained. Nevertheless, compared with CV, the magnitude of the polarimetric coherence between ${Z_{12}}$ Z 12 and ${Z_{21}}$ Z 21 (i.e. $\left| \gamma \right|$ γ ) is identified as a better index to measure the quality of FRE. A smaller STD of FRE appears along with a larger $\left| \gamma \right|$ γ . Three of the four scenes show that the selected ocean sub-area bears a larger mean of $\left| \gamma \right|$ γ (greater than 0.9890) in comparison with all the selected land sub-areas. This work can promote the ionospheric research over oceans and to the correction of ionospheric effects in oceanic L-band spaceborne polarimetric radar data as well. [ABSTRACT FROM AUTHOR]

Hypergraph neural networks (HGNNs), extending the techniques of graph neural networks, have been applied to various fields due to their ability to capture more complex high-order node relationships. However, for hyperspectral image (HSI) classification tasks, previous HGNN-based works usually constructed hypergraphs using pixels as nodes, resulting in massive computational costs. Meanwhile, pixel-level personalized features are required for HSI classification. To achieve high efficiency and accuracy simultaneously, this paper presents a fast hypergraph neural network with detail preservation (DPFHNet) for HSI classification. It constructs hypergraphs at the superpixel level to reduce time consumption and supplement pixel-level detail features through a classification refinement module. This framework contains multiple stages. Firstly, its main stage is designed with HGNNs from a superpixel viewpoint rather than pixels, providing a fast strategy to capture high-order complex relationships of multiple homogeneous irregular regions. After that, auxiliary stages based on convolutional neural networks are integrated into the main stage, which adopts a hierarchical design and attempts to acquire pixel-level spatial-spectral information before the hypergraph feature extraction of the main stage, assisting in learning more valuable features. Finally, a classification refinement module is constructed, which generates pixel-level detail features to refine the superpixel-level features obtained by HGNN. Experiments on three datasets illustrate that DPFHNet achieves competitive results and efficiency compared to advanced methodologies. [ABSTRACT FROM AUTHOR]

In inverse synthetic aperture radar (ISAR) imaging, the conventional range-Doppler (RD) algorithm cannot obtain satisfactory imaging results for sparse aperture. Compressed sensing (CS) imaging methods, such as the typical iterative shrinkage and thresholding algorithm (ISTA), are often used in sparse aperture radar imaging. However, CS-based methods have high computational complexity and difficulty in setting parameters. To overcome the shortcomings, a new deep unfolding network named complex-valued weighted learning ISTA (CV-WLISTA) is proposed in this paper. The new network is very efficient and can learn the parameters adaptively. Based on ISTA and a new weighting strategy, it takes advantage of both the sparsity and the structural property of ISAR images to improve imaging performance. The experimental results show that CV-WLISTA has better reconstruction performance and higher efficiency compared with the traditional algorithms. Therefore, CV-WLISTA is an efficient ISAR imaging method with excellent performance. [ABSTRACT FROM AUTHOR]

Multispectral image (MSI) and hyperspectral image (HSI) fusion is a popular method for HSI super-resolution reconstruction (HSI-SR). MSI-HSI fusion problem is ill-posed and demands several image priors or regularization terms to solve accurately, which is a challenging issue. In this paper, we propose an MSI-HSI fusion model via subspace representation and nonlocal low-rank regularization (SRNLRR). SRNLRR model incorporates the global spectral correlations and spatial nonlocal similarities of HSI to improve the fusion results, where the priors complement each other. First, we use the mode-n tensor-matrix product to project latent high spatial resolution HSI (HR-HSI) into spectral subspace, which can capture spectral low-rankness and reduce computational complexity. Then, based on low-rank representation (LRR) and nonlocal processing strategy, we design a spatial nonlocal LRR regularization (spa-NLRR) and a spectral global LRR regularization (spe-GLRR). These two regularizations analyze the spatial nonlocal similarities and spectral global correlations from intermediate-level vision. Finally, we use the residual regularization program to obtain more image information and input it into the fusion model. We use alternate minimization (AM) methods to optimize the SRNLRR model and employ the alternating direction method (ADM) on spatial/spectral LRR learning. Comparison experiments between the SRNLRR method and six advanced methods on three HSI datasets indicate the superiority of our method. [ABSTRACT FROM AUTHOR]

Automatic building detection from remote sensing images holds significant applications in various domains, including cartography, land-use change detection, urban planning, and 3D intelligent city construction. Driven by the innovation of deep learning technology, convolutional neural networks (CNNs) have emerged as a powerful framework for automatic interpretation, exhibiting hierarchical feature generation and robust representation for building extraction. However, the inherent computational limitations of convolutional operators hinder the acquisition of an effective global receptive field. Recent advancements in deep learning have witnessed the adoption of the multi-head self-attention (MHSA) mechanism by Transformer, presenting the superiority of global context construction. Nonetheless, this network structure encounters difficulties in effectively modelling two-dimensional spatial structure features with scale variation in semantic segmentation and often has huge parameters with high algorithm complexity. To address the above problems, this paper proposed a hybrid deep neural network synergistically harnessing the superiority of CNN and Transformer to extract buildings from remote sensing images. Meanwhile, an improved MHSA mechanism is developed to facilitate the construction of multiscale global representations, concurrently reducing computational complexity. Furthermore, the cross-level MHSA modules the semantic correlation between the deep and shallow-level features to refine spatial fine-grained information. The proposed method was comprehensively evaluated on two building datasets via quantitative analysis and visualization. The experimental results confirmed that the developed network and modules outperform other state-of-the-art methods and can effectively improve the accuracy (93.4% F1-score on the WHU dataset, 89.38% F1-score on the CAMB dataset) with high efficiency for building extraction. [ABSTRACT FROM AUTHOR]

Pine wilt disease (PWD), caused by pine wood nematodes, has brought a great loss in ecology and economy all over the world. In China, the forest health status is also significantly affected by PWD since 1980, especially in coniferous forests and mixed forest regions. The PWD spreads very fast and can cause a healthy pine wood tree to die within a very short time. An effective way to protect other healthy pine wood trees is to discover PWD trees early. Using unmanned aerial vehicle (UAV) images can help people discover the PWD tree quickly and accurately, and a few automatical methods have been developed to monitor PWD trees including the deep learning methods. Because of the robust spatial-temporal transferability, deep learning methods have become the mainstream algorithms to monitor PWD trees. As we know, the training dataset is the most important material to train a deep learning model. However, there is still a lack of a PWD segmentation dataset so far. To fill this gap, in this paper, we have generated the first open-sourced PWD segmentation dataset based on very high-resolution UAV images to help the community conduct PWD monitor research conveniently. This dataset has 994 training samples, and each sample has visible bands with 512 × 512 pixels, and the spatial resolution of this dataset is 0.05 m. In order to train an advanced segmentation model, we have designed a lightweight deep-learning model for mobile devices or edge devices in this manuscript, named MobileSeg. The main feature of MobileSeg is its decoupling, which uses the re-parameterization technology to improve the model performance. Finally, a large-scale real-world scenario experiment with very high-resolution UAV images was utilized to validate the performance of MobileSeg, the experiment result indicated that MobileSeg has achieved the best performance compared with the recent lightweight segmentation models, and the experiment also proved the effectiveness of the proposed PWD dataset. [ABSTRACT FROM AUTHOR]

Multisource remote sensing images have rich features and high interpretability and are widely employed in many applications. However, highly unbalanced category distributions and complex backgrounds have created some difficulties in the application of remote sensing image semantic segmentation tasks, such as low accuracy of small target segmentation and inaccurate edge extraction. To solve these problems, in this paper, a feature map segmentation reconstruction module and an attention upsampling module are proposed. In the encoder part, the input feature map is equally segmented, and the segmented feature map is enlarged to effectively improve the small target feature information expression ability in the model. In the decoder part, the key segmentation and location information of shallow features are obtained using the global view. The deep semantic information and shallow spatial location information are fully combined to achieve a more refined upsampling operation. In addition, the attention mechanism of the spatial and channel squeeze and excitation block (scSE) is applied to pay more attention to important features and to suppress irrelevant background and redundant information. To verify the effectiveness of the proposed method, the WHU-OPT-SAR dataset and six state-of-the-art algorithms are utilized in comparative experiments. The experimental results show that our model has demonstrated the best performance and low computational complexity. With only approximately half the floating-point operation count and the number of model parameters of the MCANet model, which is specially designed for the dataset, our model surpasses MCANet by 1.52% and 1.53% in terms of mean intersection over union (mIoU) and F1 score, respectively. In particular, for small object regions such as roads and other categories, compared to the baseline model, the IoU and F1 score of our model are improved by 5.27% and 3.99% and by 5.68% and 5.65%, respectively. These results demonstrate the superior performance of our model in terms of accuracy and efficiency. [ABSTRACT FROM AUTHOR]

Many types of objects are crowdedly distributed on the surface of remote sensing scenes. Global semantics with object mixture and small training samples potentially cause difficulties in the classification of remote sensing scenes. The description of them often requires crucial parts of the scenes and corresponding discriminative features, especially as the convolutional neural network (CNN) goes deeper. In this paper, we propose a novel Location-Aware Multi-code Generator network (LAM-GAN) that incorporates multiple latent codes as the input to a generator network. This network is designed to train from scratch and recover most details of the input (real) image in a principled way. Meanwhile, multiple latent codes are reversely updated using K cluster centres located by the subsequently proposed part co-location module. By doing so, the global features of the real-fake image pair and part-level features are stacked and fed to a joint part classification network for discriminative classification. This approach makes it easier to induce the semantic concepts in a remote sensing scene. With this formulation, our approach generates an internal compact representation of the scene and enables weakly supervised part co-localization. The proposed method provides a unified framework for not only generating high-quality fake images but also facilitating the remote sensing scene classification task. We evaluated LAM-GAN on several benchmark datasets, and the experiment results demonstrate that the proposed method is more effective than previous state-of-the-art methods. [ABSTRACT FROM AUTHOR]

In recent years, high resolution (HR) remote sensing images have brought significant changes to land cover monitoring. Monitoring water resources, a vital and scarce commodity for human survival, is a crucial aspect of land cover monitoring and forms the foundation for water resource allocation in regions facing shortages. Hence, a universal method is necessary to address this problem and handle large-scale water resources monitoring. We explore the network structure via improving the interpretability to reduce the network layers and propose a lightweight pixel-wise semantic segmentation model, which achieves waterbody extraction from GF-1 remote sensing images with high accuracy and high speed. The proposed model structure addresses both semantic segmentation for large and small waterbodies, extracting fine-grained edge and contour information from high-resolution feature maps. Additionally, it efficiently extracts multi-scale high-level semantic information using residual convolutional blocks and dilated convolutional blocks. The multi-scale feature maps are fused, and binary classification is predicted through Support Vector Machines (SVM). Furthermore, the paper introduces a model training method with an adaptive learning rate, reducing the overall training time. To validate the model's performance, remote sensing images from GF-1 are utilized to construct a dataset. Experimental results, compared with five models, demonstrate that the proposed method achieves the highest accuracy and least training time. [ABSTRACT FROM AUTHOR]

Although the emergence of deep learning has improved the performance of automatic building extraction, there is still a long way to go before it can completely replace the labour-intensive manual delineation of building contours. To narrow the gap between building extraction results of deep learning methods and manual-level annotations, this paper introduces an interactive semantic segmentation framework that uses manual clicks as interactive information to guide the process of semantic segmentation towards the manual annotation level. In our framework, we first use an interactive semantic segmentation network for coarse building extraction from high resolution remote sensing images. Then, we use an optimization network to further refine the extraction results. We comprehensively compare the automatic deep learning methods, the proposed interactive building extraction framework, and the full manual delineation in practical experimental settings. First, our interactive method can significantly improve the performance of automatic building extraction. Second, by comparing the efficiency of manual annotation using the ArcGIS software and our interactive method, it is found that the proposed method can save more than half of the time. The above results show the potential of the interactive method in improving the efficiency of contour annotation and reducing the cost of manual annotation. [ABSTRACT FROM AUTHOR]

Eddies in the Marginal Ice Zones (MIZ) contribute to an enhanced melting of sea ice by forcing contact between the sea ice and the warmer water off the ice edge. The horizontal current field can be retrieved by tracking the movement of ice floes between sequential satellite images. However, the traditional method of current retrieval imposes stringent requirements on the time intervals between sequential images, and the performance of the traditional method diminishes rapidly with increasing time intervals. In this paper, an improved method of retrieving currents from multi-sensor remote sensing images is proposed, which can significantly improve the accuracy of current retrieval. The method first extracts feature from remote sensing images based on texture features and a support vector machine model and then extracts prior information about the ice-edge eddy from the first two remote sensing images. Under the guidance of prior information, horizontal currents of the eddy are retrieved by tracking the movement of sea ice from sequential remote sensing images. The proposed method was used to retrieve currents from Sentinel-1 and Sentinel-2 sequential images over the MIZ of the Fram Strait. Comparisons with the traditional method show encouraging results that the proposed method can significantly reduce the number of mismatches and improve the reliability of current vectors. [ABSTRACT FROM AUTHOR]

Accurate information on agricultural field boundaries is important for precision agriculture. Contour detection combining local cues presents a high performance on nature images. Image sparse representation describes an image is reconstructed by using as few basic functions as possible. The number of farmland parcel boundaries is small and unbalanced for the whole agricultural fields. It fits the application category of sparse representation. In this research, we investigate an approach based on contour detection and sparse representation for the extraction of farmland parcel boundaries. First, field boundaries have an obvious brightness contrast with the internal parts of the farmland parcels. We capture the cue to describe per pixel. Then, we use efficient sparse coding algorithm to represent every pixel for boundary determination. Experimental results show that the proposed method achieves a sensitivity, specificity, accuracy, ${F_1}$ F 1 and AUC of 0.6089, 0.9055, 0.8865, 0.4073 and 0.7552, respectively. The purpose of this paper is to demonstrate the potential of combining local features with sparse representation for a fast and accurate farmland parcel boundary extraction approach from remote sensing images. Comparison results with existing methods on two datasets demonstrate that the proposed method is able for accurate discrimination of the farmland parcel boundaries. [ABSTRACT FROM AUTHOR]

Geostationary satellites have the capability to offer AOD products with a higher frequency of observation within a given period, thus improving the geographical coverage of averaged AOD products compared to polar satellites. Moreover, the averaged AOD of geostationary satellites is more reflective of the average aerosol load as compared to AOD products derived from polar orbit satellites. Despite this, there is still an absence of comprehensive research on the comparative representativeness of AOD mean products from geostationary and polar orbit satellites, and most current research only focuses on retrieval accuracy. This paper compares the geographical coverage of averaged AOD products released by the Advanced Baseline Imager (ABI) sensor on the Geostationary Operational Environmental Satellite-R (GOES-R) (09:00 UTC-23:00 UTC) with AOD products released by the Moderate-resolution Imaging Spectroradiometer (MODIS) (16:00 UTC and 19:00 UTC) on hourly, daily, semi-monthly and monthly scales. Moreover, the Aerosol Robotic Network datasets were used to evaluate the accuracy of ABI AOD and to propose usage suggestions. In terms of daily AOD products, the AOD daily mean generated by the geostationary satellite GOES-R/ABI consistently outperforms the AOD daily mean generated by MODIS AOD in terms of spatial coverage. However, on monthly scales, the difference is no longer significant. With regard to accuracy, it is proved that when the time scale of averaging is gradually expanded, root mean square error (RMSE) and mean absolute error (MAE) gradually decrease. On the season scale, ABI AOD exhibits the highest level of accuracy during the autumn season (September, October, November); on the spatial scale, ABI AOD exhibits the best accuracy in North America. Therefore, if the daily, semi-monthly or monthly averaged ABI AOD datasets are used, the recommended time is autumn, and the study area is North America. [ABSTRACT FROM AUTHOR]

Urban surface water is an important freshwater resource, and the surface water environment is increasingly being destroyed. Dynamic monitoring of surface water is of great significance for protecting the ecological environment. Remote sensing technology provides technical support for surface water monitoring, which overcomes the drawbacks of traditional manual sampling. It has been widely applied in surface water monitoring. The paper systematically reviews the research progress of remote sensing technology in surface water monitoring from the aspects of remote sensing data, inversion models and water quality parameters. Advantages and disadvantages of inversion models (analytical methods, empirical methods, semi-empirical methods, machine learning methods and comprehensive methods) are compared and analysed. Furthermore, we summarize the research progress of remote sensing technology in monitoring chlorophyll a (Chl-a), total suspended matter (TSM), coloured dissolved organic matter (CDOM), transparency and non-photosensitive parameters. Although remote sensing technology provides new ideas for surface water monitoring, there are still some problems that need to be solved, such as remote sensing signals being affected by the atmosphere, poor portability of inversion models, low resolution of satellite sensors, and susceptibility to external factors. Therefore, future research should combine multi-source data, conduct in-depth research on the optical characteristics of surface water bodies, optimize inversion methods, construct transferable inversion models, break through temporal and spatial limitations, and promote the rapid development of surface water pollution monitoring and warning. [ABSTRACT FROM AUTHOR]

In recent years, numerous hyperspectral image classification methods based on convolutional neural network (CNN) have been proposed in recent years. However, the majority of CNN-based classification models fail to take into account the semantic gap between shallow and deep features, and instead, just sum up or splice these two types of features, which leads to subpar feature fusion. To address the above problems, the paper proposes a hyperspectral image classification method based on Narrowing Semantic Gap Convolutional Neural Network (NSGCNN). We developed the feature fusion sub-network, which consists of Feature Semantic Enhancement Module (FSEM), Spatial Detail Supplement Module (SDCM), and Cross-layer Feature Fusion Module (CFFM). FSEM extracts rich global semantic information based on multi-scale dilated convolution. Reverse attention mechanism is introduced in the SDCM to complement deep-layer features with fine spatial features like edges and textures. The fusing of hierarchical features is then achieved using CFFM. Additionally, we can regulate the model's parameter count by regulating the number of output feature maps. Experimental results on three benchmark hyperspectral datasets demonstrate that NSGCNN outperforms other state-of-the-art methods in terms of classification performance and significantly outperforms them in terms of model complexity. [ABSTRACT FROM AUTHOR]

Remote sensing image scene classification is a fundamental task in intelligent interpretation of remote sensing images. Although Transformers possess a powerful attention mechanism, they require lengthy training procedures to achieve good performance levels. To address this issue, this paper proposes a novel deep learning network model by combining CNN and Swin Transformer named SwinHCST. Firstly, the model uses Weighted Normalized CNN to quickly extract low-level features of the image. Secondly, the Receptive Field Block module facilitates multi-scale information fusion, Thirdly, the Information Fusion Transformer further excavates the deep-level features of the image. Furthermore, this paper has designed a plug-and-play Cross Spatial Information Fusion Block, which is used to encodes dimensional information and extracts global information to enhance information exchange. The scene classification experiments show that the proposed model outperforms other methods on the three selected datasets and can achieve excellent performance without requiring large amounts of data and training. Specifically, the classification accuracy of the proposed method on the three datasets is 93.76%, 93.60%, and 98.10%, which is 1.7% to 3.71% higher than ResNet50 and 3.7% to 5.7% higher than Swin Transformer. [ABSTRACT FROM AUTHOR]

Remote sensing scene classification is the basis of advanced smart urban planning tasks such as urban functional zone division and land use type identification. In recent years, a wide range of emerging data sources is receiving progressive attention for urban features extraction, such as satellites, unmanned aerial vehicles (UAVs), and ground sensors. How to effectively utilize these multi-view data jointly to improve scene classification performance has become a hot topic of remote sensing challenge. Existing feature fusion methods tend to map data from different views into a common feature space, which is often difficult to find when the data between views differ greatly. Furthermore, because these methods require data from all views as input, they are not flexible enough to handle situations where there is only one view input when inferring. To address the aforementioned issues, a novel Coupled Parallel Architecture (CPA) using Weighted Collaboration Fusion Constrained by Consistency Between Views (CBV-WCF) is proposed in this paper. In the training phase, the CBV module reduces the impact of the heterogeneous gap across views by capturing the consistency information between views. Well the WCF module is used to fully mine and effectively fuse the complementary information between views to improve the performance of downstream tasks. In the inference phase, the proposed architecture can effectively improve the classification performance in both cases of multi-view and single-view input. Our method is evaluated on air-ground dual-view scene classification, which is a typical multi-view task with large image differences between views. Experimental results on two publicly available air-ground dual-view datasets demonstrate that the proposed framework significantly improves classification performance while bringing some inspiration and new solutions to multi-view tasks. The code of this paper will be published at: . [ABSTRACT FROM AUTHOR]

Semantic segmentation of high-resolution remote sensing images is important in land cover classification, road extraction, building extraction, water extraction, etc. However, high-resolution remote-sensing images have a lot of details. Due to the fixed receptive field of convolution blocks, it is impossible to model the correlation of global features. In addition, complex fusion methods cannot integrate spatial and global context information. In order to solve these problems, this paper proposes a cross-linear attention network (CLANet) to capture spatial and context information in images. The structure consists of a spatial branch and a context branch. The spatial branch is constructed by stacked convolution to better capture spatial information. The context branch models the global information based on the transformer deformation module. In addition, to effectively fuse spatial and context information, this paper also designs a feature fusion module (FFM), which uses a cross-linear attention mechanism for feature aggregation. Finally, this paper conducts many experiments on the ISPRS Vaihingen and the ISPRS Potsdam datasets. Among them, 82.28% of mIoU achieves on the ISPRS Vaihingen dataset. The experimental results show that CLANet has better performance and effect than the methods in recent years. [ABSTRACT FROM AUTHOR]

Semantic segmentation is a fundamental but meaningful task in the remote sensing image understanding community. Great progress has been made in optical sensor photography technology, which poses an opportunity and a challenge for remote sensing image segmentation task. But, in fact, a longstanding and intractable problem is that many hard pixels in special position, i.e. the prevalent intra-class noise and a poor boundary delineation, is difficult to classify due to their inherent uncertainty. In this paper, we comprehensively consider the characteristics of deep learning and introduce traditional pattern recognition methods to drive structure learning, which can leverage the corresponding fuzzy logic model to alleviate the aforementioned problem in remote sensing images. Specifically, this paper designs a multiscale bidirectional fuzzy-driven learning network (MBFNet), which takes advantage of both deep learning and fuzzy logic to effectively alleviate the inherent uncertainty of these hard pixels. The structure of convolutional neural networks driven by fuzzy systems also provides a new modelling paradigm for solving the uncertain problem in remote sensing images. Meanwhile, multiscale techniques and bidirectional fusion are introduced to enhance feature aggregation and avoid the potential adverse effects of fuzzy systems, respectively. Experimental results on two datasets demonstrate qualitatively and quantitatively that the proposed MBFNet is competitive. [ABSTRACT FROM AUTHOR]

As a classic problem of high-resolution remote sensing image tasks, land cover classification has many challenges, for instance, variable scales and low-edge discrimination. Traditional spatial semantic segmentation methods based on single-scale feature extraction are challenging to model multi-scale features. They cannot effectively fit high-resolution remote sensing images with variable scales and are prone to misclassification issues. On the other hand, spatial multi-scale semantic segmentation methods lack edge constraints, which can easily lead to edge segmentation ambiguity issues. We propose a segmentation network based on a multi-scale frequency-domain attention gating mechanism (MFAGNet) to solve the above problems. Specifically, we obtain multi-scale features through multi-scale input and design the discrete cosine transform channel attention module (DCTCAM). In DCTCAM, we extract global low-frequency features and effectively alleviate misclassification caused by scale changes. The edge features of the image are obtained through the high-frequency feature extraction module (HFEM) by using edge detection operators to enhance the model's ability to recognize edges. Additionally, no further pooling operations are employed except for a single max pooling layer in the backbone network. In this paper, we design a new gating mechanism to dynamically control the extraction ratio of various frequency features so that it can adapt to input images of different scales. This paper conducts comparative experiments on three high-resolution land cover datasets: GID, Vaihingen, and Potsdam. The new algorithm proposed compares with classic semantic segmentation models such as DANet, PSPNet, SegNet, UNet, DeepLabv3+, FcaNet, BiSeNet, AFN, and FastFCN. The experimental results show that MFAGNet is superior to the comparison models. With no significant increase in computing overhead, MFAGNet obtains MIoU of 69.05%, 73.40%, and 79.42% on the standard data sets GID, Vaihingen, and Potsdam, respectively. [ABSTRACT FROM AUTHOR]

For spaceborne ISAR imaging of space targets, due to the high-speed relative motion between the radar and targets, both the translational and rotational motion exhibit the high-order characteristics. Conventional translational motion compensation (TMC) methods are ineffective in handling such high-order translational motion. Moreover, the migration through resolution cell (MTRC) stems from the presence of the high-order spatial variant phase of the echo signal, resulting in severe defocusing of ISAR images. In this paper, a novel spaceborne ISAR imaging approach for space targets is proposed, which incorporates the high-order TMC and the high-order MTRC correction. First, the slant range model for spaceborne ISAR imaging is derived as a third-order polynomial form. Based on this model, a modified high-order TMC method is proposed, which utilizes the minimum entropy method combined with the Broyden – Fletcher – Goldfarb – Shanno (BFGS) algorithm. The proposed method leverages orbital model information to obtain the initial TMC coefficients, enabling TMC to be completed more accurately and effectively. Then, a modified polynomial keystone transform (PKT) is proposed to correct the high-order MTRC. The PKT-based method effectively addresses both the high-order and first-order MTRC corrections simultaneously. Finally, a spaceborne ISAR imaging approach is proposed to obtain well-focused ISAR images. Simulated and real data results validate the analysis of the spaceborne ISAR imaging model and demonstrate the effectiveness of the spaceborne imaging approach for space targets proposed in this paper. [ABSTRACT FROM AUTHOR]

As an important load of airborne/spaceborne passive microwave remote sensing, fully polarized microwave radiometer is widely used to the measurement of wind vector and salinity on sea surface. The retrieval of ocean surface parameters requires high accuracy data of radiometer. In recent years, the data correction scheme of fully polarized radiometer is common, but the attitude problem of radiometer is not paid enough attention. This paper establishes a full link transfer model for a fully polarized microwave radiometer, and focus on analysing the impact of aircraft attitude on various parameters. This paper aims to draw researchers' attention to attitude control of fully polarized microwave radiometer. Through the model established in this paper, the influence of attitude on fully polarized microwave radiometers is clarified and corrected, then rapidly correction can be achieved. Through simulation model, the impact of different attitudes on data can be calculated in advance before flight tests, and can provide guidance for attitude control. Using the corrected data for wind vector analysis, the deviation of wind direction is within 10°, which also verifies the accuracy of the model in this paper. The model proposed in this paper can achieve fast and accurate correction of radiometer parameters and the error prediction caused by attitude, which provides a strong guarantee for the inversion of sea surface parameters. [ABSTRACT FROM AUTHOR]

This paper examines different geographically weighted (GW) approaches for calculating spatially distributed measures of accuracy / uncertainty, consolidating current approaches and proposing 2 new ones. GW frameworks use a moving window or kernel to extract and weight data subsets, from which local (ie spatially distributed) statistics or metrics are calculated. A validation dataset with hard and soft classifications is used to illustrate the approaches. It contains observed field survey data (also commonly derived from higher resolution imagery), and predicted data from a fuzzy c-means classification. The hard classes were used to estimate spatially distributed measures of overall, user's and producer's accuracies in two ways. First, by conceptualising them as probabilities to be estimated from generalised linear regression models (GLMs), extended into Geographically Weighted GLMs. Second, by constructing local GW correspondence matrices and then calculating local accuracy measures from these. The soft classes were used to calculate per-class measures of fuzzy certainty from the absolute difference between predicted and observed fuzzy memberships. Then, a novel fuzzy certainty logic is proposed and used to create fuzzy confusion matrices and per-class measures of fuzzy omission and commission error, supporting measures of fuzzy user's and producer's certainties. These were extended to the GW case to generate spatially distributed measures. Finally, the soft classifications were conceptualised as compositional data and measures of difference were estimated using Aitchison distances. In each case, the local hard and soft accuracy and certainty measures were interpolated over a 1 km grid to estimate accuracy surfaces. The context for this review is the increasing operational use of training and validation data, often with high numbers of records, containing both hard and soft classes. The data and R code used to undertake all the analyses in this paper are provided, supporting more nuanced analyses of such data. [ABSTRACT FROM AUTHOR]

Target segmentation of remote sensing images has always been a hotspot in image processing. This paper proposes a new semantic segmentation technology for remote sensing images, which uses Unet as the backbone and combines attention mechanism and feature enhancement module. The feature enhancement module can enlarge the information of the region of interest (ROI) to improve the contrast of the image; the attention mechanism includes spatial and channel attention modules, which can obtain more detailed information of the desired target while suppressing other useless information. This paper improves the loss function of the traditional Unet. On the basis of the sparse categorical cross-entropy function, the mean squared logarithmic error function is added, which can effectively improve the accuracy of semantic segmentation. The experimental results show that the algorithm has higher computational accuracy than Unet, DeepLabV3, SegNet, PSPNet, CBAM and DAnet while having the computational speed of FCN and Unet in model testing and validation. [ABSTRACT FROM AUTHOR]

In recent years, Synthetic Aperture Radar (SAR) Tomography (TomoSAR) has ascertained great potential for the three-dimensional (3-D) reconstruction of observed scenes, especially in urban areas. However, the number of proceed snapshots (observations) is usually less than that of slant height samples (unknowns) in TomoSAR inversion processes. This impairs the quality of the reconstructed vertical information. To cope with this issue and improve the reliability of reconstructed vertical information, this paper investigates the possible potential of a deterministic descriptive regularization-based method. Deterministic descriptive regularization is a well-conditioned optimization framework based on the descriptive idea of a regularization solution. This strategy can help to mitigate the effect of the ill-posed problem. Thus, it can assist SAR tomography to deal with the possible impairing issues arising from low numbers and the distribution of baselines. For this purpose, the result of the proposed strategy is compared with the outcomes from the standard TomoSAR techniques, including Beamforming, Capon, and Minimum Norm. The proposed method for reconstruction of the reflectivity function of the observed scene has been performed on a dataset acquired by the Sentinel-1 sensor in 2022 over Tehran City, Iran. The experimental results indicate that the proposed algorithm can estimate building heights with a vertical accuracy of better than 91%. These results demonstrate the great potential of the proposed method for reconstructing the full 3-D images of urban areas. [ABSTRACT FROM AUTHOR]

In recent years, a series of bilinear mixture models (BMMs) have been well studied, based on which nonlinear unmixing algorithms for hyperspectral images have been proposed. However, the performance of unsupervised nonlinear spectral unmixing can be largely affected by the collinearity and the nonconvex unmixing problem's inherent complexity. To solve the problems, this paper proposes a geometrical projection improved multi-objective particle swarm optimization (GPMOPSO) method for nonlinear unmixing, which consists of two dynamically updating procedures. First, under the assumption of the BMMs, observed pixels are geometrically projected to their approximate linear mixture components to alleviate the collinearity. Second, the linear mixture components are efficiently decomposed to refined endmembers and abundances in an improved linear unmixing framework using multi-objective particle swarm optimization. Two advanced multi-objective optimization strategies are adopted to balance the influence of an endmember distance constraint and an abundance sparsity constraint on the achieved unsupervised linear unmixing process, respectively. Then, accurate unmixing variables can be fed back to the geometrical projection procedure to produce more reliable linear mixture components which facilitate the execution of the former in turn. Experimental results of both simulated data and real hyperspectral remote sensing data verify the superior nonlinear unmixing performance of the proposed method. [ABSTRACT FROM AUTHOR]

In recent years, with the continuous advancement of remote sensing technology, remote sensing images have found widespread application in various fields. However, remote sensing images are often hindered by the presence of clouds, which can significantly reduce their usability. Removing clouds from remote sensing images has thus become an essential preprocessing step in remote sensing image analysis. While numerous models based on deep learning have produced impressive results in the domain of image denoising, there has been limited research on applying deep neural networks to tackle the issue of cloud removal in remote sensing images. This paper proposes a novel model, the Hybrid Attention Generative Adversarial Network (HyA-GAN), that blends the channel attention mechanism and the spatial attention mechanism and integrates it into a generative adversarial network. By incorporating both the channel attention mechanism and the spatial attention mechanism, HyA-GAN permits the network to prioritize regions that are vital for image processing. This feature leads to an improvement in the network's capacity to recover data and generate remote sensing images with superior cloud removal effects. When comparing HyA-GAN with other existing cloud removal models on the RICE dataset, it outperformed them in both peak signal-to-noise ratio (PSNR) and structural similarity index (SSIM). The experiments demonstrate the high potential of HyA-GAN in addressing the challenge of removing clouds from remote sensing images. [ABSTRACT FROM AUTHOR]

Hyperspectral image has excellent spectral information and abundant spatial information, and its feature quality is one of the key factors affecting the classification performance. Extreme learning machine (ELM) is widely used in hyperspectral classification problems. However, traditional ELM is usually based on regular Euclidean data, ignoring the inherent structured information between hyperspectral pixels, resulting in poor robustness. In this paper, we propose a new supervised extreme learning machine framework, termed spatial-spectral graph convolutional ELM (SSG-ELM), based on using graph convolution to extend ELM into the non-Euclidean domain. The method inherits all the advantages from ELM, and consists of a random graph convolutional layer followed by a graph convolutional regression layer, enabling it to model complex intra class variations. Otherwise, a local spectral-spatial context integration and reshaping mechanism is incorporated into the hidden layer feature representation by using a context-aware bilateral filtering procedure. Experimental results show that the proposed algorithm obtains a competitive performance and outperforms other state-of-the-art ELM-based methods. [ABSTRACT FROM AUTHOR]