Search

Aerial-view geo-localization tends to determine an unknown position through matching the drone-view image with the geo-tagged satellite-view image. This task is mostly regarded as an image retrieval problem. The key underpinning this task is to design a series of deep neural networks to learn discriminative image descriptors. However, existing methods meet large performance drops under realistic weather, such as rain and fog, since they do not take the domain shift between the training data and multiple test environments into consideration. To minor this domain gap, we propose a Multiple-environment Self-adaptive Network (MuSe-Net) to dynamically adjust the domain shift caused by environmental changing. In particular, MuSe-Net employs a two-branch neural network containing one multiple-environment style extraction network and one self-adaptive feature extraction network. As the name implies, the multiple-environment style extraction network is to extract the environment-related style information, while the self-adaptive feature extraction network utilizes an adaptive modulation module to dynamically minimize the environment-related style gap. Extensive experiments on three widely-used benchmarks, i.e. , University-1652, SUES-200, and CVUSA, demonstrate that the proposed MuSe-Net achieves a competitive result for geo-localization in multiple environments. Furthermore, we observe that the proposed method also shows great potential to the unseen extreme weather, such as mixing the fog, rain and snow. • Identifying one key challenge in visual geo-localization: weather and illumination changes. • Presenting MuSe-Net to alleviate the interference caused by environmental changes. • Designing Residual SPADE for efficient training and feature discrimination boosting. • Results on three geo-localization benchmarks confirm the superiority of our MuSe-Net. [ABSTRACT FROM AUTHOR]

This paper addresses the issue of noise interference in road defect detection, caused by various environmental factors or acquisition equipment. In this article, we add three different levels of salt & pepper noise to the road defect dataset and propose a novel anti-noise dual-branch network (ADNet). The proposed ADNet leverages two backbone networks equipped with the dual-branch interaction (DI) modules to learn the defect information from noise and clear images for improving noise immunity. Then, the weighted feature representation (WFR) module is designed to extract more context-aware cues from the multi-level feature. Additionally, the region perception unit is proposed, where channel-spatial attention optimization (CSAO) module extracts more defect region information by utilizing the attention mechanism and multi-scale refinement (MR) optimizes the boundary information with the U-Net structure. Extensive experimental results demonstrate that the proposed method outperforms state-of-the-art methods, making it a promising solution for detecting road defects in noisy environments. [ABSTRACT FROM AUTHOR]

To boost the product quality, numerous saliency-based surface defect detection methods have been devoted to the areas of industrial production, construction consumable, road construction. However, the existing salient object detection (SOD) methods not only consume a significant amount of computing resources but also fail to meet the detection efficiency requirements of enterprises. Therefore, this paper proposes a lightweight semantics-aware multi-level feature interaction network (SMINet), to address the above issues. In the encoder phase, we integrate multiple adjacent level features in the cross-layer feature fusion (CFF) module to alleviate the discrepancy between multi-scale features. In the decoder phase, we first employ the semantic-aware feature extraction (SFE) module to mine the location cues embedded in the high-level features. Afterwards, we introduce the detail-aware context attention (DCA) module based on the attention mechanism to recover more spatial details. Extensive experiments on four surface defect datasets validate that our SMINet outperforms the existing state-of-the-art methods. [ABSTRACT FROM AUTHOR]

Salient object detection methods based on two-modal images have achieved remarkable success with the aid of image acquisition equipment. However, environmental factors often interfere with the Depth and Thermal maps, rendering them ineffective in providing object information. To address this weakness, we utilize the VDT dataset, which includes Visible, Depth, and Thermal images, and propose a triple-modal interaction encoder and multi-scale fusion decoder network (TMNet) to highlight the salient regions. The triple-modal interaction encoder comprises the separation context-aware feature module, channel-wise fusion module, and triple-modal refinement and fusion module, enabling us to fully explore and utilize the complementarity between Visible, Depth, and Thermal information. The multi-scale fusion decoder involves the semantic-aware localizing module and contour-aware refinement module to extract and fuse the location and boundary information, yielding a high-quality saliency map. Extensive experiments on the public VDT-2048 dataset demonstrate that our TMNet outperforms existing state-of-the-art methods in terms of all evaluation metrics. • This paper proposes a triple-modal interaction encoder and multi-scale fusion decoder network (TMNet) to highlight the salient regions. • The triple-modal interaction encoder comprises the separation context-aware feature module, channel-wise fusion module, and triple-modal refinement and fusion module to explore and utilize the complementarity between Visible, Depth, and Thermal information. • The multi-scale fusion decoder involves the semantic-aware localizing module and contour-aware refinement module to extract and fuse the location and boundary information, yielding a high-quality saliency map. • Extensive experiments on the public VDT-2048 dataset demonstrate that our TMNet outperforms existing state-of-the-art methods in terms of all evaluation metrics. [ABSTRACT FROM AUTHOR]