Search

The limited number and under-representation of side-scan sonar samples hinders the training of high-performance underwater object detection models. To address this issue, in this paper, we propose a diffusion model-based method to augment side-scan sonar image samples. First, the side-scan sonar image is transformed into Gaussian distributed random noise based on its a priori discriminant. Then, the Gaussian noise is modified step by step in the inverse process to reconstruct a new sample with the same distribution as the a priori data. To improve the sample generation speed, an accelerated encoder is introduced to reduce the model sampling time. Experiments show that our method can generate a large number of representative side-scan sonar images. The generated side-scan sonar shipwreck images are used to train an underwater shipwreck object detection model, which achieves a detection accuracy of 91.5% on a real side-scan sonar dataset. This exceeds the detection accuracy of real side-scan sonar data and validates the feasibility of the proposed method. [ABSTRACT FROM AUTHOR]

The limitations of underwater acoustic communications mean that the side-scan sonar data of an autonomous underwater vehicle (AUV) cannot be transmitted back and processed in real time, which means that targets cannot be detected in real time. To address the problem, this paper proposes an autonomous underwater vehicle-based side-scan sonar real-time detection method for underwater targets. First, the paper describes the system and operation of real-time underwater-target detection by the side-scan sonar mounted on the autonomous underwater vehicle. Next, it proposes a real-time processing method for side-scan sonar data, method for constructing a deep-learning-based underwater-target detection model, and real-time method for underwater-target detection based on navigation strip images, which, together, solve the three key technical problems of real-time data processing, deep-learning-based detection model construction, and real-time target detection based on the autonomous underwater vehicle. Finally, through sea-based experiments, the effectiveness of the proposed methods is evaluated, providing a new solution for the autonomous underwater vehicle-based side-scan sonar real-time detection of underwater targets. [ABSTRACT FROM AUTHOR]

To accurately achieve side scan sonar (SSS) image target detection, a novel target detection algorithm based on a neutrosophic set (NS) and diffusion maps (DMs) is proposed in this paper. Firstly, the neutrosophic subset images were obtained by transforming the input SSS image into the NS domain. Secondly, the shadowed areas of the SSS image were detected using the single gray value threshold method before the diffusion map was calculated. Lastly, based on the diffusion map, the target areas were detected using the improved target scoring equation defined by the diffusion distance and texture feature. The experiments using SSS images of single clear and unclear targets, with or without shadowed areas, showed that the algorithm accurately detects targets. Experiments using SSS images of multiple targets, with or without shadowed areas, showed that no false or missing detections occurred. The target areas were also accurately detected in SSS images with complex features such as sand wave terrain. The accuracy and effectiveness of the proposed algorithm were assessed. [ABSTRACT FROM AUTHOR]

To overcome the shortcomings of the traditional manual detection of underwater targets in side-scan sonar (SSS) images, a real-time automatic target recognition (ATR) method is proposed in this paper. This method consists of image preprocessing, sampling, ATR by integration of the transformer module and YOLOv5s (that is, TR–YOLOv5s), and target localization. By considering the target-sparse and feature-barren characteristics of SSS images, a novel TR–YOLOv5s network and a down-sampling principle are put forward, and the attention mechanism is introduced in the method to meet the requirements of accuracy and efficiency for underwater target recognition. Experiments verified the proposed method achieved 85.6% mean average precision (mAP) and 87.8% macro-F2 score, and brought 12.5% and 10.6% gains compared with the YOLOv5s network trained from scratch, and had the real-time recognition speed of about 0.068 s per image. [ABSTRACT FROM AUTHOR]

Determining the altitude of side-scan sonar (SSS) above the seabed is critical to correct the geometric distortions in the sonar images. Usually, a technology named bottom tracking is applied to estimate the distance between the sonar and the seafloor. However, the traditional methods for bottom tracking often require pre-defined thresholds and complex optimization processes, which make it difficult to achieve ideal results in complex underwater environments without manual intervention. In this paper, a universal automatic bottom tracking method is proposed based on semantic segmentation. First, the waterfall images generated from SSS backscatter sequences are labeled as water column (WC) and seabed parts, then split into specific patches to build the training dataset. Second, a symmetrical information synthesis module (SISM) is designed and added to DeepLabv3+, which not only weakens the strong echoes in the WC area, but also gives the network the capability of considering the symmetry characteristic of bottom lines, and most importantly, the independent module can be easily combined with any other neural networks. Then, the integrated network is trained with the established dataset. Third, a coarse-to-fine segmentation strategy with the well-trained model is proposed to segment the SSS waterfall images quickly and accurately. Besides, a fast bottom line search algorithm is proposed to further reduce the time consumption of bottom tracking. Finally, the proposed method is validated by the data measured with several commonly used SSSs in various underwater environments. The results show that the proposed method can achieve the bottom tracking accuracy of 1.1 pixels of mean error and 1.26 pixels of standard deviation at the speed of 2128 ping/s, and is robust to interference factors. [ABSTRACT FROM AUTHOR]

As widely applicated in many underwater research fields, conventional side-scan sonars require the sonar height to be at the seabed for geocoding seabed images. However, many interference factors, including compensation with unknown gains, suspended matters, etc., would bring difficulties in bottom detection. Existing methods need manual parameter setups or to use postprocessing methods, which limits automatic and real-time processing in complex situations. To solve this problem, a one-dimensional U-Net (1D-UNet) model for sea bottom detection of side-scan data and the bottom detection and tracking method based on 1D-UNet are proposed in this work. First, the basic theory of sonar bottom detection and the interference factors is introduced, which indicates that deep learning of the bottom is a feasible solution. Then, a 1D-UNet model for detecting the sea bottom position from the side-scan backscatter strength sequences is proposed, and the structure and implementation of this model are illustrated in detail. Finally, the bottom detection and tracking algorithms of a single ping and continuous pings are presented on the basis of the proposed model. The measured side-scan sonar data in Meizhou Bay and Bayuquan District were selected in the experiments to verify the model and methods. The 1D-UNet model was first trained and applied with the side-scan data in Meizhou Bay. The training and validation accuracies were 99.92% and 99.77%, respectively, and the sea bottom detection accuracy of the training survey line was 99.88%. The 1D-UNet model showed good robustness to the interference factors of bottom detection and fully real-time performance in comparison with other methods. Moreover, the trained 1D-UNet model is used to process the data in the Bayuquan District for proving model generality. The proposed 1D-UNet model for bottom detection has been proven effective for side-scan sonar data and also has great potentials in wider applications on other types of sonars. [ABSTRACT FROM AUTHOR]

As one of the most commonly used acoustic systems in seabed surveys, the altitude of the side scan sonar from the seafloor is always difficult to determine, especially when raw signal levels and gain information are unavailable. The inaccurate sonar altitudes would limit the applications of sonar image geocoding, target detection, and sediment classification. The sonar altitude can be obtained by using bottom tracking methods, but traditional methods often require manual thresholds or complex post-processing procedures, which cannot ensure accurate and real-time bottom tracking. In this paper, a real-time bottom tracking method of side scan data is proposed based on a one-dimensional convolution neural network. First, according to the characteristics of side scan backscatter strength sequences, positive (bottom sequences) and negative (water column and seabed sequences) samples are extracted to establish the sample sets. Second, a one-dimensional convolution neural network is carefully designed and trained by using the sample set to recognize the bottom sequences. Third, a complete processing procedure of the real-time bottom tracking method is established by traversing each side scan ping data and recognizing the bottom sequences. The auxiliary methods for improving real-time performance and sample data augmentation are also explained in detail. The proposed method is implemented on the measured side scan data from the marine area in Meizhou Bay. The trained network model achieves a 100% recognition of the initial sample set as well as 100% bottom tracking accuracy of the training survey line. The average bottom tracking accuracy of the testing survey lines excluding missed pings reaches 99.2%. By comparison with multi-beam bathymetric data and the statistical analysis of real-time performance, the experimental results prove the validity and accuracy of the proposed real-time bottom tracking method. [ABSTRACT FROM AUTHOR]

Side-scan sonar (SSS) is used for obtaining high-resolution seabed images, but with low position accuracy without using the Ultra Short Base Line (USBL) or Short Base Line (SBL). Multibeam echo sounder (MBES), which can simultaneously obtain high-accuracy seabed topography as well as seabed images with low resolution in deep water. Based on the complementarity of SSS and MBES data, this paper proposes a new method for acquiring high-resolution seabed topography and surface details that are difficult to obtain using MBES or SSS alone. Firstly, according to the common seabed features presented in both images, the Speeded-Up Robust Features (SURF) algorithm, with the constraint of image geographic coordinates, is adopted for initial image matching. Secondly, to further improve the matching performance, a template matching strategy using the dense local self-similarity (DLSS) descriptor is adopted according to the self-similarities within these two images. Next, the random sample consensus (RANSAC) algorithm is used for removing the mismatches and the SSS backscatter image geographic coordinates are rectified by the transformation model established based on the correct matched points. Finally, the superimposition of this rectified SSS backscatter image on MBES seabed topography is performed and the high-resolution and high-accuracy seabed topography and surface details can be obtained. [ABSTRACT FROM AUTHOR]