Search

The limited number and under-representation of side-scan sonar samples hinders the training of high-performance underwater object detection models. To address this issue, in this paper, we propose a diffusion model-based method to augment side-scan sonar image samples. First, the side-scan sonar image is transformed into Gaussian distributed random noise based on its a priori discriminant. Then, the Gaussian noise is modified step by step in the inverse process to reconstruct a new sample with the same distribution as the a priori data. To improve the sample generation speed, an accelerated encoder is introduced to reduce the model sampling time. Experiments show that our method can generate a large number of representative side-scan sonar images. The generated side-scan sonar shipwreck images are used to train an underwater shipwreck object detection model, which achieves a detection accuracy of 91.5% on a real side-scan sonar dataset. This exceeds the detection accuracy of real side-scan sonar data and validates the feasibility of the proposed method. [ABSTRACT FROM AUTHOR]

Bubble plumes, as main manifestations of seabed gas leakage, play an important role in the exploration of natural gas hydrate and other resources. Multibeam water column images have been widely used in detecting bubble plume targets in recent years because they can wholly record water column and seabed backscatter strengths. However, strong noises in multibeam water column images cause many issues in target detection, and traditional target detection methods are mainly used in optical images and are less efficient for noise-affected sonar images. To improve the detection accuracy of bubble plume targets in water column images, this study proposes a target detection method based on the bag of visual words (BOVW) features and support vector machine (SVM) classifier. First, the characteristics of bubble plume targets in water column images are analyzed, with the conclusion that the BOVW features can well express the gray scale, texture, and shape characteristics of bubble plumes. Second, the BOVW features are constructed following steps of point description extraction, description clustering, and feature encoding. Third, the quadratic SVM classifier is used for the recognition of target images. Finally, a procedure of bubble plume target detection in water column images is described. In the experiment using the measured data in the Strait of Georgia, the proposed method achieved 98.6% recognition accuracy of bubble plume targets in validation sets, and 91.7% correct detection rate of the targets in water column images. By comparison with other methods, the experimental results prove the validity and accuracy of the proposed method, and show potential applications of our method in the exploration and research on ocean resources. [ABSTRACT FROM AUTHOR]

Sub-bottom profiler (SBP) measurements play a very important role in marine pipeline detection and checking. However, sometimes because of bad sea conditions and complex underwater environments, only poor SBP images can be obtained. Pipeline recognition based on a poor SBP image manually is tedious and has low accuracy. In this article, based on the specific hyperbola shapes caused by pipelines on SBP images, a novel method to detect the marine pipelines automatically and robustly is presented. Two main steps are used. First, a comprehensive edge extraction method is proposed, which includes line-like structure enhancement and preliminary edge extraction, local phase calculation and phase edge extraction, final edge extraction, as well as edge processing. By applying this method, interference such as reverberation can be eliminated, and fine hyperbola edges can be obtained. Second, by referencing the theoretical hyperbola and using a buffer zone and a hyperbola contour consistency (HCC) criterion, the location of the pipeline can be determined robustly. This method was implemented and verified using data collected under real conditions. The results show that the proposed method is practicable. [ABSTRACT FROM AUTHOR]

Sea bottom line is the echo boundary between the water column and seabed on side-scan sonar waterfall image. Tracking it correctly is the basis for geometric and radiative correction of side-scan sonar image. Because of the interfering echoes under complex water environment, the sea bottom line cannot be tracked through traditional threshold and smoothing algorithms. Therefore, a new method, taking full advantage of the spatial distribution characteristics of the sea bottom line, is proposed, in which points density clustering and chains seeking are the two core processes. The former clustering process can be regarded as a filter to cluster points along a direction that is approximately parallel to the track line,and the points are grouped to chains if they are density reachable in a searching neighborhood. Then, by adopting the five principles and tracking strategy given in this paper, the chains relevant to the sea bottom line are sought and identified to finish the tracking work. The test results show that the proposed method performs well even in a complex water environment and has better stability and anti-interference ability compared with traditional tracking methods. This research improves the side-scan sonar data processing, and makes it more accurate, automatic and intelligent. [ABSTRACT FROM AUTHOR]

To fulfill side scan sonar (SSS) image segmentation accurately and efficiently, a novel segmentation algorithm based on neutrosophic set (NS) and quantum-behaved particle swarm optimization (QPSO) is proposed in this paper. Firstly, the neutrosophic subset images are obtained by transforming the input image into the NS domain. Then, a co-occurrence matrix is accurately constructed based on these subset images, and the entropy of the gray level image is described to serve as the fitness function of the QPSO algorithm. Moreover, the optimal two-dimensional segmentation threshold vector is quickly obtained by QPSO. Finally, the contours of the interested target are segmented with the threshold vector and extracted by the mathematic morphology operation. To further improve the segmentation efficiency, the single threshold segmentation, an alternative algorithm, is recommended for the shadow segmentation by considering the gray level characteristics of the shadow. The accuracy and efficiency of the proposed algorithm are assessed with experiments of SSS image segmentation. [ABSTRACT FROM AUTHOR]

The towing operation mode of side‐scan sonar system (SSS) easily results in dislocations and distortions of targets in the SSS strip image, brings difficulty to the mosaic of these strip images by the geocoding method or the tessellation‐line method and affects the recognition and understanding for seabed relief. Therefore this study proposes a new method, namely the segment‐image mosaic method based on corresponding features of the two adjacent SSS strip images. Through SSS image preprocessing, segment match based on corresponding features and image fusion in the common coverage area based on wavelet transformation, this new method overcomes the drawbacks of the traditional methods of image mosaic, fulfils well the mosaic of SSS strip images and finally a whole‐area SSS image is formed. Experiments have verified that the mosaic image formed by the new method can correctly reflect the position, shape and distribution of seabed targets, which is helpful to understand seabed relief. [ABSTRACT FROM AUTHOR]

To overcome the shortcomings of the traditional manual detection of underwater targets in side-scan sonar (SSS) images, a real-time automatic target recognition (ATR) method is proposed in this paper. This method consists of image preprocessing, sampling, ATR by integration of the transformer module and YOLOv5s (that is, TR–YOLOv5s), and target localization. By considering the target-sparse and feature-barren characteristics of SSS images, a novel TR–YOLOv5s network and a down-sampling principle are put forward, and the attention mechanism is introduced in the method to meet the requirements of accuracy and efficiency for underwater target recognition. Experiments verified the proposed method achieved 85.6% mean average precision (mAP) and 87.8% macro-F2 score, and brought 12.5% and 10.6% gains compared with the YOLOv5s network trained from scratch, and had the real-time recognition speed of about 0.068 s per image. [ABSTRACT FROM AUTHOR]

A sub-bottom profiler (SBP) can capture the sediment interfaces and properties of different types of sediment. Horizon picking from SBP images is one of the most crucial steps in marine sub-bottom sediment interpretation. However, traditional horizon picking methods are good at obtaining the main horizons representing the main reflectors while ignoring the detailed horizons. While detailed horizons are the prime objective, many tiny structures caused by interference echoes will also be picked. To overcome this limitation, an integrated horizon picking method for obtaining the main and detailed horizons simultaneously is proposed in this paper. A total of three main process steps: the diffusion filtering method, the enhancement filtering method as well as the local phase calculation method, are used to help obtain the main and detailed horizons. The diffusion filtering method smooths the SBP images and preserves reflectors. Enhancement filtering can eliminate outliers and enhance reflectors. The local phase can be used to highlight all of the reflections and help in the choosing of detailed horizons. A series of experiments were then performed to validate the effectiveness of the proposed method, and good performances were achieved. [ABSTRACT FROM AUTHOR]

Determining the altitude of side-scan sonar (SSS) above the seabed is critical to correct the geometric distortions in the sonar images. Usually, a technology named bottom tracking is applied to estimate the distance between the sonar and the seafloor. However, the traditional methods for bottom tracking often require pre-defined thresholds and complex optimization processes, which make it difficult to achieve ideal results in complex underwater environments without manual intervention. In this paper, a universal automatic bottom tracking method is proposed based on semantic segmentation. First, the waterfall images generated from SSS backscatter sequences are labeled as water column (WC) and seabed parts, then split into specific patches to build the training dataset. Second, a symmetrical information synthesis module (SISM) is designed and added to DeepLabv3+, which not only weakens the strong echoes in the WC area, but also gives the network the capability of considering the symmetry characteristic of bottom lines, and most importantly, the independent module can be easily combined with any other neural networks. Then, the integrated network is trained with the established dataset. Third, a coarse-to-fine segmentation strategy with the well-trained model is proposed to segment the SSS waterfall images quickly and accurately. Besides, a fast bottom line search algorithm is proposed to further reduce the time consumption of bottom tracking. Finally, the proposed method is validated by the data measured with several commonly used SSSs in various underwater environments. The results show that the proposed method can achieve the bottom tracking accuracy of 1.1 pixels of mean error and 1.26 pixels of standard deviation at the speed of 2128 ping/s, and is robust to interference factors. [ABSTRACT FROM AUTHOR]

Traditional manual horizon picking is time-consuming and laborious, while automatic picking methods often suffer from the limited scope of their applications and the discontinuity of picked results. In this paper, we propose a novel method for automatic horizon picking from sub-bottom profiles (SBP) by an improved filtering algorithm. First, a clear and fine SBP image is formed using an intensity transformation method. On this basis, a novel filtering method is proposed by improving the multi-scale enhancement filtering algorithm to obtain clear horizons from an SBP image. The improvement is performed by applying a vertical suppression weighting term based on the form of logistic function, which is constructed by using the eigenvectors from the Hessian matrix. Then, the filtered image is segmented using a threshold method, and the horizon points in the SBP image are picked. After that, a horizon linking method is applied, which uses the horizon directions to refine the picked horizon points. The proposed method has been verified experimentally, and accurate and continuous horizons were obtained. Finally, the proposed method is discussed and some conclusions are drawn. [ABSTRACT FROM AUTHOR]

Due to the influence of equipment instability and surveying environment, scattering echoes and other factors, it is sometimes difficult to obtain high-quality sub-bottom profile (SBP) images by traditional denoising methods. In this paper, a novel SBP image denoising method is developed for obtaining underlying clean images based on a non-local low-rank framework. Firstly, to take advantage of the inherent layering structures of the SBP image, a direction image is obtained and used as a guidance image. Secondly, the robust guidance weight for accurately selecting the similar patches is given. A novel denoising method combining the weight and a non-local low-rank filtering framework is proposed. Thirdly, after discussing the filtering parameter settings, the proposed method is tested in actual measurements of sub-bottom, both in deep water and shallow water. Experimental results validate the excellent performance of the proposed method. Finally, the proposed method is verified and compared with other methods quantificationally based on the synthetic images and has achieved the total average peak signal-to-noise ratio (PSNR) of 21.77 and structural similarity index (SSIM) of 0.573, which is far better than other methods. [ABSTRACT FROM AUTHOR]

As one of the most commonly used acoustic systems in seabed surveys, the altitude of the side scan sonar from the seafloor is always difficult to determine, especially when raw signal levels and gain information are unavailable. The inaccurate sonar altitudes would limit the applications of sonar image geocoding, target detection, and sediment classification. The sonar altitude can be obtained by using bottom tracking methods, but traditional methods often require manual thresholds or complex post-processing procedures, which cannot ensure accurate and real-time bottom tracking. In this paper, a real-time bottom tracking method of side scan data is proposed based on a one-dimensional convolution neural network. First, according to the characteristics of side scan backscatter strength sequences, positive (bottom sequences) and negative (water column and seabed sequences) samples are extracted to establish the sample sets. Second, a one-dimensional convolution neural network is carefully designed and trained by using the sample set to recognize the bottom sequences. Third, a complete processing procedure of the real-time bottom tracking method is established by traversing each side scan ping data and recognizing the bottom sequences. The auxiliary methods for improving real-time performance and sample data augmentation are also explained in detail. The proposed method is implemented on the measured side scan data from the marine area in Meizhou Bay. The trained network model achieves a 100% recognition of the initial sample set as well as 100% bottom tracking accuracy of the training survey line. The average bottom tracking accuracy of the testing survey lines excluding missed pings reaches 99.2%. By comparison with multi-beam bathymetric data and the statistical analysis of real-time performance, the experimental results prove the validity and accuracy of the proposed real-time bottom tracking method. [ABSTRACT FROM AUTHOR]

To obtain large-scale seabed surface image, this paper proposes a side-scan sonar (SSS) image mosaic method using couple feature points (CFPs) with constraint of track line positions. The SSS geocoded images are firstly used to form a coarsely mosaicked one and the overlapping areas between adjacent strip images can be determined based on geographic information. Inside the overlapping areas, the feature point (FP) detection and registration operation are adopted for both strips. According to the detected CFPs and track line positions, an adjustment model is established to accommodate complex local distortions as well as ensure the global stability. This proposed method effectively solves the problem of target ghosting or dislocation and no accumulated errors arise in the mosaicking process. Experimental results show that the finally mosaicked image correctly reflects the object distribution, which is meaningful for understanding and interpreting seabed topography. [ABSTRACT FROM AUTHOR]