Search

Maritime ship classification is essential for effectively monitoring oceanic activities but faces challenges when using heterogeneous remote sensing data. This research presents a novel dataset called Heterogeneous Ship Data, created by combining synthetic aperture radar (SAR) and optical satellite images of ships. The integration of multimodal data aims to harness the complementary advantages of SAR's all-weather imaging capabilities and optical data's higher interretability and shape discrimination. To leverage the heterogeneous dataset, this paper proposes an ensemble deep learning model called MS3Net (Multi-convolutional network using Spatial attention and Second-order pooling for Ship image classification). MS3Net integrates spatial attention mechanisms and second-order pooling. MS3Net has multiple convolutional branches, each tailored to extract distinct representations from the SAR and optical data through varied filter sizes and kernels. The spatial attention units focus the learning on the most informative parts of the image while suppressing irrelevant features. The second-order pooling captures higher-order interactions between feature elements to model complex relationships. A concatenation fusion strategy aggregates the diverse branch outputs into a joint multimodal feature representation for enhanced discrimination. Extensive experiments demonstrate MS3Net's superior classification accuracy over prior state-of-the-art approaches. The proposed heterogeneous data representation coupled with the attention-based deep ensemble learning model contributes to maritime surveillance by enabling robust ship recognition across diverse sensing modalities. [ABSTRACT FROM AUTHOR]

The classification of ship images has become a significant area of research within the remote sensing community due to its potential applications in maritime security, traffic monitoring, and environmental protection. Traditional monitoring methods like the Automated Identification System (AIS) and the Constant False Alarm Rate (CFAR) have their limitations, such as challenges with sea clutter and the problem of ships turning off their transponders. Additionally, classifying ship images in remote sensing is a complex task due to the spatial arrangement of geospatial objects, complex backgrounds, and the resolution limitations of sensor platforms. To address these challenges, this paper introduces a novel approach that leverages a unique dataset termed Heterogeneous Ship data and a new technique called the Spatial–Channel Attention with Bilinear Pooling Network (SCABPNet). First, we introduce the Heterogeneous Ship data, which combines Synthetic Aperture Radar (SAR) and optical satellite imagery, to leverage the complementary features of the SAR and optical modalities, thereby providing a richer and more-diverse set of features for ship classification. Second, we designed a custom layer, called the Spatial–Channel Attention with Bilinear Pooling (SCABP) layer. This layer sequentially applies the spatial attention, channel attention, and bilinear pooling techniques to enhance the feature representation by focusing on extracting informative and discriminative features from input feature maps, then classify them. Finally, we integrated the SCABP layer into a deep neural network to create a novel model named the SCABPNet model, which is used to classify images in the proposed Heterogeneous Ship data. Our experiments showed that the SCABPNet model demonstrated superior performance, surpassing the results of several state-of-the-art deep learning models. SCABPNet achieved an accuracy of 97.67% on the proposed Heterogeneous Ship dataset during testing. This performance underscores SCABPNet's capability to focus on ship-specific features while suppressing background noise and feature redundancy. We invite researchers to explore and build upon our work. [ABSTRACT FROM AUTHOR]