Search

Logistics parcel detection technology is critical for unmanned sorting. YOLOv5, the state-of-the-art (SOTA) object detection model, is a classic network widely used in engineering. However, on the premise of fast and accurate detection of logistics parcels, it confronts certain challenges of high computing load and parameter quantity. To address these issues, this paper proposes a two-scale lightweight deep learning model named SFYOLOv5. In this article, a lightweight feature extraction module called Pruned-Shuffle-Block (PSB) is proposed. Meanwhile, a double-layer pyramid structure for the medium and large target detection is created in accordance with the image size distribution of logistics parcels. With this structure, the Floating Point of Operations (FLOPs) and parameters in feature extraction were significantly reduced. In addition, a down sampling module named Focus for Downsampling (FFD) is designed and attention modules are introduced to extract high-level semantic information in logistics parcels. These modules not only compensate for the loss caused by down sampling but also improve the mean Average Precision (mAP). Finally, the comparison experiment is performed by using the self-built logistics parcel dataset. The results show that the mAP of the model reaches 99.1%, the number of model parameters decreased by 92.14%, and the FLOPs decreased by 89.57% compared with the existing SOTA model. This model can be used in logistics parcel intelligent sorting. [ABSTRACT FROM AUTHOR]

Danmakus are user-generated comments that overlay on videos, enabling real-time interactions between viewers and video content. The emotional orientation of danmakus can reflect the attitudes and opinions of viewers on video segments, which can help video platforms optimize video content recommendation and evaluate users' abnormal emotion levels. Aiming at the problems of low transferability of traditional sentiment analysis methods in the danmaku domain, low accuracy of danmaku text segmentation, poor consistency of sentiment annotation, and insufficient semantic feature extraction, this paper proposes a video danmaku sentiment analysis method based on MIBE-RoBERTa-FF-BiLSTM. This paper constructs a "Bilibili Must-Watch List and Top Video Danmaku Sentiment Dataset" by ourselves, covering 10,000 positive and negative sentiment danmaku texts of 18 themes. A new word recognition algorithm based on mutual information (MI) and branch entropy (BE) is used to discover 2610 irregular network popular new words from trigrams to heptagrams in the dataset, forming a domain lexicon. The Maslow's hierarchy of needs theory is applied to guide the consistent sentiment annotation. The domain lexicon is integrated into the feature fusion layer of the RoBERTa-FF-BiLSTM model to fully learn the semantic features of word information, character information, and context information of danmaku texts and perform sentiment classification. Comparative experiments on the dataset show that the model proposed in this paper has the best comprehensive performance among the mainstream models for video danmaku text sentiment classification, with an F1 value of 94.06%, and its accuracy and robustness are also better than other models. The limitations of this paper are that the construction of the domain lexicon still requires manual participation and review, the semantic information of danmaku video content and the positive case preference are ignored. [ABSTRACT FROM AUTHOR]

In industry, the task of defect classification and defect localization is an important part of defect detection system. However, existing studies only focus on one task and it is difficult to ensure the accuracy of both tasks. This paper proposes a defect detection system based on improved Yolo_v4, which greatly improves the detection ability of minor defects. For K_Means algorithm clustering prianchors question with strong subjectivity, the paper proposes the Density Based Spatial Clustering of Applications with Noise (DBSCAN) algorithm to determine the number of Anchors. To solve the problem of low detection rate of small targets caused by insufficient reuse rate of low-level features in CSPDarknet53 feature extraction network, this paper proposes an ECA-DenseNet-BC-121 feature extraction network to improve it. And the Dual Channel Feature Enhancement (DCFE) module is proposed to improve the local information loss and gradient propagation obstruction caused by quad chain convolution in PANet networks to improve the robustness of the model. The experimental results on the fabric surface defect detection datasets show that the mAP of the improved Yolo_v4 is 98.97%, which is 7.67% higher than SSD, 3.75% higher than Faster_RCNN, 10.82% higher than Yolo_v4 tiny, and 5.35% higher than Yolo_v4, and the detection speed reaches 39.4 fps. It can meet the real-time monitoring needs of industrial sites. [ABSTRACT FROM AUTHOR]

With a significant number of mechanical products approaching the retirement phase, the batch recycling of discarded mechanical parts necessitates a preliminary assessment of their surface condition. However, the presence of surface rust poses a challenge to defect identification. Therefore, this paper proposes a method for detecting heavily rusted surface defects based on an improved YOLOv8n network. In the Backbone, the C2f-DBB module of re-parameterized deep feature extraction was introduced, and the attention module was designed to improve the accuracy of information extraction. In the Neck part, a Bi-Afpn multiscale feature fusion strategy is designed to facilitate information exchange between features at different scales. Finally, Focal-CIoU is employed as the bounding box loss function to enhance the network's localization performance and accuracy for defects. Experimentally, it is proved that the improved network in this paper improves the Recall, Precision, and mAP0.5 by 1.2%, 2.1%, and 1.9%, respectively, on the original basis, which is better than other network models. [ABSTRACT FROM AUTHOR]

Today, with the rapid growth of communication technology and the development of social networks and smartphones, the amount of data stored by users in the form of images has significantly increased. Therefore, several researchers have focused on the field of image retrieval in the past decade. Image retrieval means retrieving the most similar images to the query sample from a vast image database in terms of content and semantic. So far, various image retrieval methods based on feature engineering or deep features have been proposed. Most methods that use handcrafted features, despite their lower runtime, usually provide lower performance than deep learning-based approaches. In this paper, to increase the efficiency of handcrafted features in image retrieval, their combination with the output of residual blocks in deep neural networks is used in the feature fusion phase. In this paper, the efficiency of feature generation layers in common deep networks such as residual, classical sequential convolution and bottleneck has been analyzed in order to increase the efficiency of image retrieval systems based on handcrafted features. For this purpose, in most popular deep networks, the layers that perform the classification task are removed, and the output of feature generation layers at different depths, with the help of a flattened layer, is converted to feature vectors that can be connected to handcrafted made numerical features in retrieval systems. A variety of popular handcrafted features in the spatial domain, such as color and texture and wavelet in frequency, are employed to generate handcrafted features. This paper presents a novel hybrid feature set based on a combination of classical feature engineering techniques and deep convolutional neural networks suitable for image retrieval. The efficiency of the proposed method is evaluated in terms of precision and recall metrics on the benchmark datasets, such as Corel-1 and -5k. The proposed method provided an accuracy of 96.68 and 94.56% on the Corel-1k and Corel-5k, respectively. The comparative results showed that combining residual block feature maps with handcrafted features compared to bottleneck and sequential classical convolution layers increases the final performance of the image retrieval system. The comparison of the proposed method with state-of-the-art machine learning and deep learning-based techniques shows that the proposed method provides promising results in terms of precision and recall rates. [ABSTRACT FROM AUTHOR]

Video recognition is the fundamental way human eyes and brains perceive the world. The human brain's real recognition, thinking, and memory mechanism has nonlinear dynamical system models, and the interaction between neurons exists in chaotic iterative patterns characterized by nonlinear dynamics. This paper proposes a new method for extracting video face features based on a nonlinear dynamical system, which is constructed by using video images as ternary functions and Discrete Cosine Transform (DCT) basis functions as auxiliary functions. Then, chaotic iterations are performed on the system, and the iteration trajectories are used as video features. Finally, the Pearson correlation coefficient between features is calculated to determine whether the faces in different videos are similar to complete the recognition work. Regarding database preprocessing, we propose Adaptive Threshold Region Detection (ATRD) algorithm for video region segmentation to optimize the database and improve recognition performance. Overall, this paper's method is simple, flexible, and has high recognition accuracy, with good recognition results on the YouTube and VidTIMIT databases. Of course, as a new method, there is still room for improvement and refinement. [ABSTRACT FROM AUTHOR]

Automatic and accurate recognition of abnormal working conditions of fused magnesia furnace is of great significance to the safe and reliable production of fused magnesia. Aiming at the defects of manual judgment of abnormal working conditions in the production process of fused magnesium furnace and the existing recognition method of abnormal working conditions based on machine learning, this paper proposes a working condition recognition model for fused magnesium furnace based on stochastic configuration networks and reinforcement learning. Firstly, a hybrid data augmentation method of generative and non-generative is used to obtain high-quality sample data with salient features. Secondly, based on ResNeXt, multi-scale local features are extracted under the condition of limited parameter quantity by controlling the cardinality. Combining a mixed model that enjoys the benefit of both self-attention and convolution (ACmix) and bidirectional feature pyramid network (BiFPN), the extracted local feature maps of different scales are cross-scale fused and focused, and more differentiated detailed feature information of the region of interest is retained. Thirdly, based on Transformer, the working condition recognition network of fused magnesium furnace is constructed to improve the global correlation between adjacent local features in the spatial dimension. The fused features are sent to stochastic configuration networks to establish a classification criterion for working condition recognition of fused magnesium furnace with generalization ability. Finally, reinforcement learning is used to evaluate the credibility of uncertain recognition results of samples in real time, and a self-optimizing adjustment action strategy at the Transformer encoding layer is defined. Build a library of Transformer models with different encoding layers, which is adapt to the different feature extraction requirements of multi-modal working samples. The experimental results show that the method in this paper has better recognition performance and generalization ability than other algorithms. [ABSTRACT FROM AUTHOR]

Marine mammals are an important part of marine ecosystems, and human intervention seriously threatens their living environments. Few studies exist on the marine mammal call recognition task, and the accuracy of current research needs to improve. In this paper, a novel MG-ResFormer two-channel fusion network architecture is proposed, which can extract local features and global timing information from sound signals almost perfectly. Second, in the input stage of the model, we propose an improved acoustic feature energy fingerprint, which is different from the traditional single feature approach. This feature also contains frequency, energy, time sequence and other speech information and has a strong identity. Additionally, to achieve more reliable accuracy in the multiclass call recognition task, we propose a multigranular joint layer to capture the family and genus relationships between classes. In the experimental section, the proposed method is compared with the existing feature extraction methods and recognition methods. In addition, this paper also compares with the latest research, and the proposed method is the most advanced algorithm thus far. Ultimately, our proposed method achieves an accuracy of 99.39% in the marine mammal call recognition task. [ABSTRACT FROM AUTHOR]

Knowledge graph embedding converts knowledge graphs based on symbolic representations into low-dimensional vectors. Effective knowledge graph embedding methods are key to ensuring downstream tasks. Some studies have shown significant performance differences among various knowledge graph embedding models on different datasets. They attribute this issue to the insufficient representation ability of the models. However, what representation ability knowledge graph embedding models possess is still unknown. Therefore, this paper first selects three representative models for analysis: translation and rotation models in distance models, and the Bert model in neural network models. Based on the analysis results, it can be concluded that the translation model focuses on clustering features, the rotation model focuses on hierarchy features, and the Bert model focuses on word co-occurrence features. This paper categorize clustering and hierarchy as structure features, and word co-occurrence as semantic features. Furthermore, a model that solely focuses on a single feature will lead to a lack of accuracy and generality, making it challenging for the model to be applicable to modern large-scale knowledge graphs. Therefore, this paper proposes an ensemble model with structure and semantic features for knowledge graph embedding. Specifically, the ensemble model includes a structure part and a semantic part. The structure part consists of three models: translation, rotation and cross. Translation and rotation models serve as basic feature extraction, while the cross model enhances the interaction between them. The semantic part is built based on Bert and integrated with the structure part after fine-tuning. In addition, this paper also introduces a frequency model to mitigate the training imbalance caused by differences in entity frequencies. Finally, we verify the effectiveness of the model through link prediction. Experiments show that the ensemble model has achieved improvement on FB15k-237 and YAGO3-10, and also has good performance on WN18RR, proving the effectiveness of the model. [ABSTRACT FROM AUTHOR]

The traditional local binary pattern (LBP) is susceptible to the influence of the centre pixel and noise and cannot accurately identify wire rope surface defects. To solve this problem, an image segmentation-based central multiscale local binary pattern (ISCM-LBP) and grey level cooccurrence matrix (GLCM) feature fusion method is proposed in this paper for defect recognition. Image segmentation and multiple scales are introduced into the local binary pattern algorithm to improve the image detail description and suppress noise sensitivity. Second, the centre pixel is connected with the neighbourhood pixel to enhance the robustness of the centre pixel. To further improve the image integrity description, PCA dimensionality reduction and GLCM feature fusion are performed on the features extracted by the ISCM-LBP algorithm, and the steel wire rope surface defects are identified by a support vector machine classifier. Experimental results show that the overall recognition rate reaches 97.5%, which is at least 5% higher than that of other algorithms and can effectively identify various defects on the surface of wire rope. [ABSTRACT FROM AUTHOR]