Search

In industry, the task of defect classification and defect localization is an important part of defect detection system. However, existing studies only focus on one task and it is difficult to ensure the accuracy of both tasks. This paper proposes a defect detection system based on improved Yolo_v4, which greatly improves the detection ability of minor defects. For K_Means algorithm clustering prianchors question with strong subjectivity, the paper proposes the Density Based Spatial Clustering of Applications with Noise (DBSCAN) algorithm to determine the number of Anchors. To solve the problem of low detection rate of small targets caused by insufficient reuse rate of low-level features in CSPDarknet53 feature extraction network, this paper proposes an ECA-DenseNet-BC-121 feature extraction network to improve it. And the Dual Channel Feature Enhancement (DCFE) module is proposed to improve the local information loss and gradient propagation obstruction caused by quad chain convolution in PANet networks to improve the robustness of the model. The experimental results on the fabric surface defect detection datasets show that the mAP of the improved Yolo_v4 is 98.97%, which is 7.67% higher than SSD, 3.75% higher than Faster_RCNN, 10.82% higher than Yolo_v4 tiny, and 5.35% higher than Yolo_v4, and the detection speed reaches 39.4 fps. It can meet the real-time monitoring needs of industrial sites. [ABSTRACT FROM AUTHOR]

In this paper, a fault feature extraction method based on the combination of computational order tracking (COT) and variational mode decomposition (VMD) is proposed to solve the problem of fault feature extraction in a gearbox under variable speed conditions. First, a speed estimation method based on a forward-backward greedy algorithm and Fourier fitting is proposed to solve the speed estimation problem under variable speed conditions. Then, a feature extraction method based on COT, VMD, and fast kurtometry is proposed. COT is used to calculate the order. After the signal is decomposed by VMD, a fast kurtogram is used to filter the modal components with obvious fault features so as to extract fault features. Finally, combined with the analysis of actual equipment examples, the experimental results show that steady-state filtering can effectively filter the background noise and improve the signal-to-noise ratio. The rotation speed estimated by the forward–backward greedy algorithm and Fourier fitting is very close to the actual speed, which verifies that the method proposed in this paper can effectively solve the problem of fault feature extraction of a gearbox under variable speed conditions. [ABSTRACT FROM AUTHOR]

In recent years, with the development of deep learning, SAR image-based ship target-detection technology has become a current research hotspot. SAR images are characterized by complex backgrounds, significant speckle noise interference, and poor interpretability. To address this challenge, this study proposes a new Gaussian circle radius determination strategy and a multi-level feature fusion codec-based ship detection network (MFFC-SDN) for SAR images. Differing from CenterNet's corner-oriented Gaussian circle strategy, the Gaussian circle strategy proposed in this paper takes the centre point coordinates of the real target as the origin to define a circular region. This approach allows for more precise supervision of the training model. Meanwhile, we propose MFFC-SDN to solve the problem of the poor performance of CenterNet in SAR ship detection. MFFC-SDN is an anchor-free, single-stage target-detection method with a low computation cost. In MFFC-SDN, we introduce a Multilevel Feature Recapture Codec Module (MFR-CM) to enhance the feature extraction capability of the network by using the features of the encoding stage twice because of the easy loss of image features in the lengthy codec process of the CenterNet network backbone. A Residual Attention Pyramid Feature Fusion Module (RA-PFFM) is designed to enhance the feature map and obtain multi-scale features. Experimental results on the SSDD and SAR-ship-dataset show that MFFC-SDN significantly enhances SAR image target-detection performance, effectively addressing detection challenges related to large target size variations and complex environmental conditions. Compared with existing algorithms, MFFC-SDN achieves the highest $A{P^{50}}$ A P 50 . [ABSTRACT FROM AUTHOR]

Fabric defect detection is an important part of the textile industry to ensure product quality. To solve the problems such as the difficulty of detecting small defects and the coexistence of multi-scale defects in fabric defect detection, a fabric defect detection method based on the feature purification fusion structure is proposed in this paper. Specifically, we improve the feature extraction network to enhance the network's ability to focus on small defective features and effectively reduce the model parameters. The existing methods use direct fusion between multi-level feature maps, which will lead to feature confusion. Therefore, we propose the feature purification fusion structure (FPF), which includes the semantic information supplementation strategy (SIS) and the detail information supplementation strategy (DIS). SIS extracts valid information from the deep feature map and supplements it to the shallow feature map, weakening feature information irrelevant to the shallow feature map detection task. DIS adaptively supplements the feature information required by the deep feature map detection task from the shallow feature map. FPF improves the ability of the network to detect small defects and effectively mitigates the aliasing effect generated during feature fusion. The experimental results show that compared to the baseline model YOLOv5s algorithm, our model achieved a 6.8% improvement in detection accuracy, with an average inference frame rate of 37.6 FPS, demonstrating better detection performance in fabric defect detection. Furthermore, extending this model to aluminum profile defect datasets also demonstrates strong performance. [ABSTRACT FROM AUTHOR]

Point cloud registration is widely used in autonomous driving, SLAM, and 3D reconstruction, and it aims to align point clouds from different viewpoints or poses under the same coordinate system. However, point cloud registration is challenging in complex situations, such as a large initial pose difference, high noise, or incomplete overlap, which will cause point cloud registration failure or mismatching. To address the shortcomings of the existing registration algorithms, this paper designed a new coarse-to-fine registration two-stage point cloud registration network, CCRNet, which utilizes an end-to-end form to perform the registration task for point clouds. The multi-scale feature extraction module, coarse registration prediction module, and fine registration prediction module designed in this paper can robustly and accurately register two point clouds without iterations. CCRNet can link the feature information between two point clouds and solve the problems of high noise and incomplete overlap by using a soft correspondence matrix. In the standard dataset ModelNet40, in cases of large initial pose difference, high noise, and incomplete overlap, the accuracy of our method, compared with the second-best popular registration algorithm, was improved by 7.0%, 7.8%, and 22.7% on the MAE, respectively. Experiments showed that our CCRNet method has advantages in registration results in a variety of complex conditions. [ABSTRACT FROM AUTHOR]

3D point cloud registration is a basic task in computer vision. In recent years, various of learning-based methods have been proposed to solve this problem. These methods effectively overcome the original problem of over-reliance on initial conditions and enhance the ability of obtaining the corresponding relationship. However, few methods pay enough attention to local features and tend to cause some mismatches. Therefore, this paper proposes two networks to extract local features sufficiently. To obtain a more accurate correspondence relationship between the point clouds, we propose a feature weight allocation network (FWANet), in which the expression ability of feature is enhanced using the proposed significant feature extraction module. Besides that, we utilize an interference elimination module to remove the interference points and enhance the internal correlation of point clouds. We also propose a spatial structural generation network (SSGNet), which fully utilizes the spatial location information to determine the spatial correspondence and generate a reliable connection after concatenating multi-dimensional features. At last, a complete feature space can be effectively captured after combining our FWANet with SSGNet together. We conducted multiple experiments on ModelNet40 datasets and achieved excellent results. Experimental results on four types of data demonstrate the superiority of our algorithm against the state-of-the-art ones. Our code will be available at https://github.com/liu-zikang/registration as soon as the paper is accepted. [ABSTRACT FROM AUTHOR]

The characteristic frequency of a rub-impact fault is usually very complex and may contain higher harmonics and subharmonics. Due to the uncertainty of harmonic components and the complexity of signal-to-noise ratio (SNR) operation, the general scale transformation stochastic resonance (GSTSR) has certain limitations in the identification of rub-impact faults. To solve this problem, the paper starts with complexity and proposes a rub-impact fault identification method combining a swarm intelligence optimized algorithm (SIOA) with Hjorth parameters and GSTSR. The complexity of vibration signals will change greatly before and after rub-impact faults. The complexity parameter in Hjorth parameters can effectively embody the complexity of signals and is invulnerable to noise interference. Therefore, the complexity parameter in the Hjorth parameters is taken as the objective function of SIOA and combined with GSTSR. Vibration signals from cases are taken as input to adaptive stochastic resonant (ASR) systems, and the system parameters are adaptively and synchronously adjusted to realize the maximal resonant effect. Finally, the spectrum analysis of signals obtained from ASR is used to extract failure features and recognize faults in the rotor–stator rub-impact. The proposed method is verified by comparing it with other schemes under different SIOAs and different operating conditions. The result of the comparison shows that the complexity parameter of the Hjorth parameters can be taken as the objective function of SIOA to accurately identify the rub-impact fault. Meanwhile, the proposed method, compared with the method of taking SNR as an objective function, has a better effect on reducing time costs and strengthening fault characteristics. [ABSTRACT FROM AUTHOR]

With the widespread use of UAVs, UAV aerial image target detection technology can be used for practical applications in the military, traffic planning, personnel search and rescue and other fields. In this paper, we propose a multi-scale UAV aerial image detection method based on adaptive feature fusion for solving the problem of detecting small target objects in UAV aerial images. This method automatically adjusts the convolution kernel receptive field and reduces the redundant background of the image by adding an adaptive feature extraction module (AFEM) to the backbone network. This enables it to obtain more accurately and effectively small target feature information. In addition, we design an adaptive feature weighted fusion network (SBiFPN) to effectively enhance the representation of shallow feature information of small targets. Finally, we add an additional small target detection scale to the original network to expand the receptive field of the network and strengthen the detection of small target objects. The training and testing are carried out on the VisDrone public dataset. The experimental results show that the proposed method can achieve 38.5% mAP, which is 2.0% higher than the baseline network YOLOv5s, and can still detect the UAV aerial image well in complex scenes. [ABSTRACT FROM AUTHOR]

The abort mission refers to the mission where the landing vehicle needs to terminate the landing mission when an anomaly happens and be safely guided to the desired orbit. This paper focuses on solving the time-optimal abort guidance (TOAG) problem in real-time via the feature-based learning method. First, according to the optimal control theory, the features are identified to represent the optimal solutions of TOAG using a few parameters. After that, a sufficiently large data set of time-optimal abort trajectories is generated offline by solving the TOAG problems with different initial conditions. Then, the features are extracted for all generated cases. To find the implicit relationships between the initial conditions and identified features, neural networks are constructed to map the relationships based on the generated data set. Finally, experimental flight tests are conducted to demonstrate the onboard computation capability and effectiveness of the proposed method. [ABSTRACT FROM AUTHOR]

The geometric distortion in panoramic images significantly mediates the performance of saliency detection method based on traditional CNN. The strategy of dynamically expanding convolution kernel can achieve good results, but it also produces a lot of computational overhead in the process of reading the adjacency list, which decreases the computational efficiency. The appearance of graph convolution provides a new way to solve such problems. Although using graph convolution can effectively extract the structural features of the graph, it reduces the accuracy of the model resulting from ignoring the spatial features of the image signal. To this end, this paper proposes a construction method of the multi-scale graph structure of the panoramic image and a panoramic image saliency detection model composed of an image saliency feature extraction network and multi-scale saliency feature fusion network combining the image structure information and spatial information in the panoramic image. First, we establish a graph structure consisting of root and leaf nodes obtained by super-pixel segmentation at different scales and spherical Fibonacci sampling, respectively. Then, a feature extraction network composed of two graph convolution layers and two one-dimensional auto-encoders with the same parameterization is used to extract the salient features of the multi-scale graph structure. Finally, the U-Net network fuses the multi-scale saliency features to get the final saliency map. The results show that the proposed model performs better than the state-of-the-art models in terms of calculation speed and accuracy. [ABSTRACT FROM AUTHOR]

Head Pose Estimation (HPE) has a wide range of applications in computer vision, but still faces challenges: (1) Existing studies commonly use Euler angles or quaternions as pose labels, which may lead to discontinuity problems. (2) HPE does not effectively address regression via rotated matrices. (3) There is a low recognition rate in complex scenes, high computational requirements, etc. This paper presents an improved unconstrained HPE model to address these challenges. First, a rotation matrix form is introduced to solve the problem of unclear rotation labels. Second, a continuous 6D rotation matrix representation is used for efficient and robust direct regression. The RepVGG-A2 lightweight framework is used for feature extraction, and by adding a multi-level feature fusion module and a coordinate attention mechanism with residual connection, to improve the network's ability to perceive contextual information and pay attention to features. The model's accuracy was further improved by replacing the network activation function and improving the loss function. Experiments on the BIWI dataset 7:3 dividing the training and test sets show that the average absolute error of HPE for the proposed network model is 2.41. Trained on the dataset 300W_LP and tested on the AFLW2000 and BIWI datasets, the average absolute errors of HPE of the proposed network model are 4.34 and 3.93. The experimental results demonstrate that the improved network has better HPE performance. [ABSTRACT FROM AUTHOR]

In order to solve the problem that the current three-dimensional segmentation methods ignored the effective use of geometric features when mining point cloud features, this paper proposed the point cloud instance segmentation network 3D-BSNet with bilateral features and similarity measure. The network mainly consisted of two parts, such as bilateral feature learning and lightweight similarity measurement. Firstly, this paper proposed the bilateral feature extraction module with 3D-UNet based on submanifold sparse convolution and multi-layer perceptron. This module could extract semantic and geometric features of point cloud data after voxelization. Secondly, this paper designed the bilateral attention mechanism combining channel dimension and spatial dimension. This module could reduce the information loss in the process of bilateral feature aggregation. Finally, this paper developed the lightweight similarity measurement module. This module could obtain the similarity between neighboring point clouds in the high-dimensional embedded feature space and even generate the segmentation results of fine-grained instances. Experiments show that 3D-BSNet performs well on S3DIS and Scannet（v2） dataset, and the average accuracy rate on Scannet (v2) is 3.3% higher than that of SSTNet, which effectively improves the precision of 3D instance segmentation. [ABSTRACT FROM AUTHOR]

The level of face recognition technology continues to improve, and has achieved an ideal recognition rate in identity authentication, human-computer interaction and other industrial applications, and the market scale keeps growing. However, the occlusion problem in real scenes has not been completely solved. How to restrain or eliminate the negative impact of occlusion on key facial feature, is one of the hot spots in the field of face recognition. Aiming at the problem of lack of face structure information caused by occlusion, this paper reviews the occluded face recognition datasets and the occluded face recognition methods. Firstly, this paper introduces and analyzes some important new occluded face recognition datasets; Secondly, this paper summarizes the traditional learning methods and deep learning based methods to solve occlusion problems, and emphasizes the deep learning based robustness feature extraction and occluded facial information recovery. Finally, this paper summarizes and analyzes the advantages and disadvantages of relevant methods, points out the problems and challenges of occluded face recognition, and prospects the future research directions. [ABSTRACT FROM AUTHOR]

Hyperspectral image (HSI) contains rich spatial and spectral information, which has been widely used in resource exploration, ecological environment monitoring, land cover classification and target recognition. However, the nonlinearity of HSI data and the strong correlation between bands also bring difficulties and challenges to HSI application. In particular, the limited available hyperspectral training samples will lead to the classification accuracy cannot be improved. Therefore, making full use of the advantages of HSI data, through algorithms and strategies to solve the limited training samples, high-dimensional HSI data and effective classification method, so as to improve the classification accuracy. This paper reviews the research results of the feature extraction methods and classification methods of HSI classification in recent years. In addition, this paper expounds five kinds of small sample strategies, and solves the problem of small sample in HSI classification from different angles. Small sample strategy will be the focus of HSI classification research in the future. To solve the problem of small sample classification can greatly promote the application of HSI. [ABSTRACT FROM AUTHOR]

Aiming at the problems of low recognition accuracy and large calculation amount of age estimation, this paper proposes a staged single aggregation backbone network VoVNetv4. In order to improve the feature extraction ability of the network, the Regional One-Shot Aggregation (ROSA) module is proposed in the network for regional encapsulation of the feature module. The classifier adopts the COnsistent RAnk Logits (CORAL) framework, which can solve the problem of inconsistency of classifiers in ordered regression CNNs for multiple binary classification tasks. This paper conducts experimental verification on the Asian Face Age Dataset (AFAD) and compares it with other research methods. The experimental results show that VoVNetv4 can effectively improve the feature extraction and detection ability of the network and improve the detection efficiency of age estimation. [ABSTRACT FROM AUTHOR]

Collaborative problem-solving is a crucial skill to be developed in education. With the development of information technology, collaborative problem-solving in online environments has received increasing attention in recent years. There has been some foundation of research on computer-supported collaborative learning (CSCL) and collaborative problem-solving (CPS). They both have a focus, but there is a trend to combine them. Further understanding of the current state of research on online collaborative problem-solving is much needed. This study reviews 528 relevant papers from the last decade. The researchers summarized the current state of research and hotspots in online collaborative problem-solving based on the visual analysis of CiteSpace. It was found that the number of papers on online collaborative problem-solving is on the rise, with CPS and CSCL as the main research content and 'feature extraction', 'task analysis', and 'computation modeling' as the hot research topics in the past three years. The current research power on CPS and CSCL is mainly distributed in China and the United States, but the inter-institutional collaboration is little. Based on the research results, this paper proposes four future directions to improve the research in online collaborative problem-solving: identity awareness in online collaborative problem-solving, interdisciplinary online collaborative problem-solving, online collaborative problem-solving for teachers, and online collaborative problem-solving and ICT skills. [ABSTRACT FROM AUTHOR]

Scene-matching navigation is one of the essential technologies for achieving precise navigation in satellite-denied environments. Selecting suitable-matching areas is crucial for planning trajectory and reducing yaw. Most traditional selection methods of suitable-matching areas use hierarchical screening based on multiple feature indicators. However, these methods rarely consider the interrelationship between different feature indicators and use the same set of screening thresholds for different categories of images, which has poor versatility and can easily cause mis-selection and omission. To solve this problem, a suitable-matching areas' selection method based on multi-level saliency is proposed. The matching performance score is obtained by fusing several segmentation levels' salient feature extraction results and performing weighted calculations with the sub-image edge density. Compared with the hierarchical screening methods, the matching performance of the candidate areas selected by our algorithm is at least 22.2% higher, and it also has a better matching ability in different scene categories. In addition, the number of missed and wrong selections is significantly reduced. The average matching accuracy of the top three areas selected by our method reached 0.8549, 0.7993, and 0.7803, respectively, under the verification of multiple matching algorithms. Experimental results show this paper's suitable-matching areas' selection method is more robust. [ABSTRACT FROM AUTHOR]

In the process of facial expression recognition, face detection is the prerequisite, image preprocessing is the foundation, facial expression feature extraction is the key, and facial expression classification is the target. Effective feature extraction in this process can improve the accuracy of facial expression classifications. On the other hand, traditional facial expression recognition methods are not only complicated in the feature extraction process, but also unable to obtain more in-depth high-semantic features and deep features from the original image. To solve the above problems, this paper proposes a facial expression recognition method based on multi-channel fusion and lightweight neural network. First, a cascade classifier based on Haar features is used to detect the face region of the facial expression image. Second, the local binary pattern (LBP) is used to extract the local texture features from the face region. Third, face edge features are simultaneously obtained by performing edge detection in the face region based on the Canny edge detection algorithm. Fourth, the obtained face image, LBP texture feature image, and edge detection Canny image are fused, and the fused image is input into the constructed lightweight neural network for training and recognition. Experiments are carried out on the public image databases Facial Expression Recognition 2013 (Fer2013) and extended Cohn–Kanade (CK +) using the hold-out cross-validation method. The experimental results show that the proposed method effectively extracts more complete image features by combining traditional feature extraction algorithms with deep learning feature extraction algorithms, improves the accuracy and robustness of facial expression recognition, and has better recognition rate and generalization ability compared to other mainstream methods. [ABSTRACT FROM AUTHOR]

Few-shot learning is attracting extensive research because of its ability to classify only a few co-trainable samples. Current few-shot learning approaches focus on learning class prototypes representation to solve problems by a simple averaging approach, but this approach ignores intra-class differences. In this paper, we propose a new weighted prototype network for few-shot learning. Our model consists of two modules, feature extraction and prototype modification. We first construct graphs from the embeddings obtained from the feature extraction module. Then we fed these graphs into graph neural networks in order to explore the contribution of each sample to its class prototype from the graph structure. The experimental results on three benchmark datasets show that our proposed model is comparable to the state-of-the-art few-shot learning approach. • Introduced a novel approach for few-shot image classification. • Innovatively transformed the process of assessing sample importance into graph label propagation. • Achieved performance improvements on few-shot benchmark datasets. [ABSTRACT FROM AUTHOR]

Depth images obtained from lightweight, real-time depth estimation models and consumer-oriented sensors typically have low-resolution issues. Traditional interpolation methods for depth image up-sampling result in a significant information loss, especially in edges with discontinuous depth variations (depth discontinuities). To address this issue, this paper proposes a semi-coupled deformable convolution network (SCD-Net) based on the idea of guided depth map super-resolution (GDSR). The method employs a semi-coupled feature extraction scheme to learn unique and similar features between RGB images and depth images. We utilize a Coordinate Attention (CA) to suppress redundant information in RGB features. Finally, a deformable convolutional module is employed to restore the original resolution of the depth image. The model is tested on NYUv2, Middlebury, Lu, and a Real-Sense real-world dataset created using an Intel Real-sense D455 structured-light camera. The super-resolution accuracy of SCD-Net at multiple scales is much higher than that of traditional methods and superior to recent state-of-the-art (SOTA) models, which demonstrates the effectiveness and flexibility of our model on GDSR tasks. In particular, our method further solves the problem of an RGB texture being over-transferred in GDSR tasks. [ABSTRACT FROM AUTHOR]

Three-dimensional (3D) surface reconstruction is used to solve the problem of the narrow field of view in laparoscopy. It can provide surgeons or computer-assisted surgery systems with real-time complete internal abdominal anatomy. However, rapid changes in image depth, less texture, and specular reflection pose a challenge for the reconstruction. It is difficult to stably complete the reconstruction process using feature-based simultaneous localization and mapping (SLAM) method. This paper proposes a robust laparoscopic 3D surface reconstruction method using SLAM, which can automatically select appropriate parameters for stereo matching and robustly find matching point pairs for laparoscope motion estimation. The changing trend of disparity maps is used to predict stereo matching parameters to improve the quality of the disparity map. Feature patch extraction and tracking are selected to replace feature point extraction and matching in motion estimation, which reduces its failure and interruption in feature-based SLAM. The proposed feature patch matching method is suitable for parallel computing, which can improve its computing speed. Evaluation results on public in vivo and ex vivo porcine abdominal video data show the efficiency and robustness of our 3D surface reconstruction approach. [ABSTRACT FROM AUTHOR]

Local feature information plays an important role in image segmentation, however, the referring image segmentation task is dependent on the text expression, so it is impossible to extract local feature information directly from the original reference image. In order to solve this problem, this paper proposes a specific noun-guided local feature extraction deep neural network model（NgLFNet). The NgLFNet model can automatically mine the local feature information of the object to be segmented according to the key nouns in the input text expression. Specifically, the model first obtains key nouns in text through sentence analysis; secondly, extracting corresponding features through text and image encoders, and using the key nouns to obtain local features of high-interest regions through the multihead attention mechanism; then the multi-modal features are gradually fused to learn; Finally, the decoding and correction module uses the obtained local features to perform more detailed corrections on the prediction mask to obtain the final result. The method in this paper is compared with a variety of mainstream referring segmentation methods and the experimental results show that the proposed method improves the accuracy of text-based instance segmentation task. [ABSTRACT FROM AUTHOR]

Zero-shot sketch-based image retrieval (ZS-SBIR) is an important computer vision problem. The image category in the test phase is a new category that was not visible in the training stage. Because sketches are extremely abstract, the commonly used backbone networks (such as VGG-16 and ResNet-50) cannot handle both sketches and photos. Semantic similarities between the same features in photos and sketches are difficult to reflect in deep models without textual assistance. To solve this problem, we propose a novel and effective feature embedding model called Attention Map Feature Fusion (AMFF). The AMFF model combines the excellent feature extraction capability of the ResNet-50 network with the excellent representation ability of the attention network. By processing the residuals of the ResNet-50 network, the attention map is finally obtained without introducing external semantic knowledge. Most previous approaches treat the ZS-SBIR problem as a classification problem, which ignores the huge domain gap between sketches and photos. This paper proposes an effective method to optimize the entire network, called domain-aware triplets (DAT). Domain feature discrimination and semantic feature embedding can be learned through DAT. In this paper, we also use the classification loss function to stabilize the training process to avoid getting trapped in a local optimum. Compared with the state-of-the-art methods, our method shows a superior performance. For example, on the Tu-berlin dataset, we achieved 61.2 + 1.2% Prec200. On the Sketchy_c100 dataset, we achieved 62.3 + 3.3% mAPall and 75.5 + 1.5% Prec100. [ABSTRACT FROM AUTHOR]

The autonomous underwater vehicle (AUV) has a problem with feature loss when recognizing small targets underwater. At present, algorithms usually use multi-scale feature extraction to solve the problem, but this method increases the computational effort of the algorithm. In addition, low underwater light and turbid water result in incomplete information on target features. This paper proposes an enhanced dilated convolution framework (EHDC) for underwater blurred target recognition. Firstly, this paper extracts small target features through hybrid dilated convolution networks, increasing the perceptive field of the algorithm without increasing the computational power of the algorithm. Secondly, the proposed algorithm learns spatial semantic features through an adaptive correlation matrix and compensates for the missing features of the target. Finally, this paper fuses spatial semantic features and visual features for the recognition of small underwater blurred targets. Experiments show that the proposed method improves the recognition accuracy by 1.04% compared to existing methods when recognizing small underwater blurred targets. [ABSTRACT FROM AUTHOR]

In order to effectively improve the tracking performance of the target in various complex environment in the tracking process, the reinforcement research of target features has become one of the important work. In this paper, a Siamese network target tracking algorithm based on parallel channel attention mechanism (PCAM) is proposed by combining feature cascade algorithm with visual attention. Firstly, the characteristics of SENet network and ECA network are fully analyzed. Secondly, the parallel channel attention mechanism is constructed based on ECA module, which integrates global average pooling and maximum pooling. Parallel channel attention mechanism not only solves the problem of channel correlation reduction of SENet module, but also solves the problem of target feature information enhancement. Thirdly, the output model of channel attention is used as the input of spatial attention model to realize the effective complement to channel attention mechanism. By calculating the weight value of different spatial locations, the structural relation between spatial location information is constructed, the feature expression ability of the model is enhanced. Finally, the algorithm is evaluated on standard data sets OTB100, OTB2013, OTB2015, VOT2016 and VOT2018. Experimental results show that the PCAM has stronger feature extraction performance for complex environment, higher target tracking accuracy and robustness, and has strong advantages compared with other comparative experiments. [ABSTRACT FROM AUTHOR]

Vision-based Continuous Sign Language Recognition (CSLR) is a challenging and weakly supervised task aimed at segmenting sign language from weakly annotated image stream sequences for recognition. Compared with Isolated Sign Language Recognition (ISLR), the biggest challenge of this work is that the image stream sequences have ambiguous time boundaries. Recent CSLR works have shown that the visual-level sign language recognition task focuses on image stream feature extraction and feature alignment, and overfitting is the most critical problem in the CSLR training process. After investigating the advanced CSLR models in recent years, we have identified that the key to this study is the adequate training of the feature extractor. Therefore, this paper proposes a CSLR model with Multi-state Feature Optimization (MFO), which is based on Fully Convolutional Network (FCN) and Connectionist Temporal Classification (CTC). The MFO mechanism supervises the multiple states of each Sign Gloss in the modeling process and provides more refined labels for training the CTC decoder, which can effectively solve the overfitting problem caused by training, while also significantly reducing the training cost in time. We validate the MFO method on the popular CSLR dataset and demonstrate that the model has better performance. [ABSTRACT FROM AUTHOR]

To solve the problem of inaccurate description and unreliable relation inference in group activity recognition, this paper focused on constructing a scene relationship graph for three aspects: individual, group, and scene, and proposed a scene relationship graph network（SRGN） for group activity recognition. This method included a feature extraction module, a scene relation graph inference module, and a classification module. The feature extraction module extracted individual features, group features, and scene features by convolutional neural network. To fully explore the impact of scene on individual and group descriptions, the scene relation graph inference module learnt individual features and group features by building individual-scene and group-scene relationship graphs in a two-branch framework. Scene graph inference took into account the influence of individual on group and introduced a cross-branch module. It used the classification module to classify individual features and group features for prediction. The experimental results show that the group recognition accuracy of the proposed method on volleyball and collective activity data sets is improved by 1. 1% and 0. 5%,respectively. It verifies the validity of the scene graph in describing individual feature and group feature. [ABSTRACT FROM AUTHOR]

Image segmentation can be used to monitor some unconventional operations to ensure the quality of the assembled product in the product assembly process. The current supervised image segmentation method requires much time for labeling. And, the assembly segmentation feature is difficult to extract from color images, due to the influence of color, illumination, and texture factors. To solve these problems, this paper proposes a domain adaptive segmentation method for mechanical assembly with normal images as input. The method involves an adversarial learning stage and a self-training stage. The adversarial learning stage includes a segmentation network and a discriminator network. In the segmentation network, transformer and PPM layers are added to improve the segmentation accuracy of small parts. Meanwhile, the discriminator network is used to align the output features for the source and target data. In the self-training stage, the segmentation accuracy of the part edges is further improved by fine-tuning the parameter model. In addition, to ensure the effectiveness of assembly monitoring, this study establishes a domain adaptive semantic segmentation dataset based on normal image, and evaluate the proposed method. Compared with other domain adaptation methods, our two-stage training method has clearer edge processing performance, and the mIoU index reaches 83.67%, about 3.5% higher than the existing advanced method. In general, our network structure is more suitable for mechanical assembly segmentation and monitoring. [ABSTRACT FROM AUTHOR]

In order to solve the problem that the siamese neural network is sensitive to position, complex background and intra-class differences due to the use of image-level feature metrics, this paper proposed a Dual Metric Siamese Neural Network (DM-SiameseNet) . DM-SiameseNet used image-level features and local features (local descriptors) to jointly represent each image, then learned feature maps based on two different levels of similarity measures, and finally used an adaptive fusion strategy to adaptively integrate two different measurement result represented by the level feature. Experimental results showed that the accuracy of the improved model was increased by 5.04% and 9.66%respectively, and was higher than the measurement methods that only use image-level feature representation or local descriptor representation on miniImageNet, TieredImageNet, Stanford Dogs, Stanford Cars and CUB-200 datasets. The experimental results prove that the proposed model not only considers the global features of the image, but also captures more effective local feature information in the image, which improves the generalization ability of the model. [ABSTRACT FROM AUTHOR]

In order to solve the problem wherein too many base station antennas are deployed in a massive multiple-input–multiple-output system, resulting in high overhead for downlink channel state information feedback, this paper proposes an uplink-assisted channel feedback method based on deep learning. The method applies the reciprocity of the uplink and downlink, uses uplink channel state information in the base station to help users give feedback on unknown downlink information, and compresses and restores the channel state information. First, an encoder–decoder structure is established. The encoder reduces the network depth and uses multi-resolution convolution to increase the accuracy of channel state information extraction while reducing the number of computations relating to user equipment. Afterward, the channel state information is compressed to reduce feedback overhead in the channel. At the decoder, with the help of the reciprocity of the uplink and downlink, the feature extraction of the uplink's magnitudes is carried out, and the downlink channel state information is integrated into a channel state information feature matrix, which is restored to its original size. The simulation results show that compared with CSINet, CRNet, CLNet, and DCRNet, indoor reconstruction precision was improved by an average of 16.4%, and outside reconstruction accuracy was improved by an average of 21.2% under all compressions. [ABSTRACT FROM AUTHOR]

The past decade has witnessed significant progress in detecting objects by using enormous features of deep learning models. But, most of the existing models are unable to detect x-small and dense objects, due to the futility of feature extraction, and substantial misalignments between anchor boxes and axis-aligned convolution features, which leads to the discrepancy between the categorization score and positioning accuracy. This paper introduces an anchor regenerative-based transformer module in a feature refinement network to solve this problem. The anchor-regenerative module can generate anchor scales based on the semantic statistics of the objects present in the image, which avoids the inconsistency between the anchor boxes and axis-aligned convolution features. Whereas, the Multi-Head-Self-Attention (MHSA) based transformer module extracts the in-depth information from the feature maps based on the query, key, and value parameter information. This proposed model is experimentally verified on the VisDrone, VOC, and SKU-110K datasets. This model generates different anchor scales for these three datasets and achieves higher mAP, precision, and recall values on three datasets. These tested results prove that the suggested model has outstanding achievements compared with existing models in detecting x-small objects as well as dense objects. Finally, we evaluated the performance of these three datasets by using accuracy, kappa coefficient, and ROC metrics. These evaluated metrics demonstrate that our model is a good fit for VOC, and SKU-110K datasets. [ABSTRACT FROM AUTHOR]

To solve the problem of combustion state recognition in solid oxide fuel cell (SOFC) combustor, this paper proposed a combustion state recognition method based on attention mechanism and image feature pyramid. The method adopted the adaptive gamma correction with weighting distribution (AGCWD) to standardize the input images. It combined two single full connections with 1×1 convolution to replace the squeeze and excitation structure, and proposed a hybrid attention structure combined with spatial attention structure to enhance the ability of feature extraction. To provide multi-scale information communication capability, it constructed the multi-scale bidirectional fusion pyramid by means of bidirectional computation and multi-scale fusion. The experimental results show that the proposed method reaches 99.22% accuracy under the premise of 3.98 M parameters and 397 M floating point operations (FLOPs), and effectively identifies the combustion state in SOFC combustor. [ABSTRACT FROM AUTHOR]

This paper mainly conducts a comparative study of body posture action feature extraction and recognition in three‐dimensional (3D) space through motion capture technology and virtual reality technology. Firstly, this paper proposes a body posture feature extraction method in 3D space to obtain joint point data and conduct body posture feature extraction research. At the same time, this method is used for action recognition research, which solves the difficulty of traditional methods in 3D scene feature extraction and motion recognition. In addition, this paper proposes two action comparison methods in 3D space. One is a 'distance threshold method' that calculates the distance between bones in the form of joint points and bones, which can finally provide the effect of dynamic display of sliders; the other is the 'feature plane method' that calculates the detailed information based on different skeletal joint point planes, and finally provides a text display effect with detailed body posture difference values. Finally, combined with virtual reality technology, an application platform for body posture feature recognition and comparison is designed and implemented, which solves the problems of poor visualization effect and weak interaction of traditional methods. [ABSTRACT FROM AUTHOR]

Surface defect detection of industrial products has become a promising area of research. Among the existing defect detection algorithms, most of the CNN-based methods can achieve the task of defect detection under ideal experimental conditions. However, the accuracy of defect detection is easily affected by the different lighting conditions of the environment and the inconsistency of the defect scale. Therefore, general deep learning methods have difficulties in solving the problem of defect detection in complex scenes. In this paper, a defect detection network based on low-light enhancement and multi-scale feature extraction (LE–MSFE–DDNet) is proposed. There are two blocks in the proposed network, including a low-light enhancement block and a SE-FP block. In the low-light enhancement block, the deep network is applied to enhance light adaptation of the deconstructed low-light feature map in our network. The influence of illumination inconsistency is weakened by the introduction of this block. In the SE-FP block, the dependencies between different channels are combined with the multi-scale feature extraction. The defects with different scales are accurately located through the combination of this block and our network. In addition, a Fine Cans Defect dataset based on the surface of fine cans is collected by this paper to verify the feasibility of the proposed network. The proposed model is compared with the state-of-the-art object detection network and the proposed method achieves 94.3% average accuracy on the Fine Cans Defect dataset. The experimental results show that the proposed method outperforms the state-of-the-art method for surface defect detection. [ABSTRACT FROM AUTHOR]

Diesel engines have a wide range of functions in the industrial and military fields. An urgent problem to be solved is how to diagnose and identify their faults effectively and timely. In this paper, a diesel engine acoustic fault diagnosis method based on variational modal decomposition mapping Mel frequency cepstral coefficients (MFCC) and long-short-term memory network is proposed. Variational mode decomposition (VMD) is used to remove noise from the original signal and differentiate the signal into multiple modes. The sound pressure signals of different modes are mapped to the Mel filter bank in the frequency domain, and then the Mel frequency cepstral coefficients of the respective mode signals are calculated in the mapping range of frequency domain, and the optimized Mel frequency cepstral coefficients are used as the input of long and short time memory network (LSTM) which is trained and verified, and the fault diagnosis model of the diesel engine is obtained. The experimental part compares the fault diagnosis effects of different feature extraction methods, different modal decomposition methods and different classifiers, finally verifying the feasibility and effectiveness of the method proposed in this paper, and providing solutions to the problem of how to realise fault diagnosis using acoustic signals. [ABSTRACT FROM AUTHOR]

In MOOC learning, learners' emotions have an important impact on the learning effect. In order to solve the problem that learners' emotions are not obvious in the learning process, we propose a method to identify learner emotion by combining eye movement features and scene features. This method uses an adaptive window to partition samples and enhances sample features through fine-grained feature extraction. Using an adaptive window to partition samples can make the eye movement information in the sample more abundant, and fine-grained feature extraction from an adaptive window can increase discrimination between samples. After adopting the method proposed in this paper, the four-category emotion recognition accuracy of the single modality of eye movement reached 65.1% in MOOC learning scenarios. Both the adaptive window partition method and the fine-grained feature extraction method based on eye movement signals proposed in this paper can be applied to other modalities. [ABSTRACT FROM AUTHOR]

In order to solve the problem of high noise and insufficient feature extraction of Retinex-Net in low-light image enhancement processing, this paper proposes a new network structure. First, the Retinex-Net network was used as the basic model to decompose the input image, and a residual shrinkage network was introduced in the convolutional layer to remove the noise generated during the decomposition process. Then, in order to preserve the details of the image and suppress noise while enhancing the brightness, the enhancement network was divided into three small sub-networks for processing respectively. Finally, the adjusted images were fused to obtain an enhanced image. Compared with the SIRE, LIME, GLADNet, Retinex-Net algorithm, experiments show that the peak signal-to-noise ratio of the images processed by the algorithm in this paper has an average increase of 3.48 dB, the mean square error has an average increase of 0.082 7, the structural similarity has an average increase of 0.146, and the lightness order error has an average increase of 271.6. [ABSTRACT FROM AUTHOR]

Chip pad inspection is of great practical importance for chip alignment inspection and correction. It is one of the key technologies for automated chip inspection in semiconductor manufacturing. When applying deep learning methods for chip pad inspection, the main problem to be solved is how to ensure the accuracy of small target pad detection and, at the same time, achieve a lightweight inspection model. The attention mechanism is widely used to improve the accuracy of small target detection by finding the attention region of the network. However, conventional attention mechanisms capture feature information locally, which makes it difficult to effectively improve the detection efficiency of small targets from complex backgrounds in target detection tasks. In this paper, an OCAM (Object Convolution Attention Module) attention module is proposed to build long-range dependencies between channel features and position features by constructing feature contextual relationships to enhance the correlation between features. By adding the OCAM attention module to the feature extraction layer of the YOLOv5 network, the detection performance of chip pads is effectively improved. In addition, a design guideline for the attention layer is proposed in the paper. The attention layer is adjusted by network scaling to avoid network characterization bottlenecks, balance network parameters, and network detection performance, and reduce the hardware device requirements for the improved YOLOv5 network in practical scenarios. Extensive experiments on chip pad datasets, VOC datasets, and COCO datasets show that the approach in this paper is more general and superior to several state-of-the-art methods. [ABSTRACT FROM AUTHOR]

The automatic parking system based on vision is greatly affected by uneven lighting, which is difficult to make an accurate judgment on parking spaces in the case of complex image information. To solve this problem, this paper proposes a parking space visual detection and image processing method based on deep learning. Firstly, a 360-degree panoramic system was designed to photograph the vehicle environment. The image has been processed to obtain a panoramic aerial view, which was input as the original image of the parking space detection system. Secondly, the Faster R-CNN (Region-Convolutional Neural Network) parking detection model was established based on deep learning. It was aimed to detect and extract the parking space from the input image. Thirdly, the problems of uneven illumination and complex background were solved effectively by removing the background light from the image. Finally, a parking space extraction method based on the connected region has been designed, which further simplified the parking space extraction and image processing. The experiment results show that the mAP (mean Average Precision) value of the Faster R-CNN model using 101-Floor ResNet as the feature extraction network is 89.30%, which is 2.28% higher than that of the Faster R-CNN model using 50-Floor ResNet as the feature extraction network. The model built in this paper can detect most parking spaces well. The position of the output target box is accurate. In some test scenarios, the confidence of parking space recognition can even reach 100%. In summary, the proposed method can realize the effective identification and accurate positioning of parking spaces. [ABSTRACT FROM AUTHOR]

Facial expression recognition based on residual networks is important for technologies related to space human-robot interaction and collaboration but suffers from low accuracy and slow computation in complex network structures. To solve these problems, this paper proposes a multiscale feature fusion attention lightweight wide residual network. The network first uses an improved random erasing method to preprocess facial expression images, which improves the generalizability of the model. The use of a modified depthwise separable convolution in the feature extraction network reduces the computational effort associated with the network parameters and enhances the characterization of the extracted features through a channel shuffle operation. Then, an improved bottleneck block is used to reduce the dimensionality of the upper layer network feature map to further reduce the number of network parameters while enhancing the network feature extraction capability. Finally, an optimized multiscale feature lightweight attention mechanism module is embedded to further improve the feature extractability of the network for human facial expressions. The experimental results show that the accuracy of the model is 73.21%, 98.72%, and 95.21% on FER2013, CK+ and JAFFE, respectively, with a covariance of 10.14 M. Compared with other networks, the model proposed in this paper has faster computing speed and better accuracy at the same time. [ABSTRACT FROM AUTHOR]

In order to solve the problems of large number of parameters and high GPU resource cost in binocular vision stereo matching method based on neural network in robot and unmanned driving fields, this paper proposed a multi-scale aggregation stereo matching method. Firstly, this paper proposed a multi-scale feature extraction network to obtain richer features without changing the resolution by using dilated convolution, and introduced the attention mechanism was. Then, features at different resolutions were cross-fused to improve the feature information. Secondly, the acquisition method of cost volume was changed, the cost volume was obtained by aggregation at low scale, and continuously combined the high-scale similar information to update iteratively, and cross fused multiple cost volumes to obtain the final cost volume. Finally, combined with the refinement module of attention mechanism, the outliers and discontinuous regions in the initial disparity map are corrected to obtain the final disparity map. Experimental results show that the algorithm can run under low parameter number and low cost GPU resources, and obtain good matching accuracy. [ABSTRACT FROM AUTHOR]

A feature selection method based on three-way decision is proposed to solve the problem of target recognition under high-dimension and few-shot data. The main research results of this paper include the following aspects: (1) aiming at the uncertainty of existing algorithm caused by uncertain data in high-dimension and few-shot data, based on the traditional filtering feature selection ReliefF algorithm, the algorithm is improved, according to the three-way decision thought, the single threshold of original algorithm is extended into two thresholds, to increase the rate of fault tolerance of the original algorithm, avoid features is too much or too little to eliminate. (2) To solve the problem of "dimension disaster" of high-dimension and few-shot data, the features are divided into three domains according to two thresholds and feature weights, and then the features in the boundary domain are further selected by combining the wrapper feature selection idea to reduce the dimension and obtain the optimal feature subset. Finally, the experimental results show that the recognition accuracy and F1 have been improved. Experiment 1 proved the fault tolerance rate and stability of the proposed algorithm, and Experiment 2 verified the advantages of the proposed algorithm in small sample conditions. [ABSTRACT FROM AUTHOR]

Federated learning is designed to solve the problem of data fragmentation and data isolation based on privacy protection in distributed machine learning. In the federated learning system, participants collaboratively train a model. Each participant uses local data to train the local model, and uploads the trained local model to the server for aggregation. In the real application environment, the data distribution between nodes is often very different, resulting in the accuracy of federated learning model is low. In order to solve the influence of non-independent identically distributed data on the accuracy of the model, this paper proposed a clustering federated learning framework by using the similarity of data distribution between different nodes. Extensive experiments were conducted on Synthetic, CIFAR-10 and FEMNIST standard datasets. Compared with other federated learning methods, clustering federated learning based on data distribution greatly improves the accuracy of the model and requires less computation. [ABSTRACT FROM AUTHOR]

The main goal of person re-identification (ReID) is to identify human images captured by different cameras. However, people are often occluded by various obstacles. To solve the occlusion problem, this paper proposes a novel method that occluded person re-identification based on embedded graph matching network for contrastive feature relation. It involves three modules. In the contrast feature construction (C) module, we use the trained pose estimation (PE) model to extract the local features shown by the key points of person image. In addition, we propose the global discrepant contrastive pooling (GDCP) layer to capture global features after noise removal. At this point, the extracted features are only the node feature information,and what is not connected is a single one. In the adaptive node relationship (R) module, the node relation learning (NRL) layer is proposed to establish the contrast feature relationship between the individual information of feature extraction and the joint structure of monitoring the key points of the feature relationship, so as to automatically update the relationship between features, promote the transmission of meaningful features and inhibit the transmission of meaningless features. In this way, the relationship between the feature information can also be extracted. In the embedded graph matching (M) module, the embedded feature alignment (EFA) layer is proposed to directly predict the similarity score of each feature of the two images. In addition, the information collected from the non-occluded part of one image is used to compensate the occluded part corresponding to the other image, which reduces the dispersion of image information. We avoid using a sensitive one-to-one hard alignment instead of many-to-many soft alignment to enhance robustness. On Occluded_Duke, DukeMTMC and Market1501,this method is superior to the existing person re-identification methods. Particularly on Occluded_Duke, the Rank-1 reaches 60.5%, and mAP reaches 49.2%. [ABSTRACT FROM AUTHOR]

There is a huge demand for weather cloud images in the observatory' s weather monitoring system. In order to solve the problems of model instability and loss of image features when the conventional generative adversarial network expands the dataset of the weather cloud images, this paper proposed a double-layer embedded adversarial image generation method based on SAU-Net DCGAN. This method consisted of two layers of networks which were nested within each other. Firstly,by the first layer of embedded network, it added the U-shaped network to the generator of the generative adversarial network. This network acted as the basic architecture and enhanced the feature recovery capability of the image by using the jump connection between the encoder and the decoder. Secondly,by the second layer of embedded network, it added SA to the U-shaped network. This attention mechanism reduced the complexity of the model by simplifying the parameters, improved effectively the feature loss in the dark part of the image. Finally, it developed a new weight calculation method to strengthen the connection between each features and improved the extraction of detail texture features from the images. The experimental results show that the quality of the images generated by this method is better than that of the conventional generative adversarial network in terms of sharpness and saturation. The evaluation indicators PSNR and SSIM have increased by 27. 06 dB and 0. 606 5 respectively. [ABSTRACT FROM AUTHOR]

Semantic segmentation is an important task for the interpretation of remote sensing images. Remote sensing images are large in size, contain substantial spatial semantic information, and generally exhibit strong symmetry, resulting in images exhibiting large intraclass variance and small interclass variance, thus leading to class imbalance and poor small-object segmentation. In this paper, we propose a new remote sensing image semantic segmentation network, called CAS-Net, which includes coordinate attention (CA) and SPD-Conv. In the model, we replace stepwise convolution with SPD-Conv convolution in the feature extraction network and add a pooling layer into the network to avoid the loss of detailed information, effectively improving the segmentation of small objects. The CA is introduced into the atrous spatial pyramid pooling (ASPP) module, thus improving the recognizability of classified objects and target localization accuracy in remote sensing images. Finally, the Dice coefficient was introduced into the cross-entropy loss function to maximize the gradient optimization of the model and solve the classification imbalance problem in the image. The proposed model is compared with several state-of-the-art models on the ISPRS Vaihingen dataset. The experimental results demonstrate that the proposed model significantly optimizes the segmentation effect of small objects in remote sensing images, effectively solves the problem of class imbalance in the dataset, and improves segmentation accuracy. [ABSTRACT FROM AUTHOR]

With the continuous development of social economy, English learning plays an increasingly important role in daily communication. However, the update speed of English textbooks is far lower than the development speed of English. How to reconstruct the text of English textbooks in colleges and universities to improve the learning effect of college English has become an urgent problem to be solved. In order to solve this problem more effectively, this paper proposes a text reconstruction method for college English textbooks from the perspective of language images. First, this paper proposes a text reconstruction network model for college English textbooks, which includes two self-network models, namely, a text feature extraction network and an image feature extraction network. Second, text designs an English text feature reconstruction network to fuse image features and text features to guide the generation of new English texts according to the generated emotions. Finally, through a large number of experiments, it is proved that the text reconstruction method of college English textbooks from the perspective of language images can effectively generate new texts of college English textbooks, enhance the emotional color of college textbooks, and improve the effect of English learning. [ABSTRACT FROM AUTHOR]

In image retrieval based on deep hashing, to solve the problems of low feature extraction efficiency in convolutional neural networks (CNN ) and underutilization of feature correlation, this paper proposed a novel method combining sparse difference network and multi-supervised hashing( SDNMSH ), and used it for efficient image retrieval. SDNMSH took pairs of images as training inputs, and guided hash codes learning through an elaborately designed sparse difference convolutional neural network and a supervised hash function. The sparse difference convolutional layer and the vanilla convolutional layer composed the sparse difference convolutional neural network. The sparse difference convolutional layer could quickly extract rich feature information, to achieve efficient feature extraction of the entire network. At the same time, in order to make full use of the pairwise correlation of semantic information and features, so as to promote the feature information extracted by the network to be more effectively transformed into discriminative hash codes, and then to achieve efficient image retrieval by using SDNMSH, this paper adopted a multi-supervised hash( MSH) function and designed an objective function for this purpose. Extensive experimental results on three widely used datasets MNIST,CIFAR-10 and NUS-WIDE show that SDNMSH achieves better retrieval performance, compared with the state-of-the-arts. [ABSTRACT FROM AUTHOR]

Lane detection is one of the difficulties in implementing an advanced driving assistance system. In this paper, we show that the existing single frame-based algorithm suffers from the problem of unsatisfied detection result, which is directly caused by some extremely poor road environments (such as severe shadow occlusion and severe fading). To solve the problem, this paper proposes a multi-lane detection method based on the improved U-SegNet model. In order to get better feature extraction results, the number of network layers of the U-SegNet model is deepened, and a many-to-many structure is also proposed to improve the recognition rate of the algorithm. During the training stage, continuous multiple frames are input into the RNN module to get the feature maps for feature learning and prediction. The proposed method is tested on Caltech lane marking dataset, the results show that the proposed algorithm has good robustness and real-time performance, the multi-lane marking can be better detected under most complex road conditions, and the average detecting accuracy can achieve 96.95%. [ABSTRACT FROM AUTHOR]