Search

Aiming at the problem of insufficient feature extraction ability of deep clustering algorithm on multivariate time series data( MTS), This paper proposes a new deep clustering structure model (MDTC. In order to extract the key features of MTS and realize dimensionality reduction, one-dimensional convolution learns the attribute and temporal dimension feature representation of MTS and the autoencoder structure composed of network layers such as recurrent neural network; To improve the model’s ability to represent temporal features, this paper proposes MCBAM temporal attention module, which is used to enhance the representation features of different time periods in the MTS sequence. This paper conducts experiments on nine publicly available UEA multivariate time series datasets, compared with other autoencoders, the autoencoder structure of the model improves by 2%-9% on 7 data sets; Compared with other attention modules, the MCBAM module of the model improves by 0.3%-2% on the six datasets. Experiments show the effectiveness of the MDTC model structure and MCBAM module, and the model has excellent performance compared with other clustering algorithms. [ABSTRACT FROM AUTHOR]

Predictive business process monitoring(PBPM) represents a vital research field within BPM that aims to accurately predict future behavioral events. At present, deep learning methods are widely used in PBPM research. However, most of these methods consider only a single event-control flow perspective and do not fuse the attribute-data flow perspective for process prediction. To address this issue, this paper proposed a method called the fusion multi-perspective(FMP) framework based on a two-layer BERT neural network. Firstly, the first layer of BERT was used to learn attribute-data flow information. Subsequently, the second layer of BERT learnt event-behavior control flow information. Finally, the FMP framework combined data flow and control flow to achieve multi-perspective process prediction. Experimental results on real event logs demonstrate that, compared to other research methods, the FPM framework yields higher accuracy in predicting the next event activity. This validates that the FPM framework, which merges multi-perspective views of processes, enables a more comprehensive and in-depth analysis of complex process behaviors while enhancing predictive performance. [ABSTRACT FROM AUTHOR]

COVID-19 is spreading rapidly around the world. In order to diagnose it quickly and accurately and thus block the chain of epidemic transmission, the study proposed a deep learning-based classification network DLDA-A-DenseNet. Firstly, DenseNet-201 combined deep layer dense aggregation to aggregate feature information at different stages to enhance its ability to identify and localize lesions. Secondly, this paper proposed efficient multi-scale long-range attention to refine the aggregated features. Moreover, this paper used a balanced sampling training strategy to eliminate the bias for the class imbalance problem of CT image dataset. Testing on the China consortium of chest CT image investigation dataset, the method improved 2.24%,3.09%,2.09%,2.60% and 3.48% in accuracy, recall, precision, F1 score and Kappa coefficient compared with DenseNet-201,and achieved an optimal accuracy of 99.50% on COVID-CISet image dataset. The results show that the proposed COVID-19 CT image classification method can fully extract the lesion features of CT slices compared with other methods, and has higher classification accuracy and good generalizability. [ABSTRACT FROM AUTHOR]

Local feature information plays an important role in image segmentation, however, the referring image segmentation task is dependent on the text expression, so it is impossible to extract local feature information directly from the original reference image. In order to solve this problem, this paper proposes a specific noun-guided local feature extraction deep neural network model（NgLFNet). The NgLFNet model can automatically mine the local feature information of the object to be segmented according to the key nouns in the input text expression. Specifically, the model first obtains key nouns in text through sentence analysis; secondly, extracting corresponding features through text and image encoders, and using the key nouns to obtain local features of high-interest regions through the multihead attention mechanism; then the multi-modal features are gradually fused to learn; Finally, the decoding and correction module uses the obtained local features to perform more detailed corrections on the prediction mask to obtain the final result. The method in this paper is compared with a variety of mainstream referring segmentation methods and the experimental results show that the proposed method improves the accuracy of text-based instance segmentation task. [ABSTRACT FROM AUTHOR]

To address the problem of poor recommendation accuracy in the session recommendation model, this paper proposed a capsule-based graph convolutional disentanglement for session-aware recommendation (CGCD) method.Specifically, it used disentangled learning technique to transition item embedding into factor embedding based on multiple sub-channels. Then, it used a capsule dynamic fusion strategy to aggregate different factors to obtain a new item embedding.In addition, it used a multi-head attention mechanism to assign weights to each item in the session. Finally, it aggregated the item embedding with other items in the current session according to the assigned weights, and then generated an accurate session representation to achieve item recommendation. Experiments on two publicly available real datasets show that the proposed model can improve the Pre@10, Pre@20, MRR@10 and MRR@20 by 5.17%, 2.99%, 6.56% and 2.94% on average of the recommended performance, which verifies the effectiveness and efficiency of the method in this paper. [ABSTRACT FROM AUTHOR]

In dynamic gesture recognition methods based on deep learning, aiming at the problems of large network scale, simple dimension of extracted spatiotemporal features, and insufficient extraction ability of effective features, this paper proposed a deep network framework. Firstly, this paper applied a novel spatiotemporal convolution module based on multiscale information fusion in the time domain to improve the 3D residual network structure, greatly reduced the size of the network and obtained rich spatiotemporal receptive field characteristics. Then it introduced a spatiotemporal feature channel attention mechanism with global information synchronization, and used a few parameters to construct the global dependency between feature maps, and the module could obtain the key features of dynamic gestures more efficiently. The experimental results on the self-built gesture dataset SHC and the public gesture dataset SKIG show that the proposed gesture recognition method has fewer parameters and more powerful multiscale spatiotemporal feature extraction ability, and gains a higher recognition rate than the current mainstream algorithms. [ABSTRACT FROM AUTHOR]

For the beamforming design of intelligent reflector assisted large-scale MISO systems, most of the current researches are basing on the fully known channel state information, and do not consider the coupling relationship between the active beamforming matrix at the base station and the reflection coefficient matrix of intelligent reflector. The intelligent reflector assisted channel is a cascade channel, which is difficult to estimate and has high pilot frequency overhead. In view of this, this paper proposed a hybrid intelligent reflective surface architecture containing active and passive components. Firstly, based on the sparse characteristics of millimeter-wave channels, it used the compressed sensing algorithm to estimate the channels, and designed a two-stage convolutional network framework integrating attention mechanism to jointly optimize the reflection coefficient matrix and beamforming matrix with the aim of maximizing and rate. The experimental results show that compared to existing methods, the proposed method can achieve better sum rate performance with fewer pilots, effectively reducing pilot loss and reducing computational time complexity. And when the communication environment changes, the network also has good robustness. [ABSTRACT FROM AUTHOR]

The recommendation algorithm based on graph neural network can extract the association relationship between users and goods. Traditional methods can’t extract this relationship. At present, most of these algorithms ignore the general prefe-rences in the review data of users and products. In order to solve this problem, this paper proposed a new method. This me-thod used the graph neural network to extract association relations, and the advantage of deep learning to extract the general preferences, and carried out feature fusion to improve the recommendation effect. This paper conducted comparative experiments and ablation experiments on four sets of public data sets to verify the effectiveness of the proposed method. The evaluation indexes include the recall rate and normalized discounted cumulative gain. Experiments show that this method is more effective than the existing algorithms. The feature fusion of the two networks can improve the recommendation effect. [ABSTRACT FROM AUTHOR]

Aiming at the problem of fine-grained visual categorization, this paper proposed an effective algorithm to achieve end-to-end fine-grained visual categorization. The ECA module in ECA-Net was a channel attention mechanism with significant performance advantages. It model-fused with the classic network ResNet-50 to form the ResEca. Then, it used the object-level image positioning module and the part-level image generation module to generate object-level and part-level images. Those images combined with original images could be as the input of the new constructed network Tb-ResEca-Net. This paper trained the 95. 1% and 95. 3% respectively on the test set of the corresponding dataset. The experimental results show that this method has higher classification accuracy and stronger robustness compares with other traditional fine-grained classification methods, which is an effective fine-grained image classification method. [ABSTRACT FROM AUTHOR]

Single object tracking( SOT) is a technique to analyze the motion status and provide localization of the single target by using target appearance and context information in video. It has promising applications in intelligent surveillance, intelligent interaction, navigation and guidance, etc. However, problems such as occlusion, background interference and appearance variation led to slow progress in practical applications. With the rapid development of deep learning in recent years, the study of using deep learning techniques to optimize SOT algorithm has become one of the hot spots in computer vision. Around the SOT algorithm based on deep learning, this paper respectively provided outline and analysis of each of the six aspects of correlation filter, Siamese networks, meta-learning, attention, recurrent neural networks and generative adversarial networks according to the core algorithms, after analyzing the basic principles of SOT. In addition, this paper summarized the current state of research and proposed the development trend and optimization ideas of the algorithms. [ABSTRACT FROM AUTHOR]

Existing lip-reading algorithms for Chinese sentences are inadequate at feature extraction and visual ambiguity resolution, which leads to low accuracy. Aiming at this problem, this paper proposed a lip-reading algorithm for Chinese sentences based on temporal convolutional network and 3D convolutional neural network（3DT-CHLipNet）.Firstly, it used a Temporal Convolutional Network to extract long-term features from lip dynamics sequences, which has a much larger receptive field than the Long Short Term Memory Network. Secondly, in order to minimize the visual ambiguity in Chinese lipreading, it adopted a Transformer model with the self-attention mechanism to capture the context information and improve the accuracy of sentence prediction. Finally, it introduced a temporal masking data augmentation strategy in the data preprocessing to further reduce the error rate of the algorithm. Comparison experiments on CMLR, the largest open-source Sequence-to-Sequence Chinese Mandarin Lip Reading dataset, show that the improvement in accuracy over representative lip reading algorithms for Chinese sentences ranges from 2.17%to 23.99%. [ABSTRACT FROM AUTHOR]

There is a huge demand for weather cloud images in the observatory' s weather monitoring system. In order to solve the problems of model instability and loss of image features when the conventional generative adversarial network expands the dataset of the weather cloud images, this paper proposed a double-layer embedded adversarial image generation method based on SAU-Net DCGAN. This method consisted of two layers of networks which were nested within each other. Firstly,by the first layer of embedded network, it added the U-shaped network to the generator of the generative adversarial network. This network acted as the basic architecture and enhanced the feature recovery capability of the image by using the jump connection between the encoder and the decoder. Secondly,by the second layer of embedded network, it added SA to the U-shaped network. This attention mechanism reduced the complexity of the model by simplifying the parameters, improved effectively the feature loss in the dark part of the image. Finally, it developed a new weight calculation method to strengthen the connection between each features and improved the extraction of detail texture features from the images. The experimental results show that the quality of the images generated by this method is better than that of the conventional generative adversarial network in terms of sharpness and saturation. The evaluation indicators PSNR and SSIM have increased by 27. 06 dB and 0. 606 5 respectively. [ABSTRACT FROM AUTHOR]

For image denoising, this paper proposed CEANet which had a dual-channel dilated convolution with attention mechanism to solve the problem of information loss caused by deep neural network. Reserving block merged output feature maps of each layer to make up the loss of detail information during convolution. Dilated convolution achieved better balance between denoising performance and efficiency,extracting more features with less parameters and enhancing the representation capability of the model for noisy images. The sparse module of dilated convolution expanded the receptive field to extract significant structural information and edge features and recover details of complicated noisy images. The feature enhancement module based on attention mechanism further guided network for image denoising by fusing global features with local features. The experimental results show that CEANet achieves high peak signal-to-noise ratio and structure similarity mean value at Gaussian white noise level of 25 and 50, which can capture image detail information more efficiently and has better performance in edge retention and noise suppression. Through the above comparative experiments proved the effectiveness of the algorithm framework. [ABSTRACT FROM AUTHOR]

In order to solve the problem that the existing super-resolution algorithm based on deep learning didn't make full use of the feature information of each level, resulting in low reconstruction accuracy and large parameter quantity, this paper proposed a double dense connection structure named densely channel attention skip connection network. In the inner structure of the network, it improved the original dense cascade block to generate a channel separable dense cascade block. The outer structure adopted a densely residual connection and attention mechanism to fuse the features extracted by the dense block to achieve the goal that less convolution layer and higher precision effect. This paper tested the network models on several benchmark datasets . The results show the proposed model has higher accuracy and fewer parameters than the other models. [ABSTRACT FROM AUTHOR]

Copyright of Application Research of Computers / Jisuanji Yingyong Yanjiu is the property of Application Research of Computers Edition and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

Aiming at the poor classification effect caused by complex background, large intra-class difference and high interclass similarity in remote sensing scene images, this paper proposed an attentional mechanism and residual contraction unit algorithm based on supervised contrast learning. Firstly, the algorithm improved the effective channel attention mechanism (ECA), and optimized the extraction of image features to be recognized. Then, the algorithm proposed a cooperative residual shrinkage unit algorithm, which is used to filter and eliminate redundant information of images. In addition, supervised contrast learning algorithm was used to enhance the generalization ability of the algorithm. Finally, experiments were carried out with remote sensing image data set and compared with the latest algorithms such as enhanced attention algorithm and scale attention mechanism algorithm. Experimental results show that the proposed algorithm improves the classification accuracy by 1.75% and 2.5% in AID Data Set with 20% training ratio. [ABSTRACT FROM AUTHOR]

Existing deep learning based single image super-resolution (SISR) models usually improve the fitting ability of the model by increasing the number of network layers, but fail to fully extract and reuse features, leading low quality of reconstructed images. To solve this problem, this paper proposed an image super-resolution model based on feature fusion and attention mechanism. This model used residual in residual (RIR) structure in feature extraction module. The feature extraction module of the network consisted of several residual groups. Each residual group consisted of several residual blocks. This module implemented local feature fusion in each residual group and global feature fusion between each group. In addition, this model introduced coordinate attention module into each residual block and spatial attention module into each residual group. It verifies that the model is able to fully extract features and reuse features. The final experimental results show that the model is superior to the existing models in objective evaluation indexes and subjective visual effect. [ABSTRACT FROM AUTHOR]

Aiming at the problem of low person re-identification accuracy caused by similar appearance and posture of person in surveillance videos, this paper proposed a video-based person re-identification method based on a graph model, which effectively utilized the time sequence information in the video to realize the information interaction across frames and intra-frame regions. Specifically, it used the correlation information between the cross-frame block regions to establish the inherent relationship between the regional nodes, and iteratively updated the regional information through feature propagation. On the other hand, in the metric learning process, it proposed a weighted loss function strategy, which optimized the binary allocation method (that is, discarding or retaining the sample) in the previous mining strategy into a continuous score allocation method, which solved the problem that the available samples were not used efficiently. Finally, it evaluated the model on MARS and DukeMTMC-VideoReID datasets, and the experimental results confirm the effectiveness of the proposed method. [ABSTRACT FROM AUTHOR]

With the popularity and development of deep learning, the existence of adversarial samples is a serious threat to the security of the deep learning model. For the attack problem of adversarial samples in the physical world, this paper proposed a physical adversarial sample detection method based on attention mechanism. The method combined attention mechanism and feature compression to detect pertinently of local visual adversarial samples, excluded effects of non-major regions, and reduced calculation effort. It effectively combined multiple feature compression methods to deal with the main areas of the sample, which destroyed the structure of the antagonistic block and made them unaggressive. Perform defense tests on different adversarial attacked on the MNIST and CIFAR-10 data sets and compared with other countermeasures. The experimental results show that the defense accuracy of the method can reach more than 95%. This method is higher versatility and stronger stability than other local adversarial sample defense methods, and can effectively defense the attack of local visual adversarial samples. [ABSTRACT FROM AUTHOR]

Aiming at the problems of complex background, variety of change types, missing detection and rough boundary recognition in high-resolution remote sensing image of the same region, this paper proposed a high-resolution remote sensing image building change detection algorithm based on Siam-UNet++network. The algorithm used UNet++as the backbone extraction network. In the encoder phase, it applied the Siam-diff structure to extract the change features of the two sequential images, and employed the attention mechanism after the up sampling and lateral jump path connection in the decoding stage to highlight the building change features and inhibit the network learning from other types of features. Meanwhile, it used the MSOF strategy to weight and fuse feature information of different semantic levels, which improved the accuracy of building change detection. Finally, it adopted a sliding window method to predict large-scale remote sensing images, reducing the hole pattern generated by the change result map during the splicing process. The experimental results demonstrate that proposed algorithm shows better performance than other models. [ABSTRACT FROM AUTHOR]

At present, the application of convolutional neural network in remote sensing image classification requires a lot of computation and occupies a lot of memory. This paper proposed a knowledge distillation method based on pruning network to classify remote sensing images. Based on the model pruning theory, it introduced attention mechanism into the network structure to strengthen the extraction of important features, and carried out model pruning on the network. Then it introduced knowledge distillation technology to carry out transfer learning to compensate the loss of classification accuracy after pruning. In order to prove the advance and reliability of the method, it carried out a comparison experiment with similar algorithms on NWPU-RESISC45 remote sensing satellite data set. The experimental results show that the proposed method not only has better performance in classification accuracy, but also has more advantages in model size. [ABSTRACT FROM AUTHOR]

Aiming at the problem that the existing human motion recognition method needed to input a fixed length video segment and underutilized the spatio-temporal information, this paper proposed a deep neural network model based on the combination of space-time pyramid and attention mechanism. This improved architecture combined 3D-CNN including spatio-temporal pyramids with LSTM model with spatio-temporal attention mechanism, and realized multi-scale processing of video segments and full utilization of complex spatio-temporal information of actions. For the architecture, the inputs of spatial and temporal domain were RGB image and the optical flow, the input of the fusion domain was the fusion feature of the motion and appearance features of the pyramid pooling layer. Finally, it used the decision fusion strategy to obtain the final motion recognition result. Experiments were performed on the UCFlOl and HMDB51 datasets, it achieved 94. 2% and 70. 5% recognition accuracy, respectively. The experimental results show that the improved network model achieves high recognition accuracy in video based human motion recognition tasks. [ABSTRACT FROM AUTHOR]

In the mass music, how to analyze the user’s needs according to the user’s history' listening record to implement song recommendation is one of the challenging topics in the music recommendation field. The existing music recommendation method simply uses all the music the user has heard as the context of the music recommendation, which results in the same weight distribution of contexts learned by different types of music,which seriously affects the accuracy of the music recommendation. In response to this problem,this paper proposed a music recommendation method based on attention mechanism, which dynamically allocated different attentions to different users’ historical listening music, that was learns different contex-tual weights so as to make the recommendation result more in line with the user’s actual preference. And through the test on public music dataset named million song dataset,the recommended accuracy of the method proposed has greatly improved. [ABSTRACT FROM AUTHOR]