Search

Traditional geological stratification methods usually rely on manual interpretation and empirical judgment, which have shortcomings such as cumbersome processes, heavy workload, and large impact from human factors. This paper aims to study the ideas and methods of regional engineering geological stratification based on machine learning, and convert the stratigraphic stratification problem into a sequence-to-sequence prediction task of geological body spatial units and a geological attribute feature classification task, so as to improve the accuracy of geological stratification. and efficiency. Based on in-depth research on the original data of engineering geology, this paper proposes to use deep learning methods to train and predict geological stratification of static cone test data, and use classification algorithms to stratify borrow hole soil samples and quantify them. The applicability of the relevant algorithms was evaluated. By comparing the results of traditional methods and machine learning methods, the advantages of machine learning in geological stratification are verified. This study provides a new geological layering idea for regional engineering geology research, which has important practical significance. [ABSTRACT FROM AUTHOR]

Osteoporosis (OP) is one of the main problems affecting the health of middle-aged and elderly people, and its most serious complication is osteoporotic fracture (OPF), which also has a high disability and mortality rate. The accurate screening and diagnosis of OP mainly rely on imaging analysis, and the diagnosis result rely on the subjective judgment of doctors. Therefore, the traditional imaging method of OP have certain challenges to the accurate screening, diagnosis and differentiation of OP. The cross-fusion of machine learning (ML) and imaging images effectively improves the diagnostic efficiency of clinicians, while realizing the prediction of unknown diseases (such as OPF). Recently, significant progress has been made in the screening and diagnosis of OP and in the diagnosis and prediction of OPF. This paper will review the recent related studies on ML model-assisted screening and diagnosis of OP based on imaging data, so as to provide new ideas for accurate clinical diagnosis and treatment of OP. [ABSTRACT FROM AUTHOR]

In recent years, various human action recognition algorithms have achieved excellent recognition performance based on a large number of labeled samples. However, in practical applications, acquiring training samples and their corresponding labels is time-consuming and laborious, which limits the actual implementation of the algorithm. This paper summarized the deep learning algorithms for action recognition under weak supervision and few-shot learning. Firstly, in the case of weak supervision, it classified and summarized the semi-supervised action recognition methods and unsupervised domain adaptation video action recognition methods separately. Then, it reviewed video action recognition algorithms based on few-shot learning in detail. Further, it summarized the relevant human behavior datasets and analyzed and compared the performance of various relevant video action recognition algorithms on these datasets. Finally, the paper summarized the full text and discusses the future development trend of human action recognition. [ABSTRACT FROM AUTHOR]

Machine learning, as a new technique combining statistics and computer science, has been widely used in crop information acquisition tasks in recent years. Traditional methods for obtaining crop information mainly rely on chemical detection methods, which is time-consuming and labor-intensive. Based on machine learning algorithms and hyperspectral remote sensing techniques, crop appearance and internal physical and chemical parameters can be quickly sensed in a non-destructive way, which has obvious application advantages and development prospects. First, the researches related to the hyperspectral remote sensing of crop information were systematically reviewed in this paper. Second, the application, advantages and disadvantages and uncertainties of different machine learning algorithms in hyperspectral sensing crop information were summarized. Finally, it was pointed out that the future development trends of hyperspectral sensing crop information were as follows: (1) complementary crop information acquisition methods could be realized through multi-source remote sensing collaborative observations. (2) The assimilation technologies of hyperspectral remote sensing and crop model as well as the deep integration technologies of hyperspectral remote sensing and artificial intelligence could be developed. (3) The intelligent acquisition of key information oriented to the whole growth period of crops and decision-making could be realized. [ABSTRACT FROM AUTHOR]

Aspect and opinion pair extraction aims to extract aspect and opinion items and match relations from a given sentence. However, related studies typically extract aspects and opinions independently without identifying the relationships. To identify the relationships of aspect and opinion item, this paper proposed a knowledge-augmented multi-task learning model for aspect and opinion pair extraction. First, it used the pre-trained language model to generate word vectors with semantic information for the text. In order to achieve the effect of knowledge enhancement, it used the masked attention mechanism to integrate the semantic information of the knowledge graph into the word vectors, and used the sequence labeling method based on the distance-based attention and conditional random fields to extract aspects and opinions. Finally, it matched the extracted aspects and opinions to predict the corresponding relationship. In order to strengthen the connection between the aspect and opinion extraction module and the matching module, the model adopted a shared coding layer to achieve joint training. In addition, in the training process, the matching module used the real labels as input, and used the result of the extraction module as input in the testing process. Finally, to demonstrate the effectiveness of the model, this paper used three general domain datasets for comparative experiments. The model achieves F, values of 66. 99%, 75. 17% and 67. 30% in aspect and opinion matching tasks respectively, and outperforms other comparative models. [ABSTRACT FROM AUTHOR]

To address the problem of poor recommendation accuracy in the session recommendation model, this paper proposed a capsule-based graph convolutional disentanglement for session-aware recommendation (CGCD) method.Specifically, it used disentangled learning technique to transition item embedding into factor embedding based on multiple sub-channels. Then, it used a capsule dynamic fusion strategy to aggregate different factors to obtain a new item embedding.In addition, it used a multi-head attention mechanism to assign weights to each item in the session. Finally, it aggregated the item embedding with other items in the current session according to the assigned weights, and then generated an accurate session representation to achieve item recommendation. Experiments on two publicly available real datasets show that the proposed model can improve the Pre@10, Pre@20, MRR@10 and MRR@20 by 5.17%, 2.99%, 6.56% and 2.94% on average of the recommended performance, which verifies the effectiveness and efficiency of the method in this paper. [ABSTRACT FROM AUTHOR]

Osteoporosis (OP) is a kind of bone disease related to aging. Its onset is obscure and development is gradual. Patients are without obvious clinical manifestations in the early stage. However, with the progress of the disease, bone loss and bone tissue microstructure destruction occur, and bone pain, spine deformation, and even osteoporotic fracture (OPF) and other serious complications may develop. Dual-energy X-ray absorption method is the current gold standard for clinical diagnosis of OP. Because its diagnostic accuracy is affected by the factors of body weight, lumbar degenerative changes, and aortic wall calcification, a false negative diagnosis is possible. In recent years, artificial intelligence (AI) has developed rapidly in the medical field. At present, AI has been widely used in the research of OP. Its research in the field of OP screening, diagnosis, and prediction has become a new hot spot. This paper expounds the application status and advantages of AI in OP diagnosis and treatment from four aspects, i.e., OP early screening, medical imaging performance, clinical diagnosis and treatment data, and OPF risk prediction, so as to provide a new direction for the accurate diagnosis and treatment of OP. [ABSTRACT FROM AUTHOR]

In dynamic gesture recognition methods based on deep learning, aiming at the problems of large network scale, simple dimension of extracted spatiotemporal features, and insufficient extraction ability of effective features, this paper proposed a deep network framework. Firstly, this paper applied a novel spatiotemporal convolution module based on multiscale information fusion in the time domain to improve the 3D residual network structure, greatly reduced the size of the network and obtained rich spatiotemporal receptive field characteristics. Then it introduced a spatiotemporal feature channel attention mechanism with global information synchronization, and used a few parameters to construct the global dependency between feature maps, and the module could obtain the key features of dynamic gestures more efficiently. The experimental results on the self-built gesture dataset SHC and the public gesture dataset SKIG show that the proposed gesture recognition method has fewer parameters and more powerful multiscale spatiotemporal feature extraction ability, and gains a higher recognition rate than the current mainstream algorithms. [ABSTRACT FROM AUTHOR]

Discrete sequence generation is widely used in text generation, sequence recommendation and other fields. The current research work mainly focuses on improving the accuracy of sequence generation, but ignores the diversity of generation. To address this phenomenon, this paper proposed an adaptive sequence generation method ( ECoT), and designed a two-layer meta controller. In the data layer, the function of meta controller was to realize adaptive learning sampling, automatically balance the distribution of real data and generated data,and obtain mixed data distribution. At the model level, this paper added diversity constraints. The function of the meta controller was to adaptively learn the optimal update gradient to improve the generation diversity of the generation model. In addition, in order to improve the accuracy of the generation model, this paper proposed a method combining cooperative training and adversarial learning. Compared with the current mainstream models, the results show that the adaptive cooperative training sequence generation method has more balanced accuracy and diversity in terms of generation accuracy and diversity, and can effectively alleviate the pattern collapse of the generation model. [ABSTRACT FROM AUTHOR]

The classification performance of the existing multi-classification tasks of finger motor imagery EEG signals is difficult to achieve usable performance. On the basis of detailed analysis of multiple components on the time scale of EEG signals, this paper designed a self-supervised sub-network for signal sub-segment extraction, and then input the sub-segment into the next sub-network for signal classification, it synthesized the two sub-networks into a self-supervised hybrid multi-task deep network. In the training phase, the sub-segment extraction sub-network extracted different sub-segments for each EEG signal, and the subsequent classification sub-network judged whether the sub-segment was the best and automatically adjusted the position of the sub-segment. It weighted the total loss function by two loss functions of two sub-networks, and extracted the best sub-segment signal and obtained the best classification effect through the overall network learning algorithm. In the verification and testing phase, the sub-segment extraction sub-network automatically extracted the corresponding sub-segment input classification sub-network according to the parameters of the training for classification. It verified the network performance on the largest SCP data of Motor-Imagery data set and the Data sets 4 of BCI Competition IV. On the SCP dataset, the average test classification accuracy of all subjects’ three finger classification tasks is more than 70%, the average test classification accuracy of four finger classification tasks is about 60%, and the average test classification accuracy of five finger classification tasks is about 50%, which is significantly improved compared with the existing reports. It is confirmed that the network can effectively extract sub-segments of motor imagery EEG signals, and has good classification effect and generalization performance. [ABSTRACT FROM AUTHOR]

As a key problem and hub link between problem discovery and problem solving, the current research on root cause analysis mainly includes two types of methods: data-driven and causality-driven. In view of the advantages of data-driven methods in narrowing the range of root causes, at present, root cause research mainly focusses on datadriven methods such as association rule mining, heuristic search, machine learning and deep learning. There are few root cause analysis from the perspective of causal knowledge, nor has it been based on method dimension. The inductive analysis of the root cause is carried out, and there is a lack of relevant research results. Therefore, this paper sorts out and summarizes the main results of root cause analysis in recent years, analyses the differences and advantages of root cause analysis under different method dimensions, and proposes a root cause analysis method that integrates causal knowledge, and combines asymmetric Shapley value with causal chain diagram to improve the accuracy of root cause analysis. Finally, the existing some research difficulties and development trends put forward scientific and meaningful future research directions. [ABSTRACT FROM AUTHOR]

Aiming at the problem of fine-grained visual categorization, this paper proposed an effective algorithm to achieve end-to-end fine-grained visual categorization. The ECA module in ECA-Net was a channel attention mechanism with significant performance advantages. It model-fused with the classic network ResNet-50 to form the ResEca. Then, it used the object-level image positioning module and the part-level image generation module to generate object-level and part-level images. Those images combined with original images could be as the input of the new constructed network Tb-ResEca-Net. This paper trained the 95. 1% and 95. 3% respectively on the test set of the corresponding dataset. The experimental results show that this method has higher classification accuracy and stronger robustness compares with other traditional fine-grained classification methods, which is an effective fine-grained image classification method. [ABSTRACT FROM AUTHOR]

When the scale of data is large, the deep learning model will encounter the problem of time-consuming weight adjustment and easy to fall into the local optimal solution. In order to solve these problems, broad learning system comes into being. The broad learning system not only has the advantages of simple structure, fast training speed and high accuracy, but also has the advantage of incremental learning. This paper firstly introduced the background and development of broad learning system, then described the basic theory and implementation method of broad learning system, and compared its similarities and differences with deep network. Then this paper introduced the improvement of broad learning system on image classification, numerical regression, EEG signal processing, and analyzed the advantages and disadvantages of these algorithms. Finally, it summarized the shortcomings of existing broad learning algorithms, and prospected the future research direction. [ABSTRACT FROM AUTHOR]

Aiming at the poor classification effect caused by complex background, large intra-class difference and high interclass similarity in remote sensing scene images, this paper proposed an attentional mechanism and residual contraction unit algorithm based on supervised contrast learning. Firstly, the algorithm improved the effective channel attention mechanism (ECA), and optimized the extraction of image features to be recognized. Then, the algorithm proposed a cooperative residual shrinkage unit algorithm, which is used to filter and eliminate redundant information of images. In addition, supervised contrast learning algorithm was used to enhance the generalization ability of the algorithm. Finally, experiments were carried out with remote sensing image data set and compared with the latest algorithms such as enhanced attention algorithm and scale attention mechanism algorithm. Experimental results show that the proposed algorithm improves the classification accuracy by 1.75% and 2.5% in AID Data Set with 20% training ratio. [ABSTRACT FROM AUTHOR]

In order to solve the problem that the existing super-resolution algorithm based on deep learning didn't make full use of the feature information of each level, resulting in low reconstruction accuracy and large parameter quantity, this paper proposed a double dense connection structure named densely channel attention skip connection network. In the inner structure of the network, it improved the original dense cascade block to generate a channel separable dense cascade block. The outer structure adopted a densely residual connection and attention mechanism to fuse the features extracted by the dense block to achieve the goal that less convolution layer and higher precision effect. This paper tested the network models on several benchmark datasets . The results show the proposed model has higher accuracy and fewer parameters than the other models. [ABSTRACT FROM AUTHOR]

At present, multi-agent reinforcement learning algorithms mostly adopt frameworks that are centralized in learning and decentralized in action. These frameworks may take too long to converge or may not converge at all. In order to speed up the collective learning time of multi-agents, this paper proposed a novel multi-agent group learning strategy. It used recurrent neural network (RNN) to predict the grouping matrix of multi-agents to share the experience between them, resulting in improved learning efficiency within the multi-agents group. Meanwhile, this paper proposed the concept of information trace to remedy the problem that the agents could not share information brought by the grouping. In order to strengthen the retention of excellent experience within the group, this paper proposed the practice of delaying the death time of excellent agents in the group. Finally, the results show that, compared to MADDPG, the training time is reduced by 12% in the labyrinth experiment and by 17 % in capture the flag experiment. [ABSTRACT FROM AUTHOR]

Based on video action recognition, this paper firstly reviewed the traditional action recognition algorithms based on RGB, including traditional algorithms and deep learning algorithms. Because of the influence of background lighting, RGB-videobased action recognition is low accuracy, but it has rich color appearance information. Then this paper analyzed and summarized action recognition algorithms based on RGB-D, which was divided into depth sequence, bone and multi-feature fusion. RGB-D video has multiple modes and can provide more information for action recognition, which performs better than RGB video but also brings new challenges. Finally, this paper prospected the common data sets and the possible future development direction. [ABSTRACT FROM AUTHOR]

With the advancement of data acquisition technology, spatiotemporal data with geographic location information are growing rapidly, so it is urgent to explore effective spatiotemporal data modeling methods. Spatiotemporal sequence prediction is one of the basic methods in spatiotemporal data modeling and widely used in many fields. At present, there is no Chinese literature on its review, so it is of great significance to summarize these methods. For the spatiotemporal sequence prediction problem, this paper reviewed its application background and development history. Then it introduced some related definitions and characteristics. According to its category, the spatiotemporal sequence prediction methods, based on traditional methods, classical machine learning methods and deep learning methods are analyzed respectively as well as their application scope, advantages and disadvantages. Finally, this paper made a review and prospect over the research directions of spatiotemporal sequence prediction, laying a theoretical foundation for researchers to further study this problem [ABSTRACT FROM AUTHOR]

Existing deep learning based single image super-resolution (SISR) models usually improve the fitting ability of the model by increasing the number of network layers, but fail to fully extract and reuse features, leading low quality of reconstructed images. To solve this problem, this paper proposed an image super-resolution model based on feature fusion and attention mechanism. This model used residual in residual (RIR) structure in feature extraction module. The feature extraction module of the network consisted of several residual groups. Each residual group consisted of several residual blocks. This module implemented local feature fusion in each residual group and global feature fusion between each group. In addition, this model introduced coordinate attention module into each residual block and spatial attention module into each residual group. It verifies that the model is able to fully extract features and reuse features. The final experimental results show that the model is superior to the existing models in objective evaluation indexes and subjective visual effect. [ABSTRACT FROM AUTHOR]

This paper proposed an optimization model of deep-knowledge tracking（KTSA-BiGRU） based on self-attention mechanism and bidirectional GRU neural networks owing to the existing deep-knowledge tracking models with weak capture of complex relationships between input exercises and inability to effectively handle long-sequence input data. Firstly, it mapped the learner’s historical learning interaction sequence data to the real value vector sequence. Then, it trained the bidirectional GRU neural network as input to model the learner’s learning process, and finally used, the self-attention mechanism to calculate the probability of the learner correctly answering the next question based on the hidden vectors of the bidirectional GRU neural network output and the attention weight. The performance analysis on the three public datasets can improve the prediction accuracy of deep knowledge tracking. [ABSTRACT FROM AUTHOR]

Occlusion in a real environment is one of the main obstacles to accurately analyze and recognize facial expressions. In recent years, researchers have used deep learning technology to solve the problem of high misrecognition rate of facial ex-pressions under occlusion conditions. It mainly summarized the deep learning algorithm of occlusion facial expression recognition and occlusion-related issues. Firstly, this paper summarized the development status of facial expression recognition under partial occlusion conditions, expression representation, and the data set used to study occlusion expression. Secondly, it re-viewed the occlusion expression identify the latest developments in deep learning methods and analyzed the impact of occlusion on expressions. Finally, it summarized the main technical challenges, research difficulties and possible coping strategies. The purpose is to provide a more useful reference and benchmark for future research on occlusion expression recognition. [ABSTRACT FROM AUTHOR]

Because convolutional neural networks( CNN) mostly focus on global feature learning and ignore local feature information containing more details, it is difficult to improve the accuracy of indoor scene recognition. To solve this problem, this paper proposed an indoor scene recognition method based on improved global-local attention network ( GLANet). Firstly, it used GIAN et to capture the global and local features of the scene image to increase the detail information of the image features. Then, it introduced a non-local attention module into the local network to further preserve the detail features of the image through the convolution of attention diagram and feature graph. Finally, it used various features of different stages of the network for classification. Through training and verification on the MIT lndoor67 and the SUN397 dataset, the recognition accuracy of the proposed method was increased by l. 98% and 3. 07% respectively compared with the LGN method. Experimental results show that the algorithm can effectively capture global semantic information and fine spatial details, and significantly improves the recognition accuracy. [ABSTRACT FROM AUTHOR]

With the popularity and development of deep learning, the existence of adversarial samples is a serious threat to the security of the deep learning model. For the attack problem of adversarial samples in the physical world, this paper proposed a physical adversarial sample detection method based on attention mechanism. The method combined attention mechanism and feature compression to detect pertinently of local visual adversarial samples, excluded effects of non-major regions, and reduced calculation effort. It effectively combined multiple feature compression methods to deal with the main areas of the sample, which destroyed the structure of the antagonistic block and made them unaggressive. Perform defense tests on different adversarial attacked on the MNIST and CIFAR-10 data sets and compared with other countermeasures. The experimental results show that the defense accuracy of the method can reach more than 95%. This method is higher versatility and stronger stability than other local adversarial sample defense methods, and can effectively defense the attack of local visual adversarial samples. [ABSTRACT FROM AUTHOR]

The rectangle layout optimization problem with balance constraints is derived from the layout design of satellite module equipment. It belongs to combinatorial optimization problem. Deep reinforcement learning uses reward mechanism to realize high-performance decision optimization through data training. This paper proposed a new deep reinforcement learning algorithm DAR and its extension IDAR. The DAR algorithm output the optimized location sequence with a pointer network, and then used the positioning mechanism to give the layout results. The training of pointer network was realized by deep reinforcement learning. The time complexity of the DAR algorithm was O ( n ³ ). The IDAR algorithm was an iteration version of DAR, which had better results but with a time complexity of 0 ( n 4 ). The test results show that DAR algorithm has good learning ability, and the model obtained by small layout problems can be effectively applied to large-scale problems. The results on two typical large-scaled instances show that the proposed algorithms have achieved or approached to the current best results, so that they have advantages both in time and solution quality. [ABSTRACT FROM AUTHOR]

In sound event detection tasks, the target event was susceptible to background noise, and wasn't present in a significantly high portion of sound signal flow. To solve the problem, this paper proposed a new method of sound event detection based on one-dimensional dense convolutional network (DenseNet ) with multi-level attention mechanism. Firstly, it used the one-dimensional DenseNet for frame-level detection, which was effective in finding the precise onset and offset time. Then, it introduced the multi-level attention mechanism in the one-dimensional DenseNet model, which made the attention-aware features from different modules change adaptively as layers went deeper. Therefore, the model could automatically select and attend on important frames for the targets while ignoring the unrelated parts (e. g. the background noise segments) . Finally, this paper evaluated the model using DCASE 2017 Task 2 development dataset. Results show that the overall performance of the proposed method has further improvement than the conventional deep learning method. [ABSTRACT FROM AUTHOR]

In order to understand the development of SISR based on deep learning and grasp the hotspots and directions of the current research, this paper combed the existing model of SISR based on deep learning. Firstly, the paper introduced the related deep learning algorithm, these models based on deep learning and their evaluation index. In addition, it compared the performance of existing models through experiments, which aimed to understand the advantages of SISR model based on deep learning. Finally, the paper summarized the key issues of SISR, and prospected the future development trends. [ABSTRACT FROM AUTHOR]

Ocean mesoscale eddy is an important ocean mesoscale phenomenon that plays an important role in ocean circulation, mat erial and energy transport, and has an important impact on the safety of ship navigation and hydroacoustic communication. Efficient and accurate detection and identification of ocean mesoscale eddies are of great research value for both physical ocean cognition and ocean exploitation. Traditional eddy detection and identification methods rely on a single threshold designed by experts experiences. With the rise of deep learning, the current machine learning methods show certain advantages in the accuracy and automation of eddy detection and identification. This paper summarizes and comparatively analyzes the existing machine learning-based detection and identification methods to provide a systematic knowledge and reference basis for the development of ocean mesoscale eddy detection and identification research. [ABSTRACT FROM AUTHOR]

Cloud segmentation is a key task in applications of Landsat8 remote sensing images. At present, most existing deep learning based approaches usually adopt the U-type coder-encoder network structure. Although this structure can make use of spatial location information from the coding end effectively, the whole network has too many parameters and cause high computation cost. Meanwhile, the coding end only adopts simple convolution and subsampling operation, which makes it impossible to obtain high-quality contextual semantic feature information effectively. In view of the above situation, this paper proposed a new lightweight U-Net model for cloud segmentation. The whole model adopted a new U-shaped codec structure that jumped and connected the information between the shallow layer and the middle layer at the coding end, and also embedded novel optimization blocks consist of grouping convolution and attention mechanism in coding end. It also built context-semantic fusion connection to link corresponding layers in coding and decoding end. Experimental results on the common benchmark dataset 38-Cloud illustrates, compared with other mainstream cloud segmentation networks, the proposed new U-Net can achieve better segmentation precision with less model parameters. [ABSTRACT FROM AUTHOR]

Aiming at the problems of complex background, variety of change types, missing detection and rough boundary recognition in high-resolution remote sensing image of the same region, this paper proposed a high-resolution remote sensing image building change detection algorithm based on Siam-UNet++network. The algorithm used UNet++as the backbone extraction network. In the encoder phase, it applied the Siam-diff structure to extract the change features of the two sequential images, and employed the attention mechanism after the up sampling and lateral jump path connection in the decoding stage to highlight the building change features and inhibit the network learning from other types of features. Meanwhile, it used the MSOF strategy to weight and fuse feature information of different semantic levels, which improved the accuracy of building change detection. Finally, it adopted a sliding window method to predict large-scale remote sensing images, reducing the hole pattern generated by the change result map during the splicing process. The experimental results demonstrate that proposed algorithm shows better performance than other models. [ABSTRACT FROM AUTHOR]

In order to solve the problem that the recommendation model cannot mine the diversity of user interest and capture the order information between the sequence of user behavior, and the interaction occurs at the element level rather than between the feature vectors, etc., based on multiple attention mechanism and location information, this paper proposed the x DMAL FM. Firstly, it extracted the feature depth from different subspaces by using the multi-head attention mechanism, and then location information could capture the sequential relationship between user behavior sequences. Finally, it used three public datasets to conduct comparative experiments and the AUC index to evaluate the results. The experimental results show that the proposed algorithm has better recommendation performance than the xDeepFM model and show the effectiveness and feasibility of the proposed algorithm. [ABSTRACT FROM AUTHOR]

In order to maintain security and reliability of operating system, this paper developed a universal framework for net-work intrusion detection system based on artificial intelligence( AI) model. This framework was capability of detecting all sorts of network traffic, catching out possible malicious connection or attack from Internet and identifying it. Firstly, this system pre-processed the network traffic data by sampling, one-hot encoding, feature selection and normalization for basic feature extrac-tion. Secondly,it utilized feature distribution in network connection instance to build a scoring mechanism for information ex-traction once again. Thirdly, it applied the different types of ML/DL models for different forms of network traffic to do final classification for extracted features. In experiments, this system applied three benchmark datasets, KDDCup99, UNSW-NB15 and CICIDS2017. The result of experiments shows it possesses exceedingly good performance and has better accuracy and F1 score than related works under these datasets. [ABSTRACT FROM AUTHOR]

Since it is difficult to online measure the underflow concentration of the thickener in the thickening-dehydration process, a broad learning system(BLS) based soft sensor modeling method is proposed in this paper. The method has high precision and strong generalization capability. First, several pressure sensors are installed inside the thickener, and the historical dataset under normal operating conditions is established. Then, the soft sensor model is trained by employing the BLS method to online predict the underflow concentration of the thickener. Finally, the efficiency of the proposed method is verified by simulation experiments. Compared with other traditional machine learning methods, the BLS method has higher prediction accuracy. [ABSTRACT FROM AUTHOR]

Aspect words consist of multiple words, averaging the word vectors of all words may lead to semantic errors or confusion, and different context words have different influence on the judgment of emotional polarity for aspect words. This paper proposed a text sentiment analysis model that integrated the left and right bilateral attention mechanisms. First, the model designed an internal attention mechanism to process aspect words, and designed a bilateral interactive attention mechanism based on aspect words and context words, and finally cascaded the three parts of the processing result of bilateral interactive attention and the aspect word processing value for classification. Experiments on the two datasets from SemEval2014 task 4 show that the proposed model achieves 81. 33% and 74. 22% accuracy respectively, and has achieved better results than models that combine machine learning or attention mechanisms. [ABSTRACT FROM AUTHOR]

Recently, deep neural networks need to be deployed with low memory and computing resources, so it is necessary to design an efficient and compact network structure. This paper proposed a model compression method (KE ) based on improved attention transfer for the des ign of compact neural networks, which mainly used a wide residual teacher network (WRN) to guide a compact student network (KENet) by extracting both spatial and channel-wise attention to improve the performance, and applied this method to real-time object detection. The image classification experiment on CIFAR verifies that the knowledge distillation method with improved attention transfer can improve the performance of the compact model. The object detection experiment on VOC verifies that the model KEDet has good accuracy (72. 7 mAP) and time performance (86 fps) . The experimental results show that the object detection model based on improved attention transfer has good accuracy and real-time performance. [ABSTRACT FROM AUTHOR]

With the advancement of remote sensing technology, the high spatial resolution remote sensing image contains rich special information with a great detail. At the same time, the complexity of high spatial resolution remote sensing images also requires higher the classification technology of remote sensing images. However, in the face of high spatial resolution remote sensing image more obvious geometrical structure and the more rich texture characteristics, how to design rational system of characteristics, select the appropriate sorting algorithms to accurately and quickly grasp the number of rural land of building and its distribution status, are of great significance to balance urban and rural areas, save land, and realize sustainable development. This will help in exploring the application of deep learning model in high spatial resolution remote sensing image building extraction, and have research significance for improving the classification accuracy of high resolution remote sensing image. In this paper, the semantic segmentation model (SegNet) was used for extracting buildings. SegNet is mainly composed of encoder network, decoder network and pixel-wise classification layer. The encoder network transforms high-dimensional vectors into low-dimensional vectors, enabling low-dimensional extraction of high-dimensional features. The decoder network maps low-resolution feature maps to high spatial resolution feature maps, realizing the reconstruction of low-dimensional vectors to high-dimensional vectors. The softmax classifier separately classifies each pixel, which outputs the probability that each pixel belongs to each class. In this paper, a 3000 pixel × 3000 pixel and two 2000 pixel × 2000 pixel slices were taken from the global remote sensing image of Bazhou City, Hebei Province as training samples, and a 3000 pixel × 3000 pixel slice was taken as the verification sample. In this paper, five comparative experiments were used to extract the buildings, including PSPNet, support vector machine, random forest, ISO clustering and maximum likelihood method. The confusion matrix of each classification method was obtained by calculating the difference between the classification results of the comparison experiment and the real value. From the traditional classification algorithm to the shallow learning algorithm to the deep learning algorithm, the Kappa coefficient and overall accuracy of classification kept constantly increasing, among which SegNet semantic segmentation algorithm based on the deep convolutional network performed better than the other five algorithms in extracting buildings from high spatial resolution remote sensing image. The Kappa coefficient and the overall accuracy of SegNet semantic segmentation algorithm were 0.90 and 96.61%, respectively, and the ground truth value was basically the same as the classification result. The F1Score of building extraction of SegNet semantic segmentation algorithm based on deep convolution network was 0.91, but the other five algorithms were below 0.87. SegNet had the lowest error rate of 9.71% for buildings, indicating that the ability to identify buildings of semantic segmentation algorithm from high spatial resolution remote sensing was superior to traditional classification algorithms, shallow layer learning algorithms based on machine learning, and PSPNet semantic segmentation algorithm based on deep convolution network. The Kappa coefficient and overall accuracy of the remaining five classification algorithms were respectively below 0.83 and 94.68%, and the difference between the ground truth value and the classification result was relatively large. SegNet can not only make use of spectral information but also make full use of abundant spatial information. During SegNet training, more essential features can be learned, and more ideal features suitable for pattern classification were finally formed, which can enhance the ability of convergence and generalization of the model and improve the classification accuracy. Traditional classification algorithms, such as ISO clustering and maximum likelihood method, failed to make use of the rich spatial information of the high-resolution remote sensing image, so the accuracy was relatively low. Due to limited computing units and large amount of high spatial resolution remote sensing image data, shallow layer learning algorithms based on machine learning such as support vector machines and random forest cannot effectively express complex features of ground objects, so their advantages are not obvious in building extraction from the high spatial resolution remote sensing images. The experimental results showed that the SegNet based on deep learning has the best performance, and it has important theoretical significance to explore the application of deep learning model to remote sensing image classification methods. At the same time, the research results also provide a reference for improving the classification accuracy of high resolution remote sensing images. [ABSTRACT FROM AUTHOR]

Faced with the problems encountered in fatigue detection under natural environment, such as low detection rate of the face, slow detection speed and single feature for judging, etc., this paper proposed a fatigue detection method combining receptive field with clustering algorithm. Firstly, it applied cluster on the face size and returned the cluster numbers which determined the number of detection layer. Then, it set the size of anchor boxes according to the face size. Secondly, the algorithm set the number of convolutional layers according to the principle that the receptive field should match the face size in the predicted feature map. Finally, new algorithm learnt a variety of fatigue characteristics by minimizing the loss function. Experiments show that this method based on clustering framework and local receptive field have improved the detection speed while maintaining the recognition accuracy. It can reach 125 fps by using GPU GeForce GTX TITAN, and satisfy the request of real time. [ABSTRACT FROM AUTHOR]

Attack methods based on adversarial samples are one of the security challenges that machine learning algorithms are commonly facing. This paper took the security of machine learning as a starting point, introduced the current security issues such as privacy attack and integrity attack that were faced by machine learning, summarized the development process and respective characteristics of current adversarial sample generation methods, and summarized the existing defense techniques for adversarial sample attacks,finally made a further look at how to improve the robustness of machine learning algorithms. [ABSTRACT FROM AUTHOR]

Categorical features always exist in the dataset and coding them is a key issue for solving problems efficiently by machine learning models. One-hot coding is a wide accepted method to convert the features into feature values, and however it attracted sparse space and meaningless value after coding. To improve the coding performance, this paper designed a novel coding method based on conditional probability after divid ing the features into zones, which was called CZT coding. The CZT coding calculated the conditional probability of each feature and then divided the features into several zones and finally coded the features in each zone. It mathematically proved that compared with the state-of-the-art method- one-hot coding, CZT coding reduced the code length by at least the mean of feature spaces and the issue switched into an easier one after CZT coding for the following machine learning model. Finally, it used th e same neuron network as the classifier, the performance of CZT coding and one-hot coding was compared by using the Titanic dataset. The result shows that CZT coding makes the classifier performs better both on the accuracy and steadiness . [ABSTRACT FROM AUTHOR]

This paper proposed a text sentiment analysis scheme based on long short-term memory ( LSTM ) networks and feed-forward attention model. It added feed-forward attention model to basic long short-term memory networks. The scheme was implemented under the framework of Tensor Flow deep learning. According to the precision, recall and F1 measures, compared with the existing scheme, the results show that the proposed model has obvious advantages over the traditional machine learning method and the traditional long short-term memory networks [ABSTRACT FROM AUTHOR]

Mathematical modeling of aerodynamic data plays an important role in the performance evaluation of a flight vehicle. There are two kinds of aerodynamic characteristics modeling methods, i.e., the rational modeling method based on physical mechanism and the "black-box" modeling methods. In this paper, three types of "black-box" modeling methods including the classification and regression tree method(CART), the shallow learning method, and the deep learning method are investigated. The CART method and three shallow learning methods including Kriging method, radial basis function(RBF) neural network method, and support vector machines(SVM) method are applied to the aerodynamic data modeling of rocket, the unsteady aerodynamic characteristics modeling for delta wing with large angle of attack, the aerodynamic heat data fusion of wind tunnel test and CFD. The advantage and shortage of these modeling methods are compared. A deep learning neural network model of airfoil's aerodynamic coefficients is built. It considers the influence of airfoil picture and flow parameters such as Mach number, angle of attack on the prediction results at the same time through a "synthetic picture". It could significantly expand the applied range of the deep learning modeling method in aerodynamic research field. [ABSTRACT FROM AUTHOR]

This paper aims to solve the problem of high throughput automated data analysis of brain microstructure reconstruction by using the solution of systems engineering that consists of hardware, software and algorithm. To solve the key issues of limit analysis efficiency such as registration of large-volume distorted image, dense neural structure recognition, ambiguous neural connections and multi-source data fusion etc, classification method in accordance with the biological characteristics of neural structure is proposed by the realization of the samples preparation, automatic cutting, microscopic imaging, 3D reconstruction and software platform building etc. Furthermore, it provides a theoretical basis and solution for building engineering platform for large volume neural structure reconstruction and meets the brain science research of high-throughput neural circuit network reconstruction demand. [ABSTRACT FROM AUTHOR]

In the era of big data, many of traditional machine learning methods of disposing unlabeled raw voice data have become less applicable. At the same time, deep learning models can directly process unlabeled data because of its powerful capability of modeling to deal with the massive data, and has become a hot research in the field of speech recognition. To begin with, this paper analyzed and summarized the state-of-the-art deep learning of models. And then,it discussed the applications to speech recognition with speech features extraction and acoustic modeling. Finally,it concluded the problems faced and development orientation. [ABSTRACT FROM AUTHOR]