Search

Detecting and warning Advanced Persistent Threat (APT) malware in Endpoint is essential because the current trend of APT attacker groups is to find ways to spread malware to users and then escalate privileges in the system. In this study, to improve the ability to detect APT malware on Endpoint machines, we propose a novel intelligent cognitive calculation method based on a model combining graph embeddings and Attention using processes generated by executable files. The proposed intelligent cognitive computation method performs 3 main tasks: i) extracting behaviors of processes; ii) aggregating the malware behaviors based on the processes; iii) detecting APT malware based on behavior analysis. To carry out the task (i), we propose to use several data mining techniques: extracting processes from Event IDs in the operating system kernel; extracting abnormal behaviors of processes. For task (ii), a graph embedding (GE) model based on the Graph Convolutional Networks (GCN) network is proposed to be used. For task (iii), based on the results of task (ii), the paper proposes to use a combination of the Convolutional Neural Network (CNN) network and Attention network (called CNN-Attention). The novelty and originality of this study is an intelligent cognitive computation method based on the use, combination, and synchronization of many different data mining techniques to compute, extract, and represent relationships and correlations among APT malware behaviors from processes. Based on this new intelligent cognitive computation method, many meaningful anomalous features and behaviors of APT malware have been synthesized and extracted. The proposals related to data mining methods to extract malware's features and the list of malware's behaviors provided in this paper are new information that has not been published in previous studies. In the experimental section, to demonstrate the effectiveness of the proposed method in detecting APT malware, the study has compared and evaluated it with other approaches. Experimental results in the paper have shown the outstanding efficiency of the proposed method when ensuring all metrics from 96.6% or more (that are 2% to 6% higher than other approaches). Experimental results in the paper have proven that our proposed method not only has scientifically significant but also has practical meaning because the method has helped to improve the efficiency of analyzing and detecting APT malware on Endpoint devices. In addition, this research result also has opened up a new approach for the task of detecting other anomalies on the Endpoint such as malware, unauthorized intrusion, insider, etc. [ABSTRACT FROM AUTHOR]

Studying complex networks is essential for a better understanding of network science. Many studies have been done on single-layer networks in complex networks. After the advancement and widespread usage of the internet and social media networks, performing community detection in multilayer networks becomes essential to reach more people and work with different personalities on different platforms. Motivated by this observation, this paper has studied types of networks, metrics, measures, and community detection using deep learning-based models in multilayer networks. This survey can play a significant role in analyzing and understanding multilayer networks. [ABSTRACT FROM AUTHOR]

With the rapid growth of Internet video image information, there is a large amount of redundancy in image data. Use less data stream information to transfer the image or the amount of information contained in the image. Its purpose is to reduce the redundancy of images, so as to store them at low bit rate and reduce the data storage space. In the general image compression method, the hybrid coding framework is adopted. Each algorithm adopts a fixed algorithm mode through a specific design algorithm, without global optimization. Image compression is mainly divided into prediction, transformation, quantization, digital entropy coding and other steps. At present, there are many researches on super-resolution network based on deep learning technology. The main function is to reconstruct high-resolution image replace image magnification low-resolution images such as linear interpolation, which has a great performance improvement image resolution, noise reduction, deblurring and so on, but there is no effective way to use super-resolution network applications to improve quality of compression reconstructed image quality. This paper involves a new method that using image super-resolution residual learning network to improve quality of compression image, our method, the reduced image is encoded into a content stream and a transmission corresponding parameter is encoded into a model stream. Firstly, the original image is scaled down 1/2 size of source image, then encode the small image into content stream with the existing codec. Secondly, the residual learning super-resolution (SR) network is used for image filtering to scale up reconstructed image with decode image resizing method and boost the quality of edge feature extraction of image. Our results show that there is significant performance improvement of h265 in low resolution reconstructed image (bits-per-pixel less than 0.1). [ABSTRACT FROM AUTHOR]

In order to allow users to incorrectly identify images by manipulating them using deep neural networks, this paper analyses the shortcomings of deep learning for image classification. It also develops a game that uses this technique. In the game, players can select one of their preferred product categories, causing the model to classify other product categories incorrectly as the one they selected. The goal of this game is to demonstrate to players the limitations of AI. We evaluate these programs based on their overall effectiveness, user satisfaction, and achievement of their objectives. The results show that this program is a successful method for arousing curiosity and stimulating thought. They can learn to appreciate the limitations of AI and the need to prioritize AI security in their daily activities. [ABSTRACT FROM AUTHOR]

Human posture detection is easily affected by the external environment, resulting in blurred results of limb feature extraction. In order to improve the accuracy and speed of human motion detection, this paper proposes a deep learning-based motion detection method in competitive sports training. The double parallel convolution network algorithm in the depth learning algorithm is used to process the collected action information, extract the body action features, and greatly reduce the operation scale; With the help of the theory of motion mechanics, the mechanical parameters in the motion process are calculated to eliminate outliers and reduce feature dimensions; With the help of motion inertial sensors and joint degrees of freedom, the limb motion detection results are obtained. The experimental results show that the average recognition rate of the method for different motion actions is 99.5%, and the average detection time is 148 ms, with good application performance. [ABSTRACT FROM AUTHOR]

Feature Evolvable Stream Learning (FESL) has received extensive attentions during the past few years where old features could vanish and new features could appear when learning with streaming data. Existing FESL algorithms are mainly designed for simple datasets with low-dimension features, nevertheless they are ineffective to deal with complex streams such as image sequences. Such crux lies in two facts: (1) the shallow model, which is supported to be feasible for the low-dimension streams, fails to reveal the complex nonlinear patterns of images, and (2) the linear mapping used to recover the vanished features from the new ones is inadequate to reconstruct the old features of image streams. In response, this paper explores a new online learning paradigm: Feature Evolvable Learning with Image Streams (FELIS) which attempts to make the online learners less restrictive and more applicable. In particular, we present a novel ensemble residual network (ERN), in which the prediction is weighted combination of classifiers learnt by the feature representations from several residual blocks, such that the learning is able to start with a shallow network that enjoys fast convergence, and then gradually switch to a deeper model when more data has been received to learn more complex hypotheses. Moreover, we amend the first residual block of ERN as an autoencoder, and then proposed a latent representation mapping (LRM) approach to exploit the relationship between the previous and current feature space of the image streams via minimizing the discrepancy of the latent representations from the two different feature spaces. We carried out experiments on both virtual and real scenarios over large-scale images, and the experimental results demonstrate the effectiveness of the proposed method. [ABSTRACT FROM AUTHOR]

The need for a monitoring system has grown as a result of rising crime and anomalous activity. To avoid unusual incidents, the common man initiated video surveillance of important areas, which was then passed on to the government. In typical surveillance operations, surveillance devices create a vast volume of data that must be manually analysed. Manually handling huge data sets in real time results in information loss. To prevent abnormal incidents, the actions in sensitive areas can be properly monitored, evaluated, and alerted to the appropriate authorities. Previous deep learning-based activity identification methods have appeared, but the findings are inaccurate, and the proposed Hybrid Machine Learning Algorithms (HMLA) incorporate two detection methods for surveillance videos like as Transfer Learning (TL) and Continual Learning (CL). As a result, the suspicious activity in the video may be missed. Consequently, numerous image processing and computer vision technologies were used in activity detection to decrease human effort and mistakes in surveillance operations. Activities in sensitive areas can be properly monitored and evaluated to avoid unusual incidents, and the appropriate authorities may be alerted. Hence, in order to decrease human error and effort in surveillance operations, activity recognition embraced a variety of image processing and computer vision technologies. In this present work, the capacity has constraints that impact recognition accuracy. Consequently, this research paper presents a HMLA based technique that uses feature extraction using multilayer (Long Short Term Memory) LSTM, Convolutional Neural Networks (CNN), and Temporal feature extraction using multilayer LSTM to improve identification accuracy by 96% while requiring minimal execution time. To show the superior performance of the proposed hybrid machine learning technique, a standard UCF crime dataset was utilised for experimental analysis and compared to existing deep learning algorithms. [ABSTRACT FROM AUTHOR]

The smart contract, a self-executing program on the blockchain, is key to programmable finance. However, the rise of smart contract use has also led to an increase in vulnerabilities that attract illegal activity from hackers. Traditional manual approaches for vulnerability detection, relying on domain experts, have limitations such as low automation and weak generalization. In this paper, we propose a deep learning approach that leverages domain-specific features and an attention mechanism to accurately detect vulnerabilities in smart contracts. Our approach reduces the reliance on manual input and enhances generalization by continuously learning code patterns of vulnerabilities, specifically detecting various types of vulnerabilities such as reentrancy, integer overflow, forced Ether injection, unchecked return value, denial of service, access control, short address attack, tx.origin, call stack overflow, timestamp dependency, random number dependency, and transaction order dependency vulnerabilities. In order to extract semantic information, we present a semantic distillation approach for detecting smart contract vulnerabilities. This approach involves using a syntax parser, Slither, to segment the code into smaller slices and word embedding to create a matrix for model training and prediction. Our experiments indicate that the BILSTM model is the best deep learning model for smart contract vulnerability detection task. We looked at how domain features and self-attentiveness mechanisms affected the ability to identify 12 different kinds of smart contract vulnerabilities. Our results show that by including domain features, we significantly increased the F1 values for 8 different types of vulnerabilities, with improvements ranging from 7.35% to 48.58%. The methods suggested in this study demonstrate a significant improvement in F1 scores ranging from 4.18% to 38.70% when compared to conventional detection tools like Oyente, Mythril, Osiris, Slither, Smartcheck, and Securify. This study provides developers with a more effective method of detecting smart contract vulnerabilities, assisting in the prevention of potential financial losses. This research provides developers with a more effective means of detecting smart contract vulnerabilities, thereby helping to prevent potential financial losses. [ABSTRACT FROM AUTHOR]

Zero-Shot Learning (ZSL) has made significant progress driven by deep learning and is being promoted further with the advent of generative models. Despite the success of these methods, the type and number of unseen categories are nailed in the generative models, which makes it challenging to recognize unseen categories in an incremental manner, and the profits of some superior performance algorithms largely arise from their advanced capability of feature extraction, such as Transformers. This paper rigidly follows the assumptions introduced in conventional ZSL and proposes a visual feature filtering method based on a semantic mapping model, namely, filtering visual features through class-specific filters to effectively remove class-agnostic information. Extensive experiments are conducted on four benchmark datasets and have achieved very competitive performance. [ABSTRACT FROM AUTHOR]

Autism Spectrum Disorder (ASD) is a complicated neurodevelopment disorder that is becoming more common day by day around the world. The literature that uses machine learning (ML) and deep learning (DL) approaches gained interest due to their ability to increase the accuracy of diagnosing disorders and reduce the physician's workload. These artificial intelligence-based applications can learn and detect patterns automatically through the collection of data. ML approaches are used in various applications where the traditional algorithms have failed to obtain better results. The major advantage of the ML algorithm is its ability to produce consistent and better performance predictions with the help of non-linear and complex relationships among the features. In this paper, deep learning with a meta-heuristic (MH) approach is proposed to perform the feature extraction and feature selection processes. The proposed feature selection phase has two sub-phases, such as DL-based feature extraction and MH-based feature selection. The effective convolutional neural network (CNN) model is implemented to extract the core features that will learn the relevant data representation in a lower-dimensional space. The hybrid meta-heuristic algorithm called Seagull-Elephant Herding Optimization Algorithm (SEHOA) is used to select the most relevant and important features from the CNN extracted features. Autism disorder patients are identified using long-term short-term memory as a classifier. This will detect the ASD using the fMRI image dataset ABIDE (Autism Brain Imaging Data Exchange) and obtain promising results. There are five evaluation metrics such as accuracy, precision, recall, f1-score, and area under the curve (AUC) used. The validated results show that the proposed model performed better, with an accuracy of 98.6%. [ABSTRACT FROM AUTHOR]

Many Internet of Things (IoT) devices are susceptible to cyber-attacks. Attackers can exploit these flaws using the internet and remote access. An efficient Intelligent threat detection framework is proposed for IoT networks. This paper considers four key layout ideas while building a deep learning-based intelligent threat detection system at the edge of the IoT. Based on these concepts, the Hybrid Stacked Deep Learning (HSDL) model is presented. Raw IoT traffic data is pre-processed with spark. Deep Vectorized Convolution Neural Network (VCNN) and Stacked Long Short Term Memory Network build the classification model (SLSTM). VCNN is used for extracting meaningful features of network traffic data, and SLSTM is used for classification and prevents the DL model from overfitting. Three benchmark datasets (NBaIoT-balanced, UNSW-NB15 & UNSW_BOT_IoT- imbalanced) are used to test the proposed hybrid technique. The results are compared with state-of-the-art models. [ABSTRACT FROM AUTHOR]

BACKGROUND: Tuberculosis (TB) is a highly infectious disease that mainly affects the human lungs. The gold standard for TB diagnosis is Xpert Mycobacterium tuberculosis/ resistance to rifampicin (MTB/RIF) testing. X-ray, a relatively inexpensive and widely used imaging modality, can be employed as an alternative for early diagnosis of the disease. Computer-aided techniques can be used to assist radiologists in interpreting X-ray images, which can improve the ease and accuracy of diagnosis. OBJECTIVE: To develop a computer-aided technique for the diagnosis of TB from X-ray images using deep learning techniques. METHODS: This research paper presents a novel approach for TB diagnosis from X-ray using deep learning methods. The proposed method uses an ensemble of two pre-trained neural networks, namely EfficientnetB0 and Densenet201, for feature extraction. The features extracted using two CNNs are expected to generate more accurate and representative features than a single CNN. A custom-built artificial neural network (ANN) called PatternNet with two hidden layers is utilized to classify the extracted features. RESULTS: The effectiveness of the proposed method was assessed on two publicly accessible datasets, namely the Montgomery and Shenzhen datasets. The Montgomery dataset comprises 138 X-ray images, while the Shenzhen dataset has 662 X-ray images. The method was further evaluated after combining both datasets. The method performed exceptionally well on all three datasets, achieving high Area Under the Curve (AUC) scores of 0.9978, 0.9836, and 0.9914, respectively, using a 10-fold cross-validation technique. CONCLUSION: The experiments performed in this study prove the effectiveness of features extracted using EfficientnetB0 and Densenet201 in combination with PatternNet classifier in the diagnosis of tuberculosis from X-ray images. [ABSTRACT FROM AUTHOR]

Computer vision algorithms based on deep learning have evolved to play a major role in sports analytics. Nevertheless, in sports like table tennis, detecting the ball is a challenge as the ball travels at a high velocity. However, the events in table tennis games can be detected and classified by obtaining the locations of the ball. Therefore, existing methodologies predict the trajectories of the ball but do not detect and classify the in-game events. This paper, therefore, proposes a ball detection and trajectory analysis (BDTA) approach to detect the location of the ball and predict the trajectory to classify events in a table tennis game. The proposed methodology is composed of two parts: i) Scaled-YOLOv4 which can detect the precise position of the ball ii) Analysis of trajectory based on ball coordinates to detect and classify the events. The dataset was prepared and labeled as a ball after enhancing the frame resolution with a super-resolution technique to get the accurate position of the ball. The proposed approach demonstrates 97.8% precision and 98.1% f1-score in detecting the location of the ball and 97.47% precision and achieved 97.8% f-score in classifying in-game events. [ABSTRACT FROM AUTHOR]

The use of smartphones is increasing rapidly and the malicious intrusions associated with it have become a challenging task that needs to be resolved. A secure and effective technique is needed to prevent breaches and detect malicious applications. Through deep learning methods and neural networks, the earliest detection and classification of malware can be performed. Detection of Android malware is the process to identify malicious attackers and through the classification method of malware, the type is categorized as adware, ransomware, SMS malware, and scareware. Since there were several techniques employed so far for malware detection and classification, there were some limitations like a reduced rate of accuracy and so on. To overcome these limitations, a deep learning-based automated process is employed to identify the malware. In this paper, initially, the datasets are collected, and through the preprocessing method, the duplicate and noisy data are removed to improve accuracy. Then the separated malware and benign dataset from the preprocessing phase is dealt with in feature selection. The reliable features are extracted in this process by Meta-Heuristic Artificial Jellyfish Search Optimizer (MH-AJSO). Further by the process of classification, the type of malware is categorized. The classification method is performed by the proposed Dense Dilated ResNet101 (DDResNet101) classifier. According to the type of malware the breach is prevented and secured on the android device. Although several methods of malware detection are found in the android platform the accuracy is effectively derived in our proposed system. Various performance analysis is performed to compare the robustness of detection. The results show that better accuracy of 98% is achieved in the proposed model with effectiveness for identifying the malware and thereby breaches and intrusion can be prevented. [ABSTRACT FROM AUTHOR]

An intelligent segmentation and identification of edemas diseases constitutes a most important crucial ophthalmological issues since they provide important information for the diagnosis process in accordance to the disease severity. But diagnosing the different edema diseases using the OCT-images are considered to be daunting challenge among the researchers. The implementation of computational intelligence techniques such as machine learning, deep learning, bio inspired algorithms and image processing techniques may help the doctors for some extent in improving the automatic extraction and diagnosis process consequently improving patients' life quality. But, these are liable to more errors and less performance, which requires further improvisation in designing the intelligent systems for an effective classification of edema diseases. In this context, this paper proposes the hybrid intelligent framework for the identification, segmentation and classification of three types of edemas such as using the retinal optical coherence tomography (OCT) Images. In this process, Single Feed Forward Training networks (SLFTN) are integrated with Convolutional Layers whose hyperparameters are tuned by using Lion Optimization algorithm. An intensive experimentation is carried out using the Kaggle Retinal OCT Image datasets-2020 with Tensor flow and the proposed framework is trained with the different set of 84,494 images in which performance metrics such as accuracy, sensitivity, specificity, recall and f1score are calculated. Results shows the proposed system has provided satisfactory performance, reaching the average highest accuracy of 99.9% in identifying and classifying the respectively. [ABSTRACT FROM AUTHOR]

Malicious software, or malware, has posed serious and evolving security threats to Internet users. Many anti-malware software packages and tools have been developed to protect legitimate users from these threats. However, legacy anti-malware methods are confronted with millions of potential malicious programs. To combat these threats, intelligent anti-malware systems utilizing machine learning (ML) models are useful. However, most ML models have limitations in performance since the training depth is usually limited. The emergence of Deep Learning (DL) models allow more training possibilities and improvement in performance. DL models often use gradient descent optimization, i.e., the Back-Propagation (BP) algorithm; therefore, their training and optimization procedures suffer from local sub-optimal solutions. In addition, DL-based malware detection methods often entail single classifiers. Ensemble learning overcomes the shortcomings of individual techniques by consolidating their strengths to improve the performance. In this paper, we propose an ensemble DL classifier stacked with the Fuzzy ARTMAP (FAM) model for malware detection. The stacked ensemble method uses several heterogeneous deep neural networks as the base learners. During the training and optimization process, these base learners adopt a hybrid BP and Particle Swarm Optimization algorithm to combine both local and global optimization capabilities for identifying optimal features and improving the classification performance. FAM is selected as a meta-learner to effectively train and combine the outputs of the base learners and achieve robust and accurate classification. A series of empirical studies with different benchmark data sets is conducted. The results ascertain that the proposed ensemble method is effective and efficient, outperforming many other compared methods. [ABSTRACT FROM AUTHOR]

Web service recommender systems have a fundamental role in the selection, composition and substitution of services. Indeed, they are used in several application areas such as Web APIs and Cloud Computing. Likewise, Deep Learning techniques have brought undeniable advantages and solutions to the challenges faced by recommendations in all areas. Unfortunately, the field of Web services has not yet benefited well from these deep methods, moreover, the works using these methods for Web services domain are very recent compared to the works of other fields. Thus, the objective of this paper is to study and analyze state-of-the-art work on Web services recommender systems based on Deep Learning techniques. This analysis will help readers wishing to work in this field, and allows us to direct our future work concerning the Web services recommendation by exploiting the advantages of Deep Learning techniques. [ABSTRACT FROM AUTHOR]

As one of the main methods of information fusion, artificial intelligence class fusion algorithm not only inherits the powerful skills of artificial intelligence, but also inherits many advantages of information fusion. Similarly, as an important sub-field of artificial intelligence class fusion algorithm, deep learning class fusion algorithm also inherits advantages of deep learning and information fusion. Hence, deep learning fusion algorithm has become one of the research hotspots of many scholars. To solve the problem that the existing neural networks are input into multiple channels as a whole and cannot fully learn information of multichannel images, Shan et al. proposed multichannel concat-fusional convolutional neural networks. To mine more multichannel images' information and further explore the performance of different fusion types, the paper proposes new fusional neural networks called multichannel cross-fusion convolutional neural networks (McCfCNNs) with fusion types of "R+G+B/R+G+B/R+G+B" and "R+G/G+B/B+R" based on the tremendous strengths of information fusion. Experiments show that McCfCNNs obtain 0.07-6.09% relative performance improvement in comparison with their corresponding non-fusion convolutional neural networks (CNNs) on diverse datasets (such as CIFAR100, SVHN, CALTECH256, and IMAGENET) under a certain computational complexity. Hence, McCfCNNs with fusion types of "R+G+B/R+G+B/R+G+B" and "R+G/G+B/B+R" can learn more fully multichannel images' information, which provide a method and idea for processing multichannel information fusion, for example, remote sensing satellite images. [ABSTRACT FROM AUTHOR]

Deep networks require a considerable amount of training data otherwise these networks generalize poorly. Data Augmentation techniques help the network generalize better by providing more variety in the training data. Standard data augmentation techniques such as flipping, and scaling, produce new data that is a modified version of the original data. Generative Adversarial networks (GANs) have been designed to generate new data that can be exploited. In this paper, we propose a new GAN model, named StynMedGAN for synthetically generating medical images to improve the performance of classification models. StynMedGAN builds upon the state-of-the-art styleGANv2 that has produced remarkable results generating all kinds of natural images. We introduce a regularization term that is a normalized loss factor in the existing discriminator loss of styleGANv2. It is used to force the generator to produce normalized images and penalize it if it fails. Medical imaging modalities, such as X-Rays, CT-Scans, and MRIs are different in nature, we show that the proposed GAN extends the capacity of styleGANv2 to handle medical images in a better way. This new GAN model (StynMedGAN) is applied to three types of medical imaging: X-Rays, CT scans, and MRI to produce more data for the classification tasks. To validate the effectiveness of the proposed model for the classification, 3 classifiers (CNN, DenseNet121, and VGG-16) are used. Results show that the classifiers trained with StynMedGAN-augmented data outperform other methods that only used the original data. The proposed model achieved 100%, 99.6%, and 100% for chest X-Ray, Chest CT-Scans, and Brain MRI respectively. The results are promising and favor a potentially important resource that can be used by practitioners and radiologists to diagnose different diseases. [ABSTRACT FROM AUTHOR]

Recommender systems based on sentiment analysis become challenging due to the presence of enormous data available over the internet. With the lack of proper data cleaning and analysis methods, existing machine learning (ML) techniques fail to generate accurate recommendations. To overcome this issue, this paper proposes a Light Deep Learning (LightDL)-based recommender system that uses Twitter-based reviews. First, the data is collected from Twitter and cleaned by subsequent data cleaning processes. Then, this pre-processed data is fed into the LightDL model, which learns the important features like hashtags, unigrams, multigrams, etc. from each piece of data. Here, we have learned about four groups of features, including semantic features, syntactic features, symbolic features, and tweet-based features. Finally, the data is classified into positive, negative, and neutral categories according to the learned features. On the basis of classified sentiment, the review is generated to the users. Finally, the model is evaluated in terms of accuracy, precision, recall, f-measure, and error rate through extensive experiments in Matlab. The proposed LightDL model outperforms in all performance measures; specifically, it achieves 95% accuracy for the Twitter dataset. [ABSTRACT FROM AUTHOR]

This paper proposes that the task of single-image low-light enhancement can be accomplished by a straightforward method named Opt2Ada. It contains a series of pixel-level operations, including an optimized illuminance channel decomposition, an adaptive illumination enhancement, and an adaptive global scaling. Opt2Ada is traditional and it does not rely on architecture engineering, super-parameter tuning, or specific training dataset. Its parameters are generic and it has better generalization capability than existing data-driven methods. For evaluation, both the full-reference, non-reference, and semantic metrics are calculated. Extensive experiments on real-world low-light images demonstrate the superiority of Opt2Ada over recent traditional and deep learning algorithms. Due to its flexibility and effectiveness, Opt2Ada can be deployed as a pre-processing subroutine for high-level computer vision applications. [ABSTRACT FROM AUTHOR]

In the field of image classification, the Convolutional Neural Networks (CNNs) are effective. Most of the work focuses on improving and innovating CNN's network structure. However, using labeled data more effectively for training has also been an essential part of CNN's research. Combining image disturbance and consistency regularization theory, this paper proposes a model training method (PairTraining) that takes image pairs as input and dynamically modify the training difficulty according to the accuracy of the model in the training set. According to the accuracy of the model in the training set, the training process will be divided into three stages: the qualitative stage, the fine learning stage and the strengthening learning stage. Contrastive learning images are formed using a progressively enhanced image disturbance strategy at different training stages. The input image and contrast learning image are combined into image pairs for model training. The experiments are tested on four public datasets using eleven CNN models. These models have different degrees of improvement in accuracy on the four datasets. PairTraining can adapt to a variety of CNN models for image classification training. This method can better improve the effectiveness of training and improve the degree of generalization of classification models after training. The classification model obtained by PairTraining has better performance in practical application. [ABSTRACT FROM AUTHOR]

There are many attempts to implement deep neural network (DNN) distributed training frameworks. In these attempts, Apache Spark was used to develop the frameworks. Each framework has its advantages and disadvantages and needs further improvements. In the process of using Apache Spark to implement distributed training systems, we ran into some obstacles that significantly affect the performance of the systems and programming thinking. This is the reason why we developed our own distributed training framework, called Distributed Deep Learning Framework (DDLF), which is completely independent of Apache Spark. Our proposed framework can overcome the obstacles and is highly scalable. DDLF helps to develop applications that train DNN in a distributed environment (referred to as distributed training) in a simple, natural, and flexible way. In this paper, we will analyze the obstacles when implementing a distributed training system on Apache Spark and present solutions to overcome them in DDLF. We also present the features of DDLF and how to implement a distributed DNN training application on this framework. In addition, we conduct experiments by training a Convolutional Neural Network (CNN) model with datasets MNIST and CIFAR-10 in Apache Spark cluster and DDLF cluster to demonstrate the flexibility and effectiveness of DDLF. [ABSTRACT FROM AUTHOR]

Existing active learning algorithms typically assume that the data provided are complete. Nonetheless, data with missing values are common in real-world applications, and active learning on incomplete data is less studied. This paper studies the problem of active learning for ordinal classification on incomplete data. Although cutting-edge imputation methods can be used to impute the missing values before commencing active learning, inaccurately imputed instances are unavoidable and may degrade the ordinal classifier's performance once labeled. Therefore, the crucial question in this work is how to reduce the negative impact of imprecisely filled instances on active learning. First, to avoid selecting filled instances with high imputation imprecision, we propose penalizing the query selection with a novel imputation uncertainty measure that combines a feature-level imputation uncertainty and a knowledge-level imputation uncertainty. Second, to mitigate the adverse influence of potentially labeled imprecisely imputed instances, we suggest using a diversity-based uncertainty sampling strategy to select query instances in specified candidate instance regions. Extensive experiments on nine public ordinal classification datasets with varying value missing rates show that the proposed approach outperforms several baseline methods. [ABSTRACT FROM AUTHOR]

Gait recognition is the process of recognizing a person based on their walking style. Each person's walking gait is distinctive and cannot be imitated by others. However, the walking motion of a person will be changed based on their behaviour but their walking pattern doesn't change. In this paper, a novel Clustering based Faster RCNN has been proposed to identify the single, double and multi-gait. The gait images from the publicly available dataset are pre-processed using Multi scale Retinex (MSR) to reduce the noise artifacts. The Faster RCNN is used for extracting the relevant features from the gait images via the two modules namely CNN and RPN. The CNN layers extract the most relevant features as feature maps and RPN is used for creating the bounding boxes for the extracted features. Fuzzy K-means clustering is used to group the features based on their labels, and it specifies the features acquired using CNN and RPN as input. Finally, the Fast RCNN is employed for classifying the gait images into suspicious and non-suspicious walking pattern. The proposed Clustering based Faster RCNN net achieves the high accuracy rate of 98.74% and 99.19% for suspicious and non-suspicious walking pattern respectively. The proposed Clustering based Faster RCNN model was compared with other traditional models like CNN, U-net, Fab net and Fast R-CNN. The proposed Clustering based Faster RCNN model improves the overall accuracy of 8.86% 33.77% 3.12% and 5.48% better than mmGait, LSTM Net, STDNN and RNN respectively. [ABSTRACT FROM AUTHOR]

With the rapid development of cloud computing, there are more and more large-scale data centers, which makes the energy management of data centers more complex. In order to achieve better energy-saving effect, it is necessary to solve the problems of concurrent management and interdependence of IT, refrigeration, storage, and network equipment. Reinforcement learning learns by interacting with the environment, which is a good way to realize the independent management of the data center. In this paper, a overall energy consumption method for data center based on deep reinforcement learning is proposed to achieve collaborative energy saving of data center task scheduling and refrigeration equipment. A new multi-agent architecture is proposed to separate the training process from the execution process, simplify the interaction process during system operation and improve the operation effect. In the deep learning stage, a hybrid deep Q network algorithm is proposed to optimize the joint action value function of the data center and obtain the optimal strategy. Experiments show that compared with other reinforcement learning methods, our method can not only reduce the energy consumption of the data center, but also reduce the frequency of hot spots. [ABSTRACT FROM AUTHOR]

In today's big data era, there are a large number of unstructured information resources on the web. Natural language processing researchers have been working hard to figure out how to extract useful information from them. Entity Relation Extraction is a crucial step in Information Extraction and provides technical support for Knowledge Graphs, Intelligent Q&A systems and Intelligent Retrieval. In this paper, we present a comprehensive history of entity relation extraction and introduce the relation extraction methods based on Machine Mearning, the relation extraction methods based on Deep Learning and the relation extraction methods for open domains. Then we summarize the characteristics and representative results of each type of method and introduce the common datasets and evaluation systems for entity relation extraction. Finally, we summarize current entity relation extraction methods and look forward to future technologies. [ABSTRACT FROM AUTHOR]

This paper proposes a robust autoencoder with Wasserstein distance metric to extract the linear separability features from the input data. To minimize the difference between the reconstructed feature space and the original feature space, using Wasserstein distance realizes a homeomorphic transformation of the original feature space, i.e., the so-called the reconstruction of feature space. The autoencoder is used for features extraction of linear separability in the reconstructed feature space. Experiment results on real datasets show that the proposed method reaches up 0.9777 and 0.7112 on the low-dimensional and high-dimensional datasets in extracted accuracies, respectively, and also outperforms competitors. Results also confirm that compared with feature metric-based methods and deep network architectures-based method, the linear separabilities of those features extracted by distance metric-based methods win over them. More importantly, the linear separabilities of those features obtained by evaluating distance similarity of the data are better than those obtained by evaluating feature importance of data. We also demonstrate that the data distribution in the feature space reconstructed by a homeomorphic transformation can be closer to the original data distribution. [ABSTRACT FROM AUTHOR]

With the rapid development of technologies such as cloud computing, big data, and the Internet of Things, the scale of data continues to grow. The recommendation system has become one of the important intelligent software to help users make decisions. The recommendation model based on user rating data is widely studied and applied, but the data sparsity problem and the cold start problem seriously affect the recommendation quality. In this paper, Multi-view Hybrid Recommendation Model (MHRM) based on deep learning is proposed. First, we use WLDA (an improved Latent Dirichlet Allocation method) to extract the vector representation of user review text, and then apply LSTM to contextual semantic level user review sentiment analysis. At the same time, the emotion fusion method based on user score embedding is proposed. The problems such as deviations between the user score and actual interest preference, and unbalanced distribution of the score level are solved. This paper has been tested on Amazon product data and compared with various classic recommendation algorithms, using Mean Absolute Error (MAE), hit rate and standardized discount cumulative return for performance evaluation. The experimental results show that the prediction of the MHRM proposed in this paper on the 7 recommendation data and the TopN recommendation index have been significantly improved. [ABSTRACT FROM AUTHOR]

Traditionally, RFID is frequently used in identification and localization. In this paper, an extension application of RFID is designed to recognize gestures. Currently, gesture recognition is mainly used for feature extraction through wearable sensors and video cameras, which have shortcomings such as inconvenience to carry and interference with obstacles. This paper proposes a gesture recognition system based on radio frequency identification (RFID), where users do not need to wear devices. In the proposed model, the interference information generated by the gesture action on the tag signal is used as the fingerprint feature of the action. To obtain satisfactory recognition, the signal diversity is first increased through the tag array. Then, the RSSI and phase signal are normalized to eliminate offset and noise before training. Furthermore, a residual neural network (ResNet) is carefully built as a gesture classification model. The experimental results show that the recognition system achieves more recognition accuracy than existing methods, and the average gesture recognition accuracy reaches 95.5%. [ABSTRACT FROM AUTHOR]

The denial-of-service (DoS) attacks block the communications of the power grids, which affects the availability of the measurement data for monitoring and control. In order to reduce the impact of DoS attacks on measurement data, it is essential to predict missing measurement data. Predicting technique with measurement data depends on the correlation between measurement data. However, it is impractical to install phasor measurement units (PMUs) on all buses owing to the high cost of PMU installment. This paper initializes the study on the impact of PMU placement on predicting measurement data. Considering the data availability, this paper proposes a scheme for predicting states using the LSTM network while ensuring system observability by optimizing phasor measurement unit (PMU) placement. The optimized PMU placement is obtained by integer programming with the criterion of the node importance and the cost of PMU deployment. There is a strong correlation between the measurement data corresponding to the optimal PMU placement. A Long-Short Term Memory neural network (LSTM) is proposed to learn the strong correlation among PMUs, which is utilized to predict the unavailable measured data of the attacked PMUs. The proposed method is verified on an IEEE 118-bus system, and the advantages compared with some conventional methods are also illustrated. [ABSTRACT FROM AUTHOR]

The paper describes the excellent method to get first-rate accuracy and performance in the discipline of Tamil character recognition in a handwritten mode. However, the subject is still at a nascent stage and grossly lacks adequate accuracy in the Tamil language, even though several studies have been conducted within the discipline of handwritten character recognition. This paper draws the attention to the offline handwritten recognition for the Tamil language using the Inception-v3 based transfer learning method. The proposed work is conducted on the readily available HP Tamil handwritten character offline dataset (Hewlett-Packard Lab: hpl-tamil-iso-char-offline-1.0.). It reveals that with the suitable arrangement of transfer learning approach with Inception-v3, the pre-trained model can achieve the recognition accuracy of 93.1%, overtaking the former deep learning designs. The achieved accuracy is due to the use of a pre-trained version with transfer learning that regularly hastens the method of the training process on a new task. Overall, this results in higher accuracy and a more capable version. [ABSTRACT FROM AUTHOR]

Deep learning has been widely used in medical image segmentation, such as breast tumor segmentation, prostate MR image segmentation, and so on. However, the labeling of the data set takes a lot of time. Although the emergence of unsupervised domain adaptation fills the technical gap, the existing domain adaptation methods for breast segmentation do not consider the alignment of the source domain and target domain breast mass structure. This paper proposes a hyperbolic graph convolutional network architecture. First, a hyperbolic graph convolutional network is used to make the source and target domains structurally aligned. Secondly, we adopt a hyperbolic space mapping model that has better expressive ability than Euclidean space in a graph structure. In particular, when constructing the graph structure, we added the completion adjacency matrix, so that the graph structure can be changed after each feature mapping, which can better improve the segmentation accuracy. Extensive comparative and ablation experiments were performed on two common breast datasets(CBIS-DDSM and INbreast). Experiments show that the method in this paper is better than the most advanced model. When CBIS-DDSM and INbreast are used as the source domain, the segmentation accuracy reaches 89.1% and 80.7%. [ABSTRACT FROM AUTHOR]

In the recent years, Artificial Intelligence (AI) has been widely deployed in the healthcare industry. The new AI technology enables efficient and personalized healthcare systems for the public. In this paper, transfer learning with pre-trained VGGFace model is applied to identify sick symptoms based on the facial features of a person. As the deep learning model's operation is unknown for making a decision, this paper investigates the use of Explainable AI (XAI) techniques for soliciting explanations for the predictions made by the model. Various XAI techniques including Integrated Gradient, Explainable region-based AI (XRAI) and Local Interpretable Model-Agnostic Explanations (LIME) are studied. XAI is crucial to increase the model's transparency and reliability for practical deployment. Experimental results demonstrate that the attribution method can give proper explanations for the decisions made by highlighting important attributes in the images. The facial features that account for positive and negative classes predictions are highlighted appropriately for effective visualization. XAI can help to increase accountability and trustworthiness of the healthcare system as it provides insights for understanding how a conclusion is derived from the AI model. [ABSTRACT FROM AUTHOR]

Person identification using biometric features is an effective method for recognizing and authenticating the identity of a person. Multimodal biometric systems combine different biometric modalities in order to make better predictions as well as for achieving increased robustness. This paper proposes a touchless multimodal person identification model using deep learning techniques by combining the gait and speech modalities. Separate pipelines for both the modalities were developed using Convolutional Neural Networks. The paper also explores various fusion strategies for combining the two pipelines and shows how various metrics get affected with different fusion strategies. Results show that weighted average and product fusion rules work best for the data used in the experiments. [ABSTRACT FROM AUTHOR]

With the development and progress of various sensors, the Internet of Things technology has continued to penetrate into people's lives. Successful application cases of the Internet of Things technology have been seen in various industries. Some scholars have begun to try to apply the Internet of Things technology to the management of various industries. Deep learning technology belongs to the category of artificial intelligence technology. Its main goal is to combine a large number of training samples to train the trained object into an object that can learn sample patterns independently. At present, deep learning has a large number of applications in various intelligent operations and key intelligent recognition fields. Due to the characteristics of its learnable training set, deep learning techniques are often used in the direction of decision analysis. The research adopts a combination of questionnaire survey and modeling analysis to explore the construction of in-depth learning methods for enterprise management intelligent decision-making in the context of the Internet of Things. The research was conducted by telephone interview and online questionnaire, and was supported by nearly 100 technical backbone personnel from 25 large enterprises. The research finds that applying the Internet of Things and deep learning technology to enterprise intelligent management decisions can improve the decision-making accuracy of enterprises, and also provide enterprises with more significant decision-making analysis advantages in the industry competition. This paper first describes the concepts of the Internet of Things, deep learning and intelligent decision-making of enterprise management. Then, in order to sort out the problems existing in the current intelligent decision-making of enterprise management, the author conducted interviews and questionnaires. Through the analysis of the questionnaire data, he found the problems existing in the current intelligent decision-making of enterprise management. Finally, he designed a new strategy of intelligent decision-making of enterprise management based on the Internet of Things and deep learning technology, through the simulation and subsequent investigation and analysis of the newly designed strategy. It is found that the enterprise management intelligent decision-making method designed by combining the Internet of Things and deep learning technology is superior to the traditional enterprise decision-making method in all aspects. The design of the system has been reformed mainly from the aspects of human resource management, digital file management and real-time monitoring of production and operation, so that the popularity of the enterprise's comprehensive information management has reached 84.2%, the efficiency of intelligent decision-making increased by 28.7% on average. The achievements of the research not only prove the role of IoT technology in promoting enterprises' in-depth learning, but also put forward new ideas for enterprises' scientific decision-making. [ABSTRACT FROM AUTHOR]

Robust and reliable 3D multi-object tracking (MOT) is essential for autonomous driving in crowded urban road scenes. In those scenarios, accurate data association between tracked objects and incoming new detections is crucial. This paper presents a tracking system based on the Kalman filter that uses a deep learning approach to the association problem. The proposed architecture consists of three neural networks. First, a convolutional LSTM network extracts spatiotemporal features from a sequence of detections of the same track. Then, a Siamese network calculates the degree of similarity between all tracks and the new detections found at each new frame. Finally, a recurrent LSTM network is used to extract 3D and bounding box information. This model follows the tracking-by-detection paradigm and has been trained with track sequences to be able to handle missed observations and to reduce identity switches. A validation test was carried out on the Argoverse dataset to validate the performance of the proposed system. The developed deep learning approach could improve current multi-object tracking systems based on classic algorithms like the Kalman filter. [ABSTRACT FROM AUTHOR]

Trend following strategies have a wide-ranging role in quantitative trading fields, which can capture important unilateral market trends for large gains, while this is vulnerable to losses in the period of consolidation. In this paper, we explored the trend trading system in the Chinese futures market based on machine learning techniques and statistical methods. This research utilized the Long-Short-Term Memory network to extract features of time series then predicted the price movements by Machine Learning classifiers. Moreover, based on rebar futures data, the results reveal that the annualized return improved from 6.39% to 15.68% after the trading signals generated in the trading strategy were filtered using the XGBoost model. Also, futures on gold and soybean were used to further test the integrated strategy and the results of the experiment show the effectiveness of the model in filtering false trading signals. [ABSTRACT FROM AUTHOR]

Human-wildlife conflicts in the habitats along the forest fringes are a substantial issue. An automated monitoring system that can find animal breaches and deter them from foraging fields is essential to solve this conflict. However, automatically forefending the intruding animals is a challenging task. In this paper, we propose a deep learning model for elephant identification using YOLO lite with knowledge distillation which could be easily deployed in edge devices. We also propose an elephant re-identification system using Siamese network which is helpful in tracking the number of times the elephant tries to forage the field. This re-encounter information about the same elephant can be used to decide the averting sound for the particular elephant. The proposed system is found to show an accuracy of 89%, which is provides good performance improvement when compared to the state of art models proposed for animal identification. Thus the proposed lite weight knowledge distillation based animal identification model and deep learning based animal re-identification model can be employed in edge devices for real time monitoring and animal deterring to safe guard the farm fields. [ABSTRACT FROM AUTHOR]

Epilepsy is the most common neurological disorder by which over 65 million people are affected across the world. Recent research has shown a very large interest to predict and diagnose epilepsy well before time. The continuous monitoring of EEG signals for seizure detection in electroencephalogram (EEG) is a very tedious and time taking process and therefore requires a qualified and trained clinical specialist. This paper presents a novel approach to detect and predict the epileptic signal in the recorded electroencephalogram (EEG). There is always a requirement for a nonlinear technique to examine the EEG signals due to the random nature of EEG signals. Therefore, we are providing an alternate method that extracts various entropy measures such Sample Entropy, Spectral Entropy, Permutation Entropy, and Shannon Entropy as statistical features from EEG signal. Based on these extracted features LSTM Fully connected Neural Network is used to classify the EEG signals as Focal and Non-focal. The proposed method gives a new insight into EEG signals by providing sensitivity as an added measure using deep learning along with accuracy and precision. [ABSTRACT FROM AUTHOR]

The task of cell segmentation in microscope images is difficult and popular. In recent years, deep learning-based techniques have made incredible progress in medical and microscopy image segmentation applications. In this paper, we propose a novel deep learning approach called Residual-Atrous MultiResUnet with Channel Attention Mechanism (RAMRU-CAM) for cell segmentation, which combines MultiResUnet architecture with Channel Attention Mechanism (CAM) and Residual-Atrous connections. The Residual-Atrous path mitigates the semantic gap between the encoder and decoder stages and manages the spatial dimension of feature maps. Furthermore, the Channel Attention Mechanism (CAM) blocks are used in the decoder stages to better maintain the spatial details before concatenating the feature maps from the encoder phases to the decoder phases. We evaluated our proposed model on the PhC-C2DH-U373 and Fluo-N2DH-GOWT1 datasets. The experimental results show that our proposed model outperforms recent variants of the U-Net model and the state-of-the-art approaches. We have demonstrated how our model can segment cells precisely while using fewer parameters and low computational complexity. [ABSTRACT FROM AUTHOR]

Everything becomes smart in the modern era, for everything we need a better plan or arrangements. In the olden days, essential information was noted as a document with the help of paper and pen or printed texts. But the intelligent world needs a paperless environment by converting handwritten or printed text documents into software copies. This can be achieved by the electronic data conversion concept called Optical Character Recognition (OCR). OCR of some documents is complex because of different writing styles and quality of scanned image issues, which can be solved by adopting a deep learning technique for better accuracy. We employed Long Short Term Memory (LSTM) for English Optical Character Recognition for paperless and effortless data storage and fast access in this work. Still, the records may contain the entities like names, contact details, drug details, diseases, educational qualifications, dates, etc. These entities cannot be separated by employing OCR alone; we need an entity recognition framework for deeper and faster data analysis. For efficient Named Entity Recognition, we utilize the Adaptive Fuzzy Inference System (ANFIS) powered by the algorithms CRF and BERT to automatically label each entity by training the vast amount of unlabeled text data. The ANFIS model is equipped with both linguistic and numerical knowledge. It is more accurate than the ANN when it comes to identifying patterns and classification data. Also, it is more transparent to the user. Our proposed framework aims to improve the performance of the character recognition system by using a feed-forward network. One of the main issues that have been identified in the development of this system is noise. Through this network, we can provide a single input and one output layer. The main components of the system are the training and recognition sections. These two sections are mainly focused on image acquisition and feature extraction. Besides these, they also include training and simulation of the classifier. The first step in the process of image recognition is to extract the features from the normalized image matrix. We then train the network using a proposed training algorithm. Experimentation on medical records attains a higher accuracy value of 0.9637, recall value of 0.9627, and f1 score of 0.9627, respectively. [ABSTRACT FROM AUTHOR]

Social networks have accelerated the speed and scope of information dissemination. However, the lack of regulation and freedom of speech on social platforms has resulted in the widespread dissemination of the unverified message. Therefore, rapid and effective detection of social network rumors is essential to purify the network environment and maintain public security. Currently, the defects of rumor detection technology are that the detection time is too long and the timeliness is poor. In addition, the differences based on specific regions or specific fields will lead to deviations in the training dataset. In this paper, firstly, the definition of rumor is described, and the current problems and detection process of rumor detection are described; Secondly, introduce different data acquisition methods and analyze their advantages and disadvantages; Thirdly, according to the development of rumor detection technology, the existing rumor detection methods of artificial, machine learning and deep learning are analyzed and compared; Finally, the challenges of social network rumor detection technology are summarized. [ABSTRACT FROM AUTHOR]

The world's energy offer has been beneath an incredible pressure because of the speedy depletion of fossil resources, energy security, environmental issues and therefore the ever-increasing fashionable living sophistication. The problem of persistent hikes in oil costs, climate threats and soaring energy demand has pleased the worldwide interest to exploiting and investment in renewable sorts of energy (RE), alternative energy specially. A electrical phenomenon, PV system is simple to put in, has no moving components, is sort of freed from maintenance, reduced vulnerability to power loss and is expandable. Despite these benefits, PV energy prices significantly on top of fossil fuels. This can be because of its lower effectiveness and better prices. In PV systems tracking MPPT in effective manner is still the problem. In this paper, the 1000 W grid connected PV system has been taken for analysis of various MPPT techniques. Grid connected PV system modeled, tested under totally different irradiation conditions and conjointly for partial shading conditions. additional it's enforced under partial shading condition for early MPPT ways, improvement methodology,at finally adopted deep learning methodology for the system and therefore the obtained results were compared with different methods. [ABSTRACT FROM AUTHOR]

In this article, a methodological approach to classifying malignant melanoma in dermoscopy images is presented. Early treatment of skin cancer increases the patient's survival rate. The classification of melanoma skin cancer in the early stages is decided by dermatologists to treat the patient appropriately. Dermatologists need more time to diagnose affected skin lesions due to high resemblance between melanoma and benign. In this paper, a deep learning based Computer-Aided Diagnosis (CAD) system is developed to accurately classify skin lesions with a high classification rate. A new architecture has been framed to classify the skin lesion diseases using the Inception v3 model as a baseline architecture. The extracted features from the Inception Net are then flattened and are given to the DenseNet block to extracts more fine grained features of the lesion disease. The International Skin Imaging Collaboration (ISIC) archive datasets contains 3307 dermoscopy images which includes both benign and malignant skin images. The dataset images are trained using the proposed architecture with the learning rate of 0.0001, batch size 64 using various optimizer. The performance of the proposed model has also been evaluated using confusion matrix and ROC-AUC curves. The experimental results show that the proposed model attains a highest accuracy rate of 91.29 % compared to other state-of-the-art methods like ResNet, VGG-16, DenseNet, MobileNet. A confusion matrix and ROC curve are used to evaluate the performance analysis of skin images. The classification accuracy, sensitivity, specificity, testing accuracy, and AUC values were obtained at 90.33%, 82.87%, 91.29%, 87.12%, and 87.40%. [ABSTRACT FROM AUTHOR]

Aspect-based sentiment analysis (ABSA) is a challenging task of sentiment analysis that aims at extracting the discussed aspects and identifying the sentiment corresponding to each aspect. We can distinguish three main ABSA tasks: aspect term extraction, aspect category detection (ACD), and aspect sentiment classification. Most Arabic ABSA research has relied on rule-based or machine learning-based methods, with little attention to deep learning techniques. Moreover, most existing Arabic deep learning models are initialized using context-free word embedding models, which cannot handle polysemy. Therefore, this paper aims at overcoming the limitations mentioned above by exploiting the contextualized embeddings from pre-trained language models, specifically the BERT model. Besides, we combine BERT with a temporal convolutional network and a bidirectional gated recurrent unit network in order to enhance the extracted semantic and contextual features. The evaluation results show that the proposed method has outperformed the baseline and other models by achieving an F1-score of 84.58% for the Arabic ACD task. Furthermore, a set of methods are examined to handle the class imbalance in the used dataset. Data augmentation based on back-translation has shown its effectiveness through enhancing the first results by an overall improvement of more than 3% in terms of F1-score. [ABSTRACT FROM AUTHOR]

Before neural networks, image style transfer procedures had a common idea: analyze images with a certain style, build a mathematical or statistical model for the style, and then change the image to be transferred, so that it better fits the established model. In this paper, k-means and semantic closed natural matting algorithm is combined for image segmentation, the style and content in the image are extracted based on neural network, and the resulting image is synthesized by image reconstruction technology to realize the migration of national costume styles. Due to the serious artifacts of the output image, an improved image style transfer algorithm is adopted to constrain the transformation from the input image to the output image in the local affine transformation of the color space, and this constraint is expressed as a completely differentiable parameter term, image distortion is suppressed effectively. In the process of real photo style transfer, there is also space inconsistency. Smoothing is done to ensure that the space style is consistent after style processing, it greatly speeds up the operation speed. On NVIDIA GTX1080TI graphics card, algorithm is tested with 256×256 resolution images. It includes three indicators of average running time, memory usage and the number of styles generated by a single model, which are 0.06 s, 136.06 MB and 1 respectively. These indicators can reflect the efficiency and flexibility of the algorithm. [ABSTRACT FROM AUTHOR]

The clothing images on the Internet is growing rapidly, and there is an increasing demand for the clothing images' intelligent classification. In this paper, Region-Based Fully Convolutional Networks (R-FCN) is introduced into the clothing image recognition. In the clothing image classification, because the network training time is long and the recognition rate of deformed clothing images is low, an improved framework HSR-FCN is proposed. The regional suggestion network and HyperNet network in R-FCN are integrated in the new framework, the learning approach of image features is changed in HSR-FCN, the higher accuracy can be achieved in a shorter training time. A spatial transformation network is introduced into the model, the input clothing image and feature map are spatially transformed and aligned, the feature learning is strengthened for multi-angle clothing and deformed clothing. The experimental results show that the improved HSR-FCN model is used to strengthen effectively the learning of deformed clothing images, and with a shorter training time, the average accuracy rate of the original network model R-FCN is increased by about 3%, it reachs 96.69%. [ABSTRACT FROM AUTHOR]

In recent years, speech processing resides a major application in the domain of signal processing. Due to the audibility loss of some speech signals, people with hearing impairment have difficulty in understanding speech, which reintroduces a crucial role in speech recognition. Automatic Speech Recognition (ASR) development is a major challenge in research in the case of noise, domain, vocabulary size, and language and speaker variability. Speech recognition system design needs careful attention to challenges or issues like performance and database evaluation, feature extraction methods, speech representations and speech classes. In this paper, HDF-DNN model has been proposed with the hybridization of discriminant fuzzy function and deep neural network for speech recognition. Initially, the speech signals are pre-processed to eliminate the unwanted noise and the features are extracted using Mel Frequency Cepstral Coefficient (MFCC). A hybrid Deep Neural Network and Discriminant Fuzzy Logic is used for assisting hearing-impaired listeners with enhanced speech intelligibility. Both DNN and DF have some problems with parameters to address this problem, Enhanced Modularity function-based Bat Algorithm (EMBA) is used as a powerful optimization tool. The experimental results show that the proposed automatic speech recognition-based hybrid deep learning model is effectively-identifies speech recognition more than the MFCC-CNN, CSVM and Deep auto encoder techniques. The proposed method improves the overall accuracy of 8.31%, 9.71% and 10.25% better than, MFCC-CNN, CSVM and Deep auto encoder respectively. [ABSTRACT FROM AUTHOR]

Increasing interest and advancement of internet and communication technologies have made network security rise as a vibrant research domain. Network intrusion detection systems (NIDSs) have developed as indispensable defense mechanisms in cybersecurity that are employed in discovery and prevention of malicious network activities. In the recent years, researchers have proposed deep learning approaches in the development of NIDSs owing to their ability to extract better representations from large corpus of data. In the literature, convolutional neural network architecture is extensively used for spatial feature learning, while the long short term memory networks are employed to learn temporal features. In this paper, a novel hybrid method that learn the discriminative spatial and temporal features from the network flow is proposed for detecting network intrusions. A two dimensional convolution neural network is proposed to intelligently extract the spatial characteristics whereas a bi-directional long short term memory is used to extract temporal features of network traffic data samples consequently, forming a deep hybrid neural network architecture for identification and classification of network intrusion samples. Extensive experimental evaluations were performed on two well-known benchmarks datasets: CIC-IDS 2017 and the NSL-KDD datasets. The proposed network model demonstrated state-of-the-art performance with experimental results showing that the accuracy and precision scores of the intrusion detection model are significantly better than those of other existing models. These results depicts the applicability of the proposed model in the spatial-temporal feature learning in network intrusion detection systems. [ABSTRACT FROM AUTHOR]