Search

Background: Dementia is a general term for several progressive neurodegenerative disorders including Alzheimer's disease. Timely and accurate detection is crucial for early intervention. Advancements in artificial intelligence present significant potential for using machine learning to aid in early detection. Objective: Summarize the state-of-the-art machine learning-based approaches for dementia prediction, focusing on non-invasive methods, as the burden on the patients is lower. Specifically, the analysis of gait and speech performance can offer insights into cognitive health through clinically cost-effective screening methods. Methods: A systematic literature review was conducted following the PRISMA protocol (Preferred Reporting Items for Systematic Reviews and Meta-Analyses). The search was performed on three electronic databases (Scopus, Web of Science, and PubMed) to identify the relevant studies published between 2017 to 2022. A total of 40 papers were selected for review. Results: The most common machine learning methods employed were support vector machine followed by deep learning. Studies suggested the use of multimodal approaches as they can provide comprehensive and better prediction performance. Deep learning application in gait studies is still in the early stages as few studies have applied it. Moreover, including features of whole body movement contribute to better classification accuracy. Regarding speech studies, the combination of different parameters (acoustic, linguistic, cognitive testing) produced better results. Conclusions: The review highlights the potential of machine learning, particularly non-invasive approaches, in the early prediction of dementia. The comparable prediction accuracies of manual and automatic speech analysis indicate an imminent fully automated approach for dementia detection. [ABSTRACT FROM AUTHOR]

BACKGROUND: Oral cancer is a malignant tumor that usually occurs within the tissues of the mouth. This type of cancer mainly includes tumors in the lining of the mouth, tongue, lips, buccal mucosa and gums. Oral cancer is on the rise globally, especially in some specific risk groups. The early stage of oral cancer is usually asymptomatic, while the late stage may present with ulcers, lumps, bleeding, etc. OBJECTIVE: The objective of this paper is to propose an effective and accurate method for the identification and classification of oral cancer. METHODS: We applied two deep learning methods, CNN and Transformers. First, we propose a new CANet classification model for oral cancer, which uses attention mechanisms combined with neglected location information to explore the complex combination of attention mechanisms and deep networks, and fully tap the potential of attention mechanisms. Secondly, we design a classification model based on Swim transform. The image is segmented into a series of two-dimensional image blocks, which are then processed by multiple layers of conversion blocks. RESULTS: The proposed classification model was trained and predicted on Kaggle Oral Cancer Images Dataset, and satisfactory results were obtained. The average accuracy, sensitivity, specificity and F1-Socre of Swin transformer architecture are 94.95%, 95.37%, 95.52% and 94.66%, respectively. The average accuracy, sensitivity, specificity and F1-Score of CANet model were 97.00%, 97.82%, 97.82% and 96.61%, respectively. CONCLUSIONS: We studied different deep learning algorithms for oral cancer classification, including convolutional neural networks, converters, etc. Our Attention module in CANet leverages the benefits of channel attention to model the relationships between channels while encoding precise location information that captures the long-term dependencies of the network. The model achieves a high classification effect with an accuracy of 97.00%, which can be used in the automatic recognition and classification of oral cancer. [ABSTRACT FROM AUTHOR]

Many colleges in China have adopted the policy of recruiting students by academic subject categories in order to optimize the talent training mode. To solve the problems in major selection after enrollment, this paper has designed an intelligent algorithm model for recommending college majors. Compared with existing methods for assigning college majors, the model uses deep neural networks and clustering algorithms to simulate complex calculations in the human brain. It uses historical learning data from senior students or graduates to predict the future grades of freshmen, judge their adaptability to various college majors, reduce human interference in the college major selection process, recommend the most suitable college major to students. [ABSTRACT FROM AUTHOR]

News text is an important branch of natural language processing. Compared to ordinary texts, news text has significant economic and scientific value. The characteristics of news text include structural hierarchy, diverse label categories, and limited high-quality annotation samples. Many machine learning and deep learning methods exist to analyze various forms of news text. However, due to label imbalance, hierarchical semantics, and confusing labels, current methods have limitations. Therefore, this paper proposes a news text classification framework based on hierarchical semantics and prior correction (HSPC). Firstly, data augmentation is used to enhance the diversity of the training set and adversarial learning is employed to improve the resistance of the model with its robustness. Then, a hierarchical feature extraction approach is employed to extract semantic features from different levels of news texts. Consequentially, a feature fusion method is designed to allow the model to focus on relevant hierarchical semantics for label classification. Finally, highly confusing label predictions are corrected to optimize the label prediction of the model and improve confidence. Multiple experiments are performed on four widely used public datasets. The experimental results indicate that HSPC achieves higher classification accuracy compared to other models. On the FCT, AGNews, THUCNews, and Ohsumed datasets, HSPC improves the accuracy by 1.03%, 1.38%, 2.55%, and 1.15%, respectively, compared to state-of-the-art methods. This validates the rationality and effectiveness of the designed mechanisms. [ABSTRACT FROM AUTHOR]

Neuroimaging technology is considered a non-invasive method research the structure and function of the brain which have been widely used in neuroscience, psychiatry, psychology, and other fields. The development of Deep Learning Neural Network (DLNN), based on the deep learning algorithms of neural imaging techniques in brain disease diagnosis plays a more and more important role. In this paper, a deep neural network imaging technology based on Stack Auto-Encoder (SAE) feature extraction is constructed, and then Support Vector Machine (SVM) was used to solve binary classification problems (Alzheimer's disease [AD] and Mild Cognitive Impairment [MCI]). Four sets of experimental data were employed to perform the training and testing stages of DLNN. The number of neurons in each of the DLNNs was determined using the grid search technique. Overall, the results of DLNNs performance indicated that the SAE feature extraction was superior over (Accuracy Rate [AR] = 74.9% with structure of 93-171-49-22-93) shallow layer features extraction (AR = 70.8% with structure of 93-22-93) and primary features extraction (AR = 69.2%). [ABSTRACT FROM AUTHOR]

Mild cognitive impairment (MCI) is a syndrome that occurs in the preclinical stage of Alzheimer's disease (AD) and is also an early signal of the onset of AD. Early detection and accurate differentiation between MCI and AD populations, and providing them with effective intervention and treatment, are of great significance for preventing or delaying the onset of AD. In this paper, we propose a deep learning model, SE-DenseNet, that combines channel attention and dense connectivity networks and apply it to the field of magnetic resonance imaging (MRI) data recognition for the diagnosis of AD and MCI. First, to extract MRI features with high quality, a slicing algorithm based on two-dimensional image information entropy is proposed to obtain AD brain lesion features with stronger representation ability. Second, in terms of model structure, SENet is introduced as a channel attention module and redistribute the weight of image features in the channel dimension; use DenseNet as the main architecture to maximize information flow, and each layer is directly interconnected with subsequent layers. It enables the network to learn and extract relevant features from the input data and improve the classification ability of the network. Finally, our proposed model is validated on the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset, the results have shown that the accuracy for the four classification tasks of AD-NC, AD-MCI, NC-MCI, and AD-NC-MCI can reach 98.12%, 97.42%, 97.42%, and 95.24%, respectively. At the same time, the sensitivity and specificity have also achieved satisfactory results, exhibited a high performance in comparison with the classic machine learning algorithm and several existing state-of-the-art deep learning methods, demonstrating the proposed method is a powerful tool for the early diagnosis and detection of AD. [ABSTRACT FROM AUTHOR]

Parkinson disease (PD) is a type of neurodegenerative disorder that affects the motor movement of the patient. But each technique has its own advantages or disadvantages. In gene, speech and handwriting data model, the feature extraction and reduction is an important step for efficient classification. These two steps require proper attention for selection and also require high processing time as compared to other data model like images. Because in image modality, the deep learning algorithm can be applied that can perform all process and automate the classification. As compared to these domains, the signal produces better and best results. Because the electroencephalogram (EEG) signal are taken from the brain using electrodes and it helps to observe the brain signals effectively and immediately as compared to the other data modals. Hence, in this paper, the wavelet transform will be used to decompose the signals and statistical features will be extracted from the transformed signal. Here, the satin bower bird optimization will be used for both type of wavelet selection and feature reduction process for final classification. The reduced feature set will be classified using Ensemble Neural Network type including InceptionV3, DenseNet, MobileNet, Xception, and NasNet) recently proposed for medical image classification. The whole process will be realized using MATLAB R2021a software and its performance will be evaluated in terms of Accuracy and is compared against Automated Tunable Q-wavelet transform performance. The proposed ensemble method, employing EEG signal processing and neural networks, achieved a 97% success rate in discriminating PD datasets, surpassing Convolutional Neural Network (CNN) and Machine Learning (ML) classifications (88% –92%). Utilizing MATLAB R2021a, its superiority over Q-wavelet transform was evident, signifying improved PD dataset discrimination. [ABSTRACT FROM AUTHOR]

Malware attack is a growing problem on the Android mobile platform due to its popularity and openness. Although numerous malware detection approaches have been proposed, it still remains challenging for malware detection due to a large amount of constantly mutating apps. The opcode, as the most fundamental part of Android app, possesses good resistance against obfuscation and Android version updates. Due to the large number of opcodes, most opcode-based methods employ statistical-based feature selection, which disrupts the correlation and semantic information among opcodes. In this paper, we propose an Android malware detection framework based on sensitive opcodes and deep reinforcement learning. Firstly, we extract sensitive opcode fragments based on sensitive elements and then encode the features using n-gram. Next, we use deep reinforcement learning to select the optimal subset of features. During the process of handling opcodes, we focus on preserving semantic information and the correlation among opcodes. Finally, our experimental results show an accuracy of 0.9670 by using the 25 opcode features we obtained. [ABSTRACT FROM AUTHOR]

Intelligent Transportation Systems (ITS) have experienced significant growth over the past decade thanks to advances in control, communication, and information technology applied to vehicles, roads, and traffic control systems. Vehicle type classification plays a vital role in implementing ITS because of its ability to collect useful traffic information, enable future development of transport infrastructures, and increase human comfort. As a branch of machine learning, deep learning represents a frontier for artificial intelligence, which seeks to be closer to its primary goal. Deep learning is a powerful tool for classifying vehicle types because it can capture complex traffic data characteristics and learn from large amounts of data. This means that it can be used to accurately classify traffic data and generate valuable insights that can be used to improve traffic management. Researchers have successfully adopted these algorithms as a solution to propose optimal vehicle-type classification strategies. This paper highlights the role of deep learning algorithms in solving the vehicle type classification problem, reviewing the state-of-the-art approaches in this field. [ABSTRACT FROM AUTHOR]

The concept of endorsing AI in embedded systems is growing in all sectors including the development of Accident Avoidance Systems. Although real-time road crash prediction is vital for enhancing road user safety, there has been limited focus on the analysis of real-time crash events within ensemble and deep learning fused systems. The main aim of this paper is to design an advanced Accident Avoidance System established on a deep learning and ensemble fusion strategy in order to acquire more performant crash predictions. As such, four highly optimized models for crash prediction have been designed based on the popular ensemble techniques: CatBoost, AdaBoost and Bagging and the deep learning CNN. Additionally, four categories of features, including driver inputs, vehicle kinematics, driver states and weather conditions, were measured during the execution of various driving tasks performed on a driving simulator. Moreover, given the infrequent nature of crash events, an imbalance-control procedure was adopted using the SMOTE and ADASYN techniques. The highest performances results have been acquired using CatBoost along with ADASYN on almost all the adopted metrics during the different weather conditions, and more than 50% of all crashes have occurred in rainy weather conditions, whereas 31% have been exhibited in fog patterns. The sensitivity analysis results indicate that the fusing all the acquired features has the highest impact on the prediction performance. To our knowledge, there has been a limited interest, if not at all, at adopting a fused ensemble deep learning system examining the real-time impact of the adopted features' combinations on the prediction of road crashes while taking into account class imbalance. The findings provide new insights into crash prediction and emphasize the relevance of the explanatory features which can be endorsed in designing efficient Accident Avoidance Systems. [ABSTRACT FROM AUTHOR]

Data driven deep learning methods have become the mainstream method of building extraction from remote sensing images. In this paper, deep learning algorithm is used to classify and extract buildings from remote sensing images of rural areas around the Great Wall in the suburbs of Beijing captured by unmanned aerial vehicles. Aiming at the shortcomings of the current mainstream instance segmentation algorithm Mask R-CNN in feature fusion and poor prediction of instance mask boundaries, this paper proposes a boundary optimization algorithm for building instance segmentation based on discrete wavelet transform. Firstly, the discrete wavelet transform is introduced into the segmentation task branch of Mask R-CNN algorithm to extract the low-frequency and high-frequency information of the real mask, in which the high-frequency information includes the boundary information. Secondly, the pixel by pixel prediction of the mask turns into the learning of the low-frequency and high-frequency information of the real mask. The learning of the high-frequency information helps the segmentation network to learn the boundary features better. Finally, using the reversibility of discrete wavelet transform, the low-frequency and high-frequency information of the learned mask is inversely transformed to reconstruct the final mask. The improved algorithm is evaluated on the dataset COCO, and applied to the automatic extraction of buildings. The DWT Mask R-CNN algorithm model achieved 70.2% segmentation accuracy and 71.4% detection accuracy, which were improved by 1% and 0.7% respectively compared with the Mask R-CNN and Cascade Mask R-CNN models. The experimental results show that the instance segmentation edge optimization algorithm combined with wavelet transform has achieved better results on the segmentation boundary, improved the poor effect of mask edge detection and achieved higher detection accuracy, and can accurately extract village buildings. [ABSTRACT FROM AUTHOR]

Multi-modal information outbreak is consistently increasing in social media. Classification of tweet sentiments using various information modalities will help the recommender systems to achieve success in digital marketing. Moreover, aspect-level sentiment analysis categorizes a target's sentiment polarity in a specific environment. Using topic modelling in aspect-level sentiment analysis enables the identification of more accurate aspect-based tweet sentiments. The existing sentiment classification techniques used for the development of recommendation systems do not focus on the aspect-based approach modelled using deep learning classifier with temporal analysis on the social media data. Hence, this paper proposes an efficient sentiment classification model that highlights the impact of topic modelling-based word feature embedding for improvising the classification of Twitter sentiments and product reviews based on temporal reasoning and analysis for performing predictive analysis. For tweets context analysis, Latent Dirichlet Allocation based topic modelling is used in this work which generates the topics. For each topic, the sentiment is calculated separately and the topic guided feature expansion is done using Senti-wordnet. Moreover, an extended deep learning classification algorithm called Long Short-Term Memory (LSTM) with word embedding and temporal reasoning(LSTMWTR) is proposed in this paper for improving the classification accuracy. Finally, the labelled data are classified using the existing machine learning algorithms namely Naïve Bayes, Support Vector Machines and also using the deep learning models such as Convolution Neural Network(CNN),LSTM, Recurrent Neural Networks (RNN) and the transformer model namelyBi-directional Encoder Representation from Transformers (BERT),Convolution Bi-directional Recurrent Neural Network (CBRNN) and the proposed deep learning algorithm namelyLSTMWTR. These sentiment classification algorithms have been evaluated with word embedding for tweet sentiment classification and product review classification. The results obtained from this work show that the proposed LSTMWTR algorithm emerges as the highly accurate model for tweet sentiment and product review classification. [ABSTRACT FROM AUTHOR]

Online shopping is a form of electronic commerce that enables customers to purchase products directly from the seller over the internet using a web browser or a mobile application. With the growing number of research papers on Deep Learning (DL)-based recommendations, DL models have proven to be effective in Recommender systems. Hence in this paper, relevant product accessories recommendation is proposed using deep learning and histogram features. The proposed recommendation describes the novel way of content-based filtering which divides the work into two phases. In phase 1, the implemented approach determines the color and category of the product. In phase 2, the recommendation system retrieves the matching accessories for the chosen product. For phase 1, Decision Tree, Linear Regression, Logistic Regression, Naïve Bayes, Long Short-Term Memory (LSTM), and a novel method of Stack dense Recurrent Neural Network (RNN) along with the color histogram is applied to identify the category and color of the product. It is justified that the proposed technique of stack dense RNN achieves 98% accuracy. In phase 2, from the Machine Learning (ML) perspective, Random Forest (RF) is employed for the recommendation. The RF model finds the matching accessories for the chosen product and retrieves the top relevant items. [ABSTRACT FROM AUTHOR]

The rise of social networking in today's society has brought convenience to people's lives, but at the same time people are also suffering from cyberbullying. How to check these bullying languages has become a popular problem. As text is an important vehicle for online social networking, the natural language learning, representation, and training becomes a necessary work for cyberbullying detection. In this paper, we summarize and analyze the existing work by studying it, and then finally propose new ideas and experiments. The specific method is based on the LSTM model, in which the parameters and dimensions are adjusted to demonstrate the best results of the model. And a user rating system is used to detect bullying more effectively. [ABSTRACT FROM AUTHOR]

Arrhythmia disorders are the leading cause of death worldwide and are primarily recognized by the patient's irregular cardiac rhythms. Wearable Internet of Things (IoT) devices can reliably measure patients' heart rhythms by producing electrocardiogram (ECG) signals. Due to their non-invasive nature, ECG signals have been frequently employed to detect arrhythmias. The manual procedure, however, takes a long time and is prone to error. Utilizing deep learning models for early automatic identification of cardiac arrhythmias is a preferable approach that will improve diagnosis and therapy. Though ECG analysis using cloud-based methods can perform satisfactorily, they still suffer from security issues. It is essential to provide secure data transmission and storage for IoT medical data because of its significant development in the healthcare system. So, this paper proposes a secure arrhythmia classification system with the help of effective encryption and a deep learning (DL) system. The proposed method mainly involved two phases: ECG signal transmission and arrhythmia disease classification. In the ECG signal transmission phase, the patient's ECG data collected through the IoT sensors is encrypted using the optimal key-based elgamal elliptic curve cryptography (OKEGECC) mechanism, and the encrypted data is securely transmitted to the cloud. After that, in the arrhythmia disease classification phase, the system collects the data from the Massachusetts Institute of Technology-Beth Israel Hospital (MIT-BIH) database to perform training. The collected data is preprocessed by applying the continuous wavelet transform (CWT) to improve the quality of the ECG data. Next, the feature extraction is carried out by deformable attention-centered residual network 50 (DARNet-50), and finally, the classification is performed using butterfly-optimized Bi-directional long short-term memory (BOBLSTM). The experimental outcomes showed that the proposed system achieves 99.76% accuracy, which is better than the existing related schemes. [ABSTRACT FROM AUTHOR]

PCB defect detection aims to identify the presence of gaps, open circuits, short circuits, and other defects in the PCB boards produced in the industry. Designing effective deep learning algorithms is crucial to finding a solution. Previously proposed PCB defect detection algorithms are limited in detecting tiny objects in high-density. Directly applying previous models to tackle PCB defect detection tasks will cause serious issues, such as missed detection and false detection. In this paper, we present a detection algorithm for tiny PCB defect targets in high-density regions to solve the above-mentioned problems. We firstly propose a detection head to detect tiny objects. Then, we design a four-channel feature fusion mechanism to fuse four different scale features and add an attention mechanism to find the attention region in scenarios with dense objects. Finally, we achieved accurate detection of tiny targets in high-density areas. Experiments were performed on the publicly available PCB defect dataset from Peking University. Our mAP@.5:.95 achieves 48.6%, while mAP@0.5 exceeds 90%. Compared with YOLOX and YOLOv5, our improved model can better localize tiny objects in high-density scenes. The experimental results certify that our model can obtain higher performance in comparison with the baseline and the state of the art. [ABSTRACT FROM AUTHOR]

During the long-term operation of the photovoltaic (PV) system, occlusion will reduce the solar radiation energy received by the PV module, as well as the photoelectric conversion efficiency and economy. However, the occlusion detection of the PV power station has the defects of low efficiency, poor accuracy, and untimely detection, which will cause unknown system losses. Based on the deep learning algorithm, this paper conducts research on PV module occlusion detection. In order to accurately obtain the occlusion area and position information of the PV panel, a PV module occlusion detection model based on the Segment-You Only Look Once (Seg-YOLO) algorithm is established. Based on the YOLOv5 algorithm, the loss function is modified, the Segment Head detection module is introduced, and the convolutional block attention module (CBAM) attention mechanism is added to achieve the accurate detection of small targets by the algorithm model and the fast detection of the PV module occlusion area identify. The model performance research is carried out on three types of occlusion datasets: leaf, bird dropping, and shadow. According to the experimental results, the proposed model has better recognition accuracy and speed than SSD, Faster-Rcnn, YOLOv4, and U-Net. The precision rate, recall rate, and recognition speed can reach 90.52%, 92.41%, and 92.3 FPS, respectively. This model can lay a theoretical foundation for the intelligent operation and maintenance of PV systems. [ABSTRACT FROM AUTHOR]

Globally, the two main causes of young people dying are mental health issues and suicide. A mental health issue is a condition of physiological disorder that inhibits with the vital process of the brain. The amount of individuals with psychiatric illnesses has considerably increased during the past several years. The majority of individuals with mental disorders reside in India. The mental illness can have an impact on a person’s health, thoughts, behaviour, or feelings. The capacity of controlling one’s thoughts, emotions, and behaviour might help an individual to deal with challenging circumstances, build relationships with others, and navigate life’s problems. With a primary focus on the healthcare domain and human-computer interaction, the capacity to recognize human emotions via physiological and facial expressions opens up important research ideas as well as application-oriented potential. Affective computing has recently become one of the areas of study that has received the greatest interest from professionals and academics in a variety of sectors. Nevertheless, despite the rise in articles published, the reviews of a particular aspect of affective computing in mental health still are limited and have certain inadequacies. As a result, a literature survey on the use of affective computing in India to make decisions about mental health issues is discussed. As a result, the paper focuses on how traditional techniques used to monitor and assess physiological data from humans by utilizing deep learning and machine learning approaches for humans’ affect recognition (AR) using Affective computing (AfC) which is a combination of computer science, AI, and cognitive science subjects (such as psychology and psychosocial). [ABSTRACT FROM AUTHOR]

The Central Nervous System (CNS) is one of the most crucial parts of the human body. Brain tumor is one of the deadliest diseases that affect CNS and they should be detected earlier to avoid serious health implications. As it is one of the most dangerous types of cancer, its diagnosis is a crucial part of the healthcare sector. A brain tumor can be malignant or benign and its grade recognition is a tedious task for the radiologist. In the recent past, researchers have proposed various automatic detection and classification techniques that use different imaging modalities focusing on increased accuracy. In this paper, we have done an in-depth study of 19 different trained deep learning models like Alexnet, VGGnet, DarkNet, DenseNet, ResNet, InceptionNet, ShuffleNet, NasNet and their variants for the detection of brain tumors using deep transfer learning. The performance parameters show that NASNet-Large is outperforming others with an accuracy of 98.03% for detection and 97.87% for classification. The thresholding algorithm is used for segmenting out the tumor region if the detected output is other than normal. [ABSTRACT FROM AUTHOR]

Machine learning (ML) has been applied in civil engineering to predict the compressive strength of concrete with high accuracy. In this paper, five boosting ensemble algorithms, i.e., XGBoost, AdaBoost, GBDT, LightGBM, and CatBoost, were used to predict the compressive strength of high-performance concrete (HPC). The models were evaluated using performance indicators such as R2, root mean square error (RMSE), and mean absolute error (MAE). The results showed that the CatBoost model had the highest accuracy with a R2 (0.970) and a RMSE (2.916). The prediction accuracy of the model was increased through hyperparameter optimization, which got a higher with a R2 (0.975) and a RMSE (2.863). Meanwhile, the SHapley Additive exPlanations (SHAP) method was used to explain the output results of the optimal model (CatBoost), which generated explainable insights that further revealed the complex relationship between the prediction model parameters. The results showed that AGE, W/B, and W/C had the most impact on high-performance concrete compressive strength (HPCCS) prediction, which was similar to the results of sensitivity analysis. This study provided a theoretical basis and technical guidance for developing the mix design of a new high-performance concrete (HPC) system. In the future, the interpretable results of the model output should be iteratively checked and validated in the actual laboratory in order to provide guidance for engineering practice. [ABSTRACT FROM AUTHOR]

In this paper, 1,538 papers retrieved with the keywords "sports artificial intelligence (AI)" on the Web of Science database since 2007 were taken as the data source, and the Cite Space V software was used to visualize and analyze them. A visual knowledge graph was used to streamline the countries, institutions and authors conducting sports AI research, discipline distribution, research hotspots and development trends in the past 15 years. Subsequently, its development direction and research progress were discussed. Sports AI was widely distributed, with the US, China and the UK leading the way. The most prolific authors and teams in research on sports AI were concentrated in American universities. Their main research direction is to develop and improve smart wearable devices based on machine learning and deep learning technologies for different groups of people. Research on sports AI involved multiple disciplines, which mainly applied and referred to research methodologies and theories on engineering, computer science and sports science. It could be seen from the frequency and centrality of keywords that in the current field of sports AI, machine learning is the main direction, artificial neural networks is the main algorithm, and practical and empirical research based on data mining is the focus. The research hotspots were divided into three major clusters: physical health promotion, sports injury prevention and control, and athletic performance enhancement. How to introduce intelligent technology into sports for a perfect integration still has an arduous and long way to go. Future development requires joint efforts and participation of scientific researchers, professionals and common people. [ABSTRACT FROM AUTHOR]

Human posture detection is easily affected by the external environment, resulting in blurred results of limb feature extraction. In order to improve the accuracy and speed of human motion detection, this paper proposes a deep learning-based motion detection method in competitive sports training. The double parallel convolution network algorithm in the depth learning algorithm is used to process the collected action information, extract the body action features, and greatly reduce the operation scale; With the help of the theory of motion mechanics, the mechanical parameters in the motion process are calculated to eliminate outliers and reduce feature dimensions; With the help of motion inertial sensors and joint degrees of freedom, the limb motion detection results are obtained. The experimental results show that the average recognition rate of the method for different motion actions is 99.5%, and the average detection time is 148 ms, with good application performance. [ABSTRACT FROM AUTHOR]

The need for a monitoring system has grown as a result of rising crime and anomalous activity. To avoid unusual incidents, the common man initiated video surveillance of important areas, which was then passed on to the government. In typical surveillance operations, surveillance devices create a vast volume of data that must be manually analysed. Manually handling huge data sets in real time results in information loss. To prevent abnormal incidents, the actions in sensitive areas can be properly monitored, evaluated, and alerted to the appropriate authorities. Previous deep learning-based activity identification methods have appeared, but the findings are inaccurate, and the proposed Hybrid Machine Learning Algorithms (HMLA) incorporate two detection methods for surveillance videos like as Transfer Learning (TL) and Continual Learning (CL). As a result, the suspicious activity in the video may be missed. Consequently, numerous image processing and computer vision technologies were used in activity detection to decrease human effort and mistakes in surveillance operations. Activities in sensitive areas can be properly monitored and evaluated to avoid unusual incidents, and the appropriate authorities may be alerted. Hence, in order to decrease human error and effort in surveillance operations, activity recognition embraced a variety of image processing and computer vision technologies. In this present work, the capacity has constraints that impact recognition accuracy. Consequently, this research paper presents a HMLA based technique that uses feature extraction using multilayer (Long Short Term Memory) LSTM, Convolutional Neural Networks (CNN), and Temporal feature extraction using multilayer LSTM to improve identification accuracy by 96% while requiring minimal execution time. To show the superior performance of the proposed hybrid machine learning technique, a standard UCF crime dataset was utilised for experimental analysis and compared to existing deep learning algorithms. [ABSTRACT FROM AUTHOR]

Autism Spectrum Disorder (ASD) is a complicated neurodevelopment disorder that is becoming more common day by day around the world. The literature that uses machine learning (ML) and deep learning (DL) approaches gained interest due to their ability to increase the accuracy of diagnosing disorders and reduce the physician's workload. These artificial intelligence-based applications can learn and detect patterns automatically through the collection of data. ML approaches are used in various applications where the traditional algorithms have failed to obtain better results. The major advantage of the ML algorithm is its ability to produce consistent and better performance predictions with the help of non-linear and complex relationships among the features. In this paper, deep learning with a meta-heuristic (MH) approach is proposed to perform the feature extraction and feature selection processes. The proposed feature selection phase has two sub-phases, such as DL-based feature extraction and MH-based feature selection. The effective convolutional neural network (CNN) model is implemented to extract the core features that will learn the relevant data representation in a lower-dimensional space. The hybrid meta-heuristic algorithm called Seagull-Elephant Herding Optimization Algorithm (SEHOA) is used to select the most relevant and important features from the CNN extracted features. Autism disorder patients are identified using long-term short-term memory as a classifier. This will detect the ASD using the fMRI image dataset ABIDE (Autism Brain Imaging Data Exchange) and obtain promising results. There are five evaluation metrics such as accuracy, precision, recall, f1-score, and area under the curve (AUC) used. The validated results show that the proposed model performed better, with an accuracy of 98.6%. [ABSTRACT FROM AUTHOR]

An intelligent segmentation and identification of edemas diseases constitutes a most important crucial ophthalmological issues since they provide important information for the diagnosis process in accordance to the disease severity. But diagnosing the different edema diseases using the OCT-images are considered to be daunting challenge among the researchers. The implementation of computational intelligence techniques such as machine learning, deep learning, bio inspired algorithms and image processing techniques may help the doctors for some extent in improving the automatic extraction and diagnosis process consequently improving patients' life quality. But, these are liable to more errors and less performance, which requires further improvisation in designing the intelligent systems for an effective classification of edema diseases. In this context, this paper proposes the hybrid intelligent framework for the identification, segmentation and classification of three types of edemas such as using the retinal optical coherence tomography (OCT) Images. In this process, Single Feed Forward Training networks (SLFTN) are integrated with Convolutional Layers whose hyperparameters are tuned by using Lion Optimization algorithm. An intensive experimentation is carried out using the Kaggle Retinal OCT Image datasets-2020 with Tensor flow and the proposed framework is trained with the different set of 84,494 images in which performance metrics such as accuracy, sensitivity, specificity, recall and f1score are calculated. Results shows the proposed system has provided satisfactory performance, reaching the average highest accuracy of 99.9% in identifying and classifying the respectively. [ABSTRACT FROM AUTHOR]

Malicious software, or malware, has posed serious and evolving security threats to Internet users. Many anti-malware software packages and tools have been developed to protect legitimate users from these threats. However, legacy anti-malware methods are confronted with millions of potential malicious programs. To combat these threats, intelligent anti-malware systems utilizing machine learning (ML) models are useful. However, most ML models have limitations in performance since the training depth is usually limited. The emergence of Deep Learning (DL) models allow more training possibilities and improvement in performance. DL models often use gradient descent optimization, i.e., the Back-Propagation (BP) algorithm; therefore, their training and optimization procedures suffer from local sub-optimal solutions. In addition, DL-based malware detection methods often entail single classifiers. Ensemble learning overcomes the shortcomings of individual techniques by consolidating their strengths to improve the performance. In this paper, we propose an ensemble DL classifier stacked with the Fuzzy ARTMAP (FAM) model for malware detection. The stacked ensemble method uses several heterogeneous deep neural networks as the base learners. During the training and optimization process, these base learners adopt a hybrid BP and Particle Swarm Optimization algorithm to combine both local and global optimization capabilities for identifying optimal features and improving the classification performance. FAM is selected as a meta-learner to effectively train and combine the outputs of the base learners and achieve robust and accurate classification. A series of empirical studies with different benchmark data sets is conducted. The results ascertain that the proposed ensemble method is effective and efficient, outperforming many other compared methods. [ABSTRACT FROM AUTHOR]

As one of the main methods of information fusion, artificial intelligence class fusion algorithm not only inherits the powerful skills of artificial intelligence, but also inherits many advantages of information fusion. Similarly, as an important sub-field of artificial intelligence class fusion algorithm, deep learning class fusion algorithm also inherits advantages of deep learning and information fusion. Hence, deep learning fusion algorithm has become one of the research hotspots of many scholars. To solve the problem that the existing neural networks are input into multiple channels as a whole and cannot fully learn information of multichannel images, Shan et al. proposed multichannel concat-fusional convolutional neural networks. To mine more multichannel images' information and further explore the performance of different fusion types, the paper proposes new fusional neural networks called multichannel cross-fusion convolutional neural networks (McCfCNNs) with fusion types of "R+G+B/R+G+B/R+G+B" and "R+G/G+B/B+R" based on the tremendous strengths of information fusion. Experiments show that McCfCNNs obtain 0.07-6.09% relative performance improvement in comparison with their corresponding non-fusion convolutional neural networks (CNNs) on diverse datasets (such as CIFAR100, SVHN, CALTECH256, and IMAGENET) under a certain computational complexity. Hence, McCfCNNs with fusion types of "R+G+B/R+G+B/R+G+B" and "R+G/G+B/B+R" can learn more fully multichannel images' information, which provide a method and idea for processing multichannel information fusion, for example, remote sensing satellite images. [ABSTRACT FROM AUTHOR]

Recommender systems based on sentiment analysis become challenging due to the presence of enormous data available over the internet. With the lack of proper data cleaning and analysis methods, existing machine learning (ML) techniques fail to generate accurate recommendations. To overcome this issue, this paper proposes a Light Deep Learning (LightDL)-based recommender system that uses Twitter-based reviews. First, the data is collected from Twitter and cleaned by subsequent data cleaning processes. Then, this pre-processed data is fed into the LightDL model, which learns the important features like hashtags, unigrams, multigrams, etc. from each piece of data. Here, we have learned about four groups of features, including semantic features, syntactic features, symbolic features, and tweet-based features. Finally, the data is classified into positive, negative, and neutral categories according to the learned features. On the basis of classified sentiment, the review is generated to the users. Finally, the model is evaluated in terms of accuracy, precision, recall, f-measure, and error rate through extensive experiments in Matlab. The proposed LightDL model outperforms in all performance measures; specifically, it achieves 95% accuracy for the Twitter dataset. [ABSTRACT FROM AUTHOR]

This paper proposes that the task of single-image low-light enhancement can be accomplished by a straightforward method named Opt2Ada. It contains a series of pixel-level operations, including an optimized illuminance channel decomposition, an adaptive illumination enhancement, and an adaptive global scaling. Opt2Ada is traditional and it does not rely on architecture engineering, super-parameter tuning, or specific training dataset. Its parameters are generic and it has better generalization capability than existing data-driven methods. For evaluation, both the full-reference, non-reference, and semantic metrics are calculated. Extensive experiments on real-world low-light images demonstrate the superiority of Opt2Ada over recent traditional and deep learning algorithms. Due to its flexibility and effectiveness, Opt2Ada can be deployed as a pre-processing subroutine for high-level computer vision applications. [ABSTRACT FROM AUTHOR]

In today's big data era, there are a large number of unstructured information resources on the web. Natural language processing researchers have been working hard to figure out how to extract useful information from them. Entity Relation Extraction is a crucial step in Information Extraction and provides technical support for Knowledge Graphs, Intelligent Q&A systems and Intelligent Retrieval. In this paper, we present a comprehensive history of entity relation extraction and introduce the relation extraction methods based on Machine Mearning, the relation extraction methods based on Deep Learning and the relation extraction methods for open domains. Then we summarize the characteristics and representative results of each type of method and introduce the common datasets and evaluation systems for entity relation extraction. Finally, we summarize current entity relation extraction methods and look forward to future technologies. [ABSTRACT FROM AUTHOR]

Trend following strategies have a wide-ranging role in quantitative trading fields, which can capture important unilateral market trends for large gains, while this is vulnerable to losses in the period of consolidation. In this paper, we explored the trend trading system in the Chinese futures market based on machine learning techniques and statistical methods. This research utilized the Long-Short-Term Memory network to extract features of time series then predicted the price movements by Machine Learning classifiers. Moreover, based on rebar futures data, the results reveal that the annualized return improved from 6.39% to 15.68% after the trading signals generated in the trading strategy were filtered using the XGBoost model. Also, futures on gold and soybean were used to further test the integrated strategy and the results of the experiment show the effectiveness of the model in filtering false trading signals. [ABSTRACT FROM AUTHOR]

Social networks have accelerated the speed and scope of information dissemination. However, the lack of regulation and freedom of speech on social platforms has resulted in the widespread dissemination of the unverified message. Therefore, rapid and effective detection of social network rumors is essential to purify the network environment and maintain public security. Currently, the defects of rumor detection technology are that the detection time is too long and the timeliness is poor. In addition, the differences based on specific regions or specific fields will lead to deviations in the training dataset. In this paper, firstly, the definition of rumor is described, and the current problems and detection process of rumor detection are described; Secondly, introduce different data acquisition methods and analyze their advantages and disadvantages; Thirdly, according to the development of rumor detection technology, the existing rumor detection methods of artificial, machine learning and deep learning are analyzed and compared; Finally, the challenges of social network rumor detection technology are summarized. [ABSTRACT FROM AUTHOR]

For real-time applications, the performance in classifying the movements should be as high as possible, and the computational complexity should be low. This paper focuses on the classification of five upper arm movements which can be provided as a control for human-machine interface (HMI) based applications. The conventional machine learning algorithms are used for classification with both time and frequency domain features, and k-nearest neighbor (KNN) outplay others. To further improve the classification accuracy, pretrained CNN architectures are employed which leads to computational complexity and memory requirements. To overcome this, the deep convolutional neural network (CNN) model is introduced with three convolutional layers. To further improve the performance which is the key idea behind real-time applications, a hybrid CNN-KNN model is proposed. Even though the performance is high, the computation costs of the hybrid method are more. Minimum redundancy maximum relevance (mRMR), a feature selection method makes an effort to reduce feature dimensions. As a result, better performance is achieved by our proposed method CNN-KNN with mRMR which reduces computational complexity and memory requirement with a mean prediction accuracy of about 99.05±0.25% with 100 features. [ABSTRACT FROM AUTHOR]

The study examines various studies on Named Entity Recognition (NER) and Part of Speech (POS) tagging for the Urdu language conducted by academics and researchers. POS and NER tagging for Urdu still faces obstacles in terms of increasing accuracy while lowering false-positive rates and labelling unknown terms, despite the efforts of numerous researchers. In addition, ambiguity exists when tagging terms with different contextual meanings within a sentence. Due to the fact that Urdu is an inflectional, derivational, morphologically rich, and context-sensitive language, the existing models, such as Linguistic rule application, N-gram Markov model, Tree Tagger, random forest (RF) tagger, etc., were unable to produce accurate experimental results on Urdu language data. The significance of this study is that it fills a gap in the literature concerning the lack of POS and NER tagging for the Urdu language. For Urdu POS and NER tagging, we propose a deep learning model with a well-balanced set of language-independent features as well as a survey of important Urdu POS/NER techniques. In addition, this is the first study to use residual biDirectional residual Long short-term memory (residual biLSTM) architecture trained on the Urmono dataset in conjunction with the randomly initialised word2vec, fastText and mBERT embeddings are utilised to generate word or character vectors.For each experiment, the paper also employs the evaluation methods of Macro-F1, precision, precision, and recall. The proposed method with mbert embedding as word vectors provides best results of F1 score for POS and NER at 91.11% and 99.11% respectively. Also, the accuracy, precision and recall for POS are reported at 94.85%, 91.79% and 90.77%. Similarly, the accuracy, precision and recall for NER of the proposed model are reported at 99.77%, 98.78% and 99.45% respectively, which are higher than baseline models. [ABSTRACT FROM AUTHOR]

In this paper, we address the challenge of producing fully automated land cover estimates from satellite imagery through Deep Learning algorithms. We developed our system according to a tile-based, classify-and-count design. To implement the classification engine of the system, we adopted a cutting-edge Convolutional Neural Network model named Inception-V3, which we customized and trained for scene classification on the EuroSAT dataset. We tested and validated our system on two Sentinel-2 images representing quite different Italian territories (with an area of 751 km 2 and 443 km 2 , respectively). Because no genuine ground-truth is available for the land cover of these sub-regional territories, we built a pseudo ground-truth by integrating land cover information from flagship European projects CORINE and LUCAS. A critical and careful analysis shows that our automatic land cover estimates are in good agreement with the pseudo ground-truth and offers extensive evidence of the remarkable segmentation ability of our system. The limits of our approach are also critically discussed in the paper and possible countermeasures are illustrated. When compared with traditional projects like CORINE and LUCAS, our automatic land cover estimation system exhibits three fundamental advantages: it can dramatically reduce production costs; it can allow delivering very timely and frequent land cover statistics; it can enable land cover estimation for very small territorial areas, well beyond the NUTS-2 level. As an additional outcome of land cover estimation, our system also automatically generates moderate resolution land cover maps that might be used in cartography projects as an agile first-level tool for map update or change detection purposes. [ABSTRACT FROM AUTHOR]

COVID-19 is a contagious respiratory illness that can be passed from person to person. Because it affects the lungs, damages blood arteries, and causes cardiac problems, COVID-19 must be diagnosed quickly. The reverse transcriptase polymerase chain reaction (RT-PCR) is a method for detecting COVID-19, but it is time consuming and labor expensive, as well as putting the person collecting the sample in danger. As a result, clinicians prefer to use CT scan and Xray images. COVID-19 classification can be done manually, however AI makes the process go faster. AI approaches include image processing, machine learning, and deep learning. An AI model is required to diagnose COVID-19, and a dataset is necessary to train that model. A dataset consists of the information from which the model is trained. This paper consists of the review of different image processing, machine learning and deep learning papers proposed by different researchers. As well as models based on deep learning and pretrained model using gradient boosting algorithm The goal of this paper is to provide information for future researchers to work with. [ABSTRACT FROM AUTHOR]

Federated learning (FL) refers to a system in which a central aggregator coordinates the efforts of several clients to solve the issues of machine learning. This setting allows the training data to be dispersed in order to protect the privacy of each device. This paper provides an overview of federated learning systems, with a focus on healthcare. FL is reviewed in terms of its frameworks, architectures and applications. It is shown here that FL solves the preceding issues with a shared global deep learning (DL) model via a central aggregator server. Inspired by the rapid growth of FL research, this paper examines recent developments and provides a comprehensive list of unresolved issues. Several privacy methods including secure multiparty computation, homomorphic encryption, differential privacy and stochastic gradient descent are described in the context of FL. Moreover, a review is provided for different classes of FL such as horizontal and vertical FL and federated transfer learning. FL has applications in wireless communication, service recommendation, intelligent medical diagnosis system and healthcare, which we review in this paper. We also present a comprehensive review of existing FL challenges for example privacy protection, communication cost, systems heterogeneity, unreliable model upload, followed by future research directions. [ABSTRACT FROM AUTHOR]

Internet of Vehicles (IoV) presents a new generation of vehicular communications with limited computation offloading, energy and memory resources with 5G/6G technologies that have grown enormously and are being used in wide variety of Intelligent Transportation Systems (ITS). Due to the limited battery power in smart vehicles, the concept of energy consumption is one of the main and critical challenges of the IoV environments. Optimizing resource management strategies for improving the energy consumption using AI-based methods is one of important solutions in the IoV environments. There are various machine learning algorithms for selecting optimal solutions for energy-efficient resource management strategies. This paper presents the existing energy-aware resource management strategies for the IoV case studies, and performs a comparative analysis among their applied AI-based methods and machine learning algorithms. This analysis presents a technical and deeper understanding of the technical aspects of existing machine learning and AI-based algorithms that will be helpful in design of new hybrid AI approaches for optimizing resource management strategies with reducing their energy consumption. [ABSTRACT FROM AUTHOR]

The use of command and control (C2) servers in cyberattacks has risen considerably, attackers frequently employ the domain generated algorithm (DGA) technique to conceal their C2 servers. Various machine learning models have been suggested for binary identification of domain names as either benign or DGA domain. The Existing techniques are inefficient and have real-time detection issues and are also very data hypersensitive, therefore, they can be circumvented by the attackers. The main problem this article addresses is how to automatically detect DGA in a way that does not rely solely on reverse engineering, not strongly affected by data size, and allows detection of this DGA in real time. This paper presents DTFS-DGA model that combine neural networks models with traditional machine learning models and maintains its performance even if the data size changes to detect DGA in real time. The model uses 15 linguistics and networks features with the features extracted by long short-term memory and convolutional neural network to classify domain names using random forest and support vector machines. The comprehensive experimental findings confirm the suggested model's accuracy. To be precise, the model achieve an average accuracy of 99.8 % for the classification. [ABSTRACT FROM AUTHOR]

Diabetic Retinopathy (DR) is a disease that damages the retina of the human eye due to diabetic complications, resulting in a loss of vision. Blindness may be avoided If the DR disease is detected at an early stage. Unfortunately, DR is irreversible process, however, early detection and treatment of DR can significantly reduce the risk of vision loss. The manual diagnosis done by ophthalmologists on DR retina fundus images is time consuming, and error prone process. Nowadays, machine learning and deep learning have become one of the most effective approaches, which have even surpassed the human performance as well as performance of traditional image processing-based algorithms and other computer aided diagnosis systems in the analysis and classification of medical images. This paper addressed and evaluated the various recent state-of-the-art methodologies that have been used for detection and classification of Diabetic Retinopathy disease using machine learning and deep learning approaches in the past decade. Furthermore, this study also provides the authors observation and performance evaluation of available research using several parameters, such as accuracy, disease status, and sensitivity. Finally, we conclude with limitations, remedies, and future directions in DR detection. In addition, various challenging issues that need further study are also discussed. [ABSTRACT FROM AUTHOR]

Temporal knowledge base exists on various fields. Take medical medicine field as example, diabetes is a typical chronic disease which evolves slowly. This paper starts from actual EMR data of hospitals by combination of experience and knowledge of clinical doctors. Link prediction on clinical knowledge base such as diabetic complication requires the analysis on temporal characteristic of temporal knowledge base, which is a great challenge for traditional link prediction models. This paper proposes temporal knowledge graph link prediction model based on deep learning. This model selects the TransR transformation model suitable for big data and makes entity projection in relation space containing different semantic meanings, so as to vector the entities and complex semantic relations in graph. Then it adopts LSTM recursive neural network and adds the top-bottom relational information of the graph for sequential learning. Finally it constantly carries out deep learning through incremental calculation and LSTM recursive network to improve the accuracy of prediction. The incremental LSTM model highlights the hidden semantic and clinical temporal information and effectively utilizes sequential learning to mining forward-backward dependent information. It compensates the deficiency of lower prediction accuracy on timely knowledge graph caused by the traditional link prediction models. Finally, it is proved that the new model has better performance over temporal knowledge graph link prediction. [ABSTRACT FROM AUTHOR]

Temporal knowledge base exists on various fields. Take medical medicine field as example, diabetes is a typical chronic disease which evolves slowly. This paper starts from actual EMR data of hospitals by combination of experience and knowledge of clinical doctors. Link prediction on clinical knowledge base such as diabetic complication requires the analysis on temporal characteristic of temporal knowledge base, which is a great challenge for traditional link prediction models. This paper proposes temporal knowledge graph link prediction model based on deep learning. This model selects the TransR transformation model suitable for big data and makes entity projection in relation space containing different semantic meanings, so as to vector the entities and complex semantic relations in graph. Then it adopts LSTM recursive neural network and adds the top-bottom relational information of the graph for sequential learning. Finally it constantly carries out deep learning through incremental calculation and LSTM recursive network to improve the accuracy of prediction. The incremental LSTM model highlights the hidden semantic and clinical temporal information and effectively utilizes sequential learning to mining forward-backward dependent information. It compensates the deficiency of lower prediction accuracy on timely knowledge graph caused by the traditional link prediction models. Finally, it is proved that the new model has better performance over temporal knowledge graph link prediction. [ABSTRACT FROM AUTHOR]

Aiming at the inconsistency of manual detection of mobile phone screen defects, the image feature extraction of traditional machine learning is often set based on experience, resulting in unsatisfactory detection results. Therefore, a mobile phone screen defect detection model (Ghostbackbone) which is proposed by this paper based on YOLOv5 s and Ghostbottleneck. The bottleneck of Ghostbackbone mainly uses and improves the Ghostbottleneck of GhostNet. The attention module of Ghostbackbone uses Coordinated Attention and Depthwise Separable Convolution for parameter reduction. Finally, Ghostbackbone uses YOLOv5 as the object detector to train the mobile phone screen defect dataset. The experimental results show that the parameter quantity of Ghostbackbone is 24% of that of YOLOv5 s, the average time of detecting a single picture is only 2% lower than that of YOLOv5 s, and the mAP0.5 : 0.95 is 2% higher than that of MobilenetV3 s. [ABSTRACT FROM AUTHOR]

A drive-by download is a method of hackers planting the Web Trojan, which exploits browser vulnerabilities to execute malicious software. Because people usually access web pages with various browsers daily, drive-by downloads have become one of the most common threats in recent years. Most previous studies utilize the abstract syntax tree(AST) with deep learning methods to detect such attacks, which achieved high accuracy but are time-consuming and challenging to explain. Also, some methods use dynamic analysis, which needs a specific environment and is time-consuming with the complex operation. In order to solve these problems, the paper proposes DDIML, an explainable machine learning model based on novel features with static analysis. These features are extracted from five aspects: code obfuscation, URL redirection, special behaviors, encoding characters, and CSS attributes. The most popular machine learning algorithm, Random forest, is applied for building the classifier detection model. In addition, we use both local and global explanations to improve the model and prove that the proposed model could be trusted. The Experimental results show that our proposed model can efficiently detect drive-by downloads with a detection precision of 0.983 and a recall of 0.980. The average detection time for each sample is only 16.07ms in total. [ABSTRACT FROM AUTHOR]

Electrocardiogram (ECG) data recorded by medical devices are hard to analyze manually. Therefore, it is important to analyze and categorize each heartbeat using machine learning. Recently, advancements in machine learning have made classification of complex data easy and fast. However, these machine learning algorithms require sufficient amount of training data and have limited performance in case the data is imbalance. In case of MIT-BIH arrhythmia dataset, the distribution of training instances are quite imbalance. Many machine learning, particularly deep learning, algorithms give high accuracy on these datasets but still the minority classes have zero accuracy. In this paper, we improve the accuracy of minority classes without hurting the overall accuracy of other classes using transfer learning. The accuracy of existing deep learning model is increased from 90.67% to 98.47%, respectively. [ABSTRACT FROM AUTHOR]

Periapical Inflammation (PI) is one of the most popular diseases in adults due to complication of endodontitis or dental trauma with corresponding consequences to quality-of-life like tiredness and signs of infection. Specifically, patients having severe PI are often tiredness and high fever accompanied by signs of infection such as dry lips, dirty tongue, lymph node reaction in the area under the jaw. In X-Ray images, PI could be recognized by vague boundaries with signs of periapical ligament extensions. It is necessary to design a computerized diagnosis system based on the Deep Learning models for supporting clinicians in diagnosis of PI from X-Ray images. In this paper, we propose a new medical system called VNU for diagnosis of PI from X-Rays images. The VNU system uses Deep Learning to classify whether X-Ray images being PI or not. The Residual Neural Network (ResNet) with 34 layers is utilized with proper data augmentation and learning algorithms. The system is designed based on 7-layer enterprise architecture (User, Business, Application, Data, Technology, Infrastructure, and Security). It is used by both the clinicians and IT operators. The system has been validated on real data from Hanoi Medical University, Vietnam consisting of 900 images with PI and 500 normal images. Two scenarios of validation namely hyperparameter selection and performance comparison with other CNN-based Deep Learning models have been performed. It has been found from the experiments that the proposed system has better performance than the others in terms of sensitivity and specificity with the corresponding values of 96.70% and 93.87%. The system is deployed on the web interface that offers flexibility for clinicians in diagnosis and training. [ABSTRACT FROM AUTHOR]

Hyperspectral Image (HSI) is usually composed of hundreds of capturing wavelength bands, which not only increase the size of the HSI rapidly but also impose various obstacles in classifying the objects accurately. Moreover, the traditional machine learning schemes utilize only the spectral features for HSI classification, which, therefore, neglect the spatial features that have a significant impact on the classification improvement. To address the aforementioned issues, in this paper, we propose to employ the principal component analysis (PCA), the baseline feature extraction method, and a thoughtfully designed stacked autoencoder, a deep learning-based feature extraction approach, for reducing the high dimensionality of the HSI and then propose a novel lightweight 3D-2D convolutional neural network (CNN) framework to concurrently exploit both spatial and spectral features from the dimensionality-reduced HSI for classification. In particular, PCA and stacked autoencoder are applied to reduce the high dimensionality of the original HSI and then the proposed 3D-2D CNN provides a combination of 3D and 2D convolution operations to extract the subtle spatial and spectral features for efficient classification. We well-adjust the proposed 3D-2D CNN architecture, and perform extensive experiments on three benchmark HSI datasets and compare our approach with the state-of-the-art classical and deep learning methods. Experimental results illustrate that we have achieved an overall accuracy of 99.73%, 99.90%, and 99.32% on Indian Pines, Pavia University, and Kennedy Space Center datasets, respectively, which outperform the classical machine learning and independent 2D and 3D CNN-based state-of-the-art methods. [ABSTRACT FROM AUTHOR]

Structural models based on Attention can not only record the relationships between features' position, but also can measure the importance of different features based on their weights. By establishing dynamically weighted parameters for choosing relevant and irrelevant features, the key information can be strengthened, and the irrelevant information can be weakened. Therefore, the efficiency of Deep Learning algorithms can be significantly elevated and improved. Although Transformer have been performed very well in many fields including Reinforcement Learning (RL). We tried to integrate Transformers into RL, however there are some challenge in this task. Especially, MARL (known as Multi-Agent Reinforcement Learning), which can be recognized as a set of independent agents trying to adapt and learn through their way to reach the goal. In order to emphasize the relationship between each MDP decision in a certain time period, we applied the hierarchical coding method and validated the effectiveness of this method. This paper proposed a Hierarchical Transformer MADDPG based on recurrent neural network(RNN) which we call it Hierarchical RNNs-Based Transformers MADDPG(HRTMADDPG). It consists of a lower level encoder based on RNNs that encodes multiple step sizes in each time sequence, and it also consists of an upper sequence level encoder based on Transformer for learning the correlations between multiple sequences. Then we can capture the causal relationship between sub-time sequences and make HRTMADDPG more efficient. [ABSTRACT FROM AUTHOR]

Network attacks have become a major security concern for organizations worldwide. A category of network attacks that exploit the logic (security) flaws of a few widely-deployed authentication protocols has been commonly observed in recent years. Such logic-flaw-exploiting network attacks often do not have distinguishing signatures, and can thus easily evade the typical signature-based network intrusion detection systems. Recently, researchers have applied neural networks to detect network attacks with network logs. However, public network data sets have major drawbacks such as limited data sample variations and unbalanced data with respect to malicious and benign samples. In this paper, we present a new end-to-end approach based on protocol fuzzing to automatically generate high-quality network data, on which deep learning models can be trained for network attack detection. Our findings show that protocol fuzzing can generate data samples that cover real-world data, and deep learning models trained with fuzzed data can successfully detect the logic-flaw-exploiting network attacks. [ABSTRACT FROM AUTHOR]

Nowadays, early detecting and warning Advanced Persistent Threat (APT) attacks is a major challenge for intrusion monitoring and prevention systems. Current studies and proposals for APT attack detection often focus on combining machine-learning techniques and APT malware behavior analysis techniques based on network traffic. To improve the efficiency of APT attack detection, this paper proposes a new approach based on a combination of deep learning networks and ATTENTION networks. The proposed process for APT attack detection in this study is as follows: Firstly, all data of network traffic is pre-processed, and analyzed by the CNN-LSTM deep learning network, which is a combination of Convolutional Neural Network (CNN) and Long Short Term Memory (LSTM). Then, instead of being used directly for classification, this data is analyzed and evaluated by the ATTENTION network. Finally, the output data of the ATTENTION network is classified to identify APT attacks. The optimization proposal for detecting APT attacks in this study is a novel proposal. It hasn't been proposed and applied by any research. Some scenarios for comparing and evaluating the method proposed in this study with other approaches (implemented in section 4.4) show the superior effectiveness of our proposed approach. The results prove that the proposed method not only has scientific significance but also has practical significance because the model combining deep learning with ATTENTION network has helped improve the efficiency of analyzing and detecting APT malware based on network traffic. [ABSTRACT FROM AUTHOR]