Search

Most existing studies and public datasets for handwritten Chinese text recognition are based on the regular documents with clean and blank background, lacking research reports for handwritten text recognition on challenging areas such as educational documents and financial bills. In this paper, we focus on examination paper text recognition and construct a challenging dataset named examination paper text (SCUT-EPT) dataset, which contains 50 000 text line images (40 000 for training and 10 000 for testing) selected from the examination papers of 2 986 volunteers. The proposed SCUT-EPT dataset presents numerous novel challenges, including character erasure, text line supplement, character/phrase switching, noised background, nonuniform word size, and unbalanced text length. In our experiments, the current advanced text recognition methods, such as convolutional recurrent neural network (CRNN) exhibits poor performance on the proposed SCUT-EPT dataset, proving the challenge and significance of the dataset. Nevertheless, through visualizing and error analysis, we observe that humans can avoid vast majority of the error predictions, which reveal the limitations and drawbacks of the current methods for handwritten Chinese text recognition (HCTR). Finally, three popular sequence transcription methods, connectionist temporal classification (CTC), attention mechanism, and cascaded attention-CTC are investigated for HCTR problem. It is interesting to observe that although the attention mechanism has been proved to be very effective in English scene text recognition, its performance is far inferior to the CTC method in the case of HCTR with large-scale character set.

For current steganalysis of the image content-adaptive steganography, there are multiple problems to be improved, such as high difficulty and low accuracy, when detecting images with various contents and textures. For this problem, an improved steganalytic method is proposed in this paper based on the pre-classification and feature selection. First, using the features extracted based on the dependency analysis of image adjacent data, the images with various content and texture complexities are pre-classified as multiple clusters by the K-means algorithms. Then, the performance of existing various steganalytic features are analyzed for different clusters of images, and the optimal features for each cluster are selected for final classification. The experimental results show that the detection accuracy could be improved by the proposed method, and the rationality and availability are also verified. At the same time, the analysis and experimental results in this paper also show that the images with rich content and complex texture should be paid more attention both in steganography and in steganalysis.

A human-centric emotion estimation method based on correlation maximization with consideration of changes with time in visual attention and brain activity when viewing images is proposed in this paper. Owing to the recent developments of many kinds of biological sensors, many researchers have focused on multimodal emotion estimation using both eye gaze data and brain activity data for improving the quality of emotion estimation. In this paper, a novel method that focuses on the following two points is introduced. First, in order to reduce the burden on users, we obtain brain activity data from users only in the training phase by using a projection matrix calculated by canonical correlation analysis (CCA) between gaze-based visual features and brain activity-based features. Next, for considering the changes with time in both visual attention and brain activity, we obtain novel features based on CCA-based projection in each time unit. In order to include these two points, the proposed method analyzes a fourth-order gaze and image tensor for which modes are pixel location, color channel and the changes with time in visual attention. Moreover, in each time unit, the proposed method performs CCA between gaze-based visual features and brain activity-based features to realize human-centric emotion estimation with a high level of accuracy. Experimental results show that accurate human emotion estimation is achieved by using our new human-centric image representation.

The airway tree is one of the most important part in human respiratory system. Airway segmentation plays a crucial role in pulmonary disease diagnosis, localization and surgical navigation. We propose a novel method to improve airway segmentation in thoracic computed tomography(CT) using deep learning. In order to take into account the multi-scale changes of the airway and achieve accurate airway segmentation, we design an end-to-end Tiny Atrous Convolutional Network (TACNet) based on 3D convolution neural network. In view of the difficulty of classification due to the numerous branches of airway, two evaluation factors, namely, the angle of airway bifurcation and the buffer length of airway bifurcation are designed, which are used for airway classification by combining the centerline extraction. We train TACNet on the inspirator thoracic CT scans with ground truth, which are generated by clinicians and evaluate on our own clinical data sets and EXACT’09 data sets. Compared with state-of-the-art airway segmentation algorithms, proposed algorithm in this paper achieve very competitive results in 20 test datasets of the EXACT’09 challenge. The experimental results show that the algorithm proposed in this paper has high robustness and advantages regardless of airway segmentation or airway classification. In 20 test datasets of the EXACT’09 challenge, the average airway tree length detection rate is the best in the public literatures.

This paper tackles the problem of detecting incongruities between headlines and body text, where a news headline is irrelevant or even in opposition to the information in its body. Our model, called the graph-based hierarchical dual encoder (GHDE), utilizes a graph neural network to efficiently learn the content similarity between news headlines and long body paragraphs. This paper also releases a million-item-scale dataset of incongruity labels that can be used for training. The experimental results show that the proposed graph-based neural network model outperforms previous state-of-the-art models by a substantial margin (5.3%) on the area under the receiver operating characteristic (AUROC) curve. Real-world experiments on recent news articles confirm that the trained model successfully detects headline incongruities. We discuss the implications of these findings for combating infodemics and news fatigue.

An intrusion detection system (IDS) is an important protection instrument for detecting complex network attacks. Various machine learning (ML) or deep learning (DL) algorithms have been proposed for implementing anomaly-based IDS (AIDS). Our review of the AIDS literature identifies some issues in related work, including the randomness of the selected algorithms, parameters, and testing criteria, the application of old datasets, or shallow analyses and validation of the results. This paper comprehensively reviews previous studies on AIDS by using a set of criteria with different datasets and types of attacks to set benchmarking outcomes that can reveal the suitable AIDS algorithms, parameters, and testing criteria. Specifically, this paper applies 10 popular supervised and unsupervised ML algorithms for identifying effective and efficient ML-AIDS of networks and computers. These supervised ML algorithms include the artificial neural network (ANN), decision tree (DT), k-nearest neighbor (k-NN), naive Bayes (NB), random forest (RF), support vector machine (SVM), and convolutional neural network (CNN) algorithms, whereas the unsupervised ML algorithms include the expectation-maximization (EM), k-means, and self-organizing maps (SOM) algorithms. Several models of these algorithms are introduced, and the turning and training parameters of each algorithm are examined to achieve an optimal classifier evaluation. Unlike previous studies, this study evaluates the performance of AIDS by measuring the true positive and negative rates, accuracy, precision, recall, and F-Score of 31 ML-AIDS models. The training and testing time for ML-AIDS models are also considered in measuring their performance efficiency given that time complexity is an important factor in AIDSs. The ML-AIDS models are tested by using a recent and highly unbalanced multiclass CICIDS2017 dataset that involves real-world network attacks. In general, the k-NN-AIDS, DT-AIDS, and NB-AIDS models obtain the best results and show a greater capability in detecting web attacks compared with other models that demonstrate irregular and inferior results.

Deep convolutional neural networks (DCNNs) have attracted extensive attention in synthetic aperture radar (SAR) image target detection. However, there is usually a lack of labeled data in SAR images which results in difficulties to improve the detection performance with DCNN based methods. Transfer learning borrows generic knowledge from other tasks for the target task and can be an effective solution to the small sample problem, but the features’ generality and specificity across various models are not discussed in target detection. In addition, conventional DCNN based models have too many parameters related to the prior information of the targets which increase the difficulty of transfer learning between different tasks. In this paper, we mainly conduct research in three folds to address these mentioned issues. First, the generality and specificity of features in different network models are analyzed in the field of SAR target detection. Second, a transitive transfer framework is developed for detection under small sample condition. Third, an anchor free rotatable detector with flexible structure is designed for SAR images detection to suit the transfer detection framework proposed in this paper and a reasonable explanation is given for its upper hand with small samples. Experimental results demonstrate that: 1) transitive transfer framework is valid in SAR target detection; 2) the anchor free detector in this framework is superior to the anchor based one; 3) the proposed detector achieves better performance under small sample condition by comparison with state-of-the-art methods.

Near-infrared spectroscopy (NIR) has become one of the most important methods for counterfeit drugs identification for its low cost, non-destructive, and on-site detection. However, it is often invalid for unknown samples beyond the scope of modeling samples, as well as it is not efficient in conditions of insufficient samples (insufficient number of samples within the class), unbalanced samples (large difference in the number of samples between classes), and sensitivity of identification results (different tolerance for different errors in application scenarios). To solve these problems, this paper proposes a general method for on-site identification of counterfeit drugs based on Siamese-network modeling with near-infrared spectroscopy, which especially constructs the train set and test set, learning the general knowledge of spectral differences to identify the different drugs by a costumed one-dimensional convolution neural network (1D-CNN), and finally answered the question of whether the on-site two spectra are pointed to the same drug. Based on experimental modeling samples of 1314 spectra, which are involved 9 drugs produced by 25 manufacturers, this paper has constructed and fully trained its model. Then, not known at the time of modeling, 4 drugs produced by 9 manufacturers are used for testing in the on-site application, and the accuracy rate amounts to 97.3%. For generalizing consideration, randomly divided into training and testing categories, the 32015 spectra of 135 drugs produced by 391 manufacturers in the spectral library are handled by the same processing. The generalization model is equally applicable, and the accuracy is above 97%. Compared with traditional binary classification identification methods such as SVM, PLS-DA, Auto-encoding, and one class (OC) threshold identification algorithms such as SVM-OC, SIMCA, conformity test (CT), the proposed method has the best identification ability for unknown samples in modeling.

Handwritten mathematical expressions are an essential part of many domains, including education, engineering, and science. The pervasive availability of computationally powerful touch-screen devices, similar to the recent emergence of deep neural networks as high-quality sequence recognition models, result in the widespread adoption of online recognition of handwritten mathematical expressions. Also, a deeper study and improvement of such technologies is necessary to address the current challenges posed by the extensive usage of distance learning, and remote work due to the world pandemic. This paper delineates the state-of-the-art recognition methods along with the user's experience in pen-centric applications for operating with handwritten mathematical expressions. Recognition methods have been categorized into classes, with a description of their merits and limitations. Particular attention is paid to end-to-end approaches based on encoder-decoder architecture and multi-modal input. Evaluation protocols and open benchmark datasets are considered as well as the comparison of the recognition performance, based on open competition results. The use of handwritten math recognition is illustrated by examples of applications for various fields and platforms. A distinctive part of the survey is that we also considered how UI design relies on the use of different recognition approaches, which is aimed at helping potential researchers improve the performance of the introduced approaches toward the best responses in practical applications. Finally, this paper presents the prospective survey of future research directions in handwritten mathematical expression recognition and their applications.

We address the problem of depth estimation from a single monocular image in the paper. Depth estimation from a single image is an ill-posed and inherently ambiguous problem. In the paper, we propose an encoder-decoder structure with the feature pyramid to predict the depth map from a single RGB image. More specifically, the feature pyramid is used to detect objects of different scales in the image. The encoder structure aims to extract the most representative information from the original image through a series of convolution operations and to reduce the resolution of the input image. We adopt Res2-50 as the encoder to extract important features. The decoder section uses a novel upsampling structure to improve the output resolution. Then, we also propose a novel loss function that adds gradient loss and surface normal loss to the depth loss, which can predict not only the global depth but also the depth of fuzzy edges and small objects. Additionally, we use Adam as our optimization function to optimize our network and speed up convergence. Our extensive experimental evaluation proves the efficiency and effectiveness of the method, which is competitive with previous methods on the Make3D dataset and outperforms state-of-the-art methods on the NYU Depth v2 dataset.

The Internet of Things is based on a communication network to automatically receive various information from the natural world. It uses intelligent objects with perception, communication and computers to automatically receive various information from nature. All independently managed physical objects are connected to each other to achieve integrated perception, reliable transmission and intelligent processing, and to establish intelligent information between people and objects, and objects and object service systems. This article mainly introduces the impact of industrial agglomeration on the regional economy in a simulated intelligent environment based on machine learning. This paper proposes a method to detect industrial agglomeration index to analyze industrial agglomeration. Through the establishment of the industrial agglomeration index system, the level of integration of the manufacturing industry in our city was objectively analyzed, and the impact of the integration of manufacturing industry on our city was tested empirically. Finally, the relationship between industrial integration and regional economic development was tested. The experimental results in this paper show that industrial integration in a smart environment based on simulation learning has a significant positive impact on regional economic development. Among them, the level of cooperation between the manufacturing service industry and the manufacturing industry increased by 1%, and the level of regional economic development increased by 0.025%.

The attention-based SeriesNet (A-SeriesNet) combined augmented attention residual learning module-based convolutional neural network (augmented ARLM-CNN) subnetwork with hidden state attention module-based recurrent neural network (HSAM-RNN) subnetwork for conditional time series prediction with high accuracy. The augmented ARLM-CNN subnetwork has defects in extracting latent features of the multi-condition series. The forecasting accuracy will decrease when the feature dimension of the multi-condition series becomes high. The same problem also occurs in the HSAM-RNN subnetwork of A-SeriesNet. The dual-stage attention recurrent neural network (DA-RNN) proved that the attention-based encoder-decoder framework is an effective model for dealing with the above problem. This paper applies the DA-RNN to the HSAM-RNN subnetwork of A-SeriesNet and presents the triple-stage attention-based recurrent neural network (TA-RNN) subnetworks. Furthermore, this paper considers a CNN-based encoder-decoder structure named dual attention residual learning module-based convolutional neural network (DARLM-CNN) subnetwork to improve the augmented ARLM-CNN subnetwork of A-SeriesNet. Finally, this paper presents the triple-stage attention-based SeriesNet (TA-SeriesNet), which uses a new concatenation method instead of the element-wise multiplication of A-SeriesNet to parallel connect the proposed subnetworks and reduce the dependence of forecasting results on a certain subnetwork. The experimental results show our TA-SeriesNet is superior to other deep learning models in forecasting accuracy evaluation metrics for high feature dimensional time series datasets.

Technology forecasting not only helps business managers to make the right decisions but also helps researchers to grasp the direction of technology development. Technology forecasting, which facilitates the identification of the development technologies with high potential, can be an effective tool to support the management and plan for the future research activities. For this purpose, this paper firstly constructs Multi-modal input based on deep learning (MIDL) text classification model to extract relevant SCI papers from Web of Science database from 1996 to 2019 for topic classification, and then apply the Ensemble Empirical Mode Decomposition (EEMD) and Long Short-Term Memory (LSTM) neural networks to build an EEMD-LSTM technology forecasting model to predict the future development of each research field. Besides, we verify the validity of the method by taking robotics as an example in this paper. The results show that the accuracy, recall and F1 of MIDL text classification model are 0.826, 0.822 and 0.824 respectively. As compared with the optimal results of other classification models, the accuracy, recall and F1 are improved by 4.1%, 3.5%, and 3.8% respectively. The mean MAPE of the EEMD-LSTM model is 7%, which is 11% lower than ARIMA, 8% lower than LSTM, and 10% lower than 2-layer-LSTM.

This paper discusses impact of recovering missing Electroencephalography (EEG) data on classification accuracy of hand movements using tensor-based methods. Improvement in classification accuracy is important for efficient performance of prosthesis. Classification accuracy relies on quality of the observed data. In practice, observed data is usually incomplete because of disconnection of electrodes and other artefacts, which negatively affect the classification accuracy. In this paper, we employ tensor-based imputation methods (canonical/polyadiac decomposition (CPD), weighted optimization version of CPD (CP-WOPT and Nonnegative Matrix Factorization (NMF)) to recover missing data in EEG signals and apply various classifiers to classify hand movements on recovered data. In particular, structured missing data was considered because that is how data gets missed in real-life data acquisition. Percentage of missing data was changed from 10% to 50%. Classifiers are applied on complete, missing and recovered data explicitly to test the performance of our framework. Results show that mean classification accuracy on complete data, missing data and recovered data was 71%, 53% and 64% respectively which shows applicability of our framework.

In recent years, a variety of supervised manifold learning techniques have been proposed to outperform their unsupervised alternative versions in terms of classification accuracy and data structure capturing. Some dissimilarity measures have been used in these techniques to guide the dimensionality reduction process. Their good performance was empirically demonstrated; however, the relevant analysis is still missing. This paper contributes to a theoretical analysis on a) how dissimilarity measures affect maintaining manifold neighbourhood structure and b) how supervised manifold learning techniques could contribute to the reduction of classification error. This paper also provides a cross-comparison between supervised and unsupervised manifold learning approaches in terms of structure capturing using Kendall’s Tau coefficients and co-ranking matrices. Four different metrics (including three dissimilarity measures and Euclidean distance) have been considered along with manifold learning methods such as Isomap, ${t}$ -Stochastic Neighbour Embedding ( ${t}$ -SNE), and Laplacian Eigenmaps (LE), in two datasets: Breast Cancer and Swiss-Roll. This paper concludes that although the dissimilarity measures used in the manifold learning techniques can reduce classification error, they do not learn well or preserve the structure of the hidden manifold in the high dimensional space, but instead, they destroy the structure of the data. Based on the findings of this paper, it is advisable to use supervised manifold learning techniques as a pre-processing step in classification. In addition, it is not advisable to apply supervised manifold learning for visualization purposes since the two-dimensional representation using supervised manifold learning does not improve the preservation of data structure.

It is expected that peer to peer energy trading will constitute a significant share of research in upcoming generation power systems due to the rising demand of energy in smart microgrids. However, the on-demand use of energy is considered a big challenge to achieve the optimal cost for households. This paper proposes a blockchain-based predictive energy trading platform to provide real-time support, day-ahead controlling, and generation scheduling of distributed energy resources. The proposed blockchain-based platform consists of two modules; blockchain-based energy trading and smart contract enabled predictive analytics modules. The blockchain module allows peers with real-time energy consumption monitoring, easy energy trading control, reward model, and unchangeable energy trading transaction logs. The smart contract enabled predictive analytics module aims to build a prediction model based on historical energy consumption data to predict short-term energy consumption. This paper uses real energy consumption data acquired from the Jeju province energy department, the Republic of Korea. This study aims to achieve optimal power flow and energy crowdsourcing, supporting energy trading among the consumer and prosumer. Energy trading is based on day-ahead, real-time control, and scheduling of distributed energy resources to meet the smart grid’s load demand. Moreover, we use data mining techniques to perform time-series analysis to extract and analyze underlying patterns from the historical energy consumption data. The time-series analysis supports energy management to devise better future decisions to plan and manage energy resources effectively. To evaluate the proposed predictive model’s performance, we have used several statistical measures, such as mean square error and root mean square error on various machine learning models, namely recurrent neural networks and alike. Moreover, we also evaluate the blockchain platform’s effectiveness through hyperledger calliper in terms of latency, throughput, and resource utilization. Based on the experimental results, the proposed model is effectively used for energy crowdsourcing between the prosumer and consumer to attain service quality.

The epidemic increase in online reviews’ growth made the sentiment classification a fascinating domain in academic and industrial research. The reviews assist several domains, which is complicated to gather annotated training data. Several sentiment classification methodologies are devised for performing the sentiment analysis, but retrieval of information is not accurately performed, less effective, and less convergence speed. In this paper, we propose a sentiment paper proposes a sentiment classification model, namely Spider Monkey Crow Optimization algorithm (SMCA), for training the deep recurrent neural network (DeepRNN). In this method, the telecom review is employed to remove stop words and stemming to eliminate inappropriate data to minimize user’s seeking time. Meanwhile, the feature extraction is performed using SentiWordNet to derive the sentiments from the reviews. The extracted SentiWordNet features and other features, like elongated words, punctuation, hashtag, and numerical values, are employed in the DeepRNN for classifying sentiments. To retrieve the required review, the Fuzzy K-Nearest neighbor (Fuzzy-KNN) is employed to retrieve the review based on a distance measure. With rigorous assessments and experimentation, it is observed that the proposed SMCA-based DeepRNN performs better in terms of accuracy of 97.7%, precision of 95.5%, recall of 94.6%, and F1-score 96.7%, respectively.

Hyperspectral and multispectral information processing systems and technologies have demonstrated its usefulness for the improvement of agricultural productivity and practices by providing useful information to farmers and crop managers on the factors affecting crop status and growth. These technologies are widely used in a range of agriculture applications such as crop management, crop yield forecasting, crop disease detection, and the monitoring of agriculture land usage, water, and soil conditions. Hyperspectral information sensing can acquire several hundred spectral bands that cover the electromagnetic spectrum of an observational scene in a single acquisition. The resulting hyperspectral data cube contains a large volume of spatial and spectral information. The hyperspectral sequence of images or video further increases the data generation velocity and volume which lead to the Big data challenges particularly in agricultural remote sensing applications. This paper is structured to first give a comprehensive review of representative studies to provide insights into significant research efforts in agriculture using Big data, machine learning and deep learning with the focus on frameworks or architectures, information processing and analytics with hyperspectral and multispectral data. The potential for utilizing Big data, machine learning and deep learning for hyperspectral and multispectral data in agriculture is very promising. The paper then further explores the potential of using ensemble machine learning and scalable parallel discriminant analysis which takes into consideration the spatial and spectral components for Big data in agriculture. To the best of our knowledge, no similar review study on agriculture with Big data, machine learning and deep learning for hyperspectral and multispectral information processing has been reported. Furthermore, the potential of ensemble machine learning and scalable parallel discriminant analysis has not been explored in agriculture information processing. Experiments and data analytics have been performed on hyperspectral data from agriculture for validation. The results have shown the good performance of our approach.

Dyslexia is a neurological disorder that is characterized by imprecise comprehension of words and generally poor reading performance. It affects a significant population of school-age children, with more occurrences in males, thus, putting them at risk of poor academic performance and low self-esteem for a lifetime. The long-term hope is to have a dyslexia diagnostic method that is informed by neural-biomarkers. In this regard, large numbers of machine learning methods and, more recently, deep learning methods have been implemented across various types of dataset with the above-chance classification accuracy. However, attainment of clinical acceptability of these state-of-the-art methods is bedeviled by certain challenges including lack of biologically-interpretable biomarkers, privacy of dataset and classifiers, hyper-parameter selection/optimization, and overfitting problem among others. This review paper critically analyzes recent machine learning methods for detecting dyslexia and its biomarkers and discusses challenges that require proper attentions from the users of deep learning methods in order to enable them to attain clinically relevance and acceptable level. The review is conducted within the premise of implementation and experimental outcomes for each of the 22 selected articles using the Preferred Reporting Items for Systematic review and Meta-Analyses (PRISMA) protocol, with a view to outlining some critical challenges for achieving high accuracy and reliability of the state-of-the-art machine learning methods. As an evidence-based protocol for reporting in systematic reviews and meta-analyses, PRISMA helps to ensure clarity and transparency of this paper by showing a four-phase flow diagram of the selection process for articles used in this review. It is therefore, envisaged that higher classification performance of clinical relevance can be achieved using deep learning models for dyslexia and its biomarkers by addressing identified potential challenges.

Several hypovigilance detection systems (HDx) were developed to avoid road-side accidents due to driver fatigue. They have suffered from several limitations. Notably many of these are focused on center-head position to define an area of interest (often referred to as PERCLOS (percentage eye closure)) without considering the face occlusion problem, light illumination, and suffer poor response time. These HDx systems mostly depend on image processing, vision-based, and multisensor-based features. To address these problems, the author utilized vision, sensors, environmental, and vehicular-based features that integrated together by fusion to predict multistage of HDx. Lately, few studies have utilized the combination of multimodal features and deep learning (DL) architectures. Those multimodal-based features (M-HDx) were feasible to predict stages of driver fatigue (multi-stage). However, there is a need to critically measure the performance of these M-HDx by carrying out a comparative analysis to recognize multi-stage of fatigue in terms of hardware-based benchmarks. Moreover, it is important to evaluate the M-HDx systems using different features-set with respect to traditional and advanced machine learning techniques. Therefore, the primary aim of this work is in algorithm and feature modeling, then compare the advantages and differences with other work. In this paper, a different study is conducted compare to state-of-the-art survey articles by statistically measuring the performance. After experiments on M-HDx systems, this paper concludes that there is still a research gap to real-time development of multistage M-HDx systems. In the end, the paper summarizes the directions, challenges, and applications in the development of HDx systems to assist other researchers for further research.

The sixth generation (6G) wireless communication network presents itself as a promising technique that can be utilized to provide a fully data-driven network evaluating and optimizing the end-to-end behavior and big volumes of a real-time network within a data rate of Tb/s. In addition, 6G adopts an average of 1000+ massive number of connections per person in one decade (2030 virtually instantaneously). The data-driven network is a novel service paradigm that offers a new application for the future of 6G wireless communication and network architecture. It enables ultra-reliable and low latency communication (URLLC) enhancing information transmission up to around 1 Tb/s data rate while achieving a 0.1 millisecond transmission latency. The main limitation of this technique is the computational power available for distributing with big data and greatly designed artificial neural networks. The work carried out in this paper aims to highlight improvements to the multi-level architecture by enabling artificial intelligence (AI) in URLLC providing a new technique in designing wireless networks. This is done through the application of learning, predicting, and decision-making to manage the stream of individuals trained by big data. The secondary aim of this research paper is to improve a multi-level architecture. This enables user level for device intelligence, cell level for edge intelligence, and cloud intelligence for URLLC. The improvement mainly depends on using the training process in unsupervised learning by developing data-driven resource management. In addition, improving a multi-level architecture for URLLC through deep learning (DL) would facilitate the creation of a data-driven AI system, 6G networks for intelligent devices, and technologies based on an effective learning capability. These investigational problems are essential in addressing the requirements in the creation of future smart networks. Moreover, this work provides further ideas on several research gaps between DL and 6G that are up-to-date unknown.

Big Data (BD), Machine Learning (ML) and Internet of Things (IoT) are expected to have a large impact on Smart Farming and involve the whole supply chain, particularly for rice production. The increasing amount and variety of data captured and obtained by these emerging technologies in IoT offer the rice smart farming strategy new abilities to predict changes and identify opportunities. The quality of data collected from sensors greatly influences the performance of the modelling processes using ML algorithms. These three elements (e.g., BD, ML and IoT) have been used tremendously to improve all areas of rice production processes in agriculture, which transform traditional rice farming practices into a new era of rice smart farming or rice precision agriculture. In this paper, we perform a survey of the latest research on intelligent data processing technology applied in agriculture, particularly in rice production. We describe the data captured and elaborate role of machine learning algorithms in paddy rice smart agriculture, by analyzing the applications of machine learning in various scenarios, smart irrigation for paddy rice, predicting paddy rice yield estimation, monitoring paddy rice growth, monitoring paddy rice disease, assessing quality of paddy rice and paddy rice sample classification. This paper also presents a framework that maps the activities defined in rice smart farming, data used in data modelling and machine learning algorithms used for each activity defined in the production and post-production phases of paddy rice. Based on the proposed mapping framework, our conclusion is that an efficient and effective integration of all these three technologies is very crucial that transform traditional rice cultivation practices into a new perspective of intelligence in rice precision agriculture. Finally, this paper also summarizes all the challenges and technological trends towards the exploitation of multiple sources in the era of big data in agriculture.

Terrain generation aims to automatize the procedure of creating landscapes using a computer system. The generation models must follow different terrains’ topographical features, such as areas with river deltas and other regions where water bodies affect the natural landscapes. It is possible to generate more realistic terrains thanks to improvements in computer graphics techniques and deep learning models that use specific hardware. However, the advance on the generation of terrains that include river deltas, fjords, and waterfalls has not had the same pace as other more studied landscapes. Therefore, as a contribution to the advance of the research of terrain generation with water bodies using generative models, this paper presents the DRCA2020 dataset, which is useful for supervised training. The proposed dataset contains eight different types of real-world satellite images. These images are grouped by the same geographical location. There are 13,184 groups; each one has three RGB surface images, a water coverage map, three binarizations of water coverage, and a digital elevation model (DEM). Additionally, this paper proposes the use of a cGAN composite model, trained with the DRCA2020 dataset, for generating synthetic DEMs from water coverage images and therefore, to create realistic surface texture images with promising validation results.

Facility Layout Problems (FLP) are concerned with finding efficient factory layouts. Numerous resolution approaches are known in literature for layout optimization. Among those, intelligent approaches are less researched than solutions from exact or approximating approaches. The recent surge of research interest in Artificial Intelligence, and specifically Machine Learning (ML) techniques, presages an increase of such techniques' usage in FLP. However, previous reviews on FLP research induce that, to date, this trend has not yet emerged. Utilizing a systematic literature review coupled with a k-Means based clustering algorithm, we analyzed 25 relevant publication full-texts from an original sample of 1,425 papers. Our findings corroborate the statement that ML techniques have attracted substantially less research interest than most other resolution approaches. While a few papers used Unsupervised Learning algorithms directly as a solution to the FLP, Supervised and Reinforcement Learning were found to be practically irrelevant. ML usage was significantly higher in FLP-adjacent planning tasks such as group technology. Drawing from experiences with other NP-hard combinatorial optimization problems in manufacturing research, we conclude that Reinforcement Learning is most promising to bridge the evident gap between FLP and ML research. Our study further contributes to FLP research by extending established classification frameworks.

Unsupervised person re-identification (re-id) is an effective analysis for video surveillance in practice, which can train a pedestrian matching model without any annotations, and it is easy to deploy in unseen camera scenarios. The most challenging problem in unsupervised re-id task is the huge distribution-gap among different camera views, and the intrinsic correlations in unlabeled identities are also complicated to sufficiently explored. This paper proposes a Multi-order Cross-view Graph adversarial Network (MCGN) to bridge the cross-view distribution-gap, and mine the inherent discriminative information by multi-order triplet correlations. Specifically, MCGN firstly exploits graph representations by a cross-view graph convolutional network according to intra-view and inter-view graph structure, and then encodes each pedestrian image into a view-shared feature space, which is iteratively trained by a graph generative adversarial learning strategy to deeply bridge the distribution-gap. Finally, this paper proposes a multi-order discriminative learning module for composing reasonable triplet samples according to multi-order similarity correlations among unlabeled pedestrian images. Furthermore, sufficient experiments are conducted in two large scale person re-id datasets (Market-1501 and DukeMTMC-reID). The comparison to state-of-the-art methods and ablation study demonstrate the superiority of MCGN and the contribution of each module proposed in this paper.

Pitting corrosion of rotating machinery is one of the most common faults in industrial engineering. The convolutional neural network (CNN) is increasingly applied to the fault diagnosis. However, the conventional CNN method will reduce the feature dimension of the collected signal and cause the loss of information during the pooling process. In this paper, a new method based on dilated CNN combined with spatial dropout (DCSD) is proposed to diagnose the early faults of rotating machinery. By filling the convolution kernel, the DCSD method can increase the receptive field of the CNN without increasing the number of parameters while retaining more features of the raw vibration signal of the rotating machine. To avoid the dropout method eliminates the adjacent elements with a strong correlation, the Spatial Dropout method is adopted to reduce the overfitting problem of deep networks. The early pitting gears experiment was designed to verify the DCSD method in this paper. The raw vibration signal data of 6 different healthy states were collected to verify the effectiveness of the method. The experimental results show that the DCSD method proposed can effectively distinguish the different early gears pitting, and the diagnostic accuracy is better than other popular deep learning methods.

Wind speed fluctuations and load demand variations represent the big challenges against wind energy conversion systems (WECS). Besides, the inefficient measuring devices and the environmental impacts (e.g. temperature, humidity, and noise signals) affect the system equipment, leading to increased system uncertainty issues. In addition, the time delay due to the communication channels can make a gap between the transmitted control signal and the WECS that causes instability for the WECS operation. To tackle these issues, this paper proposes an adaptive neuro-fuzzy inference system (ANFIS) as an effective control technique for blade pitch control of the WECS instead of the conventional controllers. However, the ANFIS requires a suitable dataset for training and testing to adjust its membership functions in order to provide effective performance. In this regard, this paper also suggests an effective strategy to prepare a sufficient dataset for training and testing of the ANFIS controller. Specifically, a new optimization algorithm named the mayfly optimization algorithm (MOA) is developed to find the optimal parameters of the proportional integral derivative (PID) controller to find the optimal dataset for training and testing of the ANFIS controller. To demonstrate the advantages of the proposed technique, it is compared with different three algorithms in the literature. Another contribution is that a new time-domain named figure of demerit is established to confirm the minimization of settling time and the maximum overshoot in a simultaneous manner. A lot of test scenarios are performed to confirm the effectiveness and robustness of the proposed ANFIS based technique. The robustness of the proposed method is verified based on the frequency domain conditions that are driven from Hermite–Biehler theorem. The results emphases that the proposed controller provides superior performance against the wind speed fluctuations, load demand variations, system parameters uncertainties, and the time delay of the communication channels.

The standardization and digitalization of nine constitutions of traditional Chinese medicine (TCM) have promoted the development of TCM automation. The keys to constitution identification are tongue diagnosis and consultation diagnosis. In this paper, a tongue detection method based on the combination of the histogram of oriented gradients (HOG) and the support vector machine (SVM) is proposed. To separate the tongue body and tongue coating, a k-means segmentation method based on the Lab color space is proposed. Based on the clustering analysis of the difference between the color components of the tongue body and tongue coating in the Lab color space, the separation is realized. Thus, the relationship between the tongue image and constitution can be analyzed. The method for consultation diagnosis is divided into a questionnaire scale and a question answering system. The questionnaire includes 29 quantified items with corresponding weights and answer scores, so the final score of each type of constitution is calculated. The final constitution type is determined on the basis of the scores of both diagnoses. In addition, the key of question answering system is text similarity calculation. First, a sentence similarity calculation method combining the n-gram language model and word2vec is proposed. Then, a multifeature fusion sentence similarity calculation method combining the Word Mover’s Distance (WMD) and editing distance is proposed. Finally, the experimental results show the effectiveness of the proposed method, and a constitution identification application is developed based on the content of this paper.

Surveillance cameras are everywhere, keeping an eye on pedestrians as they navigate through a scene. With this context, our paper addresses the problem of pedestrian attribute recognition (PAR). This problem entails recognizing attributes such as age-group, clothing style, accessories, footwear style etc. This is a multi-label problem and challenging even for human observers. The problem has rightly attracted attention recently from the computer vision community. In this paper, we adopt trainable Gabor wavelets (TGW) layers and use it with a convolution neural network (CNN). Whereas other researchers are using fixed Gabor filters with the CNN, the proposed layers are learnable and adapt to the dataset for a better recognition. We propose a multi-branch neural network where mixed-layers, a combination of the TGW and convolutional layer, make up the building block of our 3-branch deep neural network. We test our method on publicly available challenging datasets and compare our results with state of the art.

Aero-turbines usually work in various non-stationary and harsh operating environments. Its blades easily appear early crack faults in long-time operation, and it is difficult to dig out discriminant features of early crack. To solve these problems, in the paper, a novel intelligent approach for early crack diagnosis of turbine blades using three-dimensional blade tip clearance is presented. In order to improve feature learning ability to obtain better generalization ability, the paper firstly develops a novel deep learning method based on deep belief networks (DBNs). Considering the fact that the feature degradation easily occurs in deeper layers because of the change of the distribution in each layer's outputs with the increase of the layers, it is hard to decide which layer to learn features is useful for fault diagnosis. Accordingly, in the pre-training process, the global back-reconstruction (GBR) mechanism is introduced into DBNs to optimize the feature learning ability. The GBR mechanism can be realized between the input layer and hidden layers by “shortcut connection”, and the layer to learn more discriminant features can be determined automatically without prior knowledge. Moreover, due to three-dimensional blade tip clearance (3-DBTC) acquired from three different directions of turbine blades contains much more useful crack failure multiscale information, it is suitable to be used as an input from which to extract multiscale discriminant features. Eventually, in the supervised training, the softmax regression model is employed to classify the health conditions of turbine blades using these sensitive features learned from 3-DBTC. The experimental results show that the proposed method can effectively identify the crack of turbine blades with fairly high diagnostic accuracies and significantly outperform other methods considered in the paper.

Camera localization is an essential technique in many applications, such as robot navigation, mixed reality, and unmanned vehicle. We are committed to solving the problem of predicting the 6-DoF pose of cameras from a single color image in a given three-Dimensional (3D) environment. In this paper, we proposed a robust learning model for it. Basically, our proposed methodology consists of two steps: image retrieval and space reprojection. The former is in charge of simultaneous localization and mapping based on pre-captured reference images that rely on the correspondence between pixel points and scene coordinates; whereas the latter carries out camera calibration between the 2D image plane and the 3D scene. Given a two-Dimensional (2D) image, the initial localization is accomplished rapidly by matching a reference image using Siamese networks. More precise localization is achieved by camera calibration between the 2D image and the 3D scene using a fully convolutional network. The experimental results on the public dataset show that our model is more robust and expandable than the previous methods. At the end of this paper, we also apply the system to Unmanned Aerial Vehicle (UAV) localization and achieve good results.

Due to the proliferation of the Internet of Things (IoT), the IoT devices are becoming utilized at the edge network at a much higher rate. Conventionally, the IoT devices lack the computation resources required for carrying out ultra-edge analytics. In this paper, we go beyond the typical edge analytics paradigm, which is mostly limited to user-smartphones, and investigate how to embed intelligence into the ultra-edge IoT sensors. To conceptualize the smart IoT sensors with enhanced intelligence, we select the arrhythmia detection task employing Electrocardiogram (ECG) trace as one of the mobile health (mHealth) cases. The existing approaches are not feasible for ultra-edge IoT sensors due to the extensive noise-filtering and manual feature extraction phase. Hence, in this paper, to facilitate the analytics, we propose a Deep Learning-based Lightweight Arrhythmia Classification (DL-LAC) method, which employs only single-lead ECG trace and does not require noise-filtering and manual feature extraction steps. As the proposed technique, we design a one-dimensional Convolutional Neural Network (CNN) architecture. Complying with the ANSI/AAMI EC57:1998 standard, four heartbeat types are taken into consideration as class labels. The efficiency and the generalization ability of the proposed model are evaluated, employing four different datasets from PhysioNet. The experimental results demonstrate that the proposed DL method outperforms traditional methods such as the Delay Differential Equation (DDE)-based optimization, K-Nearest Neighbor (KNN), and Random Forest (RF). The proposed DL-LAC illustrates encouraging performance in terms of time and memory requirement when the trained model is transferred to virtualized microcontrollers connected to IoT sensors.

The application of Artificial Intelligence (AI) to financial investment is a research area that has attracted extensive research attention since the 1990s, when there was an accelerated technological development and popularization of the personal computer. Since then, countless approaches have been proposed to deal with the problem of price prediction in the stock market. This paper presents a systematic review of the literature on Artificial Intelligence applied to investments in the stock market based on a sample of 2326 papers from the Scopus website between 1995 and 2019. These papers were divided into four categories: portfolio optimization, stock market prediction using AI, financial sentiment analysis, and combinations involving two or more approaches. For each category, the initial introductory research to its state-of-the-art applications are described. In addition, an overview of the review leads to the conclusion that this research area is gaining continuous attention and the literature is becoming increasingly specific and thorough.

Traditional optical fiber vibration signal (OFVS) recognition research focuses on signal endpoint detection and feature extraction. These two aspects directly determine the success of OFVS recognition. The traditional method relies on artificially designed features and has a strong pertinence to the classification target, resulting in poor stability and flexibility. In response to the above problems, this paper combines the traditional OFVS recognition ideas (time-frequency analysis and feature extraction) and the characteristics of deep learning automatic learning parameters to construct an end-to-end adaptive filtering convolutional neural network (AF-CNN), which can directly get the classification results through the iterative update of the network. In modeling the original signal, the following steps were taken to make the network interpretable. First, we use a one-dimensional (1-D) convolution on the original OFVS. The convolution kernel can adaptively treat the original signal perform filtering to obtain filtered signals of different frequency bands. Second, using a general convolutional neural network (CNN) to extract the filtered signal features. Finally, a multi-layer perceptron (MLP) is used for classification. This paper compares the AF-CNN network with three traditional pattern recognition methods and proves that the AF-CNN network’s accuracy is better than traditional pattern recognition methods. The average accuracy can reach 96.7%, and it can effectively distinguish OFVS with weaker energy and similar waveforms.

Aiming at the difference in density between the light guide point distribution of the light guide plate (LGP) images, the different size, shape and brightness of LGP defects, and the limitation of a small number of defect samples, our paper proposes a two-stage multiscale residual attention network based on “segmentation + decision” for LGP defect detection. In the first stage, a segmentation subnet is constructed to achieve accurate location of multiscale defects by using the U-shaped structure and the designed Multiscale Residual Attention Unit (MRAU). In the second stage, a decision subnet is constructed to achieve accurate decision whether the LGP image is defective under the guidance of features extracted by segmentation subnet. The design of the network enables the model to be trained using a small number of samples, which is a significant requirement for practical applications. Finally, a lot of experimental studies were conducted on two datasets, including compared with related deep learning methods, proving the effectiveness of residual attention mechanism and proving the effectiveness of multiscale mechanism. Experimental results show that the detection method in this paper has advantages in both detection accuracy and universality under the limitation of a small number of samples. In particular, the detection indicator F1-Score respectively reached 99.85% and 95.46% on the two datasets. Combined with an image acquisition platform, a surface defect detection system is implemented to realize the real-time production quality inspection on the production lines.

Context: User stories have been widely accepted as artifacts to capture the user requirements in agile software development. They are short pieces of texts in a semi-structured format that express requirements. Natural language processing (NLP) techniques offer a potential advantage in user story applications. Objective: Conduct a systematic literature review to capture the current state-of-the-art of NLP research on user stories. Method: The search strategy is used to obtain relevant papers from SCOPUS, ScienceDirect, IEEE Xplore, ACM Digital Library, SpringerLink, and Google Scholar. Inclusion and exclusion criteria are applied to filter the search results. We also use the forward and backward snowballing techniques to obtain more comprehensive results. Results: The search results identified 718 papers published between January 2009 to December 2020. After applying the inclusion/exclusion criteria and the snowballing technique, we identified 38 primary studies that discuss NLP techniques in user stories. Most studies used NLP techniques to extract aspects of who, what, and why from user stories. The purpose of NLP studies in user stories is broad, ranging from discovering defects, generating software artifacts, identifying the key abstraction of user stories, and tracing links between model and user stories. Conclusion: NLP can help system analysts manage user stories. Implementing NLP in user stories has many opportunities and challenges. Considering the exploration of NLP techniques and rigorous evaluation methods is required to obtain quality research. As with NLP research in general, the ability to understand a sentence’s context continues to be a challenge.

Semantic segmentation is a task that covers most of the perception needs of intelligent vehicles in an unified way. Recent studies witnessed that attention mechanisms achieve impressive performance in computer vision task. Current attention mechanisms based segmentation methods differ with each other in position and form of the attention mechanism, and perform differently in practice. This paper firstly introduces the effectiveness of multi-scale context features and attention mechanisms in segmentation tasks. We find that multi-scale and channel attention can play a vital role in constructing effective context features. Based on this analysis, this paper proposes an efficient attention pyramid network (EAPNet) for semantic segmentation. Specifically, to efficient handle the problem of segmenting objects at multiple scales, we design efficient channel attention pyramid (ECAP) which employ atrous convolution with channel attention in cascade or in parallel to capture multi-scale context by using multiple atrous rates. Furthermore, we propose a residual attention fusion block (RAFB), whose purpose is to simultaneously focus on meaningful low-level feature maps and spatial location information. At the same time, we will explore different channel attention modules and spatial attention modules, and describe their impact on network performance. We empirically evaluate our EAPNet on two semantic segmentation datasets, including PASCAL VOC 2012 and Cityscapes datasets. Experimental results show that without MS COCO pre-training and any post-processing, EAPNet achieved 81.7% mIoU on the PASCAL VOC 2012 validation set. With deeplabv3+ as the benchmark, EAPNet improve the model performance of more than 1.50% mIoU.

Recognizing the current weather conditions from a single image is of great theoretical significance. It also has potential practical value for daily life and traffic scheduling. To achieve that, typical weather recognition methods focus on learning a general weather description, e.g., sunny, cloudy, foggy, rainy and snowy etc, for the overall weather condition. However, it is far away from being sufficient for many tasks especially traffic management and control. To solve this key problem, this paper proposes a Global-Similarity Local-Salience Network (abbreviated as GSLSNet) for traffic weather recognition. Specifically, a simple but effective Global-Similarity Module (GSM) is proposed to recognize the overall weather condition and a Local-Salience Module (LSM) is presented to restrict the network to focus on road weather details. Besides, this paper also provides a new traffic weather dataset, named TWData, which is the first fine categorized dataset especially for highway weather recognition. Experimental results compared with state-of-the-art methods on both public datasets and TWData demonstrate the superiority of the proposed GSLSNet.

A distributed denial of service (DDoS) attack represents a major threat to service providers. More specifically, a DDoS attack aims to disrupt and deny services to legitimate users by overwhelming the target with a massive number of malicious requests. A cyberattack of this kind is likely to result in tremendous economic losses for businesses and service providers due to increasing both operating and financial costs. In recent years, machine learning (ML) techniques have been widely used to prevent DDoS attacks. Indeed, many defense systems have been transformed into smart and intelligent systems through the use of ML techniques, which allow them to defeat DDoS attacks. This paper analyzes recent studies concerning DDoS detection methods that have adapted single and hybrid ML approaches in modern networking environments. Additionally, the paper discusses different DDoS defense systems based on ML techniques that make use of a virtualized environment, including cloud computing, software-defined network, and network functions virtualization environments. As the development of the Internet of Things (IoT) has been the subject of significant research attention in recent years, the paper also discusses ML approaches as security solutions against DDoS attacks in IoT environments. Furthermore, the paper recommends a number of directions for future research. This paper is intended to assist the research community with the design and development of effective defense systems capable of overcoming different types of DDoS attacks.

Enhancement of low-light images is a challenging task due to the impact of low brightness, low contrast, and high noise. The inability to collect natural labeled data intensifies this problem further. Many researchers have attempted to solve this problem using learning-based approaches; however, most models ignore the impact of noise in low-lit images. In this paper, an encoder-decoder architecture, made up of separable convolution layers that solve the issues encountered in low-light image enhancement, is proposed. The architecture is trained end-to-end on a custom low-light image dataset (LID), comprising both clean and noisy images. We introduce a unique multi-context feature extraction module (MC-FEM) where the input first passes through a feature pyramid of dilated separable convolutions for hierarchical-context feature extraction followed by separable convolutions for feature compression. The model is optimized using a novel three-part loss function that focuses on high-level contextual features, structural similarity, and patch-wise local information. We conducted several ablation studies to determine the optimal model for low-light image enhancement under noisy and noiseless conditions. We have used performance metrics like peak-signal-to-noise ratio, structural similarity index matrix, visual information fidelity, and average brightness to demonstrate the superiority of the proposed work against the state-of-the-art algorithms. Qualitative results presented in this paper prove the strength and suitability of our model for real-time applications.

When taking pictures of electronic screens or objects with high-frequency textures, people often run across colorful rainbow patterns that are known as “moire”, seriously affecting the image quality and subsequent processing. Current methods for removing moire patterns mostly extract multiscale information by downsampling pooling layers, which may inevitably cause information loss. To address this issue, this paper proposes a demoireing method in the wavelet domain. By employing both discrete wavelet transform (DWT) and inverse discrete wavelet transform (IDWT) instead of traditional downsampling and upsampling, this method can effectively increase the network receptive field without information loss. In addition, to further reconstruct more details of moire patterns, this paper proposes an efficient attention fusion module (EAFM). With a combination of efficient channel attention, spatial attention and local residual learning, this module can self-adaptively learn various weights of feature information at different levels and inspire the network to focus more on effective information such as moire details to improve learning and demoireing performance. Extensive experiments based on public datasets have shown that this suggested method can efficiently remove moire patterns and has a good quantitative and qualitative performance.

In this paper, an integration approach (IA) and parametric approach (PA) fusion-based pedestrian dead reckoning (PDR) using low-cost inertial sensors is proposed to improve the indoor position estimation. When moving indoors using a smartphone, various poses such as texting and putting a pocket are possible. In the existing PA-based positioning algorithms, it can be used only when the pedestrian’s walking direction and the device’s direction coincide. In order to solve the problem, this paper proposes an algorithm that constructs state variables based on the IA and uses the position vector from the PA as a measurement. If the walking direction and the device heading do not match based on the poses, the position is updated according to the direction calculated using principal component analysis (PCA) and the step length obtained from the PA. Through experiments considering various operating conditions and paths, it shows that the proposed method stably estimates the position and improves performance even in various indoor environments with the accuracy of 2.13m for Xsens MTw 2.49m for Smartphone.

How to extract discriminative features from redundant video information is a key issue for video pedestrian re-identification. Factors such as occlusion, perspective, and posture changes in complex environments pose severe challenges to pedestrian re-identification based on local methods. In this paper, a posture-guided multi-scale structural relationship learning pedestrian re-identification method is proposed. The purpose is to analyze the video sequence of pedestrians based on the reference pose and the pose alignment model, and extract the sample frame with the highest image quality and the most complete spatial information in the reference pose. The method based on posture guidance can more accurately eliminate the interference of background, occlusion and perspective factors. To further explore the potential relationship between local regions, this paper calculates the relationship matrix between the local regions based on the relationship model to further calculate the relationship weight, and the graph convolutional network based on the relationship weight learns the structural relationship feature of multi-scale regions. The input of the graph convolutional network is a local region divided by a multi-scale method, and the output is a pose-guided multi-scale structural relationship feature. The experimental results on three public datasets show that the proposed method performs favorably against state-of-the-art methods.

In the advanced television systems committee (ATSC) 3.0 system, the concept of flexibility is significant for supporting backward compatibility within the same ATSC 3.0 system. However, since the conventional bootstrap signal detection scheme is difficult to support the flexibility, the conventional bootstrap signal detection scheme should be newly designed according to the change of version. In this paper, a convolution neural network (CNN) model for bootstrap signal detection in ATSC 3.0 is proposed to maintain the flexibility of bootstrap. Additionally, for minimizing the loss of error performance of CNN-based bootstrap detection scheme, this paper proposes two dimensional alternate array to utilize the correlation of the adjacent bootstrap symbol and proposes the offline learning method using the bootstrap signal corrupted by noise to improve the error performance.

Graph embedding models are widely used in knowledge graph completion (KGC) task. However, most models are based on the assumption that knowledge is completely certain, and this is inconsistent with real-world situations. Although there are multiple studies on uncertain knowledge embedding tasks, they often use knowledge confidence to learn embedding and cannot make full use the structural and uncertain information of knowledge. This paper presents a new embedding model named Structural and Uncertain Knowledge Embedding (SUKE), which comprises two components: an evaluator and a confidence generator. For unknown triples, the evaluator learns the structural and uncertain information to evaluate its rationality and obtain a candidate set. The confidence generator then determines the confidence of the candidate set to achieve KGC. To verify the effectiveness of the proposed model, confidence prediction, triple evaluation, and fact classification tasks are performed on three data sets. Experimental results show that SUKE performs better than mainstream embedding methods. The model proposed in this paper can help advance the research on the embedding of uncertain knowledge graphs.

Wireless communication systems play a very crucial role in modern society for entertainment, business, commercial, health and safety applications. These systems keep evolving from one generation to next generation and currently we are seeing deployment of fifth generation (5G) wireless systems around the world. Academics and industries are already discussing beyond 5G wireless systems which will be sixth generation (6G) of the evolution. One of the main and key components of 6G systems will be the use of Artificial Intelligence (AI) and Machine Learning (ML) for such wireless networks. Every component and building block of a wireless system that we currently are familiar with from our knowledge of wireless technologies up to 5G, such as physical, network and application layers, will involve one or another AI/ML techniques. This overview paper, presents an up-to-date review of future wireless system concepts such as 6G and role of ML techniques in these future wireless systems. In particular, we present a conceptual model for 6G and show the use and role of ML techniques in each layer of the model. We review some classical and contemporary ML techniques such as supervised and un-supervised learning, Reinforcement Learning (RL), Deep Learning (DL) and Federated Learning (FL) in the context of wireless communication systems. We conclude the paper with some future applications and research challenges in the area of ML and AI for 6G networks.

Sentiment Analysis is an important research direction of natural language processing, and it is widely used in politics, news and other fields. Word embeddings play a significant role in sentiment analysis. The existing sentiment embeddings methods directly embed the sentiment lexicons into traditional word representation. This sentiment representation methods can only differentiate the sentiment information of different words, not the same word in different contexts, so it cannot provide accurate sentiment information for word in different contexts. This paper proposes sentiment concept to solve the problem. First, we found the optimal sentiment concept of words in Microsoft Concept Graph according to the context of words. Then we obtained the sentiment information of words under optimal sentiment concept from the multi-semantics sentiment intensity lexicon which we constructed in this paper to achieve accurate embedding of sentiment information and provide more accurate semantics and sentiment representation for words. Finally, we combined two refined word embeddings methods to achieve a more comprehensive word representation. Compared with traditional and sentiment embeddings methods on six representative datasets, the validity of the word embeddings method based on sentiment concept proposed in this paper is verified.

The use rate of urban land is a significant sign to evaluate urban construction, and scene recognition has important application value in improving urban land use rate. In this paper, a new lightweight model based on VGG16 is proposed to extract distinct features of remote sensing images through five convolution modules. This model uses depthwise separable convolution to reduce the network parameters. An adaptive pooling layer is added to solve the inherent non-adaptive problem of the convolution network. It makes the network insensitive to the size of the input image. The global average pooling layer is used to sum the information to make the input spatial transformation more stable. This paper conducts training and testing on two data sets, NWPU-RESISC45 Dataset and SIRI-WHU Dataset, and the recognition scenarios are 13 and 12 categories. Experimental results show that this method is better than other models in recognition accuracy and model size.

In recent years, deep learning has been increasingly used in the field of multimodal emotion recognition in conjunction with electroencephalogram. Considering the complexity of recording electroencephalogram signals, some researchers have applied deep learning to find new features for emotion recognition. In previous studies, convolutional neural network model was used to automatically extract features and complete emotion recognition, and certain results were obtained. However, the extraction of hierarchical features with convolutional neural network for multimodal emotion recognition remains unexplored. Therefore, this paper proposes a hierarchical fusion convolutional neural network model to mine the potential information in the data by constructing different network hierarchical structures, extracting multiscale features, and using feature-level fusion to fuse the global features formed by combining weights with manually extracted statistical features to form the final feature vector. This paper conducts binary classification experiments on the valence and arousal dimensions of the DEAP and MAHNOB-HCI data sets to evaluate the performance of the proposed model. The results show that the model proposed in this paper can achieve accuracies of 84.71% and 89.00% on the two corresponding data sets, indicating that the model proposed in this paper is superior to other deep learning emotion classification models in feature extraction and fusion.

Nowadays, rehabilitation training for stroke survivors is mainly completed under the guidance of the physician. There are various treatment ways, however, most of them are affected by various factors such as experience of physician and training intensity. The treatment effect cannot be fed back in time, and objective evaluation data is lacking. In addition, the treatment method is complicated, costly, and highly dependent on physicians. Moreover, stroke survivors’ compliance is poor, which leads to various limitations. This paper combines the Internet-of-Things, machine learning, and intelligence system technologies to design a smartphone-based intelligence system to help stroke survivors to improve upper limb rehabilitation. With the built-in multi-modal sensors of the smart phone, training action data of users can be obtained, and then transfer to the server through the Internet. This research presents a DTW-KNN joint algorithm to recognize accuracy of rehabilitation actions and classify to multiple training completion levels. The experimental results show that the DTW-KNN algorithm can evaluate the rehabilitation actions, the accuracy rates of the classification in excellent, good, and normal are 85.7%, 66.7%, and 80% respectively. The intelligence system presented in this paper can help stroke survivors to proceed rehabilitation training independently and remotely, which reduces medical costs and psychological burden.