Search

The existing plethora of document classification techniques exploits different data sources either from the content or metadata of research articles. Various journal publishers like Springer, Elsevier, IEEE, etc., do not provide open access to the content of research articles, whereas metadata is freely available there. Metadata like title, keyword, and abstract can serve as a better alternative to the content in various scenarios. In the current literature, researchers have assessed the role of some of the metadata individually. We believe that the collective contribution of metadata parameters can play a significant role in classifying research papers. This paper presents a comprehensive evaluation of the role of metadata, individually as well as in combinations to achieve the objective of research paper classification. Moreover, we have classified the research articles into ACM hierarchy root categories (e.g. general literature, hardware, software, etc.). In this comprehensive evaluation, we have assessed all the possible combinations of metadata features against different classifiers such as Random Forest, K Nearest Neighbor, and Decision Tree. The results of this research reveal that the title & keywords combination outperforms other combinations with an F-measure score of 0.88.

For current steganalysis of the image content-adaptive steganography, there are multiple problems to be improved, such as high difficulty and low accuracy, when detecting images with various contents and textures. For this problem, an improved steganalytic method is proposed in this paper based on the pre-classification and feature selection. First, using the features extracted based on the dependency analysis of image adjacent data, the images with various content and texture complexities are pre-classified as multiple clusters by the K-means algorithms. Then, the performance of existing various steganalytic features are analyzed for different clusters of images, and the optimal features for each cluster are selected for final classification. The experimental results show that the detection accuracy could be improved by the proposed method, and the rationality and availability are also verified. At the same time, the analysis and experimental results in this paper also show that the images with rich content and complex texture should be paid more attention both in steganography and in steganalysis.

In the process of digital image acquisition, color inconsistency is a common issue due to the influence of photographic conditions. The inconsistency of color affects the quality of digital orthophoto products and subsequent applications significantly, and this issue remains challenging both in the academia and industry. This paper proposes a color equalization method for aerial image based on block adjustment and an improved color balance model based on the analysis of causes for color deviation. Two nonlinear functions are used to simulate the process of color deviation and correct the color of images. Due to the existence of error, the color corrected images still have minor deviations in the color of the overlapped regions. Therefore, this research introduces an error equation to address this issue and uses the least square principle to calculate the adjustment. The simulation experiments and real experiments are carried out on several groups of aerial image data respectively. The results show that the method not only achieves better visual effect but also has a higher adjustment precision. Finally, the rationality and parameters of the model proposed in this paper are discussed.

Machine reading comprehension is a very challenging task, which aims to determine the answer span based on the given context and question. The newly developed pre-training language model has achieved a series of successes in various natural language understanding tasks with its powerful contextual representation ability. However, these pre-training language models generally lack the downstream processing structure for specific tasks, which limits further performance improvement. In order to solve this problem and deepen the model’s understanding of the question and context, this paper proposes S&I Reader. On the basis of the pre-training model, skimming, intensive reading, and gated mechanism modules are added to simulate the behavior of humans reading text and filtering information. Based on the idea of granular computing, a multi-granularity module for computing context granularity and sequence granularity is added to the model to simulate the behavior of human beings to understand the text from words to sentences, from parts to the whole. Compared with the previous machine reading comprehension model, our model structure is novel. The skimming module and multi-granularity module proposed in this paper are used to solve the problem that the previous model ignores the key information of the text and cannot understand the text with multi granularity. Experiments show that the model proposed in this paper is effective for both Chinese and English datasets. It can better understand the question and context and give a more accurate answer. The performance has made new progress on the basis of the baseline model.

The airway tree is one of the most important part in human respiratory system. Airway segmentation plays a crucial role in pulmonary disease diagnosis, localization and surgical navigation. We propose a novel method to improve airway segmentation in thoracic computed tomography(CT) using deep learning. In order to take into account the multi-scale changes of the airway and achieve accurate airway segmentation, we design an end-to-end Tiny Atrous Convolutional Network (TACNet) based on 3D convolution neural network. In view of the difficulty of classification due to the numerous branches of airway, two evaluation factors, namely, the angle of airway bifurcation and the buffer length of airway bifurcation are designed, which are used for airway classification by combining the centerline extraction. We train TACNet on the inspirator thoracic CT scans with ground truth, which are generated by clinicians and evaluate on our own clinical data sets and EXACT’09 data sets. Compared with state-of-the-art airway segmentation algorithms, proposed algorithm in this paper achieve very competitive results in 20 test datasets of the EXACT’09 challenge. The experimental results show that the algorithm proposed in this paper has high robustness and advantages regardless of airway segmentation or airway classification. In 20 test datasets of the EXACT’09 challenge, the average airway tree length detection rate is the best in the public literatures.

This paper tackles the problem of detecting incongruities between headlines and body text, where a news headline is irrelevant or even in opposition to the information in its body. Our model, called the graph-based hierarchical dual encoder (GHDE), utilizes a graph neural network to efficiently learn the content similarity between news headlines and long body paragraphs. This paper also releases a million-item-scale dataset of incongruity labels that can be used for training. The experimental results show that the proposed graph-based neural network model outperforms previous state-of-the-art models by a substantial margin (5.3%) on the area under the receiver operating characteristic (AUROC) curve. Real-world experiments on recent news articles confirm that the trained model successfully detects headline incongruities. We discuss the implications of these findings for combating infodemics and news fatigue.

An intrusion detection system (IDS) is an important protection instrument for detecting complex network attacks. Various machine learning (ML) or deep learning (DL) algorithms have been proposed for implementing anomaly-based IDS (AIDS). Our review of the AIDS literature identifies some issues in related work, including the randomness of the selected algorithms, parameters, and testing criteria, the application of old datasets, or shallow analyses and validation of the results. This paper comprehensively reviews previous studies on AIDS by using a set of criteria with different datasets and types of attacks to set benchmarking outcomes that can reveal the suitable AIDS algorithms, parameters, and testing criteria. Specifically, this paper applies 10 popular supervised and unsupervised ML algorithms for identifying effective and efficient ML-AIDS of networks and computers. These supervised ML algorithms include the artificial neural network (ANN), decision tree (DT), k-nearest neighbor (k-NN), naive Bayes (NB), random forest (RF), support vector machine (SVM), and convolutional neural network (CNN) algorithms, whereas the unsupervised ML algorithms include the expectation-maximization (EM), k-means, and self-organizing maps (SOM) algorithms. Several models of these algorithms are introduced, and the turning and training parameters of each algorithm are examined to achieve an optimal classifier evaluation. Unlike previous studies, this study evaluates the performance of AIDS by measuring the true positive and negative rates, accuracy, precision, recall, and F-Score of 31 ML-AIDS models. The training and testing time for ML-AIDS models are also considered in measuring their performance efficiency given that time complexity is an important factor in AIDSs. The ML-AIDS models are tested by using a recent and highly unbalanced multiclass CICIDS2017 dataset that involves real-world network attacks. In general, the k-NN-AIDS, DT-AIDS, and NB-AIDS models obtain the best results and show a greater capability in detecting web attacks compared with other models that demonstrate irregular and inferior results.

In this paper, we show that adversarial training time attacks by a few pixel modifications can cause undesirable overfitting in neural networks for both discriminative and generative models. We propose an evolutionary algorithm to search for an optimal pixel attack using a novel cost function inspired by domain adaptation literature to design our training time attack. The proposed cost function explicitly maximizes the generalization gap and domain divergence between clean and corrupted images. Empirical evaluations demonstrate that our adversarial training attack can achieve significantly low testing accuracy (with high training accuracy) on multiple datasets by just perturbing a single pixel in the training images. Even under the use of popular regularization techniques, we identify a significant performance drop compared to clean data training. Our attack is more successful than previous pixel-based training time attacks on state-of-the-art Convolutional Neural Networks (CNNs) architectures, as evidenced by significantly lower testing accuracy. Interestingly, we find that the choice of optimization plays an essential role in robustness against our attack. We empirically observe that Stochastic Gradient Descent (SGD) is resilient to the proposed adversarial training attack, different from adaptive optimization techniques such as the popular Adam optimizer. We identify that such vulnerabilities are caused due to over-reliance on the cross-entropy (CE) loss on highly predictive features. Therefore, we propose a robust loss function that maximizes the mutual information between latent features and input images, in addition to optimizing the CE loss. Finally, we show that the discriminator in Generative Adversarial Networks (GANs) can also be attacked by our proposed training time attack resulting in poor generative performance. Our paper is one of the first works to design attacks for generative models.

Increasing human activities have caused serious disturbance to global forest resources, so how to accurately identify individual trees has become an important task of forest resources investigation. In order to get the accurate number of individual trees, this paper took coniferous forest and mixed coniferous and broad-leaved forest as experimental samples, as well as Digital Orthophoto Map and airborne LiDAR Point Cloud as research data. We propose a deep Learning individual tree segmentation method based on RetinaNet model and PCS algorithm by doing comparative analysis (classical Watershed Algorithm and Layer Stacking Algorithm) at the plots (with high, medium, and low densities). The experimental results show that the method proposed in this paper can solve the problem of individual tree segmentation in high density forest and improve its degree of automation. Compared with Watershed algorithm and Layer stacking algorithm, F-Measure is improved by 6%-29% and 7%-20%, respectively. In other words, the results of individual tree segmentation presented in this paper can not only improve the precision of individual tree segmentation, but also maintain a high detection rate, which can meet the accuracy and high efficiency of individual tree extraction, so as to meet the needs for modern forestry investigation.

With the rapid development of remote-sensing imaging technology, remote-sensing images have become increasingly diverse, and people are paying more attention to ocean remote-sensing research. Because ocean remote-sensing data are complex, and the ocean environment is diverse, results will differ, even if the same target is detected at different times in the same scene. To obtain more semantic features and better pixel-level prediction capabilities, this paper proposes a pixel-level ocean remote-sensing image algorithm (GLPO-Net) that combines local and global features. First, texture features, color features, and spatial relationship features are extracted. Second, the algorithm constructs a multiscale local cross-attention mechanism strategy to obtain feature weight information in different directions to fully mine the local features of ocean remote-sensing images. Concurrently, an algorithm constructs a multiscale global cross-attention mechanism strategy to obtain global features. Then, the fusion of global features and local features is described in each submodule to obtain more representative deep features. Finally, small-sample ocean remote-sensing is described via image pixel-level prediction. The algorithm proposed in this paper has been tested with three public ocean remote-sensing datasets. The experimental results show that the proposed GLPO-Net algorithm can learn features from small samples of ocean remote-sensing images. Compared to the prediction results of other remote-sensing image algorithms, GLPO-Net exhibits better prediction capabilities.

Accurate diagnosis of corn crop diseases is a complex challenge faced by farmers during the growth and production stages of corn. In order to address this problem, this paper proposes a method based on K-means clustering and an improved deep learning model for accurately diagnosing three common diseases of corn leaves: gray spot, leaf spot, and rust. First, to diagnose three diseases, use the K-means algorithm to cluster sample images and then feed them into the improved deep learning model. This paper investigates the impact of various k values (2, 4, 8, 16, 32, and 64) and models (VGG-16, ResNet18, Inception v3, VGG-19, and the improved deep learning model) on corn disease diagnosis. The experiment results indicate that the method has the most significant identification effect on 32-means samples, and the diagnostic recall of leaf spot, rust, and gray spot disease is 89.24 %, 100 %, and 90.95 %, respectively. Similarly, VGG-16 and ResNet18 also achieve the best diagnostic results on 32-means samples, and their average diagnostic accuracy is 84.42% and 83.75%. In addition, Inception v3 (83.05%) and VGG-19 (82.63%) perform best on the 64-means samples. For the three corn diseases, the approach cited in this paper has an average diagnostic accuracy of 93%. It has a more significant diagnostic effect than the other four approaches and can be applied to the agricultural field to protect crops.

Near-infrared spectroscopy (NIR) has become one of the most important methods for counterfeit drugs identification for its low cost, non-destructive, and on-site detection. However, it is often invalid for unknown samples beyond the scope of modeling samples, as well as it is not efficient in conditions of insufficient samples (insufficient number of samples within the class), unbalanced samples (large difference in the number of samples between classes), and sensitivity of identification results (different tolerance for different errors in application scenarios). To solve these problems, this paper proposes a general method for on-site identification of counterfeit drugs based on Siamese-network modeling with near-infrared spectroscopy, which especially constructs the train set and test set, learning the general knowledge of spectral differences to identify the different drugs by a costumed one-dimensional convolution neural network (1D-CNN), and finally answered the question of whether the on-site two spectra are pointed to the same drug. Based on experimental modeling samples of 1314 spectra, which are involved 9 drugs produced by 25 manufacturers, this paper has constructed and fully trained its model. Then, not known at the time of modeling, 4 drugs produced by 9 manufacturers are used for testing in the on-site application, and the accuracy rate amounts to 97.3%. For generalizing consideration, randomly divided into training and testing categories, the 32015 spectra of 135 drugs produced by 391 manufacturers in the spectral library are handled by the same processing. The generalization model is equally applicable, and the accuracy is above 97%. Compared with traditional binary classification identification methods such as SVM, PLS-DA, Auto-encoding, and one class (OC) threshold identification algorithms such as SVM-OC, SIMCA, conformity test (CT), the proposed method has the best identification ability for unknown samples in modeling.

Handwritten mathematical expressions are an essential part of many domains, including education, engineering, and science. The pervasive availability of computationally powerful touch-screen devices, similar to the recent emergence of deep neural networks as high-quality sequence recognition models, result in the widespread adoption of online recognition of handwritten mathematical expressions. Also, a deeper study and improvement of such technologies is necessary to address the current challenges posed by the extensive usage of distance learning, and remote work due to the world pandemic. This paper delineates the state-of-the-art recognition methods along with the user's experience in pen-centric applications for operating with handwritten mathematical expressions. Recognition methods have been categorized into classes, with a description of their merits and limitations. Particular attention is paid to end-to-end approaches based on encoder-decoder architecture and multi-modal input. Evaluation protocols and open benchmark datasets are considered as well as the comparison of the recognition performance, based on open competition results. The use of handwritten math recognition is illustrated by examples of applications for various fields and platforms. A distinctive part of the survey is that we also considered how UI design relies on the use of different recognition approaches, which is aimed at helping potential researchers improve the performance of the introduced approaches toward the best responses in practical applications. Finally, this paper presents the prospective survey of future research directions in handwritten mathematical expression recognition and their applications.

We address the problem of depth estimation from a single monocular image in the paper. Depth estimation from a single image is an ill-posed and inherently ambiguous problem. In the paper, we propose an encoder-decoder structure with the feature pyramid to predict the depth map from a single RGB image. More specifically, the feature pyramid is used to detect objects of different scales in the image. The encoder structure aims to extract the most representative information from the original image through a series of convolution operations and to reduce the resolution of the input image. We adopt Res2-50 as the encoder to extract important features. The decoder section uses a novel upsampling structure to improve the output resolution. Then, we also propose a novel loss function that adds gradient loss and surface normal loss to the depth loss, which can predict not only the global depth but also the depth of fuzzy edges and small objects. Additionally, we use Adam as our optimization function to optimize our network and speed up convergence. Our extensive experimental evaluation proves the efficiency and effectiveness of the method, which is competitive with previous methods on the Make3D dataset and outperforms state-of-the-art methods on the NYU Depth v2 dataset.

Dementia diseases are increasing rapidly, according to the World Health Organization (WHO), becoming an alarming problem for the health sector. The electroencephalogram (EEG) is a non-invasive test that records brain electrical activity and has a wide field of applications in the medical area, one of which is the detection of neurodegenerative diseases. The aim of this work is to present the results of a thorough review of the use of EEG systems for the detection of dementia diseases. Around 82 papers published between 2009 and 2020 were reviewed and compared obtaining data such as sampling time, number of electrodes, the most popular processing, classification, and validation techniques, as well as an analysis of the reported results. The relationship of the selected parameters with the efficiency obtained is shown. Some more common combinations in the reviewed papers that demonstrated to have reliability levels greater than 90%, and details to be considered at each stage of the process. An overview of the most commonly used classification tools and processing techniques is also described.

The Internet of Things is based on a communication network to automatically receive various information from the natural world. It uses intelligent objects with perception, communication and computers to automatically receive various information from nature. All independently managed physical objects are connected to each other to achieve integrated perception, reliable transmission and intelligent processing, and to establish intelligent information between people and objects, and objects and object service systems. This article mainly introduces the impact of industrial agglomeration on the regional economy in a simulated intelligent environment based on machine learning. This paper proposes a method to detect industrial agglomeration index to analyze industrial agglomeration. Through the establishment of the industrial agglomeration index system, the level of integration of the manufacturing industry in our city was objectively analyzed, and the impact of the integration of manufacturing industry on our city was tested empirically. Finally, the relationship between industrial integration and regional economic development was tested. The experimental results in this paper show that industrial integration in a smart environment based on simulation learning has a significant positive impact on regional economic development. Among them, the level of cooperation between the manufacturing service industry and the manufacturing industry increased by 1%, and the level of regional economic development increased by 0.025%.

Autonomous driving (AD) provides a reliable solution for safe driving by replacing human drivers responsible for the majority of accidents. The emergence of Machine Learning, specifically Deep Reinforcement Learning (DRL), and its ability to solve complex games proved its potential to address AD challenges. However, model-free methods still suffer from safety-related issues that can be resolved using safe-DRL approaches. The addition of model-based safety filters to the learning-based algorithms provides safety bounds on their performance and constraint satisfaction. In this paper, we investigate the addition of a safety filter based on Model Predictive Control and show an increase in mean testing episode reward by 110% from −75 mean episode reward during testing for 50 episodes for Deep Deterministic Policy Gradient ( $DDPG$ ) to 7.758. We study the impacts of safety filters (7.758 mean reward), heuristic rules, bounded additive noises (0.49% performance increase comparing to noise-free case), and exploration (3.425 mean reward) on the learning algorithm. We compare the effects of filters in the context of simulated exploration and bounded exploration and prove that bounded exploration results in 9.86% increase in mean reward and 12.95% decrease in std comparing to the other method. Additionally, inspired by Deep Internal Learning and biological mechanisms like brain plasticity, we investigate the idea of using each sample for training only once instead of utilizing stochastic batches which increases the mean testing accumulated reward by 1.87% and leads to the best performance (7.942 mean reward and 0.048 std). Finally, the results demonstrate better automotive results for our proposed method than DDPG. Our proposed method, DDPG with safety filter in bounded exploration and adaptive learning under noisy input conditions, has a success rate of 100% under different traffic densities for the simulation environment used in this paper and our assumptions. The proposed method’s automotive results are shown for a braking scenario to avoid collision with other road users.

Choosing optimal Deep Learning (DL) architecture and hyperparameters for a particular problem is still not a trivial task among researchers. The most common approach relies on popular architectures proven to work on specific problem domains led on the same experiment environment and setup. However, this limits the opportunity to choose or invent novel DL networks that could lead to better results. This paper proposes a novel approach for providing general recommendations of an appropriate DL architecture and its hyperparameters based on different configurations presented in thousands of published research papers that examine various problem domains. This architecture can further serve as a starting point of investigating DL architecture for a concrete data set. Natural language processing (NLP) methods are used to create structured data from unstructured scientific papers upon which intelligent models are learned to propose optimal DL architecture, layer type, and activation functions. The advantage of the proposed methodology is multifold. The first is the ability to eventually use the knowledge and experience from thousands of DL papers published through the years. The second is the contribution to the forthcoming novel researches by aiding the process of choosing optimal DL setup based on the particular problem to be analyzed. The third advantage is the scalability and flexibility of the model, meaning that it can be easily retrained as new papers are published in the future, and therefore to be constantly improved.

Accurate electricity consumption forecasting in the power grids ensures efficient generation and distribution of electricity. Keeping this in mind, the paper introduces a novel deep learning model, termed Gated-FCN, for short-term load forecasting. The key idea is to introduce an automated feature selection and deep learning model for forecasting. The model includes an eight-layered Fully Convolutional Network (FCN-8) in which the hand-crafted feature selection that requires expert domain knowledge is avoided. Furthermore, the model also reduces noise as it learns internal dependencies and the correlation of the time series. Enhanced Bidirectional Gated Recurrent Unit (EBiGRU) is used in combination with FCN-8 to learn long-term temporal dependencies of the time series. Moreover, a weighted averaging mechanism of multiple snapshot models is adopted in the proposed model to assign optimized weights to BiGRU. At the end of FCN-8 and BiGRU, a fully connected dense layer is used that gives final prediction results. Gated-FCN is an end-to-end forecasting model that does not require any other model for enhancing its forecasting efficiency. Different activation functions are initially analyzed to determine how the proposed model learns complex patterns from the time series data. Later, the activation function having the best accuracy is used for forecasting. The proposed model extracts both spatial and temporal features from the data. Furthermore, this paper also provides predictive and exploratory data analyses to assist policymakers in making optimal decisions regarding power production and dispatch. In order to demonstrate the applicability of the proposed technique, the simulations are performed using nine years’ load consumption data taken from Independent System Operators New England (ISO-NE). The comparison with five state-of-the-art techniques is also provided to prove the fact that Gated-FCN gives the best forecasting accuracy as compared to other benchmark techniques in terms of two performance metrics: Mean Absolute Percentage Error (MAPE) and Root Mean Square Error (RMSE).

Many studies showed the feasibility of detecting Freezing of Gait (FOG) of Parkinson’s patients by using several numbers of inertial sensors worn on the body and in back-end computing power. This work uses machine learning approaches for analyzing the data of one single body-worn inertial sensor system to classify and detect FOG. Long-Short-Term-Memory (LSTM) is employed as the FOG detection algorithm and the Daphnet (FOG and normal gait) dataset provides the data for model training and testing in this paper. The model considers raw data from three channels of the acceleration sensor mounted on the patient’s shank and ignores all other data from other sensors. The model is patient dependent and uses sensitivity and specificity metrics to evaluate the model’s performance. In this paper, we propose a novel padding method that is applied to the windows of FOG and non-FOG with zero overlaps on the training set and adapts the padding to the individual regions. This method produces windows of only one type of data and label. The proposed padding method reduces the padding amount by two orders of magnitude compared to bigger batch sizes in the sequence splitting method offered by MATLAB 2019a. The padding amount is independent of the batch size. Raw data is fed to the model in the testing mode without any pre-processing or data transformation. The standard rolling window generates fixed-size windows for the test set without overlap and the higher amount of FOG or Normal walking data which defines the label of the individual window. The model for one-second long windows applied in this work outperformed the literature results with a sensitivity of 92.57% and a specificity of 95.62% compared to 82% and 94% reported by Masiala et al.

This paper discusses impact of recovering missing Electroencephalography (EEG) data on classification accuracy of hand movements using tensor-based methods. Improvement in classification accuracy is important for efficient performance of prosthesis. Classification accuracy relies on quality of the observed data. In practice, observed data is usually incomplete because of disconnection of electrodes and other artefacts, which negatively affect the classification accuracy. In this paper, we employ tensor-based imputation methods (canonical/polyadiac decomposition (CPD), weighted optimization version of CPD (CP-WOPT and Nonnegative Matrix Factorization (NMF)) to recover missing data in EEG signals and apply various classifiers to classify hand movements on recovered data. In particular, structured missing data was considered because that is how data gets missed in real-life data acquisition. Percentage of missing data was changed from 10% to 50%. Classifiers are applied on complete, missing and recovered data explicitly to test the performance of our framework. Results show that mean classification accuracy on complete data, missing data and recovered data was 71%, 53% and 64% respectively which shows applicability of our framework.

Laparoscopic surgery is a surgical procedure performed by inserting narrow tubes into the abdomen without making large incisions in the skin. It is done with the aid of a video camera. Laparoscopic videos are affected by various distortions during surgery which lead to loss of visual quality. Identification of these distortions is the primary requisite in automated video enhancement systems used to classify the distortions correctly and accordingly select the proper algorithm to enhance video quality. In addition to high accuracy, the speed of distortion classification should be high, and the system must consider real-time conditions. This paper aims to address the issues faced by similar methods by developing a fast and accurate deep learning model for distortion classification. The dataset proposed by the ICIP2020 conference challenge was used for training and evaluation of the proposed method. This challenging dataset contains videos that have five types of distortions such as noise, smoke, uneven illumination, defocus blur, and motion blur with four levels of intensity. This paper discusses the proposed solution which received the first prize in the ICIP2020 challenge. The solution utilized a transfer learning approach to transfer representation from the domain of natural images to the domain of laparoscopic videos. We used a pre-trained ResNet50 convolutional neural network (CNN) to extract informative features that were mapped by support vector machine (SVM) classifiers to various distortion categories. In this work, the problem of multiple distortions in the same video was formulated as a multi-label distortion classification problem. The approach of transfer learning with decision fusion was applied and was found to outperform other solutions in terms of accuracy (83%), F1 score of a single distortion (94.7%), and F1 score of single and multiple distortions (94.9%). In addition, the proposed solution can run in real time with an inference speed of 20 frames per second (FPS).

In this paper, we propose a highly efficient method for synthesizing high-resolution(HR) smoke simulations based on deep learning. A major issue for physics-based HR fluid simulations is that they require large amounts of physical memory and long execution times. In recent years, this issue has been addressed by developing deep-learning-based super-resolution(SR) methods that convert low-resolution(LR) fluid simulation results to HR(High-resolution) versions. However, these methods were not very efficient because they performed operations even in areas with low density or no density. In this paper, we propose a method that can maximize its efficiency by introducing a downscaled and binarized adaptive octree. However, even if it is divided by octree, because the number of nodes increases when the resolution of the simulation space is large, we reduce the size of the space by multiscaling and at the same time perform binarization to preserve the density that may be lost in this process. The octree calculated in this process has a structure similar to that of a multigrid solver, and the octree calculated at coarse resolution is restored to its original size and used for HR expression. Finally, we apply the SR process only to those areas having significant density values. Using the proposed method, the SR process is significantly faster and the memory efficiency is improved. The performance of our method is compared with that of an existing SR method to demonstrate its efficiency.

Generally, a few-shot distribution shift will lead to a poor generalization. Furthermore, while the number of instances of each class in the real world may significantly different, the existing few-shot classification methods are based on the assumption that the number of samples in each class is equal, which causes the trained classifier invalid. Moreover, through ResNet and WRN (Wide Residual Network) have achieved great success in the image processing field, the depth and width of CNNs constrain the conventional convolution layer performance. Thus, to overcome the above problems, the model of this paper proposes a novel few-shot classification model that uses learning balance variables to decide how much to learn from the imbalance dataset, which dynamically generates the convolution kernel based on each input. In our model, to extend the decision boundaries and enhance the class representations, this paper uses embedding propagation as a regularizer for manifold smoothing. Manifold smoothing can effectively solve the above problems of transductive learning. The interpolations between neural network features based on similarity graphs are used by embedding propagation. Experiments show that embedding propagation can produce a better embedding manifold and our model in standard few-shot datasets, such as miniImagenet, tieredImagenet, CUB has state-of-the-art results. It significantly outperforms the existing few-shot approaches, which consistently improves the accuracy of the models by about 11%.

Analysis of Brazil’s rainforest fires caused by various factors has become a hot topic nowadays,. Mining of rainforest fire data through learning unlabeled training samples can reveal inherent properties and patterns, providing a clue for fire prevention. Among commonly used mining approaches, clustering algorithms based on density estimation can relatively effectively capture the potential ignition features through probability calculation, while the Gaussian mixture model (GMM) based on Expectation-Maximum (EM) can effectively quantify fire distribution curves and decompose a fire object into different shape clustering problems based on the actual distribution characteristics of fires data, and thus cluster fires more accurately. However, when the discrimination of probability density is not apparent, the clustering effect is susceptible to both the number of parameters used in clustering and the shape of the clustering problem. Therefore, in the present paper, based on a new strategy of selecting and updating the parameters in the GMM, a new hybrid clustering model called Principal Component Analysis-boosted Dynamic Gaussian Mixture Clustering model (PCA-DGM) is developed. Specifically, Principal Component Analysis (PCA) reduces the dimension of fire samples and strengthens key ignition features. Furthermore, a new dynamic distance loss function is developed by dynamically selecting density parameters or distance parameters, whose computing value is utilized as one important parameter of the clustering shape decision of the GMM. Using the PCA-DGM, which can effectively solve clustering problems with various shapes, the causes of forest fires in Brazil are analyzed at both the temporal and geographical levels, and the experimental results demonstrate that the proposed PCA-DGM in this paper has a better clustering effect than the other traditional clustering algorithms.

This paper proposed a novel fuzzy best-worst multi-criteria group decision-making method to solve the group decision-making (GDM) problem with multi-granular linguistic approach, which is an effective and promising technique to tackle this issue. In the proposed method, the selectable multi-granularity linguistic term sets (LTS) are firstly provided for experts to expressed their individual assessment information. Then, the improved fuzzy BWM is employed to calculate the weights of criteria with the form of fuzzy numbers. In current several studies using the BWM for group decision-making, only two unified best and worst criteria are given, which cannot reflect the evaluation of the best and worst criteria by different experts, resulting in the omission of information. Moreover, the difference between the best and worst criteria initially given and the experts’ ideas will cause the experts to be inaccurate in the comparison of each criterion. Therefore, in this paper, in order not to omit too much information, each expert will determine the best and the worst criteria. The evaluation information of each expert is integrated into two comparison vectors according to the transformation formula proposed in this paper. What’s more, an improved input-based consistency measurement is proposed, which can provide the DMs with a clear guideline on the revision of the inconsistent judgement(s). Finally, two examples are given to illustrate the effectiveness and applicability of the proposed method.

Hyperspectral and multispectral information processing systems and technologies have demonstrated its usefulness for the improvement of agricultural productivity and practices by providing useful information to farmers and crop managers on the factors affecting crop status and growth. These technologies are widely used in a range of agriculture applications such as crop management, crop yield forecasting, crop disease detection, and the monitoring of agriculture land usage, water, and soil conditions. Hyperspectral information sensing can acquire several hundred spectral bands that cover the electromagnetic spectrum of an observational scene in a single acquisition. The resulting hyperspectral data cube contains a large volume of spatial and spectral information. The hyperspectral sequence of images or video further increases the data generation velocity and volume which lead to the Big data challenges particularly in agricultural remote sensing applications. This paper is structured to first give a comprehensive review of representative studies to provide insights into significant research efforts in agriculture using Big data, machine learning and deep learning with the focus on frameworks or architectures, information processing and analytics with hyperspectral and multispectral data. The potential for utilizing Big data, machine learning and deep learning for hyperspectral and multispectral data in agriculture is very promising. The paper then further explores the potential of using ensemble machine learning and scalable parallel discriminant analysis which takes into consideration the spatial and spectral components for Big data in agriculture. To the best of our knowledge, no similar review study on agriculture with Big data, machine learning and deep learning for hyperspectral and multispectral information processing has been reported. Furthermore, the potential of ensemble machine learning and scalable parallel discriminant analysis has not been explored in agriculture information processing. Experiments and data analytics have been performed on hyperspectral data from agriculture for validation. The results have shown the good performance of our approach.

Dyslexia is a neurological disorder that is characterized by imprecise comprehension of words and generally poor reading performance. It affects a significant population of school-age children, with more occurrences in males, thus, putting them at risk of poor academic performance and low self-esteem for a lifetime. The long-term hope is to have a dyslexia diagnostic method that is informed by neural-biomarkers. In this regard, large numbers of machine learning methods and, more recently, deep learning methods have been implemented across various types of dataset with the above-chance classification accuracy. However, attainment of clinical acceptability of these state-of-the-art methods is bedeviled by certain challenges including lack of biologically-interpretable biomarkers, privacy of dataset and classifiers, hyper-parameter selection/optimization, and overfitting problem among others. This review paper critically analyzes recent machine learning methods for detecting dyslexia and its biomarkers and discusses challenges that require proper attentions from the users of deep learning methods in order to enable them to attain clinically relevance and acceptable level. The review is conducted within the premise of implementation and experimental outcomes for each of the 22 selected articles using the Preferred Reporting Items for Systematic review and Meta-Analyses (PRISMA) protocol, with a view to outlining some critical challenges for achieving high accuracy and reliability of the state-of-the-art machine learning methods. As an evidence-based protocol for reporting in systematic reviews and meta-analyses, PRISMA helps to ensure clarity and transparency of this paper by showing a four-phase flow diagram of the selection process for articles used in this review. It is therefore, envisaged that higher classification performance of clinical relevance can be achieved using deep learning models for dyslexia and its biomarkers by addressing identified potential challenges.

This article mainly studies Electroencephalogram (EEG) mental recognition. Because the human brain is very complex and the EEG signal is greatly affected by the environment, EEG mental recognition can be attributed to domain adaptative problems. Our main work is as follows: (1) At present, most domain adaptation learning only learns the linear subspace of Reproducing Kernel Hilbert Space (RKHS), and RKHS itself does not. Given the complexity and nonlinearity of EEG mental recognition, we propose an EEG mental recognition algorithm based on two learning. The two learning is RKHS learning and RKHS subspace learning. The source dictionary regularized RKHS subspace learning we proposed applies to EEG mental recognition and is better than pure RKHS subspace learning, but not enough. To get satisfactory results, we learn RKHS before RKHS subspace. (2) According to Moore–Aronszajn theorem, RKHS can be uniquely generated by a kernel function. The existing RKHS is rarely learnable. It is difficult to find a kernel function that can be learned and optimized. In RKHS learning, this paper uses a learnable kernel function that we published, and the kernel function is easy to optimize. (3) In RKHS subspace learning, most of the existing methods adopt the Maximum Mean Discrepancy (MMD) criterion, but it cannot make the spatial distribution of the same category of source and target domain data overlap as much as possible, and the label of the target domain data is unknown. To solve this problem, this paper proposes a framework of RKHS subspace learning based on source domain dictionary regularization. The experimental results on the brain-computer interface international competition data set (BCI competition IV 2a) show that the effect of the algorithm proposed in this paper is better than that of the other five advanced domain adaptation learning algorithms.

The sixth generation (6G) wireless communication network presents itself as a promising technique that can be utilized to provide a fully data-driven network evaluating and optimizing the end-to-end behavior and big volumes of a real-time network within a data rate of Tb/s. In addition, 6G adopts an average of 1000+ massive number of connections per person in one decade (2030 virtually instantaneously). The data-driven network is a novel service paradigm that offers a new application for the future of 6G wireless communication and network architecture. It enables ultra-reliable and low latency communication (URLLC) enhancing information transmission up to around 1 Tb/s data rate while achieving a 0.1 millisecond transmission latency. The main limitation of this technique is the computational power available for distributing with big data and greatly designed artificial neural networks. The work carried out in this paper aims to highlight improvements to the multi-level architecture by enabling artificial intelligence (AI) in URLLC providing a new technique in designing wireless networks. This is done through the application of learning, predicting, and decision-making to manage the stream of individuals trained by big data. The secondary aim of this research paper is to improve a multi-level architecture. This enables user level for device intelligence, cell level for edge intelligence, and cloud intelligence for URLLC. The improvement mainly depends on using the training process in unsupervised learning by developing data-driven resource management. In addition, improving a multi-level architecture for URLLC through deep learning (DL) would facilitate the creation of a data-driven AI system, 6G networks for intelligent devices, and technologies based on an effective learning capability. These investigational problems are essential in addressing the requirements in the creation of future smart networks. Moreover, this work provides further ideas on several research gaps between DL and 6G that are up-to-date unknown.

DNA microarray data analysis is infamous due to a massive number of features, imbalanced class distribution, and limited available samples. In this paper, we focus on high-dimensional multi-class imbalanced problems. The high dimensional and multi-class imbalanced problem has posed acute challenges for the conventional classifiers to effectively perform classification tasks on both the minority and majority classes. Numerous efforts have been devoted to addressing either high dimensionality dataset or class imbalance problems. Nonetheless, few methods have been proposed to address the intersection of multi-class imbalanced and high-dimensional problems concurrently due to their intricate interactions. This paper presents novel hybrid algorithms for feature selection with the high dimensional multi-class imbalanced problem using multiple filter-based rankers (MFR) and hybrid Grasshopper optimization algorithm (GOA). The Simulated Annealing (SA) algorithm is incorporated into GOA. SA is used to enhance the best solution found by the GOA algorithm. The aim of using the SA here is to tackle the slow convergence and improve the exploitation by searching the high-quality regions found by the GOA. The experimental results confirm the effectiveness of the proposed methods in improving the classification performance in terms of area under the curve (AUC) compared to other well-known methods, which guarantees the ability of the proposed methods in searching the feature space and identifying very robust and discriminative features that best predict the minority class.

In recent times, numerous convolutional neural network (CNN) based detection models have been proposed and have shown excellent performance. However, because these models are generally developed to detect objects in class units (e.g., person, car), additional training processes with numerous datasets are required to find a specific object. This paper proposes a model that accurately detects specific persons by using top clothing color information without any additional training processes. The proposed method combines CNN-based instance segmentation and pose estimation, utilizing all the advantages of each technique. To avoid redundant computations, these two schemes are implemented as a filtering-based sequential operation structure. As a result, the proposed method has a 92.57% of accuracy in detecting a specific person with only a slight processing speed decrease. Furthermore, in this paper, the proposed model is efficiently ported on the heterogeneous embedded platform (i.e., NVIDIA Jetson AGX Xavier) with a parallel processing technique to maximize the hardware utilization.

In a smart urban environment, providing accurate information about human activities is an important task. It is a trend to implement human activity recognition (HAR) algorithms and applications on smart phones, including health monitoring, self-management system, health tracking and so on. However, human activity recognition(HAR) is very complex, and it is important to use the best technology and machine learning to understand human activities. One of the main problems of the existing HAR strategies is that the classification accuracy is relatively low, and in order to improve the accuracy, it needs high computational overhead. The purpose of this paper is to use an exploratory data analysis method to deal with HAR, after the implementation of different data mining techniques, the results of dimensionality reduction and visualization are obtained. The HAR method based on smart phone and EDA proposed in this paper is a high precision method. Compared with other classifiers, its accuracy is 96.56%. This article will discuss computational prediction activities and the computational limitations of using exploratory data to analyze (EDA) on 564 feature data frames. The experimental results show that HAR-based exploratory data analysis is a common sensory signal processing technology. The GridSearchCV and LinearSVC algorithm can provide accurate automatic human activity recognition (HAR), for elderly and disabled patients in need of continuous care, and it is a decision-making tool to support sports coaches to make plans.

Artificial intelligence-assisted diagnosis systems are developing rapidly, but doctors are currently less aware of artificial intelligence-assisted diagnosis systems. Understanding how to allow doctors to accept and use artificial intelligence medical assistant diagnosis system can promote the implementation of artificial intelligence medical assistant diagnosis system applications. Taking into account the current difficulties faced by the Internet of Things medical consultation services, this paper proposes a business operation model based on multi-party participation and sharing of medical consultation resources. We designed the information flow, overall logic and service implementation process of the service model, and completed the construction of the artificial intelligence medical service service model. We combine IoT technology to build a vital signs monitoring environment and clarify how to use IoT devices. In the error backpropagation algorithm, there is no significant difference in the contribution of different samples to the weight change, which makes the adjustment of network parameters not easily affected by difficult medical consultation samples, thereby weakening the effect of network medical consultation. In order to solve this problem, this article defines the degree to which the sample belongs to its correct category as the confidence of medical inquiry, and divides the training sample into a dangerous sample and a safe sample according to a dynamic threshold. Based on the difficulty of medical inquiry, an improved new learning algorithm is proposed. The algorithm penalizes the loss of dangerous samples, so that the convolutional neural network pays more attention to dangerous samples and can learn more effective information. Aiming at the eight physiological characteristics of data, this paper adjusts the structure of the convolutional neural network to make it take into account the richness of data characteristics and the dynamics of data changes over time. The realized CNN optimization algorithm model has improved the prediction effect, and the accuracy rate of medical consultation reaches 90.15%, which is better than other machine learning algorithms.

Photo Response Non-Uniformity (PRNU) is considered the most effective trace for the image source attribution task. Its uniqueness ensures that the sensor pattern noises extracted from different cameras are strongly uncorrelated, even when they belong to the same camera model. However, with the advent of computational photography, most recent devices heavily process the acquired pixels, possibly introducing non-unique artifacts that may reduce PRNU noise's distinctiveness, especially when several exemplars of the same device model are involved in the analysis. Considering that PRNU is an image forensic technology that finds actual and wide use by law enforcement agencies worldwide, it is essential to keep validating such technology on recent devices as they appear. In this paper, we perform an extensive testing campaign on over 33.000 Flickr images belonging to 45 smartphone and 25 DSLR camera models released recently to determine how widespread the issue is and which is the plausible cause. Experiments highlight that most brands, like Samsung, Huawei, Canon, Nikon, Fujifilm, Sigma, and Leica, are strongly affected by this issue. We show that the primary cause of high false alarm rates cannot be directly related to specific camera models, firmware, nor image contents. It is evident that the effectiveness of \prnu based source identification on the most recent devices must be reconsidered in light of these results. Therefore, this paper is intended as a call to action for the scientific community rather than a complete treatment of the subject. Moreover, we believe publishing these data is important to raise awareness about a possible issue with PRNU reliability in the law enforcement world., Comment: Final paper in : https://ieeexplore.ieee.org/document/9393356

With the advent of smart grid, load forecasting is emerging as an essential technology to implement optimal planning and control of grid assets. Ergo in recent years, a significant thrust can be witnessed for the research towards the improvement of the prediction of the energy demand. However thus far there has not been any one technique in the literature that is shown to give best forecasts for a variety of sites; almost all the papers published on load forecasting, report their best results on just one of the dataset. This problem accentuates further when the training data does not have enough data points to learn patterns over all the seasons. Hence to devise a load forecasting technique that can yield the best estimates on diverse datasets, especially when the training data is limited, is a big challenge, which is addressed in this paper. The paper presents a novel combination of deep learning with feature engineering for short-term load forecasting. The proposed architecture, named as Deep Derived Feature Fusion (DeepDeFF), is based on the sequential model in conjunction with the hand-crafted derived features in order to aid the model for better learning and predictions. The raw data and the hand-crafted features are trained at separate levels, then their respective outputs are combined to make the final prediction. The efficacy and robustness of the proposed methodology is evaluated on diverse datasets from five countries with completely different patterns. The extensive experiments and results demonstrate that the proposed technique is superior to the existing state of the art.

This paper presents a hybrid ontology-XLNet sentiment analysis classification approach for sentence-level aspects. The main objective of the proposed approach allows discovering user social data considering the extracted in-depth inference about sentiment depending on the context. Thus, in this paper, we investigate the contribution of utilizing the lexicalized ontology to improve the aspect-based sentiment analysis performance through extracting the indirect relationships in user social data. The XLNet model is utilized for extracting the neighboring contextual meaning and concatenating it with each embeddings word to produce a more comprehensive context and enhance feature extraction. In the proposed approach, Bidirectional Long Short Term Memory (Bi-LSTM) networks are used for classifying the aspects in online user reviews. Various experiments considering Adverse Drug Reactions (ADRs) discovery are conducted on six drug-related social data real-world datasets to evaluate the performance of the proposed approach using several measures. Obtained experimental results show that the proposed approach outperformed other tested state-of-the-art related approaches through improving feature extraction of unstructured social media text and accordingly improving the overall accuracy of sentiment classification. A significant accuracy of 98% and F-measure of 96.4% are achieved by the proposed ADRs aspect-based sentiment analysis approach.

Prescription dispensing accuracy is of paramount importance for all hospitals. However, human errors are inevitable due to multiple reasons, such as fatigue, stress, heavy workload, lack of effective verification measures, mismanagement. Such human errors pose serious safety and health concerns on the part of patients and may as well lead to a series of medical disputes. Based on induced deep learning, this paper proposes a real-time Blister Package Identification System (BPIS) to assist pharmacists’ drug verification and dispensing. Under the guidance of the induction strategy, image preprocessing is introduced to form a standardized image containing the front and back side of the blister package, which is subsequently sent to CNN-based object identification network for feature extraction and identification. This preprocessing method allows the identification system to promote the deep learning system to focus on feature learning to obtain more information about the appearance of the package ruling out confounding factors such as background noise, size, shape or positioning. In addition, this article collects and establishes an image dataset of adult lozenges. Under this dataset, this paper verifies the enhancement of Induced Deep Learning (IDL) on YOLO v2, ResNet, and SENet. By optimizing the deep learning identification network with the help of the embedded technology and a two-side extraction mechanism, a real-time BPIS is built. Long-term tests in hospitals prove the effectiveness of the proposed system.

Document layout analysis plays an important role in the area of Document Understanding. It is responsible for identifying and classifying the different components of digital documents. Currently, there is no universal algorithm that fits all types of digital documents. This work presents a novel approach for identifying tables, figures, isolated equations and text regions in scientific papers using deep learning and computer vision techniques. Our proposed approach is a three-stage system: (i) obtaining the spectrograms of the horizontal and vertical intensity histograms of segmented regions of interest; (ii) labeling segmented regions of interest into text, table, and figures using a deep convolutional neural network classifier; and (iii) identifying isolated equations in text regions using Bag of Visual Words (BOVW) with Zernike moments. We built a new dataset composed of 11007 papers to perform the experiments, using two common segmentation metrics to evaluate our model: (1) Adjusted Rand Index (ARI) and (2) Variation of Information (VI). The proposed document layout analysis system reached an overall accuracy of 96.2685%, outperforming prior art with a less computational cost.

Recent advances in the domain of software defect prediction (SDP) include the integration of multiple classification techniques to create an ensemble or hybrid approach. This technique was introduced to improve the prediction performance by overcoming the limitations of any single classification technique. This research provides a systematic literature review on the use of the ensemble learning approach for software defect prediction. The review is conducted after critically analyzing research papers published since 2012 in four well-known online libraries: ACM, IEEE, Springer Link, and Science Direct. In this study, five research questions covering the different aspects of research progress on the use of ensemble learning for software defect prediction are addressed. To extract the answers to identified questions, 46 most relevant papers are shortlisted after a thorough systematic research process. This study will provide compact information regarding the latest trends and advances in ensemble learning for software defect prediction and provide a baseline for future innovations and further reviews. Through our study, we discovered that frequently employed ensemble methods by researchers are the random forest, boosting, and bagging. Less frequently employed methods include stacking, voting and Extra Trees. Researchers proposed many promising frameworks, such as EMKCA, SMOTE-Ensemble, MKEL, SDAEsTSE, TLEL, and LRCR, using ensemble learning methods. The AUC, accuracy, F-measure, Recall, Precision, and MCC were mostly utilized to measure the prediction performance of models. WEKA was widely adopted as a platform for machine learning. Many researchers showed through empirical analysis that features selection, and data sampling was necessary pre-processing steps that improve the performance of ensemble classifiers.

Large-scale group decision-making (LSGDM) is one of the main open problems where a decision is made by many different results. Moreover, there is also a problem with how to make the decision when there is no all information. This uncertainty can be very problematic for many different solutions in artificial intelligence. In this paper, we propose to extend a federated learning (FL) approach to not only a training process but also for making a decision using many different classifiers. This solution is applied in LSGDM, where many different results are intended for the classification of various data and can be used for deciding, even when some of the data are missing. For this purpose, we propose a fuzzy consensus that can be used in these problems. The contribution of this paper is the new way of using FL and extending its operation to many different classifiers. Our proposition was described for medical purposes and evaluated to show the advantages of the proposal. The proposal obtained 89,12% of accuracy on HAM10000, which is one of the best results compared to state-of-art.

Predicting the personality type of text authors has a well-known usage in psychology with practical applications in business. From the data science perspective, we can look at this problem as a text classification task that can be tackled using natural language processing (NLP) and deep learning. This paper proposes a method and a novel loss function for multiclass classification using the Myers–Briggs Type Indicator (MBTI) approach for predicting the author’s personality type. Furthermore, this paper proposes an approach that improves the current results of the MBTI multiclass classification because it considers components of compound class labels as supportive elements for better classification according to MBTI. As such, it also provides a new perspective on this classification problem. The experimental results on long short-term memory (LSTM) and convolutional neural network (CNN) models outperform baseline models for multiclass classification, related research on multiclass classification, and most research with four binary approaches to MBTI classification. Moreover, other classification problems that target compound class labels and label parts with binary mutually exclusive values can benefit from this approach.

In this paper, we propose a classification system that uses multiple autoencoder models for identifying malware images. It is crucial to accurately classify malware before we can deploy appropriate countermeasures to prevent them from spreading. Rapid malware classification is the first step in preparing effective countermeasures. Typical approaches to this problem, which can be divided into static or dynamic methods, are not suitable for efficient malware classification because they require either fixed malware patterns or lots of time to investigate, respectively. If the malware analysts have enough time and resources, they can analyze any malware thoroughly. However, finite resources mean they always suffer from a lack of time due to the malware that needs analyzing increasing at a dramatic rate. In the real world, new malware and variants of existing malware are constantly emerging. To address this issue, many researchers have developed approaches using machine learning techniques. However, to date these systems have had difficulty responding appropriately to the rapidly changing malware environment and also suffer from data imbalance problems in the training data. The system proposed in this paper consists of multiple autoencoder models that classify malware that has been converted to an image. Each autoencoder model classifies only one type of malware and is trained using only samples from the corresponding family, this allows the system to update quickly and mitigates the data imbalance problem. We demonstrate our method’s superior performance through various experiments compared to other state-of-the-art techniques using the Malimg dataset.

he acoustic emission technique has been applied successfully for the identification, characterization, and localization of deformations in civil engineering structures. Numerous localization techniques, such as Modal Acoustic Emission, Neural Networks, Beamforming, and Triangulation methods with or without prior knowledge of wave velocity, have been presented. Several authors have conducted in-depth research in the localization of AE sources. However, existing review papers do not focus on the performance evaluation of existing source localization techniques. This paper discusses these techniques based on the number of sensors used and the geometry of the structures of interest. Furthermore, it evaluates them on the basis of their performance. At the end of this paper, a comparative analysis of existing methods has been presented based on their basic principles, key strengths, and limitations. A deep learning circular sensor cluster-based solution has the potential to provide a low-cost reliable localization solution for acoustic emission sources.

This paper addresses the problems related to the mapless navigation control of wheeled mobile robots based on deep learning technology. The traditional navigation control framework is based on a global map of the environment, and its navigation performance depends on the quality of the global map. In this paper, we proposes a mapless Light Detection and Ranging (LiDAR) navigation control method for wheeled mobile robots based on deep imitation learning. The proposed method is a data-driven control method that directly uses LiDAR sensors and relative target position for mobile robot navigation control. A deep convolutional neural network (CNN) model is proposed to predict motion control commands of the mobile robot without the requirement of the global map to achieve navigation control of the mobile robot in unknown environments. While collecting the training dataset, we manipulated the mobile robot to avoid obstacles through manual control and recorded the raw data of the LiDAR sensor, the relative target position, and the corresponding motion control commands. Next, we applied a data augmentation method on the recorded samples to increase the number of training samples in the dataset. In the network model design, the proposed CNN model consists of a LiDAR CNN module to extract LiDAR features and a motion prediction module to predict the motion behavior of the robot. In the model training phase, the proposed CNN model learns the mapping between the input sensor data and the desired motion behavior through end-to-end imitation learning. Experimental results show that the proposed mapless LiDAR navigation control method can safely navigate the mobile robot in four unseen environments with an average success rate of 75%. Therefore, the proposed mapless LiDAR navigation control system is effective for robot navigation control in an unknown environment without the global map.

Unsupervised person re-identification (re-id) is an effective analysis for video surveillance in practice, which can train a pedestrian matching model without any annotations, and it is easy to deploy in unseen camera scenarios. The most challenging problem in unsupervised re-id task is the huge distribution-gap among different camera views, and the intrinsic correlations in unlabeled identities are also complicated to sufficiently explored. This paper proposes a Multi-order Cross-view Graph adversarial Network (MCGN) to bridge the cross-view distribution-gap, and mine the inherent discriminative information by multi-order triplet correlations. Specifically, MCGN firstly exploits graph representations by a cross-view graph convolutional network according to intra-view and inter-view graph structure, and then encodes each pedestrian image into a view-shared feature space, which is iteratively trained by a graph generative adversarial learning strategy to deeply bridge the distribution-gap. Finally, this paper proposes a multi-order discriminative learning module for composing reasonable triplet samples according to multi-order similarity correlations among unlabeled pedestrian images. Furthermore, sufficient experiments are conducted in two large scale person re-id datasets (Market-1501 and DukeMTMC-reID). The comparison to state-of-the-art methods and ablation study demonstrate the superiority of MCGN and the contribution of each module proposed in this paper.

Image super-resolution reconstruction has been widely used in remote sensing, medicine and other fields. In recent years, due to the rise of deep learning research and the successful application of convolutional neural networks in the image field, the super-resolution reconstruction technology based on deep learning has also achieved great development. However, there are still some problems that need to be solved. For example, the current mainstream image super-resolution algorithms based on single or multiple frames pursue high performance indicators such as PSNR and SSIM, while the reconstructed image is relatively smooth and lacks many high-frequency details. It is not conducive to application in a real environment. To address such problem, this paper proposes a super-resolution reconstruction model of sequential images based on Generative Adversarial Networks (GAN). The proposed approach combines the registration module to fuse adjacent frames, effectively use the detailed information in multiple consecutive frames, and enhances the spatio-temporality of low-resolution images in sequential images. While the GAN was used to improve the effect of image high-frequency texture detail reconstruction, WGAN was introduced to optimize model training. The reconstruction results not only improved the PSNR and SSIM indexes but also reconstructed more high-frequency detail textures. Finally, in order to further improve the perception effect, an additional registration loss item RLT is introduced in the GAN network perception loss. Through extensive experiments, it shows that the model proposed in this paper effectively obtains the information between the sequence images. When the PSNR and SSIM indicators are improve, it can reconstruct better high-frequency texture details than the current advanced multi-frame algorithms.

Wind speed fluctuations and load demand variations represent the big challenges against wind energy conversion systems (WECS). Besides, the inefficient measuring devices and the environmental impacts (e.g. temperature, humidity, and noise signals) affect the system equipment, leading to increased system uncertainty issues. In addition, the time delay due to the communication channels can make a gap between the transmitted control signal and the WECS that causes instability for the WECS operation. To tackle these issues, this paper proposes an adaptive neuro-fuzzy inference system (ANFIS) as an effective control technique for blade pitch control of the WECS instead of the conventional controllers. However, the ANFIS requires a suitable dataset for training and testing to adjust its membership functions in order to provide effective performance. In this regard, this paper also suggests an effective strategy to prepare a sufficient dataset for training and testing of the ANFIS controller. Specifically, a new optimization algorithm named the mayfly optimization algorithm (MOA) is developed to find the optimal parameters of the proportional integral derivative (PID) controller to find the optimal dataset for training and testing of the ANFIS controller. To demonstrate the advantages of the proposed technique, it is compared with different three algorithms in the literature. Another contribution is that a new time-domain named figure of demerit is established to confirm the minimization of settling time and the maximum overshoot in a simultaneous manner. A lot of test scenarios are performed to confirm the effectiveness and robustness of the proposed ANFIS based technique. The robustness of the proposed method is verified based on the frequency domain conditions that are driven from Hermite–Biehler theorem. The results emphases that the proposed controller provides superior performance against the wind speed fluctuations, load demand variations, system parameters uncertainties, and the time delay of the communication channels.

The productivity and profitability of poultry farming are crucial to support its affordability issues in food security. Criteria in productivity measurement, including Feed Conversion Ratio (FCR) calculation, whereas economic management is essential for profitability. Hence, best management practices need to be implemented throughout the growth period for optimizing the poultry performance. This review provides a comprehensive overview of computer vision technology for poultry industry research. This review relies on the use of several online databases to identify key works in the area of computer vision in a poultry farm. We recommend our search by focusing on four keywords, ‘computer vision’ and ‘poultry’ or ‘chicken’ or ‘broiler’ that had been published between 2010 and early 2020 with open access provided by University Teknologi Malaysia only. All the selected papers were manually examined and sorted to determine their relevance to computer vision in a poultry farm. We focus on the latest developments by focusing on the hardware and software parts used to analyze the poultry data with some examples of various representative studies on poultry farming. Notably, hardware parts can be classified into camera types, lighting units and camera position, whereas software parts can be categorized into data acquisition and analysis software types as well as data processing and analysis methods that can be implemented into the software types. This paper concludes by highlighting the future works and key challenges that needed to be addressed to assure the quality of this technology prior to the successful implementation of the poultry industry.

Surveillance cameras are everywhere, keeping an eye on pedestrians as they navigate through a scene. With this context, our paper addresses the problem of pedestrian attribute recognition (PAR). This problem entails recognizing attributes such as age-group, clothing style, accessories, footwear style etc. This is a multi-label problem and challenging even for human observers. The problem has rightly attracted attention recently from the computer vision community. In this paper, we adopt trainable Gabor wavelets (TGW) layers and use it with a convolution neural network (CNN). Whereas other researchers are using fixed Gabor filters with the CNN, the proposed layers are learnable and adapt to the dataset for a better recognition. We propose a multi-branch neural network where mixed-layers, a combination of the TGW and convolutional layer, make up the building block of our 3-branch deep neural network. We test our method on publicly available challenging datasets and compare our results with state of the art.