Search

In recent years, the proliferation of vehicles on roadways, accompanied by an escalating demand for augmented safety and refined traffic management, has fueled substantial progress in the domains of computer vision and deep learning methodologies. This technological surge has precipitated ground-breaking applications, with real-time vehicle detection emerging as a linchpin. Capability to accurately detect vehicles in a real-time holds profound implications across diverse domains. In the context of autonomous driving, it underpins essential functions such as path planning, collision avoidance, and decision-making, essential for the safe operation of autonomous vehicles. In the arena of traffic monitoring, it empowers transportation authorities to acquire real-time insights into traffic dynamics, congestion patterns, and incident detection, thereby optimizing traffic flow and resource allocation strategies. Furthermore, within surveillance systems, real-time vehicle detection equips security personnel with the means to swiftly identify potential security threats, enhancing overall situational awareness and safety. This paper contributes to this dynamic landscape by introducing an innovative architecture expressly crafted for vehicle detection. Leveraging state-of-the-art computer vision techniques and deep learning methodologies, this architecture addresses the evolving challenges posed by contemporary traffic scenarios. Through the enhancement of real-time vehicle detection capabilities, our aim is to fortify the foundations of safety, efficiency, and security within vehicular contexts. The paper includes a fusion of AlexNet and Darknet accompanied by a comparative analysis. It is expected to deliver unmatched dependability and accuracy in real-time traffic monitoring, setting a new standard for performance in this application. [ABSTRACT FROM AUTHOR]

This paper investigates the art design of user interaction experience in mobile systems through the methods of contextual perception and machine learning. The theoretical foundations for the design of intangible cultural heritage interactive display resources include digital display theory, intangible cultural heritage education theory, embodied cognition theory, and gamification design theory. Based on the modelling and analysis of the theoretical foundations, the design principles are derived, including the heritage education principle, the somatic interaction design principle, and the content design principle. In this paper, we use ontologies to construct user knowledge models, fuse multi-situational similarity metrics, screen out candidate neighbour sets through preliminary screening, then combine the user's activity to construct time-based weight tensor scores, use tensor decomposition to obtain recommendation evaluation values, and finally use the recommendation evaluation values to make artistic recommendations. The experimental results show that the algorithm can still obtain a good recommendation implementation in the case of extremely sparse data. The analysis of the fit between augmented reality and folk art appreciation class, as well as the reference to relevant application cases, make design and practice of augmented reality application in folk art appreciation class, try to solve the common problems in folk art appreciation class, analyse the feedback effect and make a summary and outlook. [ABSTRACT FROM AUTHOR]

This paper presents an intelligent healthcare framework by incorporating modern computing technologies like machine learning and deep learning. The sole motivation of this paper is to predict diabetes status intelligently so that patients can be made aware of their diabetes status regularly. A novel ensemble machine learning-based diabetes prediction framework, namely "iDP", has been proposed in this paper. Six different machine learning approaches have been used for the iDP framework, namely random forest, decision tree, neural network, AdaBoost, support vector machine, and XGBoost. Training and testing of ensemble modeling have been performed based on these learning techniques. A comprehensive preliminary data analysis and screening of statistical analysis have been systematically demonstrated in this paper. The recursive feature elimination and fivefold cross-validation methods have been used to select the best model. All experiments have been performed using R-Studio 1.2.5 with the help of the Rattle library 5.4.0. The preliminary data analytic and Pearson correlation coefficient values have been computed to verify the linearity relationship among the data. Results have been reported in eight performance metrics, including accuracy, specificity, sensitivity, area under curve, area under convex hull, minimum error rate, minimum weighted loss, and precision. The proposed iDP framework improves the results on different aspects in order to compare them with individual learning approaches. Despite this, a comparative performance analysis of the iDP framework has also been performed with state-of-the-art prevailing models. As per experiment, the iDP framework gives better results in most cases, like accuracy: 95.26%, AUC: 91.15%, sensitivity: 96.81%, specificity: 97.72% and precision: 90.72%. [ABSTRACT FROM AUTHOR]

Manual term extraction is similar to literal meaning: A translator browses text, classifies words, and prepares for translation. Terminology, as a centralized carrier of expertise, creation, popularization, and disappearance, dynamically reflects the development and evolution of an industry. The automatic extraction of terminology is a key technology for creating a professional terminology database, and it is also a key topic in the field of natural language processing. The purpose of this paper is to study how to analyse a term extraction algorithm based on machine learning and a comprehensive feature strategy. Focusing on the problems of poor generality and single statistical features of current term extraction algorithms, this paper proposes an improved domain ontology term extraction algorithm based on a comprehensive feature strategy. Moreover, automatic term extraction experiments based on a word-based maximum entropy model and a conditional random field model based on machine learning are conducted in this paper. Its word-based conditional random field model outperforms the maximum entropy model. The experimental results show that the algorithm based on the comprehensive feature strategy improves the accuracy by 8.6% compared with the TF-IDF algorithm and the C-value term extraction algorithm. This algorithm can be used to effectively extract the terms in a text and has good generality. [ABSTRACT FROM AUTHOR]

Limitations in computer-assisted diagnosis include lack of labeled data and inability to model the relation between what experts see and what computers learn. Even though artificial intelligence and machine learning have demonstrated remarkable performances in medical image computing, their accountability and transparency level must be improved to transfer this success into clinical practice. The reliability of machine learning decisions must be explained and interpreted, especially for supporting the medical diagnosis. While deep learning techniques are broad so that unseen information might help learn patterns of interest, human insights to describe objects of interest help in decision-making. This paper proposes a novel approach, DeepCraftFuse, to address the challenge of combining information provided by deep networks with visual-based features to significantly enhance the correct identification of cancerous tissues in patients affected with Barrett's esophagus (BE). We demonstrate that DeepCraftFuse outperforms state-of-the-art techniques on private and public datasets, reaching results of around 95% when distinguishing patients affected by BE that is either positive or negative to esophageal cancer. [ABSTRACT FROM AUTHOR]

Multi-Object Tracking, also known as Multi-Target Tracking, is an important area of computer vision with various applications in different domains. The advent of deep learning has had a profound impact on this field, forcing researchers to explore innovative avenues. Deep learning methods have become the cornerstone of today's state-of-the-art solutions, consistently delivering exceptional tracking results. However, the significant computational demands of deep learning models require powerful hardware resources that do not always match real-time tracking requirements, limiting their practical applicability in real-world scenarios. Thus, there is an imperative to strike a balance by merging robust deep learning strategies with conventional approaches to enable more accessible, cost-effective solutions that meet real-time requirements. This paper embarks on this endeavor by presenting a hybrid strategy for real-time multi-target tracking. It effectively combines a classical optical flow algorithm with a deep learning architecture tailored for human crowd tracking systems. This hybrid approach achieves a commendable balance between tracking accuracy and computational efficiency. The proposed architecture, subjected to extensive experimentation in various settings, demonstrated notable results, achieving a Mean Object Tracking Accuracy (MOTA) of 0.608. This level of performance placed it as the highest ranking solution on the MOT15 benchmark, surpassing the state-of-the-art benchmark of 0.549, and consistently ranked among the superior models on the MOT17 and MOT20 benchmarks. Additionally, the incorporation of the optical flow phase resulted in a substantial reduction in processing time, nearly halving the duration, while simultaneously maintaining accuracy levels comparable to established techniques. [ABSTRACT FROM AUTHOR]

The data-driven modular deep fuzzy model has demonstrated excellent forecasting performance due to its clear architecture and powerful fuzzy inference ability. However, the fixed structure predesigned for specific types of datasets limits the further improvement of generalization ability, especially when facing high-dimensional datasets with the challenging problem of rule explosion, thereby suffering from the time-consuming training process. To overcome these limitations, a novel randomized fuzzy modules (RFMs) stacked residual deep fuzzy system (RFM-RDFS) is proposed in this study. Firstly, to obtain high-precision outputs, this paper presents a residual deep fuzzy framework by stacking RFMs layer by layer, where the modules in the current layer only learn the residual of the previous layer. Secondly, to improve the design freedom for different applications, the RFM with multiple inputs is raised, where the input variables are allocated by a sliding window along the input spaces of the layers, so the number of the parallel modules in the same layer can be flexibly adjusted. Meanwhile, in the RFM, inspired by the extreme learning machine, the centers and widths of Gaussian membership functions are randomly generated, which can greatly accelerate the training speed. Thirdly, to strengthen the approximation performance, the consequent parameters of the fuzzy rules in each RFM are learned by minimizing the loss function with the regularization terms through the ridge regression algorithm. Finally, extensive experiments on various datasets are conducted to compare the proposed RFM-RDFS with several state-of-the-art shallow and deep models. The detailed comparison results clearly show that the proposed RFM-RDFS is more flexible and compact, and has greater advantages in terms of the interpretability, generalization ability and robustness. [ABSTRACT FROM AUTHOR]

Parkinson's disease (PD) is a condition that degenerates over time and impairs speech and pronunciation because brain cells have died. This research work aims to predict parkinson disease using the voice features extracted from speech signals recorded from PD individuals with dysphonic speech disorders by employing deep learning algorithms. PD is challenging to diagnose early on in the clinical presentation. To address the issue in machine learning methods, this paper proposes a neural network model by processing speech signals to classify PD using the University of California Irvine (UCI) machine learning repository dataset. Initially, a pre-loss reduction module is created by using pre-sampling to make the dataset balanced by reducing the dimensionality and maintaining the size of the space without influencing the learning process for data preparation. The relevant features are derived using a novel multi-agent salp swarm (MASS) algorithm, and a novel Parkinson classification neural network (PCNN) is proposed to classify Parkinson's patients with high accuracy employing these derived features. The result shows that the models that use MASS-PCNN produce higher classification accuracy of 99.1%, precision of 97.8%, recall of 94.7% and F1-score of 0.995 when paralleled to the existing models. As an outcome, the suggested model will perform superior to common convolutional neural networks. [ABSTRACT FROM AUTHOR]

Once realized, autonomous aerial refueling will revolutionize unmanned aviation by removing current range and endurance limitations. Previous attempts at establishing vision-based solutions have come close but rely heavily on near perfect extrinsic camera calibrations that often change midflight. In this paper, we propose dual object detection, a technique that overcomes such requirement by transforming aerial refueling imagery directly into receiver aircraft reference frame probe-to-drogue vectors regardless of camera position and orientation. These vectors are precisely what autonomous agents need to successfully maneuver the tanker and receiver aircraft in synchronous flight during refueling operations. Our method follows a common 4-stage process of capturing an image, finding 2D points in the image, matching those points to 3D object features, and analytically solving for the object pose. However, we extend this pipeline by simultaneously performing these operations across two objects instead of one using machine learning and add a fifth stage that transforms the two pose estimates into a relative vector. Furthermore, we propose a novel supervised learning method using bounding box corrections such that our trained artificial neural networks can accurately predict 2D image points corresponding to known 3D object points. Simulation results show that this method is reliable, accurate (within 3 cm at contact), and fast (45.5 fps). [ABSTRACT FROM AUTHOR]

Personalized learning has gained significant attention in education as a means to cater to the diverse needs of learners and optimize educational outcomes. However, ensuring the efficiency of personalized learning remains a challenge. It requires the ability to accurately analyze and interpret vast amounts of data collected from learners. Traditional analytical approaches often struggle to handle the complexity and heterogeneity of this data, limiting the potential for personalized learning interventions. To address these challenges, this paper proposes a personalized learning efficiency data analysis network (PLEDANet) based on machine learning. First, PLEDANet redesigns a convolutional neural network based on the ResNet structure. The network performs convolutions using multiple convolution kernels of different scales to extract diverse feature information from personalized learning efficiency data. To enhance the extraction and representation of fine-grained differentiated features, PLEDANet introduces a hybrid attention module to combine channel and spatial information among feature maps. Second, PLEDANet designs a hybrid loss function for model training, which consists of the AM-softmax loss and the Center loss. The former increases the inter-class distance of features by imposing a fixed angular margin, while the latter reduces the intra-class distance by constraining the samples and feature centers. Finally, extensive experiments are conducted on PLEDANet. The experimental results validate the superiority of PLEDANet for personalized learning efficiency analysis. [ABSTRACT FROM AUTHOR]

For market players and policy officials, commodity price forecasts are crucial problems that are challenging to address due to the complexity of price time series. Given its strategic importance, corn crops are hardly an exception. The current paper evaluates the forecasting issue for China's weekly wholesale price index for yellow corn from January 1, 2010 to January 10, 2020. We develop a Gaussian process regression model using cross validation and Bayesian optimizations over various kernels and basis functions that could effectively handle this sophisticated commodity price forecast problem. The model provides precise out-of-sample forecasts from January 4, 2019 to January 10, 2020, with a relative root mean square error, root mean square error, and mean absolute error of 1.245%, 1.605, and 0.936, respectively. The models developed here might be used by market players for market evaluations and decision-making as well as by policymakers for policy creation and execution. [ABSTRACT FROM AUTHOR]

Petrophysical properties estimation is vital in reservoir characterisation domain to identify the prospect locations of presence of petroleum. Geophysical sensing with seismic survey and well logging provide such information of subsurface without completely digging over the reservoir. Machine learning models are popular in this domain to estimate the petrophysical properties from seismic signals and well logging. However, the performance is affected when the available labelled data are limited to model a reservoir. Transfer learning has a significant contribution in handling the limited labelled data issue in many application domains. But its applicability is almost unexplored in this domain as it is necessary to first identify the relevant model to transfer. In this paper, we propose a novel transfer learning approach for the estimation of petrophysical properties in a real-world reservoir dataset having inadequate labelled data samples. The proposed solution transfers the contextual knowledge of reservoir facies classes to the predictive model of petrophysical properties. Both the tasks share the common domain information and provided the improved generalisation performance considering the out-of-fold prediction in blind wells. Moreover, the analysis of results depicts better convergence and accuracy compared to its considered baselines. [ABSTRACT FROM AUTHOR]

Federated Learning (FL) is a collaborative training method for machine learning (ML) that aggregates model weights from multiple participants during the training phase. The learning phase of machine learning techniques is distributed, in which each participating device trains a model using its local data set and sends model weights to a centralized node. The central node aggregates weights and sends the updated weights back to devices. The process continues until a specific threshold is reached such accuracy, response time. In this paper, we present a performance evaluation of FL in a clustering-based multi-hop network to simulate the effect of the dynamic environment on the accuracy of the global model. It is observed that a minimum number of participating nodes is required within a cluster to maintain a high level of global accuracy. A global threshold value needs to be defined to maintain high global accuracy and avoid degradation of model performance. [ABSTRACT FROM AUTHOR]

Ground penetrating radar (GPR) systems are effective sensors for discovering various types of objects buried underground, such as military mines, metal objects, and pieces of underground infrastructures. A GPR system can be manually operated by a human or can be an integral part of a host platform. The host platform may be semi- or fully autonomous and may operate in different environments such as land vehicles or more recently air-borne drones. One challenge for the fully or semi-autonomous host platforms in particular is to find an efficient search procedure that would reduce the operation time and optimize resource utilization. Most of the current approaches are based on pre-defined search patterns which, for large and sparse areas, could mean unnecessary waste of time and resources. In this paper, we introduce a method that combines a coarse and therefore relatively low cost initial search pattern with a Reinforcement Learning (RL) driven efficient navigation path for eventual target detection, by exploiting the signal processing pipeline of the onboard GPR. We illustrate the applicability of the method using a well-known, high fidelity GPR simulation environment and a novel RL framework. Our results suggest that combination of a coarse navigation scheme and an RL-based training procedure based on GPR scan returns can lead to a more efficient target discovery procedure for host platforms. [ABSTRACT FROM AUTHOR]

In multiple-instance learning (MIL), the existing bag encoding and attention-based pooling approaches assume that the instances in the bag have no relationship among them. This assumption is unsuited, as the instances in the bags are rarely independent in diverse MIL applications. In contrast, the instance relationship assumption-based techniques incorporate the instance relationship information in the classification process. However, in MIL, the bag composition process is complicated, and it may be possible that instances in one bag are related and instances in another bag are not. In present MIL algorithms, this relationship assumption is not explicitly modeled. The learning algorithm is trained based on one of two relationship assumptions (whether instances in all bags have a relationship or not). Hence, it is essential to model the assumption of instance relationships in the bag classification process. This paper proposes a robust approach that generates vector representation for the bag for both assumptions and the representation selection process to determine whether to consider the instances related or unrelated in the bag classification process. This process helps to determine the essential bag representation vector for every individual bag. The proposed method utilizes attention pooling and vision transformer approaches to generate bag representation vectors. Later, the representation selection subnetwork determines the vector representation essential for bag classification in an end-to-end trainable manner. The generalization abilities of the proposed framework are demonstrated through extensive experiments on several benchmark datasets. The experiments demonstrate that the proposed approach outperforms other state-of-the-art MIL approaches in bag classification. [ABSTRACT FROM AUTHOR]

Deep learning integration in cancer diagnosis enhances accuracy and diagnosis speed which helps clinical decision-making and improves health outcomes. Despite all these benefits in cancer diagnosis, the present AI models in urology cancer diagnosis have not been sufficiently reviewed systematically. This paper reviews the artificial intelligence approaches used in cancer diagnosis, prediction, and treatment of urology cancer. AI models and their applications in urology subspecialties are evaluated and discussed. The Scopus, Microsoft Academic and PubMed/MEDLINE databases were searched in November 2022 using the terms "artificial intelligence", "neural network", "machine learning," or "deep learning" combined with the phrase "urology cancers". The search was limited to publications published within the previous 20 years to identify cutting-edge deep-learning applications published in English. Irrelevant review articles and publications were eliminated. The included research involves two kinds of research analysis: quantitative and qualitative. 48 articles were included in this survey. 25 studies proposed several approaches for prostate cancers, while 15 were for bladder cancers. 8 studies discussed renal cell carcinoma and kidney cancer. The models presented to detect urology cancers have achieved high detection accuracy (77–95%). Deep learning approaches that use convolutional neural networks have achieved the highest accuracy among other techniques. Although it is still progressing, the development of AI models for urology cancer detection, prediction, and therapy has shown significant promise. Additional research is required to employ more extensive, higher-quality, and more recent datasets to the clinical performance of the proposed AI models in urology cancer applications. [ABSTRACT FROM AUTHOR]

The core premise of cancelable biometrics lies in the creation of a distinct biometric template for every individual, which can be either canceled or regenerated as needed. This process requires the use of a uniquely-defined key during the generation of such template. The generated templates are tailored to be key-specific. This ensures that each distinct key will generate a unique template, while preserving the integrity and security of the original biometric data, ensuring that it remains uncompromised. In this paper, a cancelable biometric system based on electrocardiography (ECG) and photoplethysmography (PPG) signals is introduced. A signal fusion process is implemented for the two traits to generate a single template per user. In order to enhance the security of generated templates, a well-designed permutation stage is implemented according to a user-specific key. The permutation key is obtained through a well-designed look-up table created by the authors. The user verification is conducted on the cancelable template, without the need for any inversion processes. The user verification scheme depends on a two-pronged approach: robust feature extraction followed by the application of a machine learning (ML) classifier. The mel-frequency cepstral coefficients (MFCCs) extraction algorithm is employed for feature extraction due to the low frequency range of the adopted biometric signals and the nonlinearity of the filter bank used for MFCC extraction. Several ML classifiers are adopted to validate the system with cancelable templates without any inversion process. Simulation results with multilayer perceptron (MLP) and logistic regression (LR) classifiers demonstrated superior effectiveness of the proposed authentication framework, with accuracy rates up to 100% and 99.7% on the pulse transit time PPG and BIDMC datasets, respectively. Hence, the proposed system proves effective access control and user verification in the Internet-of-Things (IoT) applications. [ABSTRACT FROM AUTHOR]

In areas with high tuberculosis (TB) prevalence, high mortality rate has significantly increased over the past few decades. Even though tuberculosis can be treated, areas with high disease burden continue to have insufficient screening tools, leading to diagnostic delays and incorrect diagnoses. As a result of these challenges, a computer-aided diagnostics (CAD) system has been developed that can automatically detect tuberculosis. There are few different methods that can be used to screen for tuberculosis; however, chest X-ray (CXR) is most commonly used and strongly suggested because it is so effective in identifying lung irregularities. Over past ten years, we have seen a meteoric rise in amount of research conducted into application of machine learning strategies to examination of chest X-ray images for screening regarding pulmonary abnormalities. Particularly, we have also noticed significant interest in testing for TB. This attentiveness has increased in tandem with phenomenal progress that has been made in deep learning (DL), which is predominately founded on convolutional neural networks (CNNs). Because of these advancements, significant research contributions have been made in field of DL techniques for TB screening by utilizing CXR images. The main focus of this paper is to emphasize favorable methods and data collection, as well as methodological contributions, identify data collections, and identify challenges. [ABSTRACT FROM AUTHOR]

Reinforcement learning is a compelling area of research within machine learning because it enables the improvement of control strategies for future manipulation of dynamic systems, leveraging previous data even without a precise model of the system. It usually makes complex, model-free predictions from data alone, which is actually consistent with the purpose of control in that they both aim to design systems using richly structured perceptions to execute planning and control strategies that adequately adapt to changing environments. The robust trajectory tracking control of intricate mechanical systems presents a challenging problem that necessitates effective control methods. In this paper, we propose a novel nonlinear control strategy based on deep reinforcement learning to solve the trajectory tracking problem of a 3-degree-of-freedom (3-DOF) control moment gyroscope (CMG). First, dynamic modeling of the 3-DOF CMG is used as a policy solver for the reinforcement learning training environment, and transfer learning is employed to bridge the reality gap. Then, the hyperparameters and reward functions of the neural network are optimized using the asynchronous successive halving algorithm. Ultimately, the twin delay depth determination policy gradient algorithm is trained in simulation to yield an agent capable of tracking user-defined trajectory routes as a nonlinear controller for the system. Both simulation and experimental results show that the proposed method works well for both high-frequency and low-frequency varying trajectory tracking control, and that the proposed method has better response speed and robustness than classic linear parameter-varying control methods and the state-of-the-art nonlinear parameter-varying method and the neural network-based feedback linearization adaptive control method. [ABSTRACT FROM AUTHOR]

In recent years, credit card transaction fraud has resulted in massive losses for both consumers and banks. Subsequently, both cardholders and banks need a strong fraud detection system to reduce cardholder losses. Credit card fraud detection (CCFD) is an important method of fraud prevention. However, there are many challenges in developing an ideal fraud detection system for banks. First off, due to data security and privacy concerns, various banks and other financial institutions are typically not permitted to exchange their transaction datasets. These issues make traditional systems find it difficult to learn and detect fraud depictions. Therefore, this paper proposes federated learning for CCFD over different frameworks (TensorFlow federated, PyTorch). Second, there is a significant imbalance in credit card transactions across all banks, with a small percentage of fraudulent transactions outweighing the majority of valid ones. In order to demonstrate the urgent need for a comprehensive investigation of class imbalance management techniques to develop a powerful model to identify fraudulent transactions, the dataset must be balanced. In order to address the issue of class imbalance, this study also seeks to give a comparative analysis of several individual and hybrid resampling techniques. In several experimental studies, the effectiveness of various resampling techniques in combination with classification approaches has been compared. In this study, it is found that the hybrid resampling methods perform well for machine learning classification models compared to deep learning classification models. The experimental results show that the best accuracy for the Random Forest (RF); Logistic Regression; K-Nearest Neighbors (KNN); Decision Tree (DT), and Gaussian Naive Bayes (NB) classifiers are 99,99%; 94,61%; 99.96%; 99,98%, and 91,47%, respectively. The comparative results show that the RF outperforms with high performance parameters (accuracy, recall, precision and f score) better than NB; RF; DT and KNN. RF achieve the minimum loss values with all resampling techniques, and the results, when utilizing the proposed models on the entire skewed dataset, achieved preferable outcomes to the unbalanced dataset. Furthermore, the PyTorch framework achieves higher prediction accuracy for the federated learning model than the TensorFlow federated framework but with more computational time. [ABSTRACT FROM AUTHOR]

In the field of machine learning, clustering has become an increasingly popular research topic due to its critical importance. Many clustering algorithms have been proposed utilizing a variety of approaches. This study focuses on clustering of high-dimensional data using the maximum margin clustering approach. In this paper, two methods are introduced: The first method employs the classical maximum margin clustering approach, which separates data into two clusters with the greatest margin between them. The second method takes cluster compactness into account and searches for two parallel hyperplanes that best fit to the cluster samples while also being as far apart from each other as possible. Additionally, robust variants of these clustering methods are introduced to handle outliers and noise within the data samples. The stochastic gradient algorithm is used to solve the resulting optimization problems, enabling all proposed clustering methods to scale well with large-scale data. Experimental results demonstrate that the proposed methods are more effective than existing maximum margin clustering methods, particularly in high-dimensional clustering problems, highlighting the efficacy of the proposed methods. [ABSTRACT FROM AUTHOR]

Nowadays, machine learning (ML) has attained a high level of achievement in many contexts. Considering the significance of ML in medical and bioinformatics owing to its accuracy, many investigators discussed multiple solutions for developing the function of medical and bioinformatics challenges using deep learning (DL) techniques. The importance of DL in Internet of Things (IoT)-based bio- and medical informatics lies in its ability to analyze and interpret large amounts of complex and diverse data in real time, providing insights that can improve healthcare outcomes and increase efficiency in the healthcare industry. Several applications of DL in IoT-based bio- and medical informatics include diagnosis, treatment recommendation, clinical decision support, image analysis, wearable monitoring, and drug discovery. The review aims to comprehensively evaluate and synthesize the existing body of the literature on applying deep learning in the intersection of the IoT with bio- and medical informatics. In this paper, we categorized the most cutting-edge DL solutions for medical and bioinformatics issues into five categories based on the DL technique utilized: convolutional neural network, recurrent neural network, generative adversarial network, multilayer perception, and hybrid methods. A systematic literature review was applied to study each one in terms of effective properties, like the main idea, benefits, drawbacks, methods, simulation environment, and datasets. After that, cutting-edge research on DL approaches and applications for bioinformatics concerns was emphasized. In addition, several challenges that contributed to DL implementation for medical and bioinformatics have been addressed, which are predicted to motivate more studies to develop medical and bioinformatics research progressively. According to the findings, most articles are evaluated using features like accuracy, sensitivity, specificity, F-score, latency, adaptability, and scalability. [ABSTRACT FROM AUTHOR]

With the development of informatization, traditional industries have been seriously impacted by cross-border e-commerce (CBEC), and the financial management mode no longer meets the needs of CBEC users. As cross-border electronic trading platforms face enormous financial data challenges, they need financial supervision and effective network risk protection. Artificial intelligence (AI) can effectively improve the financial accounting ability and resource integration of platforms. However, at present, the underdeveloped financial management system of CBEC platforms and problems, such as the running records of platform funds have seriously hindered the development of the financial standardization of platforms because the financial management system affects managers' statistical analysis of financial data. Therefore, this paper analyzes the financial risks, the management problems and the causes of these problems of CBEC platforms and then uses AI to study the financial operation of CBEC platforms. Subsequently, this paper uses a machine learning (ML) algorithm to analyze the financial data clustering center and the security factor of the financial model. Finally, this paper proposes some corresponding strategies for financial model optimization and construction that can improve the information security and capital management of CBEC finance and promote the long-term development of CBEC platforms. The experimental results show that the classifier value and the safety factor of the financial model of CBEC platforms gradually increase under the ML algorithm. The mean value of the classifier value is approximately 1.14, and the mean value of the safety factor is approximately 1.37. Overall, the initial value of the classifier value of the platform financial model is 0.85, which increases to 1.41 on the seventh day, while the whole process increases by 0.56. The initial value of the safety factor of the platform financial model is 1.10, which increases to 1.64 on the seventh day, while the whole process increases by 0.54. The transaction information security and financial accounting accuracy of the CBEC platform financial model is better than that of the original financial model. The transaction information security is 10.4% higher than that of the original financial model, and the financial accounting accuracy is 10% higher than that of the original financial model. In other words, both AI and ML can promote the financial accounting standards and long-term development of CBEC platforms. [ABSTRACT FROM AUTHOR]

Today's factories are considered as smart ecosystems with humans, machines and devices interacting with each other for efficient manufacturing of products. Industry 4.0 is a suite of enabler technologies for such smart ecosystems that allow transformation of industrial processes. When implemented, Industry 4.0 technologies have a huge impact on efficiency, productivity and profitability of businesses. The adoption and implementation of Industry 4.0, however, require to overcome a number of practical challenges, in most cases, due to the lack of modernisation and automation in place with traditional manufacturers. This paper presents a first of its kind case study for moving a traditional food manufacturer, still using the machinery more than one hundred years old, a common occurrence for small- and medium-sized businesses, to adopt the Industry 4.0 technologies. The paper reports the challenges we have encountered during the transformation process and in the development stage. The paper also presents a smart production control system that we have developed by utilising AI, machine learning, Internet of things, big data analytics, cyber-physical systems and cloud computing technologies. The system provides novel data collection, information extraction and intelligent monitoring services, enabling improved efficiency and consistency as well as reduced operational cost. The platform has been developed in real-world settings offered by an Innovate UK-funded project and has been integrated into the company's existing production facilities. In this way, the company has not been required to replace old machinery outright, but rather adapted the existing machinery to an entirely new way of operating. The proposed approach and the lessons outlined can benefit similar food manufacturing industries and other SME industries. [ABSTRACT FROM AUTHOR]

Since much emphasis has been put on the eco-friendly manufacturing process in industries, and the complex changes in market demands, this paper focuses on a green scheduling problem of automated guided vehicles (AGVs) in a flexible manufacturing system (FMS). The studied FMS consists of multi-FMCs (flexible manufacturing cells) which have many material handling needs with time constraints. Distinguished from other AGV scheduling problems in FMS, this paper concentrates on the pickup and delivery operations or even bi-handling requirements of AGVs for FMCs, ignoring the inner production process within them. To solve this problem, a bi-objective mathematical model is built trying to minimize the total tardiness and energy consumption of AGVs simultaneously. Some properties of the problem and a no-collision algorithm are developed for the potential conflicts among AGVs. Due to the NP-hard nature of the proposed problem, a hyper-heuristic (HH) algorithm based on a double deep Q network (DDQN) is introduced, which benefits from the structures of double decision networks and multi-operator. To improve the performance of the proposed algorithm, the experience pool is used to increase the convergence speed and the crowding distance, and the non-dominated sorting strategies are presented to decide the acceptance of the new generation. Besides, in the DDQN, the states and rewards of agents are designed based on the characteristics of the scheduling problem. Finally, many experiments have been conducted and the computational results reveal that the proposed DDQN-HH algorithm outperforms the other two compared algorithms in both the convergence speed and quality of solutions. [ABSTRACT FROM AUTHOR]

With the advances in technology, assistive medical systems are emerging with rapid growth and helping healthcare professionals. The proactive diagnosis of diseases with artificial intelligence (AI) and its aligned technologies has been an exciting research area in the last decade. Doctors usually detect tuberculosis (TB) by checking the lungs' X-rays. Classification using deep learning algorithms is successfully able to achieve accuracy almost similar to a doctor in detecting TB. It is found that the probability of detecting TB increases if classification algorithms are implemented on segmented lungs instead of the whole X-ray. The paper's novelty lies in detailed analysis and discussion of U-Net + + results and implementation of U-Net + + in lung segmentation using X-ray. A thorough comparison of U-Net + + with three other benchmark segmentation architectures and segmentation in diagnosing TB or other pulmonary lung diseases is also made in this paper. To the best of our knowledge, no prior research tried to implement U-Net + + for lung segmentation. Most of the papers did not even use segmentation before classification, which causes data leakage. Very few used segmentations before classification, but they only used U-Net, which U-Net + + can easily replace because accuracy and mean_iou of U-Net + + are greater than U-Net accuracy and mean_iou , discussed in results, which can minimize data leakage. The authors achieved more than 98% lung segmentation accuracy and mean_iou 0.95 using U-Net + + , and the efficacy of such comparative analysis is validated. [ABSTRACT FROM AUTHOR]

Customers churn is an important issue that is always concerned by banks, and is put at the forefront of the bank's policies. The fact that banks can identify customers who are intending to leave the service can help banks promptly make policies to retain customers. In this paper, we propose a combined deep learning network models to predict customers leaving or staying at the bank. The proposed model consists of two levels, Level 0 consists of three basic models using three Deep Learning Neural Networks, and Level 1 is a logistic regression model. The proposed model has obtained evaluation results with accuracy metrics of 96.60%, precision metrics of 90.26%, recall metrics of 91.91% and F1 score of 91.07% on the dataset "Bank Customer Churn Prediction". [ABSTRACT FROM AUTHOR]

This paper addresses distributional offline continuous-time reinforcement learning (DOCTR-L) with stochastic policies for high-dimensional optimal control. A soft distributional version of the classical Hamilton–Jacobi–Bellman (HJB) equation is given by a semilinear partial differential equation (PDE). This 'soft HJB equation' can be learned from offline data without assuming that the latter correspond to a previous optimal or near-optimal policy. A data-driven solution of the soft HJB equation uses methods of Neural PDEs and Physics-Informed Neural Networks developed in the field of Scientific Machine Learning (SciML). The suggested approach, dubbed 'SciPhy RL', thus reduces DOCTR-L to solving neural PDEs from data. Our algorithm called Deep DOCTR-L converts offline high-dimensional data into an optimal policy in one step by reducing it to supervised learning, instead of relying on value iteration or policy iteration methods. The method enables a computable approach to the quality control of obtained policies in terms of both expected returns and uncertainties about their values. [ABSTRACT FROM AUTHOR]

Sleep is an essential physiological process that is crucial for human health and well-being. However, with the rise of technology and increasing work demands, people are experiencing more and more disrupted sleep patterns. Poor sleep quality and quantity can lead to a wide range of negative health outcomes, including obesity, diabetes, and cardiovascular disease. This research paper proposes a smart sleeping enhancement system, named SleepSmart, based on the Internet of Things (IoT) and continual learning using bio-signals. The proposed system utilizes wearable biosensors to collect physiological data during sleep, which is then processed and analyzed by an IoT platform to provide personalized recommendations for sleep optimization. Continual learning techniques are employed to improve the accuracy of the system's recommendations over time. A pilot study with human subjects was conducted to evaluate the system's performance, and the results show that SleepSmart can significantly improve sleep quality and reduce sleep disturbance. The proposed system has the potential to provide a practical solution for sleep-related issues and enhance overall health and well-being. With the increasing prevalence of sleep problems, SleepSmart can be an effective tool for individuals to monitor and improve their sleep quality. [ABSTRACT FROM AUTHOR]

Diabetic retinopathy (DR) is a human eye disease in which the eye's retina is damaged in diabetics. Diabetic retinopathy can be diagnosed by manually interpreting retinal fundus images, even though that takes longer to diagnose. Among these, the most challenging task in diagnosing the DR disease is edge detection in retinal fundus images to identify the region of infection and its severity. This paper aims to use the adaptive neural network-based Laplacian of Gaussian (AnLoG) classification algorithm on features extracted from diverse retinal fundus images to improve DR disease diagnostic accuracy and reduce training time. Based on the retinal fundus image in the Messidor dataset, the consequence of the proposed AnLoG classification algorithm for detecting diabetic retinopathy is compared to traditional supervised BPN machine learning algorithms and other contemporary techniques. AnLoG has proved its supremacy in terms of accuracy (97.29%), recall (94.64%), precision (93.13%), and F-Score (93.80%). Simulation results show that the proposed technique performs well compared to the existing approach. [ABSTRACT FROM AUTHOR]

Document classification is becoming increasingly essential for the vast number of documents available in digital libraries, emails, the Internet, etc. Textual records frequently contain non-discriminative (noisy and irrelevant) terms that are also high-dimensional, resulting in higher computing costs and poorer learning performance in Text Classification (TC). Feature selection (FS), which tries to discover discriminate terms or features from the textual data, is one of the most effective tasks for this issue. This paper introduces a novel multi-stage term-weighting scheme-based FS model designed for the single-label TC system to obtain the optimal set of features. We have also developed a hybrid deep learning fine-tuning network based on Bidirectional Long Short-Term Memory (BiLSTM) and Convolutional Neural Network (CNN) for the classification stage. The FS approach is worked on two-stage criteria. The filter model is used in the first stage, and the multi-objective wrapper model, an upgraded version of the Whale Optimization Algorithm (WOA) with Particle Swarm Optimization (PSO), is used in the second stage. The objective function in the above wrapper model is based on a tri-objective principle. It uses the Pareto front technique to discover the optimal set of features. Here in the wrapper model, a novel selection strategy has been introduced to select the whale instead of the random whale. The proposed work is evaluated on four popular benchmark text corpora, of which two are binary class, and two are multi-class. The suggested FS technique is compared against classic Machine Learning (ML) and deep learning classifiers. The results of the experiments reveal that the recommended FS technique is more effective in obtaining better results than the other results. [ABSTRACT FROM AUTHOR]

One of the significant aspects of our digital world is that data are literally everywhere, and it is increasing. On the other hand, the number of cyberattacks aiming to seize this data and use it illegally is increasing at an exponential rate, and this is the challenge. Therefore, intrusion detection systems (IDS) have attracted considerable interest from researchers and industries. In this regard, machine learning (ML) techniques are playing a pivotal role as they put the responsibility of analyzing enormous amounts of data, finding patterns, classifying intrusions, and solving issues on computers instead of humans. This paper implements two separate classification layers of ML-based algorithms with the recently published NF-UQ-NIDS-v2 dataset, preprocessing two volumes of sample records (100 k and 10 million), utilizing MinMaxScaler, LabelEncoder, selecting superlative features by recursive feature elimination, normalizing the data, and optimizing hyper-parameters for classical algorithms and neural networks. With a small dataset volume, the results of the classical algorithms layer show high detection accuracy rates for support vector (98.26%), decision tree (98.78%), random forest (99.07%), K-nearest neighbors (98.16%), CatBoost (99.04%), and gradient boosting (98.80%). In addition, the layer of neural network algorithms has proven to be a very powerful technology when using deep learning, particularly due to its unique ability to effectively handle enormous amounts of data and detect hidden correlations and patterns; it showed high detection results, which were (98.87%) for long short-term memory and (98.56%) for convolutional neural networks. [ABSTRACT FROM AUTHOR]

Any machine learning (ML) model is highly dependent on the data it uses for learning, and this is even more important in the case of deep learning models. The problem is a data bottleneck, i.e. the difficulty in obtaining an adequate number of cases and quality data. Another issue is improving the learning process, which can be done by actively introducing experts into the learning loop, in what is known as human-in-the-loop (HITL) ML. We describe an ML model based on a neural network in which HITL techniques were used to resolve the data bottleneck problem for the treatment of pancreatic cancer. We first augmented the dataset using synthetic cases created by a generative adversarial network. We then launched an active learning (AL) process involving human experts as oracles to label both new cases and cases by the network found to be suspect. This AL process was carried out simultaneously with an interactive ML process in which feedback was obtained from humans in order to develop better synthetic cases for each iteration of training. We discuss the challenges involved in including humans in the learning process, especially in relation to human–computer interaction, which is acquiring great importance in building ML models and can condition the success of a HITL approach. This paper also discusses the methodological approach adopted to address these challenges. [ABSTRACT FROM AUTHOR]

Cyberbullying detection systems rely increasingly on machine learning techniques. However, class imbalance in cyberbullying datasets, where the percentage of normal labeled classes is higher than that of abnormal labeled ones, presents a significant challenge for classification algorithms. This issue is particularly problematic in two-class datasets, where conventional machine learning methods tend to perform poorly on minority class samples due to the influence of the majority class. To address this problem, researchers have proposed various oversampling and undersampling techniques. In this paper, we investigate the effectiveness of such techniques in addressing class imbalance in cyberbullying datasets. We conduct an experimental study that involves a preprocessing step to enhance machine learning algorithm performance. We then examine the impact of imbalanced data on classification performance for four cyberbullying datasets. To study the classification performance on balanced cyberbullying datasets, we employ four resampling techniques, namely random undersampling, random oversampling, SMOTE, and SMOTE + TOMEK. We evaluate the impact of each rebalancing technique on classification performance using eight well-known classification algorithms. Our findings demonstrate that the performance of resampling techniques depends on the dataset size, imbalance ratio, and classifier used. The conducted experiments proved that there are no techniques that will always perform better the others. [ABSTRACT FROM AUTHOR]

Ground reaction force and moment (GRF&M) measurements are vital for biomechanical analysis and significantly impact the clinical domain for early abnormality detection for different neurodegenerative diseases. Force platforms have become the de facto standard for measuring GRF&M signals in recent years. Although the signal quality achieved from these devices is unparalleled, they are expensive and require laboratory setup, making them unsuitable for many clinical applications. For these reasons, predicting GRF&M from cheaper and more feasible alternatives has become a topic of interest. Several works have been done on predicting GRF&M from kinematic data captured from the subject's body with the help of motion capture cameras. The problem with these solutions is that they rely on markers placed on the whole body to capture the movements, which can be very infeasible in many practical scenarios. This paper proposes a novel deep learning-based approach to predict 3D GRF&M from only 5 markers placed on the shoe. The proposed network "Attention Guided MultiResUNet" can predict the force and moment signals accurately and reliably compared to the techniques relying on full-body markers. The proposed deep learning model is tested on two publicly available datasets containing data from 66 healthy subjects to validate the approach. The framework has achieved an average correlation coefficient of 0.96 for 3D ground reaction force prediction and 0.86 for 3D ground reaction momentum prediction in cross-dataset validation. The framework can provide a cheaper and more feasible alternative for predicting GRF&M in many practical applications. [ABSTRACT FROM AUTHOR]

Large amounts of cooling water are required for the cooling process in coal-fired or nuclear power plants. Because the primary use of water in a power plant is to condense steam and remove waste heat as part of a Rankine cycle, seawater temperature (SWT) is of critical importance for electrical output in power plant applications installed at the seaside. Moreover, the analysis of SWT is an important criterion for researching sea life and global climate, and it also serves as an important indicator of climate change. In this paper, multilayer perceptron, which is in the class of a feed-forward artificial neural network, deep learning approach based on long short-term memory and bidirectional long short-term memory neural networks and data-driven methods, such as adaptive neuro-fuzzy inference system (ANFIS) accompanied by fuzzy c-means, ANFIS with grid partition and ANFIS with subtractive clustering methods were applied to make 1-day ahead SWT predictions. Analyses were conducted using 5-year daily mean SWTs measured by the Turkish State Meteorological Service for Antalya province between 2014 and 2018. The models were evaluated using mean absolute error (MAE), root-mean-square error (RMSE), and correlation coefficient (R). According to the daily SWT prediction, the best MAE, RMSE, and R values were obtained with the ANFIS-SC model, which were 0.1877 °C, 0.2683 °C, and 0.99814, respectively. [ABSTRACT FROM AUTHOR]

Since 2020, novel coronavirus pneumonia has been spreading rapidly around the world, bringing tremendous pressure on medical diagnosis and treatment for hospitals. Medical imaging methods, such as computed tomography (CT), play a crucial role in diagnosing and treating COVID-19. A large number of CT images (with large volume) are produced during the CT-based medical diagnosis. In such a situation, the diagnostic judgement by human eyes on the thousands of CT images is inefficient and time-consuming. Recently, in order to improve diagnostic efficiency, the machine learning technology is being widely used in computer-aided diagnosis and treatment systems (i.e., CT Imaging) to help doctors perform accurate analysis and provide them with effective diagnostic decision support. In this paper, we comprehensively review these frequently used machine learning methods applied in the CT Imaging Diagnosis for the COVID-19, discuss the machine learning-based applications from the various kinds of aspects including the image acquisition and pre-processing, image segmentation, quantitative analysis and diagnosis, and disease follow-up and prognosis. Moreover, we also discuss the limitations of the up-to-date machine learning technology in the context of CT imaging computer-aided diagnosis. [ABSTRACT FROM AUTHOR]

Twin support vector regression (TSVR) has been widely applied in regression problems. TSVR seeks a pair of ε -insensitive proximal planes by solving two support vector machine type problems. TSVR assumes that the matrices appearing in the dual formulation are positive definite. However, in real-world scenarios, such an assumption may not be fulfilled and, hence, leads to suboptimal performance. ε -Twin support vector regression (ε -TSVR) improved the TSVR by introducing the regularisation term to avoid the singularity issues. Most of the twin support vector machine models involve the computation of matrix inverses. Also, TSVR implements the empirical risk minimization principle. In this paper, we propose an improved twin support vector regression (ITSVR) for brain age estimation by introducing different Lagrangian functions for the primal problems of the TSVR. The proposed ITSVR implements the structural risk minimization principle and avoids the computation of the matrix inverses. To solve the optimization problem more efficiently, we used successive overrelaxation (SOR) technique. We evaluated the proposed ITSVR on cognitively healthy subjects, mild cognitive impairment subjects and Alzheimer's disease subjects. The experimental results demonstrate that the proposed ITSVR has superior performance compared to the baseline models for brain age estimation. [ABSTRACT FROM AUTHOR]

Human-to-machine (H2M) communication is an important evolution in the industrial internet of health things (IIoHT), where many H2M interfaces are remotely interacting with industrial and medical assets. Lightweight protocols, such as constrained application protocol (CoAP), have been widely utilised in transferring sensing data of medical devices to end-users in smart satellite-based healthcare IIoT networks (SmartSat-IIoHT). However, such protocols are extensively deployed without appropriate security configurations, making attackers' mission easier for abusing these protocols to launch advanced cyber threats. This paper, therefore, presents a new threat intelligence framework to examine and model CoAP protocol's attacks in these systems. We present a ransom denial of service (RDoS) as a new threat that would exploit this protocol's vulnerabilities. We propose many RDoS attack's techniques to understand the attack indicators and analyse their behaviour on systems. Moreover, we present a real-time discovery of attacks' network behaviours using deep learning. The experiment results demonstrate that this proposed discovery model obtains a better performance in revealing RDoS than other conventional machine learning algorithms and accomplishing high fidelity of protecting SmartSat-IIoHT networks. [ABSTRACT FROM AUTHOR]

This paper investigates how to solve image classification with Hopfield neural networks (HNNs) and oscillatory neural networks (ONNs). This is a first attempt to apply ONNs for image classification. State-of-the-art image classification networks are multi-layer models trained with supervised gradient back-propagation, which provide high-fidelity results but require high energy consumption and computational resources to be implemented. On the contrary, HNN and ONN networks are single-layer, requiring less computational resources, however, they necessitate some adaptation as they are not directly applicable for image classification. ONN is a novel brain-inspired computing paradigm that performs low-power computation and is attractive for edge artificial intelligence applications, such as image classification. In this paper, we perform image classification with HNN and ONN by exploiting their auto-associative memory (AAM) properties. We evaluate precision of HNN and ONN trained with state-of-the-art unsupervised learning algorithms. Additionally, we adapt the supervised equilibrium propagation (EP) algorithm to single-layer AAM architectures, proposing the AAM-EP. We test and validate HNN and ONN classification on images of handwritten digits using a simplified MNIST set. We find that using unsupervised learning, HNN reaches 65.2%, and ONN 59.1% precision. Moreover, we show that AAM-EP can increase HNN and ONN precision up to 67.04% for HNN and 62.6% for ONN. While intrinsically HNN and ONN are not meant for classification tasks, to the best of our knowledge, these are the best-reported precisions of HNN and ONN performing classification of images of handwritten digits. [ABSTRACT FROM AUTHOR]

There are many methods for explaining why a machine learning model produces a given output in response to a given input. The relative merits of these methods are often debated using theoretical arguments and illustrative examples. This paper provides a large-scale empirical test of four widely used explanation methods by comparing how well their algorithmically generated denial reasons align with lender-provided denial reasons using a dataset of home mortgage applications. On a held-out sample of 10,000 denied applications, Shapley additive explanations (SHAP) correspond most closely with lender-provided reasons. SHAP is also the most computationally efficient. As a second contribution, this paper presents a method for computing integrated gradient explanations that can be used for non-differentiable models such as XGBoost. [ABSTRACT FROM AUTHOR]

With the increased use of social network sites, such as Twitter, attackers exploit these platforms to spread counterfeit content. Such content can be fake advertisements or illegal content. Classifying such content is a challenging task, especially in Arabic. The Arabic language has a complex structure and makes classification tasks more difficult. This paper presents an approach to classifying Arabic tweets using classical machine learning (non-deep machine learning) and deep learning techniques. Tweets corpus were collected through Twitter API and labelled manually to get a reliable dataset. For an efficient classifier, feature extraction is applied to the corpus dataset. Then, two learning techniques are used for each feature extraction technique on the created dataset using N-gram models (uni-gram, bi-gram, and char-gram). The applied classical machine learning algorithms are support vector machines, neural networks, logistics regression, and naïve Bayes. Global vector (GloVe) and fastText learning models are utilised for the deep learning approaches. The Precision, Recall, and F1-score are the suggested performance measures calculated in this paper. Afterwards, the dataset is increased using the synthetic minority oversampling technique class to create a balanced dataset. After applying the classical machine learning models, the experimental results show that the neural network algorithm outperforms the other algorithms. Moreover, the GloVe outperforms the fastText model for the deep learning approach. [ABSTRACT FROM AUTHOR]

Acute lymphocytic leukemia (ALL) is a common serious cancer in white blood cells (WBC) that advances quickly and produces abnormal cells in the bone marrow. Cancerous cells associated with ALL lead to impairment of body systems. Microscopic examination of ALL in a blood sample is applied manually by hematologists with many defects. Computer-aided leukemia image detection is used to avoid human visual recognition and to provide a more accurate diagnosis. This paper employs the ensemble strategy to detect ALL cells versus normal WBCs using three stages automatically. Firstly, image pre-processing is applied to handle the unbalanced database through the oversampling process. Secondly, deep spatial features are generated using a convolution neural network (CNN). At the same time, the gated recurrent unit (GRU)-bidirectional long short-term memory (BiLSTM) architecture is utilized to extract long-distance dependent information features or temporal features to obtain active feature learning. Thirdly, a softmax function and the multiclass support vector machine (MSVM) classifier are used for the classification mission. The proposed strategy has the resilience to classify the C-NMC 2019 database into two categories by using splitting the entire dataset into 90% as training and 10% as testing datasets. The main motivation of this paper is the novelty of the proposed framework for the purposeful and accurate diagnosis of ALL images. The proposed CNN-GRU-BiLSTM-MSVM is simply stacked by existing tools. However, the empirical results on C-NMC 2019 database show that the proposed framework is useful to the ALL image recognition problem compared to previous works. The DenseNet-201 model yielded an F1-score of 96.23% and an accuracy of 96.29% using the MSVM classifier in the test dataset. The findings exhibited that the proposed strategy can be employed as a complementary diagnostic tool for ALL cells. Further, this proposed strategy will encourage researchers to augment the rare database, such as blood microscopic images by creating powerful applications in terms of combining machine learning with deep learning algorithms. [ABSTRACT FROM AUTHOR]

Broad-XAI moves away from interpreting individual decisions based on a single datum and aims to provide integrated explanations from multiple machine learning algorithms into a coherent explanation of an agent's behaviour that is aligned to the communication needs of the explainee. Reinforcement Learning (RL) methods, we propose, provide a potential backbone for the cognitive model required for the development of Broad-XAI. RL represents a suite of approaches that have had increasing success in solving a range of sequential decision-making problems. However, these algorithms operate as black-box problem solvers, where they obfuscate their decision-making policy through a complex array of values and functions. EXplainable RL (XRL) aims to develop techniques to extract concepts from the agent's: perception of the environment; intrinsic/extrinsic motivations/beliefs; Q-values, goals and objectives. This paper aims to introduce the Causal XRL Framework (CXF), that unifies the current XRL research and uses RL as a backbone to the development of Broad-XAI. CXF is designed to incorporate many standard RL extensions and integrated with external ontologies and communication facilities so that the agent can answer questions that explain outcomes its decisions. This paper aims to: establish XRL as a distinct branch of XAI; introduce a conceptual framework for XRL; review existing approaches explaining agent behaviour; and identify opportunities for future research. Finally, this paper discusses how additional information can be extracted and ultimately integrated into models of communication, facilitating the development of Broad-XAI. [ABSTRACT FROM AUTHOR]

Parkinson's disease (PD) is a neurological disease that has been reported to have affected most people worldwide. Recent research pointed out that about 90% of PD patients possess voice disorders. Motivated by this fact, many researchers proposed methods based on multiple types of speech data for PD prediction. However, these methods either face the problem of low rate of accuracy or lack generalization. To develop an approach that will be free of these issues, in this paper we propose a novel ensemble approach. These paper contributions are two folds. First, investigating feature selection integration with deep neural network (DNN) and validating its effectiveness by comparing its performance with conventional DNN and other similar integrated systems. Second, development of a novel ensemble model namely EOFSC (Ensemble model with Optimal Features and Sample Dependant Base Classifiers) that exploits the findings of recently published studies. Recent research pointed out that for different types of voice data, different optimal models are obtained which are sensitive to different types of samples and subsets of features. In this paper, we further consolidate the findings by utilizing the proposed integrated system and propose the development of EOFSC. For multiple types of vowel phonations, multiple base classifiers are obtained which are sensitive to different subsets of features. These features and sample-dependent base classifiers are integrated, and the proposed EOFSC model is constructed. To evaluate the final prediction of the EOFSC model, the majority voting methodology is adopted. Experimental results point out that feature selection integration with neural networks improves the performance of conventional neural networks. Additionally, feature selection integration with DNN outperforms feature selection integration with conventional machine learning models. Finally, the newly developed ensemble model is observed to improve PD detection accuracy by 6.5%. [ABSTRACT FROM AUTHOR]

The paper presents a novel manifold learning algorithm, the deep Gaussian process autoencoder (DPGA), based on deep Gaussian processes. Deep Gaussian process autoencoder algorithm has the following two main characteristics. The former is a bottleneck structure, borrowed by variational autoencoders and the latter is based on the so-called doubly stochastic variational inference for deep Gaussian processes architecture (DSVI). The main novelties of the paper consist in DGPA algorithm and the experimental protocol for evaluating it. In fact, to the best of our knowledge, deep Gaussian processes algorithms have not been applied to manifold learning, yet. Besides, an experimental protocol is introduced, the so-called manifold learning performance protocol (MLPP), to compare quantitatively the geometric preserved properties of manifold learning projections of the proposed deep Gaussian process autoencoder with the ones of state-of-the-art manifold learning algorithms. Extensive experimental tests on eleven synthetic and five real datasets show that deep Gaussian process autoencoder compares favorably with the other manifold learning competitors. [ABSTRACT FROM AUTHOR]

"Digital" agriculture is rapidly affecting the value of agricultural output. Robotic picking of the ripe agricultural product enables accurate and rapid picking, making agricultural harvesting intelligent. How to increase product output has also become a challenge for digital agriculture. During the cherry growth process, realizing the rapid and accurate detection of cherry fruits is the key to the development of cherry fruits in digital agriculture. Due to the inaccurate detection of cherry fruits, environmental problems such as shading have become the biggest challenge for cherry fruit detection. This paper proposes an improved YOLO-V4 deep learning algorithm to detect cherry fruits. This model is suitable for cherry fruits with a small volume. It is proposed to increase the network based on the YOLO-V4 backbone network CSPDarknet53 network, combined with DenseNet The density between layers, the a priori box in the YOLO-V4 model, is changed to a circular marker box that fits the shape of the cherry fruit. Based on the improved YOLO-V4 model, the feature extraction is enhanced, the network structure is deepened, and the detection speed is improved. To verify the effectiveness of this method, different deep learning algorithms of YOLO-V3, YOLO-V3-dense and YOLO-V4 are compared. The results show that the mAP (average accuracy) value obtained by using the improved YOLO-V4 model (YOLO-V4-dense) network in this paper is 0.15 higher than that of yolov4. In actual orchard applications, cherries with different ripeness of cherries in the same area can be detected, and the fruits with larger ripeness differences can be artificially intervened, and finally, the yield of cherry fruits can be increased. [ABSTRACT FROM AUTHOR]

The constrained 0-1 quadratic programming problem (CBQP) is an important problem of integer programming, and many combinatorial optimization problems can be converted to CBQP problem. Because BQP is NP-hard problem, the solving time and accuracy of traditional optimization algorithm are very dependent on the size of the problem, and the local optimal solution obtained by the heuristic algorithm is unstable. Deep learning algorithm has great advantages in solving such problems. In this paper, for the CBQP problem with linear constraints, we creatively apply two algorithms and models to solve it: the graph pointer network model (GPN) trained by hierarchical reinforcement learning (HRL), and the multi-head attention-based pointer network model trained by Advantage Actor-Critic (A2C), which greatly improves the solving speed, accuracy and constraint satisfaction rate of CBQP problems of different scales. At the same time, the bidirectional mask mechanism is innovatively introduced into the network so that the constraint satisfaction rate of the solution is very high. For the two algorithms, this paper solved the 0-1 knapsack (BKP) problem and the quadratic knapsack (QKP) problem, which are equivalent to the CBQP problem, and compared the results of the CBQP problem with different data distribution and scales. The experiment shows that no matter the objective function of the CBQP problem is linear or nonlinear, different data set distribution, or the scale, the pointer network trained by reinforcement learning in this paper has better results than traditional optimization algorithms in solving time, accuracy, stability and constraint satisfaction rate, and with the increase in the size of the problem, this advantage becomes more obvious. [ABSTRACT FROM AUTHOR]

Social bots are automated social media accounts governed by software and controlled by humans at the backend. Some bots have good purposes, such as automatically posting information about news and even to provide help during emergencies. Nevertheless, bots have also been used for malicious purposes, such as for posting fake news or rumour spreading or manipulating political campaigns. There are existing mechanisms that allow for detection and removal of malicious bots automatically. However, the bot landscape changes as the bot creators use more sophisticated methods to avoid being detected. Therefore, new mechanisms for discerning between legitimate and bot accounts are much needed. Over the past few years, a few review studies contributed to the social media bot detection research by presenting a comprehensive survey on various detection methods including cutting-edge solutions like machine learning (ML)/deep learning (DL) techniques. This paper, to the best of our knowledge, is the first one to only highlight the DL techniques and compare the motivation/effectiveness of these techniques among themselves and over other methods, especially the traditional ML ones. We present here a refined taxonomy of the features used in DL studies and details about the associated pre-processing strategies required to make suitable training data for a DL model. We summarize the gaps addressed by the review papers that mentioned about DL/ML studies to provide future directions in this field. Overall, DL techniques turn out to be computation and time efficient techniques for social bot detection with better or compatible performance as traditional ML techniques. [ABSTRACT FROM AUTHOR]

Gestational diabetes mellitus (GDM) is one of the pregnancy complications that poses a significant risk on mothers and babies as well. GDM usually diagnosed at 22–26 of gestation. However, the early prediction is desirable as it may contribute to decrease the risk. The continuous monitoring for mother's vital signs helps in predicting any deterioration during pregnancy. The originality of this paper is to provide comprehensive framework for pregnancy women monitoring. The proposed Data Replacement and Prediction Framework consists of three layers which are: (i) IoT Layer, (ii) Fog Layer, and (iii) Cloud Layer. The first layer used IOT sensors to aggregate vital sings from pregnancies using invasive and noninvasive sensors. Then the vital signs transmitted to fog nodes to processed and finally stored in the cloud layer. The main contribution in this paper is located in the fog layer producing GDM module to implement two influential tasks which are: (i) Data Finding Methodology (DFM), and (ii) Explainable Prediction Algorithm (EPM) using DNN. First, the DFM is used to replace the unused data to free the cache space for the new incoming data items. The cache replacement is very important in the case of healthcare system as the incoming vital signs are frequent and must be replaced continuously. Second, the EPM is used to predict the incidence of GDM that may occur in the second trimester of the pregnancy. To evaluate our model, we extract data of 16,354 pregnancy women from medical information mart for intensive care (MIMIC III) benchmark dataset. For each woman, vital signs, demographic data and laboratory tests was aggregated. The results of the prediction model superior the state of the art (ACC = 0.957, AUC = 0.942). Regarding to explainability, we utilized Shapley additive explanation framework to provide local and global explanation for the developed models. Overall, the proposed framework is medically intuitive, allow the early prediction of GDM with cost effective solution. [ABSTRACT FROM AUTHOR]