Search

Due to the uncertainty of geological conditions during the tunneling process, advanced prediction of TBM tunneling parameters is significant for evaluating operational safety and efficiency, especially for real-time prediction of key tunneling parameters during the steady phase of TBM operation. At present, although there are studies on constructing predictive models based on machine learning algorithms, multiparameter prediction consistent with the actual tunneling process remains challenging due to the complexity of the TBM tunneling process and the numerous tunneling parameters. Therefore, this paper proposes a real-time multiple tunneling parameters prediction method of TBM steady phase based on dual recurrent neural networks. Firstly, the irregular multidimensional time series of tunneling parameters are analyzed and processed, which are divided into an idle-push phase, a rising phase, and a steady phase; secondly, the parameters of rising phase are analyzed using a recurrent neural network, and the parameters relevant for constructing a real-time prediction model are screened; then, based on the screened parameters, the Bayesian-optimized gated recurrent unit (GRU, a kind of recursive neural network) is proposed to construct a real-time prediction model for the four key tunneling parameters during the steady phase. Finally, the effectiveness and practicality of the proposed method are demonstrated by verification on real TBM tunnel datasets and comparing it with the models constructed by six commonly used machine learning algorithms. The results of this paper show that the designed prediction method is able to achieve a good combination of performance in terms of accuracy and computational time-consumption, with an average prediction accuracy of 91.1% for the four parameters for different rock grades of geology, the multiparameter prediction time for 100 samples is only 11 ms. In addition, three current similar studies using deep learning methods were compared to demonstrate the superiority of this proposal. As a method more closer to practical application, this work provides guidance for the forward-looking prediction of TBM tunneling parameters. [ABSTRACT FROM AUTHOR]

Mental stress is a common problem that affects individuals all over the world. Stress reduces human functionality during routine work and may lead to severe health defects. Early detection of stress is important for preventing diseases and other negative health-related consequences of stress. Several neuroimaging techniques have been utilized to assess mental stress, however, due to its ease of use, robustness, and non-invasiveness, electroencephalography (EEG) is commonly used. This paper aims to fill a knowledge gap by reviewing the different EEG-related deep learning algorithms with a focus on Convolutional Neural Networks (CNNs) and Long Short-Term Memory networks (LSTMs) for the evaluation of mental stress. The review focuses on data representation, individual deep neural network model architectures, hybrid models, and results amongst others. The contributions of the paper address important issues such as data representation and model architectures. Out of all reviewed papers, 67% used CNN, 9% LSTM, and 24% hybrid models. Based on the reviewed literature, we found that dataset size and different representations contributed to the performance of the proposed networks. Raw EEG data produced classification accuracy around 62% while using spectral and topographical representation produced up to 88%. Nevertheless, the roles of generalizability across different deep learning models and individual differences remain key areas of inquiry. The review encourages the exploration of innovative avenues, such as EEG data image representations concurrently with graph convolutional neural networks (GCN), to mitigate the impact of inter-subject variability. This novel approach not only allows us to harmonize structural nuances within the data but also facilitates the integration of temporal dynamics, thereby enabling a more comprehensive assessment of mental stress levels. [ABSTRACT FROM AUTHOR]

Historical architecture has different special styles attributed to each era, dynasty, or region. These styles are common features such as geometric properties, ratios, scales, colors, and artistic techniques. Historical geometric ornaments have an enormous capability for classification based on their geometric characteristics. Smart pattern recognition allows researchers to classify huge databases of heritage for useful internet searches. So, our main goal in this paper is to implement the detection of categories in geometric patterns for classification and documentation in which by the photography of ornaments in every monument, the type of patterns and the number of every type of pattern would be estimated quickly. Furthermore, due to occurring deterioration in these patterns, our method also contributes to recognizing the deteriorated patterns. When we encounter numerous pieces of deteriorated patterns, manual recognition in order to reassemble and reconstruct is usually impossible or time-consuming. With the aid of artificial intelligence, in this paper, our aim is to seek to solve the automatic recognition of historical geometric patterns, even patterns having deterioration as an occlusion via image processing and machine learning methods. A challenging issue that researchers would tackle in detecting historical geometric pattern's types is the variety in geometric textures, especially when they have occlusion such as deterioration. This issue leads to limited success in classifying via extracting only one feature. The other issue is that the extracted feature must be invariant to the transformation, such as scale, rotation, and noise variation. To cope with the challenges mentioned above and accurately classify, we plan to use the fusion method based on extracting global and local features. So, the features extracted from images in this research are based on local and global. In other words, the proposed fusion strategy lies both in feature and decision level, but the core is the proposed three combination methods in fusion decision methods. In this method, the dataset is composed of four main Persian geometric pattern types: Tond dah, Kond tablghenas, Hashtva 4 lengeh, and HashtvatablKond. So, the model will be trained by extracting global and local features of the images separately. Random forest, as the prevalent machine learning algorithm, is proposed for training data and predicting the class of input images. Finally, the probability of prediction for random forest classifiers is fused by the Decision Templates (DT) combiner, Naïve Bayes (NB) combiner, and Dempster–Shafer combination methods. In comparison with the individual classifier accuracy results of 80% and 85% for global and local features respectively, our proposed approach achieves an improved accuracy of 90%, 88%, and 90% in three fusion decision methods including DT combiner, NB combiner, and Dempster–Shafer combination methods. [ABSTRACT FROM AUTHOR]

Recent increases in global food demand have made this research and, therefore, the prediction of agricultural commodity prices, almost imperative. The aim of this paper is to build efficient artificial intelligence methods to effectively forecast commodity prices in light of these global events. Using three separate, well-structured models, the commodity prices of eleven major agricultural commodities that have recently caused crises around the world have been predicted. In achieving its objective, this paper proposes a novel forecasting model for agricultural commodity prices using the extreme learning machine technique optimized with the genetic algorithm. In predicting the eleven commodities, the proposed model, the extreme learning machine with the genetic algorithm, outperforms the model formed by the combination of long short-term memory with the genetic algorithm and the autoregressive integrated moving average model. Despite the fluctuations and changes in agricultural commodity prices in 2022, the extreme learning machine with the genetic algorithm model described in this study successfully predicts both qualitative and quantitative behavior in such a large number of commodities and over such a long period of time for the first time. It is expected that these predictions will provide benefits for the effective management, direction and, if necessary, restructuring of agricultural policies by providing food requirements that adapt to the dynamic structure of the countries. [ABSTRACT FROM AUTHOR]

Demand response, and artificial intelligence integration with it, have a considerable effect in optimizing energy consumption, grid stability, and promoting sustainable energy practices. Consequently, this paper presents NeuroQuMan, a comprehensive methodology for simulating demand response using a three-Qubit quantum neural network (QNN) model. NeuroQuMan integrates quantum computing and machine learning techniques to accurately predict demand based on user reaction time. The methodology encompasses an advanced structure that includes data preprocessing, three-Qubit quantum device initialization, quantum circuit definition, user decision-making, QNN predictions, loss calculations, and visualization. During the tests, NeuroQuMan achieved considerable performance values of metrics, with RMSPE of 5.41%, MAPE of 4.43%, as well as MAE of 0.37, RMSE of 0.45, and MSE of 0.21, respectively. These metrics manifest the accuracy and effectiveness of NeuroQuMan in predicting demand response. By the side of future perspectives of the work, it explores the application of advanced quantum techniques to further enhance prediction accuracy. NeuroQuMan represents the potential of quantum computing in addressing demand response challenges and provides a pathway toward more resilient and intelligent energy management systems. The findings and framework presented in this paper are utilized to advance the field of demand response and quantum-based energy management techniques using a three-Qubit structure. [ABSTRACT FROM AUTHOR]

Deep learning-based segmentation models often struggle to achieve optimal performance when encountering new, unseen semantic classes. Their effectiveness hinges on vast amounts of annotated data and high computational resources for training. However, a promising solution to mitigate these challenges is the adoption of few-shot segmentation (FSS) networks, which can train models with reduced annotated data. The inherent complexity of medical images limits the applicability of FSS in medical imaging, despite its potential. Recent advancements in self-supervised label-efficient FSS models have demonstrated remarkable efficacy in medical image segmentation tasks. This paper presents a novel FSS architecture that enhances segmentation accuracy by utilising fewer features than existing methodologies. Additionally, this paper proposes a novel self-supervised learning approach that utilises supervoxel and augmented superpixel images to further enhance segmentation accuracy. This paper assesses the efficacy of the proposed model on two different datasets: abdominal magnetic resonance imaging (MRI) and cardiac MRI. The proposed model achieves a mean dice score and mean intersection over union of 81.62% and 70.38% for abdominal images, and 79.38% and 65.23% for cardiac images. [ABSTRACT FROM AUTHOR]

In an era in which cardiovascular disease has become the main cause of death all over the world, diagnostic accuracy in identifying blood vessels has become particularly important. Vascular stenosis causes serious health risks by affecting blood flow, leading to conditions like heart attacks and strokes. Traditional diagnostic methods face challenges in terms of timeliness and accuracy. Our systematic review aims to critically assess the role of machine learning (ML) techniques in enhancing computed tomography angiography's (CTA) diagnostic capabilities for vasoconstriction. This review followed the predetermined inclusion and exclusion criteria and focused on research articles published between January 2013 and October 2023 collected from databases such as PubMed, IEEE, Web of Science, and Scopus. Studies focus on multiphase CTA or dynamic CTA; papers do not use the ML; and papers not in English are removed. The risk of bias of included studies was evaluated using the QUADAS2 tool. The results were analyzed in tabular form using metrics such as accuracy, sensitivity, and specificity and examine variations in stenosis detection by anatomical regions. In our review, a total of 63 studies were identified as relevant. These studies included a variety of ML applications for identifying anatomical stenosis of the arteries in different anatomical areas. The findings highlighted a trend of high sensitivity and specificity in broader anatomical assessments, with nuanced variations observed in detailed segmental analysis. The review acknowledges limitations within the existing studies, including the retrospective nature of most studies and their limited scope in terms of patient diversity and center variation. Nonetheless, the implications of integrating ML in vascular stenosis detection via CTA are profound, suggesting a pivotal shift toward more accurate, efficient, and patient-centric diagnostic practices in cardiovascular care. Registration: The protocol for this systematic review and meta-analysis was registered on PROSPERO, with the registration number CRD420234603. [ABSTRACT FROM AUTHOR]

This paper investigates the art design of user interaction experience in mobile systems through the methods of contextual perception and machine learning. The theoretical foundations for the design of intangible cultural heritage interactive display resources include digital display theory, intangible cultural heritage education theory, embodied cognition theory, and gamification design theory. Based on the modelling and analysis of the theoretical foundations, the design principles are derived, including the heritage education principle, the somatic interaction design principle, and the content design principle. In this paper, we use ontologies to construct user knowledge models, fuse multi-situational similarity metrics, screen out candidate neighbour sets through preliminary screening, then combine the user's activity to construct time-based weight tensor scores, use tensor decomposition to obtain recommendation evaluation values, and finally use the recommendation evaluation values to make artistic recommendations. The experimental results show that the algorithm can still obtain a good recommendation implementation in the case of extremely sparse data. The analysis of the fit between augmented reality and folk art appreciation class, as well as the reference to relevant application cases, make design and practice of augmented reality application in folk art appreciation class, try to solve the common problems in folk art appreciation class, analyse the feedback effect and make a summary and outlook. [ABSTRACT FROM AUTHOR]

In recent years, the proliferation of vehicles on roadways, accompanied by an escalating demand for augmented safety and refined traffic management, has fueled substantial progress in the domains of computer vision and deep learning methodologies. This technological surge has precipitated ground-breaking applications, with real-time vehicle detection emerging as a linchpin. Capability to accurately detect vehicles in a real-time holds profound implications across diverse domains. In the context of autonomous driving, it underpins essential functions such as path planning, collision avoidance, and decision-making, essential for the safe operation of autonomous vehicles. In the arena of traffic monitoring, it empowers transportation authorities to acquire real-time insights into traffic dynamics, congestion patterns, and incident detection, thereby optimizing traffic flow and resource allocation strategies. Furthermore, within surveillance systems, real-time vehicle detection equips security personnel with the means to swiftly identify potential security threats, enhancing overall situational awareness and safety. This paper contributes to this dynamic landscape by introducing an innovative architecture expressly crafted for vehicle detection. Leveraging state-of-the-art computer vision techniques and deep learning methodologies, this architecture addresses the evolving challenges posed by contemporary traffic scenarios. Through the enhancement of real-time vehicle detection capabilities, our aim is to fortify the foundations of safety, efficiency, and security within vehicular contexts. The paper includes a fusion of AlexNet and Darknet accompanied by a comparative analysis. It is expected to deliver unmatched dependability and accuracy in real-time traffic monitoring, setting a new standard for performance in this application. [ABSTRACT FROM AUTHOR]

The importance of technology and managerial risk management in banks has increased due to the financial crisis. Banks are the most affected since there are so many of them with poor financial standing. Due to this problem, an unstable and inefficient financial system causes economic stagnation in both the banking sector and overall economy. Data envelopment analysis (DEA) has been used to examine decision-making units (DMUs) performance to enhance efficiency. Currently, with the rapid growth of big data, adding more DMUs will likely require a large amount of memory and CPU time on the computer system, which will be the biggest challenge. As a result, machine learning (ML) approaches have been used to analyze financial institution performance, but many of them have variances in predictions or model stability, making measuring bank efficiency extremely difficult. For this, ensemble learning is commonly used to evaluate the performance of financial institutions in this context. This paper presents a robust super learner ensemble technique for assessing bank efficiency, with four machine learning models serving as base learners. These models are the support vector machine (SVM), K-nearest neighbors (KNN), random forest (RF), and AdaBoost classifier (ADA) which represent the base learners and their results utilized to train the meta-learner. The super learner (SL) approach is an extension of the stacking technique, which generates an ensemble based on cross-validation. One important benefit of this cross-validation theory-based technique is that it can overcome the overfitting issue that plagues most other ensemble approaches. When SL and base learners were compared for their forecasting abilities using different statistical standards, the results showed that the SL is superior to the base learners, where different variable combinations were used. The SL had accuracy (ACC) of 0.8636–0.9545 and F1-score (F1) of 0.9143–0.9714, while the basic learners had ACC of 0.5909–0.8182 and F1 of 0.6897–0.9143. So, SL is highly recommended for improving the accuracy of financial data forecasts, even with limited financial data. [ABSTRACT FROM AUTHOR]

Long time series forecasting (LTSF), which involves modeling relationships within long time series to predict future values, has extensive applications in domains such as weather forecasting, financial analysis, and traffic prediction. Recently, numerous transformer-based models have been developed to address the challenges in LTSF. These models employ methods such as sparse attention to alleviate the inefficiencies associated with the attention mechanism and utilize decomposition architecture to enhance the predictability of the series. However, these complexity reduction methods necessitate additional calculations, and the series decomposition architecture overlooks the random components. To overcome these limitations, this paper proposes the Frequency Enhanced Decomposed Attention Free Transformer (FEDAF). FEDAF introduces two variants of the Frequency Enhanced Attention Free Mechanism (FEAFM), namely FEAFM-s and FEAFM-c, which seamlessly replace self-attention and cross-attention. Both variants perform calculations in the frequency domain without incurring additional costs, with the time and space complexity of FEAFM-s being O (L log L) . Additionally, FEDAF incorporates a time series decomposition architecture that considers random components. Unlike other models that solely decompose the series into trend and seasonal components, FEDAF also eliminates random terms by applying Fourier denoising. Our study quantifies data drift and validates that the proposed decomposition structure can mitigate the adverse effects caused by data shift. Overall, FEDAF demonstrates superior forecasting performance compared to state-of-the-art models across various domains, achieving a remarkable improvement of 19.49% for Traffic in particular. Furthermore, an efficiency analysis reveals that FEAFM enhances space efficiency by 12.8% compared to the vanilla attention mechanism and improves time efficiency by 43.63% compared to other attention mechanism variants. [ABSTRACT FROM AUTHOR]

Invasive sea lamprey (Petromyzon marinus) has historically inflicted considerable economic and ecological damage in the Great Lakes and continues to be a major threat. Accurately monitoring sea lampreys are critical to enabling the deployment of more targeted and effective control measures to minimize the impact associated with this species. This paper presents the first stand-alone system for real-time detection of sea lamprey attachment on underwater surfaces through the use of classifier models deployed on a microcontroller system. A range of low-complexity models was explored: single-layer artificial neural networks, logistic regression, Gaussian Naive-Bayes, decision trees, random forest, and Scalable, Efficient, and Fast classifieR (SEFR). Threshold models tuned using a multi-objective optimization formulation were also considered. Classifier models were trained with a dataset generated through live animal testing and presented accuracies between 80 and 86%. The models were deployed on an Arduino microcontroller platform and compared in classification accuracy, detection performance, time complexity, and memory size using real-time detection testing. Classification accuracies between 65 and 75% were observed during validation. Models demonstrated good capture rates for lamprey attachments (63–85%), and average detection delays ranging from 9 to 36 s. A video demonstrating the operation of the system during a real-time validation test is also included in this work. While there is room for improving the accuracy of the system, this research presents the first step toward an electronic sea lamprey monitoring system that can provide a detailed view of sea lamprey activity enhancing control and conservation efforts across its entire range. [ABSTRACT FROM AUTHOR]

Entrepreneurs and small businesses have increasingly used reward-based crowdfunding to raise capital for their creative projects, whose success is central to this industry. Thus, predicting the success of crowdfunding campaigns is a topic of great importance for entrepreneurs and platform managers. The literature that employs monolithic classifiers and static ensemble learning for crowdfunding success prediction are scarce. In contrast, the dynamic selection (DS) algorithm, which belongs to the ensemble learning category, deserves a particular remark since it has overcome traditional monolithic classifiers and static ensembles in many applications. This paper proposes a dynamic selection framework for reward crowdfunding prediction. DS algorithms select a competent subset of the classifier per query instance. This procedure is performed during the generalization, and the subset is composed of local experts, favoring an increase in accuracy. Fifteen machine learning models are evaluated using three metrics (accuracy, area under the ROC curve and F-score), and ensemble learning obtained better results than traditional classifiers. In particular, Meta-DES, which performs dynamic selection, obtains the best overall results among the evaluated models. Furthermore, since usually interpreting the output of ML models is considered to be very difficult due to their complex "black box" architecture, we also use Shapley additive explanations to interpret the perdition's outputs. Among variables evaluated in our models, the textual sentiment of the mass media, the number of pledges, and the target amount of the campaign deserve a highlight when predicting the campaign's success. The source-code and further details about the experimental analysis are available at https://github.com/las33/Crowdfunding. [ABSTRACT FROM AUTHOR]

This paper introduces a new learning-based approach for approximately solving the Kidney-Exchange Problem (KEP), an NP-hard problem on graphs. The KEP consists of, given a pool of kidney donors and patients waiting for kidney donations, optimally selecting a set of donations to optimize the quantity and quality of transplants performed while respecting a set of constraints about the arrangement of these donations. The proposed technique consists of two major steps: the first is a Graph Neural Network (GNN) trained without supervision; the second is a deterministic non-learned search heuristic that uses the output of the GNN to find a valid solution. To allow for comparisons, we also implemented and tested an exact solution method using integer programming, two greedy search heuristics without the machine learning module, and the GNN alone without a heuristic. We analyze and compare the methods and conclude that the learning-based two-stage approach is the best solution quality, outputting approximate solutions on average 1.1 times more valuable than the ones from the deterministic heuristic alone. [ABSTRACT FROM AUTHOR]

Obfuscation techniques (e.g., blurring) are employed to protect sensitive information (SI) in images such as individuals' faces. Recent works demonstrated that adversaries can perform deep learning-assisted (DL) attacks to re-identify obfuscated face images. Adversaries are modeled by their goals, knowledge (e.g., background knowledge), and capabilities (e.g., DL-assisted attacks). Nevertheless, enhancing the evaluation methodology of obfuscation techniques and improving the defense strategies against adversaries requires considering more "pessimistic" attacking scenario, i.e., stronger adversaries. According to a 2019 article published by the European Union Agency for Cybersecurity (ENISA), adversaries tend to perform more sophisticated and dangerous attacks when collaborating together. To address these concerns, our paper investigates a novel privacy challenge in the context of image obfuscation. Specifically, we examine whether adversaries, when collaborating together, can amplify their DL-assisted attacks and cause additional privacy breaches against a target dataset of obfuscated images. We empirically demonstrate that federated learning (FL) can be used as a collaborative attack/adversarial strategy to (i) leverage the attacking capabilities of an adversary, (ii) increase the privacy breaches, and (iii) remedy the lack of background knowledge and data shortage without the need to share/disclose the local training datasets in a centralized location. To the best of our knowledge, we are the first to consider collaborative and more specifically FL-based attacks in the context of face obfuscation. [ABSTRACT FROM AUTHOR]

In 2022, the World Health Organization declared an outbreak of monkeypox, a viral zoonotic disease. With time, the number of infections with this disease began to increase in most countries. A human can contract monkeypox by direct contact with an infected human, or even by contact with animals. In this paper, a diagnostic model for early detection of monkeypox infection based on artificial intelligence methods is proposed. The proposed method is based on training the artificial neural network (ANN) with the adaptive artificial bee colony algorithm for the classification problem. In the study, the ABC algorithm was preferred instead of classical training algorithms for ANN because of its effectiveness in numerical optimization problem solutions. The ABC algorithm consists of food and limit parameters and three procedures: employed, onlooker and scout bee. In the algorithm standard, artificial onlooker bees are produced as much as the number of artificially employed bees and an equal number of limit values are assigned for all food sources. In the advanced adaptive design, different numbers of artificial onlooker bees are used in each cycle, and the limit numbers are updated. For effective exploitation, onlooker bees tend toward more successful solutions than the average fitness value of the solutions, and limit numbers are updated according to the fitness values of the solutions for efficient exploration. The performance of the proposed method was investigated on CEC 2019 test suites as examples of numerical optimization problems. Then, the system was trained and tested on a dataset representing the clinical symptoms of monkeypox infection. The dataset consists of 240 suspected cases, 120 of which are infected and 120 typical cases. The proposed model's results were compared with those of ten other machine learning models trained on the same dataset. The deep learning model achieved the best result with an accuracy of 75%. It was followed by the random forest model with an accuracy of 71.1%, while the proposed model came third with an accuracy of 71%. [ABSTRACT FROM AUTHOR]

This paper describes and evaluates the performance of a learning classifier system (lcs) inspired algorithm called Temporal Reinforcement And Classification Architecture (traca) on maze navigation tasks which contain hidden state. The evaluation of traca includes comparisons with other learning algorithms on selected difficult maze navigation tasks. Not all lcss are capable of learning all types of hidden-state mazes so traca is specifically compared against selected other lcs-based approaches that are most capable on these tasks, including xcsmh, AgentP (G), and AgentP (SA). Each algorithm is evaluated using a maze navigation task that has been identified as among the most difficult due to recurring aliased regions. The comparisons between algorithms include training time, test performance, and the size of the learned rule sets. The results indicate that each algorithm has its own advantages and drawbacks. For example, on the most difficult maze traca's average steps to the goal are 10.1 while AgentP (G) are 7.87; however, traca requires an average of only 354 training trials compared with 537 for AgentP (G). Following the maze tasks, traca is also tested on two variations in a truck driving task where it must learn to navigate four lanes of slower vehicles while avoiding collisions. The results show that traca can achieve a low number of collisions with relatively few trials (as low as 24 collisions over 5000 time steps after 10,000 training time steps) but may require multiple network construction attempts to achieve high performance. [ABSTRACT FROM AUTHOR]

Recent advancements in the industrial revolution and artificial intelligence have aided in the development of novel approaches that have considerable potential for increasing the efficiency of traffic networks. Emerging concepts of autonomous driving and machine learning can be incorporated intelligently for improving traffic operations and control. In the coming years, traffic composition can vary in terms of autonomous vehicle (AV) penetration rate, which can lead to a heterogeneous traffic environment. Traffic control methods for such complex networks need to be designed effectively for accommodating the positive effects of AV implementation without compromising the safety and level of service in the presence of regular vehicles (RVs). An intelligent-based optimization framework for traffic signal control under heterogeneous AV-based traffic is proposed in this paper. This framework utilizes state-of-the-art machine-learning approaches to represent and design different components of the optimization process of cycle length. Further, SHapley Additive exPlanations (SHAP) is used to enhance model interpretability. The proposed optimization framework improves performance under congested traffic conditions compared with that of the conventional optimization methods. Compared to pure RV-based traffic, the penetration rates of 25%, 50%, and 100% can decrease optimized cycle lengths by 26%, 39%, and 53%, respectively, which can result in delay reductions of approximately 18%, 31%, and 56%, respectively. The proposed framework when applied in an adaptive-based manner can help in the generalization of controlling existing signalized intersections with the gradual penetration of AVs without the extra infrastructure or specific operational and connectivity capabilities of the involved vehicles. [ABSTRACT FROM AUTHOR]

The goal of the growing discipline of neuro-symbolic artificial intelligence (AI) is to develop AI systems with more human-like reasoning capabilities by combining symbolic reasoning with connectionist learning. We survey the literature on neuro-symbolic AI during the last two decades, including books, monographs, review papers, contribution pieces, opinion articles, foundational workshops/talks, and related PhD theses. Four main features of neuro-symbolic AI are discussed, including representation, learning, reasoning, and decision-making. Finally, we discuss the many applications of neuro-symbolic AI, including question answering, robotics, computer vision, healthcare, and more. Scalability, explainability, and ethical considerations are also covered, as well as other difficulties and limits of neuro-symbolic AI. This study summarizes the current state of the art in neuro-symbolic artificial intelligence. [ABSTRACT FROM AUTHOR]

Wind power forecasting techniques have been well developed over the last half-century. There has been a large number of research literature as well as review analyses. Over the past 5 decades, considerable advancements have been achieved in wind power forecasting. A large body of research literature has been produced, including review articles that have addressed various aspects of the subject. However, these reviews have predominantly utilized horizontal comparisons and have not conducted a comprehensive analysis of the research that has been undertaken. This survey aims to provide a systematic and analytical review of the technical progress made in wind power forecasting. To accomplish this goal, we conducted a knowledge map analysis of the wind power forecasting literature published in the Web of Science database over the last 2 decades. We examined the collaboration network and development context, analyzed publication volume, citation frequency, journal of publication, author, and institutional influence, and studied co-occurring and bursting keywords to reveal changing research hotspots. These hotspots aim to indicate the progress and challenges of current forecasting technologies, which is of great significance for promoting the development of forecasting technology. Based on our findings, we analyzed commonly used traditional machine learning and advanced deep learning methods in this field, such as classical neural networks, and recent Transformers, and discussed emerging technologies like large language models. We also provide quantitative analysis of the advantages, disadvantages, forecasting accuracy, and computational costs of these methods. Finally, some open research questions and trends related to this topic were discussed, which can help improve the understanding of various power forecasting methods. This survey paper provides valuable insights for wind power engineers. [ABSTRACT FROM AUTHOR]

The water quality index (WQI) serves as a global representation of river water quality (WQ). Existing studies related to the WQI have mainly focused on two aspects: (i) a WQI point estimation using multiple WQ inputs; and (ii) a one-step-ahead WQI forecasting with datasets of lower temporal resolution. These approaches, however, are limited in their ability to forecast future trends of the WQI for timely and prompt responses to pollution events. In this study, the deep learning algorithms, namely the long short-term memory (LSTM) and the gated recurrent unit (GRU), were selected for direct multi-step-ahead WQI forecasting. To enhance the capability of the models in capturing their temporal patterns, the input signal was pre-decomposed using the empirical mode decomposition (EMD) and variational mode decomposition (VMD) into several intrinsic mode functions (IMFs). The characteristics of these IMFs were then analyzed and used to ease model learning on capturing their temporal patterns. Our study shows that the selection of signal decomposition strategies significantly impact the model performance. Both deep learning algorithms offered comparable performances, with the VMD-LSTM exhibiting the lowest prediction errors (MAPE = 1.9237%) and the highest Kling–Gupta efficiency (KGE = 0.6761) over a two-month test period. To the best of our knowledge, this is the first paper that applies a direct forecast approach for the multi-step-ahead WQI forecasting, using the IMFs obtained from the EMD and VMD decompositions. The performance of the model was evaluated through a rolling forward setup to ensure its consistency across different test periods. The proposed modeling framework holds the potential to assist policymakers and stakeholders in decision-making, particularly in planning remedies and efficient water resource management. [ABSTRACT FROM AUTHOR]

Accurate forecasting of electricity generation from renewable energy sources is crucial for the operation, planning and management of smart grids. For reliable planning and operation of photovoltaic (PV) systems in grid-connected or islanded utilities, an hourly day-ahead forecast of PV output is critical. The forecast of PV power can be done indirectly by estimating solar irradiance. For forecasting day-ahead hourly global horizontal irradiance (GHI), two forecasting models with different multivariate inputs are proposed in this paper, and the results are compared. These models use a hybrid algorithm of discrete wavelet decomposition and bidirectional long short-term memory (BILSTM). The inputs of the first model contain GHI and weather type data. The other model allows for observation of the effect of meteorological values including GHI, temperature, humidity, wind speed, and weather type data. The forecasting performance of deep learning algorithms which contain recurrent neural network (RNN), long short-term memory (LSTM), and BILSTM algorithms for day ahead hourly solar irradiance forecasting problems are also compared. To evaluate the performance of proposed models, two datasets are used for Model 1 and one dataset is used for Model 2. An experiment is also done to demonstrate that the proposed Model 1 is applicable in datasets collected in the vicinity of the city of Trabzon. On the other hand, BILSTM algorithm outperforms RNN and LSTM algorithms. It is seen that the test successes of both proposed models are better than the results given in the literature. [ABSTRACT FROM AUTHOR]

Data are an essential component for building machine learning models. Linearly separable high-quality data are conducive to building efficient classification models. However, the collected dataset is not of high quality, and the number of instances for difference class is not absolutely consistent. Therefore, models built on these datasets are vulnerable to problems such as class-imbalance, class-overlap, and other problems. Traditional instance selection algorithms mainly determine whether there is redundancy or overlap in instances based on the degree of similarity between instances. Therefore, these methods only focus on the local information of the dataset and ignore the global approximate relationship of the instances in the dataset. In this paper, an instance selection method based on the global relationship of instances in the dataset is proposed, called instance selection based on Laplacian matrix decomposition with weighted k-nearest-neighbor graph (LMD-WNG). First, this method tries to construct a new distance-weighted Laplacian matrix using the weighted k-nearest-neighbor graph. Then, the distance-weighted Laplacian matrix is decomposed using a Schur decomposition method. Finally, according to the eigenvalues of the decomposed real matrix, a training dataset suitable for model learning is selected, and a classifier is constructed on the new training data. The experimental results show that as the imbalance ratio increases, LMD-WNG becomes more sensitive to parameter k. When the significance level is p = 0.05 , the analysis results using Friedman ranking and the Holm's post hoc test show that LMD-WNG is significantly better than or similar to other state-of-the-art algorithms on 30 datasets. [ABSTRACT FROM AUTHOR]

Reinforcement learning (RL) and imitation learning (IL) are quite two useful machine learning techniques that were shown to be potential in enhancing navigation performance. Basically, both of these methods try to find a policy decision function in a reinforcement learning fashion or through imitation. In this paper, we propose a novel algorithm named Reinforcement Imitation Learning (RIL) that naturally combines RL and IL together in accelerating more reliable and efficient navigation in dynamic environments. RIL is a hybrid approach that utilizes RL for policy optimization and IL as some kind of learning from expert demonstrations with the inclusion of guidance. We present the comparison of the convergence of RIL with conventional RL and IL to provide the support for our algorithm's performance in a dynamic environment with moving obstacles. The results of the testing indicate that the RIL algorithm has better collision avoidance and navigation efficiency than traditional methods. The proposed RIL algorithm has broad application prospects in many specific areas such as an autonomous driving, unmanned aerial vehicles, and robots. [ABSTRACT FROM AUTHOR]

Graph neural networks (GNNs) are powerful tools for data mining on graph-structured data in various domains, such as social science, finance, and biology. However, most existing GNNs operate in Euclidean space and may fail to preserve the intrinsic network properties, such as self-similarity and hierarchy, that characterize many real-world graphs. Hyperbolic graph neural networks (HGNNs) address this limitation by embedding graphs into hyperbolic space, which can better capture the hierarchical structures of networks. However, HGNNs often involve complex computations in hyperbolic space or its tangent space during training, which may hinder their efficiency. In this paper, we propose hyperbolic attention graph neural networks (HA-GNN), which can leverage both network structure and node features for graph representation learning in an efficient way. Specifically, we design a structural properties attention mechanism that measures the structural connection between nodes based on their hyperbolic embeddings. We also design a node features attention mechanism that quantifies the feature similarity between nodes. We then combine these two attentions to obtain a hyperbolic attention that weights the relevance between all connected nodes. We conduct extensive experiments on five real-world networks and demonstrate that our model consistently and significantly outperforms other state-of-the-art methods. For example, on the Cora network, our model achieves an accuracy of 83.1 (± 0.4) on node classification tasks, which is 1.6% higher than the best baseline method in Euclidean space. [ABSTRACT FROM AUTHOR]

Automatic handwritten character recognition plays a significant role in various applications across multiple fields. With the growing interest in automatic handwriting recognition and the advancement of deep learning methods, researchers have achieved significant improvements in the development of English handwriting recognition methods. However, the recognition of Arabic handwriting has received insufficient attention. In this paper, a novel "DeepAHR" model is presented to accurately and efficiently recognize Arabic handwritten characters using deep learning techniques. The "DeepAHR" model is based on a convolutional neural network (CNN) and is trained using two recent public datasets: Hijaa and Arabic handwritten characters dataset (AHCD). The overall accuracies of the proposed model were 98.66% and 88.24% on the AHCD and Hijaa datasets, respectively.The experimental results showed that DeepAHR outperformed state-of-the-art methods in the literature. These promising results provide evidence of the successful use of the DeepAHR model for recognizing handwritten Arabic characters [ABSTRACT FROM AUTHOR]

Edge computing, artificial intelligence (AI), and machine learning (ML) concepts have become increasingly prevalent in Internet of Things (IoT) applications. As the number of IoT devices continues to grow, relying solely on cloud computing for real-time data processing and analysis is proving to be more challenging. The synergy between edge computing and AI is particularly intriguing due to AI's reliance on rapid data processing, a capability facilitated by edge computing. Edge AI represents a significant paradigm shift, leveraging AI within edge computing frameworks to reduce reliance on internet connections and mitigate data latency issues. This approach accelerates data processing, supporting use cases that demand real-time inference. Additionally, as cloud storage costs continue to rise, the feasibility of streaming and storing large volumes of data comes into question. Edge AI offers a compelling solution by performing big data analytics closer to the end device where edge computing is deployed. This paper presents a systematic literature review (SLR) of 85 articles published between 2018 and 2023 within Edge AI. The study provides a comprehensive examination of the analysis of measurement environments and assesses factors applied to Edge AI for big data. It offers taxonomies specific to Edge AI within the big data domain, presents case studies, and outlines the challenges and open issues inherent in Edge AI for big data. [ABSTRACT FROM AUTHOR]

The significant increase in online activities in the wake of recent global events has underlined the importance of biometric person authentication on digital platforms. Although many biometric devices may be used for precise biometric authentication, acquiring the necessary technology, such as 3D sensors or fingerprint scanners, can be prohibitively expensive and logistically challenging. Addressing the demands of online environments, where access to specialized hardware is limited, this paper introduces an innovative approach. In this work, by fusing static and dynamic signature data with facial data captured through regular computer cameras, a dataset of 1750 samples from 25 individuals is constructed. Deep learning models, including convolutional neural networks (CNN), long short-term memory (LSTM), gated recurrent unit (GRU), and temporal convolutional networks (TCN), are employed to craft a robust multi-classification model. This integration of various deep learning algorithms has demonstrated remarkable performance enhancements in biometric authentication. This research also underscores the potential of merging dynamic and static biometric features, derived from readily available sources, to yield a high-performance recognition framework. As online interactions continue to expand, the combination of various biometric modalities holds potential for enhancing the security and usability of virtual environments. [ABSTRACT FROM AUTHOR]

This paper presents an intelligent healthcare framework by incorporating modern computing technologies like machine learning and deep learning. The sole motivation of this paper is to predict diabetes status intelligently so that patients can be made aware of their diabetes status regularly. A novel ensemble machine learning-based diabetes prediction framework, namely "iDP", has been proposed in this paper. Six different machine learning approaches have been used for the iDP framework, namely random forest, decision tree, neural network, AdaBoost, support vector machine, and XGBoost. Training and testing of ensemble modeling have been performed based on these learning techniques. A comprehensive preliminary data analysis and screening of statistical analysis have been systematically demonstrated in this paper. The recursive feature elimination and fivefold cross-validation methods have been used to select the best model. All experiments have been performed using R-Studio 1.2.5 with the help of the Rattle library 5.4.0. The preliminary data analytic and Pearson correlation coefficient values have been computed to verify the linearity relationship among the data. Results have been reported in eight performance metrics, including accuracy, specificity, sensitivity, area under curve, area under convex hull, minimum error rate, minimum weighted loss, and precision. The proposed iDP framework improves the results on different aspects in order to compare them with individual learning approaches. Despite this, a comparative performance analysis of the iDP framework has also been performed with state-of-the-art prevailing models. As per experiment, the iDP framework gives better results in most cases, like accuracy: 95.26%, AUC: 91.15%, sensitivity: 96.81%, specificity: 97.72% and precision: 90.72%. [ABSTRACT FROM AUTHOR]

Manual term extraction is similar to literal meaning: A translator browses text, classifies words, and prepares for translation. Terminology, as a centralized carrier of expertise, creation, popularization, and disappearance, dynamically reflects the development and evolution of an industry. The automatic extraction of terminology is a key technology for creating a professional terminology database, and it is also a key topic in the field of natural language processing. The purpose of this paper is to study how to analyse a term extraction algorithm based on machine learning and a comprehensive feature strategy. Focusing on the problems of poor generality and single statistical features of current term extraction algorithms, this paper proposes an improved domain ontology term extraction algorithm based on a comprehensive feature strategy. Moreover, automatic term extraction experiments based on a word-based maximum entropy model and a conditional random field model based on machine learning are conducted in this paper. Its word-based conditional random field model outperforms the maximum entropy model. The experimental results show that the algorithm based on the comprehensive feature strategy improves the accuracy by 8.6% compared with the TF-IDF algorithm and the C-value term extraction algorithm. This algorithm can be used to effectively extract the terms in a text and has good generality. [ABSTRACT FROM AUTHOR]

Electroencephalography (EEG) is a well-known modality in neuroscience and is widely used in identifying and classifying neurological disorders. This paper investigates how EEG data can be used along with knowledge distillation-based deep learning models to detect mental disorders like epilepsy and sleep disorders. The EEG signals are converted into time–frequency plots using short-time Fourier transforms. Further, we propose a novel methodology for using knowledge distillation-based transfer learning (KDTL). Knowledge distillation is becoming quite prevalent in the machine learning field and is associated with various applications in our work; we propose its use in the detection of mental disorders from EEG spectrograms. We convert the EEGs using short-term Fourier transform to obtain time–frequency representation and apply teacher-student by first training a large teacher model and use knowledge distillation to train a student model. In our experiments, we found that ConvNext teacher and MobileNet student combination obtained better results. Our proposed KDTL approach is tested on two datasets with multiple cases, namely the Bonn and ISRUC datasets and obtain 98% and 95% accuracies, respectively. Further experimental results show that the overall KDTL methodology can obtain high classification accuracy across both datasets in binary and multiclass classifications and proves to be better than multiple prior works. Further, our KDTL approach provides a way to train lightweight models which have a smaller number of trainable parameters and thereby constitute lower training time overall. Our proposed KDTL-based approach obtained accurate results in diagnosing mental disorders from EEG spectrograms. Compared to other related methods, KDTL outperformed across tasks with obtained good results in both binary and multiclass classifications. [ABSTRACT FROM AUTHOR]

Accurate and early disease prediction enables patients to plan and improve their quality of life in the future. Early detection of neurodegenerative diseases, such as Parkinson's disease, is a high priority and a significant challenge in which physicians must act quickly to diagnose and predict the risk of disease severity. Machine learning (ML) models combined with feature selection (FS) techniques can assist physicians in quickly diagnosing a disease. FS technique optimally subsets features to improve model performance and reduce the number of tests required for a patient, thereby speeding up diagnosis. This paper proposes an e-diagnosis approach based on ML-FS algorithms to detect Parkinson's disease using data obtained from Parkinson's Progression Markers Initiative (PPMI) Online study. Also, it can be considered patient-oriented research as it uses self-reported online collected data. The results of six FS techniques pre-applied to classification algorithms named logistic regression, random forest, support vector machine, CatBoost, extreme learning machine, and XGBoost are shown in this study. Chi-square, mutual information, and analysis of variance (ANOVA) filter-based FS methods, while sequential feature selection, Boruta, and recursive feature elimination are considered wrapper methods. The outcomes show that random forest when trained on features selected by the recursive feature elimination technique help to build an efficient and effective approach for detecting Parkinson's disease. [ABSTRACT FROM AUTHOR]

Disease outbreaks are nowadays a critical issue despite the development and rapid growth of technology. One of the major challenges facing healthcare professionals and healthcare industries is disease prevention and control by technology. Due to busy work schedules, maintaining a healthy lifestyle has become impossible, so the solution to these previous challenges is the intelligent health monitoring system. Over the past few years, a lot of research has been done on the use of Machine learning (ML) techniques in healthcare applications. With wearable devices, ML greatly helps in tracking human activities and vital signs as well as helping to monitor and diagnose patients' health so it plays a huge role in elderly care. Research and development of more applications for wearable devices has been underway in the past five years, due to significant technological advances in medical sensors. Despite the widespread use of wearable devices, there is little research on machine learning applications of these devices. This paper presents a review of the different areas of recent ML research for healthcare wearable devices. It also discusses the different challenges facing ML applications on wearable devices. [ABSTRACT FROM AUTHOR]

Limitations in computer-assisted diagnosis include lack of labeled data and inability to model the relation between what experts see and what computers learn. Even though artificial intelligence and machine learning have demonstrated remarkable performances in medical image computing, their accountability and transparency level must be improved to transfer this success into clinical practice. The reliability of machine learning decisions must be explained and interpreted, especially for supporting the medical diagnosis. While deep learning techniques are broad so that unseen information might help learn patterns of interest, human insights to describe objects of interest help in decision-making. This paper proposes a novel approach, DeepCraftFuse, to address the challenge of combining information provided by deep networks with visual-based features to significantly enhance the correct identification of cancerous tissues in patients affected with Barrett's esophagus (BE). We demonstrate that DeepCraftFuse outperforms state-of-the-art techniques on private and public datasets, reaching results of around 95% when distinguishing patients affected by BE that is either positive or negative to esophageal cancer. [ABSTRACT FROM AUTHOR]

The data-driven modular deep fuzzy model has demonstrated excellent forecasting performance due to its clear architecture and powerful fuzzy inference ability. However, the fixed structure predesigned for specific types of datasets limits the further improvement of generalization ability, especially when facing high-dimensional datasets with the challenging problem of rule explosion, thereby suffering from the time-consuming training process. To overcome these limitations, a novel randomized fuzzy modules (RFMs) stacked residual deep fuzzy system (RFM-RDFS) is proposed in this study. Firstly, to obtain high-precision outputs, this paper presents a residual deep fuzzy framework by stacking RFMs layer by layer, where the modules in the current layer only learn the residual of the previous layer. Secondly, to improve the design freedom for different applications, the RFM with multiple inputs is raised, where the input variables are allocated by a sliding window along the input spaces of the layers, so the number of the parallel modules in the same layer can be flexibly adjusted. Meanwhile, in the RFM, inspired by the extreme learning machine, the centers and widths of Gaussian membership functions are randomly generated, which can greatly accelerate the training speed. Thirdly, to strengthen the approximation performance, the consequent parameters of the fuzzy rules in each RFM are learned by minimizing the loss function with the regularization terms through the ridge regression algorithm. Finally, extensive experiments on various datasets are conducted to compare the proposed RFM-RDFS with several state-of-the-art shallow and deep models. The detailed comparison results clearly show that the proposed RFM-RDFS is more flexible and compact, and has greater advantages in terms of the interpretability, generalization ability and robustness. [ABSTRACT FROM AUTHOR]

Multi-Object Tracking, also known as Multi-Target Tracking, is an important area of computer vision with various applications in different domains. The advent of deep learning has had a profound impact on this field, forcing researchers to explore innovative avenues. Deep learning methods have become the cornerstone of today's state-of-the-art solutions, consistently delivering exceptional tracking results. However, the significant computational demands of deep learning models require powerful hardware resources that do not always match real-time tracking requirements, limiting their practical applicability in real-world scenarios. Thus, there is an imperative to strike a balance by merging robust deep learning strategies with conventional approaches to enable more accessible, cost-effective solutions that meet real-time requirements. This paper embarks on this endeavor by presenting a hybrid strategy for real-time multi-target tracking. It effectively combines a classical optical flow algorithm with a deep learning architecture tailored for human crowd tracking systems. This hybrid approach achieves a commendable balance between tracking accuracy and computational efficiency. The proposed architecture, subjected to extensive experimentation in various settings, demonstrated notable results, achieving a Mean Object Tracking Accuracy (MOTA) of 0.608. This level of performance placed it as the highest ranking solution on the MOT15 benchmark, surpassing the state-of-the-art benchmark of 0.549, and consistently ranked among the superior models on the MOT17 and MOT20 benchmarks. Additionally, the incorporation of the optical flow phase resulted in a substantial reduction in processing time, nearly halving the duration, while simultaneously maintaining accuracy levels comparable to established techniques. [ABSTRACT FROM AUTHOR]

Once realized, autonomous aerial refueling will revolutionize unmanned aviation by removing current range and endurance limitations. Previous attempts at establishing vision-based solutions have come close but rely heavily on near perfect extrinsic camera calibrations that often change midflight. In this paper, we propose dual object detection, a technique that overcomes such requirement by transforming aerial refueling imagery directly into receiver aircraft reference frame probe-to-drogue vectors regardless of camera position and orientation. These vectors are precisely what autonomous agents need to successfully maneuver the tanker and receiver aircraft in synchronous flight during refueling operations. Our method follows a common 4-stage process of capturing an image, finding 2D points in the image, matching those points to 3D object features, and analytically solving for the object pose. However, we extend this pipeline by simultaneously performing these operations across two objects instead of one using machine learning and add a fifth stage that transforms the two pose estimates into a relative vector. Furthermore, we propose a novel supervised learning method using bounding box corrections such that our trained artificial neural networks can accurately predict 2D image points corresponding to known 3D object points. Simulation results show that this method is reliable, accurate (within 3 cm at contact), and fast (45.5 fps). [ABSTRACT FROM AUTHOR]

Parkinson's disease (PD) is a condition that degenerates over time and impairs speech and pronunciation because brain cells have died. This research work aims to predict parkinson disease using the voice features extracted from speech signals recorded from PD individuals with dysphonic speech disorders by employing deep learning algorithms. PD is challenging to diagnose early on in the clinical presentation. To address the issue in machine learning methods, this paper proposes a neural network model by processing speech signals to classify PD using the University of California Irvine (UCI) machine learning repository dataset. Initially, a pre-loss reduction module is created by using pre-sampling to make the dataset balanced by reducing the dimensionality and maintaining the size of the space without influencing the learning process for data preparation. The relevant features are derived using a novel multi-agent salp swarm (MASS) algorithm, and a novel Parkinson classification neural network (PCNN) is proposed to classify Parkinson's patients with high accuracy employing these derived features. The result shows that the models that use MASS-PCNN produce higher classification accuracy of 99.1%, precision of 97.8%, recall of 94.7% and F1-score of 0.995 when paralleled to the existing models. As an outcome, the suggested model will perform superior to common convolutional neural networks. [ABSTRACT FROM AUTHOR]

Personalized learning has gained significant attention in education as a means to cater to the diverse needs of learners and optimize educational outcomes. However, ensuring the efficiency of personalized learning remains a challenge. It requires the ability to accurately analyze and interpret vast amounts of data collected from learners. Traditional analytical approaches often struggle to handle the complexity and heterogeneity of this data, limiting the potential for personalized learning interventions. To address these challenges, this paper proposes a personalized learning efficiency data analysis network (PLEDANet) based on machine learning. First, PLEDANet redesigns a convolutional neural network based on the ResNet structure. The network performs convolutions using multiple convolution kernels of different scales to extract diverse feature information from personalized learning efficiency data. To enhance the extraction and representation of fine-grained differentiated features, PLEDANet introduces a hybrid attention module to combine channel and spatial information among feature maps. Second, PLEDANet designs a hybrid loss function for model training, which consists of the AM-softmax loss and the Center loss. The former increases the inter-class distance of features by imposing a fixed angular margin, while the latter reduces the intra-class distance by constraining the samples and feature centers. Finally, extensive experiments are conducted on PLEDANet. The experimental results validate the superiority of PLEDANet for personalized learning efficiency analysis. [ABSTRACT FROM AUTHOR]

Code smells are poorly designed code structures indicating that the code may need to be refactored. Recognizing code smells in practice is complex, and researchers strive to develop automatic code smell detectors. An obstacle to developing these solutions is the datasets' limitations. Manually labeled datasets were collected to investigate the developers' perceptions of code smells. They are characterized by a high label disagreement that hurts the performance of Machine Learning (ML) models trained using them. Furthermore, all large, manually labeled datasets are developed for Java. We recently created a novel dataset for C# to alleviate these issues. This paper evaluates ML code smell detection approaches on our novel dataset. We consider two feature representations to train ML models: (1) code metrics and (2) CodeT5 embeddings. This study is the first to consider the CodeT5 state-of-the-art neural source code embedding for code smell detection in C#. To prove the effectiveness of ML, we consider multiple metrics-based heuristics as alternatives. In our experiments, the best-performing approach was the ML classifier trained on code metrics (F-measure of 0.87 for Long Method and 0.91 for Large Class detection). However, the performance improvement over CodeT5 features is negligible if we consider the advantages of automatically inferring features. Finally, our ML model surpassed less experienced annotators and nearly matched the most experienced annotator, suggesting it can assist less experienced developers under tight deadlines. To the best of our knowledge, this is the first study to compare the performance of automatic smell detectors against human performance. [ABSTRACT FROM AUTHOR]

For market players and policy officials, commodity price forecasts are crucial problems that are challenging to address due to the complexity of price time series. Given its strategic importance, corn crops are hardly an exception. The current paper evaluates the forecasting issue for China's weekly wholesale price index for yellow corn from January 1, 2010 to January 10, 2020. We develop a Gaussian process regression model using cross validation and Bayesian optimizations over various kernels and basis functions that could effectively handle this sophisticated commodity price forecast problem. The model provides precise out-of-sample forecasts from January 4, 2019 to January 10, 2020, with a relative root mean square error, root mean square error, and mean absolute error of 1.245%, 1.605, and 0.936, respectively. The models developed here might be used by market players for market evaluations and decision-making as well as by policymakers for policy creation and execution. [ABSTRACT FROM AUTHOR]

Federated Learning (FL) is a collaborative training method for machine learning (ML) that aggregates model weights from multiple participants during the training phase. The learning phase of machine learning techniques is distributed, in which each participating device trains a model using its local data set and sends model weights to a centralized node. The central node aggregates weights and sends the updated weights back to devices. The process continues until a specific threshold is reached such accuracy, response time. In this paper, we present a performance evaluation of FL in a clustering-based multi-hop network to simulate the effect of the dynamic environment on the accuracy of the global model. It is observed that a minimum number of participating nodes is required within a cluster to maintain a high level of global accuracy. A global threshold value needs to be defined to maintain high global accuracy and avoid degradation of model performance. [ABSTRACT FROM AUTHOR]

Petrophysical properties estimation is vital in reservoir characterisation domain to identify the prospect locations of presence of petroleum. Geophysical sensing with seismic survey and well logging provide such information of subsurface without completely digging over the reservoir. Machine learning models are popular in this domain to estimate the petrophysical properties from seismic signals and well logging. However, the performance is affected when the available labelled data are limited to model a reservoir. Transfer learning has a significant contribution in handling the limited labelled data issue in many application domains. But its applicability is almost unexplored in this domain as it is necessary to first identify the relevant model to transfer. In this paper, we propose a novel transfer learning approach for the estimation of petrophysical properties in a real-world reservoir dataset having inadequate labelled data samples. The proposed solution transfers the contextual knowledge of reservoir facies classes to the predictive model of petrophysical properties. Both the tasks share the common domain information and provided the improved generalisation performance considering the out-of-fold prediction in blind wells. Moreover, the analysis of results depicts better convergence and accuracy compared to its considered baselines. [ABSTRACT FROM AUTHOR]

Ground penetrating radar (GPR) systems are effective sensors for discovering various types of objects buried underground, such as military mines, metal objects, and pieces of underground infrastructures. A GPR system can be manually operated by a human or can be an integral part of a host platform. The host platform may be semi- or fully autonomous and may operate in different environments such as land vehicles or more recently air-borne drones. One challenge for the fully or semi-autonomous host platforms in particular is to find an efficient search procedure that would reduce the operation time and optimize resource utilization. Most of the current approaches are based on pre-defined search patterns which, for large and sparse areas, could mean unnecessary waste of time and resources. In this paper, we introduce a method that combines a coarse and therefore relatively low cost initial search pattern with a Reinforcement Learning (RL) driven efficient navigation path for eventual target detection, by exploiting the signal processing pipeline of the onboard GPR. We illustrate the applicability of the method using a well-known, high fidelity GPR simulation environment and a novel RL framework. Our results suggest that combination of a coarse navigation scheme and an RL-based training procedure based on GPR scan returns can lead to a more efficient target discovery procedure for host platforms. [ABSTRACT FROM AUTHOR]

In multiple-instance learning (MIL), the existing bag encoding and attention-based pooling approaches assume that the instances in the bag have no relationship among them. This assumption is unsuited, as the instances in the bags are rarely independent in diverse MIL applications. In contrast, the instance relationship assumption-based techniques incorporate the instance relationship information in the classification process. However, in MIL, the bag composition process is complicated, and it may be possible that instances in one bag are related and instances in another bag are not. In present MIL algorithms, this relationship assumption is not explicitly modeled. The learning algorithm is trained based on one of two relationship assumptions (whether instances in all bags have a relationship or not). Hence, it is essential to model the assumption of instance relationships in the bag classification process. This paper proposes a robust approach that generates vector representation for the bag for both assumptions and the representation selection process to determine whether to consider the instances related or unrelated in the bag classification process. This process helps to determine the essential bag representation vector for every individual bag. The proposed method utilizes attention pooling and vision transformer approaches to generate bag representation vectors. Later, the representation selection subnetwork determines the vector representation essential for bag classification in an end-to-end trainable manner. The generalization abilities of the proposed framework are demonstrated through extensive experiments on several benchmark datasets. The experiments demonstrate that the proposed approach outperforms other state-of-the-art MIL approaches in bag classification. [ABSTRACT FROM AUTHOR]

In areas with high tuberculosis (TB) prevalence, high mortality rate has significantly increased over the past few decades. Even though tuberculosis can be treated, areas with high disease burden continue to have insufficient screening tools, leading to diagnostic delays and incorrect diagnoses. As a result of these challenges, a computer-aided diagnostics (CAD) system has been developed that can automatically detect tuberculosis. There are few different methods that can be used to screen for tuberculosis; however, chest X-ray (CXR) is most commonly used and strongly suggested because it is so effective in identifying lung irregularities. Over past ten years, we have seen a meteoric rise in amount of research conducted into application of machine learning strategies to examination of chest X-ray images for screening regarding pulmonary abnormalities. Particularly, we have also noticed significant interest in testing for TB. This attentiveness has increased in tandem with phenomenal progress that has been made in deep learning (DL), which is predominately founded on convolutional neural networks (CNNs). Because of these advancements, significant research contributions have been made in field of DL techniques for TB screening by utilizing CXR images. The main focus of this paper is to emphasize favorable methods and data collection, as well as methodological contributions, identify data collections, and identify challenges. [ABSTRACT FROM AUTHOR]

The core premise of cancelable biometrics lies in the creation of a distinct biometric template for every individual, which can be either canceled or regenerated as needed. This process requires the use of a uniquely-defined key during the generation of such template. The generated templates are tailored to be key-specific. This ensures that each distinct key will generate a unique template, while preserving the integrity and security of the original biometric data, ensuring that it remains uncompromised. In this paper, a cancelable biometric system based on electrocardiography (ECG) and photoplethysmography (PPG) signals is introduced. A signal fusion process is implemented for the two traits to generate a single template per user. In order to enhance the security of generated templates, a well-designed permutation stage is implemented according to a user-specific key. The permutation key is obtained through a well-designed look-up table created by the authors. The user verification is conducted on the cancelable template, without the need for any inversion processes. The user verification scheme depends on a two-pronged approach: robust feature extraction followed by the application of a machine learning (ML) classifier. The mel-frequency cepstral coefficients (MFCCs) extraction algorithm is employed for feature extraction due to the low frequency range of the adopted biometric signals and the nonlinearity of the filter bank used for MFCC extraction. Several ML classifiers are adopted to validate the system with cancelable templates without any inversion process. Simulation results with multilayer perceptron (MLP) and logistic regression (LR) classifiers demonstrated superior effectiveness of the proposed authentication framework, with accuracy rates up to 100% and 99.7% on the pulse transit time PPG and BIDMC datasets, respectively. Hence, the proposed system proves effective access control and user verification in the Internet-of-Things (IoT) applications. [ABSTRACT FROM AUTHOR]

Reinforcement learning is a compelling area of research within machine learning because it enables the improvement of control strategies for future manipulation of dynamic systems, leveraging previous data even without a precise model of the system. It usually makes complex, model-free predictions from data alone, which is actually consistent with the purpose of control in that they both aim to design systems using richly structured perceptions to execute planning and control strategies that adequately adapt to changing environments. The robust trajectory tracking control of intricate mechanical systems presents a challenging problem that necessitates effective control methods. In this paper, we propose a novel nonlinear control strategy based on deep reinforcement learning to solve the trajectory tracking problem of a 3-degree-of-freedom (3-DOF) control moment gyroscope (CMG). First, dynamic modeling of the 3-DOF CMG is used as a policy solver for the reinforcement learning training environment, and transfer learning is employed to bridge the reality gap. Then, the hyperparameters and reward functions of the neural network are optimized using the asynchronous successive halving algorithm. Ultimately, the twin delay depth determination policy gradient algorithm is trained in simulation to yield an agent capable of tracking user-defined trajectory routes as a nonlinear controller for the system. Both simulation and experimental results show that the proposed method works well for both high-frequency and low-frequency varying trajectory tracking control, and that the proposed method has better response speed and robustness than classic linear parameter-varying control methods and the state-of-the-art nonlinear parameter-varying method and the neural network-based feedback linearization adaptive control method. [ABSTRACT FROM AUTHOR]

Deep learning integration in cancer diagnosis enhances accuracy and diagnosis speed which helps clinical decision-making and improves health outcomes. Despite all these benefits in cancer diagnosis, the present AI models in urology cancer diagnosis have not been sufficiently reviewed systematically. This paper reviews the artificial intelligence approaches used in cancer diagnosis, prediction, and treatment of urology cancer. AI models and their applications in urology subspecialties are evaluated and discussed. The Scopus, Microsoft Academic and PubMed/MEDLINE databases were searched in November 2022 using the terms "artificial intelligence", "neural network", "machine learning," or "deep learning" combined with the phrase "urology cancers". The search was limited to publications published within the previous 20 years to identify cutting-edge deep-learning applications published in English. Irrelevant review articles and publications were eliminated. The included research involves two kinds of research analysis: quantitative and qualitative. 48 articles were included in this survey. 25 studies proposed several approaches for prostate cancers, while 15 were for bladder cancers. 8 studies discussed renal cell carcinoma and kidney cancer. The models presented to detect urology cancers have achieved high detection accuracy (77–95%). Deep learning approaches that use convolutional neural networks have achieved the highest accuracy among other techniques. Although it is still progressing, the development of AI models for urology cancer detection, prediction, and therapy has shown significant promise. Additional research is required to employ more extensive, higher-quality, and more recent datasets to the clinical performance of the proposed AI models in urology cancer applications. [ABSTRACT FROM AUTHOR]

In recent years, credit card transaction fraud has resulted in massive losses for both consumers and banks. Subsequently, both cardholders and banks need a strong fraud detection system to reduce cardholder losses. Credit card fraud detection (CCFD) is an important method of fraud prevention. However, there are many challenges in developing an ideal fraud detection system for banks. First off, due to data security and privacy concerns, various banks and other financial institutions are typically not permitted to exchange their transaction datasets. These issues make traditional systems find it difficult to learn and detect fraud depictions. Therefore, this paper proposes federated learning for CCFD over different frameworks (TensorFlow federated, PyTorch). Second, there is a significant imbalance in credit card transactions across all banks, with a small percentage of fraudulent transactions outweighing the majority of valid ones. In order to demonstrate the urgent need for a comprehensive investigation of class imbalance management techniques to develop a powerful model to identify fraudulent transactions, the dataset must be balanced. In order to address the issue of class imbalance, this study also seeks to give a comparative analysis of several individual and hybrid resampling techniques. In several experimental studies, the effectiveness of various resampling techniques in combination with classification approaches has been compared. In this study, it is found that the hybrid resampling methods perform well for machine learning classification models compared to deep learning classification models. The experimental results show that the best accuracy for the Random Forest (RF); Logistic Regression; K-Nearest Neighbors (KNN); Decision Tree (DT), and Gaussian Naive Bayes (NB) classifiers are 99,99%; 94,61%; 99.96%; 99,98%, and 91,47%, respectively. The comparative results show that the RF outperforms with high performance parameters (accuracy, recall, precision and f score) better than NB; RF; DT and KNN. RF achieve the minimum loss values with all resampling techniques, and the results, when utilizing the proposed models on the entire skewed dataset, achieved preferable outcomes to the unbalanced dataset. Furthermore, the PyTorch framework achieves higher prediction accuracy for the federated learning model than the TensorFlow federated framework but with more computational time. [ABSTRACT FROM AUTHOR]