Search

Objective: This study aimed to develop a deep learning model to predict skeletal malocclusions with an acceptable level of accuracy using airway and cephalometric landmark values obtained from analyzing different CBCT images. Background: In orthodontics, multitudinous studies have reported the correlation between orthodontic treatment and changes in the anatomy as well as the functioning of the airway. Typically, the values obtained from various measurements of cephalometric landmarks are used to determine skeletal class based on the interpretation an orthodontist experiences, which sometimes may not be accurate. Methods: Samples of skeletal anatomical data were retrospectively obtained and recorded in Digital Imaging and Communications in Medicine (DICOM) file format. The DICOM files were used to reconstruct 3D models using 3DSlicer (slicer.org) by thresholding airway regions to build up 3D polygon models of airway regions for each sample. The 3D models were measured for different landmarks that included measurements across the nasopharynx, the oropharynx, and the hypopharynx. Male and female subjects were combined as one data set to develop supervised learning models. These measurements were utilized to build 7 artificial intelligence-based supervised learning models. Results: The supervised learning model with the best accuracy was Random Forest, with a value of 0.74. All the other models were lower in terms of their accuracy. The recall scores for Class I, II, and III malocclusions were 0.71, 0.69, and 0.77, respectively, which represented the total number of actual positive cases predicted correctly, making the sensitivity of the model high. Conclusion: In this study, it is observed that the Random Forest model was the most accurate model for predicting the skeletal malocclusion based on various airway and cephalometric landmarks. [ABSTRACT FROM AUTHOR]

Many species of fishes around the world are soniferous. The types of sounds fishes produce vary among species and regions but consist typically of low-frequency (< 1.5 kHz) pulses and grunts. These sounds can potentially be used to monitor fishes non-intrusively and could complement traditional monitoring techniques. However, the significant time required for human analysts to manually label fish sounds in acoustic recordings does not yet allow passive acoustics to be used as a viable tool for monitoring fishes. In this paper, we compare two different approaches to automatically detect fish sounds. One is a more traditional machine learning technique based on the detection of acoustic transients in the spectrogram and the classification using Random Forest (RF). The other is using a deep learning approach and is based on the classification of overlapping segments (0.2 s) of spectrogram using a ResNet18 Convolutional Neural Network (CNN). Both algorithms were trained using 21,950 manually annotated fish and non-fish sounds collected from 2014 to 2019 at five different locations in the Strait of Georgia, British Columbia, Canada. The performance of the detectors was tested on part of the data from the Strait of Georgia that was withheld from the training phase, data from Barkley Sound, British Columbia, and data collected in the Port of Miami, Florida, United States. The CNN performed up to 1.9 times better than the RF (F1 score: 0.82 vs. 0.43). In some cases, the CNN was able to find more faint fish sounds than the analyst and performed well in environments different from the one it was trained in (Miami F1 score: 0.88). Noise analysis in the 20--1,000 Hz frequency band shows that the CNN is still reliable in noise levels greater than 130 dB re 1 μPa in the Port of Miami but becomes less reliable in Barkley Sound past 100 dB re 1 μPa due to mooring noise. The proposed approach can efficiently monitor (unidentified) fish sounds in a variety of environments and can also facilitate the development of species-specific detectors. We provide the software FishSound Finder, an easy-to-use open-source implementation of the CNN detector with detailed documentation. [ABSTRACT FROM AUTHOR]

Tree species classification using hyperspectral imagery shows incredible promise in developing a large-scale, high-resolution model for identifying tree species, providing unprecedented details on global tree species distribution. Many questions remain unanswered about the best practices for creating a global, general hyperspectral tree species classification model. This study aims to address three key issues in creating a hyperspectral species classification model. We assessed the effectiveness of three data-labeling methods to create training data, three data-splitting methods for training/validation/testing, and machine-learning and deep-learning (including semi-supervised deep-learning) models for tree species classification using hyperspectral imagery at National Ecological Observatory Network (NEON) Sites. Our analysis revealed that the existing data-labeling method using the field vegetation structure survey performed reasonably well. The random tree data-splitting technique was the most efficient method for both intra-site and inter-site classifications to overcome the impact of spatial autocorrelation to avoid the potential to create a locally overfit model. Deep learning consistently outperformed random forest classification; both semi-supervised and supervised deep-learning models displayed the most promising results in creating a general taxa-classification model. This work has demonstrated the possibility of developing tree-classification models that can identify tree species from outside their training area and that semi-supervised deep learning may potentially utilize the untapped terabytes of unlabeled forest imagery. [ABSTRACT FROM AUTHOR]

Skin cancer diagnosis greatly benefits from advanced machine learning techniques, particularly fine-tuned deep learning models. In our research, we explored the impact of traditional machine learning and fine-tuned deep learning approaches on prediction accuracy. Our findings reveal significant improvements in predictability and accuracy with fine-tuning, particularly evident in deep learning models. The CNN, SVM, and Random Forest Classifier achieved high accuracy. However, fine-tuned deep learning models such as EfficientNetB0, ResNet34, VGG16, Inception _v3, and DenseNet121 demonstrated superior performance. To ensure comparability, we fine-tuned these models by incorporating additional layers, including one flatten layer and three densely interconnected layers. These layers play a crucial role in enhancing model efficiency and performance. The flatten layer preprocesses multidimensional feature maps, facilitating efficient information flow, while subsequent dense layers refine feature representations, capturing intricate patterns and relationships within the data. Leveraging LeakyReLU activation functions in the dense layers mitigates the vanishing gradient problem and promotes stable training. Finally, the output dense layer with a sigmoid activation function simplifies decision making for healthcare professionals by providing binary classification output. Our study underscores the significance of incorporating additional layers in fine-tuned neural network models for skin cancer classification, offering improved accuracy and reliability in diagnosis. [ABSTRACT FROM AUTHOR]

Given the increasing competition among household appliance enterprises, accurately predicting household appliance demand is crucial for enterprise supply chain management and marketing. This paper proposes a combined model integrating deep learning and ensemble learning—LSTM-RF-XGBoost—to assist enterprises in identifying customer demand, thereby addressing the complexity and uncertainty of the household appliance market demand. In this study, Long Short-Term Memory Network (LSTM), Random Forest (RF), and Extreme Gradient Boosting (XGBoost) models are established separately. Then, the three individual algorithms are used as the base models in the first layer, with the multiple linear regression (MLR) algorithm serving as the meta-model in the second layer, merging the demand prediction model based on the hybrid model into the overall demand prediction model. This study demonstrates that the accuracy and stability of demand prediction using the LSTM–RF–XGBoost model significantly outperform traditional single models, highlighting the significant advantages of using a combined model. This research offers practical and innovative solutions for enterprises seeking rational resource allocation through demand prediction. [ABSTRACT FROM AUTHOR]

This paper proposes an advanced deep learning model that integrates the Diffusion-Transformer structure and parallel attention mechanism for the tasks of growth estimation and disease detection in jujube forests. Existing methods in forestry monitoring often fall short in meeting the practical needs of large-scale and highly complex forest areas due to limitations in data processing capabilities and feature extraction precision. In response to this challenge, this paper designs and conducts a series of benchmark tests and ablation experiments to systematically evaluate and verify the performance of the proposed model across key performance metrics such as precision, recall, accuracy, and F1-score. Experimental results demonstrate that compared to traditional machine learning models like Support Vector Machines and Random Forests, as well as common deep learning models such as AlexNet and ResNet, the model proposed in this paper achieves a precision of 95%, a recall of 92%, an accuracy of 93%, and an F1-score of 94% in the task of disease detection in jujube forests, showing similarly superior performance in growth estimation tasks as well. Furthermore, ablation experiments with different attention mechanisms and loss functions further validate the effectiveness of parallel attention and parallel loss function in enhancing the overall performance of the model. These research findings not only provide a new technical path for forestry disease monitoring and health assessment but also contribute rich theoretical and experimental foundations for related fields. [ABSTRACT FROM AUTHOR]

Brazil, a leading rice producer globally, faces challenges in systematically mapping its diverse rice fields due to varying cropping systems, climates, and planting calendars. Existing rice mapping methods often rely on complex techniques like deep learning or microwave imagery, posing limitations for large-scale mapping. This study proposes a novel approach utilizing Sentinel-2 spectral–temporal metrics (STMs) in conjunction with a random forest classifier for rice paddy mapping. By extracting diverse STMs and training both regional and global classifiers, we validated the method across independent areas. While regional models tended to overestimate rice areas, the global model effectively reduced discrepancies between our data and the reference maps, achieving an overall classifier accuracy exceeding 80%. Despite the need for further refinement to address confusion with other crops, STM exhibits promise for national-scale rice paddy mapping in Brazil. [ABSTRACT FROM AUTHOR]

Predicting phase stability in high entropy alloys (HEAs), such as phase fractions as functions of composition and temperature, is essential for understanding alloy properties and screening desirable materials. Traditional methods like CALPHAD are computationally intensive for exploring high-dimensional compositional spaces. To address such a challenge, this study explored and compared the effectiveness of random forests (RF) and deep neural networks (DNN) for accelerating materials discovery by building surrogate models of phase stability prediction. For interpolation scenarios (testing on the same order of system as trained), RF models generally produce smaller errors than DNN models. However, for extrapolation scenarios (training on lower-order systems and testing on higher order systems), DNNs generalize more effectively than traditional ML models. DNN demonstrate the potential to predict topologically relevant phase composition when data were missing, making it a powerful predictive tool in materials discovery frameworks. The study uses a CALPHAD dataset of 480 million data points generated from a custom database, available for further model development and benchmarking. Experiments show that DNN models are data-efficient, achieving similar performance with a fraction of the dataset. This work highlights the potential of DNNs in materials discovery, providing a powerful tool for predicting phase stability in HEAs, particularly within the Cr-Hf-Mo-Nb-Ta-Ti-V-W-Zr composition space. [ABSTRACT FROM AUTHOR]

BACKGROUND: The field of toxicology has witnessed substantial advancements in recent years, particularly with the adoption of new approach methodologies (NAMs) to understand and predict chemical toxicity. Class-based methods such as clustering and classification are key to NAMs development and application, aiding the understanding of hazard and risk concerns associated with groups of chemicals without additional laboratory work. Advances in computational chemistry, data generation and availability, and machine learning algorithms represent important opportunities for continued improvement of these techniques to optimize their utility for specific regulatory and research purposes. However, due to their intricacy, deep understanding and careful selection are imperative to align the adequate methods with their intended applications. OBJECTIVES: This commentary aims to deepen the understanding of class-based approaches by elucidating the pivotal role of chemical similarity (structural and biological) in clustering and classification approaches (CCAs). It addresses the dichotomy between general end point–agnostic similarity, often entailing unsupervised analysis, and end point–specific similarity necessitating supervised learning. The goal is to highlight the nuances of these approaches, their applications, and common misuses. DISCUSSION: Understanding similarity is pivotal in toxicological research involving CCAs. The effectiveness of these approaches depends on the right definition and measure of similarity, which varies based on context and objectives of the study. This choice is influenced by how chemical structures are represented and the respective labels indicating biological activity, if applicable. The distinction between unsupervised clustering and supervised classification methods is vital, requiring the use of end point–agnostic vs. end point–specific similarity definition. Separate use or combination of these methods requires careful consideration to prevent bias and ensure relevance for the goal of the study. Unsupervised methods use end point– agnostic similarity measures to uncover general structural patterns and relationships, aiding hypothesis generation and facilitating exploration of datasets without the need for predefined labels or explicit guidance. Conversely, supervised techniques demand end point–specific similarity to group chemicals into predefined classes or to train classification models, allowing accurate predictions for new chemicals. Misuse can arise when unsupervised methods are applied to end point–specific contexts, like analog selection in read-across, leading to erroneous conclusions. This commentary provides insights into the significance of similarity and its role in supervised classification and unsupervised clustering approaches. [ABSTRACT FROM AUTHOR]

With the ongoing challenge of air pollution posing serious health and environmental threats, particularly in rapidly industrializing regions, accurate forecasting and effective pollutant identification are crucial for enhancing public health and ecological stability. This study aimed to optimize air quality management through the prediction of the Air Quality Index (AQI) and identification of air pollutants. Our study spans nine representative cities (Hohhot, Yinchuan, Lanzhou, Beijing, Taiyuan, Xi'an, Shanghai, Nanjing, Wuhan) in China, with data collected from January 1, 2015, to November 30, 2021. We proposed a new model for daily AQI prediction, termed VMD-CSA-CNN-LSTM, which employed advanced machine learning techniques, including convolutional neural networks (CNN) and long short-term memory (LSTM) networks, and leveraged the chameleon swarm algorithm (CSA) for hyperparameter optimization, integrated through a variational mode decomposition approach. The model was developed using data from Lanzhou, with a split ratio of 8:1:1 into training, validation, and test sets, achieving an RMSE of 2.25, MAPE of 0.02, adjusted R-squared of 98.91%, and training efficiency of 5.31%. The model was further externally validated in the other eight cities, yielding comparable results, with an adjusted R-squared above 96%, MAPE below 0.1, and RMSE below 7.5. Additionally, we employed a random forest algorithm to identify the primary pollutants contributing to AQI levels. Our results indicated that PM2.5 was the most significant pollutant in Beijing, Taiyuan, and Xi'an, while PM10 was dominant in Hohhot, Yinchuan, and Lanzhou. In Shanghai, Nanjing, and Wuhan, both PM2.5 and PM10 were critical, with ozone also identified as a major air pollutant. This study not only advances the predictive accuracy of AQI models but also aids policymakers by providing a reliable tool for air quality management and strategic planning aimed at pollution reduction. The integration of these advanced computational techniques into environmental monitoring practices offers a promising avenue for enhancing air quality and mitigating pollution-related risks. [ABSTRACT FROM AUTHOR]

Site-specific weed management employs image data to generate maps through various methodologies that classify pixels corresponding to crop, soil, and weed. Further, many studies have focused on identifying specific weed species using spectral data. Nonetheless, the availability of open-access weed datasets remains limited. Remarkably, despite the extensive research employing hyperspectral imaging data to classify species under varying conditions, to the best of our knowledge, there are no open-access hyperspectral weed datasets. Consequently, accessible spectral weed datasets are primarily RGB or multispectral and mostly lack the temporal aspect, i.e., they contain a single measurement day. This paper introduces an open dataset for training and evaluating machine-learning methods and spectral features to classify weeds based on various biological traits. The dataset comprises 30 hyperspectral images, each containing thousands of pixels with 204 unique visible and near-infrared bands captured in a controlled environment. In addition, each scene includes a corresponding RGB image with a higher spatial resolution. We included three weed species in this dataset, representing different botanical groups and photosynthetic mechanisms. In addition, the dataset contains meticulously sampled labeled data for training and testing. The images represent a time series of the weed's growth along its early stages, critical for precise herbicide application. We conducted an experimental evaluation to test the performance of a machine-learning approach, a deep-learning approach, and Spectral Mixture Analysis (SMA) to identify the different weed traits. In addition, we analyzed the importance of features using the random forest algorithm and evaluated the performance of the selected algorithms while using different sets of features. [ABSTRACT FROM AUTHOR]

Several machine learning (ML) techniques have demonstrated efficacy in precisely forecasting HIV risk and identifying the most eligible individuals for HIV testing in various countries. Nevertheless, there is a data gap on the utility of ML algorithms in strengthening HIV testing worldwide. This systematic review aimed to evaluate how effectively ML algorithms can enhance the efficiency and accuracy of HIV testing interventions and to identify key outcomes, successes, gaps, opportunities, and limitations in their implementation. This review was guided by the Preferred Reporting Items for Systematic Reviews and Meta-Analysis guidelines. A comprehensive literature search was conducted via PubMed, Google Scholar, Web of Science, Science Direct, Scopus, and Gale OneFile databases. Out of the 845 identified articles, 51 studies were eligible. More than 75% of the articles included in this review were conducted in the Americas and various parts of Sub-Saharan Africa, and a few were from Europe, Asia, and Australia. The most common algorithms applied were logistic regression, deep learning, support vector machine, random forest, extreme gradient booster, decision tree, and the least absolute shrinkage selection operator model. The findings demonstrate that ML techniques exhibit higher accuracy in predicting HIV risk/testing compared to traditional approaches. Machine learning models enhance early prediction of HIV transmission, facilitate viable testing strategies to improve the efficiency of testing services, and optimize resource allocation, ultimately leading to improved HIV testing. This review points to the positive impact of ML in enhancing early prediction of HIV spread, optimizing HIV testing approaches, improving efficiency, and eventually enhancing the accuracy of HIV diagnosis. We strongly recommend the integration of ML into HIV testing programs for efficient and accurate HIV testing. [ABSTRACT FROM AUTHOR]

This study focuses on estimating the lead times of various processes in wind tower factories. Accurate estimation of these times allows for more efficient sequencing of activities, proper allocation of resources, and setting of realistic delivery dates, thus avoiding delays and bottlenecks in the production flow and improving process quality and efficiency. In addition, accurate estimation of these times contributes to a proper assessment of costs, overcoming the limitations of traditional techniques; this allows for the establishment of tighter quotations. The data used in this study were collected at wind tower manufacturing facilities in Spain and Brazil. Data preprocessing was conducted rigorously, encompassing cleaning, transformation, and feature selection processes. Following preprocessing, machine learning regression analysis was performed to estimate lead times. Nine algorithms were employed: decision trees, random forest, Ridge regression, Lasso regression, Elastic Net, support vector regression, gradient boosting, XGBoost, LightGBM, and multilayer perceptron. Additionally, the performance of two deep learning models, TabNet and NODE, designed specifically for tabular data, was evaluated. The results showed that gradient boosting-based algorithms were the most effective in predicting processing times and optimizing resource allocation. The system is designed to retrain models as new information becomes available. [ABSTRACT FROM AUTHOR]

This study addresses the growing concern of technostress, a condition caused by the overwhelming use of digital technologies, exacerbated by the COVID-19 pandemic. The researchers developed a predictive model using machine learning algorithms, Random Forest (RF) and Support Vector Machine (SVM), to assess and manage technostress levels. The model considers factors such as age, gender, technology usage hours, and technological experiences to classify stress levels into high, moderate, and low categories. The study collected data through a questionnaire administered to knowledgeable respondents, using a non-probabilistic sampling approach. The results showed that both RF and SVM algorithms achieved high accuracy in classifying technostress, with SVM performing slightly better (94.5% vs 84.50%). The model’s effectiveness in predicting stress levels for users with varying degrees of stress is a significant contribution to the field. The research also developed an interactive user interface to facilitate user engagement with the model, promoting stress management and well-being in a technology-driven society. The study’s findings provide valuable insights into the challenges posed by technostress and offer a solution for mitigating its effects. The use of machine learning algorithms to classify gender based on the dataset demonstrates the model’s potential applications in various areas. Overall, this study demonstrates the importance of addressing technostress in the digital age and provides a valuable tool for managing stress levels. The development of predictive models like this one can help individuals and organizations mitigate the negative impacts of technostress, promoting a healthier and more sustainable relationship with technology. [ABSTRACT FROM AUTHOR]

Marine transportation accounts for approximately 90% of the total trade managed in international logistics and plays a vital role in many companies' supply chains. However, en-route factors like weather conditions or piracy incidents often delay scheduled arrivals at destination ports, leading to downstream inefficiencies. Due to the maritime industry's digital transformation, smart ports and vessels generate vast amounts of data, creating an opportunity to use the latest technologies, like machine and deep learning (ML/DL), to support terminals in their operations. This study proposes a data-driven solution for accurately predicting vessel arrival times using ML/DL techniques, including Deep Neural Networks, K-Nearest Neighbors, Decision Trees, Random Forest, and Extreme Gradient Boosting. This study collects real-world AIS data in the Eastern Mediterranean Sea from a network of public and private AIS base stations. The most relevant features are selected for training and evaluating the six ML/DL models. A comprehensive comparison is also performed against the estimated arrival time provided by shipping agents, a simple calculation-based approach, and four other ML/DL models proposed recently in the literature. The evaluation has revealed that Random Forest achieves the highest performance with an MAE of 99.9 min, closely followed by XGBoost, having an MAE of 105.0 min. [ABSTRACT FROM AUTHOR]

In recent years, machine learning (ML) algorithms have gained substantial recognition for ecological modeling across various temporal and spatial scales. However, little evaluation has been conducted for the prediction of soil organic carbon (SOC) on small data sets commonly inherent to long-term soil ecological research. In this context, the performance of ML algorithms for SOC prediction has never been tested against traditional process-based modeling approaches. Here, we compare ML algorithms, calibrated and uncalibrated process-based models as well as multiple ensembles on their performance in predicting SOC using data from five long-term experimental sites (comprising 256 independent data points) in Austria. Using all available data, the ML-based approaches using Random forest and Support vector machines with a polynomial kernel were superior to all process-based models. However, the ML algorithms performed similar or worse when the number of training samples was reduced or when a leave-one-site-out cross validation was applied. This emphasizes that the performance of ML algorithms is strongly dependent on the data-size related quality of learning information following the well-known curse of dimensionality phenomenon, while the accuracy of process-based models significantly relies on proper calibration and combination of different modeling approaches. Our study thus suggests a superiority of ML-based SOC prediction at scales where larger datasets are available, while process-based models are superior tools when targeting the exploration of underlying biophysical and biochemical mechanisms of SOC dynamics in soils. Therefore, we recommend applying ensembles of ML algorithms with process-based models to combine advantages inherent to both approaches. • We evaluated process-based (PB) and machine-learning (ML) models for SOC prediction. • Random forest & support vector machine predicted SOC superior to PB models. • Reduced data availability and quality significantly weakened ML model performance. • ML-assisted PB model ensembles strongly improved model performance. [ABSTRACT FROM AUTHOR]

Despite its proven success in various fields such as engineering, business, and healthcare, human–machine collaboration in education remains relatively unexplored. This study aims to highlight the advantages of human–machine collaboration for improving the efficiency and accuracy of decision-making processes in educational settings. High school dropout prediction serves as a case study for examining human–machine collaboration's efficacy. Unlike previous research prioritizing high accuracy with immutable predictors, this study seeks to bridge gaps by identifying actionable factors for dropout prediction through a framework of human–machine collaboration. Utilizing a large dataset from the High School Longitudinal Study of 2009 (HSLS:09), two machine learning models were developed to predict 9th-grade students' high school dropout history. Results indicated that the Random Forest algorithm outperformed the deep learning algorithm. Model explainability revealed the significance of actionable variables such as students' GPA in the 9th grade, sense of school belonging, self-efficacy in mathematics and science, and immutable variables like socioeconomic status in predicting high school dropout history. The study concludes with discussions on the practical implications of human–machine partnerships for enhancing student success. [ABSTRACT FROM AUTHOR]

In recent years, the semantic segmentation model has been widely applied in fields such as the extraction of crops due to its advantages such as strong discrimination ability, high accuracy, etc. Currently, there is no standard set of ground true label data for major crops in China, and the visual interpretation process is usually time-consuming and laborious. The sample size also makes it difficult to support the model to learn enough ground features, resulting in poor generalisation ability of the model, which in turn makes the model difficult to apply in fine extraction tasks of large-area crops. In this study, a method to establish a pseudo-label sample set based on the random forest algorithm to train a semantic segmentation model (U-Net) was proposed to perform winter wheat extraction. With the help of the GEE platform, Winter Wheat Canopy Index (WCI) indicators were employed in this method to initially extract winter wheat, and training samples (i.e., pseudo labels) were built for the semantic segmentation model through the iterative process of "generating random sample points—random forest model training—winter wheat extraction"; on this basis, the U-net model was trained with multi-time series remote sensing images; finally, the U-Net model was employed to obtain the spatial distribution map of winter wheat in Henan Province in 2022. The results illustrated that: (1) Pseudo-label data were constructed using the random forest model in typical regions, achieving an overall accuracy of 97.53% under validation with manual samples, proving that its accuracy meets the requirements for U-Net model training. (2) Utilizing the U-Net model, U-Net++ model, and random forest model constructed based on pseudo-label data for 2022, winter wheat mapping was conducted in Henan Province. The extraction accuracy of the three models is in the order of U-Net model > U-Net++ model > random forest model. (3) Using the U-Net model to predict the winter wheat planting areas in Henan Province in 2019, although the extraction accuracy decreased compared to 2022, it still exceeded that of the random forest model. Additionally, the U-Net++ model did not achieve higher classification accuracy. (4) Experimental results demonstrate that deep learning models constructed based on pseudo-labels exhibit higher classification accuracy. Compared to traditional machine learning models like random forest, they have higher spatiotemporal adaptability and robustness, further validating the scientific and practical feasibility of pseudo-labels and their generation strategies, which are expected to provide a feasible technical pathway for intelligent extraction of winter wheat spatial distribution information in the future. [ABSTRACT FROM AUTHOR]

This project employs artificial intelligence, including machine learning and deep learning, to assess COVID-19 readmission risk in Malaysia. It offers tools to mitigate healthcare resource strain and enhance patient outcomes. This study outlines a methodology for classifying COVID-19 readmissions. It starts with dataset description and pre-processing, while the data balancing was computed through Random Oversampling, Borderline SMOTE, and Adaptive Synthetic Sampling. Nine machine learning and ten deep learning techniques are applied, with five-fold cross-validation for evaluation. Optuna is used for hyperparameter selection, while the consistency in training hyperparameters is maintained. Evaluation metrics encompass accuracy, AUC, and training/inference times. Results were based on stratified five-fold cross-validation and different data-balancing methods. Notably, CatBoost consistently excelled in accuracy and AUC across all tables. Using ROS, CatBoost achieved the highest accuracy (0.9882 ± 0.0020) with an AUC of 1.0000 ± 0.0000. CatBoost maintained its superiority in BSMOTE and ADASYN as well. Deep learning approaches performed well, with SAINT leading in ROS and TabNet leading in BSMOTE and ADASYN. Decision Tree ensembles like Random Forest and XGBoost consistently showed strong performance. [ABSTRACT FROM AUTHOR]

Cardiovascular and neurological diseases are a major cause of mortality and morbidity worldwide. Such diseases require careful monitoring to effectively manage their progression. Artificial intelligence (AI) offers valuable tools for this purpose through its ability to analyse data and identify predictive patterns. This review evaluated the application of AI in cardiac and neurological diseases for their clinical impact on the general population. We reviewed studies on the application of AI in the neurological and cardiological fields. Our search was performed on the PubMed, Web of Science, Embase and Cochrane library databases. Of the initial 5862 studies, 23 studies met the inclusion criteria. The studies showed that the most commonly used algorithms in these clinical fields are Random Forest and Artificial Neural Network, followed by logistic regression and Support-Vector Machines. In addition, an ECG-AI algorithm based on convolutional neural networks has been developed and has been widely used in several studies for the detection of atrial fibrillation with good accuracy. AI has great potential to support physicians in interpretation, diagnosis, risk assessment and disease management. [ABSTRACT FROM AUTHOR]

The past few years have seen an emergence of interest in examining the significance of machine learning (ML) in the medical field. Diseases, health emergencies, and medical disorders may now be identified with greater accuracy because of technological advancements and advances in ML. It is essential especially to diagnose individuals with chronic diseases (CD) as early as possible. Our study has focused on analyzing ML's applicability to predict CD, including cardiovascular disease, diabetes, cancer, liver, and neurological disorders. This study offered a high-level summary of the previous research on ML-based approaches for predicting CD and some instances of their applications. To wrap things up, we compared the results obtained by various studies and the methodologies as well as tools employed by the researchers. The factors or parameters that are responsible for improving the accuracy of the predicting model for different previous works are also identified. For identifying significant features, most of the authors employed a variety of strategies, where least absolute shrinkage and selection (LASSO), minimal-redundancy-maximum-relevance (mRMR), and RELIEF are extensively used methods. It is seen that a wide range of ML approaches, including support vector machine (SVM), random forest (RF), decision tree (DT), naïve Bayes (NB), etc., have been widely used. Also, several deep learning techniques and hybrid models are employed to create CD prediction models, resulting in efficient and reliable clinical decision-making models. For the benefit of the whole healthcare system, we have also offered our suggestions for enhancing the prediction results of CD. [ABSTRACT FROM AUTHOR]

Artificial intelligence algorithms have become extensively utilized in survival analysis for high-dimensional, multi-source data. However, due to their complexity, these methods often yield poorly interpretable outcomes, posing challenges in the analysis of several conditions. One of these conditions is obstructive sleep apnea, a sleep disorder characterized by the simultaneous occurrence of comorbidities. Survival analysis provides a potential solution for assessing and categorizing the severity of obstructive sleep apnea, aiding personalized treatment strategies. Given the critical role of time in such scenarios and considering limitations in model interpretability, time-dependent explainable artificial intelligence algorithms have been developed in recent years for direct application to basic Machine Learning models, such as Cox regression and survival random forest. Our work aims to enhance model selection in OSA survival analysis using time-dependent XAI for Machine Learning and Deep Learning models. We developed an end-to-end pipeline, training several survival models and selecting the best performers. Our top models—Cox regression, Cox time, and logistic hazard—achieved good performance, with C-index scores of 0.81, 0.78, and 0.77, and Brier scores of 0.10, 0.12, and 0.11 on the test set. We applied SurvSHAP methods to Cox regression and logistic hazard to investigate their behavior. Although the models showed similar performance, our analysis established that the results of the log hazard model were more reliable and useful in clinical practice compared to those of Cox regression in OSA scenarios. [ABSTRACT FROM AUTHOR]

Motivation Understanding the mechanisms and structural mappings between molecules and pathway classes are critical for design of reaction predictors for synthesizing new molecules. This article studies the problem of prediction of classes of metabolic pathways (series of chemical reactions occurring within a cell) in which a given biochemical compound participates. We apply a hybrid machine learning approach consisting of graph convolutional networks used to extract molecular shape features as input to a random forest classifier. In contrast to previously applied machine learning methods for this problem, our framework automatically extracts relevant shape features directly from input SMILES representations, which are atom-bond specifications of chemical structures composing the molecules. Results Our method is capable of correctly predicting the respective metabolic pathway class of 95.16% of tested compounds, whereas competing methods only achieve an accuracy of 84.92% or less. Furthermore, our framework extends to the task of classification of compounds having mixed membership in multiple pathway classes. Our prediction accuracy for this multi-label task is 95.62%. We analyze the relative importance of various global physicochemical features to the pathway class prediction problem and show that simple linear/logistic regression models can predict the values of these global features from the shape features extracted using our framework. Availability and implementation https://github.com/baranwa2/MetabolicPathwayPrediction. [ABSTRACT FROM AUTHOR]

Blockchain is a developing technology that promises advancements when it is applied to other fields. Applying blockchain to other systems requires a customized blockchain model to satisfy the requirements of different application fields. One important area is to integrate blockchain with smart spaces and the Internet of Things to process, manage, and store data. Actually, smart spaces and Internet of Things systems include various types of transactions in terms of sensitivity. The sensitivity can be considered as correctness sensitivity, time sensitivity, and specialization sensitivity. Correctness sensitivity means that the systems should accept precise or approximated data in some cases, whereas time sensitivity means that there are time bounds for each type of transaction, and specialization sensitivity applies when some transactions are processed only by specialized people. Therefore, this work introduces the smart partitioned blockchain model, where we use machine learning and deep learning models to classify transactions into different pools according to their sensitivity levels. Then, each pool is mapped to a specific part of the smart partitioned blockchain model. The parts can be permissioned or permissionless. The permissioned parts can have different sub-parts if needed. Consequently, the smart partitioned blockchain can be customized to meet application-field requirements. In the experimental results, we use bank and medical datasets with a predefined sensitivity threshold for classification accuracy in each system. The bank transactions are critical, whereas the classification of the medical dataset is speculative and less critical. The Random Forest model is used for bank-dataset classification, and its accuracy reaches 100%, whereas Sequential Deep Learning is used for the medical dataset, which reaches 91%. This means that all bank transactions are correctly mapped to the corresponding parts of the blockchain, whereas accuracy is lower for the medical dataset. However, acceptability is determined based on the predefined sensitivity threshold. [ABSTRACT FROM AUTHOR]

Airborne laser technology produces point clouds that can be used to build 3D models of buildings. However, the work is a laborious process that could benefit from automation. Artificial intelligence (AI) has been widely used in automating building segmentation as one of the initial stages in the 3D modeling process. The algorithms with a high success rate using point clouds for automatic semantic segmentation are random forest (RF) and PointNet++, with each algorithm having its own advantages and disadvantages. However, the training and testing data to develop and test the model usually share similar characteristics. Moreover, producing a good automation model requires a lot of training data, which may become an issue for users with a small amount of training data (limited data). The aim of this research is to test the performance of the RF and PointNet++ models in different regions with limited training and testing data. We found that the RF model developed from a small amount data, in different regions between the training and testing data, performs well compared to PointNet++, yielding an OA score of 73.01% for the RF model. Furthermore, several scenarios have been used in this research to explore the capabilities of RF in several cases. [ABSTRACT FROM AUTHOR]

In this work, we present a novel methodology for performing the supervised classification of time-ordered noisy data; we call this methodology Entropic Sparse Probabilistic Approximation with Markov regularization (eSPA-Markov). It is an extension of entropic learning methodologies, allowing the simultaneous learning of segmentation patterns, entropy-optimal feature space discretizations, and Bayesian classification rules. We prove the conditions for the existence and uniqueness of the learning problem solution and propose a one-shot numerical learning algorithm that—in the leading order—scales linearly in dimension. We show how this technique can be used for the computationally scalable identification of persistent (metastable) regime affiliations and regime switches from high-dimensional non-stationary and noisy time series, i.e., when the size of the data statistics is small compared to their dimensionality and when the noise variance is larger than the variance in the signal. We demonstrate its performance on a set of toy learning problems, comparing eSPA-Markov to state-of-the-art techniques, including deep learning and random forests. We show how this technique can be used for the analysis of noisy time series from DNA and RNA Nanopore sequencing. [ABSTRACT FROM AUTHOR]

Machine learning (ML) has been broadly applied for vadose zone applications in recent years. This article provides a comprehensive review of such developments. ML applications for variables corresponding to different complex vadose zone processes are summarized mostly in a prediction context. By analyzing and assessing these applications, we discovered extensive usages of classic ML models with relatively limited applications of deep learning (DL) approaches in general. We also recognized a lack of benchmark datasets for soil property research as well as limited integration of physics‐based vadose zone principles into the ML approaches. To facilitate this interdisciplinary research of ML in vadose zone characterization and processes, a paradigm of knowledge‐guided machine learning is suggested along with other data‐driven and ML model‐based research suggestions to advance future research. Core Ideas: Random forest and artificial neural network are two widely applied machine learning options for predicting vadose zone studies.A benchmark dataset is missing in soil property studies.We suggest vadose zone scientists explore more deep learning options and expand knowledge‐guided machine learning implementations. [ABSTRACT FROM AUTHOR]

The study uses machine learning and deep learning models to study the intricate relationship between viral genetic DNA sequences and host organisms. It uses a comprehensive dataset from databases like ExPASy and NCBI, which encodes crucial genetic information for viral replication. The study aimed to create a viral DNA dataset and develop robust machine learning and deep learning models to classify viruses into eight host categories. Despite extensive experimentation using various models, performance improvement was elusive due to genetic overlaps. Viral genomes from different classes had significant shared genetic sequences, making it difficult for these models to identify unique class-specific features, blurring the lines of differentiation. The study reduced the number of classes from eight to three, focusing on plants, animals, and microorganisms. This resulted in improved evaluation metrics, with the Random Forest Machine learning model reaching a maximum accuracy of 70% and the LSTM deep learning model surpassing 85%, overcoming earlier challenges. The discovery that viral genomes from different classes share significant genetic overlaps challenges conventional molecular distinctions, emphasizing the complexity of molecular differentiation in viral genomes. This pragmatic approach aligns molecular understanding with genetic data in viral host determination. [ABSTRACT FROM AUTHOR]

Tea, a commonly consumed beverage, is susceptible to being sold in adulterated or expired forms by third-party vendors. Hyperspectral imaging across different wavelength bands has proven to precisely assess the diverse types of tea and their corresponding financial gains. This study aims to employ a deep learning methodology in conjunction with hyperspectral imaging for efficiently classifying tea leaves. A novel approach is proposed, wherein a waveband convolutional neural network is utilized to generate hyper spectral images of tea leaf samples with enhanced resolution. The model known as optimized-convolutional neural network-random forest O-(ConvNet-RF) demonstrated exceptional performance, achieving high accuracy, impressive recall, F1 score, and notable sensitivity rate, outperforming existing alternative methods. The tea leaf types, namely green, yellow, and black, were accurately identified using a combination of the random forest (RF) model and the O-ConvNet-RF model. The tree-based classification method for the identification of tea leaves demonstrated superior performance as compared to alternative machine learning models. In general, this study presents a successful methodology for the classification of tea leaves, with potential implications for consumer processing and distributor profit analysis. [ABSTRACT FROM AUTHOR]

Virtual reality (VR) and immersive technology have emerged as powerful tools with numerous applications. VR technology creates a computer-generated simulation that immerses users in a virtual environment, providing a highly realistic and interactive experience. This technology finds applications in various fields, including gaming, healthcare, education, architecture, and training simulations. Understanding user immersion levels in VR is crucial and challenging for optimizing the design of VR applications. Immersion refers to the extent to which users feel absorbed and engrossed in the virtual environment. This research primarily aims to detect user immersion levels in VR using an efficient machine-learning model. We utilized a benchmark dataset based on user experiences in VR environments to conduct our experiments. Advanced deep and machine learning approaches are applied in comparison. We proposed a novel technique called Polynomial Random Forest (PRF) for feature generation mechanisms. The proposed PRF approach extracts polynomial and class prediction probability features to generate a new feature set. Extensive research experiments show that random forest outperformed state-of-the-art approaches, achieving a high immersion level detection rate of 98%, using the proposed PRF technique. We applied hyperparameter optimization and cross-validation approaches to validate the performance scores. Additionally, we utilized explainable artificial intelligence (XAI) to interpret the reasoning behind the decisions made by the proposed model for user immersion level detection in VR. Our research has the potential to revolutionize user immersion level detection in VR, enhancing the design process. [ABSTRACT FROM AUTHOR]

The fundamental method for pre-processing speech or text data that enables computers to comprehend human language is known as natural language processing. Numerous models have been developed to date to pre-process data in the English language; however, the Hindi language does not support these models. India's national tongue is Hindi. In order to help the locals, the authors of this study used supervised learning methods like Linear Regression, SVM, and Naive Bayes algorithm to investigate a dataset of complicated terms in the Hindi language. Additionally, a sophisticated Hindi word classification model is suggested employing several methods based on the forecasts as well as collective learning strategies like Random Forest, Adaboost, and Decision Tree. Depending on how well the user's language is understood, the suggested model will assist in simplifying Hindi text. Authors attempt to classify the uncharted dataset using deep learning algorithms like Bi-LSTM and GRU approaches in further processing. [ABSTRACT FROM AUTHOR]

Skin lesion classification plays a crucial role in the early detection and diagnosis of various skin conditions. Recent advances in computer-aided diagnostic techniques have been instrumental in timely intervention, thereby improving patient outcomes, particularly in rural communities lacking specialized expertise. Despite the widespread adoption of convolutional neural networks (CNNs) in skin disease detection, their effectiveness has been hindered by the limited size and data imbalance of publicly accessible skin lesion datasets. In this context, a two-step hierarchical binary classification approach is proposed utilizing hybrid machine and deep learning (DL) techniques. Experiments conducted on the International Skin Imaging Collaboration (ISIC 2017) dataset demonstrate the effectiveness of the hierarchical approach in handling large class imbalances. Specifically, employing DenseNet121 (DNET) as a feature extractor and random forest (RF) as a classifier yielded the most promising results, achieving a balanced multiclass accuracy (BMA) of 91.07% compared to the pure deep-learning model (end-to-end DNET) with a BMA of 88.66%. The RF ensemble exhibited significantly greater efficiency than other machine-learning classifiers in aiding DL to address the challenge of learning with limited data. Furthermore, the implemented predictive hybrid hierarchical model demonstrated enhanced performance while significantly reducing computational time, indicating its potential efficiency in real-world applications for the classification of skin lesions. [ABSTRACT FROM AUTHOR]

Intrusion Detection Systems (IDSs) play a crucial role in safeguarding network infrastructures from cyber threats and ensuring the integrity of highly sensitive data. Conventional IDS technologies, although successful in achieving high levels of accuracy, frequently encounter substantial model bias. This bias is primarily caused by imbalances in the data and the lack of relevance of certain features. This study aims to tackle these challenges by proposing an advanced machine learning (ML) based IDS that minimizes misclassification errors and corrects model bias. As a result, the predictive accuracy and generalizability of the IDS are significantly improved. The proposed system employs advanced feature selection techniques, such as Recursive Feature Elimination (RFE), sequential feature selection (SFS), and statistical feature selection, to refine the input feature set and minimize the impact of non-predictive attributes. In addition, this work incorporates data resampling methods such as Synthetic Minority Oversampling Technique and Edited Nearest Neighbor (SMOTE_ENN), Adaptive Synthetic Sampling (ADASYN), and Synthetic Minority Oversampling Technique–Tomek Links (SMOTE_Tomek) to address class imbalance and improve the accuracy of the model. The experimental results indicate that our proposed model, especially when utilizing the random forest (RF) algorithm, surpasses existing models regarding accuracy, precision, recall, and F Score across different data resampling methods. Using the ADASYN resampling method, the RF model achieves an accuracy of 99.9985% for botnet attacks and 99.9777% for Man-in-the-Middle (MITM) attacks, demonstrating the effectiveness of our approach in dealing with imbalanced data distributions. This research not only improves the abilities of IDS to identify botnet and MITM attacks but also provides a scalable and efficient solution that can be used in other areas where data imbalance is a recurring problem. This work has implications beyond IDS, offering valuable insights into using ML techniques in complex real-world scenarios. [ABSTRACT FROM AUTHOR]

The Yellow River Delta wetlands in China belong to the coastal wetland ecosystem, which is one of the youngest and most characteristic wetlands in the world. The Yellow River Delta wetlands are constantly changed by inland sediment and the influence of waves and storm surges, so the accurate classification of the coastal wetlands in the Yellow River Delta is of great significance for the rational utilization, development and protection of wetland resources. In this study, the Yellow River Delta sentinel-2 multispectral data were processed by super-resolution synthesis, and the feature bands were optimized. The optimal feature-band combination scheme was screened using the OIF algorithm. A deep learning model attention mechanism ResNet based on feature optimization with attention mechanism integration into the ResNet network is proposed. Compared with the classical machine learning model, the AM_ResNet model can effectively improve the classification accuracy of the wetlands in the Yellow River Delta. The overall accuracy was 94.61% with a Kappa of 0.93, and they were improved by about 6.99% and 0.1, respectively, compared with the best-performing Random Forest Classification in machine learning. The results show that the method can effectively improve the classification accuracy of the wetlands in the Yellow River Delta. [ABSTRACT FROM AUTHOR]

Non-neural machine learning (ML) and deep learning (DL) are used to predict system failures in industrial maintenance. However, only a few studies have assessed the effect of varying the amount of past data used to make a prediction and the extension in the future of the forecast. This study evaluates the impact of the size of the reading window and of the prediction window on the performances of models trained to forecast failures in three datasets of (1) an industrial wrapping machine working in discrete sessions, (2) an industrial blood refrigerator working continuously, and (3) a nitrogen generator working continuously. A binary classification task assigns the positive label to the prediction window based on the probability of a failure to occur in such an interval. Six algorithms (logistic regression, random forest, support vector machine, LSTM, ConvLSTM, and Transformers) are compared on multivariate time series. The dimension of the prediction windows plays a crucial role and the results highlight the effectiveness of DL approaches in classifying data with diverse time-dependent patterns preceding a failure and the effectiveness of ML approaches in classifying similar and repetitive patterns preceding a failure. [ABSTRACT FROM AUTHOR]

Cardiovascular disease (CVD) is a leading cause of death globally; therefore, early detection of CVD is crucial. Many intelligent technologies, including deep learning and machine learning (ML), are being integrated into healthcare systems for disease prediction. This paper uses a voting ensemble ML with chi-square feature selection to detect CVD early. Our approach involved applying multiple ML classifiers, including naïve Bayes, random forest, logistic regression (LR), and k-nearest neighbor. These classifiers were evaluated through metrics including accuracy, specificity, sensitivity, F1-score, confusion matrix, and area under the curve (AUC). We created an ensemble model by combining predictions from the different ML classifiers through a voting mechanism, whose performance was then measured against individual classifiers. Furthermore, we applied chi-square feature selection method to the 303 records across 13 clinical features in the Cleveland cardiac disease dataset to identify the 5 most important features. This approach improved the overall accuracy of our ensemble model and reduced the computational load considerably by more than 50%. Demonstrating superior effectiveness, our voting ensemble model achieved a remarkable accuracy of 92.11%, representing an average improvement of 2.95% over the single highest classifier (LR). These results indicate the ensemble method as a viable and practical approach to improve the accuracy of CVD prediction. [ABSTRACT FROM AUTHOR]

With the rapid growth of online property rental and sale platforms, the prevalence of fake real estate listings has become a significant concern. These deceptive listings waste time and effort for buyers and sellers and pose potential risks. Therefore, developing effective methods to distinguish genuine from fake listings is crucial. Accurately identifying fake real estate listings is a critical challenge, and clustering analysis can significantly improve this process. While clustering has been widely used to detect fraud in various fields, its application in the real estate domain has been somewhat limited, primarily focused on auctions and property appraisals. This study aims to fill this gap by using clustering to classify properties into fake and genuine listings based on datasets curated by industry experts. This study developed a K-means model to group properties into clusters, clearly distinguishing between fake and genuine listings. To assure the quality of the training data, data pre-processing procedures were performed on the raw dataset. Several techniques were used to determine the optimal value for each parameter of the K-means model. The clusters are determined using the Silhouette coefficient, the Calinski-Harabasz index, and the Davies-Bouldin index. It was found that the value of cluster 2 is the best and the Camberra technique is the best method when compared to overlapping similarity and Jaccard for distance. The clustering results are assessed using two machine learning algorithms: Random Forest and Decision Tree. The observational results have shown that the optimized K-means significantly improves the accuracy of the Random Forest classification model, boosting it by an impressive 96%. Furthermore, this research demonstrates that clustering helps create a balanced dataset containing fake and genuine clusters. This balanced dataset holds promise for future investigations, particularly for deep learning models that require balanced data to perform optimally. This study presents a practical and effective way to identify fake real estate listings by harnessing the power of clustering analysis, ultimately contributing to a more trustworthy and secure real estate market. [ABSTRACT FROM AUTHOR]

Skin cancer has a significant impact on the lives of many individuals annually and is recognized as the most prevalent type of cancer. In the United States, an estimated annual incidence of approximately 3.5 million people receiving a diagnosis of skin cancer underscores its widespread prevalence. Furthermore, the prognosis for individuals afflicted with advancing stages of skin cancer experiences a substantial decline in survival rates. This paper is dedicated to aiding healthcare experts in distinguishing between benign and malignant skin cancer cases by employing a range of machine learning and deep learning techniques and different feature extractors and feature selectors to enhance the evaluation metrics. In this paper, different transfer learning models are employed as feature extractors, and to enhance the evaluation metrics, a feature selection layer is designed, which includes diverse techniques such as Univariate, Mutual Information, ANOVA, PCA, XGB, Lasso, Random Forest, and Variance. Among transfer models, DenseNet-201 was selected as the primary feature extractor to identify features from data. Subsequently, the Lasso method was applied for feature selection, utilizing diverse machine learning approaches such as MLP, XGB, RF, and NB. To optimize accuracy and precision, ensemble methods were employed to identify and enhance the best-performing models. The study provides accuracy and sensitivity rates of 87.72% and 92.15%, respectively. [ABSTRACT FROM AUTHOR]

Recent studies have shown that the microbiome can impact cancer development, progression, and response to therapies suggesting microbiome-based approaches for cancer characterization. As cancer-related signatures are complex and implicate many taxa, their discovery often requires Machine Learning approaches. This review discusses Machine Learning methods for cancer characterization from microbiome data. It focuses on the implications of choices undertaken during sample collection, feature selection and pre-processing. It also discusses ML model selection, guiding how to choose an ML model, and model validation. Finally, it enumerates current limitations and how these may be surpassed. Proposed methods, often based on Random Forests, show promising results, however insufficient for widespread clinical usage. Studies often report conflicting results mainly due to ML models with poor generalizability. We expect that evaluating models with expanded, hold-out datasets, removing technical artifacts, exploring representations of the microbiome other than taxonomical profiles, leveraging advances in deep learning, and developing ML models better adapted to the characteristics of microbiome data will improve the performance and generalizability of models and enable their usage in the clinic. [ABSTRACT FROM AUTHOR]

Monitoring snow avalanche activity is essential for operational avalanche forecasting and the successful implementation of mitigation measures to ensure safety in mountain regions. To facilitate and automate the monitoring process, avalanche detection systems equipped with seismic sensors can provide a cost-effective solution. Still, automatically differentiating avalanche signals from other sources in seismic data remains challenging, mainly due to the complexity of seismic signals generated by avalanches, the complex signal transmission through the ground, the relatively rare occurrence of avalanches, and the presence of multiple sources in the continuous seismic data. One approach to automate avalanche detection is by applying machine learning methods. So far, research in this area has mainly focused on extracting standard domain-specific signal attributes in the time and frequency domains as input features for statistical models. In this study, we propose a novel application of deep learning autoencoder models for the automatic and unsupervised extraction of features from seismic recordings. These new features are then fed into classifiers for discriminating snow avalanches. To this end, we trained three Random forest classifiers based on different feature extraction approaches. The first set of 32 features was automatically extracted from the time-series signals by an autoencoder consisting of convolutional layers and a recurrent long short-term memory unit. The second autoencoder applies a series of fully connected layers to extract 16 features from the spectrum of the signals. As a benchmark, a third random forest was trained with typical waveform, spectral and spectrogram attributes used to discriminate seismic events. We extracted all these features from 10-second windows of the seismograms recorded with an array of five seismometers installed in an avalanche test site located above Davos, Switzerland. The database used to train and test the models contained 84 avalanches and 828 noise (unrelated to avalanches) events recorded during the winter seasons of 2020–2021 and 2021–2022. Finally, we assessed the performance of each classifier, compared the results, and proposed different aggregation methods to improve the predictive performance of the developed seismic detection algorithms. The classifiers achieved an avalanche f1-score of 0.61 (seismic attributes), 0.49 (temporal autoencoder) and 0.60 (spectral autoencoder) and avalanche recall of 0.68, 0.71 and 0.71, respectively. Overall, the macro f1-score ranged from 0.70 (temporal autoencoder) to 0.78 (seismic attributes). After applying a post-processing step to event-based predictions, the avalanche recall of the three models significantly increased, reaching values between 0.82 and 0.91. The developed approach could be potentially used as an operational, near-real-time avalanche detection system. Yet, the relatively high number of false alarms still needs further implementation of the current automated seismic classification algorithms to be used as unique methods to detect avalanches effectively. [ABSTRACT FROM AUTHOR]

Stroke is a high morbidity and mortality disease that poses a serious threat to people's health. Early recognition of the various warning signs of stroke is necessary so that timely clinical intervention can help reduce the severity of stroke. Deep neural networks have powerful feature representation capabilities and can automatically learn discriminant features from large amounts of data. This paper uses a range of physiological characteristic parameters and collaborates with deep neural networks, such as the Wasserstein generative adversarial networks with gradient penalty and regression network, to construct a stroke prediction model. Firstly, to address the problem of imbalance between positive and negative samples in the stroke public data set, we performed positive sample data augmentation and utilized WGAN‐GP to generate stroke data with high fidelity and used it for the training of the prediction network model. Then, the relationship between observable physiological characteristic parameters and the predicted risk of suffering a stroke was modeled as a nonlinear mapping transformation, and a stroke prediction model based on a deep regression network was designed. Finally, the proposed method is compared with commonly used machine learning‐based classification algorithms such as decision tree, random forest, support vector machine, and artificial neural networks. The prediction results of the proposed method are optimal in the comprehensive measurement index F. Further ablation experiments also show that the designed prediction model has certain robustness and can effectively predict stroke diseases. [ABSTRACT FROM AUTHOR]

Prostate cancer is a common cancer with significant implications for global health. Prompt and precise identification is crucial for efficient treatment strategizing and enhanced patient results. This research study investigates the utilization of machine learning techniques to diagnose prostate cancer. It emphasizes utilizing deep learning models, namely VGG16, VGG19, ResNet50, and ResNet50V2, to extract relevant features. The random forest approach then uses these features for classification. The study begins by doing a thorough comparison examination of the deep learning architectures outlined above to evaluate their effectiveness in extracting significant characteristics from prostate cancer imaging data. Key metrics such as sensitivity, specificity, and accuracy are used to assess the models' efficacy. With an accuracy of 99.64%, ResNet50 outperformed other tested models when it came to identifying important features in images of prostate cancer. Furthermore, the analysis of understanding factors aims to offer valuable insights into the decision‐making process, thereby addressing a critical problem for clinical practice acceptance. The random forest classifier, a powerful ensemble learning method renowned for its adaptability and ability to handle intricate datasets, then uses the collected characteristics as input. The random forest model seeks to identify patterns in the feature space and produce precise predictions on the presence or absence of prostate cancer. In addition, the study tackles the restricted availability of datasets by utilizing transfer learning methods to refine the deep learning models using a small amount of annotated prostate cancer data. The objective of this method is to improve the ability of the models to generalize across different patient populations and clinical situations. This study's results are useful because they show how well VGG16, VGG19, ResNet50, and ResNet50V2 work for extracting features in the field of diagnosing prostate cancer, when used with random forest's classification abilities. The results of this work provide a basis for creating reliable and easily understandable machine learning‐based diagnostic tools for detecting prostate cancer. This will enhance the possibility of an early and precise diagnosis in clinical settings such as index terms deep learning, machine learning, prostate cancer, cancer identification, and cancer classification. [ABSTRACT FROM AUTHOR]

Recently, explainability in machine and deep learning has become an important area in the field of research as well as interest, both due to the increasing use of artificial intelligence (AI) methods and understanding of the decisions made by models. The explainability of artificial intelligence (XAI) is due to the increasing consciousness in, among other things, data mining, error elimination, and learning performance by various AI algorithms. Moreover, XAI will allow the decisions made by models in problems to be more transparent as well as effective. In this study, models from the 'glass box' group of Decision Tree, among others, and the 'black box' group of Random Forest, among others, were proposed to understand the identification of selected types of currant powders. The learning process of these models was carried out to determine accuracy indicators such as accuracy, precision, recall, and F1-score. It was visualized using Local Interpretable Model Agnostic Explanations (LIMEs) to predict the effectiveness of identifying specific types of blackcurrant powders based on texture descriptors such as entropy, contrast, correlation, dissimilarity, and homogeneity. Bagging (Bagging_100), Decision Tree (DT0), and Random Forest (RF7_gini) proved to be the most effective models in the framework of currant powder interpretability. The measures of classifier performance in terms of accuracy, precision, recall, and F1-score for Bagging_100, respectively, reached values of approximately 0.979. In comparison, DT0 reached values of 0.968, 0.972, 0.968, and 0.969, and RF7_gini reached values of 0.963, 0.964, 0.963, and 0.963. These models achieved classifier performance measures of greater than 96%. In the future, XAI using agnostic models can be an additional important tool to help analyze data, including food products, even online. [ABSTRACT FROM AUTHOR]

Automated disease diagnosis and prediction, powered by AI, play a crucial role in enabling medical professionals to deliver effective care to patients. While such predictive tools have been extensively explored in resource-rich languages like English, this manuscript focuses on predicting disease categories automatically from symptoms documented in the Afaan Oromo language, employing various classification algorithms. This study encompasses machine learning techniques such as support vector machines, random forests, logistic regression, and Naïve Bayes, as well as deep learning approaches including LSTM, GRU, and Bi-LSTM. Due to the unavailability of a standard corpus, we prepared three data sets with different numbers of patient symptoms arranged into 10 categories. The two feature representations, TF-IDF and word embedding, were employed. The performance of the proposed methodology has been evaluated using accuracy, recall, precision, and F1 score. The experimental results show that, among machine learning models, the SVM model using TF-IDF had the highest accuracy and F1 score of 94.7%, while the LSTM model using word2vec embedding showed an accuracy rate of 95.7% and F1 score of 96.0% from deep learning models. To enhance the optimal performance of each model, several hyper-parameter tuning settings were used. This study shows that the LSTM model verifies to be the best of all the other models over the entire dataset. [ABSTRACT FROM AUTHOR]

Objective: To establish whether or not a natural language processing technique could identify two common inpatient neurosurgical comorbidities using only text reports of inpatient head imaging. Materials and methods: A training and testing dataset of reports of 979 CT or MRI scans of the brain for patients admitted to the neurosurgery service of a single hospital in June 2021 or to the Emergency Department between July 1–8, 2021, was identified. A variety of machine learning and deep learning algorithms utilizing natural language processing were trained on the training set (84% of the total cohort) and tested on the remaining images. A subset comparison cohort (n = 76) was then assessed to compare output of the best algorithm against real-life inpatient documentation. Results: For "brain compression", a random forest classifier outperformed other candidate algorithms with an accuracy of 0.81 and area under the curve of 0.90 in the testing dataset. For "brain edema", a random forest classifier again outperformed other candidate algorithms with an accuracy of 0.92 and AUC of 0.94 in the testing dataset. In the provider comparison dataset, for "brain compression," the random forest algorithm demonstrated better accuracy (0.76 vs 0.70) and sensitivity (0.73 vs 0.43) than provider documentation. For "brain edema," the algorithm again demonstrated better accuracy (0.92 vs 0.84) and AUC (0.45 vs 0.09) than provider documentation. Discussion: A natural language processing-based machine learning algorithm can reliably and reproducibly identify selected common neurosurgical comorbidities from radiology reports. Conclusion: This result may justify the use of machine learning-based decision support to augment provider documentation. [ABSTRACT FROM AUTHOR]

Petrographic prediction is crucial in identifying target areas and understanding reservoir lithology in oil and gas exploration. Traditional logging methods often rely on manual interpretation and experiential judgment, which can introduce subjectivity and constraints due to data quality and geological variability. To enhance the precision and efficacy of lithology prediction, this study employed a Savitzky–Golay filter with a symmetric window for anomaly data processing, coupled with a residual temporal convolutional network (ResTCN) model tasked with completing missing logging data segments. A comparative analysis against the support vector regression and random forest regression model revealed that the ResTCN achieves the smallest MAE, at 0.030, and the highest coefficient of determination, at 0.716, which are indicative of its proximity to the ground truth. These methodologies significantly enhance the quality of the training data. Subsequently, a Transformer–long short-term memory (T-LS) model was applied to identify and classify the lithology of unexplored wells. The input layer of the Transformer model follows an embedding-like principle for data preprocessing, while the encoding block encompasses multi-head attention, Add & Norm, and feedforward components, integrating the multi-head attention mechanism. The output layer interfaces with the LSTM layer through dropout. A performance evaluation of the T-LS model against established rocky prediction techniques such as logistic regression, k-nearest neighbor, and random forest demonstrated its superior identification and classification capabilities. Specifically, the T-LS model achieved a precision of 0.88 and a recall of 0.89 across nine distinct lithology features. A Shapley analysis of the T-LS model underscored the utility of amalgamating multiple logging data sources for lithology classification predictions. This advancement partially addresses the challenges associated with imprecise predictions and limited generalization abilities inherent in traditional machine learning and deep learning models applied to lithology identification, and it also helps to optimize oil and gas exploration and development strategies and improve the efficiency of resource extraction. [ABSTRACT FROM AUTHOR]

In this paper, we introduce a novel approach to address the dynamic prediction of customer activity in electronic payment transactions for individual clients. Our approach is founded on customer online payment transaction records from registered UK-based online retailers between 01/12/2009 and 09/12/2011. These retailers primarily specialize in unique gift items for various occasions, catering to a wide range of clients, including wholesalers. We used classification analysis based on the correlation coefficient to measure and describe a customer's electronic payment capability based on the quality of products they purchase. Furthermore, we trained multi-layered models (linear model, deep learning, random forest, and support vector machines (SVM)) to capture the dynamics of e-bank transaction reinforcement for retail customers using machine learning. Real transaction data from a UK online retailer was employed in our study. The experimental results consistently demonstrated the effectiveness of our proposed strategy. [ABSTRACT FROM AUTHOR]

Rock physics plays an important role in the oil, gas, and water industries by providing essential data for reservoir management. This study focuses on predicting Shear Wave Velocity (Vs), a key geophysical parameter, using the Deep Belief Network (DBN) and Random Forest (RF) algorithms. The dataset is divided for training, validation, and testing, revealing that the DBN model surpasses the RF and empirical models in accuracy. With a low RMSE value of 0.0398 km/s in testing and an R2 of 0.9775, the DBN model demonstrates precision in Vs prediction. The analysis identifies specific parameters—Measure Depth (MD), Caliper (CALL), Gamma Ray (GR), Shallow Electrical Resistivity (RES-S), Medium Electrical Resistivity (RES-M), Deep Electrical Resistivity (RES-D), Compressional Wave Velocity (DCT), Neutron Porosity (NPHI), and Photoelectric Coefficient Index (PEF)—as significantly influencing Vs, while CALI and GR have a relatively lesser effect. The results of the Vs prediction indicated that the DBN algorithm excels in deep feature extraction, unsupervised pretraining, and efficient handling of complex data. Ultimately, the DBN algorithm proves to be a superior and time-saving alternative for Vs prediction and analysis in subsurface reservoirs. • Rock physics aids oil, gas, and water industries through crucial reservoir data. • Deep Belief Network (DBN) excels in Vs prediction with superior performance. • DBN model achieves remarkable precision with a low RMSE of 0.0398 km/s. • Correlation analysis identifies key parameters influencing shear wave velocity (Vs). • DBN algorithm proves a time-saving, reliable alternative for Vs prediction in subsurface reservoirs. [ABSTRACT FROM AUTHOR]

The global spread of the SARS-CoV-2 pandemic, originating in Wuhan, China, has had profound consequences on both health and the economy. Traditional alignment-based phylogenetic tree methods for tracking epidemic dynamics demand substantial computational power due to the growing number of sequenced strains. Consequently, there is a pressing need for an alignment-free approach to characterize these strains and monitor the dynamics of various variants. In this work, we introduce a swift and straightforward tool named GenoSig, implemented in C++. The tool exploits the Di and Tri nucleotide frequency signatures to delineate the taxonomic lineages of SARS-CoV-2 by employing diverse machine learning (ML) and deep learning (DL) models. Our approach achieved a tenfold cross-validation accuracy of 87.88% (± 0.013) for DL and 86.37% (± 0.0009) for Random Forest (RF) model, surpassing the performance of other ML models. Validation using an additional unexposed dataset yielded comparable results. Despite variations in architectures between DL and RF, it was observed that later clades, specifically GRA, GRY, and GK, exhibited superior performance compared to earlier clades G and GH. As for the continental origin of the virus, both DL and RF models exhibited lower performance than in predicting clades. However, both models demonstrated relatively higher accuracy for Europe, North America, and South America compared to other continents, with DL outperforming RF. Both models consistently demonstrated a preference for cytosine and guanine over adenine and thymine in both clade and continental analyses, in both Di and Tri nucleotide frequencies signatures. Our findings suggest that GenoSig provides a straightforward approach to address taxonomic, epidemiological, and biological inquiries, utilizing a reductive method applicable not only to SARS-CoV-2 but also to similar research questions in an alignment-free context. [ABSTRACT FROM AUTHOR]

RNA-protein interaction (RPI) is crucial to the life processes of diverse organisms. Various researchers have identified RPI through long-term and high-cost biological experiments. Although numerous machine learning and deep learning-based methods for predicting RPI currently exist, their robustness and generalizability have significant room for improvement. This study proposes LPI-MFF, an RPI prediction model based on multi-source information fusion, to address these issues. The LPI-MFF employed protein–protein interactions features, sequence features, secondary structure features, and physical and chemical properties as the information sources with the corresponding coding scheme, followed by the random forest algorithm for feature screening. Finally, all information was combined and a classification method based on convolutional neural networks is used. The experimental results of fivefold cross-validation demonstrated that the accuracy of LPI-MFF on RPI1807 and NPInter was 97.60% and 97.67%, respectively. In addition, the accuracy rate on the independent test set RPI1168 was 84.9%, and the accuracy rate on the Mus musculus dataset was 90.91%. Accordingly, LPI-MFF demonstrated greater robustness and generalization than other prevalent RPI prediction methods. [ABSTRACT FROM AUTHOR]