Search

The majority of people are using connecting media in recent times, like Facebook, Twitter, LinkedIn, etc. People like to communicate on social websites as compared to direct conversation due to the lack of time, fast communication, minimizing long distance, etc. but more fraud such as fake accounts, cloned attacks, etc. are generated due to growing data on social connecting media. In our proposed approach, we are using the Bernoulli RBM_RF Classifier (BRRC) to detect cloned attacks in connecting media. This model is based on deep learning algorithms and more research is under process but still, there is no such kind of model to provide high accuracy. In this model, we have used multiple algorithms Artificial Neural Networks (ANN), Logistic Regression, Decision Trees, K-Nearest Neighbour Classification, Random Forest, and Bernoulli RBM with extra add-on features of the random forest we have created a Bernoulli pipeline also known as BRRC. Our goal is to establish a clear neural network connection between our target attributes. Finally, we created a restricted Boltzmann machine using a RBM Bernoulli pipeline with additional add-on random forest features after using random forest, where we employed n number of decision trees for classification and provided the same in depth. Our model can extract higher-level features from the given data and helps in the dimensionality Reduction of the input data by learning a compressed representation. Accuracy can be improved by using a big dataset with particular connecting media attributes that are either not currently available or are only sparingly present. We can conclude that Bernoulli Restricted Boltzmann Machine is the best fit and suitable for our model with 93% accuracy. [ABSTRACT FROM AUTHOR]

Purpose: This study leverages pre-procedural data and machine learning (ML) techniques to predict outcomes at one year following prostate artery embolization (PAE). Materials and Methods: This retrospective analysis combines data from the UK-ROPE registry and patients that underwent PAE at our institution between 2012 and 2023. Traditional ML approaches, including linear regression, lasso regression, ridge regression, decision trees and random forests, were used with leave-one-out cross-validation to predict international prostate symptom score (IPSS) at baseline and change at 1 year. Predictors included age, prostate volume, Qmax (maximum urinary flow rate), post-void residual volume, Abrams-Griffiths number (urodynamics score) and baseline IPSS (for change at 1 year). We also independently confirmed our findings using a separate dataset. An interactive digital user interface was developed to facilitate real-time outcome prediction. Results: Complete data were available in 128 patients (66.7 ± 6.9 years). All models predicting IPSS demonstrated reasonable performance, with mean absolute error ranging between 4.9–7.3 for baseline IPSS and 5.2–8.2 for change in IPSS. These numbers represent the differences between the patient-reported and model-predicted IPSS scores. Interestingly, the model error in predicting baseline IPSS (based on objective measures alone) significantly correlated with the change in IPSS at 1-year post-PAE (R2 = 0.2, p < 0.001), forming the basis for our digital user interface. Conclusion: This study uses ML methods to predict IPSS improvement at 1 year, integrated into a user-friendly interface for real-time prediction. This tool could be used to counsel patients prior to treatment. [ABSTRACT FROM AUTHOR]

Machine learning (ML) models, particularly decision tree (DT)-based algorithms, are being increasingly utilized for flood susceptibility mapping. To evaluate the advantages of DT-based ML models over traditional statistical models on flood susceptibility assessment, a comparative study is needed to systematically compare the performances of DT- based ML models with that of traditional statistical models. New Orleans, which has a long history of flooding and is highly susceptible to flooding, is selected as the test bed. The primary purpose of this study is to compare the performance of multiple DT-based ML models namely DT, Adaptive Boosting (AdaBoost), Gradient Boosting (GdBoost), Extreme Gradient Boosting (XGBoost) and Random Forest (RF) models with a traditional statistical model known as Frequency Ratio (FR) model in New Orleans. This study also aims to identify the main drivers contributing to flooding in New Orleans using the best performing model. Based on the most recent Hurricane Ida-induced flood inventory map and nine crucial flood conditioning factors, the models' accuracies are tested and compared using multiple evaluation metrics. The findings of this study indicate that all DT-based ML models perform better compared to FR. The RF model emerges as the best model (AUC = 0.85) among all DT-based ML models in every evaluation metrics. This study then adopts the RF model to simulate flood susceptibility map (FSM) of New Orleans and compares it with the prediction of FR model. The RF model also demonstrates that low elevation and higher precipitation are the main factors responsible for flooding in New Orleans. Therefore, this comparative approach offers a significant understanding about the advantages of advanced ML models over traditional statistical models in local flood susceptibility assessment. [ABSTRACT FROM AUTHOR]

A stroke is a dangerous, life-threatening disease that mostly affects people over 65, but an unhealthy diet is also contributing to the development of strokes at younger ages. Strokes can be treated successfully if they are identified early enough, and suitable therapies are available. The purpose of this study is to develop a stroke prediction model that will improve stroke prediction effectiveness as well as accuracy. Predicting whether someone is suffering from a stroke or not can be accomplished with this proposed machine learning algorithm. In this research, various machine learning techniques are evaluated for predicting stroke on the healthcare stroke dataset. The feature selection algorithms used here are gradient boosting and random forest, and classifiers include the decision tree classifier, Support Vector Machine (SVM) classifier, logistic regression classifier, gradient boosting classifier, random forest classifier, K neighbors classifier, and Xtreme gradient boosting classifier. In this process, different machine-learning approaches are employed to test predictive methods on different data samples. As a result obtained from the different methods applied, and the comparison of different classification models, the random forest model offers an accuracy rate of 98%. [ABSTRACT FROM AUTHOR]

Air quality is a fundamental component of a healthy environment for human beings. Monitoring networks for air pollution have been established in numerous industrial zones. The data collected by the pervasive monitoring devices can be utilized not only for determining the current environmental condition, but also for forecasting it in the near future. This paper considers the applications of different machine learning methods for the prediction of the two most widely used quantities. Particulate matter (PM) with a diameter of 2.5 and 10 µm, respectively. The data are collected via a proprietary monitoring station, designated as the Ecolumn. The Ecolumn monitors a number of key parameters, including temperature, pressure, humidity, PM 1.0, PM 2.5, and PM 10, in a timely manner. The data were employed in the development of multiple models based on selected machine learning methods. The decision tree, random forest, recurrent neural network, and long short-term memory models were employed. Experiments were conducted with varying hyperparameters and network architectures. Different time scales (10 min, 1 h, and 24 h) were examined. The most optimal results were observed for the Long Short-Term Memory algorithm when utilizing the shortest available time spans (shortest averaging times). The decision tree and random forest algorithms demonstrated unexpectedly high performance for long averaging times, exhibiting only a slight decline in accuracy compared to neural networks for shorter averaging times. Recommendations for the potential applicability of the tested methods were formulated. [ABSTRACT FROM AUTHOR]

Purpose Methods Results Conclusion Level of Evidence The objective of this study is to train and test machine‐learning (ML) models to automatically classify shoulder rehabilitation exercises.The cohort included both healthy and patients with rotator‐cuff (RC) tears. All participants performed six shoulder rehabilitation exercises, following guidelines developed by the American Society of Shoulder and Elbow Therapists. Each exercise was repeated six times, while wearing a wearable system equipped with three magneto‐inertial sensors. Six supervised machine‐learning models (k‐Nearest Neighbours, Support Vector Machine, Decision Tree, Random Forest (RF), Logistic Regression and Adaptive Boosting) were trained for the classification. The algorithms' ability to accurately classify exercise activities was evaluated using the nested cross‐validation method, with different combinations of outer and inner folds.A total of 19 healthy subjects and 17 patients with complete RC tears were enroled in the study. The highest classification performances were achieved by the RF classifier, with an accuracy of 89.91% and an F1‐score of 89.89%.The results of this study highlight the feasibility and effectiveness of using wearable sensors and ML algorithms to accurately classify shoulder rehabilitation exercises. These findings suggest promising prospects for implementing the proposed wearable system in remote home‐based monitoring scenarios. The ease of setup and modularity of the system reduce user burden enabling patient‐driven sensor positioning.Level III. [ABSTRACT FROM AUTHOR]

This article investigates the behavior of hybrid FRP Concrete-Steel columns with an elliptical cross section. The investigation was carried out by gathering information through literature and conducting a parametric study, which resulted in 116 data points. Moreover, multiple machine learning predictive models were developed to accurately estimate the confined ultimate strain and the ultimate load of confined concrete at the rupture of FRP tube. Decision Tree (DT), Random Forest (RF), Adaptive Boosting (ADAB), Categorical Boosting (CATB), and eXtreme Gradient Boosting (XGB) machine learning techniques were utilized for the proposed models. Finally, these models were visually and quantitatively verified and evaluated. It was concluded that the CATB and XGB are standout models, offering high accuracy and strong generalization capabilities. The CATB model is slightly superior due to its consistently lower error rates during testing, indicating it is the best model for this dataset when considering both accuracy and robustness against overfitting. [ABSTRACT FROM AUTHOR]

Within the Hadoop ecosystem, MapReduce stands as a cornerstone for managing, processing, and mining large-scale datasets. Yet, the absence of efficient solutions for precise estimation of job execution times poses a persistent challenge, impacting task allocation and distribution within Hadoop clusters. In this study, we present a comprehensive machine learning approach for predicting the execution time of MapReduce jobs, encompassing data collection, preprocessing, feature engineering, and model evaluation. Leveraging a rich dataset derived from comprehensive Hadoop MapReduce job traces, we explore the intricate relationship between cluster parameters and job performance. Through a comparative analysis of machine learning models, including linear regression, decision tree, random forest, and gradient-boosted regression trees, we identify the random forest model as the most effective, demonstrating superior predictive accuracy and robustness. Our findings underscore the critical role of features such as data size and resource allocation in determining job performance. With this work, we aim to enhance resource management efficiency and enable more effective utilisation of cloud-based Hadoop clusters for large-scale data processing tasks. [ABSTRACT FROM AUTHOR]

Introduction: The Indian Himalayas' susceptibility to landslides, particularly as a location where climate change effects may be event catalysts, necessitates the development of dependable landslide susceptibility maps (LSM). Method: This study diverges from traditional binary classification models, framing LSM as a positive-unlabeled learning problem. This approach acknowledges that regions without recorded landslides are not necessarily at low risk but could simply have not experienced landslides yet. The study utilizes novel positive-unlabeled learning-enhanced algorithms—Random Forest, K-Nearest Neighbor, and Decision Tree—to create LSM for Chamoli district, India. Eleven causative factors for landslides are identified, including elevation, aspect, slope, geology, geomorphology, distance to lineament, lithology, NDVI, distance to river, distance to road and residential land use. To address spatial correlation biases, instead of randomly splitting the dataset, the study adopts spatial splitting to get the training and testing datasets. Conclusion: The study reveals that positive-unlabeled learning substantially improves the Area Under Curve and recall, leading to a more conservative LSM compared to binary classification methods. Analysis shows that the southern region of Chamoli exhibits high recall but lower accuracy, suggesting a latent high landslide susceptibility despite a lack of historical landslides in this region. The study also quantifies the impact of human activity on landslide risk, indicating an elevated threat to life and the local economy, especially in Chamoli's southwestern areas. [ABSTRACT FROM AUTHOR]

The past few years have seen an emergence of interest in examining the significance of machine learning (ML) in the medical field. Diseases, health emergencies, and medical disorders may now be identified with greater accuracy because of technological advancements and advances in ML. It is essential especially to diagnose individuals with chronic diseases (CD) as early as possible. Our study has focused on analyzing ML's applicability to predict CD, including cardiovascular disease, diabetes, cancer, liver, and neurological disorders. This study offered a high-level summary of the previous research on ML-based approaches for predicting CD and some instances of their applications. To wrap things up, we compared the results obtained by various studies and the methodologies as well as tools employed by the researchers. The factors or parameters that are responsible for improving the accuracy of the predicting model for different previous works are also identified. For identifying significant features, most of the authors employed a variety of strategies, where least absolute shrinkage and selection (LASSO), minimal-redundancy-maximum-relevance (mRMR), and RELIEF are extensively used methods. It is seen that a wide range of ML approaches, including support vector machine (SVM), random forest (RF), decision tree (DT), naïve Bayes (NB), etc., have been widely used. Also, several deep learning techniques and hybrid models are employed to create CD prediction models, resulting in efficient and reliable clinical decision-making models. For the benefit of the whole healthcare system, we have also offered our suggestions for enhancing the prediction results of CD. [ABSTRACT FROM AUTHOR]

Predicting hotel ratings from reviews involves natural language processing techniques to extract sentiment and features from text data, then applying machine learning (ML) models like regression or classification to estimate the corresponding rating based on these features. This study proposes an ensemble learning approach for predicting hotel ratings from user reviews. By integrating multiple ML algorithms trained on various textual features, including linguistic, semantic, and sentiment-based attributes, our model achieves superior predictive accuracy. The primary aim of this study is to predict user experience ratings with high accuracy. To achieve this, this research utilizes an Ensemble learning approach known as majority voting to make these predictions effectively. In this investigation, initially, the dataset undergoes cleaning and is subsequently subjected to a series of pre-processing steps using Natural Language Processing (NLP) techniques. The research includes a comparative analysis of various classifiers along with different embedding methods. Seven different types of classifiers are used alongside three embedding techniques i.e., Term Frequency-Inverse Document Frequency (TF-IDF), Bag of Words (BoW), and Word2Vec. The classifiers include, Logistic Regression without Cross Validation (LR), LR with Cross Validation (LRCV), Decision Tree Classifier (DTC), Stochastic Gradient Descent Classifier (SGDC), Random Forest Classifier (RFC), Support Vector Classifier (SVC) and K-Nearest Neighbour (KNN). Our proposed methodology demonstrates higher accuracy and robust performance. Accuracy and frequency are utilized as performance metrics for assessing and validating both classifiers and embedding techniques. As per the simulation results, TF-IDF in combination with LRCV achieves an accuracy rate of 61%. [ABSTRACT FROM AUTHOR]

As a popular nutraceutical, collagen powder is the target of adulteration like other high-value food products, therefore detection of adulteration in collagen powder is of great practical significance to ensure market order and the health of the people. To achieve accurate detection of adulterants in collagen powder, a modeling method of fluorescence hyperspectral technology combined with machine learning algorithm was proposed. This study employed various preprocessing methods for denoising and spectral correction to enhance the effective spectral data. Principal component analysis was used to visualize the spectral data and initially revealed the spatial distribution of adulterated collagen powder. Genetic algorithm-k nearest neighbor, particle swarm optimization-support vector machine, and gradient boosting decision tree were used to construct classification models to identify adulterated collagen powder, with the best 2-class discriminant model accuracy, 4-class discriminant model accuracy, and 5-class discriminant model accuracy reaching 99%, 94%, and 98%, respectively. In the quantitative detection models of adulteration level, the random forest model performed best with correlation coefficient (R2) of 0.95 to 0.99. These results suggested that fluorescence hyperspectral technology combined with machine learning algorithm can be effectively used to detect adulterated collagen powder. [ABSTRACT FROM AUTHOR]

This study evaluated the performance of multiple models that used machine learning to anticipate wind speed in the city of Dhaka. The NASA Power website provided the data set for this investigation. The models used for prediction included the decision tree regressor, support vector regressor, random forest, linear regression, neural network and polynomial regression. A hold-out check and k-fold cross-validation were used to assess how well these models performed. With the highest R2 scores and lowest RMSEs on both the validation and test sets, the results demonstrated that the polynomial regression model performed the best. With the lowest R2 scores and largest RMSEs on both sets, the decision tree model scored the poorest. High R2 scores and low RMSEs were achieved by the random forest model, which had comparable performance to the polynomial regression model but required a longer computation time. In addition, the neural network model demonstrated commendable predictive accuracy, yielding an R2 score of 0.67 and a low RMSE of 0.57. However, its application is contingent on the availability of substantial computational resources, given its extensive computation time of 457.93 s. The study concludes by highlighting the efficacy of the Polynomial Regression model as the optimal choice for wind speed prediction in Dhaka, offering a balance between superior performance and efficient computation. This insight provides valuable guidance for practitioners and researchers seeking effective models for similar applications. [ABSTRACT FROM AUTHOR]

Machine learning is frequently used in various geotechnical applications nowadays. This study presents a statistics and machine learning model for settlement prediction of helical piles that relates compressive service load and soil parameters as a group with the pile parameters. Machine learning algorithms such as Decision Trees, Random Forests, AdaBoost, and Artificial Neural Networks (ANN) were used to develop the predictive models. The models were validated using cross-validation techniques and tested on an independent dataset to assess their accuracy and generalizability. Numerical investigation is used here to supplement the field data by simulating various soil conditions and pile geometries that have not been tested in the field. This study compiled numerical results of 3600 models. As the models are well-calibrated and validated, the data from these models can be reasonably assumed to simulate the ground situation. At the end of this study, a comparative analysis of statistic learning and machine learning (ML) was done using the field axial load tests database and numerical investigation on helical piles. It is observed that ML models like Decision Trees and Random Forests provided the better model with R-squared values of 0.92 and 0.96, respectively, for large diameters. The authors believe this study will permit engineers and state agencies to understand this prediction model's efficacy better, resulting in a more resilient approach to designing large-diameter helical piles for the compressive load. [ABSTRACT FROM AUTHOR]

Leptospirosis is a global disease that impacts people worldwide, particularly in humid and tropical regions, and is associated with significant socio-economic deficiencies. Its symptoms are often confused with other syndromes, which can compromise clinical diagnosis and the failure to carry out specific laboratory tests. In this respect, this paper presents a study of three algorithms (Decision Tree, Random Forest and Adaboost) for predicting the outcome (cure or death) of individuals with leptospirosis. Using the records contained in the government National System of Aggressions and Notification (SINAN, in portuguese) from 2007 to 2017, for the state of Pará, Brazil, where the temporal attributes of health care, symptoms (headache, vomiting, jaundice, calf pain) and clinical evolution (renal failure and respiratory changes) were used. In the performance evaluation of the selected models, it was observed that the Random Forest exhibited an accuracy of 90.81% for the training dataset, considering the attributes of experiment 8, and the Decision Tree presented an accuracy of 74.29 for the validation database. So, this result considers the best attributes pointed out by experiment 10: time first symptoms medical attention, time first symptoms ELISA sample collection, medical attention hospital admission time, headache, calf pain, vomiting, jaundice, renal insufficiency, and respiratory alterations. The contribution of this article is the confirmation that artificial intelligence, using the Decision Tree model algorithm, depicting the best choice as the final model to be used in future data for the prediction of human leptospirosis cases, helping in the diagnosis and course of the disease, aiming to avoid the evolution to death. [ABSTRACT FROM AUTHOR]

The paper explores the possibilities of using data classification methods when forecasting time series of the geomagnetic Kp-index by machine learning methods. To classify categories of the Kp-index based on the degree of disturbance, linear and logistic regression, random forest, gradient boosting on top of decision trees, and artificial neural networks of various architectures are used. The results of these methods are compared with a trivial inertial forecast (the statistical indicators of which for problems of this type are always high) at horizons from 3 h to 1 day in 3-h increments. The problem of choosing a cross-validation scheme for selecting the model hyperparameters, ways to overcome the imbalance of categories, the relative importance of input features, as well as the dependence of the results on the test sample (beginning of the 25th solar activity cycle) on inclusion in the training sample of data from the 23rd and 24th cycles or only the 24th cycles are studied. Based on the results, conclusions are drawn about the preferred methods for classifying values of the Kp-index based on the level of geomagnetic disturbance. Ways for further research and possible improvement of the classification quality are outlined, including for determining the characteristic hidden states of Earth's magnetosphere as a dynamic system in order to improve the quality of forecasting geomagnetic indices. [ABSTRACT FROM AUTHOR]

In recent years, machine learning (ML) has become increasingly popular in various fields of activity. Cloud platforms have also grown in popularity, as they offer services that are more secure and accessible worldwide. In this context, cloud-based technologies emerged to support ML, giving rise to the machine learning as a service (MLaaS) concept. However, the clients accessing ML services in order to obtain classification results on private data may be reluctant to upload sensitive information to cloud. The model owners may also prefer not to outsource their models in order to prevent model inversion attacks and to protect intellectual property. The privacy-preserving evaluation of ML models is possible through multi-key homomorphic encryption (MKHE), that allows both the client data and the model to be encrypted under different keys. In this paper, we propose an MKHE evaluation method for decision trees and we extend the proposed method for random forests. Each decision tree is evaluated as a single lookup table, and voting is performed at the level of groups of decision trees in the random forest. We provide both theoretical and experimental evaluations for the proposed method. The aim is to minimize the performance degradation introduced by the encrypted model compared to a plaintext model while also obtaining practical classification times. In our experiments with the proposed MKHE random forest evaluation method, we obtained minimal (less than 0.6%) impact on the main ML performance metrics considered for each scenario, while also achieving reasonable classification times (of the order of seconds). [ABSTRACT FROM AUTHOR]

The escalating frequency and sophistication of cyber threats pose significant challenges to traditional intrusion detection methods. Signature-based misuse detection, hybrid detection, and anomaly detection, while effective in isolation, often struggle to keep pace with the ever-evolving tactics employed by attackers. This research stems from the pressing need to develop intrusion detection models that offer improved accuracy, adaptability, and robustness in the face of rapidly changing attack vectors. Our study leverages a comprehensive set of experiments conducted on diverse datasets, including N-BaIoT, NSL-KDD, and CICIDS2017. The primary focus is on the evaluation and comparison of machine learning algorithms such as Random Forest, XGBoost, and decision trees. Notably, our research culminates in the development of a hybrid intrusion detection model that combines the strengths of these algorithms. The results of our experiments indicate that the hybrid model, particularly when combining Random Forest and XGBoost, exhibits exceptional accuracy. This approach outperforms individual algorithms, achieving an accuracy rate of 97% in certain cases. We attribute this success to the ensemble learning approach, which capitalizes on the consensus of diverse classifiers. In conclusion, our research not only demonstrates the effectiveness of ensemble learning in enhancing intrusion detection but also underscores the importance of continuous adaptation in the face of evolving threats. By leveraging network traffic data, our hybrid model offers a promising avenue for bolstering intrusion classification in Big Data environments. [ABSTRACT FROM AUTHOR]

Insider threats have recently become one of the most urgent cybersecurity challenges facing numerous businesses, such as public infrastructure companies, major federal agencies, and state and local governments. Our purpose is to find the most accurate machine learning (ML) model to detect insider attacks. In the realm of machine learning, the most convenient classifier is usually selected after further evaluation trials of candidate models which can cause unseen data (test data set) to leak into models and create bias. Accordingly, overfitting occurs because of frequent training of models and tuning hyperparameters; the models perform well on the training set while failing to generalize effectively to unseen data. The validation data set and hyperparameter tuning are utilized in this study to prevent the issues mentioned above and to choose the best model from our candidate models. Furthermore, our approach guarantees that the selected model does not memorize data of the threats occurring in the local area network (LAN) through the usage of the NSL-KDD data set. The following results are gathered and analyzed: support vector machine (SVM), decision tree (DT), logistic regression (LR), adaptive boost (AdaBoost), gradient boosting (GB), random forests (RFs), and extremely randomized trees (ERTs). After analyzing the findings, we conclude that the AdaBoost model is the most accurate, with a DoS of 99%, a probe of 99%, access of 96%, and privilege of 97%, as well as an AUC of 0.992 for DoS, 0.986 for probe, 0.952 for access, and 0.954 for privilege. [ABSTRACT FROM AUTHOR]

In this work, our proof-of-concept study can be used to predict the number of cells within printed droplets based on droplet velocity at two different points along the nozzle-substrate distance using machine learning approaches. A novel high-throughput contactless method that combines the use of an optical system and machine learning algorithms was utilized for various applications such as cell detection within single droplets (presence/absence of cells) and prediction of the total number of printed cells within multiple droplets by measuring the droplet deceleration between two positions along the nozzle-substrate distance. The proposed method in this work has demonstrated good accuracy in cell prediction within single droplet (presence/absence of cells) and low prediction error in determining number of cells within multiple droplets by reducing the error by a factor of for N droplets measured in a batch. The performance of five different machine learning algorithms such as linear regression, support vector regression, decision tree regressor, random forest regression, and extra tree regression were compared to determine the best algorithm for each type of application. The random forest regressor algorithm demonstrated the highest accuracy at 80% in cell prediction (presence/absence of cells) within single droplets, while the extra tree regressor demonstrated the lowest mean error of 12% in predicting the number of printed cells within multiple droplets (e.g., 20 droplets on same spot). By incorporating these models in a droplet monitoring system, live assessment of the number of printed cells during an inkjet-based bioprinting process can be achieved. [ABSTRACT FROM AUTHOR]

Heavy metals are the most environmentally hazardous pollutions in agricultural soils, threatening humans and several ecosystem services. Cadmium (Cd) is a highly toxic element but distinctively different from other heavy metals with its high mobility in soil environments. The study aimed to evaluate the Cd concentration of soils in the Konya plain with a specific attribute to soil fertilization, mainly phosphorous fertilizers. A total of 538 surface (0–20 cm) soil samples were analyzed to determine basic physical and chemical properties and total phosphorus (P) and Cd concentrations. Descriptive statistics, machine learning, and regression models were used to assess the accumulation of Cd in soils. Decision Trees, Linear Regression, Random Forest, and XGBoost machine learning methods were used in Cd prediction. The XGBoost model proved to be the best prediction model, with a coefficient of determination of 98.1%. Electrical conductivity, pH, CaCO3, silt, and P were used in the Cd estimation of the XGBoost model and explained 56.51% of the total variance in relation to measured soil properties. The results revealed that a machine learning algorithm could be useful for estimating Cd concentration in soils using basic physical and chemical soil properties. [ABSTRACT FROM AUTHOR]

Higher education is crucial as it introduces students to various fields and then guides them to the next steps. Student's academic performance is critical and could lead to failure if it is not monitored to find the strengths and weaknesses of students and the factors that affect them. That is why the student academic prediction method should be improved so teachers can predict their students' performance. A lot of research tried to improve the prediction accuracy but had problems with imbalanced data and how to tune the algorithm. For this case, we proposed two different machine learning algorithms that handle imbalanced data by applying the Synthetic Minority Oversampling Technique and employing a hyperparameter tuning algorithm to increase the prediction during the training process in the machine learning models. The machine learning models we used are Random Forest and Decision Tree. Models were further tuned using Grid Search, Random Search and Bayesian Optimization Hyperparameter Tuning. After we compared them, the results showed that Synthetic Minority Oversampling Technique and Bayesian Optimization combined with the Decision Tree algorithm outperformed models for student academic prediction. [ABSTRACT FROM AUTHOR]

This study investigates the effectiveness of six prominent machine learning models—random forest, decision trees, K-nearest neighbor, logistic regression, support vector machines, and Naïve Bayes—for intrusion detection systems in industrial Internet of Things environments. The evaluation encompasses the effects of data preprocessing techniques, including feature engineering, data normalization, recoding, and missing data mitigation. Furthermore, the research delves into dataset balancing, examining the effects of six different techniques on model performance. The investigations are conducted using the domain-specific WUSTL-IIOT-2021 dataset, which captures the unique characteristics of IIoT data. The study also investigates multi-class attack identification utilizing an innovative SMOTE-based multi-class balancing approach to tackle dataset imbalances. The results indicate that data preprocessing and intelligent dataset balancing produce consistent enhancements in the classification performance of the selected models across binary and multi-classification tasks. Random forest emerges as the standout algorithm, delivering consistently high performance with computational efficiency. [ABSTRACT FROM AUTHOR]

Assessment of the spatial distribution of potential pathways of sediment transport and the degree of linkage between sediment sources and the channel network within a watershed represents a valuable analysis for informing management decisions on sediment yield and transfer. Given the limitations of conventional methods for determining index of sediment connectivity (IC), there is a need to provide a flexible and efficient approach with the ability to apply different factors. In this regard, five decision tree-based machine learning models: M5 prime (M5P), random tree (RT), random forest (RF), alternating model tree (AMT), and reduced error pruning tree (REPT) were tested using geomorphic and climatic factors. Two databases were constructed with 200 and 1600 classes at 50 watersheds in Queensland, Australia. In these models, IC was assessed as an output parameter and six attributes that affect IC were assigned as input parameters (i.e., elevation, slope, area, length of stream channel, normalized difference vegetation index, and rainfall). Statistical validation and comparison of model predictions with calculated IC values based on the approach of Borselli et al. (Catena 75:268–277, 2008) were performed. Based on the statistical criteria, the RF model produced the most robust estimations of IC compared to other models and performed very well for IC modelling, especially in smaller subsections of watersheds. Accordingly, these findings can play an effective role for implementing watershed management and soil and water resources management measures. [ABSTRACT FROM AUTHOR]

This article aims to predict the mid-span displacements of reinforced concrete (RC) columns exposed to blast loading with machine learning models. Machine learning models including the gradient boosting decision tree (GBDT) model and the random forest (RF) model are developed. The model hyperparameters in the machine learning models are globally optimized using Bayesian optimization method. The dataset used to train and test the models is constructed by collecting data from shock-tube-simulated experiments. Results show that the performance of the optimized models is significantly improved. By comparing the performance metrics of two models, it is evident that the GBDT model is superior to the RF model in predicting mid-span displacements. The optimized GBDT model is then used to predict the displacements of columns during field tests, and the experimental results and predictive results are relatively consistent, which verifies the effectiveness of GBDT model with Bayesian optimization in damage assessment for RC columns. [ABSTRACT FROM AUTHOR]

Privacy and security are the most essential barriers preventing widespread public cloud adaptation. The data that is distributed within the cloud requires privacy protection which can be achieved through the implementation of a data anonymization process. However, there is a lack of privacy for the user data. Even though the differential privacy model minimizes the efficiency, it also leads to generate data loss and privacy is not enhanced. Data securing in a cloud environment is a complex task. The data that are distributed within the cloud requires privacy protection which can be achieved through the implementation of a data anonymization process. So in order to improve the efficiency the novel hybrid ABRF-Stacked Bi-GRU is proposed to secure the medical data. This proposed method diminished the leakage of data and also effectively improve security and privacy. Therefore, in this paper, the privacy-preserving hybrid attention-based random forest (ABRF) with stacked bidirectional gated recurrent unit (stacked Bi-GRU) model named hybrid ABRF-Stacked Bi-GRU is proposed in the cloud environment. This proposed model is used to preserve medical data in the cloud from private data leakage. The attention weights along with the trainable parameters are assigned by the ABRF model to the decision trees. The privacy leakage is reduced by combining Jarratt butterfly optimization algorithm with the Ebola optimization search algorithm. However, in various existing methods, the differential privacy model is applied but it does not minimize the efficiency. In such cases it leads to generate data loss and privacy is not enhanced. Data securing in a cloud environment is a complex task. So in order to improve the efficiency the novel hybrid ABRF-Stacked Bi-GRU is proposed to secure the medical data. This proposed method diminished the leakage of data and also effectively improve security and privacy. The ensemble of the ABRF and stacked Bi-GRU model enhances the security of data in a cloud environment. The proposed model is evaluated using Diabetes UCI Dataset and Obesity UCI ML Dataset. The obtained outcomes compared with existing methods showed that the proposed method achieves a high anonymization degree with less Information Loss and takes less time for computation and minimizes the complexity during computation. [ABSTRACT FROM AUTHOR]

This paper analyzes the efficiency of various machine learning models (artificial neural networks, random forest, decision tree, AdaBoost and XGBoost) against the evolution of VBA-based (Visual Basic for Applications) malware over a large period of time (1995–2021). The file set used in our research is comprehensive—approximately 1.9 million files (out of which 944,595 are malicious and the rest are benign)—which allowed to gain insights on the resilience of various machine learning models against the diversity and the evolution of file features that reflect obfuscation techniques in VBA-based malware. In studying detection of VBA-based malware, we focus on characteristics of both the classifiers—proactivity (short-term detection efficiency against future malware), endurance (long-term detection robustness)—and of the detection-wise relevant file features—feature perishability (dynamics of feature relevance). We also describe in some detail—as a prerequisite of the study—various obfuscation techniques used by the malware under investigation during the last decade. [ABSTRACT FROM AUTHOR]

Learning from high dimensional data has been utilized in various applications such as computational biology, image classification, and finance. Most classical machine learning algorithms fail to give accurate predictions in high dimensional settings due to the enormous feature space. In this article, we present a novel ensemble of classification trees based on weighted random subspaces that aims to adjust the distribution of selection probabilities. In the proposed algorithm base classifiers are built on random feature subspaces in which the probability that influential features will be selected for the next subspace, is updated by incorporating grouping information based on previous classifiers through a weighting function. As an interpretation tool, we show that variable importance measures computed by the new method can identify influential features efficiently. We provide theoretical reasoning for the different elements of the proposed method, and we evaluate the usefulness of the new method based on simulation studies and real data analysis. [ABSTRACT FROM AUTHOR]

Ensemble methods are supervised learning algorithms that provide highly accurate solutions by training many models. Random forest is probably the most widely used in regression and classification problems. It builds decision trees on different samples and takes their majority vote for classification and average in case of regression. However, such an algorithm suffers from a lack of explainability and thus does not allow users to understand how particular decisions are made. To improve on that, we propose a new way of interpreting an ensemble tree structure. Starting from a random forest model, our approach is able to explain graphically the relationship structure between the response variable and predictors. The proposed method appears to be useful in all real-world cases where model interpretation for predictive purposes is crucial. The proposal is evaluated by means of real data sets. [ABSTRACT FROM AUTHOR]

Intensity modulation/direct detection (IM/DD) optical interconnect systems are susceptible to waveform distortion caused by complex nonlinearities. To reduce the effect of waveform distortion on signal transmission accuracy, in this paper, a random forest (RF) equalization algorithm based on decision tree (DT) integration is proposed for cost-sensitive IM/DD systems, which has the characteristics of nonlinear classification and regression. The performance of the RF equalizer is verified by simulation experiments on a 120 Gbps 8-level pulse amplitude modulation (PAM8) transmission system using an electro-absorption-modulated laser (EML). Simulation studies show that whether it is a back-to-back (B2B) transmission system or a 10 km optical fiber transmission system, the RF equalization scheme can achieve much better bit error rate (BER) performance than the traditional equalization scheme. In addition, in both transmission cases, the RF equalization scheme enables efficient classification of signals and is much less simpler than the artificial neural network (ANN) equalization scheme. [ABSTRACT FROM AUTHOR]

Since there has been concern about food security, accurate prediction of wheat yield prior to harvest is a key component. Random Forest (RF) has been used in many classification and regression applications, such as yield estimation, and the performance of RF has improved by tuning its hyperparameters. In this paper, different changes are made to traditional RF for yield estimation, and the performance of RF is evaluated. Accordingly, RFs constructed using various weak learners, as well as a combined RF consisting of different weak learners are assessed by growing weak Gaussian Process Regression (GPR), Decision Tree (DT), Neural Network (NN), and Stepwise Regression (SW) models in the forest. The input data to DTs are also partitioned into leaves in N (e.g., two) dimensional feature space by using clustering in each parent node. In addition, a subset of the training set is randomly sampled with replacement for training a learner in the forest, instead of randomly sampling the whole training set in traditional RF. Using clustering in DTs added flexibility while utilizing NN as a weak learner yielded the most favorable outcomes in our research. The number of input training samples (Itree) to each tree was also identified as a new hyperparameter to the forest, and the prediction results were more influenced by the Itree compared to the known hyperparameters, such as the number of trees in the forest (ntree) and the number of features for each tree (mtry). [ABSTRACT FROM AUTHOR]

Gullying is one of the problems that cause soil degradation in semi-arid areas and should be predicted to mitigate its damaging effects. Three machine learning models have been employed in this work to map the susceptibility to gully erosion in the N'fis river basin in the Moroccan High Atlas. Utilizing high-resolution images from Google Earth alongside fieldwork data, we digitized 434 gully erosion events to construct the comprehensive inventory map. These data were divided into two groups: training (70%) and test (30%). Based on the literature research and the multicollinearity test, 11 conditioning factors were selected. The receiver operating characteristic (ROC) approach and other statistical measures were used to quantify the model's accuracy. The study findings highlight the significance of drainage density, slope, NDVI, and distance from roads as crucial factors influencing gully erosion in the study area. Among the evaluated machine learning algorithms, the random forest (RF) model exhibited the highest performance, with an area under the curve (AUC) value of 0.932. It was followed by adaptive boosting (AB) with an AUC of 0.902 and gradient-boosted decision trees (GBDT) with an AUC of 0.893. The maps produced reveal that the southern and central regions of the study area have the classes of very high and high gully erosion susceptibility. The outputs of the current study can be used by decision-makers to improve prevention planning and mitigation techniques against gully erosion damage. [ABSTRACT FROM AUTHOR]

Landslide is one of the most highly frequent natural hazards that can bring serious casualties. One of the most susceptible landslide regions in Indonesia is Bogor area (the Regency and City of Bogor), which records the highest landslide events in the Province of West Java, Indonesia. An assessment of landslide susceptibility is one of the mitigation measures that can spatially model the zone of landslide hazard. Recently, the Landslide Susceptibility Mapping (LSM) model has been developed using Machine Learning (ML) algorithms. However, there is still no agreement yet on which ML technique is the most appropriate for LSM. Accordingly, this paper aims to explore and compare the 7 ML algorithms for generating the most promising LSM. The LSM uses the available 13 landslide causal factors and a dataset consisting of 822 authorized landslide records and 822 prepared non-landslide points. The resulting LSMs are classified into 5 susceptibility levels, and evaluated through the Area Under Curve (AUC) of the Receiver-Operating Curve (ROC) and statistical indices (sensitivity, specificity, precision, F1-score, and accuracy). The resulting LSMs present that: (1) the very high (VH) class has the largest area percentage in all LSM models, (2) generally, the 7 MLs perform excellent for achieving > 90% AUC value, except for the Decision Tree (DT) (87.68%) in model classification, and (3) moreover, the overall accuracy (ACC) reflects that Random Forest (RF) outperforms the other MLs in model prediction. With this promising result, ML-based LSM models can be promoted as one of the mitigation measures for landslide disaster management. [ABSTRACT FROM AUTHOR]

Interactions between predictors play an important role in many applications. Popular and successful tree-based supervised learning methods such as random forests or logic regression can incorporate interactions associated with the considered outcome without specifying which variables might interact. Nonetheless, these algorithms suffer from certain drawbacks such as limited interpretability of model predictions and difficulties with negligible marginal effects in the case of random forests or not being able to incorporate interactions with continuous variables, being restricted to additive structures between Boolean terms, and not directly considering conjunctions that reveal the interactions in the case of logic regression. We, therefore, propose a novel method called logic decision trees (logicDT) that is specifically tailored to binary input data and helps to overcome the drawbacks of existing methods. The main idea consists of considering sets of Boolean conjunctions, using these terms as input variables for decision trees, and searching for the best performing model. logicDT is also accompanied by a framework for estimating the importance of identified terms, i.e., input variables and interactions between input variables. This new method is compared to other popular statistical learning algorithms in simulations and real data applications. As these evaluations show, logicDT is able to yield high prediction performances while maintaining interpretability. [ABSTRACT FROM AUTHOR]

Predicting oil well behavior regarding the integrity of its equipment during production and anticipating behavioral changes and anomalies are among the main challenges in oil production. In this context, this study focuses on the development of predictive models for real-time monitoring of well behavior using sensor data from production wells. An unsupervised Novelty and Outlier Detection model has been introduced with a specific focus on predicting instances of unexpected subsurface safety valve closures in subsea wells. This model effectively classifies anomalies observed in these systems by leveraging real-world pressure and temperature data sourced from published literature. The methodology involves the implementation of a floating window for assembling training and test sets. Additionally, a comprehensive investigation is conducted into the impact of hyperparameters and the model's threshold value (cp threshold). The results highlight the effectiveness of the developed model, observed through the accuracy achieved around 99.9% in predicting spurious closure events of the Downhole Safety Valve. On the same dataset, previous works reported 99.9% accuracy by using long short-term memory (LSTM) autoencoder, 87.1% by using random forest, and 60% with the Decision Tree method. Looking at F1-SCORE values, the developed model performs the best, followed by the LSTM model, both of which are significantly superior to the Decision Tree and random forest models. Furthermore, the model's applicability is validated through testing in ultradeep water subsea wells within the pre-salt area of the Santos Basin. The significance lies in the potential for this research to enhance anomaly prediction in offshore wells, consequently reducing the costly interventions due to equipment malfunctions. Timely detection and corrective actions, facilitated by the model, can mitigate production loss and safeguard well integrity, addressing critical concerns in the oil and gas industry. [ABSTRACT FROM AUTHOR]

The complex trajectories of higher education students are deviations from the regular path due to delays in completing a degree, dropping out, taking breaks, or changing programmes. In this study, we investigated degree changing as a cause of complex student trajectories. We characterised cohorts of students who graduated with a complex trajectory and identified the characteristics that influenced the time to graduation. To support this predictive task, we employed machine learning techniques such as neural networks, support vector machines, and random forests. In addition, we used interpretable techniques such as decision trees to derive managerial insights that could prove useful to decision-makers. We validated the proposed methodology taking the University of Porto (Portugal) as case study. The results show that the time to degree (TTD) of students with and without complex trajectories was different. Moreover, the proposed models effectively predicted TTD, outperforming two benchmark models. The random forest model proved to be the best predictor. Finally, this study shows that the factors that best predict TTD are the median TTD and the admission regime of the programme of destination of transfer students, followed by the admission average of the previous programme. By identifying students who take longer to complete their studies, targeted interventions such as counselling and tutoring can be promoted, potentially improving completion rates and educational outcomes without having to use as many resources. [ABSTRACT FROM AUTHOR]

What dataset features affect machine learning (ML) performance has primarily been unknown in the current literature. This study examines the impact of tabular datasets' different meta-level and statistical features on the performance of various ML algorithms. The three meta-level features this study considered are the dataset size, the number of attributes and the ratio between the positive (class 1) and negative (class 0) class instances. It considered four statistical features for each dataset: mean, standard deviation, skewness and kurtosis. After applying the required scaling, this study averaged (uniform and weighted) each dataset's different attributes to quantify its four statistical features. We analysed 200 open-access tabular datasets from the Kaggle (147) and UCI Machine Learning Repository (53) and developed ML classification models (through classification implementation and hyperparameter tuning) for each dataset. Then, this study developed multiple regression models to explore the impact of dataset features on ML performance. We found that kurtosis has a statistically significant negative effect on the accuracy of the three non-tree-based ML algorithms of the Support vector machine (SVM), Logistic regression (LR) and K-nearest neighbour (KNN) for their classical implementation with both uniform and weighted aggregations. This study observed similar findings in most cases for ML implementations through hyperparameter tuning, except for SVM with weighted aggregation. Meta-level and statistical features barely show any statistically significant impact on the accuracy of the two tree-based ML algorithms (Decision tree and Random forest), except for implementation through hyperparameter tuning for the weighted aggregation. When we excluded some datasets based on the imbalanced statistics and a significantly higher contribution of one attribute compared to others to the classification performance, we found a significant effect of the meta-level ratio feature and statistical mean and standard deviation features on SVM, LR and KNN accuracy in many cases. Our findings open a new research direction in understanding how dataset characteristics affect ML performance and will help researchers select appropriate ML algorithms for a possible optimal accuracy outcome. [ABSTRACT FROM AUTHOR]

Recently, there has been an increase in telemedicine applied to child neuropsychiatry, such as the use of online platforms to collect remotely case histories and demographic and behavioral information. In the present proof-of-concept study, we aimed to understand to what extent information parents and teachers provide through online questionnaires overlaps with clinicians' diagnostic conclusions on attention-deficit/hyperactivity disorder (ADHD). Moreover, we intended to explore a possible role that autism spectrum disorders (ASD) symptoms played in this process. We examined parent- and teacher-rated questionnaires collected remotely and an on-site evaluation of intelligence quotients from 342 subjects (18% females), aged 3–16 years, and referred for suspected ADHD. An easily interpretable machine learning model—decision tree (DT)—was built to simulate the clinical process of classifying ADHD/non-ADHD based on collected data. Then, we tested the DT model's predictive accuracy through a cross-validation approach. The DT classifier's performance was compared with those that other machine learning models achieved, such as random forest and support vector machines. Differences in ASD symptoms in the DT-identified classes were tested to address their role in performing a diagnostic error using the DT model. The DT identified the decision rules clinicians adopt to classify an ADHD diagnosis with an 82% accuracy rate. Regarding the cross-validation experiment, our DT model reached a predictive accuracy of 74% that was similar to those of other classification algorithms. The caregiver-reported ADHD core symptom severity proved the most discriminative information for clinicians during the diagnostic decision process. However, ASD symptoms were a confounding factor when ADHD severity had to be established. Telehealth procedures proved effective in obtaining an automated output regarding a diagnostic risk, reducing the time delay between symptom detection and diagnosis. However, this should not be considered an alternative to on-site procedures but rather as automated support for clinical practice, enabling clinicians to allocate further resources to the most complex cases. [ABSTRACT FROM AUTHOR]

Digital soil mapping relies on relating soils to a particular set of covariates, which capture inherent soil spatial variation. In digital mapping of soil classes, the most commonly used covariates are topographic attributes, RS attributes, and maps, including geology, geomorphology, and land use; in contrast, the subsurface soil characteristics are usually ignored. Therefore, we investigate the possibility of using soil diagnostic characteristics as covariates in a mountainous landscape as the main aim of this study. Conventional covariates (CC) and a combination of soil subsurface covariates with conventional covariates (SCC) were used as covariates, and random forest (RF), Multinomial Logistic Regression (LR), and C5.0 Decision Trees (C5) were used as different machine learning algorithms in digital mapping of soil family classes. Based on the results, the RF model with the SCC dataset had the best performance (KC = 0.85, OA = 90). In all three models, adding soil covariates to the sets of covariates increased the model performance. Soil covariates, slope, and aspect were selected as the principal auxiliary variables in describing the distribution of soil family classes. [ABSTRACT FROM AUTHOR]

Dyskinesias are non preventable abnormal involuntary movements that represent the main challenge of the long term treatment of Parkinson's disease (PD) with the gold standard dopamine precursor levodopa. Applying machine learning techniques on the data extracted from the Parkinson's Progression Marker Initiative (PPMI, Michael J. Fox Foundation), this study was aimed to identify PD patients who are at high risk of developing dyskinesias. Data regarding clinical, behavioral and neurological features from 697 PD patients were included in our study. Our results show that the Random Forest was the classifier with the best and most consistent performance, reaching an area under the receiver operating characteristic (ROC) curve of up to 91.8% with only seven features. Information regarding the severity of the symptoms, the semantic verbal fluency, and the levodopa treatment were the most important for the prediction, and were further used to create a Decision Tree, whose rules may guide the pharmacological management of PD symptoms. Our results contribute to the identification of PD patients who are prone to develop dyskinesia, and may be considered in future clinical trials aiming at developing new therapeutic approaches for PD. [ABSTRACT FROM AUTHOR]

Economic progress has been founded on environmental pressure by generating all types of environmental harm, such as an increase in greenhouse gases in the atmosphere and significant climate change, which has forced people to reflect. Building a people-oriented, comprehensive, coordinated system to compile experience and lessons assists the government in formulating appropriate policies according to the meaning of the scientific development viewpoint. Based on the above, this research designs Cost–Benefit Decision Tree (CBDT) Algorithm for the economic protection development level using a Decision Tree (DT) and Ensemble Algorithm. In the design of ML Algorithm, this research work initially introduces the Decision Tree model for economic protection evaluation by emphasizing its value as a basic machine-learning framework for fully examining many aspects of economic protection development. Second, it investigates the critical role of Ensemble Algorithms, such as Random Forest in augmenting the capabilities of DT. Third, the paper focuses on the development of a complete Economic Protection Evaluation Index System using the DT Algorithm. To provide a robust, scientifically sound, and practicable framework for evaluating economic protection, this approach integrates scientificity, comparability, systematization, hierarchy, relative decoupling, and data availability principles. Finally, the study constructs the suggested ML Algorithm using the insights from the preceding parts. This algorithm combines the Decision Tree and Random Forest models to generate a single, effective tool for evaluating economic development levels. The experimental findings suggest that the proposed hybrid assessment technique is effective across several dimensions. The proposed CBDT demonstrated its capacity to adapt to changing data circumstances in evaluating low-carbon efficiency using real-world data from 30 major Chinese cities. Furthermore, the algorithm regularly beats rival techniques regarding efficiency improvements, with an average improvement of 12.5% across all cities. Notably, it outperforms other algorithms regarding computational efficiency, with a quicker execution time and an exceptional accuracy rate of 93.2%. The proposed ML Algorithm improves decision-making in the economic protection development level field by effectively balancing cost and benefit considerations. It will improve accuracy and efficiency to outperform existing approaches, thereby advancing economic protection evaluation and decision-making processes in this domain. [ABSTRACT FROM AUTHOR]

The lithology log, an integral component of the master log, graphically portrays the encountered lithological sequence during drilling operations. In addition to offering real-time cross-sectional insights, lithology logs greatly aid in correlating and evaluating multiple sections efficiently. This paper introduces a novel workflow reliant on an enhanced weighted average ensemble approach for producing high-resolution lithology logs. The research contends with a challenging multiclass imbalanced lithofacies distribution emerging from substantial heterogeneities within subsurface geological structures. Typically, methods to handle imbalanced data, e.g., cost-sensitive learning (CSL), are tailored for issues encountered in binary classification. Error correcting output code (ECOC) originates from decomposition strategies, effectively breaking down multiclass problems into numerous binary subproblems. The database comprises conventional well logs and lithology logs obtained from five proximate wells within a Middle Eastern oilfield. Utilizing well-known machine learning (ML) algorithms, such as support vector machine (SVM), random forest (RF), decision tree (DT), logistic regression (LR), and extreme gradient boosting (XGBoost), as baseline classifiers, this study aims to enhance the accurate prediction of underground lithofacies. Upon recognizing a blind well, the data from the remaining four wells are utilized to train the ML algorithms. After integrating ECOC and CSL techniques with the baseline classifiers, they undergo evaluation. In the initial assessment, both RF and SVM demonstrated superior performance, prompting the development of an enhanced weighted average ensemble based on them. The comprehensive numerical and visual analysis corroborates the outstanding performance of the developed ensemble. The average Kappa statistic of 84.50%, signifying almost-perfect agreement, and mean F-measures of 91.04% emphasize the robustness of the designed ensemble-based workflow during the evaluation of blind well data. [ABSTRACT FROM AUTHOR]

The escalating threat of natural disasters to public safety worldwide underlines the crucial role of effective environmental risk management tools, such as insurance. This is particularly evident in the case of earthquakes that occurred in Oklahoma between 2011 and 2020, which were linked to wastewater injection, underscoring the need for earthquake insurance. In this regard, from a survey of 812 respondents in Oklahoma, USA, we used supervised machine learning techniques (i.e., logit, ridge, least absolute shrinkage and selection operator (LASSO), decision tree, and random forest classifiers) to identify the factors that influence earthquake insurance uptake and to predict individuals who would acquire earthquake insurance. Our findings reveal that influential factors that affect earthquake insurance uptake include demographic factors such as older age, male gender, race, and ethnicity. These were found to significantly influence the decision to purchase earthquake insurance. Additionally, individuals residing in rental properties were less likely to purchase earthquake insurance, while longer residency in Oklahoma had a positive influence. Past experience of earthquakes was also found to positively influence the decision to purchase earthquake insurance. Both decision trees and random forests demonstrated good predictive capabilities for identifying earthquake insurance uptake. Notably, random forests exhibited higher precision and robustness, emerging as an encouraging choice for earthquake insurance modeling and other classification problems. Empirically, we highlight the importance of insurance as an environmental risk management tool and emphasize the need for awareness and education on earthquake insurance as well as the use of supervised machine learning algorithms for classification problems. [ABSTRACT FROM AUTHOR]

Machine Learning algorithms has proved its significant contribution in all major domains of technical and non-technical sectors. In present days, the Intelligence Bureau is also using Artificial Intelligence and Machine Learning based analytical approach to predict crime location using past crime data for a given geographical location. Availability of digital records of last few years crimes happened in a certain geographical location is helping crime control division to predict the possible zones for happening next crime and take some precautionary action to reduce the probability of occurring the unwanted event. The government of Boston city initiate to improve city by releasing Crime Incident Report dataset of Boston city to the public. The researcher or analyst can take their initiatives to develop some crime prediction models that can help Boston Police Department to identify the crime prone locations in Boston city and could take some well advance measure to reduce the crime. In this research work, we have analyzed the provided dataset and did an exploratory data analysis to identified the high and low crime prone locations, most severe and least severe crime, year-wise and month-wise crime and shooted and not-shooted crime cases in Boston city. The result presented in this study shows that random forest with Principle Component Analysis (PCA) improve the classification result by 9% in accuracy with comparison to simple decision tree, and PCA with decision tree gives 5% more accuracy than decision tree. Although the computation time is increased in PCA based algorithms in compare to simple decision tree. The proposed research work opens the doors for application of these supervised learning algorithms for prediction and classifying crimes in some other states. [ABSTRACT FROM AUTHOR]

In the last few decades, technological improvements have had a considerable impact on education, much like many other fields of society and human endeavor. The applications of today's cutting-edge technology are numerous in education, but recently researchers focused on using these technologies, especially artificial intelligence (AI) and machine learning (ML), for students' performance prediction prior to the exam. It makes perfect sense to forecast student success to help all participants in the educational process. Student performance prediction may assist them in the selection of suitable courses and in creating their academic schedules. Keeping in mind the importance of student performance evaluation, this paper analyzes the prediction rate of college English level 4 by using one of the powerful ML algorithms called random forest (RF). RF uses numerous classifiers, or "ensembles", rather than just one classifier, and is based on the decision tree technique. To do this, we constructed input and output variables and collected data for these variables, including basic student information (gender, ethnicity, major), English scores on college admission exams, college English scores (total of four semesters), and extracurricular activities of college students. Preprocessing was performed on the collected data, which included the removal of unnecessary attributes, handling outliers, normalization, and data cleaning. After the preprocessing, the features were extracted and transformed into reduced dimensionality by the local-preserving projection (LPP) algorithm. From the extracted features, we selected only the most relevant in order to feed them as input to the RF model. The model is implemented in MATLAB in order to evaluate its performance. The efficiency of the proposed model is evaluated with the help of experiments in order to verify the effectiveness of the model. The performance of the RF algorithm-based college English IV pass rate prediction model is evaluated by computing the prediction accuracy, recall rate, and hit rate of the classification results. We achieved a prediction accuracy of 96.5%, a recall rate of 89.5%, and a hit rate of 93.3%. The results show that the random RF-based prediction model for college English level 4 has a good classification effect and that the prediction results are more accurate. [ABSTRACT FROM AUTHOR]

An in-depth understanding of a key element such as lake evaporation is particularly beneficial in developing the optimal management approach for reservoirs. In this study, we first aim to evaluate the applicability of regressors Random Forest (RF), Gradient Booting (GB), and Decision Tree (DT), K Nearest Neighbor (kNN), and XGBoost architectures to predict daily lake evaporation of five reservoirs in the Awash River basin, Ethiopia. The best performing models, Gradient Boosting and XGBoost, are then explained through an explanatory framework using daily climate datasets. The interpretability of the models was evaluated using the Shapley Additive explanations (SHAP). The GB model performed better with (RMSE = 0.045, MSE = 0.031, MAE = 0.002, NSE = 0.997, KGF = 0.991, RRMSE = 0.011) for Metehara Station, (RMSE = 0.032, MSE = 0.024, MAE = 0.001, NSE = 0.998, KGF = 0.999, RRMSE = 0.008) at Melkasa Station, and Dubti Station (RMSE = 0.13, MSE = 0.09, MAE = 0.017, NSE = 0.982, KGF = 0.977,RRMSE = 0.022) as the same as of XGBoost. The factors with the greatest overall impact on the daily evaporation for GB and XGboost Architecture were the SH, month, Tmax, and Tmin for Metehara and Melkasa, and Tmax, Tmin, and month had the greatest impact on the daily evaporation for Dubti. Furthermore, the interpretability of the models showed good agreement between the MLAs simulations and the actual hydro-climatic evaporation process. This result allows decision makers to not only rely on the results of an algorithm, but to make more informed decisions by using interpretable results for better control of the basin reservoir operating rules. [ABSTRACT FROM AUTHOR]

What causes viewers to change their winner perception during a televised debate? The article addresses this question, drawing on a large-N field study of the 2021 chancellor debate in Germany, which contains survey and real-time response data for 4613 participants. Using machine learning techniques, we identify determinants of why participants change their opinion about who is winning the discussion during the debate. Our analysis based on random forest and decision tree models shows in detail, first, what factors drive debate winner perceptions in the course of televised debate reception. Second, we reveal what combinations of political predispositions and candidate statements are necessary to change the viewers' debate winner perception. In doing so, third, we expand the toolbox of empirical debate research with our analysis based on machine learning algorithms. Our findings indicate that pre-debate chancellor preference and candidate images play a crucial role in determining post-debate perception change, while party identification is less important in predicting changes. We can also directly identify several speech moments in the debate that shifted viewer perception, a novel approach to evaluating political debate performance. [ABSTRACT FROM AUTHOR]

Machine learning algorithms (ML) are receiving a lot of attention in the development of predictive models for monitoring dengue transmission rates. Previous work has focused only on specific weather variables and algorithms, and there is still a need for a model that uses more variables and algorithms that have higher performance. In this study, we use vector indices and meteorological data as predictors to develop the ML models. We trained and validated seven ML algorithms, including an ensemble ML method, and compared their performance using the receiver operating characteristic (ROC) with the area under the curve (AUC), accuracy and F1 score. Our results show that an ensemble ML such as XG Boost, AdaBoost and Random Forest perform better than the logistics regression, Naïve Bayens, decision tree, and support vector machine (SVM), with XGBoost having the highest AUC, accuracy and F1 score. Analysis of the importance of the variables showed that the container index was the least important. By removing this variable, the ML models improved their performance by at least 6% in AUC and F1 score. Our result provides a framework for future studies on the use of predictive models in the development of an early warning system. [ABSTRACT FROM AUTHOR]

The dimensions of microarray datasets are very large, containing noise and redundancy. The problem with microarray datasets is the presence of more features compared to the number of samples, which adversely affects algorithm performance. In other words, the number of columns exceeds the number of rows. Therefore, to extract precise information from microarray datasets, a robust technique is required. Microarray datasets play a critical role in detecting various diseases, including cancer and tumors. This is where feature selection techniques come into play. In recent times, feature selection (FS) has gained significant importance as a data preparation method, particularly for high-dimensional data. It is preferable to address classification problems with fewer features while maintaining high accuracy, as not all features are necessary to achieve this goal. The primary objective of feature selection is to identify the optimal subset of features. In this context, we will employ the Differential Evolution (DE) algorithm. DE is a population-based stochastic search approach that has found widespread use in various scientific and technical domains to solve optimization problems in continuous spaces. In our approach, we will combine DE with three different classification algorithms: Random Forest (RF), Decision Tree (DT), and Logistic Regression (LR). Our analysis will include a comparison of the accuracy achieved by each algorithmic model on each dataset, as well as the fitness error for each model. The results indicate that when feature selection was used the results were better compared to the results where the feature selection was not used. [ABSTRACT FROM AUTHOR]

The present research work focused on predicting the electrical conductivity (EC) of surface water in the Upper Ganga basin using four machine learning algorithms: multilayer perceptron (MLP), co-adaptive neuro-fuzzy inference system (CANFIS), random forest (RF), and decision tree (DT). The study also utilized the gamma test for selecting appropriate input and output combinations. The results of the gamma test revealed that total hardness (TH), magnesium (Mg), and chloride (Cl) parameters were suitable input variables for EC prediction. The performance of the models was evaluated using statistical indices such as Percent Bias (PBIAS), correlation coefficient (R), Willmott's index of agreement (WI), Index of Agreement (PI), root mean square error (RMSE) and Legate-McCabe Index (LMI). Comparing the results of the EC models using these statistical indices, it was observed that the RF model outperformed the other algorithms. During the training period, the RF algorithm has a small positive bias (PBIAS = 0.11) and achieves a high correlation with the observed values (R = 0.956). Additionally, it shows a low RMSE value (360.42), a relatively good coefficient of efficiency (CE = 0.932), PI (0.083), WI (0.908) and LMI (0.083). However, during the testing period, the algorithm's performance shows a small negative bias (PBIAS = − 0.46) and a good correlation (R = 0.929). The RMSE value decreases significantly (26.57), indicating better accuracy, the coefficient of efficiency remains high (CE = 0.915), PI (0.033), WI (0.965) and LMI (− 0.028). Similarly, the performance of the RF algorithm during the training and testing periods in Prayagraj. During the training period, the RF algorithm shows a PBIAS of 0.50, indicating a small positive bias. It achieves an RMSE of 368.3, R of 0.909, CE of 0.872, PI of 0.015, WI of 0.921, and LMI of 0.083. During the testing period, the RF algorithm demonstrates a slight negative bias with a PBIAS of − 0.06. The RMSE reduces significantly to 24.1, indicating improved accuracy. The algorithm maintains a high correlation (R = 0.903) and a good coefficient of efficiency (CE = 0.878). The index of agreement (PI) increases to 0.035, suggesting a better fit. The WI is 0.960, indicating high accuracy compared to the mean value, while the LMI decreases slightly to − 0.038. Based on the comparative results of the machine learning algorithms, it was concluded that RF performed better than DT, CANFIS, and MLP. The study recommended using the current month's total hardness (TH), magnesium (Mg), and chloride (Cl) parameters as input variables for multi-ahead forecasting of electrical conductivity (ECt+1, ECt+2, and ECt+3) in future studies in the Upper Ganga basin. The findings also indicated that RF and DT models had superior performance compared to MLP and CANFIS models. These models can be applied for multi-ahead forecasting of monthly electrical conductivity at both Varanasi and Prayagraj stations in the Upper Ganga basin. [ABSTRACT FROM AUTHOR]