Search

Machine learning classifiers are increasingly widely used. This research note explores how a particular widely used classifier, the Random Forest, performs when faced with samples which are imbalanced and noisy data. Both are known to affect accuracy, but if their effects are independent or not has not been explored. Based on an experiment using synthetic data generated for the study we find that the effects of noise and sample balance interact with each other; classification accuracy is worse when faced with both noisy data and sample imbalance. This has implications for the use of RF in market research, but also for how methods to address either sample imbalance or noise are assessed. [ABSTRACT FROM AUTHOR]

Spherical data arise widely in various settings. Spherical statistics is an analysis of data on a unit hyper-spherical domain. In this paper, we mainly consider the local kernel estimators for regression models with a binary response and the predictors including spherical variables. We apply the random forests kernel to nonparametric binary regression models with spherical predictors. Simulation experiments and real examples are used to validate the performance of the new models. Compared with the classical von Mises–Fisher kernel and the linear-spherical kernel, the random forests kernel has better fitting effect and faster computation speed. Compared with other classifiers, the models proposed in this paper have better classification performance in both low and high dimensional cases. [ABSTRACT FROM AUTHOR]

LiDAR-unmanned aerial system (LiDAR-UAS) technology can accurately and efficiently obtain detailed and accurate three-dimensional spatial information of objects. The classification of objects in estuarine areas is highly important for management, planning, and ecosystem protection. Owing to the presence of slopes in estuarine areas, distinguishing between dense vegetation (lawns and trees) on slopes and the ground at the tops of slopes is difficult. In addition, the imbalance in the number of point clouds also poses a challenge for accurate classification directly from point cloud data. A multifeature-assisted and multilayer fused neural network (MLF-PointNet++) is proposed for LiDAR-UAS point cloud classification in estuarine areas. First, the 3D shape features that characterize the geometric characteristics of targets and the visible-band difference vegetation index (VDVI) that can characterize vegetation distribution are used as auxiliary features to enhance the distinguishability of dense vegetation (lawns and trees) on slopes and the ground at the tops of slopes. Second, to enhance the extraction of target spatial information and contextual relationships, the feature vectors output by different layers of set abstraction in the PointNet++ model are fused to form a combined feature vector that integrates low and high-level information. Finally, the focal loss function is adopted as the loss function in the MLF-PointNet++ model to reduce the effect of imbalance in the number of point clouds in each category on the classification accuracy. A classification evaluation was conducted using LiDAR-UAS data from the Moshui River estuarine area in Qingdao, China. The experimental results revealed that MLF-PointNet++ had an overall accuracy (OA), mean intersection over union (mIOU), kappa coefficient, precision, recall, and F1-score of 0.976, 0.913, 0.960, 0.953, 0.953, and 0.953, respectively, for object classification in the three representative areas, which were better than the corresponding values for the classification methods of random forest, BP neural network, Naive Bayes, PointNet, PointNet++, and RandLA-Net. The study results provide effective methodological support for the classification of objects in estuarine areas and offer a scientific basis for the sustainable development of these areas. [ABSTRACT FROM AUTHOR]

Machine learning methods have improved in recent years and provide increasingly powerful tools for understanding landscape evolution. In this study, we used the random forest method based on Google Earth Engine to evaluate the desertification dynamics in northern China from 1995 to 2020. We selected Landsat series image bands, remote sensing inversion data, climate baseline data, land use data, and soil type data as variables for majority voting in the random forest method. The method's average classification accuracy was 91.6% ± 5.8 [mean ± SD], and the average kappa coefficient was 0.68 ± 0.09, suggesting good classification results. The random forest classifier results were consistent with the results of visual interpretation for the spatial distribution of different levels of desertification. From 1995 to 2000, the area of aeolian desertification increased at an average rate of 9977 km2 yr−1, and from 2000 to 2005, from 2005 to 2010, from 2010 to 2015, and from 2015 to 2020, the aeolian desertification decreased at an average rate of 2535, 3462, 1487, and 4537 km2 yr−1, respectively. [ABSTRACT FROM AUTHOR]

In order to increase the likelihood of obtaining treatment and achieving a complete recovery, early illness identification and diagnosis are crucial. Artificial intelligence is helpful with this process by allowing us to rapidly start the necessary protocol for treatment in the early stages of disease development. Artificial intelligence is a major contributor to the improvement of medical treatment for patients. In order to prevent and foresee this problem on the individual, family, and generational levels, Monitoring the patient's therapy and recovery is crucial. This study's objective is to outline a non-invasive method for using mammograms to detect breast abnormalities, classify breast disorders, and identify cancerous or benign tumor tissue in the breast. We used classification models on a dataset that has been pre-processed so that the number of samples is balanced, unlike previous work on the same dataset. Identifying cancerous or benign breast tissue requires the use of supervised learning techniques and algorithms, such as random forest (RF) and decision tree (DT) classifiers, to examine up to thirty features, such as breast size, mass, diameter, circumference, and the nature of the tumor (solid or cystic). To ascertain if the tissue is malignant or benign, the examination's findings are employed. These features are mostly what determines how effectively anything may be categorized. The DT classifier was able to get a score of 95.32%, while the RF satisfied a far higher 98.83 percent. [ABSTRACT FROM AUTHOR]

This study introduces an innovative scheme for classifying uncrewed aerial vehicle (UAV)-derived vehicle trajectory behaviors by employing machine learning (ML) techniques to transform original trajectories into various sequences: space–time, speed–time, and azimuth–time. These transformed sequences were subjected to normalization for uniform data analysis, facilitating the classification of trajectories into six distinct categories through the application of three ML classifiers: random forest, time series forest (TSF), and canonical time series characteristics. Testing was performed across three different intersections to reveal an accuracy exceeding 90%, underlining the superior performance of integrating azimuth–time and speed–time sequences over conventional space–time sequences for analyzing trajectory behaviors. This research highlights the TSF classifier's robustness when incorporating speed data, demonstrating its efficiency in feature extraction and reliability in intricate trajectory pattern handling. This study's results indicate that integrating direction and speed information significantly enhances predictive accuracy and model robustness. This comprehensive approach, which leverages UAV-derived trajectories and advanced ML techniques, represents a significant step forward in understanding vehicle trajectory behaviors, aligning with the goals of enhancing traffic control and management strategies for better urban mobility. [ABSTRACT FROM AUTHOR]

Movie Recommender systems are frequently used in academics and industry to give users with relevant, engaging material based on their rating history. However, most traditional methods suffer from the cold-start problem, which is the initial lack of item ratings and data sparsity. The Hybrid Machine Learning (ML) technique is proposed for a movie recommendation system. Demographic data is collected from the Movie Lens dataset, and attributes are evaluated using the Attribute Analysis module. The Aquila Optimization Algorithm is used to select the best attributes, while Random Forest classifier is used for classification. Data is clustered using Fuzzy Probabilistic Cmeans Clustering Algorithm (FPCCA), and the Correspondence Index Assessment Phase (CIAP) uses Bhattacharyya Coefficient in Collaborative Filtering (BCCF) for similarity index calculation. The Outcomes gives the proposed method obtained low error, such as MAE has 0.44, RMSE has 0.63 compared with the baseline methods. [ABSTRACT FROM AUTHOR]

Honey authentication is a complex process which traditionally requires costly and time-consuming analytical techniques not readily available to the producers. This study aimed to develop non-invasive sensor methods coupled with a multivariate data analysis to detect the type and percentage of exogenous sugar adulteration in UK honeys. Through-container spatial offset Raman spectroscopy (SORS) was employed on 17 different types of natural honeys produced in the UK over a season. These samples were then spiked with rice and sugar beet syrups at the levels of 10%, 20%, 30%, and 50% w/w. The data acquired were used to construct prediction models for 14 types of honey with similar Raman fingerprints using different algorithms, namely PLS-DA, XGBoost, and Random Forest, with the aim to detect the level of adulteration per type of sugar syrup. The best-performing algorithm for classification was Random Forest, with only 1% of the pure honeys misclassified as adulterated and <3.5% of adulterated honey samples misclassified as pure. Random Forest was further employed to create a classification model which successfully classified samples according to the type of adulterant (rice or sugar beet) and the adulteration level. In addition, SORS spectra were collected from 27 samples of heather honey (24 Calluna vulgaris and 3 Erica cinerea) produced in the UK and corresponding subsamples spiked with high fructose sugar cane syrup, and an exploratory data analysis with PCA and a classification with Random Forest were performed, both showing clear separation between the pure and adulterated samples at medium (40%) and high (60%) adulteration levels and a 90% success at low adulteration levels (20%). The results of this study demonstrate the potential of SORS in combination with machine learning to be applied for the authentication of honey samples and the detection of exogenous sugars in the form of sugar syrups. A major advantage of the SORS technique is that it is a rapid, non-invasive method deployable in the field with potential application at all stages of the supply chain. [ABSTRACT FROM AUTHOR]

Combining an Internet of Things-driven approach with machine learning algorithms holds great promise in discerning pure gases across various applications. Interconnecting gas sensors within a network allows for continuous monitoring and real-time environmental analysis, producing valuable data for machine learning models. Utilizing supervised learning algorithms, like random forests, enables the creation of accurate classification models that can effectively distinguish between different pure gases based on their distinct features, such as spectral signatures or sensor responses. This groundbreaking integration of the Internet of Things and Machine Learning fosters the development of robust, automated gas detection systems, ensuring high accuracy and minimal delay in recognizing pure gases. Consequently, it opens avenues for enhanced safety, efficiency, and environmental sustainability in numerous industrial and commercial scenarios. [ABSTRACT FROM AUTHOR]

ALS (Amyotrophic Lateral Sclerosis) is a fatal neurodegenerative disease of the human motor system. It is a group of progressive diseases that affects the nerve cells in the brain and spinal cord that control the muscle movement of the body hence, detection and classification of ALS at the right time is considered to be one of the vital aspects that can save the life of humans. Therefore, in various studies, different AI techniques are used for the detection of ALS, however, these methods are considered to be ineffectual in terms of identifying the disease due to the employment of ineffective algorithms. Hence, the proposed model utilizes Modified Principal Component Analysis (MPCA) and Modified Random Forest (MRF) for performing dimensionality reduction of all the potential features considered for effective classification of the ALS presence and absence of ALS causing mutation in the corresponding gene. The MPCA is adapted for capturing all the Low-Importance Data transformation. Furthermore, The MPCA is objected to performing three various approaches: Covariance Matrix Correlation, Eigen Vector- Eigenvalue decomposition, and selecting the desired principal components. This is done in aspects of implying the LI (Lower-Importance) Data Transformation. By choosing these potential components without any loss of features ensures better viability of selecting the attributes for ALS-causing gene classification. This is followed by the classification of the proposed model by using Modified RF by updating the clump detector technique. The clump detector is proceeded by clustering approach using K-means, and the data reduced by their dimension are grouped accordingly. These clustered data are analyzed either for ALS causing or devoid of causing ALS. Finally, the model's performance is assessed using different evaluation metrics like accuracy, recall, F1 score, and precision, and the proposed model is further compared with the existing models to assess the efficacy of the proposed model. [ABSTRACT FROM AUTHOR]

Recent advances in sequencing, mass spectrometry, and cytometry technologies have enabled researchers to collect multiple 'omics data types from a single sample. These large datasets have led to a growing consensus that a holistic approach is needed to identify new candidate biomarkers and unveil mechanisms underlying disease etiology, a key to precision medicine. While many reviews and benchmarks have been conducted on unsupervised approaches, their supervised counterparts have received less attention in the literature and no gold standard has emerged yet. In this work, we present a thorough comparison of a selection of six methods, representative of the main families of intermediate integrative approaches (matrix factorization, multiple kernel methods, ensemble learning, and graph-based methods). As non-integrative control, random forest was performed on concatenated and separated data types. Methods were evaluated for classification performance on both simulated and real-world datasets, the latter being carefully selected to cover different medical applications (infectious diseases, oncology, and vaccines) and data modalities. A total of 15 simulation scenarios were designed from the real-world datasets to explore a large and realistic parameter space (e.g. sample size, dimensionality, class imbalance, effect size). On real data, the method comparison showed that integrative approaches performed better or equally well than their non-integrative counterpart. By contrast, DIABLO and the four random forest alternatives outperform the others across the majority of simulation scenarios. The strengths and limitations of these methods are discussed in detail as well as guidelines for future applications. [ABSTRACT FROM AUTHOR]

Jilin Province is located in the northeast of China, and has fragile ecosystems, and a vulnerable environment. Large-scale, long time series, high-precision land-use/cover change (LU/CC) data are important for spatial planning and environmental protection in areas with high surface heterogeneity. In this paper, based on the high temporal and spatial fusion data of Landsat and MODIS and the Google Earth Engine (GEE), long time series LU/CC mapping and spatio-temporal analysis for the period 2000–2023 were realized using the random forest remote sensing image classification method, which integrates remote sensing indices. The prediction results using the OL-STARFM method were very close to the real images and better contained the spatial image information, allowing its application to the subsequent classification. The average overall accuracy and kappa coefficient of the random forest classification products obtained using the fused remote sensing index were 95.11% and 0.9394, respectively. During the study period, the area of cultivated land and unused land decreased as a whole. The area of grassland, forest, and water fluctuated, while building land increased to 13,442.27 km2 in 2023. In terms of land transfer, cultivated land was the most important source of transfers, and the total area share decreased from 42.98% to 38.39%. Cultivated land was mainly transferred to grassland, forest land, and building land, with transfer areas of 7682.48 km2, 8374.11 km2, and 7244.52 km2, respectively. Grassland was the largest source of land transfer into cultivated land, and the land transfer among other feature types was relatively small, at less than 3300 km2. This study provides data support for the scientific management of land resources in Jilin Province, and the resulting LU/CC dataset is of great significance for regional sustainable development. [ABSTRACT FROM AUTHOR]

One expanding area of bioinformatics is medical diagnosis through the categorization of biomedical characteristics. Automatic medical strategies to boost the diagnostic through machine learning (ML) methods are challenging. They require a formal examination of their performance to identify the best conditions that enhance the ML method. This work proposes variants of the Voting and Stacking (VC and SC) ensemble strategies based on diverse auto-tuning supervised machine learning techniques to increase the efficacy of traditional baseline classifiers for the automatic diagnosis of vertebral column orthopedic illnesses. The ensemble strategies are created by first combining a complete set of auto-tuned baseline classifiers based on different processes, such as geometric, probabilistic, logic, and optimization. Next, the three most promising classifiers are selected among k-Nearest Neighbors (kNN), Naïve Bayes (NB), Logistic Regression (LR), Linear Discriminant Analysis (LDA), Quadratic Discriminant Analysis (QDA), Support Vector Machine (SVM), Artificial Neural Networks (ANN), and Decision Tree (DT). The grid-search K-Fold cross-validation strategy is applied to auto-tune the baseline classifier hyperparameters. The performances of the proposed ensemble strategies are independently compared with the auto-tuned baseline classifiers. A concise analysis evaluates accuracy, precision, recall, F1-score, and ROC-ACU metrics. The analysis also examines the misclassified disease elements to find the most and least reliable classifiers for this specific medical problem. The results show that the VC ensemble strategy provides an improvement comparable to that of the best baseline classifier (the kNN). Meanwhile, when all baseline classifiers are included in the SC ensemble, this strategy surpasses 95% in all the evaluated metrics, standing out as the most suitable option for classifying vertebral column diseases. [ABSTRACT FROM AUTHOR]

Levels of a predictor variable that are absent when a classification tree is grown can not be subject to an explicit splitting rule. This is an issue if these absent levels are present in a new observation for prediction. To date, there remains no satisfactory solution for absent levels in random forest models. Unlike missing data, absent levels are fully observed and known. Ordinal encoding of predictors allows absent levels to be integrated and used for prediction. Using a case study on source attribution of Campylobacter species using whole genome sequencing (WGS) data as predictors, we examine how target-agnostic versus target-based encoding of predictor variables with absent levels affects the accuracy of random forest models. We show that a target-based encoding approach using class probabilities, with absent levels designated the highest rank, is systematically biased, and that this bias is resolved by encoding absent levels according to the a priori hypothesis of equal class probability. We present a novel method of ordinal encoding predictors via principal coordinates analysis (PCO) which capitalizes on the similarity between pairs of predictor levels. Absent levels are encoded according to their similarity to each of the other levels in the training data. We show that the PCO-encoding method performs at least as well as the target-based approach and is not biased. [ABSTRACT FROM AUTHOR]

Rice plays an essential role in ensuring the food security of Indonesia. Hence, rice (paddy) field monitoring using synthetic aperture radar (SAR) satellite data is critical, particularly in tropical regions. This study presents a new algorithm to detect paddy fields in Subang, West Java, using Sentinel-1 SAR with a 12-day revisit acquisition. Three temporal phenological features of paddy growth were used, namely, the minimum and maximum backscatter, as well as their differences. Paddy fields were discriminated from other land covers using a simple thresholding algorithm based on their specific pattern of low minimum, high maximum, and high difference of vertical transmithorizontal receive polarization (VH) backscatter on a 2-dimensional (2D) scatter plot. The results showed that the proposed algorithm had an accuracy of 94.02%, comparable to that of the random forest algorithm and other studies using 3-dimensional (3D) parameters. The proposed algorithm reduces the dimensionality from 3D to 2D and is practical for mapping and monitoring paddy fields. In this context, the application of the algorithm to the surrounding regions of Karawang, Indramayu, and Bekasi achieved high accuracy rates of 93.37%, 92.87%, and 88.13%, respectively. [ABSTRACT FROM AUTHOR]

Recently, the Internet of Things (IoT) has become a buzzword in various technology fields because of its many applications. Healthcare is one of the most important fields in daily life and holds significant interest for IoT and artificial intelligence researchers. In the area of healthcare, the mental healthcare field has attracted many researchers and funding organizations for various reasons. Among those reasons are the adverse impact of mental conditions on both individuals and society, the high costs of mental care, the nature of mental conditions and their hidden and unclear symptoms, and the stigma associated with them. In this work, an approach to building an IoT mental health monitoring and detection system has been proposed. The depression problem is used as a case study for the mental conditions. The proposed approach involves data collection, data pre-processing, feature extraction, feature selection, and model building. Machine learning (ML) and data mining techniques, along with different data types for training and testing the models, have been utilized to accomplish the tasks of the proposed approach. Four ML algorithms have been investigated to detect and predict the diagnosis of the mental state. These algorithms are random forest, decision tree, support vector machine (SVM) and k-nearest neighbors (KNN). Our ML detection model has achieved a high detection accuracy of 95% using the random forest algorithm. Comparisons in different aspects with other works are presented. Our work has the advantages of using ML, adopting different data types, and therefore achieving better classification. [ABSTRACT FROM AUTHOR]

Object detection plays an important role in various fields. Developing detection models for 2D objects that experience rotation and texture variations is a challenge. In this research, the initial stage of the proposed model integrates the gray-level co-occurrence matrix (GLCM) and local binary patterns (LBP) texture feature extraction to obtain feature vectors. The next stage is classifying features using k-nearest neighbors (KNN) and random forest (RF), as well as voting ensemble (VE). System testing used a dataset of 4,437 2D images, the results for KNN accuracy were 92.7% and F1-score 92.5%, while RF performance was lower. Although GLCM features improve performance on both algorithms, KNN is more consistent. The VE approach provides the best performance with an accuracy of 93.9% and an F1-score of 93.8%, this shows the effectiveness of the ensemble technique in increasing object detection accuracy. This study contributes to the field of object detection with a new approach combining GLCM and LBP as feature vectors as well as VE for classification. [ABSTRACT FROM AUTHOR]

Machine learning (ML) techniques empower computers to learn from data and make predictions or decisions in various domains, while preprocessing methods assist in cleaning and transforming data before it can be effectively utilized by ML. Feature selection in ML is a critical process that significantly influences the performance and effectiveness of models. By carefully choosing the most relevant and informative attributes from the dataset, feature selection enhances model accuracy, reduces overfitting, and minimizes computational complexity. In this study, we leverage the UAH-DriveSet dataset to classify driver behavior, employing Filter, embedded, and wrapper methods encompassing 10 distinct feature selection techniques. Through the utilization of diverse ML algorithms, we effectively categorize driver behavior into normal, drowsy, and aggressive classes. The second objective is to employ feature selection techniques to pinpoint the most influential features impacting driver behavior. As a results, random forest emerges as the top-performing classifier, achieving an impressive accuracy of 96.4% and an F1-score of 96.36% using backward feature selection in 7.43 s, while K-nearest neighbour (K-NN) attains an accuracy of 96.29% with forward feature selection in 0.05 s. Following our comprehensive results, we deduce that the primary influential features for studying driver behavior include speed (km/h), course, yaw, impact time, road width, distance to the ahead vehicle, vehicle position, and number of detected vehicles. [ABSTRACT FROM AUTHOR]

Skin lesion classification plays a crucial role in the early detection and diagnosis of various skin conditions. Recent advances in computer-aided diagnostic techniques have been instrumental in timely intervention, thereby improving patient outcomes, particularly in rural communities lacking specialized expertise. Despite the widespread adoption of convolutional neural networks (CNNs) in skin disease detection, their effectiveness has been hindered by the limited size and data imbalance of publicly accessible skin lesion datasets. In this context, a two-step hierarchical binary classification approach is proposed utilizing hybrid machine and deep learning (DL) techniques. Experiments conducted on the International Skin Imaging Collaboration (ISIC 2017) dataset demonstrate the effectiveness of the hierarchical approach in handling large class imbalances. Specifically, employing DenseNet121 (DNET) as a feature extractor and random forest (RF) as a classifier yielded the most promising results, achieving a balanced multiclass accuracy (BMA) of 91.07% compared to the pure deep-learning model (end-to-end DNET) with a BMA of 88.66%. The RF ensemble exhibited significantly greater efficiency than other machine-learning classifiers in aiding DL to address the challenge of learning with limited data. Furthermore, the implemented predictive hybrid hierarchical model demonstrated enhanced performance while significantly reducing computational time, indicating its potential efficiency in real-world applications for the classification of skin lesions. [ABSTRACT FROM AUTHOR]

The seasonal temperature trends and ice phenology in the Great Slave Lake (GSL) are significantly influenced by inflow from the Slave River. The river undergoes a sequence of mechanical break-ups all the way to the GSL, initiating the GSL break-up process. Additionally, upstream water management practices impact the discharge of the Slave River and, consequently, the ice break-up of the GSL. Therefore, monitoring the break-up process at the Slave River Delta (SRD), where the river meets the lake, is crucial for understanding the cascading effects of upstream activities on GSL ice break-up. This research aimed to use Random Forest (RF) models to monitor the ice break-up processes at the SRD using a combination of satellite images with relatively high spatial resolution, including Landsat-5, Landsat-8, Sentinel-2a, and Sentinel-2b. The RF models were trained using selected training pixels to classify ice, open water, and cloud. The onset of break-up was determined by data-driven thresholds on the ice fraction in images with less than 20% cloud coverage. Analysis of break-up timing from 1984 to 2023 revealed a significant earlier trend using the Mann–Kendall test with a p-value of 0.05. Furthermore, break-up data in recent years show a high degree of variability in the break-up rate using images in recent years with better temporal resolution. [ABSTRACT FROM AUTHOR]

In the rapidly evolving online learning environment, accurate prediction of student performance plays an important role in improving the quality of education and overall student outcomes. This study investigated the effectiveness of machine learning algorithms in classifying student performance in online courses based on affective, cognitive, and behavioural factors to develop more effective teaching strategies and interventions to support student success. A dataset of 485 engineering students who took Astronomy Physics at a private university in the fall and spring semesters of 2022-2023 was used to train and evaluate six machine learning algorithms: Support vector machines (SVM), K-nearest neighbours (KNN), Naive Bayes (NB) classifier, logistic regression, decision tree, and random forest. The random forest algorithm achieved the highest classification accuracy (87%), correctly classifying 87% of students into one of three performance categories: high, medium, or low. Moreover, the study determined that anxiety and expectations are the most influential factors in increasing student performance in online courses, while the least effective feature is social isolation. The findings suggest that Machine learning can efficiently categorize student performance in online courses, even with a limited set of features, enabling educators to enhance teaching strategies and interventions for better student support. [ABSTRACT FROM AUTHOR]

The Yellow River Delta wetlands in China belong to the coastal wetland ecosystem, which is one of the youngest and most characteristic wetlands in the world. The Yellow River Delta wetlands are constantly changed by inland sediment and the influence of waves and storm surges, so the accurate classification of the coastal wetlands in the Yellow River Delta is of great significance for the rational utilization, development and protection of wetland resources. In this study, the Yellow River Delta sentinel-2 multispectral data were processed by super-resolution synthesis, and the feature bands were optimized. The optimal feature-band combination scheme was screened using the OIF algorithm. A deep learning model attention mechanism ResNet based on feature optimization with attention mechanism integration into the ResNet network is proposed. Compared with the classical machine learning model, the AM_ResNet model can effectively improve the classification accuracy of the wetlands in the Yellow River Delta. The overall accuracy was 94.61% with a Kappa of 0.93, and they were improved by about 6.99% and 0.1, respectively, compared with the best-performing Random Forest Classification in machine learning. The results show that the method can effectively improve the classification accuracy of the wetlands in the Yellow River Delta. [ABSTRACT FROM AUTHOR]

Traditional bioclimatic classification schemes have several inherent shortcomings; they do not represent anthropogenic impact, they contain a bias for global north representation, and they lack flexibility regarding novel climates that may arise due to climate change. Here we present an alternative approach, using a machine learning approach. We combine European Space Agency Land Cover Classification data with traditional bioclimate classification climate variables, and additional variables; latitude, elevation, and topography. We utilise a random forest algorithm to create a classification system that overcomes the limitations and biases of the traditional schemes. The algorithm produced is able to predict land cover classification globally at 0.5-degree resolution with 93% accuracy. The resulting classifications account for human impact, particularly via agriculture, are informed by the topography of a region, and avoids the biases that traditional bioclimatic schemes contain. The algorithm can provide insights into the drivers of land cover change, the spatial distribution of land cover change, the potential impacts on ecosystem services and human well-being. Furthermore, the random forest model serves as a novel approach to the prediction of future land cover, and can be used to identify regions at risk of a land cover transition. Our data-based machine learning approach produces larger land-cover changes due to climate change than a traditional bioclimatic scheme, especially in sensitive regions such as Amazonia. Overall, our new approach projects approximately 17.4 million square kilometre of land-cover change per degree celsius of global warming. [ABSTRACT FROM AUTHOR]

With the rapid growth of the data scale in data centers, the high reliability of storage is facing various challenges. Specifically, hardware failures such as disk faults occur frequently, causing serious system availability issues. In this context, hardware fault prediction based on AI and big data technologies has become a research hotspot, aiming to guide operation and maintenance personnel to implement preventive replacement through accurate prediction to reduce hardware failure rates. However, existing methods still have weaknesses in terms of accuracy due to the impacts of data quality issues such as the sample imbalance. This article proposes a disk fault prediction method based on classification intensity resampling, which fills the gap between the degree of data imbalance and the actual classification intensity of the task by introducing a base classifier to calculate the classification intensity, thus better preserving the data features of the original dataset. In addition, using ensemble learning methods such as random forests, combined with resampling, an integrated classifier for imbalanced data is developed to further improve the prediction accuracy. Experimental verification shows that compared with traditional methods, the F1-score of disk fault prediction is improved by 6%, and the model training time is also greatly reduced. The fault prediction method proposed in this paper has been applied to approximately 80 disk drives and nearly 40,000 disks in the production environment of a large bank's data center to guide preventive replacements. Compared to traditional methods, the number of preventive replacements based on our method has decreased by approximately 21%, while the overall disk failure rate remains unchanged, thus demonstrating the effectiveness of our method. [ABSTRACT FROM AUTHOR]

Drylands are characterized by unique ecosystem types, sparse vegetation, fragile environments, and vital ecosystem services. The accurate mapping of dryland ecosystems is essential for their protection and restoration, but previous approaches primarily relied on modifying land use data derived from remote sensing, lacking the direct utilization of latest remote sensing technologies and methods to map ecosystems, especially failing to effectively identify key ecosystems with sparse vegetation. This study attempts to integrate Google Earth Engine (GEE), random forest (RF) algorithm, multi-source remote sensing data (spectral, radar, terrain, texture), feature optimization, and image segmentation to develop a fine-scale mapping method for an ecologically critical area in northern China. The results showed the following: (1) Incorporating multi-source remote sensing data significantly improved the overall classification accuracy of dryland ecosystems, with radar features contributing the most, followed by terrain and texture features. (2) Optimizing the features set can enhance the classification accuracy, with overall accuracy reaching 91.34% and kappa coefficient 0.90. (3) User's accuracies exceeded 90% for forest, cropland, and water, and were slightly lower for steppe and shrub-steppe but were still above 85%, demonstrating the efficacy of the GEE and RF algorithm to map sparse vegetation and other dryland ecosystems. Accurate dryland ecosystems mapping requires accounting for regional heterogeneity and optimizing sample data and feature selection based on field surveys to precisely depict ecosystem patterns in complex regions. This study precisely mapped dryland ecosystems in a typical dryland region, and provides baseline data for ecological protection and restoration policies in this region, as well as a methodological reference for ecosystem mapping in similar regions. [ABSTRACT FROM AUTHOR]

An accurate prediction of fetal birth weight is crucial in ensuring safe delivery without health complications for the mother and baby. The uncertainty surrounding the fetus's birth situation, including its weight range, can lead to significant risks for both mother and baby. As there is a standard birth weight range, if the fetus exceeds or falls below this range, it can result in considerable health problems. Although ultrasound imaging is commonly used to predict fetal weight, it does not always provide accurate readings, which may lead to unnecessary decisions such as early delivery and cesarian section. Besides that, no supporting system is available to predict the weight range in Saudi Arabia. Therefore, leveraging the available technologies to build a system that can serve as a second opinion for doctors and health professionals is essential. Machine learning (ML) offers significant advantages to numerous fields and can address various issues. As such, this study aims to utilize ML techniques to build a predictive model to predict the birthweight range of infants into low, normal, or high. For this purpose, two datasets were used: one from King Fahd University Hospital (KFHU), Saudi Arabia, and another publicly available dataset from the Institute of Electrical and Electronics Engineers (IEEE) data port. KFUH's best result was obtained with the Extra Trees model, achieving an accuracy, precision, recall, and F1-score of 98%, with a specificity of 99%. On the other hand, using the Random Forest model, the IEEE dataset attained an accuracy, precision, recall, and F1-score of 96%, respectively, with a specificity of 98%. These results suggest that the proposed ML system can provide reliable predictions, which could be of significant value for doctors and health professionals in Saudi Arabia. [ABSTRACT FROM AUTHOR]

The results of first-step research activity are presented for realizing an envisioned "event radio" capability that mimics neuromorphic event-based camera processing. The energy efficiency of neuromorphic processing is orders of magnitude higher than traditional von Neumann-based processing and is realized through synergistic design of brain-inspired software and hardware computing elements. Relative to event-based cameras, the development of event-based hardware devices supporting Radio Frequency (RF) applications is severely lagging and considerable interest remains in obtaining neuromorphic efficiency through event-based RF signal processing. In the Operational Technology (OT) protection arena, this includes efficient software computing capability to provide reliable device classification. A Random Forest (RndF) classifier is considered here as a reliable precursor to obtaining Spiking Neural Network (SNN) benefits. Both 1D and 2D eventized RF fingerprints are generated for bursts from NDev = 8 WirelessHART devices. Average correct classification (%C) results show that 2D fingerprinting is best overall using detected events in burst Gabor transform responses. This includes %C ≥ 90% under multiple access interference conditions using an average of NEPB ≥ 400 detected events per burst. This is sufficiently promising to motivate next-step activity aimed at (1) reducing fingerprint dimensionality and minimizing the required computational resources, and (2) transitioning to a neuromorphic-friendly SNN classifier—two significant steps toward developing the necessary computing elements to achieve the full benefits of neuromorphic processing in the envisioned RF event radio. [ABSTRACT FROM AUTHOR]

Web applications are important for various online businesses and operations because of their platform stability and low operation cost. The increasing usage of Internet-of-Things (IoT) devices within a network has contributed to the rise of network intrusion issues due to malicious Uniform Resource Locators (URLs). Generally, malicious URLs are initiated to promote scams, attacks, and frauds which can lead to high-risk intrusion. Several methods have been developed to detect malicious URLs in previous works. There has been a good amount of work done to detect malicious URLs using various methods such as random forest, regression, LightGBM, and more as reported in the literature. However, most of the previous works focused on the binary classification of malicious URLs and are tested on limited URL datasets. Nevertheless, the detection of malicious URLs remains a challenging task that remains open to research. Hence, this work proposed a stacking-based ensemble classifier to perform multi-class classification of malicious URLs on larger URL datasets to justify the robustness of the proposed method. This study focuses on obtaining lexical features directly from the URL to identify malicious websites. Then, the proposed stacking-based ensemble classifier is developed by integrating Random Forest, XGBoost, LightGBM, and CatBoost. In addition, hyperparameter tuning was performed using the Randomized Search method to optimize the proposed classifier. The proposed stacking-based ensemble classifier aims to take advantage of the performance of each machine learning model and aggregate the output to improve prediction accuracy. The classification accuracies of the machine learning model when applied individually are 93.6%, 95.2%, 95.7% and 94.8% for random forest, XGBoost, LightGBM, and CatBoost respectively. The proposed stacking-based ensemble classifier has shown significant results in classifying four classes of malicious URLs (phishing, malware, defacement, and benign) with an average accuracy of 96.8% when benchmarked with previous works. [ABSTRACT FROM AUTHOR]

Automated disease diagnosis and prediction, powered by AI, play a crucial role in enabling medical professionals to deliver effective care to patients. While such predictive tools have been extensively explored in resource-rich languages like English, this manuscript focuses on predicting disease categories automatically from symptoms documented in the Afaan Oromo language, employing various classification algorithms. This study encompasses machine learning techniques such as support vector machines, random forests, logistic regression, and Naïve Bayes, as well as deep learning approaches including LSTM, GRU, and Bi-LSTM. Due to the unavailability of a standard corpus, we prepared three data sets with different numbers of patient symptoms arranged into 10 categories. The two feature representations, TF-IDF and word embedding, were employed. The performance of the proposed methodology has been evaluated using accuracy, recall, precision, and F1 score. The experimental results show that, among machine learning models, the SVM model using TF-IDF had the highest accuracy and F1 score of 94.7%, while the LSTM model using word2vec embedding showed an accuracy rate of 95.7% and F1 score of 96.0% from deep learning models. To enhance the optimal performance of each model, several hyper-parameter tuning settings were used. This study shows that the LSTM model verifies to be the best of all the other models over the entire dataset. [ABSTRACT FROM AUTHOR]

This study investigates how missing data samples in continuous blood glucose data affect the prediction of postprandial hypoglycemia, which is crucial for diabetes management. We analyzed the impact of missing samples at different times before meals using two datasets: virtual patient data and real patient data. The study uses six commonly used machine learning models under varying conditions of missing samples, including custom and random patterns reflective of device failures and arbitrary data loss, with different levels of data removal before mealtimes. Additionally, the study explored different interpolation techniques to counter the effects of missing data samples. The research shows that missing samples generally reduce the model performance, but random forest is more robust to missing samples. The study concludes that the adverse effects of missing samples can be mitigated by leveraging complementary and informative non-point features. Consequently, our research highlights the importance of strategically handling missing data, selecting appropriate machine learning models, and considering feature types to enhance the performance of postprandial hypoglycemia predictions, thereby improving diabetes management. [ABSTRACT FROM AUTHOR]

Breast cancer represents a significant health concern, particularly in Saudi Arabia, where it ranks as the most prevalent cancer type among women. This study focuses on leveraging eXplainable Artificial Intelligence (XAI) techniques to predict benign and malignant breast cancer cases using various clinical and pathological features specific to Saudi Arabian patients. Six distinct models were trained and evaluated based on common performance metrics such as accuracy, precision, recall, F1 score, and AUC-ROC score. To enhance interpretability, Local Interpretable Model-Agnostic Explanations (LIME) and SHapley Additive exPlanations (SHAP) were applied. The analysis identified the Random Forest model as the top performer, achieving an accuracy of 0.72, along with robust precision, recall, F1 score, and AUC-ROC score values. Conversely, the Support Vector Machine model exhibited the poorest performance metrics, indicating its limited predictive capability. Notably, the XAI approaches unveiled variations in the feature importance rankings across models, underscoring the need for further investigation. These findings offer valuable insights into breast cancer diagnosis and machine learning interpretation, aiding healthcare providers in understanding and potentially integrating such technologies into clinical practices. [ABSTRACT FROM AUTHOR]

Background: The Center for Medicare and Medicaid Services (CMS) imposes payment penalties for readmissions following total joint replacement surgeries. This study focuses on total hip, knee, and shoulder arthroplasty procedures as they account for most joint replacement surgeries. Apart from being a burden to healthcare systems, readmissions are also troublesome for patients. There are several studies which only utilized structured data from Electronic Health Records (EHR) without considering any gender and payor bias adjustments. Methods: For this study, dataset of 38,581 total knee, hip, and shoulder replacement surgeries performed from 2015 to 2021 at Novant Health was gathered. This data was used to train a random forest machine learning model to predict the combined endpoint of emergency department (ED) visit or unplanned readmissions within 30 days of discharge or discharge to Skilled Nursing Facility (SNF) following the surgery. 98 features of laboratory results, diagnoses, vitals, medications, and utilization history were extracted. A natural language processing (NLP) model finetuned from Clinical BERT was used to generate an NLP risk score feature for each patient based on their clinical notes. To address societal biases, a feature bias analysis was performed in conjunction with propensity score matching. A threshold optimization algorithm from the Fairlearn toolkit was used to mitigate gender and payor biases to promote fairness in predictions. Results: The model achieved an Area Under the Receiver Operating characteristic Curve (AUROC) of 0.738 (95% confidence interval, 0.724 to 0.754) and an Area Under the Precision-Recall Curve (AUPRC) of 0.406 (95% confidence interval, 0.384 to 0.433). Considering an outcome prevalence of 16%, these metrics indicate the model's ability to accurately discriminate between readmission and non-readmission cases within the context of total arthroplasty surgeries while adjusting patient scores in the model to mitigate bias based on patient gender and payor. Conclusion: This work culminated in a model that identifies the most predictive and protective features associated with the combined endpoint. This model serves as a tool to empower healthcare providers to proactively intervene based on these influential factors without introducing bias towards protected patient classes, effectively mitigating the risk of negative outcomes and ultimately improving quality of care regardless of socioeconomic factors. [ABSTRACT FROM AUTHOR]

Predicting whether a compound can cause drug-induced liver injury (DILI) is difficult due to the complexity of drug mechanism. The cysteine trapping assay is a method for detecting reactive metabolites that bind to microsomes covalently. However, it is cumbersome to use 35S isotope-labeled cysteine for this assay. Therefore, we constructed an in silico classification model for predicting a positive/negative outcome in the cysteine trapping assay. We collected 475 compounds (436 in-house compounds and 39 publicly available drugs) based on experimental data performed in this study, and the composition of the results showed 248 positives and 227 negatives. Using a Message Passing Neural Network (MPNN) and Random Forest (RF) with extended connectivity fingerprint (ECFP) 4, we built machine learning models to predict the covalent binding risk of compounds. In the time-split dataset, AUC-ROC of MPNN and RF were 0.625 and 0.559 in the hold-out test, restrictively. This result suggests that the MPNN model has a higher predictivity than RF in the time-split dataset. Hence, we conclude that the in silico MPNN classification model for the cysteine trapping assay has a better predictive power. Furthermore, most of the substructures that contributed positively to the cysteine trapping assay were consistent with previous results. [ABSTRACT FROM AUTHOR]

Reliable and up-to-date training reference samples are imperative for land cover (LC) classification. However, such training datasets are not always available in practice. The sample migration method has shown remarkable success in addressing this challenge in recent years. This work investigated the application of Sentinel-1 (S1) and Sentinel-2 (S2) data in training sample migration. In addition, the impact of various spectral bands and polarizations on the accuracy of the migrated training samples was also assessed. Subsequently, combined S1 and S2 images were classified using the Support Vector Machines (SVM) and Random Forest (RF) classifiers to produce annual LC maps from 2017 to 2021. The results showed a higher accuracy (98.25%) in training sample migrations using both images in comparison to using S1 (87.68%) and S2 (96.82%) data independently. Among the LC classes, the highest accuracy in migrated training samples was found for water, built-up, bare land, grassland, cropland, and wetland. Inquiries on the efficiency of different spectral bands and polarization used in training sample migration showed that bands 4 and 8 and VV polarization in the water class were more important, while for the wetland class, bands 5, 6, 7, 8, and 8A together with VV polarization showed superior performance. The results showed that the RF classifier provided better performance than the SVM (higher overall, producer, and user accuracy). Overall, our findings suggested that shared use of S1 and S2 data can be used as a suitable means for producing up-to-date and high-quality training samples. [ABSTRACT FROM AUTHOR]

This study examines urban sprawl and land-use changes by utilizing systematic points and random forest classification. The research focuses on Neyriz city in Fars Province, Iran, using satellite images from 1986 to 2016. Land-use maps were classified into urban, mountains, bare land, and vegetation using random forest machine learning in Google Earth Engine. Seven factors were analyzed in the geographic information system, and a kernel analysis of systematic points (KASyP) was applied to rank spatial variables. A grid of 4300 systematic points with 90 × 90 m spacing was created for data extraction and scatter plot generation. The study predicts a 12.3% increase in urban areas by 2026, with significant land changes near commercial, educational, administrative, and road areas. KASyP shows low change probability in mountains and high change probability in bare land. Notably, bare land to urban changes were prominent along roads and rivers. This research assists land use planners by identifying influential driver factors for land-use changes. It highlights the need to consider spatial variables and long-term trends in land-use analysis to mitigate risks, resolve conflicts, improve ecological safety, and maximize land potential. The combination of systematic points and random forest classification provides a robust methodology for managing urban sprawl and its environmental implications. [ABSTRACT FROM AUTHOR]

An electrical power system is a network that facilitates the sourcing, transfer, and distribution of electrical energy. In the traditional power system, there are eleven types of faults that can occur in the system. This paper focuses on the classification of these faults over a stretch of 100 kilometres. The dataset used is synthetic and generated from a simulated model using MATLAB/Simulink software. Data augmentation is carried out during training to improve the accuracy of the classification. An indirect training approach through generative adversarial network (GAN) is used to classify these overhead transmission line faults. The random forest (RF) classification is used as the base learning model on the original dataset and it achieves accuracy of 84%. However, the base learner RF when used on GAN model generated augmented faulty data, it performs exceptionally well achieving 99% accuracy. One of the recent state-of-art methods is compared with this approach. [ABSTRACT FROM AUTHOR]

Arid zone grassland is a crucial component of terrestrial ecosystems and plays a significant role in ecosystem protection and soil erosion prevention. However, accurately mapping grassland spatial information in arid zones presents a great challenge. The accuracy of remote sensing grassland mapping in arid zones is affected by spectral variability caused by the highly diverse landscapes. In this study, we explored the potential of a rectangular tile classification model, constructed using the random forest algorithm and integrated images from Sentinel-1A (synthetic aperture radar imagery) and Sentinel-2 (optical imagery), to enhance the accuracy of grassland mapping in the semiarid to arid regions of Ordos, China. Monthly Sentinel-1A median value images were synthesised, and four MODIS vegetation index mean value curves (NDVI, MSAVI, NDWI and NDBI) were used to determine the optimal synthesis time window for Sentinel-2 images. Seven experimental groups, including 14 experimental schemes based on the rectangular tile classification model and the traditional global classification model, were designed. By applying the rectangular tile classification model and Sentinel-integrated images, we successfully identified and extracted grasslands. The results showed the integration of vegetation index features and texture features improved the accuracy of grassland mapping. The overall accuracy of the Sentinel-integrated images from EXP7-2 was 88.23%, which was higher than the accuracy of the single sensor Sentinel-1A (53.52%) in EXP2-2 and Sentinel-2 (86.53%) in EXP5-2. In all seven experimental groups, the rectangular tile classification model was found to improve overall accuracy (OA) by 1.20% to 13.99% compared to the traditional global classification model. This paper presents novel perspectives and guidance for improving the accuracy of remote sensing mapping for land cover classification in arid zones with highly diverse landscapes. The study presents a flexible and scalable model within the Google Earth Engine framework, which can be readily customized and implemented in various geographical locations and time periods. [ABSTRACT FROM AUTHOR]

The selection of group features is a critical aspect in reducing model complexity by choosing the most essential group features, while eliminating the less significant ones. The existing group feature selection methods select a set of important group features, without providing the relative importance of all group features. Moreover, few methods consider the relative importance of group features in the selection process. This study introduces a permutation-based group feature selection approach specifically designed for high-dimensional multiclass datasets. Initially, the least absolute shrinkage and selection operator (lasso) method was applied to eliminate irrelevant individual features within each group feature. Subsequently, the relative importance of the group features was computed using a random-forest-based permutation method. Accordingly, the process selected the highly significant group features. The performance of the proposed method was evaluated using machine learning algorithms and compared with the performance of other approaches, such as group lasso. We used real-world, high-dimensional, multiclass microarray datasets to demonstrate its effectiveness. The results highlighted the capability of the proposed method, which not only selected significant group features but also provided the relative importance and ranking of all group features. Furthermore, the proposed method outperformed the existing method in terms of accuracy and F1 score. [ABSTRACT FROM AUTHOR]

Mapping benthic habitats with bathymetric, acoustic, and spectral data requires georeferenced ground-truth information about habitat types and characteristics. New technologies like autonomous underwater vehicles (AUVs) collect tens of thousands of images per mission making image-based ground truthing particularly attractive. Two types of machine learning (ML) models, random forest (RF) and deep neural network (DNN), were tested to determine whether ML models could serve as an accurate substitute for manual classification of AUV images for substrate type interpretation. RF models were trained to predict substrate class as a function of texture, edge, and intensity metrics (i.e., features) calculated for each image. Models were tested using a manually classified image dataset with 9-, 6-, and 2-class schemes based on the Coastal and Marine Ecological Classification Standard (CMECS). Results suggest that both RF and DNN models achieve comparable accuracies, with the 9-class models being least accurate (~73–78%) and the 2-class models being the most accurate (~95–96%). However, the DNN models were more efficient to train and apply because they did not require feature estimation before training or classification. Integrating ML models into benthic habitat mapping process can improve our ability to efficiently and accurately ground-truth large areas of benthic habitat using AUV or similar images. [ABSTRACT FROM AUTHOR]

The identification of wetland vegetation is essential for environmental protection and management as well as for monitoring wetlands' health and assessing ecosystem services. However, some limitations on vegetation classification may be related to remote sensing technology, confusion between plant species, and challenges related to inadequate data accuracy. In this paper, vegetation classification in the Yancheng Coastal Wetlands is studied and evaluated from Sentinel-2 images based on a random forest algorithm. Based on consistent time series from remote sensing observations, the characteristic patterns of the Yancheng Coastal Wetlands were better captured. Firstly, the spectral features, vegetation indices, and phenological characteristics were extracted from remote sensing images, and classification products were obtained by constructing a dense time series using a dataset based on Sentinel-2 images in Google Earth Engine (GEE). Then, remote sensing classification products based on the random forest machine learning algorithm were obtained, with an overall accuracy of 95.64% and kappa coefficient of 0.94. Four indicators (POP, SOS, NDVIre, and B12) were the main contributors to the importance of the weight analysis for all features. Comparative experiments were conducted with different classification features. The results show that the method proposed in this paper has better classification. [ABSTRACT FROM AUTHOR]

Machine learning(ML) based techniques for Land Use Land Cover(LULC) classification is crucial for extracting valuable insights from satellite imagery. The impact of severe class imbalance problems on LULC datasets, added to the limited temporal coverage, incomplete spectral information, spatial resolution constraints, and limitations due to sensor characteristics of a single satellite, hinder the efficient capturing of complex image features. The object-based classification using Gray-level co-occurrence matrix(GLCM) and Simple Non-Iterative Clustering(SNIC) captures the textural and spectral information, respectively, to enhance the accuracy in heterogeneous landscapes and overcome the limitations of pixel-based classification, such as the sensitivity towards noise and spectral confusion in mixed pixels at the cost of increased additional computational steps. In this context, the proposed study leverages high-quality fused images with diverse temporal, spectral, and spatial information obtained by fusing Landsat-8 and Sentinel-2 satellite imageries using Spatial-and-Temporal-Adaptive-Reflectance-Fusion-Model(STARFM). Further, to solve the class imbalance problem, a Granular Computing(GrC) based Segmentation and Textural Analysis(GrCSTA) framework is proposed for reducing the number of image primitives and computations required for subsequent image analysis processes in the object-based classification. The GrCSTA framework focuses on extracting the Spatial Granules(Gs) from the fused imagery using Spatial neighborhood Granulation(SNGr), textural indices of the Gs using GLCM, and reduced textural indices using Principal Component Analysis(PCA). Gs and its reduced textural indices are input features to train the Random Forest(RF) classifier. Experimental results demonstrate that the proposed GrCSTA framework achieves comparably higher accuracy than the state-of-the-art models. [ABSTRACT FROM AUTHOR]

Background: DNA-binding proteins (DNA-BPs) are the proteins that bind and interact with DNA. DNA-BPs regulate and affect numerous biological processes, such as, transcription and DNA replication, repair, and organization of the chromosomal DNA. Very few proteins, however, are DNA-binding in nature. Therefore, it is necessary to develop an efficient predictor for identifying DNA-BPs. Result: In this work, we have proposed new benchmark datasets for the DNA-binding protein prediction problem. We discovered several quality concerns with the widely used benchmark datasets, PDB1075 (for training) and PDB186 (for independent testing), which necessitated the preparation of new benchmark datasets. Our proposed datasets UNIPROT1424 and UNIPROT356 can be used for model training and independent testing respectively. We have retrained selected state-of-the-art DNA-BP predictors in the new dataset and reported their performance results. We also trained a novel predictor using the new benchmark dataset. We extracted features from various feature categories, then used a Random Forest classifier and Recursive Feature Elimination with Cross-validation (RFECV) to select the optimal set of 452 features. We then proposed a stacking ensemble architecture as our final prediction model. Named Stacking Ensemble Model for DNA-binding Protein Prediction, or StackDPP in short, our model achieved 0.92, 0.92 and 0.93 accuracy in 10-fold cross-validation, jackknife and independent testing respectively. Conclusion: StackDPP has performed very well in cross-validation testing and has outperformed all the state-of-the-art prediction models in independent testing. Its performance scores in cross-validation testing generalized very well in the independent test set. The source code of the model is publicly available at https://github.com/HasibAhmed1624/StackDPP. Therefore, we expect this generalized model can be adopted by researchers and practitioners to identify novel DNA-binding proteins. [ABSTRACT FROM AUTHOR]

Gender prediction based on names is an important task with various applications. In this study, we used the PhoBERT model to predict gender and compared its performance with traditional classifiers such as Naïve Bayes, Logistic Regression, and Random Forest. We evaluated the performance of these methods on the GenderVN 1.0 dataset, which consists of over 3 million Vietnamese name samples. Additionally, we analyzed the impact of removing family names or using only middle names on the prediction results. The experimental results showed that the PhoBERT model outperformed traditional classifiers, achieving an accuracy of 92.3%, compared to 90.9% for previously applied methods on the GenderVN 1.0 dataset. This study also demonstrates that using the PhoBERT model for this task can lead to reduced training data requirements without compromising prediction accuracy. These findings contribute to the advancement of gender prediction methodologies and establish a solid groundwork for future research in this domain. [ABSTRACT FROM AUTHOR]

This study investigated the impact of auditory stimuli on muscular activation patterns using wearable surface electromyography (EMG) sensors. Employing four key muscles (Sternocleidomastoid Muscle (SCM), Cervical Erector Muscle (CEM), Quadricep Muscles (QMs), and Tibialis Muscle (TM)) and time domain features, we differentiated the effects of four interventions: silence, music, positive reinforcement, and negative reinforcement. The results demonstrated distinct muscle responses to the interventions, with the SCM and CEM being the most sensitive to changes and the TM being the most active and stimulus dependent. Post hoc analyses revealed significant intervention-specific activations in the CEM and TM for specific time points and intervention pairs, suggesting dynamic modulation and time-dependent integration. Multi-feature analysis identified both statistical and Hjorth features as potent discriminators, reflecting diverse adaptations in muscle recruitment, activation intensity, control, and signal dynamics. These features hold promise as potential biomarkers for monitoring muscle function in various clinical and research applications. Finally, muscle-specific Random Forest classification achieved the highest accuracy and Area Under the ROC Curve for the TM, indicating its potential for differentiating interventions with high precision. This study paves the way for personalized neuroadaptive interventions in rehabilitation, sports science, ergonomics, and healthcare by exploiting the diverse and dynamic landscape of muscle responses to auditory stimuli. [ABSTRACT FROM AUTHOR]

The No Free Lunch Theorem tells us that no algorithm can beat other algorithms on all types of problems. The algorithm selection structure is proposed to select the most suitable algorithm from a set of algorithms for an unknown optimization problem. This paper introduces an innovative algorithm selection approach called the CNN-HT, which is a two-stage algorithm selection framework. In the first stage, a Convolutional Neural Network (CNN) is employed to classify problems. In the second stage, the Hypothesis Testing (HT) technique is used to suggest the best-performing algorithm based on the statistical analysis of the performance metric of algorithms that address various problem categories. The two-stage approach can adapt to different algorithm combinations without the need to retrain the entire model, and modifications can be made in the second stage only, which is an improvement of one-stage approaches. To provide a more general structure for the classification model, we adopt Exploratory Landscape Analysis (ELA) features of the problem as input and utilize feature selection techniques to reduce the redundant ones. In problem classification, the average accuracy of classifying problems using CNN is 96%, which demonstrates the advantages of CNN compared to Random Forest and Support Vector Machines. After feature selection, the accuracy increases to 98.8%, further improving the classification performance while reducing the computational cost. This demonstrates the effectiveness of the first stage of the CNN-HT method, which provides a basis for algorithm selection. In the experiments, CNN-HT shows the advantages of the second stage algorithm as well as good performance with better average rankings in different algorithm combinations compared to the individual algorithms and another algorithm combination approach. [ABSTRACT FROM AUTHOR]

Feature selection (FS) is a data preprocessing step in machine learning (ML) that selects a subset of relevant and informative features from a large feature pool. FS helps ML models improve their predictive accuracy at lower computational costs. Moreover, FS can handle the model overfitting problem on a high-dimensional dataset. A major problem with the filter and wrapper FS methods is that they consume a significant amount of time during FS on high-dimensional datasets. The proposed "HDFS(PSO-MI): hybrid distribute feature selection using particle swarm optimization-mutual information (PSO-MI)", is a PSO-based hybrid method that can overcome the problem mentioned above. This method hybridizes the filter and wrapper techniques in a distributed manner. A new combiner is also introduced to merge the effective features selected from multiple data distributions. The effectiveness of the proposed HDFS(PSO-MI) method is evaluated using five ML classifiers, i.e., logistic regression (LR), k-NN, support vector machine (SVM), decision tree (DT), and random forest (RF), on various datasets in terms of accuracy and Matthew's correlation coefficient (MCC). From the experimental analysis, we observed that HDFS(PSO-MI) method yielded more than 98%, 95%, 92%, 90%, and 85% accuracy for the unbalanced, kidney disease, emotions, wafer manufacturing, and breast cancer datasets, respectively. Our method shows promising results comapred to other methods, such as mutual information, gain ratio, Spearman correlation, analysis of variance (ANOVA), Pearson correlation, and an ensemble feature selection with ranking method (EFSRank). [ABSTRACT FROM AUTHOR]

In this paper, we modify the proof methods of some previously weakly consistent variants of random forest into strongly consistent proof methods, and improve the data utilization of these variants in order to obtain better theoretical properties and experimental performance. In addition, we propose the Data-driven Multinomial Random Forest (DMRF) algorithm, which has the same complexity with BreimanRF (proposed by Breiman) while satisfying strong consistency with probability 1. It has better performance in classification and regression tasks than previous RF variants that only satisfy weak consistency, and in most cases even surpasses BreimanRF in classification tasks. To the best of our knowledge, DMRF is currently a low-complexity and high-performing variation of random forest that achieves strong consistency with probability 1. [ABSTRACT FROM AUTHOR]

The application of lidar data to assist with forest inventory is common around the world. However, the determination of tree species is still somewhat elusive. Lidar data collected using UAS (uncrewed aircraft systems) platforms offer high density point cloud data for areas from a few to several hundred hectares. General point cloud metrics computed using these data captured differences in the crown structure that proved useful for species classification. For our study, we manually adjusted plot and tree locations to align field trees and UAS lidar point data and computed common descriptive metrics using a small cylindrical sample of points designed to capture the top three meters and leader of each tree. These metrics were used to train a random forest classifier to differentiate between two conifer species, Douglas fir and western hemlock, common in the Pacific Northwest region of the United States. Our UAS lidar data had a single swath pulse density of 90 pulses/m2 and an aggregate pulse density of 556 pulses/m2. We trained classification models using both height and intensity metrics, height metrics alone, intensity metrics alone, and a small subset of five metrics, and achieved overall accuracies of 91.8%, 88.7%, 78.6%, and 91.5%, respectively. Overall, we showed that UAS lidar data captured morphological differences between the upper crowns of our two target species and produced a classification model that could be applied over large areas. [ABSTRACT FROM AUTHOR]

Class noise is a common issue that affects the performance of classification techniques on real-world data sets. Class noise appears when a class variable in data sets has incorrect class labels. In the case of noisy data, the robustness of classification techniques against noise could be more important than the performance results on noise-free data sets. The decision tree method is one of the most popular techniques for classification tasks. The C4.5, CART, and random forest (RF) algorithms are considered to be three of the most used algorithms in decision trees. The aim of this paper is to reach conclusions on which decision tree algorithm is better to use for building decision trees in terms of its performance and robustness against class noise. In order to achieve this aim, we study and compare the performance of the models when applied to class variables with noise. The results obtained indicate that the RF algorithm is more robust to data sets with noisy class variable than other algorithms. [ABSTRACT FROM AUTHOR]