Search

Accurate and comparable annual mapping is critical to understanding changing vegetation distribution and informing land use planning and management. A U-Net convolutional neural network (CNN) model was used to map natural vegetation and forest types based on annual Landsat geomedian reflectance composite images for a 500 km × 500 km study area in southeastern Australia. The CNN was developed using 2018 imagery. Label data were a ten-class natural vegetation and forest classification (i.e., Acacia, Callitris, Casuarina, Eucalyptus, Grassland, Mangrove, Melaleuca, Plantation, Rainforest and Non-Forest) derived by combining current best-available regional-scale maps of Australian forest types, natural vegetation and land use. The best CNN generated using six Landsat geomedian bands as input produced better results than a pixel-based random forest algorithm, with higher overall accuracy (OA) and weighted mean F1 score for all vegetation classes (93 vs. 87% in both cases) and a higher Kappa score (86 vs. 74%). The trained CNN was used to generate annual vegetation maps for 2000–2019 and evaluated for an independent test area of 100 km × 100 km using statistics describing accuracy regarding the label data and temporal stability. Seventy-six percent of pixels did not change over the 20 years (2000–2019), and year-on-year results were highly correlated (94–97% OA). The accuracy of the CNN model was further verified for the study area using 3456 independent vegetation survey plots where the species of interest had ≥ 50% crown cover. The CNN showed an 81% OA compared with the plot data. The model accuracy was also higher than the label data (76%), which suggests that imperfect training data may not be a major obstacle to CNN-based mapping. Applying the CNN to other regions would help to test the spatial transferability of these techniques and whether they can support the automated production of accurate and comparable annual maps of natural vegetation and forest types required for national reporting. [ABSTRACT FROM AUTHOR]

Non-neural machine learning (ML) and deep learning (DL) are used to predict system failures in industrial maintenance. However, only a few studies have assessed the effect of varying the amount of past data used to make a prediction and the extension in the future of the forecast. This study evaluates the impact of the size of the reading window and of the prediction window on the performances of models trained to forecast failures in three datasets of (1) an industrial wrapping machine working in discrete sessions, (2) an industrial blood refrigerator working continuously, and (3) a nitrogen generator working continuously. A binary classification task assigns the positive label to the prediction window based on the probability of a failure to occur in such an interval. Six algorithms (logistic regression, random forest, support vector machine, LSTM, ConvLSTM, and Transformers) are compared on multivariate time series. The dimension of the prediction windows plays a crucial role and the results highlight the effectiveness of DL approaches in classifying data with diverse time-dependent patterns preceding a failure and the effectiveness of ML approaches in classifying similar and repetitive patterns preceding a failure. [ABSTRACT FROM AUTHOR]

Cardiovascular disease (CVD) is a leading cause of death globally; therefore, early detection of CVD is crucial. Many intelligent technologies, including deep learning and machine learning (ML), are being integrated into healthcare systems for disease prediction. This paper uses a voting ensemble ML with chi-square feature selection to detect CVD early. Our approach involved applying multiple ML classifiers, including naïve Bayes, random forest, logistic regression (LR), and k-nearest neighbor. These classifiers were evaluated through metrics including accuracy, specificity, sensitivity, F1-score, confusion matrix, and area under the curve (AUC). We created an ensemble model by combining predictions from the different ML classifiers through a voting mechanism, whose performance was then measured against individual classifiers. Furthermore, we applied chi-square feature selection method to the 303 records across 13 clinical features in the Cleveland cardiac disease dataset to identify the 5 most important features. This approach improved the overall accuracy of our ensemble model and reduced the computational load considerably by more than 50%. Demonstrating superior effectiveness, our voting ensemble model achieved a remarkable accuracy of 92.11%, representing an average improvement of 2.95% over the single highest classifier (LR). These results indicate the ensemble method as a viable and practical approach to improve the accuracy of CVD prediction. [ABSTRACT FROM AUTHOR]

The utilization of street view big data is increasingly being used to uncover visual characteristics and spatial perceptions of urban streets. However, there is a lack of studies that combine street view big data for perceptual evaluation in underdeveloped ethnic areas and better street quality. This study integrates deep learning methods to create a human–computer confrontational model for perception score, with a focus on the central city of Lhasa in Tibet. Pearson correlation analysis was conducted on six dimensions of perception data (beautiful, wealthy, safe, lively, boring and depressing) and visual elements. The streets in the top 20% for both visual elements and perceptual scores were identified to reveal areas with high visual element proportions and high perceptual scores. The spatial distribution characteristics and correlation between visual elements and street perceptions were thoroughly analyzed. The findings of this study reveal that the central city of Lhasa exhibited high percentages of visual elements in buildings (88.23%), vegetation (89.52%), and poles (3.14%). Out of the six perceptions examined, the highest scores were for boring (69.70) and depressing (67.76) perceptions, followed by beautiful (60.66) and wealthy (59.91) perceptions, with lively (56.68) and safe (50.64) perceptions receiving the lowest scores. Visual components like roads (−0.094), sidewalks (−0.031), fences (−0.036), terrain (−0.020), sky (−0.098), cars (−0.016), and poles (−0.075) were observed to have a significant deterring effect on the boring perception, while other visual elements showed a positive influence. This investigation seeks to provide valuable insights for the design and advancement of urban streets in marginalized ethnic localities, addressing a void in perception research of urban streets in such areas. [ABSTRACT FROM AUTHOR]

To enhance traffic safety on mountainous roads, this study proposes an innovative CNN-LSTM-Attention model designed for the identification of near-crash events, utilizing naturalistic driving data from the challenging terrains in Yunnan, China. A combination of a threshold method complemented by manual verification is used to label and annotate near-crash events within the dataset. The importance of vehicle motion features is evaluated using the random forest algorithm, revealing that specific variables, including x-axis acceleration, y-axis acceleration, y-axis angular velocity, heading angle, and vehicle speed, are particularly crucial for identifying near-crash events. Addressing the limitations of existing models in accurately detecting near-crash scenarios, this study combines the strengths of convolutional neural networks (CNN), long short-term memory (LSTM) networks, and an attention mechanism to enhance model sensitivity to crucial temporal and spatial features in naturalistic driving data. Specifically, the CNN-LSTM-Attention model leverages CNN to extract local features from the driving data, employs LSTM to track temporal dependencies among feature variables, and uses the attention mechanism to dynamically fine-tune the network weights of feature parameters. The efficacy of the proposed model is extensively evaluated against six comparative models: CNN, LSTM, Attention, CNN-LSTM, CNN-Attention, and LSTM-Attention. In comparison to the benchmark models, the CNN-LSTM-Attention model achieves superior overall accuracy at 98.8%. Moreover, it reaches a precision rate of 90.1% in detecting near-crash events, marking an improvement of 31.6%, 14.8%, 63.5%, 8%, 23.5%, and 22.6% compared to the other six comparative models, respectively. [ABSTRACT FROM AUTHOR]

With the rapid growth of online property rental and sale platforms, the prevalence of fake real estate listings has become a significant concern. These deceptive listings waste time and effort for buyers and sellers and pose potential risks. Therefore, developing effective methods to distinguish genuine from fake listings is crucial. Accurately identifying fake real estate listings is a critical challenge, and clustering analysis can significantly improve this process. While clustering has been widely used to detect fraud in various fields, its application in the real estate domain has been somewhat limited, primarily focused on auctions and property appraisals. This study aims to fill this gap by using clustering to classify properties into fake and genuine listings based on datasets curated by industry experts. This study developed a K-means model to group properties into clusters, clearly distinguishing between fake and genuine listings. To assure the quality of the training data, data pre-processing procedures were performed on the raw dataset. Several techniques were used to determine the optimal value for each parameter of the K-means model. The clusters are determined using the Silhouette coefficient, the Calinski-Harabasz index, and the Davies-Bouldin index. It was found that the value of cluster 2 is the best and the Camberra technique is the best method when compared to overlapping similarity and Jaccard for distance. The clustering results are assessed using two machine learning algorithms: Random Forest and Decision Tree. The observational results have shown that the optimized K-means significantly improves the accuracy of the Random Forest classification model, boosting it by an impressive 96%. Furthermore, this research demonstrates that clustering helps create a balanced dataset containing fake and genuine clusters. This balanced dataset holds promise for future investigations, particularly for deep learning models that require balanced data to perform optimally. This study presents a practical and effective way to identify fake real estate listings by harnessing the power of clustering analysis, ultimately contributing to a more trustworthy and secure real estate market. [ABSTRACT FROM AUTHOR]

Skin cancer has a significant impact on the lives of many individuals annually and is recognized as the most prevalent type of cancer. In the United States, an estimated annual incidence of approximately 3.5 million people receiving a diagnosis of skin cancer underscores its widespread prevalence. Furthermore, the prognosis for individuals afflicted with advancing stages of skin cancer experiences a substantial decline in survival rates. This paper is dedicated to aiding healthcare experts in distinguishing between benign and malignant skin cancer cases by employing a range of machine learning and deep learning techniques and different feature extractors and feature selectors to enhance the evaluation metrics. In this paper, different transfer learning models are employed as feature extractors, and to enhance the evaluation metrics, a feature selection layer is designed, which includes diverse techniques such as Univariate, Mutual Information, ANOVA, PCA, XGB, Lasso, Random Forest, and Variance. Among transfer models, DenseNet-201 was selected as the primary feature extractor to identify features from data. Subsequently, the Lasso method was applied for feature selection, utilizing diverse machine learning approaches such as MLP, XGB, RF, and NB. To optimize accuracy and precision, ensemble methods were employed to identify and enhance the best-performing models. The study provides accuracy and sensitivity rates of 87.72% and 92.15%, respectively. [ABSTRACT FROM AUTHOR]

Recent studies have shown that the microbiome can impact cancer development, progression, and response to therapies suggesting microbiome-based approaches for cancer characterization. As cancer-related signatures are complex and implicate many taxa, their discovery often requires Machine Learning approaches. This review discusses Machine Learning methods for cancer characterization from microbiome data. It focuses on the implications of choices undertaken during sample collection, feature selection and pre-processing. It also discusses ML model selection, guiding how to choose an ML model, and model validation. Finally, it enumerates current limitations and how these may be surpassed. Proposed methods, often based on Random Forests, show promising results, however insufficient for widespread clinical usage. Studies often report conflicting results mainly due to ML models with poor generalizability. We expect that evaluating models with expanded, hold-out datasets, removing technical artifacts, exploring representations of the microbiome other than taxonomical profiles, leveraging advances in deep learning, and developing ML models better adapted to the characteristics of microbiome data will improve the performance and generalizability of models and enable their usage in the clinic. [ABSTRACT FROM AUTHOR]

Monitoring snow avalanche activity is essential for operational avalanche forecasting and the successful implementation of mitigation measures to ensure safety in mountain regions. To facilitate and automate the monitoring process, avalanche detection systems equipped with seismic sensors can provide a cost-effective solution. Still, automatically differentiating avalanche signals from other sources in seismic data remains challenging, mainly due to the complexity of seismic signals generated by avalanches, the complex signal transmission through the ground, the relatively rare occurrence of avalanches, and the presence of multiple sources in the continuous seismic data. One approach to automate avalanche detection is by applying machine learning methods. So far, research in this area has mainly focused on extracting standard domain-specific signal attributes in the time and frequency domains as input features for statistical models. In this study, we propose a novel application of deep learning autoencoder models for the automatic and unsupervised extraction of features from seismic recordings. These new features are then fed into classifiers for discriminating snow avalanches. To this end, we trained three Random forest classifiers based on different feature extraction approaches. The first set of 32 features was automatically extracted from the time-series signals by an autoencoder consisting of convolutional layers and a recurrent long short-term memory unit. The second autoencoder applies a series of fully connected layers to extract 16 features from the spectrum of the signals. As a benchmark, a third random forest was trained with typical waveform, spectral and spectrogram attributes used to discriminate seismic events. We extracted all these features from 10-second windows of the seismograms recorded with an array of five seismometers installed in an avalanche test site located above Davos, Switzerland. The database used to train and test the models contained 84 avalanches and 828 noise (unrelated to avalanches) events recorded during the winter seasons of 2020–2021 and 2021–2022. Finally, we assessed the performance of each classifier, compared the results, and proposed different aggregation methods to improve the predictive performance of the developed seismic detection algorithms. The classifiers achieved an avalanche f1-score of 0.61 (seismic attributes), 0.49 (temporal autoencoder) and 0.60 (spectral autoencoder) and avalanche recall of 0.68, 0.71 and 0.71, respectively. Overall, the macro f1-score ranged from 0.70 (temporal autoencoder) to 0.78 (seismic attributes). After applying a post-processing step to event-based predictions, the avalanche recall of the three models significantly increased, reaching values between 0.82 and 0.91. The developed approach could be potentially used as an operational, near-real-time avalanche detection system. Yet, the relatively high number of false alarms still needs further implementation of the current automated seismic classification algorithms to be used as unique methods to detect avalanches effectively. [ABSTRACT FROM AUTHOR]

Stroke is a high morbidity and mortality disease that poses a serious threat to people's health. Early recognition of the various warning signs of stroke is necessary so that timely clinical intervention can help reduce the severity of stroke. Deep neural networks have powerful feature representation capabilities and can automatically learn discriminant features from large amounts of data. This paper uses a range of physiological characteristic parameters and collaborates with deep neural networks, such as the Wasserstein generative adversarial networks with gradient penalty and regression network, to construct a stroke prediction model. Firstly, to address the problem of imbalance between positive and negative samples in the stroke public data set, we performed positive sample data augmentation and utilized WGAN‐GP to generate stroke data with high fidelity and used it for the training of the prediction network model. Then, the relationship between observable physiological characteristic parameters and the predicted risk of suffering a stroke was modeled as a nonlinear mapping transformation, and a stroke prediction model based on a deep regression network was designed. Finally, the proposed method is compared with commonly used machine learning‐based classification algorithms such as decision tree, random forest, support vector machine, and artificial neural networks. The prediction results of the proposed method are optimal in the comprehensive measurement index F. Further ablation experiments also show that the designed prediction model has certain robustness and can effectively predict stroke diseases. [ABSTRACT FROM AUTHOR]

Due to the recent advances in the Internet and communication technologies, network systems and data have evolved rapidly. The emergence of new attacks jeopardizes network security and make it really challenging to detect intrusions. Multiple network attacks by an intruder are unavoidable. Our research targets the critical issue of class imbalance in intrusion detection, a reflection of the real-world scenario where legitimate network activities significantly out number malicious ones. This imbalance can adversely affect the learning process of predictive models, often resulting in high false-negative rates, a major concern in Intrusion Detection Systems (IDS). By focusing on datasets with this imbalance, we aim to develop and refine advanced algorithms and techniques, such as anomaly detection, cost-sensitive learning, and oversampling methods, to effectively handle such disparities. The primary goal is to create models that are highly sensitive to intrusions while minimizing false alarms, an essential aspect of effective IDS. This approach is not only practical for real-world applications but also enhances the theoretical understanding of managing class imbalance in machine learning. Our research, by addressing these significant challenges, is positioned to make substantial contributions to cybersecurity, providing valuable insights and applicable solutions in the fight against digital threats and ensuring robustness and relevance in IDS development. An intrusion detection system (IDS) checks network traffic for security, availability, and being non-shared. Despite the efforts of many researchers, contemporary IDSs still need to further improve detection accuracy, reduce false alarms, and detect new intrusions. The mean convolutional layer (MCL), feature-weighted attention (FWA) learning, a bidirectional long short-term memory (BILSTM) network, and the random forest algorithm are all parts of our unique hybrid model called MCL-FWA-BILSTM. The CNN-MCL layer for feature extraction receives data after preprocessing. After convolution, pooling, and flattening phases, feature vectors are obtained. The BI-LSTM and self-attention feature weights are used in the suggested method to mitigate the effects of class imbalance. The attention layer and the BI-LSTM features are concatenated to create mapped features before feeding them to the random forest algorithm for classification. Our methodology and model performance were validated using NSL-KDD and UNSW-NB-15, two widely available IDS datasets. The suggested model's accuracies on binary and multi-class classification tasks using the NSL-KDD dataset are 99.67% and 99.88%, respectively. The model's binary and multi-class classification accuracies on the UNSW-NB15 dataset are 99.56% and 99.45%, respectively. Further, we compared the suggested approach with other previous machine learning and deep learning models and found it to outperform them in detection rate, FPR, and F-score. For both binary and multiclass classifications, the proposed method reduces false positives while increasing the number of true positives. The model proficiently identifies diverse network intrusions on computer networks and accomplishes its intended purpose. The suggested model will be helpful in a variety of network security research fields and applications. [ABSTRACT FROM AUTHOR]

Prostate cancer is a common cancer with significant implications for global health. Prompt and precise identification is crucial for efficient treatment strategizing and enhanced patient results. This research study investigates the utilization of machine learning techniques to diagnose prostate cancer. It emphasizes utilizing deep learning models, namely VGG16, VGG19, ResNet50, and ResNet50V2, to extract relevant features. The random forest approach then uses these features for classification. The study begins by doing a thorough comparison examination of the deep learning architectures outlined above to evaluate their effectiveness in extracting significant characteristics from prostate cancer imaging data. Key metrics such as sensitivity, specificity, and accuracy are used to assess the models' efficacy. With an accuracy of 99.64%, ResNet50 outperformed other tested models when it came to identifying important features in images of prostate cancer. Furthermore, the analysis of understanding factors aims to offer valuable insights into the decision‐making process, thereby addressing a critical problem for clinical practice acceptance. The random forest classifier, a powerful ensemble learning method renowned for its adaptability and ability to handle intricate datasets, then uses the collected characteristics as input. The random forest model seeks to identify patterns in the feature space and produce precise predictions on the presence or absence of prostate cancer. In addition, the study tackles the restricted availability of datasets by utilizing transfer learning methods to refine the deep learning models using a small amount of annotated prostate cancer data. The objective of this method is to improve the ability of the models to generalize across different patient populations and clinical situations. This study's results are useful because they show how well VGG16, VGG19, ResNet50, and ResNet50V2 work for extracting features in the field of diagnosing prostate cancer, when used with random forest's classification abilities. The results of this work provide a basis for creating reliable and easily understandable machine learning‐based diagnostic tools for detecting prostate cancer. This will enhance the possibility of an early and precise diagnosis in clinical settings such as index terms deep learning, machine learning, prostate cancer, cancer identification, and cancer classification. [ABSTRACT FROM AUTHOR]

Recently, explainability in machine and deep learning has become an important area in the field of research as well as interest, both due to the increasing use of artificial intelligence (AI) methods and understanding of the decisions made by models. The explainability of artificial intelligence (XAI) is due to the increasing consciousness in, among other things, data mining, error elimination, and learning performance by various AI algorithms. Moreover, XAI will allow the decisions made by models in problems to be more transparent as well as effective. In this study, models from the 'glass box' group of Decision Tree, among others, and the 'black box' group of Random Forest, among others, were proposed to understand the identification of selected types of currant powders. The learning process of these models was carried out to determine accuracy indicators such as accuracy, precision, recall, and F1-score. It was visualized using Local Interpretable Model Agnostic Explanations (LIMEs) to predict the effectiveness of identifying specific types of blackcurrant powders based on texture descriptors such as entropy, contrast, correlation, dissimilarity, and homogeneity. Bagging (Bagging_100), Decision Tree (DT0), and Random Forest (RF7_gini) proved to be the most effective models in the framework of currant powder interpretability. The measures of classifier performance in terms of accuracy, precision, recall, and F1-score for Bagging_100, respectively, reached values of approximately 0.979. In comparison, DT0 reached values of 0.968, 0.972, 0.968, and 0.969, and RF7_gini reached values of 0.963, 0.964, 0.963, and 0.963. These models achieved classifier performance measures of greater than 96%. In the future, XAI using agnostic models can be an additional important tool to help analyze data, including food products, even online. [ABSTRACT FROM AUTHOR]

Automated disease diagnosis and prediction, powered by AI, play a crucial role in enabling medical professionals to deliver effective care to patients. While such predictive tools have been extensively explored in resource-rich languages like English, this manuscript focuses on predicting disease categories automatically from symptoms documented in the Afaan Oromo language, employing various classification algorithms. This study encompasses machine learning techniques such as support vector machines, random forests, logistic regression, and Naïve Bayes, as well as deep learning approaches including LSTM, GRU, and Bi-LSTM. Due to the unavailability of a standard corpus, we prepared three data sets with different numbers of patient symptoms arranged into 10 categories. The two feature representations, TF-IDF and word embedding, were employed. The performance of the proposed methodology has been evaluated using accuracy, recall, precision, and F1 score. The experimental results show that, among machine learning models, the SVM model using TF-IDF had the highest accuracy and F1 score of 94.7%, while the LSTM model using word2vec embedding showed an accuracy rate of 95.7% and F1 score of 96.0% from deep learning models. To enhance the optimal performance of each model, several hyper-parameter tuning settings were used. This study shows that the LSTM model verifies to be the best of all the other models over the entire dataset. [ABSTRACT FROM AUTHOR]

Sugarcane smut and Pachymetra root rots are two serious diseases of sugarcane, with susceptible infected crops losing over 30% of yield. A heritable component to both diseases has been demonstrated, suggesting selection could improve disease resistance. Genomic selection could accelerate gains even further, enabling early selection of resistant seedlings for breeding and clonal propagation. In this study we evaluated four types of algorithms for genomic predictions of clonal performance for disease resistance. These algorithms were: Genomic best linear unbiased prediction (GBLUP), including extensions to model dominance and epistasis, Bayesian methods including BayesC and BayesR, Machine learning methods including random forest, multilayer perceptron (MLP), modified convolutional neural network (CNN) and attention networks designed to capture epistasis across the genome-wide markers. Simple hybrid methods, that first used BayesR/GWAS to identify a subset of 1000 markers with moderate to large marginal additive effects, then used attention networks to derive predictions from these effects and their interactions, were also developed and evaluated. The hypothesis for this approach was that using a subset of markers more likely to have an effect would enable better estimation of interaction effects than when there were an extremely large number of possible interactions, especially with our limited data set size. To evaluate the methods, we applied both random five-fold cross-validation and a structured PCA based cross-validation that separated 4702 sugarcane clones (that had disease phenotypes and genotyped for 26k genome wide SNP markers) by genomic relationship. The Bayesian methods (BayesR and BayesC) gave the highest accuracy of prediction, followed closely by hybrid methods with attention networks. The hybrid methods with attention networks gave the lowest variation in accuracy of prediction across validation folds (and lowest MSE), which may be a criteria worth considering in practical breeding programs. This suggests that hybrid methods incorporating the attention mechanism could be useful for genomic prediction of clonal performance, particularly where nonadditive effects may be important. [ABSTRACT FROM AUTHOR]

Pine Wilt Disease poses a significant global threat to forests, necessitating swift detection methods. Conventional approaches are resource-intensive but utilizing deep learning on ortho-mapped images obtained from Unmanned Aerial Vehicles offers cost-effective and scalable solutions. This study presents a novel method for Pine Wilt Disease detection and classification using YOLOv8 for segmenting diseased areas, followed by cropping the diseased regions from the original image and applying Deep Metric Learning for classification. We trained a ResNet50 model using semi-hard triplet loss to obtain embeddings, and subsequently trained a Random Forest classifier tasked with identifying tree species and distinguishing false positives. Segmentation was favored over object detection due to its ability to provide pixel-level information, enabling the flexible extension of subsequent bounding boxes. Deep Metric Learning-based classification after segmentation was chosen for its effectiveness in handling visually similar images. The results indicate a mean Intersection over Union of 83.12% for segmentation, with classification accuracies of 98.7% and 90.7% on the validation and test sets, respectively. [ABSTRACT FROM AUTHOR]

Objective: To establish whether or not a natural language processing technique could identify two common inpatient neurosurgical comorbidities using only text reports of inpatient head imaging. Materials and methods: A training and testing dataset of reports of 979 CT or MRI scans of the brain for patients admitted to the neurosurgery service of a single hospital in June 2021 or to the Emergency Department between July 1–8, 2021, was identified. A variety of machine learning and deep learning algorithms utilizing natural language processing were trained on the training set (84% of the total cohort) and tested on the remaining images. A subset comparison cohort (n = 76) was then assessed to compare output of the best algorithm against real-life inpatient documentation. Results: For "brain compression", a random forest classifier outperformed other candidate algorithms with an accuracy of 0.81 and area under the curve of 0.90 in the testing dataset. For "brain edema", a random forest classifier again outperformed other candidate algorithms with an accuracy of 0.92 and AUC of 0.94 in the testing dataset. In the provider comparison dataset, for "brain compression," the random forest algorithm demonstrated better accuracy (0.76 vs 0.70) and sensitivity (0.73 vs 0.43) than provider documentation. For "brain edema," the algorithm again demonstrated better accuracy (0.92 vs 0.84) and AUC (0.45 vs 0.09) than provider documentation. Discussion: A natural language processing-based machine learning algorithm can reliably and reproducibly identify selected common neurosurgical comorbidities from radiology reports. Conclusion: This result may justify the use of machine learning-based decision support to augment provider documentation. [ABSTRACT FROM AUTHOR]

Invasive noxious weed species (INWS) are typical poisonous plants and forbs that are considered an increasing threat to the native alpine grassland ecosystems in the Qinghai–Tibetan Plateau (QTP). Accurate knowledge of the continuous cover of INWS across complex alpine grassland ecosystems over a large scale is required for their control and management. However, the cooccurrence of INWS and native grass species results in highly heterogeneous grass communities and generates mixed pixels detected by remote sensors, which causes uncertainty in classification. The continuous coverage of INWS at the pixel level has not yet been achieved. In this study, objective 1 was to test the capability of Senginel-2 imagery at estimating continuous INWS cover across complex alpine grasslands over a large scale and objective 2 was to assess the performance of the state-of-the-art convolutional neural network-based regression (CNNR) model in estimating continuous INWS cover. Therefore, a novel CNNR model and a random forest regression (RFR) model were evaluated for estimating INWS continuous cover using Sentinel-2 imagery. INWS continuous cover was estimated directly from Sentinel-2 imagery with an R2 ranging from 0.88 to 0.93 using the CNNR model. The RFR model combined with multiple features had a comparable accuracy, which was slightly lower than that of the CNNR model, with an R2 of approximately 0.85. Twelve green band-, red-edge band-, and near-infrared band-related features had important contributions to the RFR model. Our results demonstrate that the CNNR model performs well when estimating INWS continuous cover directly from Sentinel-2 imagery, and the RFR model combined with multiple features derived from the Sentinel-2 imager can also be used for INWS continuous cover mapping. Sentinel-2 imagery is suitable for mapping continuous INWS cover across complex alpine grasslands over a large scale. Our research provides information for the advanced mapping of the continuous cover of invasive species across complex grassland ecosystems or, more widely, terrestrial ecosystems over large spatial areas using remote sensors such as Sentinel-2. [ABSTRACT FROM AUTHOR]

Petrographic prediction is crucial in identifying target areas and understanding reservoir lithology in oil and gas exploration. Traditional logging methods often rely on manual interpretation and experiential judgment, which can introduce subjectivity and constraints due to data quality and geological variability. To enhance the precision and efficacy of lithology prediction, this study employed a Savitzky–Golay filter with a symmetric window for anomaly data processing, coupled with a residual temporal convolutional network (ResTCN) model tasked with completing missing logging data segments. A comparative analysis against the support vector regression and random forest regression model revealed that the ResTCN achieves the smallest MAE, at 0.030, and the highest coefficient of determination, at 0.716, which are indicative of its proximity to the ground truth. These methodologies significantly enhance the quality of the training data. Subsequently, a Transformer–long short-term memory (T-LS) model was applied to identify and classify the lithology of unexplored wells. The input layer of the Transformer model follows an embedding-like principle for data preprocessing, while the encoding block encompasses multi-head attention, Add & Norm, and feedforward components, integrating the multi-head attention mechanism. The output layer interfaces with the LSTM layer through dropout. A performance evaluation of the T-LS model against established rocky prediction techniques such as logistic regression, k-nearest neighbor, and random forest demonstrated its superior identification and classification capabilities. Specifically, the T-LS model achieved a precision of 0.88 and a recall of 0.89 across nine distinct lithology features. A Shapley analysis of the T-LS model underscored the utility of amalgamating multiple logging data sources for lithology classification predictions. This advancement partially addresses the challenges associated with imprecise predictions and limited generalization abilities inherent in traditional machine learning and deep learning models applied to lithology identification, and it also helps to optimize oil and gas exploration and development strategies and improve the efficiency of resource extraction. [ABSTRACT FROM AUTHOR]

In this work, we used the convolutional neural network (CNN) method to invert sea surface height (SSH) from the Global Navigation Satellite System (GNSS) delayed Doppler map (DDM) data during 2009–2017 and compared the CNN inversion data with those obtained from traditional simple random forest (RF) method. SSH observations from the OSTM/Jason-2 satellite were used to judge the merits of the two methods. The results show that both methods yield good SSH inversion results, but when the training set is 9000, the root mean square errors of the SSH inversion results based on the CNN and the RF method are 16.78 and 15.96 respectively; as the training set increases above 9000, the accuracy of the CNN method is significantly better than that of the RF method. This suggests that SSH inversion based on the CNN method will become more advantageous as more data become available. [ABSTRACT FROM AUTHOR]

In this paper, we introduce a novel approach to address the dynamic prediction of customer activity in electronic payment transactions for individual clients. Our approach is founded on customer online payment transaction records from registered UK-based online retailers between 01/12/2009 and 09/12/2011. These retailers primarily specialize in unique gift items for various occasions, catering to a wide range of clients, including wholesalers. We used classification analysis based on the correlation coefficient to measure and describe a customer's electronic payment capability based on the quality of products they purchase. Furthermore, we trained multi-layered models (linear model, deep learning, random forest, and support vector machines (SVM)) to capture the dynamics of e-bank transaction reinforcement for retail customers using machine learning. Real transaction data from a UK online retailer was employed in our study. The experimental results consistently demonstrated the effectiveness of our proposed strategy. [ABSTRACT FROM AUTHOR]

Rock physics plays an important role in the oil, gas, and water industries by providing essential data for reservoir management. This study focuses on predicting Shear Wave Velocity (Vs), a key geophysical parameter, using the Deep Belief Network (DBN) and Random Forest (RF) algorithms. The dataset is divided for training, validation, and testing, revealing that the DBN model surpasses the RF and empirical models in accuracy. With a low RMSE value of 0.0398 km/s in testing and an R2 of 0.9775, the DBN model demonstrates precision in Vs prediction. The analysis identifies specific parameters—Measure Depth (MD), Caliper (CALL), Gamma Ray (GR), Shallow Electrical Resistivity (RES-S), Medium Electrical Resistivity (RES-M), Deep Electrical Resistivity (RES-D), Compressional Wave Velocity (DCT), Neutron Porosity (NPHI), and Photoelectric Coefficient Index (PEF)—as significantly influencing Vs, while CALI and GR have a relatively lesser effect. The results of the Vs prediction indicated that the DBN algorithm excels in deep feature extraction, unsupervised pretraining, and efficient handling of complex data. Ultimately, the DBN algorithm proves to be a superior and time-saving alternative for Vs prediction and analysis in subsurface reservoirs. • Rock physics aids oil, gas, and water industries through crucial reservoir data. • Deep Belief Network (DBN) excels in Vs prediction with superior performance. • DBN model achieves remarkable precision with a low RMSE of 0.0398 km/s. • Correlation analysis identifies key parameters influencing shear wave velocity (Vs). • DBN algorithm proves a time-saving, reliable alternative for Vs prediction in subsurface reservoirs. [ABSTRACT FROM AUTHOR]

With the installation of solar panels around the world and the permanent fluctuation of climatic factors, it is, therefore, important to provide the necessary energy in the electrical network in order to satisfy the electrical demand at all times for smart grid applications. This study first presents a comprehensive and comparative review of existing deep learning methods used for smart grid applications such as solar photovoltaic (PV) generation forecasting and power consumption forecasting. In this work, electrical consumption forecasting is long term and will consider smart meter data and socioeconomic and demographic data. Photovoltaic power generation forecasting is short term by considering climatic data such as solar irradiance, temperature, and humidity. Moreover, we have proposed a novel hybrid deep learning method based on multilayer perceptron (MLP), long short-term memory (LSTM), and genetic algorithm (GA). We then simulated all the deep learning methods on a climate and electricity consumption dataset for the city of Douala. Electrical consumption data are collected from smart meters installed at consumers in Douala. Climate data are collected at the climate management center in the city of Douala. The results obtained show the outperformance of the proposed optimized method based on deep learning in the both electrical consumption and PV power generation forecasting and its superiority compared to basic methods of deep learning such as support vector machine (SVM), MLP, recurrent neural network (RNN), and random forest algorithm (RFA). [ABSTRACT FROM AUTHOR]

Deep learning algorithms lack interpretability and interpretability in the decision-making process. This makes it difficult to understand the judgment basis and decision-making process of financial risks based on algorithms, which may reduce the trust and acceptance of risk decisions by enterprises. To address this issue, this study introduces the improved random forest algorithm based on the decision tree algorithm to discuss its framework. Through analysis of the PR curve in the experiment, it was determined that the AP value of the enhanced random forest algorithm is 0.9919, a significant improvement over the RF algorithm's previous value of 0.9237. It also has a good balance between the precision rate and the recall rate. By introducing the data set to compare and analyze the three algorithms of SVM, CRAT, and the improved random forest algorithm, it is found that the improved random forest algorithm has a higher test value. Through cluster analysis, it is found that the clustering accuracy of the improved random forest algorithm is about 81%. The final analysis of a company's financial data sample showed an accuracy rate of 69.6% on the enterprise access index. The improved random forest algorithm achieves a good balance between accuracy and recall, resulting in the potential for high accuracy in the domain of risk assessment. In addition, compared with other algorithms such as SVM and CRAT, the improved random forest algorithm has higher test values, indicating its excellent performance in financial risk prediction. To sum up, this study firstly verified the feasibility and accuracy of the improved random forest algorithm for financial risk prediction. Additionally, it validated the method's predictive capability using factual enterprise data samples and ultimately established a foundation for the enterprise's financial risk management framework. Construction offers a new theoretical direction. [ABSTRACT FROM AUTHOR]

The global spread of the SARS-CoV-2 pandemic, originating in Wuhan, China, has had profound consequences on both health and the economy. Traditional alignment-based phylogenetic tree methods for tracking epidemic dynamics demand substantial computational power due to the growing number of sequenced strains. Consequently, there is a pressing need for an alignment-free approach to characterize these strains and monitor the dynamics of various variants. In this work, we introduce a swift and straightforward tool named GenoSig, implemented in C++. The tool exploits the Di and Tri nucleotide frequency signatures to delineate the taxonomic lineages of SARS-CoV-2 by employing diverse machine learning (ML) and deep learning (DL) models. Our approach achieved a tenfold cross-validation accuracy of 87.88% (± 0.013) for DL and 86.37% (± 0.0009) for Random Forest (RF) model, surpassing the performance of other ML models. Validation using an additional unexposed dataset yielded comparable results. Despite variations in architectures between DL and RF, it was observed that later clades, specifically GRA, GRY, and GK, exhibited superior performance compared to earlier clades G and GH. As for the continental origin of the virus, both DL and RF models exhibited lower performance than in predicting clades. However, both models demonstrated relatively higher accuracy for Europe, North America, and South America compared to other continents, with DL outperforming RF. Both models consistently demonstrated a preference for cytosine and guanine over adenine and thymine in both clade and continental analyses, in both Di and Tri nucleotide frequencies signatures. Our findings suggest that GenoSig provides a straightforward approach to address taxonomic, epidemiological, and biological inquiries, utilizing a reductive method applicable not only to SARS-CoV-2 but also to similar research questions in an alignment-free context. [ABSTRACT FROM AUTHOR]

Aeroengines use numerous sensors to detect equipment health and ensure proper operation. Currently, filtering useful sensor data and removing useless data is challenging in predicting the remaining useful life (RUL) of an aeroengine using deep learning. To reduce computational costs and improve prediction performance, we use random forest to evaluate the feature importance of sensor data. Based on the size of the feature corresponding to the Gini index, we select the appropriate sensor. This helps us to determine which sensor to use and ensures that the computational resources are not wasted on unnecessary sensors. Considering that the RUL of equipment changes in a progressively more complex manner as the equipment is used over time, we propose an improved squeeze and excitation block (SSE) and combine it with a convolutional neural network (CNN). By enhancing the feature selection ability of CNN through segmented squeeze and excitation block, the model can focus on important information within features to effectively improve prediction performance. We compared our experiments with other RUL experiments on the CMAPSS aeroengine dataset and then conducted ablation experiments to verify the critical role of the methods we used. [ABSTRACT FROM AUTHOR]

At present, for business lightning positioning systems, the classification of lightning discharge types is mostly based on lightning pulse signal features, and there is still a lot of room for improvement. We propose a lightning discharge classification method based on convolutional encoding features. This method utilizes convolutional neural networks to extract encoding features, and uses random forests to classify the extracted encoding features, achieving high accuracy discrimination for various lightning discharge events. Compared with traditional multi-parameter-based methods, the new method proposed in this paper has the ability to identify multiple lightning discharge events and does not require precise detailed feature engineering to extract individual pulse parameters. The accuracy of this method for identifying lightning discharge types in intra-cloud flash (IC), cloud-to-ground flash (CG), and narrow bipolar events (NBEs) is 97%, which is higher than that of multi-parameter methods. Moreover, our method can complete the classification task of lightning signals at a faster speed. Under the same conditions, the new method only requires 28.2 µs to identify one pulse, while deep learning-based methods require 300 µs. This method has faster recognition speed and higher accuracy in identifying multiple discharge types, which can better meet the needs of real-time business positioning. [ABSTRACT FROM AUTHOR]

This study delves into the intricate realm of recognizing handwritten Arabic characters, specifically targeting children's script. Given the inherent complexities of the Arabic script, encompassing semi-cursive styles, distinct character forms based on position, and the inclusion of diacritical marks, the domain demands specialized attention. While prior research has largely concentrated on adult handwriting, the spotlight here is on children's handwritten Arabic characters, an area marked by its distinct challenges, such as variations in writing quality and increased distortions. To this end, we introduce a novel dataset, "Dhad", refined for enhanced quality and quantity. Our investigation employs a tri-fold experimental approach, encompassing the exploration of pre-trained deep learning models (i.e., MobileNet, ResNet50, and DenseNet121), custom-designed Convolutional Neural Network (CNN) architecture, and traditional classifiers (i.e., Support Vector Machine (SVM), Random Forest (RF), and Multilayer Perceptron (MLP)), leveraging deep visual features. The results illuminate the efficacy of fine-tuned pre-existing models, the potential of custom CNN designs, and the intricacies associated with disjointed classification paradigms. The pre-trained model MobileNet achieved the best test accuracy of 93.59% on the Dhad dataset. Additionally, as a conceptual proposal, we introduce the idea of a computer application designed specifically for children aged 7–12, aimed at improving Arabic handwriting skills. Our concluding reflections emphasize the need for nuanced dataset curation, advanced model architectures, and cohesive training strategies to navigate the multifaceted challenges of Arabic character recognition. [ABSTRACT FROM AUTHOR]

RNA-protein interaction (RPI) is crucial to the life processes of diverse organisms. Various researchers have identified RPI through long-term and high-cost biological experiments. Although numerous machine learning and deep learning-based methods for predicting RPI currently exist, their robustness and generalizability have significant room for improvement. This study proposes LPI-MFF, an RPI prediction model based on multi-source information fusion, to address these issues. The LPI-MFF employed protein–protein interactions features, sequence features, secondary structure features, and physical and chemical properties as the information sources with the corresponding coding scheme, followed by the random forest algorithm for feature screening. Finally, all information was combined and a classification method based on convolutional neural networks is used. The experimental results of fivefold cross-validation demonstrated that the accuracy of LPI-MFF on RPI1807 and NPInter was 97.60% and 97.67%, respectively. In addition, the accuracy rate on the independent test set RPI1168 was 84.9%, and the accuracy rate on the Mus musculus dataset was 90.91%. Accordingly, LPI-MFF demonstrated greater robustness and generalization than other prevalent RPI prediction methods. [ABSTRACT FROM AUTHOR]

In recent years, automatic image classification methods have significantly progressed, notably black box algorithms such as machine learning and deep learning. Unfortunately, such efforts only focused on improving performance, rather than attempting to explain and interpret how classification models actually operate. This article compares three state-of-the-art algorithms incorporating random forests, gradient boosting and convolutional neural networks for geomorphological mapping. It also attempts to explain how the most effective classifier makes decisions by evaluating which of the geomorphometric variables are most important for automatic mapping and how they affect the classification results using one of the explainable artificial intelligence techniques, namely accumulated local effects (ALE). This method allows us to understand the relationship between predictors and the model's outcome. For these purposes, eight sheets of the digital geomorphological map of Poland on the scale of 1:100,000 were used as the reference material. The classification results were validated using the holdout method and cross-validation for individual sheets representing different morphogenetic zones. The terrain elevation entropy, absolute elevation, aggregated median elevation and standard deviation of elevation had the greatest impact on the classification results among the 15 geomorphometric variables considered. The ALE analysis was conducted for the XGBoost classifier, which achieved the highest accuracy of 92.8%, ahead of Random Forests at 84% and LightGBM at 73.7% and U-Net at 59.8%. We conclude that automatic classification can support geomorphological mapping only if the geomorphological characteristics in the predicted area are similar to those in the training dataset. The ALE plots allow us to analyze the relationship between geomorphometric variables and landform membership, which helps clarify their role in the classification process. [ABSTRACT FROM AUTHOR]

Language identification has become a critical challenge in NLP, particularly in multilingual countries like India. This study addresses the identification of closely related Indo-Aryan languages, proposing a robust deep-learning ensemble model with data augmentation. Pre-trained models (Indic BERT, Indic Transformer, DevBERT, L3Cube-HindBERT) and various embedding techniques (word2vec, Indic transformer, Keras embedding) are explored with LSTM, Bi-LSTM, GRU, Bi-GRU, and CNN-Bi-LSTM deep learning models. Keras embedding performs better as compared to other embedding methods. The four best deep learning models are selected, and ensemble methods (soft voting, hard voting, stacking with meta models Random Forest and SVM classifier) are employed. When utilizing data augmentation with the training data and fitting the models Bi-LSTM, GRU, Bi-GRU, and CNN-Bi-LSTM with Keras embedding, the best performance, a 93% F1-score, was achieved by their soft voting classifier as compared to the other models. The performance of the proposed model was compared with the existing baseline models on the same dataset. For the comparison of model performance, the macro F1 score, accuracy, recall, and precision were used. [ABSTRACT FROM AUTHOR]

In the realm of global computer security, safeguarding sensitive data and computer systems stands as an ongoing challenge. Striking the delicate balance between convenient access for legitimate users and thwarting imposter attacks is imperative. Traditional authentication methods, primarily reliant on username and password schemes, have been the longstanding cornerstone of cyber system authentication. Yet, this conventional approach is marred by inherent vulnerabilities, including password exchange, shoulder surfng, brute force attacks, dictionary attacks, speculation, phishing, and emerging threats. In response to these shortcomings, biometrics technology has emerged as a reliable alternative for authentication and verification, with Keystroke Dynamics being a well-established method. This research advances Keystroke Dynamics-based authentication through cutting-edge technologies, including machine learning, deep learning, and neural networks. A quantitative assessment demonstrates remarkable results—Machine Learning achieves 99.9% accuracy with the Random Forest model, Deep Learning combines CNN with GRU to reach 99.31% accuracy, and the DBN model registers at 98.01%. In the realm of neural networks, Bi-CNN and FFM-NN excel, with accuracy rates of 96.8% and 94.7%, respectively. These findings lay the foundation for robust, secure authentication systems, ensuring the protection of sensitive data and computer assets in our interconnected world. [ABSTRACT FROM AUTHOR]

Gender prediction based on names is an important task with various applications. In this study, we used the PhoBERT model to predict gender and compared its performance with traditional classifiers such as Naïve Bayes, Logistic Regression, and Random Forest. We evaluated the performance of these methods on the GenderVN 1.0 dataset, which consists of over 3 million Vietnamese name samples. Additionally, we analyzed the impact of removing family names or using only middle names on the prediction results. The experimental results showed that the PhoBERT model outperformed traditional classifiers, achieving an accuracy of 92.3%, compared to 90.9% for previously applied methods on the GenderVN 1.0 dataset. This study also demonstrates that using the PhoBERT model for this task can lead to reduced training data requirements without compromising prediction accuracy. These findings contribute to the advancement of gender prediction methodologies and establish a solid groundwork for future research in this domain. [ABSTRACT FROM AUTHOR]

The present study uses the benchmark UNSW-NB15 datasets to detect network anomalies using the proposed deep learning-based Convolutional Neural Network (CNN) model. Several studies have already worked on network anomaly detection with some limits. However, earlier research has used old datasets and obtained limited accuracy. In addition, previous studies could not detect the latest malicious activities. Therefore, in the present study, firstly, we implemented the machine learning-based random forest method to diminish the dimensionality of the dataset and pick the most notable features. In this case, the random forest method has set only fifteen features from the forty-one and reduced the complexity of the data. Subsequently, the CNN model was trained and tested on the UNSW-NB15 dataset with 99.00% testing accuracy. The performance of the offered CNN model was assessed using precision, recall and the f1-values. The present study's outcome can be used in real-time malicious activity detection. [ABSTRACT FROM AUTHOR]

Detecting road cracks is essential for inspecting and assessing the integrity of concrete pavement structures. Traditional image-based methods often require complex preprocessing to extract crack features, making them challenging when dealing with noisy concrete surfaces in diverse real-world scenarios, such as autonomous vehicle road detection. This study introduces an image-based crack detection approach that combines a Random Forest machine learning classifier with a deep convolutional neural network (CNN) to address these challenges. Three state-of-the-art models, namely MobileNet, InceptionV3, and Xception, were employed and trained using a dataset of 30,000 images to build an effective CNN. A systematic comparison of validation accuracy across various base learning rates identified a base learning rate of 0.001 as optimal, achieving a maximum validation accuracy of 99.97%. This optimal learning rate was then applied in the subsequent testing phase. The robustness and flexibility of the trained models were evaluated using 6,000 test photos, each with a resolution of 224 × 224 pixels, which were not part of the training or validation sets. The outstanding results, boasting a remarkable 99.95% accuracy, 99.95% precision, 99.94% recall, and a matching 99.94% F1 Score, unequivocally affirm the efficacy of the proposed technique in precisely identifying road fractures in photographs taken on real concrete surfaces. [ABSTRACT FROM AUTHOR]

A near-global framework for automated training data generation and land cover classification using shallow machine learning with low-density time series imagery does not exist. This study presents a methodology to map nine-class, six-class, and five-class land cover using two dates (winter and non-winter) of a Sentinel-2 granule across seven international sites. The approach uses a series of spectral, textural, and distance decision functions combined with modified ancillary layers (such as global impervious surface and global tree cover) to create binary masks from which to generate a balanced set of training data applied to a random forest classifier. For the land cover masks, stepwise threshold adjustments were applied to reflectance, spectral index values, and Euclidean distance layers, with 62 combinations evaluated. Global (all seven scenes) and regional (arid, tropics, and temperate) adaptive thresholds were computed. An annual 95th and 5th percentile NDVI composite was used to provide temporal corrections to the decision functions, and these corrections were compared against the original model. The accuracy assessment found that the regional adaptive thresholds for both the two-date land cover and the temporally corrected land cover could accurately map land cover type within nine-class (68.4% vs. 73.1%), six-class (79.8% vs. 82.8%), and five-class (80.1% vs. 85.1%) schemes. Lastly, the five-class and six-class models were compared with a manually labeled deep learning model (Esri), where they performed with similar accuracies (five classes: Esri 80.0 ± 3.4%, region corrected 85.1 ± 2.9%). The results highlight not only performance in line with an intensive deep learning approach, but also that reasonably accurate models can be created without a full annual time series of imagery. [ABSTRACT FROM AUTHOR]

Accurate extraction of crop acreage is an important element of digital agriculture. This study uses Sentinel-2A, Sentinel-1, and DEM as data sources to construct a multidimensional feature dataset encompassing spectral features, vegetation index, texture features, terrain features, and radar features. The Relief-F algorithm is applied for feature selection to identify the optimal feature dataset. And the combination of deep learning and the random forest (RF) classification method is utilized to identify lilies in Qilihe District and Yuzhong County of Lanzhou City, obtain their planting structure, and analyze their spatial distribution characteristics in Gansu Province. The findings indicate that terrain features significantly contribute to ground object classification, with the highest classification accuracy when the number of features in the feature dataset is 36. The precision of the deep learning classification method exceeds that of RF, with an overall classification accuracy and kappa coefficient of 95.9% and 0.934, respectively. The Lanzhou lily planting area is 137.24 km2, and it primarily presents a concentrated and contiguous distribution feature. The study's findings can serve as a solid scientific foundation for Lanzhou City's lily planting structure adjustment and optimization and a basis of data for local lily yield forecasting, development, and application. [ABSTRACT FROM AUTHOR]

As the application of large language models (LLMs) has broadened into the realm of biological predictions, leveraging their capacity for self-supervised learning to create feature representations of amino acid sequences, these models have set a new benchmark in tackling downstream challenges, such as subcellular localization. However, previous studies have primarily focused on either the structural design of models or differing strategies for fine-tuning, largely overlooking investigations into the nature of the features derived from LLMs. In this research, we propose different ESM2 representation extraction strategies, considering both the character type and position within the ESM2 input sequence. Using model dimensionality reduction, predictive analysis and interpretability techniques, we have illuminated potential associations between diverse feature types and specific subcellular localizations. Particularly, the prediction of Mitochondrion and Golgi apparatus prefer segments feature closer to the N-terminal, and phosphorylation site-based features could mirror phosphorylation properties. We also evaluate the prediction performance and interpretability robustness of Random Forest and Deep Neural Networks with varied feature inputs. This work offers novel insights into maximizing LLMs' utility, understanding their mechanisms, and extracting biological domain knowledge. Furthermore, we have made the code, feature extraction API, and all relevant materials available at https://github.com/yujuan-zhang/feature-representation-for-LLMs. [ABSTRACT FROM AUTHOR]

Automated built-up infrastructure classification is a global need for planning. However, individual indices have weaknesses, including spectral confusion with bare ground, and computational requirements for deep learning are intensive. We present a computationally lightweight method to classify built-up infrastructure. We use an ensemble of spectral indices and a novel red-band texture layer with global thresholds determined from 12 diverse sites (two seasonally varied images per site). Multiple spectral indexes were evaluated using Sentinel-2 imagery. Our texture metric uses the red band to separate built-up infrastructure from spectrally similar bare ground. Our evaluation produced global thresholds by evaluating ground truth points against a range of site-specific optimal index thresholds across the 24 images. These were used to classify an ensemble, and then spectral indexes, texture, and stratified random sampling guided training data selection. The training data fit a random forest classifier to create final binary maps. Validation found an average overall accuracy of 79.95% (±4%) and an F1 score of 0.5304 (±0.07). The inclusion of the texture metric improved overall accuracy by 14–21%. A comparison to site-specific thresholds and a deep learning-derived layer is provided. This automated built-up infrastructure mapping framework requires only public imagery to support time-sensitive land management workflows. [ABSTRACT FROM AUTHOR]

Aquatic vegetation is an important component of aquatic ecosystems; therefore, the classification and mapping of aquatic vegetation is an important aspect of lake management. Currently, the decision tree (DT) classification method based on spectral indices has been widely used in the extraction of aquatic vegetation data, but the disadvantage of this method is that it is difficult to fix the threshold value, which, in turn, affects the automatic classification effect. In this study, Sentinel-2 MSI data were used to produce a sample set (about 930 samples) of aquatic vegetation in four inland lakes (Lake Taihu, Lake Caohai, Lake Honghu, and Lake Dongtinghu) using the visual interpretation method, including emergent, floating-leaved, and submerged vegetation. Based on this sample set, a DL model (Res-U-Net) was used to train an automatic aquatic vegetation extraction model. The DL model achieved a higher overall accuracy, relevant error, and kappa coefficient (90%, 8.18%, and 0.86, respectively) compared to the DT method (79%, 23.07%, and 0.77) and random forest (78%,10.62% and 0.77) when utilizing visual interpretation results as the ground truth. When utilizing measured point data as the ground truth, the DL model exhibited accuracies of 59%, 78%, and 91% for submerged, floating-leaved, and emergent vegetation, respectively. In addition, the model still maintains good recognition in the presence of clouds with the influence of water bloom. When applying the model to Lake Honghu from January 2017 to October 2023, the obtained temporal variation patterns in the aquatic vegetation were consistent with other studies. The study in this paper shows that the proposed DL model has good application potential for extracting aquatic vegetation data. [ABSTRACT FROM AUTHOR]

The research and application of convolutional neural networks (CNNs) on statistical downscaling have been hampered by the fact that deep learning is highly dependent on sample size and is considered to be a black-box model. Therefore, a CNN model with transfer learning (CNN-TL) is proposed to study the pre-rainy season precipitation of South China. First, an augmented monthly dataset is created by sliding a fixed-length window over the daily circulation field and precipitation data for the entire year. Next, a base CNN network is pretrained on the augmented dataset, and then the network parameters are tuned on the actual monthly dataset from South China. Then, guided backpropagation is conducted to obtain the distribution regions of the key features and explain the net. The coefficient of determination R2 and root-mean-square error (RMSE) show that the CNN-TL model has higher explanatory power and better fitting performance than the feature extraction–based random forest. In comparison with the base CNN, the transfer learning approach can improve the explanatory power of the model by 10.29% and reduce the average RMSE by 6.82%. In addition, the interpretation results of the model show that the critical regions are primarily South China and its surrounding areas, including the Indochina Peninsula, the Bay of Bengal, and the South China Sea. Furthermore, the ablation experiments and composite analysis illustrate that these regions are very important. Significance Statement: To mitigate the challenges posed by small sample sizes and the transparency of deep learning in downscaling problems, we propose a convolutional neural network based on sample augmentation and transfer learning to study the monthly precipitation downscaling problem during the preflood period in South China. In comparison with random forests and conventional convolutional neural networks, our model achieves an optimal interpretation rate and stability. In addition, we explore the interpretability of the model using guided backpropagation to find the distribution of key features within the large-scale circulation field, thus increasing the credibility of the model. [ABSTRACT FROM AUTHOR]

Airport service quality ratings found on social media such as Airline Quality and Google Maps offer invaluable insights for airport management to improve their quality of services. However, there is currently a lack of research analysing these reviews by airport services using sentimental analysis approaches. This research applies multiclass models based on Aspect-Based Sentimental Analysis to conduct a comprehensive analysis of travellers' reviews, in which the major airport services are tagged by positive, negative, and non-existent sentiments. Seven airport services commonly utilised in previous studies are also introduced. Subsequently, various Deep Learning architectures and Machine Learning classification algorithms are developed, tested, and compared using data collected from Twitter, Google Maps, and Airline Quality, encompassing travellers' feedback on airport service quality. The results show that the traditional Machine Learning algorithms such as the Random Forest algorithm outperform Deep Learning models in the multiclass prediction of airport service quality using travellers' feedback. The findings of this study offer concrete justifications for utilising multiclass Machine Learning models to understand the travellers' sentiments and therefore identify airport services required for improvement. [ABSTRACT FROM AUTHOR]

Abnormal changes in air temperature cause natural disasters such as droughts, hailstorms, and storms, thereby affecting the normal lives of human beings. Consequently, timely and accurate air temperature prediction is essential for human production and livelihood. Traditional air temperature prediction methods are less accurate and less consider the spatial relationship between air temperature in different regions. In this paper, we propose a new deep learning model, convolutional long short-term memory based on channel attention and spatial autocorrelation (ConvLSTM-CASA), which focuses on the spatial correlation between ambient air temperatures and can effectively capture the interaction of air temperatures in different regions. The results show that the ConvLSTM-CASA model has an average R2 of 0.954 and MSE of 5.245 for pentad-mean temperature prediction over the Yangtze River basin. Compared with baseline forecasting models, the MSE accuracy by the ConvLSTM-CASA model improved by 72.45%, 48.95%, 48.97%, 47.79%, and 22.63% over the decision tree regression (DTR), multiple linear regression (MLR), random forests (RF), long short-term memory (LSTM), and ConvLSTM models, respectively. The ConvLSTM-CASA model is expected to outperform the ConvLSTM model over 90% of the area, suggesting robust prediction skill improvement over space. The ConvLSTM-CASA model provides new insights for data-driven pentad-mean air temperature prediction by including elaborate channel and spatial feature modeling, which aid individuals in comprehending the intricate patterns of air temperature fluctuations. [ABSTRACT FROM AUTHOR]

This study investigates the prediction of mental well-being factors—depression, stress, and anxiety—using the NetHealth dataset from college students. The research addresses four key questions, exploring the impact of digital biomarkers on these factors, their alignment with conventional psychology literature, the time-based performance of applied methods, and potential enhancements through multitask learning. The findings reveal modality rankings aligned with psychology literature, validated against paper-based studies. Improved predictions are noted with temporal considerations, and further enhanced by multitasking. Mental health multitask prediction results show aligned baseline and multitask performances, with notable enhancements using temporal aspects, particularly with the random forest (RF) classifier. Multitask learning improves outcomes for depression and stress but not anxiety using RF and XGBoost. [ABSTRACT FROM AUTHOR]

The process of identifying apple varieties holds pivotal importance in pomology and agricultural science. This intricate task not only aids growers in optimizing orchard management, but also profoundly impacts consumers and the apple industry as a whole. Selecting the right apple varieties tailored to specific environmental conditions and market demands is instrumental for the sustainability and economic viability of apple cultivation. Accurate apple variety identification further contributes to maintaining product quality and ensuring consumer satisfaction. Traditional identification methods, however, are susceptible to human error given the vast diversity of apple cultivars. In response, the integration of advanced technologies, including image processing and machine learning, has emerged as a promising approach to enhance accuracy and efficiency in apple variety identification, benefitting both the agricultural and commercial sectors. The classification of apple types involved feature extraction using three methods: MobileNetV2, EfficientNetV2B0, and a combination of GLCM and Color-Space algorithms from apple images. Machine learning models were then built to classify apple varieties, utilizing various algorithms such as support vector machine (SVM), k-nearest neighbors (Knn), random subspace (RSS), and random forest. In the case of "EfficientNetV2B0 + GLCM + Color-Space" and utilizing the ReliefF feature selection method, the random forest algorithm attains peak performance with an accuracy, precision, recall, and F-score all registering an impressive 98.33%. [ABSTRACT FROM AUTHOR]

Cybersecurity threats, particularly spam SMS, are increasingly sophisticated, demanding more advanced detection systems. Traditional spam detection methods fall short due to their ineffectiveness against novel threats and lack of transparency. This paper investigates the role of Explainable Artificial Intelligence (XAI) in spam detection, emphasizing the interpretability of AI-driven systems through SHapley Additive explanations (SHAP). We propose a hybrid model combining BERT with Random Forest (RF) and Artificial Neural Networks (ANN) for spam detection, and employ SHAP values to elucidate the decision-making process. The study demonstrates that our XAI approach not only improves the accuracy of spam detection but also enhances the transparency and trustworthiness of the predictions. These findings suggest that the incorporation of XAI into spam detection models is not only beneficial but necessary for future cybersecurity measures. Our research invites further exploration into other XAI techniques and their applications in real-world scenarios. [ABSTRACT FROM AUTHOR]

Speech emotion recognition (SER) has gained an increased interest during the last decades as part of enriched affective computing. As a consequence, a variety of engineering approaches have been developed addressing the challenge of the SER problem, exploiting different features, learning algorithms, and datasets. In this paper, we propose the application of the graph theory for classifying emotionally-colored speech signals. Graph theory provides tools for extracting statistical as well as structural information from any time series. We propose to use the mentioned information as a novel feature set. Furthermore, we suggest setting a unique feature-based identity for each emotion belonging to each speaker. The emotion classification is performed by a Random Forest classifier in a Leave-One-Speaker-Out Cross Validation (LOSO-CV) scheme. The proposed method is compared with two state-of-the-art approaches involving well known hand-crafted features as well as deep learning architectures operating on mel-spectrograms. Experimental results on three datasets, EMODB (German, acted) and AESDD (Greek, acted), and DEMoS (Italian, in-the-wild), reveal that our proposed method outperforms the comparative methods in these datasets. Specifically, we observe an average UAR increase of almost 18 % , 8 % and 13 % , respectively. [ABSTRACT FROM AUTHOR]

In recent years, artificial intelligence (AI) has shown promising applications in various scientific domains, including biochemical analysis research. However, the effectiveness of AI in modeling small-scale, imbalanced datasets remains an open question in such fields. This study explores the capabilities of eight basic AI algorithms, including ridge regression, logistic regression, random forest regression, and others, in modeling a small, imbalanced clinical dataset (total n = 387, class 0 = 27, class 1 = 360) related to the records of the biochemical blood tests from the patients with multiple wasp stings (MWS). Through rigorous evaluation using k-fold cross-validation and comprehensive scoring, we found that none of the models could effectively model the data. Even after fine-tuning the hyperparameters of the best-performing models, the results remained below acceptable thresholds. The study highlights the challenges of applying AI to small-scale datasets with imbalanced groups in biochemical or clinical research and emphasizes the need for novel algorithms tailored to small-scale data. The findings also call for further exploration into techniques such as transfer learning and data augmentation, and they underline the importance of understanding the minimum dataset scale required for effective AI modeling in biochemical contexts. [ABSTRACT FROM AUTHOR]

Photovoltaic (PV) power prediction plays a critical role amid the accelerating adoption of renewable energy sources. This paper introduces a bidirectional long short-term memory (BiLSTM) deep learning (DL) model designed for forecasting photovoltaic power one hour ahead. The dataset under examination originates from a small PV installation located at the Polytechnic School of the University of Alcala. To improve the quality of historical data and optimize model performance, a robust data preprocessing algorithm is implemented. The BiLSTM model is synergistically combined with a Bayesian optimization algorithm (BOA) to fine-tune its primary hyperparameters, thereby enhancing its predictive efficacy. The performance of the proposed model is evaluated across diverse meteorological and seasonal conditions. In deterministic forecasting, the findings indicate its superiority over alternative models employed in this research domain, specifically a multilayer perceptron (MLP) neural network model and a random forest (RF) ensemble model. Compared with the MLP and RF reference models, the proposed model achieves reductions in the normalized mean absolute error (nMAE) of 75.03% and 77.01%, respectively, demonstrating its effectiveness in this type of prediction. Moreover, interval prediction utilizing the bootstrap resampling method is conducted, with the acquired prediction intervals carefully adjusted to meet the desired confidence levels, thereby enhancing the robustness and flexibility of the predictions. [ABSTRACT FROM AUTHOR]

We present an evaluation of different deep learning and machine learning approaches for tree health classification in the Black Forest, the Harz Mountains, and the Göttinger Forest on a unique, highly accurate tree-level dataset. The multispectral UAV data were collected from eight forest plots with diverse tree species, mostly conifers. As ground truth data (GTD), nearly 1500 tree polygons with related attribute information on the health status of the trees were used. This data were collected during extensive fieldwork using a mobile application and subsequent individual tree segmentation. Extensive preprocessing included normalization, NDVI calculations, data augmentation to deal with the underrepresented classes, and splitting the data into training, validation, and test sets. We conducted several experiments using a classical machine learning approach (random forests), as well as different convolutional neural networks (CNNs)—ResNet50, ResNet101, VGG16, and Inception-v3—on different datasets and classes to evaluate the potential of these algorithms for tree health classification. Our first experiment was a binary classifier of healthy and damaged trees, which did not consider the degree of damage or tree species. The best results of a 0.99 test accuracy and an F1 score of 0.99 were obtained with ResNet50 on four band composites using the red, green, blue, and infrared bands (RGBI images), while VGG16 had the worst performance, with an F1 score of only 0.78. In a second experiment, we also distinguished between coniferous and deciduous trees. The F1 scores ranged from 0.62 to 0.99, with the highest results obtained using ResNet101 on derived vegetation indices using the red edge band of the camera (NDVIre images). Finally, in a third experiment, we aimed at evaluating the degree of damage: healthy, slightly damaged, and medium or heavily damaged trees. Again, ResNet101 had the best performance, this time on RGBI images with a test accuracy of 0.98 and an average F1 score of 0.97. These results highlight the potential of CNNs to handle high-resolution multispectral UAV data for the early detection of damaged trees when good training data are available. [ABSTRACT FROM AUTHOR]