Search

This paper proposes an advanced deep learning model that integrates the Diffusion-Transformer structure and parallel attention mechanism for the tasks of growth estimation and disease detection in jujube forests. Existing methods in forestry monitoring often fall short in meeting the practical needs of large-scale and highly complex forest areas due to limitations in data processing capabilities and feature extraction precision. In response to this challenge, this paper designs and conducts a series of benchmark tests and ablation experiments to systematically evaluate and verify the performance of the proposed model across key performance metrics such as precision, recall, accuracy, and F1-score. Experimental results demonstrate that compared to traditional machine learning models like Support Vector Machines and Random Forests, as well as common deep learning models such as AlexNet and ResNet, the model proposed in this paper achieves a precision of 95%, a recall of 92%, an accuracy of 93%, and an F1-score of 94% in the task of disease detection in jujube forests, showing similarly superior performance in growth estimation tasks as well. Furthermore, ablation experiments with different attention mechanisms and loss functions further validate the effectiveness of parallel attention and parallel loss function in enhancing the overall performance of the model. These research findings not only provide a new technical path for forestry disease monitoring and health assessment but also contribute rich theoretical and experimental foundations for related fields. [ABSTRACT FROM AUTHOR]

Background: This study evaluates the efficacy of integrating MRI deep transfer learning, radiomic signatures, and clinical variables to accurately preoperatively differentiate between stage T2 and T3 rectal cancer. Methods: We included 361 patients with pathologically confirmed stage T2 or T3 rectal cancer, divided into a training set (252 patients) and a test set (109 patients) at a 7:3 ratio. The study utilized features derived from deep transfer learning and radiomics, with Spearman rank correlation and the Least Absolute Shrinkage and Selection Operator (LASSO) regression techniques to reduce feature redundancy. Predictive models were developed using Logistic Regression (LR), Random Forest (RF), Decision Tree (DT), and Support Vector Machine (SVM), selecting the best-performing model for a comprehensive predictive framework incorporating clinical data. Results: After removing redundant features, 24 key features were identified. In the training set, the area under the curve (AUC)values for LR, RF, DT, and SVM were 0.867, 0.834, 0.900, and 0.944, respectively; in the test set, they were 0.847, 0.803, 0.842, and 0.910, respectively. The combined model, using SVM and clinical variables, achieved AUCs of 0.946 in the trainingset and 0.920 in the test set. Conclusion: The study confirms the utility of a combined model of MRI deep transfer learning, radiomic features, and clinical factors for preoperative classification of stage T2 vs. T3 rectal cancer, offering significant technological support for precise diagnosis and potential clinical application. [ABSTRACT FROM AUTHOR]

Several machine learning (ML) techniques have demonstrated efficacy in precisely forecasting HIV risk and identifying the most eligible individuals for HIV testing in various countries. Nevertheless, there is a data gap on the utility of ML algorithms in strengthening HIV testing worldwide. This systematic review aimed to evaluate how effectively ML algorithms can enhance the efficiency and accuracy of HIV testing interventions and to identify key outcomes, successes, gaps, opportunities, and limitations in their implementation. This review was guided by the Preferred Reporting Items for Systematic Reviews and Meta-Analysis guidelines. A comprehensive literature search was conducted via PubMed, Google Scholar, Web of Science, Science Direct, Scopus, and Gale OneFile databases. Out of the 845 identified articles, 51 studies were eligible. More than 75% of the articles included in this review were conducted in the Americas and various parts of Sub-Saharan Africa, and a few were from Europe, Asia, and Australia. The most common algorithms applied were logistic regression, deep learning, support vector machine, random forest, extreme gradient booster, decision tree, and the least absolute shrinkage selection operator model. The findings demonstrate that ML techniques exhibit higher accuracy in predicting HIV risk/testing compared to traditional approaches. Machine learning models enhance early prediction of HIV transmission, facilitate viable testing strategies to improve the efficiency of testing services, and optimize resource allocation, ultimately leading to improved HIV testing. This review points to the positive impact of ML in enhancing early prediction of HIV spread, optimizing HIV testing approaches, improving efficiency, and eventually enhancing the accuracy of HIV diagnosis. We strongly recommend the integration of ML into HIV testing programs for efficient and accurate HIV testing. [ABSTRACT FROM AUTHOR]

This study addresses the growing concern of technostress, a condition caused by the overwhelming use of digital technologies, exacerbated by the COVID-19 pandemic. The researchers developed a predictive model using machine learning algorithms, Random Forest (RF) and Support Vector Machine (SVM), to assess and manage technostress levels. The model considers factors such as age, gender, technology usage hours, and technological experiences to classify stress levels into high, moderate, and low categories. The study collected data through a questionnaire administered to knowledgeable respondents, using a non-probabilistic sampling approach. The results showed that both RF and SVM algorithms achieved high accuracy in classifying technostress, with SVM performing slightly better (94.5% vs 84.50%). The model’s effectiveness in predicting stress levels for users with varying degrees of stress is a significant contribution to the field. The research also developed an interactive user interface to facilitate user engagement with the model, promoting stress management and well-being in a technology-driven society. The study’s findings provide valuable insights into the challenges posed by technostress and offer a solution for mitigating its effects. The use of machine learning algorithms to classify gender based on the dataset demonstrates the model’s potential applications in various areas. Overall, this study demonstrates the importance of addressing technostress in the digital age and provides a valuable tool for managing stress levels. The development of predictive models like this one can help individuals and organizations mitigate the negative impacts of technostress, promoting a healthier and more sustainable relationship with technology. [ABSTRACT FROM AUTHOR]

In recent years, machine learning (ML) algorithms have gained substantial recognition for ecological modeling across various temporal and spatial scales. However, little evaluation has been conducted for the prediction of soil organic carbon (SOC) on small data sets commonly inherent to long-term soil ecological research. In this context, the performance of ML algorithms for SOC prediction has never been tested against traditional process-based modeling approaches. Here, we compare ML algorithms, calibrated and uncalibrated process-based models as well as multiple ensembles on their performance in predicting SOC using data from five long-term experimental sites (comprising 256 independent data points) in Austria. Using all available data, the ML-based approaches using Random forest and Support vector machines with a polynomial kernel were superior to all process-based models. However, the ML algorithms performed similar or worse when the number of training samples was reduced or when a leave-one-site-out cross validation was applied. This emphasizes that the performance of ML algorithms is strongly dependent on the data-size related quality of learning information following the well-known curse of dimensionality phenomenon, while the accuracy of process-based models significantly relies on proper calibration and combination of different modeling approaches. Our study thus suggests a superiority of ML-based SOC prediction at scales where larger datasets are available, while process-based models are superior tools when targeting the exploration of underlying biophysical and biochemical mechanisms of SOC dynamics in soils. Therefore, we recommend applying ensembles of ML algorithms with process-based models to combine advantages inherent to both approaches. • We evaluated process-based (PB) and machine-learning (ML) models for SOC prediction. • Random forest & support vector machine predicted SOC superior to PB models. • Reduced data availability and quality significantly weakened ML model performance. • ML-assisted PB model ensembles strongly improved model performance. [ABSTRACT FROM AUTHOR]

Cardiovascular and neurological diseases are a major cause of mortality and morbidity worldwide. Such diseases require careful monitoring to effectively manage their progression. Artificial intelligence (AI) offers valuable tools for this purpose through its ability to analyse data and identify predictive patterns. This review evaluated the application of AI in cardiac and neurological diseases for their clinical impact on the general population. We reviewed studies on the application of AI in the neurological and cardiological fields. Our search was performed on the PubMed, Web of Science, Embase and Cochrane library databases. Of the initial 5862 studies, 23 studies met the inclusion criteria. The studies showed that the most commonly used algorithms in these clinical fields are Random Forest and Artificial Neural Network, followed by logistic regression and Support-Vector Machines. In addition, an ECG-AI algorithm based on convolutional neural networks has been developed and has been widely used in several studies for the detection of atrial fibrillation with good accuracy. AI has great potential to support physicians in interpretation, diagnosis, risk assessment and disease management. [ABSTRACT FROM AUTHOR]

The past few years have seen an emergence of interest in examining the significance of machine learning (ML) in the medical field. Diseases, health emergencies, and medical disorders may now be identified with greater accuracy because of technological advancements and advances in ML. It is essential especially to diagnose individuals with chronic diseases (CD) as early as possible. Our study has focused on analyzing ML's applicability to predict CD, including cardiovascular disease, diabetes, cancer, liver, and neurological disorders. This study offered a high-level summary of the previous research on ML-based approaches for predicting CD and some instances of their applications. To wrap things up, we compared the results obtained by various studies and the methodologies as well as tools employed by the researchers. The factors or parameters that are responsible for improving the accuracy of the predicting model for different previous works are also identified. For identifying significant features, most of the authors employed a variety of strategies, where least absolute shrinkage and selection (LASSO), minimal-redundancy-maximum-relevance (mRMR), and RELIEF are extensively used methods. It is seen that a wide range of ML approaches, including support vector machine (SVM), random forest (RF), decision tree (DT), naïve Bayes (NB), etc., have been widely used. Also, several deep learning techniques and hybrid models are employed to create CD prediction models, resulting in efficient and reliable clinical decision-making models. For the benefit of the whole healthcare system, we have also offered our suggestions for enhancing the prediction results of CD. [ABSTRACT FROM AUTHOR]

To overcome critical issues in landslide susceptibility modeling, a multifactor landslide susceptibility prediction model based on deep belief networks (DBN) with optimized learning rate control (LRC-DBN) was introduced in this study. The LRC-DBN model was applied to predict landslide susceptibility in Zhidan County, Shaanxi and its performance was compared against random forest, support vector machine and logistic regression models. The results show that the LRC-DBN model achieves a maximum AUC value of 0.941, which demonstrating higher predictive performance. The interpretability of LRC-DBN reveals that the development of loess landslides is more likely in areas with elevations ranging from 894.7 m to 998.5 m, slopes ranging from 49.6° to 64°, terrain undulations spanning 31.7 m to 91.0 m, rock type T3y and terrain humidity ranging from 2.4 to 3.9. The result provides invaluable insights for local landslide prevention endeavors and can assist decision-making in urban planning. [ABSTRACT FROM AUTHOR]

Non-neural machine learning (ML) and deep learning (DL) are used to predict system failures in industrial maintenance. However, only a few studies have assessed the effect of varying the amount of past data used to make a prediction and the extension in the future of the forecast. This study evaluates the impact of the size of the reading window and of the prediction window on the performances of models trained to forecast failures in three datasets of (1) an industrial wrapping machine working in discrete sessions, (2) an industrial blood refrigerator working continuously, and (3) a nitrogen generator working continuously. A binary classification task assigns the positive label to the prediction window based on the probability of a failure to occur in such an interval. Six algorithms (logistic regression, random forest, support vector machine, LSTM, ConvLSTM, and Transformers) are compared on multivariate time series. The dimension of the prediction windows plays a crucial role and the results highlight the effectiveness of DL approaches in classifying data with diverse time-dependent patterns preceding a failure and the effectiveness of ML approaches in classifying similar and repetitive patterns preceding a failure. [ABSTRACT FROM AUTHOR]

Stroke is a high morbidity and mortality disease that poses a serious threat to people's health. Early recognition of the various warning signs of stroke is necessary so that timely clinical intervention can help reduce the severity of stroke. Deep neural networks have powerful feature representation capabilities and can automatically learn discriminant features from large amounts of data. This paper uses a range of physiological characteristic parameters and collaborates with deep neural networks, such as the Wasserstein generative adversarial networks with gradient penalty and regression network, to construct a stroke prediction model. Firstly, to address the problem of imbalance between positive and negative samples in the stroke public data set, we performed positive sample data augmentation and utilized WGAN‐GP to generate stroke data with high fidelity and used it for the training of the prediction network model. Then, the relationship between observable physiological characteristic parameters and the predicted risk of suffering a stroke was modeled as a nonlinear mapping transformation, and a stroke prediction model based on a deep regression network was designed. Finally, the proposed method is compared with commonly used machine learning‐based classification algorithms such as decision tree, random forest, support vector machine, and artificial neural networks. The prediction results of the proposed method are optimal in the comprehensive measurement index F. Further ablation experiments also show that the designed prediction model has certain robustness and can effectively predict stroke diseases. [ABSTRACT FROM AUTHOR]

Automated disease diagnosis and prediction, powered by AI, play a crucial role in enabling medical professionals to deliver effective care to patients. While such predictive tools have been extensively explored in resource-rich languages like English, this manuscript focuses on predicting disease categories automatically from symptoms documented in the Afaan Oromo language, employing various classification algorithms. This study encompasses machine learning techniques such as support vector machines, random forests, logistic regression, and Naïve Bayes, as well as deep learning approaches including LSTM, GRU, and Bi-LSTM. Due to the unavailability of a standard corpus, we prepared three data sets with different numbers of patient symptoms arranged into 10 categories. The two feature representations, TF-IDF and word embedding, were employed. The performance of the proposed methodology has been evaluated using accuracy, recall, precision, and F1 score. The experimental results show that, among machine learning models, the SVM model using TF-IDF had the highest accuracy and F1 score of 94.7%, while the LSTM model using word2vec embedding showed an accuracy rate of 95.7% and F1 score of 96.0% from deep learning models. To enhance the optimal performance of each model, several hyper-parameter tuning settings were used. This study shows that the LSTM model verifies to be the best of all the other models over the entire dataset. [ABSTRACT FROM AUTHOR]

In this paper, we introduce a novel approach to address the dynamic prediction of customer activity in electronic payment transactions for individual clients. Our approach is founded on customer online payment transaction records from registered UK-based online retailers between 01/12/2009 and 09/12/2011. These retailers primarily specialize in unique gift items for various occasions, catering to a wide range of clients, including wholesalers. We used classification analysis based on the correlation coefficient to measure and describe a customer's electronic payment capability based on the quality of products they purchase. Furthermore, we trained multi-layered models (linear model, deep learning, random forest, and support vector machines (SVM)) to capture the dynamics of e-bank transaction reinforcement for retail customers using machine learning. Real transaction data from a UK online retailer was employed in our study. The experimental results consistently demonstrated the effectiveness of our proposed strategy. [ABSTRACT FROM AUTHOR]

This study delves into the intricate realm of recognizing handwritten Arabic characters, specifically targeting children's script. Given the inherent complexities of the Arabic script, encompassing semi-cursive styles, distinct character forms based on position, and the inclusion of diacritical marks, the domain demands specialized attention. While prior research has largely concentrated on adult handwriting, the spotlight here is on children's handwritten Arabic characters, an area marked by its distinct challenges, such as variations in writing quality and increased distortions. To this end, we introduce a novel dataset, "Dhad", refined for enhanced quality and quantity. Our investigation employs a tri-fold experimental approach, encompassing the exploration of pre-trained deep learning models (i.e., MobileNet, ResNet50, and DenseNet121), custom-designed Convolutional Neural Network (CNN) architecture, and traditional classifiers (i.e., Support Vector Machine (SVM), Random Forest (RF), and Multilayer Perceptron (MLP)), leveraging deep visual features. The results illuminate the efficacy of fine-tuned pre-existing models, the potential of custom CNN designs, and the intricacies associated with disjointed classification paradigms. The pre-trained model MobileNet achieved the best test accuracy of 93.59% on the Dhad dataset. Additionally, as a conceptual proposal, we introduce the idea of a computer application designed specifically for children aged 7–12, aimed at improving Arabic handwriting skills. Our concluding reflections emphasize the need for nuanced dataset curation, advanced model architectures, and cohesive training strategies to navigate the multifaceted challenges of Arabic character recognition. [ABSTRACT FROM AUTHOR]

Developing a fast and non-destructive methodology to identify the storage years of Coix seed is important in safeguarding consumer well-being. This study employed the utilization of hyperspectral imaging (HSI) in conjunction with conventional machine learning techniques such as support vector machines (SVM), k-nearest neighbors (KNN), random forest (RF), extreme gradient boosting (XGBoost), as well as the deep learning method of residual neural network (ResNet), to establish identification models for Coix seed samples from different storage years. Under the fusion-based modeling approach, the model's classification accuracy surpasses that of visible to near infrared (VNIR) and short-wave infrared (SWIR) spectral modeling individually. The classification accuracy of the ResNet model and SVM exceeds that of other conventional machine learning models (KNN, RF, and XGBoost). Redundant variables were further diminished through competitive adaptive reweighted sampling feature wavelength screening, which had less impact on the model's accuracy. Upon validating the model's performance using an external validation set, the ResNet model yielded more satisfactory outcomes, exhibiting recognition accuracy exceeding 85%. In conclusion, the comprehensive results demonstrate that the integration of deep learning with HSI techniques effectively distinguishes Coix seed samples from different storage years. [ABSTRACT FROM AUTHOR]

A smart grid is a modern power system that allows for bidirectional communication, driven mostly by the idea of demand responsiveness. Predicting the stability of the smart grid is necessary for improving its dependability and maximizing the efficacy and regularity of electricity delivery. Predicting smart grid stability is difficult owing to the various elements that impact it, including consumer and producer engagement, which may contribute to smart grid stability. This research work proposes machine learning (ML) and deep learning (DL) approaches for predicting smart grid sustainability. Five ML algorithms, namely support vector machine (SVM), decision tree (DT), K-nearest neighbor (KNN), random forest (RF), and logistic regression (LR), were applied for the prediction of smart grid stability. Later, the stacking ensemble and voting ensemble of ML algorithms were also applied for prediction. To further increase accuracy, a novel fusion model with DL artifical neural networks (ANN) and ML SVM was applied and achieved an accuracy of 98.92%. The experiment results show that the proposed model outperformed existing models for smart grid stability prediction. [ABSTRACT FROM AUTHOR]

Objective: This research addresses the challenges of maintaining proper yoga postures, an issue that has been exacerbated by the COVID-19 pandemic and the subsequent shift to virtual platforms for yoga instruction. This research aims to develop a mechanism for detecting correct yoga poses and providing real-time feedback through the application of computer vision and machine learning (ML) techniques. Methods and Procedures: This study utilized computer vision-based pose estimation methods to extract features and calculate yoga pose angles. A variety of models, including extremely randomized trees, logistic regression, random forest, gradient boosting, extreme gradient boosting, and deep neural networks, were trained and tested to classify yoga poses. Our study employed the Yoga-82 dataset, consisting of many yoga pose images downloaded from the web. Results: The results of this study show that the extremely randomized trees model outperformed the other models, achieving the highest prediction accuracy of 91% on the test dataset and 92% in a fivefold cross-validation experiment. Other models like random forest, gradient boosting, extreme gradient boosting, and deep neural networks achieved accuracies of 90%, 89%, 90%, and 85%, respectively, while logistic regression underperformed, having the lowest accuracy. Conclusion: This research concludes that the extremely randomized trees model presents superior predictive power for yoga pose recognition. This suggests a valuable avenue for future exploration in this domain. Moreover, the approach has significant potential for implementation on low-powered smartphones with minimal latency, thereby enabling real-time feedback for users practicing yoga at home. [ABSTRACT FROM AUTHOR]

Mental well-being is critical to an individual's health and quality of life. It encompasses emotional, psychological, and social dimensions, making it a complex and multifaceted construct. Traditionally, assessing and forecasting mental well-being has relied on self-report measures, clinical evaluations, and surveys, which can be subjective, time-consuming, and limited scope. To overcome these drawbacks and offer more precise and timely insights into mental well-being, this study presents a novel approach that uses the power of machine learning. This has been achieved by creating a comprehensive dataset containing various variables relevant to mental health. These variables include behavioral traits like exercise routines, sleep patterns, and social interactions and psychological traits like mood, stress levels, and emotional states. Environmental factors, such as geographic location, climate, and accessibility to mental health care, are also considered. A comprehensive understanding of the elements affecting mental well-being is made possible by this diversified dataset. The data is analyzed using machine learning models, such as deep learning neural networks, support vector machines, and random forests. These models were selected since they can capture intricate correlations and patterns in data, making them suitable for forecasting mental health. [ABSTRACT FROM AUTHOR]

Pressure injury (PI), or local damage to soft tissues and skin caused by prolonged pressure, remains controversial in the medical world. Patients in intensive care units (ICUs) were frequently reported to suffer PIs, with a heavy burden on their life and expenditures. Machine learning (ML) is a Section of artificial intelligence (AI) that has emerged in nursing practice and is increasingly used for diagnosis, complications, prognosis, and recurrence prediction. This study aims to investigate hospital‐acquired PI (HAPI) risk predictions in ICU based on a ML algorithm by R programming language analysis. The former evidence was gathered through PRISMA guidelines. The logical analysis was applied via an R programming language. ML algorithms based on usage rate included logistic regression (LR), Random Forest (RF), Distributed tree (DT), Artificial neural networks (ANN), SVM (Support Vector Machine), Batch normalisation (BN), GB (Gradient Boosting), expectation–maximisation (EM), Adaptive Boosting (AdaBoost), and Extreme Gradient Boosting (XGBoost). Six cases were related to risk predictions of HAPI in the ICU based on an ML algorithm from seven obtained studies, and one study was associated with the Detection of PI risk. Also, the most estimated risksSerum Albumin, Lack of Activity, mechanical ventilation (MV), partial pressure of oxygen (PaO2), Surgery, Cardiovascular adequacy, ICU stay, Vasopressor, Consciousness, Skin integrity, Recovery Unit, insulin and oral antidiabetic (INS&OAD), Complete blood count (CBC), acute physiology and chronic health evaluation (APACHE) II score, Spontaneous bacterial peritonitis (SBP), Steroid, Demineralized Bone Matrix (DBM), Braden score, Faecal incontinence, Serum Creatinine (SCr) and age. In sum, HAPI prediction and PI risk detection are two significant areas for using ML in PI analysis. Also, the current data showed that the ML algorithm, including LR and RF, could be regarded as the practical platform for developing AI tools for diagnosing, prognosis, and treating PI in hospital units, especially ICU. [ABSTRACT FROM AUTHOR]

This article describes a comparison of the pixel-based classification methods used to distinguish ice from other land cover types. The article focuses on processing RGB imagery, as these are very easy to obtained. The imagery was taken using UAVs and has a very high spatial resolution. Classical classification methods (ISODATA and Maximum Likelihood) and more modern approaches (support vector machines, random forests, deep learning) have been compared for image data classifications. Input datasets were created from two distinct areas: The Pond Skříň and the Baroch Nature Reserve. The images were classified into two classes: ice and all other land cover types. The accuracy of each classification was verified using a Cohen's Kappa coefficient, with reference values obtained via manual surface identification. Deep learning and Maximum Likelihood were the best classifiers, with a classification accuracy of over 92% in the first area of interest. On average, the support vector machine was the best classifier for both areas of interest. A comparison of the selected methods, which were applied to highly detailed RGB images obtained with UAVs, demonstrates the potential of their utilization compared to imagery obtained using satellites or aerial technologies for remote sensing. [ABSTRACT FROM AUTHOR]

Inertial measurement units (IMU) are widely used in sports applications to digitise human motion by measuring acceleration and rotational velocity in three-dimensional space. A common machine learning problem is the classification of human motion primitives from IMU data. In order to investigate the classification methods used in the existing literature and to analyse whether and how the time-dependent data structure is considered in the classification process of motion data analysis in sports, a scoping review was conducted. Based on a keyword search, articles from 2010 to 2021 were extracted, and 93 articles were relevant for data extraction. Over- and undersampling of data and data augmentation techniques were rarely used. The classification methods applied can be divided into three main branches: classic machine learning and deep learning models, threshold-based approaches, and dynamic time warping. The most often applied algorithms were support vector machines (SVM), followed by neural networks and k-nearest neighbours. In comparative works, when more than one classifier was applied, random forests, neural networks, boosting models and SVM were found to be the methods that achieved the highest accuracy. If the time-dependent data structure was taken into account, it was incorporated either within the models, for example, by using long-short-term memory models or within the feature calculation step by using rolling windows with an overlap, which was the most common method of considering the time dependency of the IMU data. [ABSTRACT FROM AUTHOR]

Defective wheels pose a significant challenge in railway transportation, impacting operational performance and safety. Excessive traction and braking forces give rise to deviations from the intended conical tread shape, resulting in amplified vibrations and noise. Moreover, these deviations contribute to the accelerated damage of track components. Detecting wheel defects at an early stage is crucial to ensure safe and comfortable operation, as well as to minimize maintenance costs. However, the presence of various vibrations, such as those induced by the track, traction motors, and other rolling stock subsystems, poses a significant challenge for onboard detection techniques. These vibrations create difficulties in accurately identifying wheel defects in real-time during operational activities, often resulting in false alarms. This research paper aims to address this issue by using a hybrid deep learning-based approach for the accurate detection of various types of wheel defects using accelerometer data. The proposed approach aims to enhance wheel defect detection accuracy while considering onboard techniques' cost-effectiveness and efficiency. A realistic simulation model of the railway wheelset is developed to generate a comprehensive dataset. To generate vibration data in various scenarios, the model is simulated for 20 s under different conditions, including one non-faulty scenario and six faulty scenarios. The simulations are conducted at different speeds and track conditions to capture a wide range of operating conditions. Within each simulation iteration, a total of 200,000 data points are generated, providing a comprehensive dataset for analysis and evaluation. The generated data are then utilized to train and evaluate a hybrid deep learning model, employing a multi-layer perceptron (MLP) as a feature extractor and multiple machine learning models (support vector machine, random forest, decision tree, and k-nearest neighbors) for performance comparison. The results demonstrate that the MLP-RF (multi-layer perceptron with random forest) model achieved an accuracy of 99%, while the MLP-DT (multi-layer perceptron with decision tree) model achieved an accuracy of 98%. These high accuracy values indicate the effectiveness of the models in accurately classifying and predicting the outcomes. The contributions of this research work include the development of a realistic simulation model, the evaluation of sensor layout effectiveness, and the application of deep learning techniques for improved wheel flat detections. [ABSTRACT FROM AUTHOR]

Simple Summary: Breast cancer is one of the leading causes of cancer death among women. Developing machine learning-based diagnosis models receives great attention from researchers and scientists using histopathology images. Deep learning (DL) algorithms automatically extract features from raw data through convolutional operations. The generalization of the DL models' results relies on large datasets, although they eliminate the expert knowledge in the feature extraction stage. This work aimed to compare the performance of the features extracted via deep learning and a knowledge-based approach in breast cancer detection from histopathology images. Cancer develops when a single or a group of cells grows and spreads uncontrollably. Histopathology images are used in cancer diagnosis since they show tissue and cell structures under a microscope. Knowledge-based and deep learning-based computer-aided detection is an ongoing research field in cancer diagnosis using histopathology images. Feature extraction is vital in both approaches since the feature set is fed to a classifier and determines the performance. This paper evaluates three feature extraction methods and their performance in breast cancer diagnosis. Features are extracted by (1) a Convolutional Neural Network, (2) a transfer learning architecture VGG16, and (3) a knowledge-based system. The feature sets are tested by seven classifiers, including Neural Network (64 units), Random Forest, Multilayer Perceptron, Decision Tree, Support Vector Machines, K-Nearest Neighbors, and Narrow Neural Network (10 units) on the BreakHis 400× image dataset. The CNN achieved up to 85% for the Neural Network and Random Forest, the VGG16 method achieved up to 86% for the Neural Network, and the knowledge-based features achieved up to 98% for Neural Network, Random Forest, Multilayer Perceptron classifiers. [ABSTRACT FROM AUTHOR]

Particulate matter (PM) in the air can cause various health problems and diseases in humans. In particular, the smaller size of PM 2.5 enable them to penetrate deep into the lungs, causing severe health impacts. Exposure to PM 2.5 can result in respiratory, cardiovascular, and allergic diseases, and prolonged exposure has also been linked to an increased risk of cancer, including lung cancer. Therefore, forecasting the PM 2.5 concentration in the surrounding is crucial for preventing these adverse health effects. This paper proposes a method for forecasting the PM 2.5 concentration after 1 h using bidirectional long short-term memory (Bi-LSTM). The proposed method involves selecting input variables based on the feature importance calculated by random forest, classifying the data to assign weight variables to reduce bias, and forecasting the PM 2.5 concentration using Bi-LSTM. To compare the performance of the proposed method, two case studies were conducted. First, a comparison of forecasting performance according to preprocessing. Second, forecasting performance between deep learning (long short-term memory, gated recurrent unit, and Bi-LSTM) and conventional machine learning models (multi-layer perceptron, support vector machine, decision tree, and random forest). In case study 1, The proposed method shows that the performance indices (RMSE: 3.98%p, MAE: 5.87%p, RRMSE: 3.96%p, and R 2 :0.72%p) are improved because weights are given according to the input variables before the forecasting is performed. In case study 2, we show that Bi-LSTM, which considers both directions (forward and backward), can effectively forecast when compared to conventional models (RMSE: 2.70, MAE: 0.84, RRMSE: 1.97, R 2 : 0.16). Therefore, it is shown that the proposed method can effectively forecast PM 2.5 even if the data in the high-concentration section is insufficient. [ABSTRACT FROM AUTHOR]

Cybersecurity has become one of the focuses of organisations. The number of cyberattacks keeps increasing as Internet usage continues to grow. As new types of cyberattacks continue to emerge, researchers focus on developing machine learning (ML)-based intrusion detection systems (IDS) to detect zero-day attacks. They usually remove some or all attack samples from the training dataset and only include them in the testing dataset when evaluating the performance. This method may detect unknown attacks; however, it does not reflect the long-term performance of the IDS as it only shows the changes in the type of attacks. In this work, we focused on evaluating the long-term performance of ML-based IDS. To achieve this goal, we proposed evaluating the ML-based IDS using a dataset created later than the training dataset. The proposed method can better assess the long-term performance as the testing dataset reflects the changes in the attack type and network infrastructure changes over time. We have implemented six of the most popular ML models, including decision tree (DT), random forest (RF), support vector machine (SVM), naïve Bayes (NB), artificial neural network (ANN), and deep neural network (DNN). These models are trained and tested with a pair of datasets with symmetrical classes. Our experiments using the CIC-IDS2017 and the CSE-CIC-IDS2018 datasets show that SVM and ANN are most resistant to overfitting. Our experiments also indicate that DT and RF suffer the most from overfitting, although they perform well on the training dataset. On the other hand, our experiments using the LUFlow dataset have shown that all models can perform well when the difference between the training and testing datasets is small. [ABSTRACT FROM AUTHOR]

The coronavirus is considered this century’s most disruptive catastrophe and global concern. This disease has prompted extreme social, psychological and economic impacts affecting millions of people around the globe. COVID-19 is transmitted from one infected person’s body to another through respiratory droplets. This virus proliferates when people breathe in air-contaminated space with droplets and microscopic airborne particles. This research aims to analyze automatic COVID-19 detection using machine learning techniques to build an intelligent web application. The dataset has been preprocessed by dropping null values, feature engineering, and synthetic oversampling (SMOTE) techniques. Next, we trained and evaluated different classifiers, i.e., logistic regression, random forest, decision tree, k-nearest neighbor, support vector machine (SVM), ensemble models (adaptive boosting and extreme gradient boosting) and deep learning (artificial neural network, convolutional neural network and long short-term memory) techniques. Explainable AI with the LIME framework has been applied to interpret the prediction results. The hybrid CNN-LSTM algorithm with the SMOTE approach performed better than the other models on the employed open-source dataset obtained from the Israeli Ministry of Health website, with 96.34% accuracy and a 0.98 F1 score. Finally, this model was chosen to deploy the proposed prediction system to a website, where users may acquire an instantaneous COVID-19 prognosis based on their symptoms. [ABSTRACT FROM AUTHOR]

Among the different contactless techniques for medical diagnosis, hyperspectral imaging has gained relevance due to the high accuracy in tissues classification. Several techniques have been proposed to elaborate these images, ranging from traditional machine learning methods to deep learning algorithms. This paper evaluates three popular machine learning methods, namely Support Vector Machine (SVM), Random Forest (RF) and eXtreme Gradient Boosting (XGBoost) considering a dataset of hyperspectral skin cancer images. The study demonstrates that the proposed algorithms are suitable for medical hyperspectral data classification, particularly when considering a small dataset. [ABSTRACT FROM AUTHOR]

With the recent growth of the Internet, the volume of data has also increased. In particular, the increase in the amount of unstructured data makes it difficult to manage data. Classification is also needed in order to be able to use the data for various purposes. Since it is difficult to manually classify the ever-increasing volume data for the purpose of various types of analysis and evaluation, automatic classification methods are needed. In addition, the performance of imbalanced and multi-class classification is a challenging task. As the number of classes increases, so does the number of decision boundaries a learning algorithm has to solve. Therefore, in this paper, an improvement model is proposed using WordNet lexical ontology and BERT to perform deeper learning on the features of text, thereby improving the classification effect of the model. It was observed that classification success increased when using WordNet 11 general lexicographer files based on synthesis sets, syntactic categories, and logical groupings. WordNet was used for feature dimension reduction. In experimental studies, word embedding methods were used without dimension reduction. Afterwards, Random Forest (RF), Support Vector Machine (SVM) and Multi-Layer Perceptron (MLP) algorithms were employed to perform classification. These studies were then repeated with dimension reduction performed by WordNet. In addition to the machine learning model, experiments were also conducted with the pretrained BERT model with and without WordNet. The experimental results showed that, on an unstructured, seven-class, imbalanced dataset, the highest accuracy value of 93.77% was obtained when using our proposed model. [ABSTRACT FROM AUTHOR]

The increase in the number of undesired SMS termed smishing message and the data imbalance problem has generated a great demand for the development of more reliable anti‐spam filters. State of the art machine learning approaches are being employed to recognize and separate spam messages. Most recent studies target message classification by using numerous properties and features of the words but fail to consider the circumstantial features like long‐range dependencies between the words that are extremely important in identifying smishing messages. The idea is to develop an intelligent model that will distinguish between smishing messages and ham messages, by adopting a combined approach of regular expression (Regex), machine learning (ML) and deep learning (DL) models. Regex rules are generated using the dataset's spam messages for the purpose of refining the dataset. Support vector machine (SVM), Multinomial Naive Bayes and Random Forest are included under machine learning models and long short‐term memory (LSTM), bidirectional long short‐term memory (Bi‐LSTM), stacked LSTM and stacked Bi‐LSTM are included under deep learning models. The comparison between machine learning models and deep learning models is also carried out based on the performance evaluation parameters namely accuracy, precision, recall and F1 score of the models. It is observed that deep learning models perform better than machine learning models and the introduction of a regular expression to the dataset increases the efficiency of both the deep learning models and machine learning models. [ABSTRACT FROM AUTHOR]

Crime is hard to anticipate since it occurs at random and can occur anywhere at any moment, making it a difficult issue for any society to address. By analyzing and comparing eight known prediction models: Naive Bayes, Stacking, Random Forest, Lazy:IBK, Bagging, Support Vector Machine, Convolutional Neural Network, and Locally Weighted Learning - this study proposed an improved deep learning crime prediction model using convolutional neural networks and the xgboost algorithm to predict crime. The major goal of this research is to provide an improved crime prediction model based on previous criminal records. Using the Boston crime dataset, where our larceny crime dataset was extracted, exploratory data analysis (EDA) is used to uncover patterns and explain trends in crimes. The performance of the proposed model on the basis of accuracy, recall, and f-measure was 100% outperforming the other models used in this study. The analysis of the proposed model and prediction can aid security services in making better use of their resources, anticipating crime at a certain time, and serving the society better. [ABSTRACT FROM AUTHOR]

Traditional Chinese medicine (TCM) has been practiced for thousands of years with clinical efficacy. Natural products and their effective agents such as artemisinin and paclitaxel have saved millions of lives worldwide. Artificial intelligence is being increasingly deployed in TCM. By summarizing the principles and processes of deep learning and traditional machine learning algorithms, analyzing the application of machine learning in TCM, reviewing the results of previous studies, this study proposed a promising future perspective based on the combination of machine learning, TCM theory, chemical compositions of natural products, and computational simulations based on molecules and chemical compositions. In the first place, machine learning will be utilized in the effective chemical components of natural products to target the pathological molecules of the disease which could achieve the purpose of screening the natural products on the basis of the pathological mechanisms they target. In this approach, computational simulations will be used for processing the data for effective chemical components, generating datasets for analyzing features. In the next step, machine learning will be used to analyze the datasets on the basis of TCM theories such as the superposition of syndrome elements. Finally, interdisciplinary natural product-syndrome research will be established by unifying the results of the two steps outlined above, potentially realizing an intelligent artificial intelligence diagnosis and treatment model based on the effective chemical components of natural products under the guidance of TCM theory. This perspective outlines an innovative application of machine learning in the clinical practice of TCM based on the investigation of chemical molecules under the guidance of TCM theory. [ABSTRACT FROM AUTHOR]

Drug combinations can be the prime strategy for increasing the initial treatment options in cancer therapy. However, identifying the combinations through experimental approaches is very laborious and costly. Notably, in vitro and/or in vivo examination of all the possible combinations might not be plausible. This study presented a novel computational approach to predicting synergistic drug combinations. Specifically, the deep neural network-based binary classification was utilized to develop the model. Various physicochemical, genomic, protein–protein interaction and protein-metabolite interaction information were used to predict the synergy effects of the combinations of different drugs. The performance of the constructed model was compared with shallow neural network (SNN), k-nearest neighbors (KNN), random forest (RF), support vector machines (SVMs), and gradient boosting classifiers (GBC). Based on our findings, the proposed deep neural network model was found to be capable of predicting synergistic drug combinations with high accuracy. The prediction accuracy and AUC metrics for this model were 92.21% and 97.32% in tenfold cross-validation. According to the results, the integration of different types of physicochemical and genomics features leads to more accurate prediction of synergy in cancer drugs. [ABSTRACT FROM AUTHOR]

Apples damaged by black root mold (BRM) lose moisture, vitamins, and minerals as well as carry dangerous toxins. Determination of the infection degree can allow for customized use of apples, reduce financial losses, and ensure food safety. In this study, red-green-blue (RGB) imaging and hyperspectral imaging (HSI) are combined to detect the infection degree of BRM in apple fruits. First, RGB and HSI images of healthy, mildly, moderately, and severely infected fruits are measured, and those with effective wavelengths (EWs) are screened from HSI by random frog. Second, the statistic and network features of images are extracted by using color moment and convolutional neural network. Meanwhile, random forest (RF), K-nearest neighbor, and support vector machine are used to construct classification models with the above two features of RGB and HSI images of EWs. Optimal results with the 100% accuracy of training set and 96% accuracy of prediction set are obtained by RF with the statistic and network features of the two images, outperforming the other cases. The proposed method furnishes an accurate and effective solution for determining the BRM infection degree in apples. [ABSTRACT FROM AUTHOR]

The numerical simulation and slope stability prediction are the focus of slope disaster research. Recently, machine learning models are commonly used in the slope stability prediction. However, these machine learning models have some problems, such as poor nonlinear performance, local optimum and incomplete factors feature extraction. These issues can affect the accuracy of slope stability prediction. Therefore, a deep learning algorithm called Long short-term memory (LSTM) has been innovatively proposed to predict slope stability. Taking the Ganzhou City in China as the study area, the landslide inventory and their characteristics of geotechnical parameters, slope height and slope angle are analyzed. Based on these characteristics, typical soil slopes are constructed using the Geo-Studio software. Five control factors affecting slope stability, including slope height, slope angle, internal friction angle, cohesion and volumetric weight, are selected to form different slope and construct model input variables. Then, the limit equilibrium method is used to calculate the stability coefficients of these typical soil slopes under different control factors. Each slope stability coefficient and its corresponding control factors is a slope sample. As a result, a total of 2160 training samples and 450 testing samples are constructed. These sample sets are imported into LSTM for modelling and compared with the support vector machine (SVM), random forest (RF) and convolutional neural network (CNN). The results show that the LSTM overcomes the problem that the commonly used machine learning models have difficulty extracting global features. Furthermore, LSTM has a better prediction performance for slope stability compared to SVM, RF and CNN models. [ABSTRACT FROM AUTHOR]

Objective: We aimed to develop a robust framework to model the complex association between clinical features and traumatic brain injury (TBI) risk in children under age two, and identify significant features to derive clinical decision rules for triage decisions. Methods: In this retrospective study, four frequently used machine learning models, i.e., support vector machine (SVM), random forest (RF), deep neural network (DNN), and XGBoost (XGB), were compared to identify significant clinical features from 24 input features associated with the TBI risk in children under age two under the permutation feature importance test (PermFIT) framework by using the publicly available data set from the Pediatric Emergency Care Applied Research Network (PECARN) study. The prediction accuracy was determined by comparing the predicted TBI status with the computed tomography (CT) scan results since CT scan is the gold standard for diagnosing TBI. Results: At a significance level of p = 0.05 , DNN, RF, XGB, and SVM identified 9, 1, 2, and 4 significant features, respectively. In a comparison of accuracy (Accuracy), the area under the curve (AUC), and the precision-recall area under the curve (PR-AUC), the permutation feature importance test for DNN model was the most powerful framework for identifying significant features and outperformed other methods, i.e., RF, XGB, and SVM, with Accuracy, AUC, and PR-AUC as 0.915, 0.794, and 0.974, respectively. Conclusion: These results indicate that the PermFIT-DNN framework robustly identifies significant clinical features associated with TBI status and improves prediction performance. The findings could be used to inform the development of clinical decision tools designed to inform triage decisions. [ABSTRACT FROM AUTHOR]

Uncertainty in renewable energy generation, energy consumption, and electricity prices, as well as transmission congestion, pose a number of problems in modern power grids, necessitating stability on the supply, grid, and demand sides. Grid‐side stability can be achieved by dynamic line rating (DLR) forecasting, which reliably predicts the overall current carrying potential of overhead transmission lines. Long short‐term memory proved beneficiary in this field, owing to its ability to learn highly variable and uncertain data. To empower this network to tackle the non‐stationary nature of meteorological parameters, a novel machine learning (ML) architecture based on Dagging technique is proposed and tested on the data collected from a 400 kV overhead transmission line. Simulation results corroborate that the proposed Dagging‐based stacked LSTM can successfully handle the non‐stationary issue and outperform the decomposition‐based technique, as the state‐of‐the‐art algorithm, for various forecasting horizons. The results confirm the generalizability of models with an application in forecasting DLR over the line without utilizing additional sensors and communication networks. Moreover, the proposed model is compared to several ML architectures, including support vector machines (SVM), random forest (RF), and multi‐layer perceptron (MLP) in a comprehensive benchmark study. The introduced algorithm outperforms MLP by 3.4%, RF by 9.4%, and SVM by 6.7% in terms of average prediction accuracy. [ABSTRACT FROM AUTHOR]

Copyright of Journal of Computer Sciences Institute is the property of Lublin University of Technology and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

The earlier prediction of heart diseases and appropriate treatment are important for preventing cardiac failure complications and reducing the mortality rate. The traditional prediction and classification approaches have resulted in a minimum rate of prediction accuracy and hence to overcome the pitfalls in existing systems, the present research is aimed to perform the prediction of heart diseases with quantum learning. When quantum learning is employed in ML (Machine Learning) and DL (Deep Learning) algorithms, complex data can be performed efficiently with less time and a higher accuracy rate. Moreover, the proposed ML and DL algorithms possess the ability to adapt to predictions with alterations in the dataset integrated with quantum computing that provides robustness in the earlier detection of chronic diseases. The Cleveland heart disease dataset is being pre-processed for the checking of missing values to avoid incorrect predictions and also for improvising the rate of accuracy. Further, SVM (Support Vector Machine), DT (Decision Tree) and RF (Random Forest) are used to perform classification. Finally, disease prediction is performed with the proposed instance-based quantum ML and DL method in which the number of qubits is computed with respect to features and optimized with instance-based learning. Additionally, a comparative assessment is provided for quantifying the differences between the standard classification algorithms with quantum-based learning in order to determine the significance of quantum-based detection in heart failure. From the results, the accuracy of the proposed system using instance-based quantum DL and instance-based quantum ML is found to be 98% and 83.6% respectively. [ABSTRACT FROM AUTHOR]

Recently, it has proven difficult to make an immediate remote diagnosis of any coronary illness, including heart disease, diabetes, etc. The drawbacks of cloud computing infrastructures, such as excessive latency, bandwidth, energy consumption, security, and privacy concerns, have lately been addressed by Fog computing with IoT applications. In this study, an IoT-Fog-Cloud integrated system, called a Fog-empowered framework for real-time analysis in heart patients using ENsemble Deep learning (FRIEND), has been introduced that can instantaneously facilitate remote diagnosis of heart patients. The proposed system was trained on the combined dataset of Long-Beach, Cleveland, Switzerland, and Hungarian heart disease datasets. We first tested the model with eight basic ML approaches, including the decision tree, logistic regression, random forest, naive Bayes, k-nearest neighbors, support vector machine, AdaBoost, and XGBoost approaches, and then applied ensemble methods including bagging classifiers, weighted averaging, and soft and hard voting to achieve enhanced outcomes and a deep neural network, a deep learning approach, with the ensemble methods. These models were validated using 16 performance and 9 network parameters to justify this work. The accuracy, PPV, TPR, TNR, and F1 scores of the experiments reached 94.27%, 97.59%, 96.09%, 75.44%, and 96.83%, respectively, which were comparatively higher when the deep neural network was assembled with bagging and hard-voting classifiers. The user-friendliness and the inclusion of Fog computing principles, instantaneous remote cardiac patient diagnosis, low latency, and low energy consumption, etc., are advantages confirmed according to the achieved experimental results. [ABSTRACT FROM AUTHOR]

Industrial refrigeration systems typically exhibit a higher energy consumption rate compared to other systems. It is a very important system, and for the brewing industry, it is at the heart of brewing as, in each process, the temperature of the beer must be controlled. Therefore, a health monitoring or faults detection system is a necessary tool for predictive and preventive maintenance to avoid faults in the system. This work presents machine learning models for faults prediction of the refrigeration system in a brewing firm. The raw data of processing parameters are collected, while the system health for each data set is identified and used for machine learning model training. Three operation cases based on the actual operation of the brewery's refrigeration system are analyzed in this work. Several machine learning models including Naïve Bayes (NB), Generalized Linear Models (GLMs), Logistic Regression (LR), Fast Large Margin (FLM), Deep Learning (DL), Decision Tree (DT), Random Forest (RF), Gradient Boosted Trees (GBT), and Support Vector Machine (SVM) are applied for refrigeration system fault detection in the three operation cases while their performances are investigated. The numerical simulation is performed based on RapidMiner Studio. According to the experiment of the three operation cases, the deep learning model was found to be the most accurate and required the least amount of time for the analysis. The accuracy percentages are 86.7%, 90.2%, and 82.5%, while the running times are 15 seconds, 27 seconds, and 15 seconds, respectively. This work can be considered as the baseline for future studies on applied machine learning models for fault detection in refrigeration systems. [ABSTRACT FROM AUTHOR]

Introduction: Medical tourism, one of the most profitable industries, has been growing rapidly in recent years. Especially Turkey, which has a high ranking among medical travel destinations, has some advantages that can become preferable for international patients. This study is among the first few studies which examine affecting factors in patients' medical travel destination choices with Data Mining techniques. Methods: The data were obtained from patients who came to Ankara from abroad for treatment in May 2015 through a question-naire. Cross-industry Standard Process for data mining, known as the CRISP-DM method, is used in this study. After cleaning out the missing data, the models were created using classification algorithms. Results: Models including Generalized Linear Model, Deep Learning, Decision Tree, Random Forest, Gradient Boosted Trees, and Support Vector Machine (SVM) were compared, and SVM reached the best performance with 0.2% Relative Error, 0.014 Root Mean Squared Error and 0.998 Correlation. As a result of the SVM model, effective attributes in patients' satisfaction level include low price advantage, advertisement, doctors with high-quality education, trained assistant staff, relatives living in Turkey, and high technology of medical equipment, respectively. Conclusion: Special attention should be paid to these factors in developing plans and policies for the health tourism sector. However, the importance of related socio-demographic variables was indicated in detail. Eventually, some suggestions were presented to improve the weaknesses in the health tourism sector. [ABSTRACT FROM AUTHOR]

The portable executable header (PEH) information is commonly used as a feature for malware detection systems to train and validate machine learning (ML) or deep learning (DL) classifiers. We propose to extract the deep features from the PEH information through hidden layers of a feed-forward deep neural network (FFDNN). The extraction of deep features of hidden layers represents the dataset with a better generalization for malware detection. While feeding the deep feature of one hidden layer to the succeeding layer, the Gaussian error linear unit (GeLU) activation function is applied. The FFDNN is trained with the GeLU activation function using the deep features of individual layers as well as concatenated deep features of all hidden layers. Similarly, the ML classifiers are also trained and validated in with individual layer deep features and concatenated features. Three highly effective ML classifiers, random forest (RF), support vector machine (SVM), and k-nearest neighbour (k-NN) have been investigated. The performance of the proposed model is demonstrated using a statically significant large dataset. The obtained results are interesting and encouraging in terms of classification accuracy. The classification accuracy reaches 99.15% with the internal discriminative deep feature for the proposed FFDNN-ML classifier with the GeLU activation function. [ABSTRACT FROM AUTHOR]

Airborne hyperspectral data has high spectral-spatial information. However, how to mine and use this information effectively is still a great challenge. Recently, a three-dimensional convolutional neural network (3D-CNN) provides a new effective way of hyperspectral classification. However, its capability of data mining in complex urban areas, especially in cloud shadow areas has not been validated. Therefore, a 3D-1D-CNN model was proposed for feature extraction in complex urban with hyperspectral images affected by cloud shadows. Firstly, spectral composition parameters, vegetation index, and texture characteristics were extracted from hyperspectral data. Secondly, the parameters were fused and segmented into many S × S × B patches which would be input into a 3D-CNN classifier for feature extraction in complex urban areas. Thirdly, Support Vector Machine (SVM), Random Forest (RF),1D-CNN, 3D-CNN, and 3D-2D-CNN classifiers were also carried out for comparison. Finally, a confusion matrix and Kappa coefficient were calculated for accuracy assessment. The overall accuracy of the proposed 3D-1D-CNN is 96.32%, which is 23.96%, 11.02%, 5.22%, and 0.42%, much higher than that of SVM, RF, 1D-CNN, or 3D-CNN, respectively. The results indicated that 3D-1D-CNN could mine spatial-spectral information from hyperspectral data effectively, especially that of grass and highway in cloud shadow areas with missing spectral information. In the future, 3D-1D-CNN could also be used for the extraction of urban green spaces. [ABSTRACT FROM AUTHOR]

Background: Cardiovascular diseases (CVDs) are a leading cause of death worldwide. Deep learning methods have been widely used in the field of medical image analysis and have shown promising results in the diagnosis of CVDs. Methods: Experiments were performed on 12-lead electrocardiogram (ECG) databases collected by Chapman University and Shaoxing People's Hospital. The ECG signal of each lead was converted into a scalogram image and an ECG grayscale image and used to fine-tune the pretrained ResNet-50 model of each lead. The ResNet-50 model was used as a base learner for the stacking ensemble method. Logistic regression, support vector machine, random forest, and XGBoost were used as a meta learner by combining the predictions of the base learner. The study introduced a method called multi-modal stacking ensemble, which involves training a meta learner through a stacking ensemble that combines predictions from two modalities: scalogram images and ECG grayscale images. Results: The multi-modal stacking ensemble with a combination of ResNet-50 and logistic regression achieved an AUC of 0.995, an accuracy of 93.97%, a sensitivity of 0.940, a precision of 0.937, and an F1-score of 0.936, which are higher than those of LSTM, BiLSTM, individual base learners, simple averaging ensemble, and single-modal stacking ensemble methods. Conclusion: The proposed multi-modal stacking ensemble approach showed effectiveness for diagnosing CVDs. [ABSTRACT FROM AUTHOR]

Seismic activity prediction has been a challenging research domain: in this regard, accurate prediction using historical data is an intricate task. Numerous machine learning and traditional approaches have been presented lately for seismic activity prediction; however, no generalizable model exists. In this work, we consider seismic activity predication as a binary classification problem, and propose a deep neural network architecture for the classification problem, using historical data from Chile, Hindukush, and Southern California. After obtaining the data for the three regions, a data cleaning process was used, which was followed by a feature engineering step, to create multiple new features based on various seismic laws. Afterwards, the proposed model was trained on the data, for improved prediction of the seismic activity. The performance of the proposed model was evaluated and compared with extant techniques, such as random forest, support vector machine, and logistic regression. The proposed model achieved accuracy scores of 98.28%, 95.13%, and 99.29% on the Chile, Hindukush, and Southern California datasets, respectively, which were higher than the current benchmark model and classifiers. In addition, we also conducted out-sample testing, where the evaluation metrics confirmed the generality of our proposed approach. [ABSTRACT FROM AUTHOR]

Because of the complexity, nonlinearity, and volatility, stock market forecasting is either highly difficult or yields very unsatisfactory outcomes when utilizing traditional time series or machine learning techniques. To cope with this problem and improve the complex stock market's prediction accuracy, we propose a new hybrid novel method that is based on a new version of EMD and a deep learning technique known as long-short memory (LSTM) network. The forecasting precision of the proposed hybrid ensemble method is evaluated using the KSE-100 index of the Pakistan Stock Exchange. Using a new version of EMD that uses the Akima spline interpolation technique instead of cubic spline interpolation, the noisy stock data are first divided into multiple components technically known as intrinsic mode functions (IMFs) varying from high to low frequency and a single monotone residue. The highly correlated sub-components are then used to build the LSTM network. By comparing the proposed hybrid model with a single LSTM and other ensemble models such as the support vector machine (SVM), Random Forest, and Decision Tree, its prediction performance is thoroughly evaluated. Three alternative statistical metrics, namely root means square error (RMSE), mean absolute error (MAE) and mean absolute percentage error (MAPE), are used to compare the aforementioned techniques. The empirical results show that the suggested hybrid Akima-EMD-LSTM model beats all other models taken into consideration for this study and is therefore recommended as an effective model for the prediction of non-stationary and nonlinear complex financial time series data. [ABSTRACT FROM AUTHOR]

Diabetes mellitus presents a high prevalence around the world. A common and long-term derived complication is diabetic foot ulcers (DFUs), which have a global prevalence of roughly 6.3%, and a lifetime incidence of up to 34%. Infrared thermograms, covering the entire plantar aspect of both feet, can be employed to monitor the risk of developing a foot ulcer, because diabetic patients exhibit an abnormal pattern that may indicate a foot disorder. In this study, the publicly available INAOE dataset composed of thermogram images of healthy and diabetic subjects was employed to extract relevant features aiming to establish a set of state-of-the-art features that efficiently classify DFU. This database was extended and balanced by fusing it with private local thermograms from healthy volunteers and generating synthetic data via synthetic minority oversampling technique (SMOTE). State-of-the-art features were extracted using two classical approaches, LASSO and random forest, as well as two variational deep learning (DL)-based ones: concrete and variational dropout. Then, the most relevant features were detected and ranked. Subsequently, the extracted features were employed to classify subjects at risk of developing an ulcer using as reference a support vector machine (SVM) classifier with a fixed hyperparameter configuration to evaluate the robustness of the selected features. The new set of features extracted considerably differed from those currently considered state-of-the-art but provided a fair performance. Among the implemented extraction approaches, the variational DL ones, particularly the concrete dropout, performed the best, reporting an F1 score of 90% using the aforementioned SVM classifier. In comparison with features previously considered as the state-of-the-art, approximately 15% better performance was achieved for classification. [ABSTRACT FROM AUTHOR]

Deep learning has drawn great attention in the financial field due to its powerful ability in nonlinear fitting, especially in the studies of asset pricing. In this paper, we proposed a long short-term memory option pricing model with realized skewness by fully considering the asymmetry of asset return in emerging markets. It was applied to price the ETF50 options of China. In order to emphasize the improvement of this model, a comparison with a parametric method, such as Black-Scholes (BS), and machine learning methods, such as support vector machine (SVM), random forests and recurrent neural network (RNN), was conducted. Moreover, we also took the characteristic of heavy tail into consideration and studied the effect of realized kurtosis on pricing to prove the robustness of the skewness. The empirical results indicate that realized skewness significantly improves the pricing performance of LSTM among moneyness states except for in-the-money call options. Specifically, the LSTM model with realized skewness outperforms the classical method and other machine learning methods in all metrics. [ABSTRACT FROM AUTHOR]

MicroRNA (miRNA)–target interaction (MTI) plays a substantial role in various cell activities, molecular regulations and physiological processes. Published biomedical literature is the carrier of high-confidence MTI knowledge. However, digging out this knowledge in an efficient manner from large-scale published articles remains challenging. To address this issue, we were motivated to construct a deep learning-based model. We applied the pre-trained language models to biomedical text to obtain the representation, and subsequently fed them into a deep neural network with gate mechanism layers and a fully connected layer for the extraction of MTI information sentences. Performances of the proposed models were evaluated using two datasets constructed on the basis of text data obtained from miRTarBase. The validation and test results revealed that incorporating both PubMedBERT and SciBERT for sentence level encoding with the long short-term memory (LSTM)-based deep neural network can yield an outstanding performance, with both F1 and accuracy being higher than 80% on validation data and test data. Additionally, the proposed deep learning method outperformed the following machine learning methods: random forest, support vector machine, logistic regression and bidirectional LSTM. This work would greatly facilitate studies on MTI analysis and regulations. It is anticipated that this work can assist in large-scale screening of miRNAs, thereby revealing their functional roles in various diseases, which is important for the development of highly specific drugs with fewer side effects. Source code and corpus are publicly available at https://github.com/qi29. [ABSTRACT FROM AUTHOR]

This study proposed a comprehensive approach that utilized PlanetScope imagery for classifying tropical-marine benthic habitats after retrieving bathymetry from ICESat-2 data and water-column correction for areas around Lyson Islands, Vietnam. Exact bathymetry derivation and water column correction were applied to the PlanetScope imagery, making it an effective method for mapping marine benthic habitats. Water column correction was achieved by applying Depth Invariant Index (DII) and Bottom Reflectance Index (BRI). Moreover, two conventional machine learning algorithms, including Random Forest and Support Vector Machine, and a current deep Convolutional Neural Network (CNN) was employed to classify the benthic features. The overall accuracy of these classifiers are 80.74%, 84.19%, and 89.80% with the BRI, 80.17%, 82.75%, and 87.85% with the DII compared to 37.64%, 42.5%, and 47.2% of without corrected water columns respectively. The CNN model demonstrated that the approach significantly maximizes the improvement in benthic classification results in coastal region. [ABSTRACT FROM AUTHOR]