Search

Genomic selection (GS) can accomplish breeding faster than phenotypic selection. Improving prediction accuracy is the key to promoting GS. To improve the GS prediction accuracy and stability, we introduce parallel convolution to deep learning for GS and call it a parallel neural network for genomic selection (PNNGS). In PNNGS, information passes through convolutions of different kernel sizes in parallel. The convolutions in each branch are connected with residuals. Four different Lp loss functions train PNNGS. Through experiments, the optimal number of parallel paths for rice, sunflower, wheat, and maize is found to be 4, 6, 4, and 3, respectively. Phenotype prediction is performed on 24 cases through ridge-regression best linear unbiased prediction (RRBLUP), random forests (RF), support vector regression (SVR), deep neural network genomic prediction (DNNGP), and PNNGS. Serial DNNGP and parallel PNNGS outperform the other three algorithms. On average, PNNGS prediction accuracy is 0.031 larger than DNNGP prediction accuracy, indicating that parallelism can improve the GS model. Plants are divided into clusters through principal component analysis (PCA) and K-means clustering algorithms. The sample sizes of different clusters vary greatly, indicating that this is unbalanced data. Through stratified sampling, the prediction stability and accuracy of PNNGS are improved. When the training samples are reduced in small clusters, the prediction accuracy of PNNGS decreases significantly. Increasing the sample size of small clusters is critical to improving the prediction accuracy of GS. [ABSTRACT FROM AUTHOR]

Detecting clouds, snow, and lakes in remote sensing images is vital due to their propensity to obscure underlying surface information and hinder data extraction. In this study, we utilize Sentinel-2 images to implement a two-stage random forest (RF) algorithm for image labeling and delve into the factors influencing neural network performance across six aspects: model architecture, encoder, learning rate adjustment strategy, loss function, input image size, and different band combinations. Our findings indicate the Feature Pyramid Network (FPN) achieved the highest MIoU of 87.14%. The multi-head self-attention mechanism was less effective compared to convolutional methods for feature extraction with small datasets. Incorporating residual connections into convolutional blocks notably enhanced performance. Additionally, employing false-color images (bands 12-3-2) yielded a 4.86% improvement in MIoU compared to true-color images (bands 4-3-2). Notably, variations in model architecture, encoder structure, and input band combination had a substantial impact on performance, with parameter variations resulting in MIoU differences exceeding 5%. These results provide a reference for high-precision segmentation of clouds, snow, and lakes and offer valuable insights for applying deep learning techniques to the high-precision extraction of information from remote sensing images, thereby advancing research in deep neural networks for semantic segmentation. [ABSTRACT FROM AUTHOR]

Skin cancer diagnosis greatly benefits from advanced machine learning techniques, particularly fine-tuned deep learning models. In our research, we explored the impact of traditional machine learning and fine-tuned deep learning approaches on prediction accuracy. Our findings reveal significant improvements in predictability and accuracy with fine-tuning, particularly evident in deep learning models. The CNN, SVM, and Random Forest Classifier achieved high accuracy. However, fine-tuned deep learning models such as EfficientNetB0, ResNet34, VGG16, Inception _v3, and DenseNet121 demonstrated superior performance. To ensure comparability, we fine-tuned these models by incorporating additional layers, including one flatten layer and three densely interconnected layers. These layers play a crucial role in enhancing model efficiency and performance. The flatten layer preprocesses multidimensional feature maps, facilitating efficient information flow, while subsequent dense layers refine feature representations, capturing intricate patterns and relationships within the data. Leveraging LeakyReLU activation functions in the dense layers mitigates the vanishing gradient problem and promotes stable training. Finally, the output dense layer with a sigmoid activation function simplifies decision making for healthcare professionals by providing binary classification output. Our study underscores the significance of incorporating additional layers in fine-tuned neural network models for skin cancer classification, offering improved accuracy and reliability in diagnosis. [ABSTRACT FROM AUTHOR]

Predicting phase stability in high entropy alloys (HEAs), such as phase fractions as functions of composition and temperature, is essential for understanding alloy properties and screening desirable materials. Traditional methods like CALPHAD are computationally intensive for exploring high-dimensional compositional spaces. To address such a challenge, this study explored and compared the effectiveness of random forests (RF) and deep neural networks (DNN) for accelerating materials discovery by building surrogate models of phase stability prediction. For interpolation scenarios (testing on the same order of system as trained), RF models generally produce smaller errors than DNN models. However, for extrapolation scenarios (training on lower-order systems and testing on higher order systems), DNNs generalize more effectively than traditional ML models. DNN demonstrate the potential to predict topologically relevant phase composition when data were missing, making it a powerful predictive tool in materials discovery frameworks. The study uses a CALPHAD dataset of 480 million data points generated from a custom database, available for further model development and benchmarking. Experiments show that DNN models are data-efficient, achieving similar performance with a fraction of the dataset. This work highlights the potential of DNNs in materials discovery, providing a powerful tool for predicting phase stability in HEAs, particularly within the Cr-Hf-Mo-Nb-Ta-Ti-V-W-Zr composition space. [ABSTRACT FROM AUTHOR]

BACKGROUND: The field of toxicology has witnessed substantial advancements in recent years, particularly with the adoption of new approach methodologies (NAMs) to understand and predict chemical toxicity. Class-based methods such as clustering and classification are key to NAMs development and application, aiding the understanding of hazard and risk concerns associated with groups of chemicals without additional laboratory work. Advances in computational chemistry, data generation and availability, and machine learning algorithms represent important opportunities for continued improvement of these techniques to optimize their utility for specific regulatory and research purposes. However, due to their intricacy, deep understanding and careful selection are imperative to align the adequate methods with their intended applications. OBJECTIVES: This commentary aims to deepen the understanding of class-based approaches by elucidating the pivotal role of chemical similarity (structural and biological) in clustering and classification approaches (CCAs). It addresses the dichotomy between general end point–agnostic similarity, often entailing unsupervised analysis, and end point–specific similarity necessitating supervised learning. The goal is to highlight the nuances of these approaches, their applications, and common misuses. DISCUSSION: Understanding similarity is pivotal in toxicological research involving CCAs. The effectiveness of these approaches depends on the right definition and measure of similarity, which varies based on context and objectives of the study. This choice is influenced by how chemical structures are represented and the respective labels indicating biological activity, if applicable. The distinction between unsupervised clustering and supervised classification methods is vital, requiring the use of end point–agnostic vs. end point–specific similarity definition. Separate use or combination of these methods requires careful consideration to prevent bias and ensure relevance for the goal of the study. Unsupervised methods use end point– agnostic similarity measures to uncover general structural patterns and relationships, aiding hypothesis generation and facilitating exploration of datasets without the need for predefined labels or explicit guidance. Conversely, supervised techniques demand end point–specific similarity to group chemicals into predefined classes or to train classification models, allowing accurate predictions for new chemicals. Misuse can arise when unsupervised methods are applied to end point–specific contexts, like analog selection in read-across, leading to erroneous conclusions. This commentary provides insights into the significance of similarity and its role in supervised classification and unsupervised clustering approaches. [ABSTRACT FROM AUTHOR]

Marine transportation accounts for approximately 90% of the total trade managed in international logistics and plays a vital role in many companies' supply chains. However, en-route factors like weather conditions or piracy incidents often delay scheduled arrivals at destination ports, leading to downstream inefficiencies. Due to the maritime industry's digital transformation, smart ports and vessels generate vast amounts of data, creating an opportunity to use the latest technologies, like machine and deep learning (ML/DL), to support terminals in their operations. This study proposes a data-driven solution for accurately predicting vessel arrival times using ML/DL techniques, including Deep Neural Networks, K-Nearest Neighbors, Decision Trees, Random Forest, and Extreme Gradient Boosting. This study collects real-world AIS data in the Eastern Mediterranean Sea from a network of public and private AIS base stations. The most relevant features are selected for training and evaluating the six ML/DL models. A comprehensive comparison is also performed against the estimated arrival time provided by shipping agents, a simple calculation-based approach, and four other ML/DL models proposed recently in the literature. The evaluation has revealed that Random Forest achieves the highest performance with an MAE of 99.9 min, closely followed by XGBoost, having an MAE of 105.0 min. [ABSTRACT FROM AUTHOR]

Cardiovascular and neurological diseases are a major cause of mortality and morbidity worldwide. Such diseases require careful monitoring to effectively manage their progression. Artificial intelligence (AI) offers valuable tools for this purpose through its ability to analyse data and identify predictive patterns. This review evaluated the application of AI in cardiac and neurological diseases for their clinical impact on the general population. We reviewed studies on the application of AI in the neurological and cardiological fields. Our search was performed on the PubMed, Web of Science, Embase and Cochrane library databases. Of the initial 5862 studies, 23 studies met the inclusion criteria. The studies showed that the most commonly used algorithms in these clinical fields are Random Forest and Artificial Neural Network, followed by logistic regression and Support-Vector Machines. In addition, an ECG-AI algorithm based on convolutional neural networks has been developed and has been widely used in several studies for the detection of atrial fibrillation with good accuracy. AI has great potential to support physicians in interpretation, diagnosis, risk assessment and disease management. [ABSTRACT FROM AUTHOR]

A complex AI system must be worked offline because the training and execution phases are processed separately. This process often requires different computer resources due to the high model requirements. A limitation of this approach is the convoluted training process that needs to be repeated to obtain models with new data continuously incorporated into the knowledge base. Although the environment may be not static, it is crucial to dynamically train models by integrating new information during execution. In this article, artificial neural networks (ANNs) are developed to predict risk levels in traffic accidents with relatively simpler configurations than a deep learning (DL) model, which is more computationally intensive. The objective is to demonstrate that efficient, fast, and comparable results can be obtained using simple architectures such as that offered by the Radial Basis Function neural network (RBFNN). This work led to the generation of a driving dataset, which was subsequently validated for testing ANN models. The driving dataset simulated the dynamic approach by adding new data to the training on-the-fly, given the constant changes in the drivers' data, vehicle information, environmental conditions, and traffic accidents. This study compares the processing time and performance of a Convolutional Neural Network (CNN), Random Forest (RF), Radial Basis Function (RBF), and Multilayer Perceptron (MLP), using evaluation metrics of accuracy, Specificity, and Sensitivity-recall to recommend an appropriate, simple, and fast ANN architecture that can be implemented in a secure alert traffic system that uses encrypted data. [ABSTRACT FROM AUTHOR]

Machine learning (ML) has been broadly applied for vadose zone applications in recent years. This article provides a comprehensive review of such developments. ML applications for variables corresponding to different complex vadose zone processes are summarized mostly in a prediction context. By analyzing and assessing these applications, we discovered extensive usages of classic ML models with relatively limited applications of deep learning (DL) approaches in general. We also recognized a lack of benchmark datasets for soil property research as well as limited integration of physics‐based vadose zone principles into the ML approaches. To facilitate this interdisciplinary research of ML in vadose zone characterization and processes, a paradigm of knowledge‐guided machine learning is suggested along with other data‐driven and ML model‐based research suggestions to advance future research. Core Ideas: Random forest and artificial neural network are two widely applied machine learning options for predicting vadose zone studies.A benchmark dataset is missing in soil property studies.We suggest vadose zone scientists explore more deep learning options and expand knowledge‐guided machine learning implementations. [ABSTRACT FROM AUTHOR]

Deep random forest (DRF), which combines deep learning and random forest, exhibits comparable accuracy, interpretability, low memory and computational overhead to deep neural networks (DNNs) in edge intelligence tasks. However, efficient DRF accelerator is lagging behind its DNN counterparts. The key to DRF acceleration lies in realizing the branch-split operation at decision nodes. In this work, we propose implementing DRF through associative searches realized with ferroelectric analog content addressable memory (ACAM). Utilizing only two ferroelectric field effect transistors (FeFETs), the ultra-compact ACAM cell performs energy-efficient branch-split operations by storing decision boundaries as analog polarization states in FeFETs. The DRF accelerator architecture and its model mapping to ACAM arrays are presented. The functionality, characteristics, and scalability of the FeFET ACAM DRF and its robustness against FeFET device non-idealities are validated in experiments and simulations. Evaluations show that the FeFET ACAM DRF accelerator achieves ~106x/10x and ~106x/2.5x improvements in energy and latency, respectively, compared to other DRF hardware implementations on state-of-the-art CPU/ReRAM. [ABSTRACT FROM AUTHOR]

Stroke is a high morbidity and mortality disease that poses a serious threat to people's health. Early recognition of the various warning signs of stroke is necessary so that timely clinical intervention can help reduce the severity of stroke. Deep neural networks have powerful feature representation capabilities and can automatically learn discriminant features from large amounts of data. This paper uses a range of physiological characteristic parameters and collaborates with deep neural networks, such as the Wasserstein generative adversarial networks with gradient penalty and regression network, to construct a stroke prediction model. Firstly, to address the problem of imbalance between positive and negative samples in the stroke public data set, we performed positive sample data augmentation and utilized WGAN‐GP to generate stroke data with high fidelity and used it for the training of the prediction network model. Then, the relationship between observable physiological characteristic parameters and the predicted risk of suffering a stroke was modeled as a nonlinear mapping transformation, and a stroke prediction model based on a deep regression network was designed. Finally, the proposed method is compared with commonly used machine learning‐based classification algorithms such as decision tree, random forest, support vector machine, and artificial neural networks. The prediction results of the proposed method are optimal in the comprehensive measurement index F. Further ablation experiments also show that the designed prediction model has certain robustness and can effectively predict stroke diseases. [ABSTRACT FROM AUTHOR]

As the application of large language models (LLMs) has broadened into the realm of biological predictions, leveraging their capacity for self-supervised learning to create feature representations of amino acid sequences, these models have set a new benchmark in tackling downstream challenges, such as subcellular localization. However, previous studies have primarily focused on either the structural design of models or differing strategies for fine-tuning, largely overlooking investigations into the nature of the features derived from LLMs. In this research, we propose different ESM2 representation extraction strategies, considering both the character type and position within the ESM2 input sequence. Using model dimensionality reduction, predictive analysis and interpretability techniques, we have illuminated potential associations between diverse feature types and specific subcellular localizations. Particularly, the prediction of Mitochondrion and Golgi apparatus prefer segments feature closer to the N-terminal, and phosphorylation site-based features could mirror phosphorylation properties. We also evaluate the prediction performance and interpretability robustness of Random Forest and Deep Neural Networks with varied feature inputs. This work offers novel insights into maximizing LLMs' utility, understanding their mechanisms, and extracting biological domain knowledge. Furthermore, we have made the code, feature extraction API, and all relevant materials available at https://github.com/yujuan-zhang/feature-representation-for-LLMs. [ABSTRACT FROM AUTHOR]

Cybersecurity threats, particularly spam SMS, are increasingly sophisticated, demanding more advanced detection systems. Traditional spam detection methods fall short due to their ineffectiveness against novel threats and lack of transparency. This paper investigates the role of Explainable Artificial Intelligence (XAI) in spam detection, emphasizing the interpretability of AI-driven systems through SHapley Additive explanations (SHAP). We propose a hybrid model combining BERT with Random Forest (RF) and Artificial Neural Networks (ANN) for spam detection, and employ SHAP values to elucidate the decision-making process. The study demonstrates that our XAI approach not only improves the accuracy of spam detection but also enhances the transparency and trustworthiness of the predictions. These findings suggest that the incorporation of XAI into spam detection models is not only beneficial but necessary for future cybersecurity measures. Our research invites further exploration into other XAI techniques and their applications in real-world scenarios. [ABSTRACT FROM AUTHOR]

Objective: This research addresses the challenges of maintaining proper yoga postures, an issue that has been exacerbated by the COVID-19 pandemic and the subsequent shift to virtual platforms for yoga instruction. This research aims to develop a mechanism for detecting correct yoga poses and providing real-time feedback through the application of computer vision and machine learning (ML) techniques. Methods and Procedures: This study utilized computer vision-based pose estimation methods to extract features and calculate yoga pose angles. A variety of models, including extremely randomized trees, logistic regression, random forest, gradient boosting, extreme gradient boosting, and deep neural networks, were trained and tested to classify yoga poses. Our study employed the Yoga-82 dataset, consisting of many yoga pose images downloaded from the web. Results: The results of this study show that the extremely randomized trees model outperformed the other models, achieving the highest prediction accuracy of 91% on the test dataset and 92% in a fivefold cross-validation experiment. Other models like random forest, gradient boosting, extreme gradient boosting, and deep neural networks achieved accuracies of 90%, 89%, 90%, and 85%, respectively, while logistic regression underperformed, having the lowest accuracy. Conclusion: This research concludes that the extremely randomized trees model presents superior predictive power for yoga pose recognition. This suggests a valuable avenue for future exploration in this domain. Moreover, the approach has significant potential for implementation on low-powered smartphones with minimal latency, thereby enabling real-time feedback for users practicing yoga at home. [ABSTRACT FROM AUTHOR]

Ionospheric sporadic E layers (Es) are intense plasma irregularities between 80 and 130 km in altitude and are generally unpredictable. Reconstructing the morphology of sporadic E layers is not only essential for understanding the nature of ionospheric irregularities and many other atmospheric coupling systems, but is also useful for solving a broad range of demands for reliable radio communication of many sectors reliant on ionosphere-dependent decision-making. Despite the efforts of many empirical and theoretical models, a predictive algorithm with both high accuracy and high efficiency is still lacking. Here we introduce a new approach for Sporadic E Layer Forecast using Artificial Neural Networks (SELF-ANN). The prediction engine is trained by fusing observational data from multiple sources, including a high-resolution ERA5 reanalysis dataset, Constellation Observing System for Meteorology, Ionosphere, and Climate (COSMIC) radio occultation (RO) measurements, and integrated data from OMNIWeb. The results show that the model can effectively reconstruct the morphology of the ionospheric E layer with intraseasonal variability by learning complex patterns. The model obtains good performance and generalization capability by applying multiple evaluation criteria. The random forest algorithm used for preliminary processing shows that local time, altitude, longitude, and latitude are significantly essential for forecasting the E-layer region. Extensive evaluations based on ground-based observations demonstrate the superior utility of the model in dealing with unknown information. The presented framework will help us better understand the nature of the ionospheric irregularities, which is a fundamental challenge in upper-atmospheric and ionospheric physics. Moreover, the proposed SELF-ANN can make a significant contribution to the development of the prediction of ionospheric irregularities in the E layer, particularly when the formation mechanisms and evolution processes of the Es layer are not well understood. [ABSTRACT FROM AUTHOR]

Identifying areas with high groundwater spring potential is crucial as it enables better decision-making concerning water supply, sustainable development, and the protection of sensitive ecosystems; therefore, it is necessary to predict the groundwater spring potential with highly accurate models. This study aims to assess and compare the effectiveness of deep neural networks (DeepNNs) and swarm-optimized random forests (SwarmRFs) in predicting groundwater spring potential. This study focuses on a case study conducted in the Gia Lai province, located in the Central Highland of Vietnam. To accomplish this objective, a comprehensive groundwater database was compiled, comprising 938 groundwater spring locations and 12 influential variables, namely land use and land cover (LULC), geology, distance to fault, distance to river, rainfall, normalized difference vegetation index (NDVI), normalized difference moisture index (NDMI), normalized difference water index (NDWI), slope, aspect, elevation, and curvature. The DeepNN model was trained and fine-tuned using the Adaptive Moment Estimation (ADAM) optimizer, while the SwarmRF model employed the Harris Hawks Optimizer (HHO) to search for optimal parameters. The results indicate that both the DeepNN model (accuracy = 77.9%, F-score = 0.783, kappa = 0.559, and AUC = 0.820) and the SwarmRF model (accuracy = 80.2%, F-score = 0.798, kappa = 0.605, and AUC = 0.854) exhibit robust predictive capabilities. The SwarmRF model displays a slight advantage over the DeepNN model in terms of performance. Among the 12 influential factors, geology emerges as the most significant determinant of groundwater spring potential. The groundwater spring potential maps generated through this research can offer valuable information for local authorities to facilitate effective water resource management and support sustainable development planning. [ABSTRACT FROM AUTHOR]

The growing concerns surrounding water supply, driven by factors such as population growth and industrialization, have highlighted the need for accurate estimation of streamflow at the river basin level. To achieve this, rainfall-runoff models are widely employed as valuable tools in watershed management. For this specific study, two modelling approaches were employed: the Soil and Water Assessment Tool (SWAT) model and a set of eight artificial intelligence (AI) models. The AI models consisted of seven data-driven approaches, namely k-nearest neighbour regression, support vector regression, linear regression, artificial neural networks, random forest regression, XGBoost, and Histogram-based Gradient Boost regression. Additionally, a deep learning model known as Long Short-Term Memory (LSTM) was also utilized. The study focused on monthly streamflow modelling in the Murredu River basin, with a calibration period from 1999 to 2003 and a validation period from 2004 to 2005, spanning a total of 7 years from 1999 to 2005. The results indicated that all nine models were generally suitable for simulating the rainfall-runoff process, with the LSTM model demonstrating exceptional performance in both the calibration (R2 is 0.97 and NSE is 0.96) and validation (R2 is 0.97 and NSE is 0.92) periods. Its high coefficient of determination (R2) and Nash–Sutcliffe efficiency (NSE) values indicated its superior ability to accurately model the rainfall-runoff relationship. While the other models also produced satisfactory results, the findings suggest that selecting the most efficient model, such as the LSTM model, could significantly contribute to the effective management and planning of sustainable water resources in the Murredu watershed. [ABSTRACT FROM AUTHOR]

Functional and motility-related gastrointestinal (GI) disorders affect nearly 40% percent of the population. Disturbances of GI myoelectric activity have been proposed to play a significant role in these disorders. A significant barrier to usage of these signals in diagnosis and treatment is the lack of consistent relationships between GI myoelectric features and function. A potential cause of this issue is the use of arbitrary classification criteria, such as percentage of power in tachygastric and bradygastric frequency bands. Here we applied automatic feature extraction using a deep neural network architecture on GI myoelectric signals from free-moving ferrets. For each animal, we recorded during baseline control and feeding conditions lasting for 1 h. Data were trained on a 1-dimensional residual convolutional network, followed by a fully connected layer, with a decision based on a sigmoidal output. For this 2-class problem, accuracy was 90%, sensitivity (feeding detection) was 90%, and specificity (baseline detection) was 89%. By comparison, approaches using hand-crafted features (e.g., SVM, random forest, and logistic regression) produced an accuracy from 54% to 82%, sensitivity from 46% to 84% and specificity from 66% to 80%. These results suggest that automatic feature extraction and deep neural networks could be useful to assess GI function for comparing baseline to an active functional GI state, such as feeding. In future testing, the current approach could be applied to determine normal and disease-related GI myoelectric patterns to diagnosis and assess patients with GI disease. [ABSTRACT FROM AUTHOR]

The number of studies in the literature that diagnose cancer with machine learning using genome data is quite limited. These studies focus on the prediction performance, and the extraction of genomic factors that cause disease is often overlooked. However, finding underlying genetic causes is very important in terms of early diagnosis, development of diagnostic kits, preventive medicine, etc. The motivation of our study was to diagnose bladder cancer (BCa) based on genetic data and to reveal underlying genetic factors by using machine-learning models. In addition, conducting hyper-parameter optimization to get the best performance from different models, which is overlooked in most studies, was another objective of the study. Within the framework of these motivations, C4.5, random forest (RF), artificial neural networks (ANN), and deep learning (DL) were used. In this way, the diagnostic performance of decision tree (DT)-based models and black box models on BCa was also compared. The most successful model, DL, yielded an area under the curve (AUC) of 0.985 and a mean square error (MSE) of 0.069. For each model, hyper-parameters were optimized by an evolutionary algorithm. On average, hyper-parameter optimization increased MSE, root mean square error (RMSE), LogLoss, and AUC by 30%, 17.5%, 13%, and 6.75%, respectively. The features causing BCa were extracted. For this purpose, entropy and Gini coefficients were used for DT-based methods, and the Gedeon variable importance was used for black box methods. The single nucleotide polymorphisms (SNPs) rs197412, rs2275928, rs12479919, rs798766 and rs2275928, whose BCa relations were proven in the literature, were found to be closely related to BCa. In addition, rs1994624 and rs2241766 susceptibility loci were proposed to be examined in future studies. [ABSTRACT FROM AUTHOR]

Simple Summary: Breast cancer is one of the leading causes of cancer death among women. Developing machine learning-based diagnosis models receives great attention from researchers and scientists using histopathology images. Deep learning (DL) algorithms automatically extract features from raw data through convolutional operations. The generalization of the DL models' results relies on large datasets, although they eliminate the expert knowledge in the feature extraction stage. This work aimed to compare the performance of the features extracted via deep learning and a knowledge-based approach in breast cancer detection from histopathology images. Cancer develops when a single or a group of cells grows and spreads uncontrollably. Histopathology images are used in cancer diagnosis since they show tissue and cell structures under a microscope. Knowledge-based and deep learning-based computer-aided detection is an ongoing research field in cancer diagnosis using histopathology images. Feature extraction is vital in both approaches since the feature set is fed to a classifier and determines the performance. This paper evaluates three feature extraction methods and their performance in breast cancer diagnosis. Features are extracted by (1) a Convolutional Neural Network, (2) a transfer learning architecture VGG16, and (3) a knowledge-based system. The feature sets are tested by seven classifiers, including Neural Network (64 units), Random Forest, Multilayer Perceptron, Decision Tree, Support Vector Machines, K-Nearest Neighbors, and Narrow Neural Network (10 units) on the BreakHis 400× image dataset. The CNN achieved up to 85% for the Neural Network and Random Forest, the VGG16 method achieved up to 86% for the Neural Network, and the knowledge-based features achieved up to 98% for Neural Network, Random Forest, Multilayer Perceptron classifiers. [ABSTRACT FROM AUTHOR]

As a result of the expansions that have taken place in the field of networking and the increase in the number of users of networks, there have recently been breakthroughs made in the techniques and methods used for network security. In this paper, a virtual private network (VPN) is proposed as a means of providing the necessary level of security for particular connections that span across vast networks. After the network performance metrics such as time delay and throughput have been accomplished, the suggested VPN is recommended for the purpose of assuring network security. In addition, artificial intelligence attack predictors and virtual private networks have been implemented with the purpose of preventing harmful activity within such connections. Using a wide variety of machine learning methods like Random Forests and Nave Bays, malicious assaults of any kind can be identified and thwarted in their tracks. Another technique for anticipating attacks is the use of an artificial neural network, which is a type of system that engages in deep learning and learns the behaviors of attacks while it is being trained so that it can then predict attacks. The results of this study demonstrate that the use of machine learning and artificial intelligence techniques can significantly improve the security and performance of virtual private networks and can effectively identify and prevent malicious attacks on networks. [ABSTRACT FROM AUTHOR]

Traditional Chinese medicine (TCM) has been practiced for thousands of years with clinical efficacy. Natural products and their effective agents such as artemisinin and paclitaxel have saved millions of lives worldwide. Artificial intelligence is being increasingly deployed in TCM. By summarizing the principles and processes of deep learning and traditional machine learning algorithms, analyzing the application of machine learning in TCM, reviewing the results of previous studies, this study proposed a promising future perspective based on the combination of machine learning, TCM theory, chemical compositions of natural products, and computational simulations based on molecules and chemical compositions. In the first place, machine learning will be utilized in the effective chemical components of natural products to target the pathological molecules of the disease which could achieve the purpose of screening the natural products on the basis of the pathological mechanisms they target. In this approach, computational simulations will be used for processing the data for effective chemical components, generating datasets for analyzing features. In the next step, machine learning will be used to analyze the datasets on the basis of TCM theories such as the superposition of syndrome elements. Finally, interdisciplinary natural product-syndrome research will be established by unifying the results of the two steps outlined above, potentially realizing an intelligent artificial intelligence diagnosis and treatment model based on the effective chemical components of natural products under the guidance of TCM theory. This perspective outlines an innovative application of machine learning in the clinical practice of TCM based on the investigation of chemical molecules under the guidance of TCM theory. [ABSTRACT FROM AUTHOR]

For the last 40 years, actigraphy or wearable accelerometry has provided an objective, low-burden and ecologically valid approach to assess real-world sleep and circadian patterns, contributing valuable data to epidemiological and clinical insights on sleep and sleep disorders. The proper use of wearable technology in sleep research requires validated algorithms that can derive sleep outcomes from the sensor data. Since the publication of the first automated scoring algorithm by Webster in 1982, a variety of sleep algorithms have been developed and contributed to sleep research, including many recent ones that leverage machine learning and / or deep learning approaches. However, it remains unclear how these algorithms compare to each other on the same data set and if these modern data science approaches improve the analytical validity of sleep outcomes based on wrist-worn acceleration data. This work provides a systematic evaluation across 8 state-of-the-art sleep algorithms on a common sleep data set with polysomnography (PSG) as ground truth. Despite the inclusion of recently published complex algorithms, simple regression-based and heuristic algorithms demonstrated slightly superior performance in sleep-wake classification and sleep outcome estimation. The performance of complex machine learning and deep learning models seem to suffer from poor generalization. This independent and systematic analytical validation of sleep algorithms provides key evidence on the use of wearable digital health technologies for sleep research and care. [ABSTRACT FROM AUTHOR]

In Mobile Performance Marketing (MPM), monetary compensation only occurs when an advertisement results in a conversion (e.g., sale of a product or service). In this work, we propose an intelligent decision support system (IDSS) to automatically select mobile marketing campaigns for users. The IDSS is based on a computationally efficient mobile user conversion prediction model that assumes a novel Percentage Categorical Pruning (PCP) categorical preprocessing and an online deep multilayer perceptron (MLP) reuse model (MLPr). Using private (nonpublicly available) business MPM data provided by a marketing company, the MLPr model outperformed an offline multilayer perceptron and a logistic regression, obtaining a high quality class discrimination when applied to sampled (85% to 92%) and complete (90% to 94%) data. In addition, the MLPr compared favorably with other machine learning (ML) models (e.g., Random Forest, XGBoost), as well as with other deep neural networks (e.g., diamond shaped). Moreover, we designed two strategies (A — best campaign selection; and B — random selection among the top candidate campaigns) to build the IDSS, in which the predictive deep learning model is used to perform a real-time selection of advertisement campaigns for mobile users. Using recently collected big data (with millions of redirect events) from a worldwide MPM company, we performed a realistic IDSS evaluation that considered three criteria: response time, potential profit and advertiser diversity. Overall, competitive results were achieved by the IDSS B strategy when compared with the current marketing company ad assignment method. [ABSTRACT FROM AUTHOR]

Accurate prediction of postoperative complications can inform shared decisions regarding prognosis, preoperative risk-reduction, and postoperative resource use. We hypothesized that multi-task deep learning models would outperform conventional machine learning models in predicting postoperative complications, and that integrating high-resolution intraoperative physiological time series would result in more granular and personalized health representations that would improve prognostication compared to preoperative predictions. In a longitudinal cohort study of 56,242 patients undergoing 67,481 inpatient surgical procedures at a university medical center, we compared deep learning models with random forests and XGBoost for predicting nine common postoperative complications using preoperative, intraoperative, and perioperative patient data. Our study indicated several significant results across experimental settings that suggest the utility of deep learning for capturing more precise representations of patient health for augmented surgical decision support. Multi-task learning improved efficiency by reducing computational resources without compromising predictive performance. Integrated gradients interpretability mechanisms identified potentially modifiable risk factors for each complication. Monte Carlo dropout methods provided a quantitative measure of prediction uncertainty that has the potential to enhance clinical trust. Multi-task learning, interpretability mechanisms, and uncertainty metrics demonstrated potential to facilitate effective clinical implementation. [ABSTRACT FROM AUTHOR]

Smart meters are key elements of a smart grid. These data from Smart Meters can help us analyze energy consumption behaviour. The machine learning and deep learning approaches can be used for mining the hidden theft detection information in the smart meter data. However, it needs effective data extraction. This research presents a theft detection dataset (TDD2022) and a machine learning-based solution for automated theft identification in a smart grid environment. An effective theft generator is modelled and used for obtaining a multi-class theft detection dataset from publicly available consumer energy consumption data, owned by the "Open Energy Data Initiative" (OEDI) platform. This is an important and interesting phase to explore in the smart grid field. The proposed dataset can be used for benchmarking and comparative studies. We evaluated the proposed dataset using five different machine learning techniques: k-nearest neighbours (KNN), decision trees (DT), random forest (RF), bagging ensemble (BE), and artificial neural networks (ANN) with different evaluation alternatives (mechanisms). Overall, our best empirical results have been recorded to the theft detection-based RF model scoring an improvement in the performance metrics by 10% or more over the other developed models. [ABSTRACT FROM AUTHOR]

Speech Emotion Detection (SER) is a field of identifying human emotions from human speech utterances. Human speech utterances are a combination of linguistic and non-linguistic information. Nonlinguistic SER provides a generalized solution in human-computer interaction applications as it overcomes the language barrier. Machine learning and deep learning techniques were previously proposed for classifying emotions using handpicked features. To achieve effective and generalized SER, feature extraction can be performed using deep neural networks and ensemble learning for classification. The proposed model employed a time-distributed attention-layered convolution neural network (TDACNN) for extracting spatiotemporal features at the first stage and a random forest (RF) classifier, which is an ensemble classifier for efficient and generalized classification of emotions, at the second stage. The proposed model was implemented on the RAVDESS and IEMOCAP data corpora and compared with the CNN-SVM and CNN-RF models for SER. The TDACNN-RF model exhibited test classification accuracies of 92.19 percent and 90.27 percent on the RAVDESS and IEMOCAP data corpora, respectively. The experimental results proved that the proposed model is efficient in extracting spatiotemporal features from time-series speech signals and can classify emotions with good accuracy. The class confusion among the emotions was reduced for both data corpora, proving that the model achieved generalization. [ABSTRACT FROM AUTHOR]

Backgrounds: Traditional Chinese medicine and Western medicine combination (TCM-WMC) increased the complexity of compounds ingested. Objective: To develop a method for screening hepatotoxic compounds in TCM-WMC based on chemical structures using artificial intelligence (AI) methods. Methods: Drug-induced liver injury (DILI) data was collected from the public databases and published literatures. The total dataset formed by DILI data was randomly divided into training set and test set at a ratio of 3:1 approximately. Machine learning models of SGD (Stochastic Gradient Descent), kNN (k-Nearest Neighbor), SVM (Support Vector Machine), NB (Naive Bayes), DT (Decision Tree), RF (Random Forest), ANN (Artificial Neural Network), AdaBoost, LR (Logistic Regression) and one deep learning model (deep belief network, DBN) were adopted to construct models for screening hepatotoxic compounds. Result: Dataset of 2035 hepatotoxic compounds was collected in this research, in which 1505 compounds were as training set and 530 compounds were as test set. Results showed that RF obtained 0.838 of classification accuracy (CA), 0.827 of F1-score, 0.832 of Precision, 0.838 of Recall, 0.814 of area under the curve (AUC) on the training set and 0.767 of CA, 0.731 of F1, 0.739 of Precision, 0.767 of Recall, 0.739 of AUC on the test set, which was better than other eight machine learning methods. The DBN obtained 82.2% accuracy on the test set, which was higher than any other machine learning models on the test set. Conclusion: The DILI AI models were expected to effectively screen hepatotoxic compounds in TCM-WMC. [ABSTRACT FROM AUTHOR]

The increase in people's use of mobile messaging services has led to the spread of social engineering attacks like phishing, considering that spam text is one of the main factors in the dissemination of phishing attacks to steal sensitive data such as credit cards and passwords. In addition, rumors and incorrect medical information regarding the COVID-19 pandemic are widely shared on social media leading to people's fear and confusion. Thus, filtering spam content is vital to reduce risks and threats. Previous studies relied on machine learning and deep learning approaches for spam classification, but these approaches have two limitations. Machine learning models require manual feature engineering, whereas deep neural networks require a high computational cost. This paper introduces a dynamic deep ensemble model for spam detection that adjusts its complexity and extracts features automatically. The proposed model utilizes convolutional and pooling layers for feature extraction along with base classifiers such as random forests and extremely randomized trees for classifying texts into spam or legitimate ones. Moreover, the model employs ensemble learning procedures like boosting and bagging. As a result, the model achieved high precision, recall, f1-score and accuracy of 98.38%. [ABSTRACT FROM AUTHOR]

Patient-centered communication (PCC) quality is critical to increasing the quality of patient-centered care. Based on the nationally representative data of the Health Information National Trends Survey (HINTS) 2019–2020 (N = 4593), this study combined four machine learning methods, namely, Generalized Linear Models (GLM), Random Forests (Random Forests), Deep Neural Networks (Deep Learning), and Gradient Boosting Machines (GBM), to identify important PCC predictors through variable importance metrics. Fifteen variables were identified as important predictors, involving multiple dimensions, such as individual sociodemographic characteristics, health-related factors, and individual living habits. Among them, four novel potential associated variables are included, an individual's level of verbal expression, exercise habits, etc., which significantly impacted respondents' perceived PCC quality. This study revealed the value of combining feature selection with machine learning approaches to identify broad variables that could enhance PCC prediction and clinical decision-making, influence future PCC prediction research, and improve patient-centered care. In the future, other easy-to-interpret models can be combined to conduct further research on the impact direction and mechanism of important predictors on PCC. [ABSTRACT FROM AUTHOR]

Liver transplantation outcomes have improved in recent years. However, with the emergence of expanded donor criteria, tools to better assist donor–recipient matching have become necessary. Most of the currently proposed scores based on conventional biostatistics are not good classifiers of a problem that is considered "unbalanced." In recent years, the implementation of artificial intelligence in medicine has experienced exponential growth. Deep learning, a branch of artificial intelligence, may be the answer to this classification problem. The ability to handle a large number of variables with speed, objectivity, and multi-objective analysis is one of its advantages. Artificial neural networks and random forests have been the most widely used deep classifiers in this field. This review aims to give a brief overview of D–R matching and its evolution in recent years and how artificial intelligence may be able to provide a solution. [ABSTRACT FROM AUTHOR]

This paper introduces AlphaVision, an innovative decision support model designed for stock price prediction by seamlessly integrating real-time news updates and Return on Investment (ROI) values, utilizing various machine learning and deep learning approaches. The research investigates the application of these techniques to enhance the effectiveness of stock trading and investment decisions by accurately anticipating stock prices and providing valuable insights to investors and businesses. The study begins by analyzing the complexities and challenges of stock market analysis, considering factors like political, macroeconomic, and legal issues that contribute to market volatility. To address these challenges, we proposed the methodology called AlphaVision, which incorporates various machine learning algorithms, including Decision Trees, Random Forest, Naïve Bayes, Boosting, K-Nearest Neighbors, and Support Vector Machine, alongside deep learning models such as Multi-layer Perceptron (MLP), Artificial Neural Networks, and Recurrent Neural Networks. The effectiveness of each model is evaluated based on their accuracy in predicting stock prices. Experimental results revealed that the MLP model achieved the highest accuracy of approximately 92%, outperforming other deep learning models. The Random Forest algorithm also demonstrated promising results with an accuracy of around 84.6%. These findings indicate the potential of machine learning and deep learning techniques in improving stock market analysis and prediction. The AlphaVision methodology presented in this research empowers investors and businesses with valuable tools to make informed investment decisions and navigate the complexities of the stock market. By accurately forecasting stock prices based on news updates and ROI values, the model contributes to better financial management and business sustainability. The integration of machine learning and deep learning approaches offers a promising solution for enhancing stock market analysis and prediction. Future research will focus on extracting more relevant financial features to further improve the model’s accuracy. By advancing decision support models for stock price prediction, researchers and practitioners can foster better investment strategies and foster economic growth. The proposed model holds potential to revolutionize stock trading and investment practices, enabling more informed and profitable decision-making in the financial sector. [ABSTRACT FROM AUTHOR]

Classification of isolated digits is the basic challenge for many speech classification systems. While a lot of work has been carried out on spoken languages, only limited research work on spoken English digit data has been reported in the literature. The paper proposes an intelligent-based system based on deep feedforward neural network (DFNN) with hyperparameter optimization techniques, an ensemble method; random forest (RF), and a regression method; gradient boosting (GB) for the classification of spoken digit data. The paper investigates different machine learning (ML) algorithms to determine the best method for the classification of spoken English digit data. The DFNN classifier outperformed the RF and GB classifiers on the public benchmark spoken English digit data and achieved 99.65% validation accuracy. The outcome of the proposed model performs better compared to existing models with only traditional classifiers. [ABSTRACT FROM AUTHOR]

Background: Alzheimer’s disease (AD) is the most common form of dementia in old age and poses a severe threat to the health and life of the elderly. However, traditional diagnostic methods and the ATN diagnostic framework have limitations in clinical practice. Developing novel biomarkers and diagnostic models is necessary to complement existing diagnostic procedures. Methods: The AD expression profile dataset GSE63060 was downloaded from the NCBI GEO public database for preprocessing. AD-related differentially expressed genes were screened using a weighted co-expression network and differential expression analysis, and functional enrichment analysis was performed. Subsequently, we screened hub genes by random forest, analyzed the correlation between hub genes and immune cells using ssGSEA, and finally built an AD diagnostic model using an artificial neural network and validated it. Results: Based on the random forest algorithm, we screened a total of seven hub genes from AD-related DEGs, based on which we confirmed that hub genes play an essential role in the immune microenvironment and successfully established a novel diagnostic model for AD using artificial neural networks, and validated its effectiveness in the publicly available datasets GSE63060 and GSE97760. Conclusion: Our study establishes a reliable model for screening and diagnosing AD that provides a theoretical basis for adding diagnostic biomarkers for the AD gene. [ABSTRACT FROM AUTHOR]

Genetic data have become increasingly complex within the past decade, leading researchers to pursue increasingly complex questions, such as those involving epistatic interactions and protein prediction. Traditional methods are ill-suited to answer these questions, but machine learning (ML) techniques offer an alternative solution. ML algorithms are commonly used in genetics to predict or classify subjects, but some methods evaluate which features (variables) are responsible for creating a good prediction; this is called feature importance. This is critical in genetics, as researchers are often interested in which features (e.g., SNP genotype or environmental exposure) are responsible for a good prediction. This allows for the deeper analysis beyond simple prediction, including the determination of risk factors associated with a given phenotype. Feature importance further permits the researcher to peer inside the black box of many ML algorithms to see how they work and which features are critical in informing a good prediction. This review focuses on ML methods that provide feature importance metrics for the analysis of genetic data. Five major categories of ML algorithms: k nearest neighbors, artificial neural networks, deep learning, support vector machines, and random forests are described. The review ends with a discussion of how to choose the best machine for a data set. This review will be particularly useful for genetic researchers looking to use ML methods to answer questions beyond basic prediction and classification. [ABSTRACT FROM AUTHOR]

A data-enhanced deep greedy optimization (DEDGO) algorithm is proposed to achieve the efficient and on-demand inverse design of multiple transition metal dichalcogenides (TMDC)-photonic cavity-integrated heterojunctions operating in the strong coupling regime. Precisely, five types of photonic cavities with different geometrical parameters are employed to alter the optical properties of monolayer TMDC, aiming at discovering new and intriguing physics associated with the strong coupling effect. Notably, the traditional rigorous coupled wave analysis (RCWA) approach is utilized to generate a relatively small training dataset for the DEDGO algorithm. Importantly, one remarkable feature of DEDGO is the integration the decision theory of reinforcement learning, which remedies the deficiencies of previous research that focused more on modeling over decision making, increasing the success rate of inverse prediction. Specifically, an iterative optimization strategy, namely, deep greedy optimization, is implemented to improve the performance. In addition, a data enhancement method is also employed in DEDGO to address the dependence on a large amount of training data. The accuracy and effectiveness of the DEDGO algorithm are confirmed to be much higher than those of the random forest algorithm and deep neural network, making possible the replacement of the time-consuming conventional scanning optimization method with the DEDGO algorithm. This research thoroughly describes the universality, interpretability, and excellent performance of the DEDGO algorithm in exploring the underlying physics of TMDC-cavity heterojunctions, laying the foundations for the on-demand inverse design of low-dimensional material-based nano-devices. [ABSTRACT FROM AUTHOR]

Previous evidence suggests that temperature is associated with the number of emergency department (ED) visits. A predictive system for ED visits, which takes local temperature into account, is therefore needed. This study aimed to compare the predictive performance of various machine learning methods with traditional statistical methods based on temperature variables and develop a daily ED attendance rate predictive model for Hong Kong. We analyzed ED utilization among Hong Kong older adults in May to September from 2000 to 2016. A total of 103 potential predictors were derived from 1- to 14-day lag of ED attendance rate and meteorological and air quality indicators and 0-day lag of holiday indicator and month and day of week indicators. LASSO regression was used to identify the most predictive temperature variables. Decision tree regressor, support vector machine (SVM) regressor, and random forest regressor were trained on the selected optimal predictor combination. Deep neural network (DNN) and gated recurrent unit (GRU) models were performed on the extended predictor combination for the previous 14-day horizon. Maximum ambient temperature was identified as a better predictor in its own value than as an indicator defined by the cutoff. GRU achieved the best predictive accuracy. Deep learning methods, especially the GRU model, outperformed conventional machine learning methods and traditional statistical methods. [ABSTRACT FROM AUTHOR]

Annual monitoring of the spatial distribution of cultivated land is important for maintaining the ecological environment, achieving a status quo of land resource management, and guaranteeing agricultural production. With the gradual development of remote sensing technology, it has become a common practice to obtain cultivated land boundary information on a large scale with the help of satellite Earth observation images. Traditional land use classification methods are affected by multiple types of land cover, which leads to a decrease in the accuracy of cultivated land mapping. In contrast, although the current advanced methods (such as deep learning) can obtain more accurate cultivated land mapping results than traditional methods, such methods often require the use of a massive amount of training samples, large computing power, and highly complex model tuning processes, increasing the cost of mapping and requiring the involvement of more professionals. This has hindered the promotion of related methods in mapping institutions. This paper proposes a method based on time series vector features (MTVF), which uses vector thinking to establish the features. The advantage of this method is that the introduction of vector features enlarges the differences between the different land cover types, which overcomes the loss of mapping accuracy caused by the influences of the spectra of different ground objects and ensures the calculation efficiency. Moreover, the MTVF uses a traditional method (random forest) as the classification core, which makes the MTVF less demanding than advanced methods in terms of the number of training samples. Sentinel-2 satellite images were used to carry out cultivated land mapping for 2020 in northern Henan Province, China. The results show that the MTVF has the potential to accurately identify cultivated land. Furthermore, the overall accuracy, producer accuracy, and user accuracy of the overall study area and four sub-study areas were all greater than 90%. In addition, the cultivated land mapping accuracy of the MTVF is significantly better than that of the maximum likelihood, support vector machine, and artificial neural network methods. [ABSTRACT FROM AUTHOR]

Evaporation is the primary aspect causing water loss in the hydrological cycle; therefore, water loss must be precisely measured. Evaporation is an intricate nonlinear process occurring as a result of several climatic aspects. The purpose of this research is to assess the feasibility of using Random Forest (RF) and two deep learning techniques, namely convolutional neural network (CNN), and deep neural network (DNN) to accurately estimate monthly pan evaporation rates. Month-based weather data gathered from four Malaysian weather stations during the 2000–2019 timeframe was used to train and evaluate the models. Several input attributes (predictor variables) were investigated to select the most suitable variables for machine learning models. Every approach was tested with several models, each with a different set of model aspects and input parameter combinations. The formulated ML approaches were benchmarked against two commonly used empirical methods: Stephens & Stewart and Thornthwaite. Model outcomes were assessed using standard statistical measures to determine their effectiveness in predicting evaporation. The results indicated that the three ML models developed in the study performed better than empirical models and could significantly improve the precision of monthly Ep estimates even with the identical input sets. The performance assessment metrics also show that the formulated CNN approach was acceptable for modelling monthly water loss due to evaporation with a higher degree of accuracy than other ML frameworks explored in this study. In addition, the CNN framework outperformed other AI techniques evaluated for the same areas using identical data inputs. The investigation's findings in relation to the various performance criteria show that the proposed CNN model is capable of capturing the highly non-linearity of evaporation and could be regarded as an effective tool to predict evaporation. [ABSTRACT FROM AUTHOR]

Eye checkups have become increasingly important to maintain good vision and quality of life. As the population requiring eye checkups increases, so does the clinical work burden of clinicians. An automatic screening algorithm to reduce the clinicians' workload is necessary. Machine learning (ML) has recently become one of the chief techniques for automated image recognition and is a helpful tool for identifying ocular diseases. However, the accuracy of ML models is lower in a clinical setting than in the laboratory. The performance of ML models depends on the training dataset. Eye checkups often prioritize speed and minimize image processing. Data distribution differs from the training dataset and, consequently, decreases prediction performance. The study aim was to investigate an ML model to screen for retinal diseases from low-quality optical coherence tomography (OCT) images captured during actual eye chechups to prevent a dataset shift. The ensemble model with convolutional neural networks (CNNs) and random forest models showed high screening performance in the single-shot OCT images captured during the actual eye checkups. Our study indicates the strong potential of the ensemble model combining the CNN and random forest models in accurately predicting abnormalities during eye checkups. [ABSTRACT FROM AUTHOR]

Most of the existing blind omnidirectional image quality assessment (BOIQA) methods are based on data-driven approach where the end-to-end neural network or deep learning tools are mainly used for feature extraction. However, it usually lacks interpretability and is difficult to discover the perceptual mechanism behind. In this paper, from the perspective of perception modeling, we propose a novel multi-angle projection based BOIQA (MP-BOIQA) method. Considering the omnibearing and near eye display characteristics with head mounted display, multiple color cubemap projection images with respect to different viewpoints are grouped as the color omnidirectional distortion (COD) units so as to simulate the user’s viewing behavior in subjective quality assessment. In the designed multi-angle projection based feature extractor, tensor decomposition is implemented on each COD unit for dimensionality reduction, and piecewise exponential fitting is used to get the distribution of mean subtracted contrast normalized coefficients of the unit’s feature matrices in tensor domain. Finally, the extracted features are pooled with random forest. The experimental results on three omnidirectional image quality datasets show that the MP-BOIQA method can deliver highly competitive performance compared with some representative full-reference quality assessment methods, as well as some state-of-the-art BOIQA methods. [ABSTRACT FROM AUTHOR]

Well planning for every drilling project includes cost estimation. Maximizing the rate of penetration (ROP) reduces the time required for drilling, resulting in reducing the expenses required for the drilling budget. The empirical formulas developed to predict ROP have limited field applications. Since real-time drilling data acquisition and computing technologies have improved over the years, we implemented the data-driven approach for this purpose. We investigated the potential of machine learning and deep learning algorithms to predict the nonlinear behavior of the ROP. The well was drilled to confirm the geothermal reservoir characteristics for the FORGE site. After cleaning and preprocessing the data, we selected two models and optimized their hyperparameters. According to our findings, the random forest regressor and the artificial neural network predicted the behavior of our field ROP with a maximum absolute mean error of 3.98, corresponding to 19% of the ROP's standard deviation. A tool was created to assist engineers in selecting the best drilling parameters that increase the ROP for future drilling tasks. The tool can be validated with an existing well from the same field to demonstrate its capability as an ROP predictive model. [ABSTRACT FROM AUTHOR]

Dengue fever modelling in endemic locations is critical to reducing outbreaks and improving vector-borne illness control. Early projections of dengue are a crucial tool for disease control because of the unavailability of treatments and universal vaccination. Neural networks have made significant contributions to public health in a variety of ways. In this paper, we develop a deep learning modelling using random forest (RF) that helps extract the features of the dengue fever from the text datasets. The proposed modelling involves the data collection, preprocessing of the input texts, and feature extraction. The extracted features are studied to test how well the feature extraction using RF is effective on dengue datasets. The simulation result shows that the proposed method achieves higher degree of accuracy that offers an improvement of more than 12% than the existing methods in extracting the features from the input datasets than the other feature extraction methods. Further, the study reduces the errors associated with feature extraction that is 10% lesser than the other existing methods, and this shows the efficacy of the model. [ABSTRACT FROM AUTHOR]

Background: The combination of deep learning methods and oncogenomics can provide an effective diagnostic method for malignant tumors; thus, we attempted to construct a reliable artificial neural network model as a novel diagnostic tool for Bladder cancer (BLCA). Methods: Three expression profiling datasets (GSE61615, GSE65635, and GSE100926) were downloaded from the Gene Expression Omnibus (GEO) database. GSE61615 and GSE65635 were taken as the train group, while GSE100926 was set as the test group. Differentially expressed genes (DEGs) were filtered out based on the logFC and FDR values. We also performed Gene Ontology (GO) and Kyoto Encyclopedia of Genes and Genomes (KEGG) analyses to explore the biological functions of the DEGs. Consequently, we utilized a random forest algorithm to identify feature genes and further constructed a neural network model. The test group was given the same procedures to validate the reliability of the model. We also explored immune cells' infiltration degree and correlation coefficients through the CiberSort algorithm and corrplot R package. The qRT–PCR assay was implemented to examine the expression level of the feature genes in vitro. Results: A total of 265 DEGs were filtered out and significantly enriched in muscle system processes, collagen-containing and focal adhesion signaling pathways. Based on the random forest algorithm, we selected 14 feature genes to construct the neural network model. The area under the curve (AUC) of the training group was 0.950 (95% CI: 0.850–1.000), and the AUC of the test group was 0.667 (95% CI: 0.333–1.000). Besides, we observed significant differences in the content of immune infiltrating cells and the expression levels of the feature genes. Conclusion: After repeated verification, our neural network model had clinical feasibility to identify bladder cancer patients and provided a potential target to improve the management of BLCA. [ABSTRACT FROM AUTHOR]

Wafer bin maps (WBM) provides crucial information regarding process abnormalities and facilitate the diagnosis of low-yield problems in semiconductor manufacturing. Most studies of WBM classification and analysis apply a statistical-based method or machine learning method operating on raw wafer data and extracted features. With increasing WBM pattern diversity and complexity, the useful features for effective WBM recognition are highly dependent on domain knowledge. This study proposes an ensemble convolutional neural network (ECNN) framework for WBM pattern classification, in which a weighted majority function is adopted to select higher weights for the base classifiers that have higher predictive performance. An industrial WBM dataset (namely, WM-811K) from a wafer fabrication process was used to demonstrate the effectiveness of the proposed ECNN framework. The proposed ECNN has superior performance in terms of precision, recall, F1 and other conventional machine learning classifiers such as linear regression, random forest, gradient boosting machine, and artificial neural network. The experimental results show that the proposed ECNN framework is able to identify common WBM defect patterns effectively. [ABSTRACT FROM AUTHOR]

The latest progresses of experimental biology have generated a large number of data with different formats and lengths. Deep learning is an ideal tool to deal with complex datasets, but its inherent "black box" nature needs more interpretability. At the same time, traditional interpretable machine learning methods, such as linear regression or random forest, could only deal with numerical features instead of modular features often encountered in the biological field. Here, we present MultiCapsNet (https://github.com/wanglf19/MultiCapsNet), a new deep learning model built on CapsNet and scCapsNet, which possesses the merits such as easy data integration and high model interpretability. To demonstrate the ability of this model as an interpretable classifier to deal with modular inputs, we test MultiCapsNet on three datasets with different data type and application scenarios. Firstly, on the labeled variant call dataset, MultiCapsNet shows a similar classification performance with neural network model, and provides importance scores for data sources directly without an extra importance determination step required by the neural network model. The importance scores generated by these two models are highly correlated. Secondly, on single cell RNA sequence (scRNA-seq) dataset, MultiCapsNet integrates information about protein-protein interaction (PPI), and protein-DNA interaction (PDI). The classification accuracy of MultiCapsNet is comparable to the neural network and random forest model. Meanwhile, MultiCapsNet reveals how each transcription factor (TF) or PPI cluster node contributes to classification of cell type. Thirdly, we made a comparison between MultiCapsNet and SCENIC. The results show several cell type relevant TFs identified by both methods, further proving the validity and interpretability of the MultiCapsNet. [ABSTRACT FROM AUTHOR]

Atherosclerotic plaque deposit in the carotid artery is used as an early estimate to identify the presence of cardiovascular diseases. Ultrasound images of the carotid artery are used to provide the extent of stenosis by examining the intima-media thickness and plaque diameter. A total of 361 images were classified using machine learning and deep learning approaches to recognize whether the person is symptomatic or asymptomatic. CART decision tree, random forest, and logistic regression machine learning algorithms, convolutional neural network (CNN), Mobilenet, and Capsulenet deep learning algorithms were applied in 202 normal images and 159 images with carotid plaque. Random forest provided a competitive accuracy of 91.41% and Capsulenet transfer learning approach gave 96.7% accuracy in classifying the carotid artery ultrasound image database. [ABSTRACT FROM AUTHOR]

Dengue fever modelling in endemic locations is critical to reducing outbreaks and improving vector-borne illness control. Early projections of dengue are a crucial tool for disease control because of the unavailability of treatments and universal vaccination. Neural networks have made significant contributions to public health in a variety of ways. In this paper, we developed a deep learning modelling using random forest (RF) that helps to extract the features of the dengue fever from the text datasets. The proposed modelling involves the data collection, preprocessing of the input texts, and feature extraction. The extracted features are studied to test how well the feature extraction using RF is effective on dengue datasets. The simulation result shows that the proposed method achieves higher degree of accuracy that offers an improvement of more than 12% than the existing methods in extracting the features from the input datasets than the other feature extraction methods that have laid a foundation for Artificial Neural Network (ANN) model efficacy test. Further, the study reduces the errors associated with feature extraction that is 10% lesser than the other existing methods and this shows the efficacy of the model. [ABSTRACT FROM AUTHOR]

This research builds a human action recognition system based on a single image or video capture snapshot. The TensorFlow Deep Learning models are developed using human keypoints generated by OpenPose. Four classifiers are considered: Neural Network, Random Forest, K-Nearest Neighbor (KNN), and Support Vector Machine (SVM) Classifiers. The models’ input layer are 50 points from x and y coordinate of 25 keypoints from OpenPose, and the output layer is the numerical representation of 11 human action labels which are 'hand-wave', 'jump', 'leg-cross', 'plank', 'ride', 'run', 'sit', 'lay-down', 'squat', 'stand', 'walk’. A total of 2132 images dataset was used for model training and testing. The results show the two best classifier models: Neural Network Classifier with 512 hidden nodes with an accuracy of 0.7733, and Random Forest Classifier with 60 estimators with an accuracy of 0.7752. Both models are then used as inference engines to recognize human action from images and real-time video. [ABSTRACT FROM AUTHOR]