Search

The importance of technology and managerial risk management in banks has increased due to the financial crisis. Banks are the most affected since there are so many of them with poor financial standing. Due to this problem, an unstable and inefficient financial system causes economic stagnation in both the banking sector and overall economy. Data envelopment analysis (DEA) has been used to examine decision-making units (DMUs) performance to enhance efficiency. Currently, with the rapid growth of big data, adding more DMUs will likely require a large amount of memory and CPU time on the computer system, which will be the biggest challenge. As a result, machine learning (ML) approaches have been used to analyze financial institution performance, but many of them have variances in predictions or model stability, making measuring bank efficiency extremely difficult. For this, ensemble learning is commonly used to evaluate the performance of financial institutions in this context. This paper presents a robust super learner ensemble technique for assessing bank efficiency, with four machine learning models serving as base learners. These models are the support vector machine (SVM), K-nearest neighbors (KNN), random forest (RF), and AdaBoost classifier (ADA) which represent the base learners and their results utilized to train the meta-learner. The super learner (SL) approach is an extension of the stacking technique, which generates an ensemble based on cross-validation. One important benefit of this cross-validation theory-based technique is that it can overcome the overfitting issue that plagues most other ensemble approaches. When SL and base learners were compared for their forecasting abilities using different statistical standards, the results showed that the SL is superior to the base learners, where different variable combinations were used. The SL had accuracy (ACC) of 0.8636–0.9545 and F1-score (F1) of 0.9143–0.9714, while the basic learners had ACC of 0.5909–0.8182 and F1 of 0.6897–0.9143. So, SL is highly recommended for improving the accuracy of financial data forecasts, even with limited financial data. [ABSTRACT FROM AUTHOR]

Asthma is a common disease. The clinical diagnosis is usually confirmed on a pulmonary function test, which is not always readily accessible. We aimed to develop a computationally lightweight handcrafted machine learning model for asthma detection based on cough sounds recorded using mobile phones. Toward this aim, we proposed a novel feature extractor based on a one-dimensional version of the published attractive-and-repulsive center-symmetric local binary pattern (1D-ARCSLBP), which we tested on a new cough sound dataset. We prospectively recorded cough sounds from 511 asthmatics and 815 non-asthmatic subjects (comprising mostly healthy volunteers), which yielded 1875 one-second cough sound segments for analysis. Our model comprised four steps: (i) preprocessing, in which speech signals and stop times (silent zones between coughs) were removed, leaving behind analyzable cough sound segments; (ii) feature extraction, in which tunable q-factor wavelet transformation was used to perform multilevel signal decomposition into wavelet subbands, allowing 1D-ARCSLBP to extract local low- and high-level features; (iii) feature selection, in which neighborhood component analysis was used to select the most discriminative features; and (iv) classification, in which a standard shallow cubic support vector machine was deployed to calculate binary classification results (asthma versus non-asthma) using tenfold and leave-one-subject-out cross-validations. Our model attained 98.24% and 96.91% accuracy rates with tenfold and leave-one-subject-out cross-validation strategies, respectively, and obtained a low-time complexity. The excellent results confirmed the feature extraction capability of 1D-ARCSLBP and the feasibility of the model being developed into a real-world application for asthma screening. [ABSTRACT FROM AUTHOR]

In educational institutions, it is now more important than ever to deliver high-quality academic instruction, and educational data mining is essential for resolving problems that arise from challenging unstructured data in this field. Using machine learning (ML) approaches, the performance of students and traits related to academia, a crucial indicator of higher education, is examined. In the proposed study, the educational dataset is subjected to feature ranking algorithms, including MRMR, ReliefF, Chi-Square, ANOVA, and Kruskal–Wallis, followed by important feature selection using Shapley. The dataset has 16 attributes of integer, categorical type, and after feature ranking approaches, the features with the most important information are chosen and ML techniques are applied to them. It takes two phases to complete the work. The results are obtained after the first phase, in which all features are taken into account for ML training. The second phase of ML training takes into account selective features that are derived using ranking approaches. ML models with only selective attributes are compared to models with all features in order to determine which is more precise. In comparison, the results of the ML models with selective attributes outperformed the models with all attributes. Overall, the ensemblers, i.e., bagged tree and AdaBoost, outperformed other ML techniques such as decision trees, neural networks, naive Bayes, K-nearest neighbor, and support vector machines presented in the proposed study. Bagged trees achieved an accuracy of 81.0 percent, while AdaBoost achieved an accuracy of 74.2 percent. [ABSTRACT FROM AUTHOR]

Categorical features appear in datasets from almost every practice area, including real estate datasets. One of the most critical handicaps of machine learning algorithms is that they are not designed to capture the qualitative nature of the categorical features, leading to sub-optimal predictions for the datasets with categorical observations. This study focuses on a new fuzzy regression functions framework, namely hierarchical fuzzy regression functions, that can handle categorical features properly for the regression task. The proposed framework is benchmarked with linear regression, support vector machines, deep neural networks, and adaptive neuro-fuzzy inference systems with real estate data having categorical features from six markets. It is observed that the proposed method produces better prediction performance for real estate price prediction than the benchmark methods in a wide variety of real estate markets. Since we provide all the required software codes to implement the proposed hierarchical fuzzy regression functions framework, our approach offers practitioners a readily applicable, high-performing tool for real estate price prediction and other regression problems involving categorical independent features. [ABSTRACT FROM AUTHOR]

During the takeoff phase, aircraft engines reach maximum speed and temperature to achieve the required thrust. Due to these harsh operating conditions, the performance of aircraft engines may decrease. This decrease in performance increases both fuel consumption and environmental damage. Reducing or eliminating the damages caused by aircraft is among the objectives of ICAO. In order to achieve this goal, aircraft engines are compulsorily tested, evaluated by experts and certified. The data obtained during the test process is recorded and stored in the engine emission databank (EEDB). During the takeoff phase, there is no system that can evaluate aircraft engines without dismantling and without expert knowledge. In this study, EEDB 2019 and 2021 takeoff phase data sets were used. Fuel flow T/O parameter is an important parameter used both in the calculation of aircraft emissions and in the evaluation of engine performance. Gaussian process regression (GPR), support vector machine (SVM) and multilayer perceptron (MLP) models were used to estimate the fuel flow T/O parameter. The results obtained were compared according to error performance criteria and the best model was selected. In MATLAB® environment, confidence intervals were plotted with the estimated fuel flow T/O value at 99% confidence level. This study demonstrates that the performance evaluation of aircraft engines during the takeoff phase can be performed without the need for expert knowledge. [ABSTRACT FROM AUTHOR]

Accurate and early disease prediction enables patients to plan and improve their quality of life in the future. Early detection of neurodegenerative diseases, such as Parkinson's disease, is a high priority and a significant challenge in which physicians must act quickly to diagnose and predict the risk of disease severity. Machine learning (ML) models combined with feature selection (FS) techniques can assist physicians in quickly diagnosing a disease. FS technique optimally subsets features to improve model performance and reduce the number of tests required for a patient, thereby speeding up diagnosis. This paper proposes an e-diagnosis approach based on ML-FS algorithms to detect Parkinson's disease using data obtained from Parkinson's Progression Markers Initiative (PPMI) Online study. Also, it can be considered patient-oriented research as it uses self-reported online collected data. The results of six FS techniques pre-applied to classification algorithms named logistic regression, random forest, support vector machine, CatBoost, extreme learning machine, and XGBoost are shown in this study. Chi-square, mutual information, and analysis of variance (ANOVA) filter-based FS methods, while sequential feature selection, Boruta, and recursive feature elimination are considered wrapper methods. The outcomes show that random forest when trained on features selected by the recursive feature elimination technique help to build an efficient and effective approach for detecting Parkinson's disease. [ABSTRACT FROM AUTHOR]

Finding patches is a crucial step in a pavement performance survey. The study develops a machine learning and image processing algorithm-established automatic method for identifying asphalt pavement patches. The GrayLevel Co-Occurrence Matrix and image texture-based features derived from color channel statistics are used as input parameters to describe the condition of the pavement. For feature extraction, image processing methods like the projective integral of images, steerable filters, and an improved image thresholding method were used. Support Vector Machine is employed for categorizing the differentiating patched regions from non-patch ones. The suggested combination of image texture analytical methods has been trained using an IA data set created from 400 image samples. The feature set, which combines the characteristics of cracked objects with those generated from the projective integral, can produce the desired result. To make the model's execution simpler, a patch recognition program was created and implemented in MATLAB. As a result, the recently created method has the potential to be an instrument for traffic management organizations through the assessment of pavement performance. The results of the experiments indicate that the newly developed method may achieve excellent accuracy prediction results with a classifier performance rate of about 96%. Such a method could enable transportation authorities to assess the state of asphalt pavement. [ABSTRACT FROM AUTHOR]

Parkinson's disease (PD) is the second most common neurological disorder caused by damage to dopaminergic neurons. Therefore, it is important to develop systems for early and automatic diagnosis of PD. For this purpose, a study that will contribute to the development of systems for the automatic diagnosis of PD is presented. The Electroencephalography (EEG) signals were decomposed into sub-bands using adaptive decomposition methods, such as empirical mode decomposition, variational mode decomposition, and Vold-Kalman order filtering (VKF). Various features were extracted from the sub-band decomposed signals, and the significant ones were determined by Chi-squared test. These important features were applied as input to support vector machine (SVM), fitch neural network (FNN), k-nearest neighbours (KNN), and decision trees (DT), machine learning (ML) models and classification was performed. We analysed the performance of ML models by obtaining accuracy, sensitivity, specificity, positive predictive value, negative predictive values, F1-score, false-positive rate, kappa statistics, and area under the curve. The classification process was performed for two cases: PD ON-HC and PD OFF-HC groups. The most successful method in this study was the VKF method, which was applied for the first time in this field with the approach specified for both cases. In both instances, the SVM algorithm was employed as the ML model, with classifier performance criterion values close to 100%. The results obtained in this study seem to be successful compared to the results of recent research on the diagnosis of PD. [ABSTRACT FROM AUTHOR]

Insider threats have recently become one of the most urgent cybersecurity challenges facing numerous businesses, such as public infrastructure companies, major federal agencies, and state and local governments. Our purpose is to find the most accurate machine learning (ML) model to detect insider attacks. In the realm of machine learning, the most convenient classifier is usually selected after further evaluation trials of candidate models which can cause unseen data (test data set) to leak into models and create bias. Accordingly, overfitting occurs because of frequent training of models and tuning hyperparameters; the models perform well on the training set while failing to generalize effectively to unseen data. The validation data set and hyperparameter tuning are utilized in this study to prevent the issues mentioned above and to choose the best model from our candidate models. Furthermore, our approach guarantees that the selected model does not memorize data of the threats occurring in the local area network (LAN) through the usage of the NSL-KDD data set. The following results are gathered and analyzed: support vector machine (SVM), decision tree (DT), logistic regression (LR), adaptive boost (AdaBoost), gradient boosting (GB), random forests (RFs), and extremely randomized trees (ERTs). After analyzing the findings, we conclude that the AdaBoost model is the most accurate, with a DoS of 99%, a probe of 99%, access of 96%, and privilege of 97%, as well as an AUC of 0.992 for DoS, 0.986 for probe, 0.952 for access, and 0.954 for privilege. [ABSTRACT FROM AUTHOR]

One of the main concerns of cloud-based services based on machine and deep learning algorithms is the privacy of users' data. This is particularly relevant when companies want to leverage such services because they have to outsource potentially sensible data to be processed. In this work, the problem of privacy-preserving anomaly detection on industrial vibrational data with machine learning is tackled. It consists in the detection of irregularities or deviations from expected patterns in the vibration signals generated by industrial machinery and equipment. Such anomalies can be indicative of potential equipment failures, maintenance needs, or process deviations, making their timely detection critical for ensuring the smooth operation and reliability of industrial systems. We combine this industrial need with the ability to guarantee data privacy by proposing encrypted vibrational anomaly detection (EVAD). EVAD allows the detection of anomalies on vibrational data in a privacy-preserving manner by integrating, for the first time in the literature, one-class support vector machines and homomorphic encryption, the latter being a particular kind of encryption that allows the computation of some operations directly on encrypted data. Experimental results show that, on two publicly available datasets for vibrational anomaly detection, EVAD is able to distinguish, in a privacy-preserving manner, between nominal and anomaly situations, in an effective and efficient way. To the best of our knowledge, EVAD represents the first privacy-preserving solution for the detection of anomalies in vibrational data present in the literature. [ABSTRACT FROM AUTHOR]

Text classification has critical applications, including healthcare, where it can assist patients in locating specialized clinics based on their symptom descriptions. This can enhance healthcare services by reducing misdiagnoses and efficiently guiding patients to appropriate specialists. This research focuses on building a model for multi-class text classification in Arabic healthcare. Two evaluation schemes were employed using health data from the Altibbi dataset. Various feature extraction techniques were employed, including term frequency-inverse document frequency (TF-IDF) and word-to-vector (Word2Vec). Classical machine learning models such as Logistic Regression (LR), Random Forest (RF), Multinomial Naïve Bayes (MNB), Stochastic Gradient Descent, and Support Vector Machine (SVM), along with ensemble classifications, were implemented. Evaluation measures were used to compare model performance, including precision, recall, and F1-score. Results indicated that TF-IDF generally outperformed Word2Vec regarding the F1-score across most classes. LR and RF consistently demonstrated strong performance, while MNB exhibited lower precision. Ensemble methods like stacking and bagging showed promise, with LR and RF performing well across multiple classes. The SVM model displayed lower precision in certain classes. Preliminary experiments with the transformer-based models for Arabic language AraBERT and MarBERT as feature extraction and classification models demonstrated impressive precision, recall, and F1 scores across various classes. The findings show the effectiveness of ensemble models using TF-IDF and Arabic transformer models in accurately classifying Arabic health texts. However, challenges related to standardization, semantic variations, data availability, and resources should be considered. [ABSTRACT FROM AUTHOR]

This study investigates the effectiveness of six prominent machine learning models—random forest, decision trees, K-nearest neighbor, logistic regression, support vector machines, and Naïve Bayes—for intrusion detection systems in industrial Internet of Things environments. The evaluation encompasses the effects of data preprocessing techniques, including feature engineering, data normalization, recoding, and missing data mitigation. Furthermore, the research delves into dataset balancing, examining the effects of six different techniques on model performance. The investigations are conducted using the domain-specific WUSTL-IIOT-2021 dataset, which captures the unique characteristics of IIoT data. The study also investigates multi-class attack identification utilizing an innovative SMOTE-based multi-class balancing approach to tackle dataset imbalances. The results indicate that data preprocessing and intelligent dataset balancing produce consistent enhancements in the classification performance of the selected models across binary and multi-classification tasks. Random forest emerges as the standout algorithm, delivering consistently high performance with computational efficiency. [ABSTRACT FROM AUTHOR]

The catastrophic forgetting problem is one of the hotspots in the field of deep learning. At present, there is no doubt that storing samples of previous tasks in fixed-size memory is the best way to solve this problem. However, the number of samples stored in fixed-size memory is limited. With the increase in tasks, the number of samples stored in memory for a single task will decrease sharply. It is also difficult to balance the memory capacity and number of samples. To solve this problem, some methods use a fixed size of memory to store dimensionality reduction images. However, this will create new problems. 1) The quality of dimensionality reduction images is poor, and they are significantly different from original images. 2) How to choose the dimensionality reduction method of images. To address these problem, we put forward a new method. Firstly, we employ a simple and reliable scheme to solve the domain difference between dimensionality reduction images and original images. And we theoretically analyzed which image dimensionality reduction method is better. Secondly, to increase the generalization ability of our method and further mitigate the catastrophic forgetting phenomenon, we utilize a self-supervised image augmentation method and the output features similarity loss. Thirdly, we make use of the neural kernel mapping support vector machine theory to improve the interpretability of our method. Experimental results demonstrated that the top-1 average accuracy of our method is much higher than other methods when using the same size of memory. [ABSTRACT FROM AUTHOR]

This paper presents an intelligent healthcare framework by incorporating modern computing technologies like machine learning and deep learning. The sole motivation of this paper is to predict diabetes status intelligently so that patients can be made aware of their diabetes status regularly. A novel ensemble machine learning-based diabetes prediction framework, namely "iDP", has been proposed in this paper. Six different machine learning approaches have been used for the iDP framework, namely random forest, decision tree, neural network, AdaBoost, support vector machine, and XGBoost. Training and testing of ensemble modeling have been performed based on these learning techniques. A comprehensive preliminary data analysis and screening of statistical analysis have been systematically demonstrated in this paper. The recursive feature elimination and fivefold cross-validation methods have been used to select the best model. All experiments have been performed using R-Studio 1.2.5 with the help of the Rattle library 5.4.0. The preliminary data analytic and Pearson correlation coefficient values have been computed to verify the linearity relationship among the data. Results have been reported in eight performance metrics, including accuracy, specificity, sensitivity, area under curve, area under convex hull, minimum error rate, minimum weighted loss, and precision. The proposed iDP framework improves the results on different aspects in order to compare them with individual learning approaches. Despite this, a comparative performance analysis of the iDP framework has also been performed with state-of-the-art prevailing models. As per experiment, the iDP framework gives better results in most cases, like accuracy: 95.26%, AUC: 91.15%, sensitivity: 96.81%, specificity: 97.72% and precision: 90.72%. [ABSTRACT FROM AUTHOR]

Makam is defined as melodies that are described with typical the agâz(beginning), seyir (the orientation style), and karar (ending) features in a certain perde düzen (tone/fret tunings). For this reason, determining the makam is the basic step in understanding the melodic progression, as in musical keys. Machine learning, an artificial intelligence discipline, offers stable solutions for estimating different situations based on known data. In this study, classifications for makam recognition in Turkish folk music were carried out using different machine learning methods on the original dataset. The success of the different methods used was compared, and also data augmentation was performed by using SMOTE, KMeansSMOTE, ADASYN, and SVMSMOTE oversampling techniques, which are widely used in the literature to increase the prediction success of the classifiers. For each of eight different machine learning techniques, namely light gradient boosting machine, eXtreme gradient boosting, naive Bayes, decision tree, support vector machine, K-nearest neighbor, random forest, and logistic regression, in addition to classification without data augmentation, a total of 40 classification processes were carried out using four different data augmentation techniques. The results of the classification processes are reported with four different parameters: accuracy, precision, recall, and F1-score. The highest accuracy value of 99.17% was obtained when the light gradient boosting machine classifier was used together with the SMOTE data augmentation technique. It was observed that the measurements obtained in the study were higher than the results obtained in similar studies conducted in the literature in recent years. [ABSTRACT FROM AUTHOR]

Twin support vector regression (TSVR) has been widely applied in regression problems. TSVR seeks a pair of ε -insensitive proximal planes by solving two support vector machine type problems. TSVR assumes that the matrices appearing in the dual formulation are positive definite. However, in real-world scenarios, such an assumption may not be fulfilled and, hence, leads to suboptimal performance. ε -Twin support vector regression (ε -TSVR) improved the TSVR by introducing the regularisation term to avoid the singularity issues. Most of the twin support vector machine models involve the computation of matrix inverses. Also, TSVR implements the empirical risk minimization principle. In this paper, we propose an improved twin support vector regression (ITSVR) for brain age estimation by introducing different Lagrangian functions for the primal problems of the TSVR. The proposed ITSVR implements the structural risk minimization principle and avoids the computation of the matrix inverses. To solve the optimization problem more efficiently, we used successive overrelaxation (SOR) technique. We evaluated the proposed ITSVR on cognitively healthy subjects, mild cognitive impairment subjects and Alzheimer's disease subjects. The experimental results demonstrate that the proposed ITSVR has superior performance compared to the baseline models for brain age estimation. [ABSTRACT FROM AUTHOR]

With the aging of the population, China has a large population base. The number of people suffering from mild cognitive impairment has gradually increased and gradually turned to senile dementia. The probability of mild cognitive impairment in China is about 5–7%, and about 15 million people are ill. To better distinguish mild cognitive impairment from Alzheimer's, this paper adopted the machine learning (ML) method to model. The evaluation table was established by considering the reaction time, education, background, memory, and other aspects of the patient. Machine learning has been applied in the fields of the Internet, finance, medicine, automation, biological science, etc. Through the machine learning support vector machine (SVM) and linear regression, the classification accuracy was compared. The results showed that the classification accuracy of SVM was 87.92% under the ML algorithm. It also showed that ML was more conducive to classification and recognition, which has played an important role in the identification of mild cognitive impairment in the current aging population. [ABSTRACT FROM AUTHOR]

Breast cancer is a significant global health concern, with millions of cases and deaths each year. Accurate diagnosis is critical for timely treatment and medication. Machine learning techniques have shown promising results in detecting breast cancer. Previous studies have primarily used single-modality data for breast cancer diagnosis. Hence, this work aims to mobilize the benefits of multimodal data over unimodality samples. This study proposes a custom deep learning-based model pipeline that works over this multimodal data. This work has been separated into three phases. Phase 1 and Phase 2 under the unimodal category examine gene expression data and histopathological images separately. The Cancer Genome Atlas makes these datasets available. In Phase 3, the proposed pipeline operates on both data types' samples for each patient in the multimodal category. This study investigates how data pre-processing (cleaning, transformation, reduction) and cascaded filtering affect model performance. Precision, recall, f1-score, and accuracy assessed the models, whereas L2 regularization, exponentially weighted moving average, and transfer learning minimized over-fitting. A custom deep neural network and support vector machine obtained 86% accuracy in Phase 1, whereas the VGG16 model reached 80.21% accuracy in Phase 2. In Phase 3, the curated multimodal dataset was applied to a custom deep learning pipeline (VGG16 backbone with hyper-tuned machine learning models as head classifiers) to achieve 94% accuracy, demonstrating the importance of multimodal data over unimodal in breast cancer subtype classification. These findings highlight the importance of multimodal data for breast cancer diagnosis and subtype prediction. [ABSTRACT FROM AUTHOR]

Colorectal cancer (CRC) is one of the most lethal kinds of cancer, so early detection is critical. Three datasets, namely CNN transfer learning with discrete wavelet transform (DWT), discrete cosine transform (DCT), and support vector machines (SVMs), were used to find CRC. In these instances, a quick and precise visual diagnosis of polyps is needed in the current scenario. The proposed process involves four distinct phases. First and foremost, convolutional neural networks (CNNs) are developed to test the efficacy of the model. Further, a transfer learning approach was incorporated using SVM and LSTM. Using the K-means technique, a visual explanation is finally presented. This system works with the balanced Hyper Kvasir and mixed datasets, which are made up of CVC Clinic DB, Kvasir2, and Hyper Kvasir. The system is called "ColoRectalCADx". The convolutional neural network (CNN) models are ResNet-50V2, DenseNet-201, VGG-16, and RDV-22. The system achieved the highest accuracy with CNN DesnseNet-201 in Hyper Kvasir (98.92% training, 98.91% testing, 93.62% SVM training, and 95.87% SVM tests). CNN DenseNet-201 also achieved the highest accuracy with the mixed dataset (98.91% training, 96.13% testing, 95.41% SVM training, and 94.86% SVM testing). The process involved three phases, namely individual CNN, combination of CNN with SVM, and combination of CNN, LSTM, and SVM. After three phases of the system, across both datasets, the CNN + SVM + LSTM combination was proven to be the most effective. Finally, the unsupervised K-means learning algorithm extracts the location of any cancerous polyps and upon classification using SVM classifier resulted with an accuracy of 80%. The K-means algorithm, which uses segmented images as input, accurately predicts the sites of tumours in colorectal cancer patients. [ABSTRACT FROM AUTHOR]

Accurate short-term electricity load forecasts are critical for the secure and economic operation of power systems. This paper presents a computationally efficient and powerful three-stage model to accurately forecast short-term electricity load. Variational mode decomposition (VMD) was used in the first stage to extract features from the historical load signal. The stacked kernel extreme learning machine (KELM)-based auto-encoders were utilized in the unsupervised feature learning-based second stage. In the third stage, the high-order learned features were used as the inputs for the KELM-based regression model. The proposed deep KELM architecture combines stacked KELM-based auto-encoders and a KELM-based regression model to forecast short-term electricity load effectively. In order to examine the performance improvement of the proposed forecasting model, several performance comparison tests were realized using publicly available electricity load and day-ahead forecast data from the Turkish transmission system operator (TSO). The proposed model results were compared with state-of-the-art deep extreme learning machine (ELM) architectures as well as the benchmark forecasting models based on original ELM, KELM, artificial neural network (ANN), support vector machine (SVM), and regression tree (RT). The comparison results indicated that the proposed model outperformed state-of-the-art architectures and was significantly more successful than the TSO model. [ABSTRACT FROM AUTHOR]

In a smart grid, the main goals are to provide grid stability, improve power system performance and security, and reduce operations, system maintenance, and planning costs. The prediction stability of smart grid (SG) systems is essential in terms of power loss minimization and the importance of adequate energy policies. SG systems must accurately predict the energy demand and ensure the right amount of energy is available at the right time. If the prediction is inaccurate, it can lead to costly energy production or usage errors and create considerable inefficiencies in the power grid. Due to this, this manuscript offers five different cascade methods to detect the stability of SG systems. Detecting the stability of SG systems enables the grid to respond quickly to changes in demand and supply, improves system reliability, reduces power outages, and increases the overall efficiency of the grid. The present work proposed five different cascade methods with pre-processing, training and testing division, and the classification stages of the classification procedure for estimating SG stability. In the first pre-processing stage, the SG dataset is pre-proceeded with the feature selection (Relief, Fast Correlation-Based Filter (FCBF), and supervised attribute filter). The resampling (the bootstrapping), the Fuzzy C-Means Clustering-Based Feature Weighting (FCMFW), the resampling then feature selection (supervised attribute filter), and the feature selection (supervised attribute filter), then FCMFW. In the second stage, the training and testing division stage, the SG dataset was separated into three test and training data methods before the classification algorithm: The 5 Fold Cross Validation (FVC), 10 FVC, and hold-out (50–50%). In the third stage, the classification stage, five different classification algorithms, including Naive Kernel Bayes, Linear Support Vector Machine (SVM), Weighted K-Nearest Neighbors, Begged Trees, and Narrow Neural Network classifying algorithms, are used to classify the SG dataset. The simulation results of this study demonstrated that the suggested cascade ML system had achieved significant accuracy in predicting SG stability. The best cascade method is the feature selection (supervised attribute filter) + FCMFW + 10 FCV and then performing the bagged trees algorithm; thus, the new approach affords an accuracy of 99.9%. Furthermore, due to the rapid growth of ML techniques, sensors, and smart meters technologies, with Machine to Machine communication via the internet of things (IoT), the real-time identification process is made practical with higher accuracy. For this reason, our future research will focus on an IoT-based SG system, an E-stability determination system. Thanks to the proposed cascade method, the SG dataset can be classified easily, quickly, and reliably. E-stability determination systems can help to fast detect, predict, and respond, which is an important application of IoT on the grid systems. [ABSTRACT FROM AUTHOR]

With the increased use of social network sites, such as Twitter, attackers exploit these platforms to spread counterfeit content. Such content can be fake advertisements or illegal content. Classifying such content is a challenging task, especially in Arabic. The Arabic language has a complex structure and makes classification tasks more difficult. This paper presents an approach to classifying Arabic tweets using classical machine learning (non-deep machine learning) and deep learning techniques. Tweets corpus were collected through Twitter API and labelled manually to get a reliable dataset. For an efficient classifier, feature extraction is applied to the corpus dataset. Then, two learning techniques are used for each feature extraction technique on the created dataset using N-gram models (uni-gram, bi-gram, and char-gram). The applied classical machine learning algorithms are support vector machines, neural networks, logistics regression, and naïve Bayes. Global vector (GloVe) and fastText learning models are utilised for the deep learning approaches. The Precision, Recall, and F1-score are the suggested performance measures calculated in this paper. Afterwards, the dataset is increased using the synthetic minority oversampling technique class to create a balanced dataset. After applying the classical machine learning models, the experimental results show that the neural network algorithm outperforms the other algorithms. Moreover, the GloVe outperforms the fastText model for the deep learning approach. [ABSTRACT FROM AUTHOR]

The operation of large utility companies such as Consolidated Edison Company of New York, Inc. (Con Edison) typically rely on large quantities of regulation documents from external institutions which inform the company of upcoming or ongoing policy changes or new requirements the company might need to comply with if deemed applicable. As a concrete example, if a recent regulatory publication mentions that the timeframe for the Company to respond to a reported system emergency in its service territory changes from within X time to within Y time—then the affected operating groups will be notified, and internal Company operating procedures may need to be reviewed and updated accordingly to comply with the new regulatory requirement. Each such regulation document needs to be reviewed manually by an expert to determine if the document is relevant to the company and, if so, which department it is relevant to. In order to help enterprises improve the efficiency of their operation, we propose an automatic document classification pipeline that determines whether a document is important for the company or not, and if deemed important it forwards those documents to the departments within the company for further review. Binary classification task of determining the importance of a document is done via ensembling the Naive Bayes (NB), support vector machine (SVM), random forest (RF), and artificial neural network (ANN) together for the final prediction, whereas the multi-label classification problem of identifying the relevant departments for a document is executed by the transformer-based DocBERT model. We apply our pipeline to a large corpus of tens of thousands of text data provided by Con Edison and achieve an accuracy score over 80 % . Compared with existing solutions for document classification which rely on a single classifier, our paper i) ensemble multiple classifiers for better accuracy results and escaping from the problem of overfitting, ii) utilize pretrained transformer-based DocBERT model to achieve ideal performance for multi-label classification task and iii) introduce a bi-level structure to improve the performance of the whole pipeline where the binary classification module works as a rough filter before finally distributing the text to corresponding departments through the multi-label classification module. [ABSTRACT FROM AUTHOR]

For semi-supervised learning, a few labeled data and a large number of unlabeled data are used to construct a reasonable classifier. In recent years, many semi-supervised learning methods have been proposed and achieved good performance, especially for the graph-based approaches that can exploit the geometric information embedded in the data. Motivated by the success of generalized elastic net Lp-norm nonparallel support vector machine (GLpNPSVM) and the graph-based regularization term, in this paper, a novel Laplacian generalized elastic net Lp-norm nonparallel support vector machine for semi-supervised learning (Lap-GLpNPSVM) is proposed. A Lp-norm graph regularization term is introduced to improve the performance by the adjustability of the value of p. Experimental results on two synthetic datasets, fifteen UCI datasets, and Handwritten Numeral datasets demonstrate that proposed methods outperform other state-of-the-art methods. [ABSTRACT FROM AUTHOR]

The coronavirus pandemic has been globally impacting the health and prosperity of people. A persistent increase in the number of positive cases has boost the stress among governments across the globe. There is a need of approach which gives more accurate predictions of outbreak. This paper presents a novel approach called diffusion prediction model for prediction of number of coronavirus cases in four countries: India, France, China and Nepal. Diffusion prediction model works on the diffusion process of the human contact. Model considers two forms of spread: when the spread takes time after infecting one person and when the spread is immediate after infecting one person. It makes the proposed model different over other state-of-the art models. It is giving more accurate results than other state-of-the art models. The proposed diffusion prediction model forecasts the number of new cases expected to occur in next 4 weeks. The model has predicted the number of confirmed cases, recovered cases, deaths and active cases. The model can facilitate government to be well prepared for any abrupt rise in this pandemic. The performance is evaluated in terms of accuracy and error rate and compared with the prediction results of support vector machine, logistic regression model and convolution neural network. The results prove the efficiency of the proposed model. [ABSTRACT FROM AUTHOR]

With each passing day, the number of smart vehicles is increasing manifold, hence, automatic/automated parking lot detection is gaining a lot of importance among Smart City applications. A robust approach is desired to identify parking spaces effectively and efficiently. This work presents a deep learning classifier based on convolutional neural network (CNN) and extreme learning machine (ELM), i.e., CNN-ELM to classify the parking space as vacant or occupied. CNN is well-known for efficient image classification, but its training time is highly influenced by backpropagation of errors in the fully connected layer. Thus, ELM is plugged into CNN to replace the fully connected layer and perform classification whereas, feature extraction is performed using CNN. The performance of CNN-ELM is validated on the publicly available PKLot dataset, which contains approximately 700,000 images categorized into sunny, overcast, and rainy weather conditions. The experimental results indicate that CNN-ELM approach outperforms other hybrid CNN models using different classifiers such as support vector machine, Xgboost, and Extra Trees in terms of sensitivity, specificity, and accuracy. The comparison of results with other state-of-the-art approaches based on accuracy and Area under the curve (AUC) score further justifies the effectiveness of the proposed approach in real-time parking space detection. [ABSTRACT FROM AUTHOR]

One of the most important problems for farmers who produce large amounts of apples is the classification of the apples according to their types in a short time without handling them. Support vector machines (SVM) and deep residual networks (ResNet-50) are machine learning methods that are able to solve general classification situations. In this study, the classification of apple varieties according to their genus is made using machine learning algorithms. A database is created by capturing 120 images from six different apple species. Bag of visual words (BoVW) treat image features as words representing a sparse vector of occurrences over the vocabulary. BoVW features are classified using SVM. On the other hand, ResNet-50 is a convolutional neural network that is 50 layers deep with embedded feature extraction layers. The pre-trained ResNet-50 architecture is retrained for apple classification using transfer learning. In the experiments, our dataset is divided into three cases: Case 1: 40% train, 60% test; Case 2: 60% train, 40% test; and Case 3: 80% train, 20% test. As a result, the linear, Gaussian, and polynomial kernel functions used in the BoVW + SVM algorithm achieved 88%, 92%, and 96% accuracy in Case 3, respectively. In the ResNet-50 classification, the root-mean-square propagation (rmsprop), adaptive moment estimation (adam), and stochastic gradient descent with momentum (sgdm) training algorithms achieved 86%, 89%, and 90% accuracy, respectively, in the set of Case 3. [ABSTRACT FROM AUTHOR]

A computerized coconut tree detection system can help dendrologists and laypersons in identifying coconut trees based on three morphological parameters including height, inclination, and orientation. These three parameters help to determine the health and the nature of growth of coconut trees which influences the design and use of robots for harvesting coconuts. Deep learning is a powerful tool used for feature extraction as it is better in extracting deeper details (features) in an image. In this research work, a new Modified Inception Net based Hyper Tuning Support Vector Machine classification method named MIN-SVM is proposed for coconut tree classification based on three morphological parameters including height, inclination and orientation. The features from the pre-processed coconut tree images were extracted using four distinct Convolutional Neural Network models including Visual Geometry Group, Inception Net, ResNet, and MIN-SVM. These extracted features were then classified using a Machine Learning model named Support Vector Machine (SVM). The MIN-SVM have achieved a remarkable accuracy of 95.35 percent as contrasted to Visual Geometry Group (91.90%), Inception Net (81.66%), and ResNet (71.95%). The features extracted from Modified Inception Net fitted good with SVM classifier. Experimental results show that MIN-SVM can be powerful computerized automated system to identify coconut trees based on height, inclination, and orientation. [ABSTRACT FROM AUTHOR]

Accurate streamflow estimation is crucial for proper water management for irrigation, hydropower, drinking and industrial purposes. The main aim of this study to adopt new data preprocessing techniques (e.g., EMD, EEMD and EWT) to capture the data noise and to enhance the prediction accuracy of machine learning methods for streamflow estimation which is a challenging task in high-altitude basins due to the influence of many external climatic and geographical parameters. The prediction accuracy of support vector regression (SVR), twin support vector machine (T), extreme learning machine (ELM), asymmetric Huber loss function-based ELM (AHELM) and ε-insensitive Huber loss function-based ELM (ε-AHELM) methods are investigated in monthly streamflow prediction. Among the standalone methods, the ε-AHELM performs superior to the SVR, TSVR, ELM, and AHELM in streamflow prediction; improvements in root mean square error are 6.9%, 4.9%, 6% and 4.2%, respectively. The study outcomes reveal that the preprocessing methods considerably improve the prediction accuracy of the implemented standalone models. Among the data preprocessing techniques, it is found that the EWT outperforms the EMD and EEMD techniques by reducing the prediction errors in the best ε-AHELM, EMD-ε-AHELM and EEMD-ε-AHELM models by 68–61.3%, 64.7–63.4% and 59.4–58.6%, respectively. The overall results of the study recommend the use of EWT-ε-AHELM in streamflow estimation. [ABSTRACT FROM AUTHOR]

In this study, the performance of a counter-flow Ranque–Hilsch vortex tube (RHVT) was investigated experimentally using working fluid nitrogen, and the thermal performance was modeled using different modeling methods with these experimental results. Each method was compared with the others. The variation of ΔT, which is the measure of temperature separation in RHVT, was investigated by using nozzle number, the thermal conductivity of nozzle material, inlet pressure, specific heat, and density of working fluid. In the study, the prediction models of linear, k-nearest neighbor (kNN), random forest (RF), and support vector machine (SVM) regression were trained with measured thermal performance using a specific portion of the experimental data and tested with the remaining data. Two different train and test datasets were used with the ratio of experimental data as 90–10% and 80–20%, respectively. The highest accuracy ratio was determined at the end of the four methods with SVM regression as 96.01% when using the train and test datasets as 90–10%, respectively. The percent accuracy of the other models under the same conditions was calculated as 95.7, 90.87, and 78.36% for RF, kNN, and linear, respectively. [ABSTRACT FROM AUTHOR]

Specific language impairment (SLI) is one of the most common diseases in children, and early diagnosis can help to obtain better timely therapy economically. It is difficult and time-consuming for clinicians to accurately detect SLI through standard clinical assessments. Hence, machine learning algorithms have been developed to assist in the accurate diagnosis of SLI. This work aims to investigate the graph of the favipiravir molecule-based feature extraction function and propose an accurate SLI detection model using vowels. We proposed a novel handcrafted machine learning framework. This architecture comprises the favipiravir molecular structure pattern, statistical feature extractor, wavelet packet decomposition (WPD), iterative neighborhood component analysis (INCA), and support vector machine (SVM) classifier. Two feature extraction models, statistical and textural, are employed in the handcrafted feature generation methodology. A new nature-inspired graph-based feature extractor that uses the chemical depiction of the favipiravir (favipiravir became popular with the COVID-19 pandemic) is employed for feature extraction. Finally, the proposed favipiravir pattern, statistical feature extractor, and wavelet packet decomposition are used to create a feature vector. Moreover, a statistical feature extractor is used in this work. The WPD generates multilevel features, and the most meaningful features are selected using the NCA feature selector. Finally, these chosen features are fed to SVM classifier for automated classification. Two validation methods, (i) leave one subject out (LOSO) and (ii) tenfold cross-validations (CV), are used to obtain robust classification results. Our proposed favipiravir pattern-based model developed using a vowel dataset can detect SLI children with an accuracy of 99.87% and 98.86% using tenfold and LOSO CV strategies, respectively. These results demonstrated the high vowel classification ability of the proposed favipiravir pattern-based model. [ABSTRACT FROM AUTHOR]

The least squares support vector machine (LS-SVM) is an effective method to deal with classification and regression problems and has been widely studied and applied in the fields of machine learning and pattern recognition. The learning algorithms of the LS-SVM are usually conjugate gradient (CG) and sequential minimal optimization (SMO) algorithms. Based on this, we propose a conjugate functional gain SMO algorithm and theoretically prove its asymptotic convergence. This algorithm combines the conjugate direction method and the functional gain SMO algorithm with second-order information, which increases the functional gain of the plain SMO algorithm. In addition, we also provide a generalized SMO-type algorithm framework with a simple iterative format and easy implementation for other LS-SVM training algorithms. The numerical results show that the execution time of this algorithm is significantly shorter than that of the other plain SMO-type algorithms and CG-type algorithms. [ABSTRACT FROM AUTHOR]

Non-motor manifestations of Parkinson's disease (PD) appear early and have a significant impact on the quality of life of patients, but few studies have evaluated their predictive potential with machine learning algorithms. We evaluated 9 algorithms for discriminating PD patients from controls using a wide collection of non-motor clinical PD features from two databases: Biocruces (96 subjects) and PPMI (687 subjects). In addition, we evaluated whether the combination of both databases could improve the individual results. For each database 2 versions with different granularity were created and a feature selection process was performed. We observed that most of the algorithms were able to detect PD patients with high accuracy (>80%). Support Vector Machine and Multi-Layer Perceptron obtained the best performance, with an accuracy of 86.3% and 84.7%, respectively. Likewise, feature selection led to a significant reduction in the number of variables and to better performance. Besides, the enrichment of Biocruces database with data from PPMI moderately benefited the performance of the classification algorithms, especially the recall and to a lesser extent the accuracy, while the precision worsened slightly. The use of interpretable rules obtained by the RIPPER algorithm showed that simply using two variables (autonomic manifestations and olfactory dysfunction), it was possible to achieve an accuracy of 84.4%. Our study demonstrates that the analysis of non-motor parameters of PD through machine learning techniques can detect PD patients with high accuracy and recall, and allows us to select the most discriminative non-motor variables to create potential tools for PD screening. [ABSTRACT FROM AUTHOR]

Keyword extraction is one of the main problems in clustering and linking textual content. In literature, several machine learning approaches were proposed for keyword and keyphrase extraction. However, the state-of-the-art performance results are still below the expectations. In this paper, we propose a novel hybrid keyword extraction model, HybridKEM. The proposed model addresses the keyword extraction problem as a sequence labelling task. Naive Bayes (NB), Polynomial Regression (PR) Support Vector Machine (SVM), Multi-Layer Perceptron (MLP), and Random Forest (RF) classification algorithms were trained separately in the Token Classification module of the model. The Token Classification process was performed by using text, graphic, embedding, and set features in the model. The performance of the model was evaluated using the Inspec, Semeval-2017, 500N-KPCrowd datasets, which are widely used in studies in the literature, and two newly collected, TRDizinEn and DergiParkEn datasets. The model achieved an average F 1 -score of 0.664 for all datasets. The highest F 1 -score (0.74) was obtained with the TRDizinEn dataset. [ABSTRACT FROM AUTHOR]

This study focuses on using EEG signal-based behavioral biometric data to classify and identify persons. A person identification system based on a nonlinear model with excellent estimation accuracy was proposed. Six tasks were performed on all subjects utilizing EEG data collected from 64 channels and 96 subjects. The stages of this model included feature creation, feature selection, and classification. To generate features from EEG signals, statistical methods were used. Using neighborhood component analysis, the best 15 features were chosen. The selected feature vector was given as input to deep feature neural network (DNN) model and traditional ML classifier decision tree (DT), k-nearest neighbor (KNN), support vector machine (SVM), ensemble—random forest (RF) classifiers. The classification performance of the proposed methods for six tasks was separately tested and compared. The average accuracy of DT, RF, KNN, SVM and DNN classifiers for all tasks was 98.63%, 100%, 99.96%, 99.91%, and 100%, respectively. The results show that RF and DNN classifier-based models are highly effective in the classification and person identification using EEG signals. [ABSTRACT FROM AUTHOR]

Unsupervised clustering (e.g., K-means) and supervised machine learning [e.g., support vector machines (SVMs)] methods can be used in data-driven classification and predictive mapping of mineral prospectivity. In this study, the conceptual model of porphyry-type Cu deposits in Varzaghan district, Northwest Iran, was utilized to translate mineralization-related processes into mappable targeting criteria, resulting in six evidence layers derived from geochemical, geological, structural and remote sensing data. Then, traditional K-means clustering (KMC) method and a supervised SVM were employed to construct GIS-based mineral prospectivity maps. One of the challenging issues for generation of mineral prospectivity maps using clustering algorithms is to select suitable cluster centers (called centroids) in order to circumscribe the similar spatial features into meaningful clusters. Machine learning methods are strongly sensitive to hyperparameter values that contribute to prediction, as the prediction accuracy can significantly enhance when the optimized hyperparameters are calibrated to training procedure. To reach these goals, a genetic algorithm was incorporated into K-means and SVM in order to automatically select the optimized cluster centroids and tuned hyperparameters, respectively, and two new prospectivity models namely GKMC and genetic-based SVM were then generated. To evaluate the performance accuracy in training procedures of SVM and genetic-based SVM, K-fold cross-validation and confusion matrix were employed. Moreover, success-rate curves were plotted to compare the overall performance of unsupervised clustering models comprising KMC and GKMC and also supervised machine learning models comprising SVM and genetic-based SVM for detection of favorable areas associated with porphyry-type Cu mineralization. The results suggested the superiority of genetic-based SVM model over other models. [ABSTRACT FROM AUTHOR]

Language classification using speeches is a complex issue in machine learning and pattern recognition. Various text and image-based language classification methods have been presented. But there are limited speech-based language classification methods in the literature. Also, the previously presented models classified limited numbers of languages, and few are accents. This work presents an automated handcrafted language classification model. The novel pyramid pattern is presented to extract the features extraction. Also, statistical features and maximum pooling are used to generate the features. We have developed our speech-language classification model using two datasets: (i) created a new big speech dataset containing 14,500 speeches in 29 languages, and (ii) used the VoxForge dataset. The neighborhood component analysis method is used to select the most informative 1000 features from the generated features, and these features are classified using a quadratic support vector machine classifier (QSVM). Our developed method yielded 98.87 ± 0.30% and 97.12 ± 1.27% accuracies for our and VoxForge datasets, respectively. Also, geometric mean, average precision, and F1-score evaluation parameters are calculated, and they are presented in the results section. This paper presents an accurate language classification model developed using two big speech-language datasets. Our results indicate the success of the proposed pyramid pattern-based language classification method in classifying various speech languages accurately. [ABSTRACT FROM AUTHOR]

Machine learning (ML) is a fast-evolving field of artificial intelligence that has been applied in many domains due to the increasing availability of computerized databases, including materials science; for instance, validating crystal descriptors for energy prediction poses difficult problems. This work investigates machine learning models to substitute the laboratory crystal energy prediction using two- and three-body distribution functions as structural and atomic descriptors. To achieve this, ML algorithms were used notably ElasticNet, Bayesian Ridge, Random Forest, Support Vector Machine, and Deep Neural Networks to model structural descriptors. Moreover, a non-conventional Deep Neural Networks topology was developed and implemented to model atomic descriptors. Five-fold cross-validation procedure was performed on each model; quality assessment metrics were else used for testing and evaluation in order to identify the most robust descriptors. Finally, the best result of energy prediction was achieved by combining both two- and three-body atomic distribution functions. [ABSTRACT FROM AUTHOR]

In this study, the extreme learning machine, support vector machine, and deep learning models were used to predict the effect on the voting behavior of election music's used in the elections in Turkey. A questionnaire was conducted to measure the effect of election music on the voting behavior in Turkey. This questionnaire was applied face to face to 412 people. The twelve questions were used to determine the effect of the election music on the voters. The first eleven of these questions in the questionnaire was used as the input variables of the models. The last question was determined whether the election music affects the voting behavior or not. The last question was selected as the output variable of the models. The extreme learning machine, support vector machine, and deep learning models estimated the voting behavior with 98.32%, 92.02% and 99.08% accuracy, respectively. Moreover, the sensitivity analysis and t-test were performed for the input variables in the models. These analyses obtained that 7th question was the most important question on the questionnaire. This study found that politicians can be used the deep learning algorithm to estimate the voting behavior in elections. [ABSTRACT FROM AUTHOR]

One of the world's deadliest diseases is lung cancer. Based on a few features, machine learning techniques can help in the diagnosis of lung cancer. The performance of several classifiers: support vector machine (SVM), logistic regression (LR), Naïve Bayes (NB), random forest (RF), and K-nearest neighbor (KNN), was evaluated by the authors using the dataset available on Kaggle to create a systematic approach for the diagnosis of lung cancer disease based on readily observable signs and historical medical data without the requirement of CT scan images. The authors have proposed a novel approach for classification called Pearson correlation weighted KNN (PCWKNN), which is a modified version of KNN and uses Pearson correlation coefficient values to determine weights in a weighted KNN. The performance of the classifiers was evaluated using the hold-out validation method. SVM, LR, and RF were 96.77% accurate. NB obtained 95.16% accuracy. KNN achieved 91.93% accuracy. PCWKNN outperformed the employed classifiers and obtained an accuracy of 98.39%. Addressing the imperative for improved model generalization, the researchers utilized PCWKNN on an alternative, more extensive lung cancer dataset and subsequently broadened its application to diverse diseases, including the brain stroke dataset. The encouraging outcomes underscore PCWKNN's resilience and adaptability, suggesting its viability for real-world implementation. [ABSTRACT FROM AUTHOR]

Accurately predicting crop yield is essential for optimizing agricultural practices and ensuring food security. However, existing approaches often struggle to capture the complex interactions between various environmental factors and crop growth, leading to suboptimal predictions. Consequently, identifying the most important feature is vital when leveraging Support Vector Regressor (SVR) for crop yield prediction. In addition, the manual tuning of SVR hyperparameters may not always offer high accuracy. In this paper, we introduce a novel framework for predicting crop yields that address these challenges. Our framework integrates a new hybrid feature selection approach with an optimized SVR model to enhance prediction accuracy efficiently. The proposed framework comprises three phases: preprocessing, hybrid feature selection, and prediction phases. In preprocessing phase, data normalization is conducted, followed by an application of K-means clustering in conjunction with the correlation-based filter (CFS) to generate a reduced dataset. Subsequently, in the hybrid feature selection phase, a novel hybrid FMIG-RFE feature selection approach is proposed. Finally, the prediction phase introduces an improved variant of Crayfish Optimization Algorithm (COA), named ICOA, which is utilized to optimize the hyperparameters of SVR model thereby achieving superior prediction accuracy along with the novel hybrid feature selection approach. Several experiments are conducted to assess and evaluate the performance of the proposed framework. The results demonstrated the superior performance of the proposed framework over state-of-art approaches. Furthermore, experimental findings regarding the ICOA optimization algorithm affirm its efficacy in optimizing the hyperparameters of SVR model, thereby enhancing both prediction accuracy and computational efficiency, surpassing existing algorithms. [ABSTRACT FROM AUTHOR]

Parkinson’s disease (PD) is a prevalent neurodegenerative disorder affecting millions of people globally, with substantial health risks and economic burdens. This study aims to introduce an innovative hybrid approach combining deep learning and machine learning algorithms to improve the diagnosis of PD using handwriting dynamics indicative of Parkinson’s symptoms. The proposed approach integrates hybrid feature extraction using nine fine-tuned transfer learning models, i.e., InceptionV3, DenseNet201, EfficientNetB0, ResNet50, MobileNetV2, VGG16, Xception, NASNetMobile, and InceptionResNetV2. Initially, features from these models are used individually or in binary and ternary combinations. Given the limited sample size in PD datasets, some extracted features through fine-tuning may lack significance, and fully connected layers can lead to overfitting. To address this issue, Neighborhood Component Analysis (NCA) is employed to refine these features, retaining only the most informative ones. Finally, the selected features are classified using Support Vector Machines (SVM) maximizing the margin between classes and reducing the risk of overfitting. The proposed hybrid model achieves a state-of-the-art accuracy of 99.39% on the Parkinson Hand Drawings dataset. The combination of features extracted from DenseNet201, Xception, and NASNetMobile models, processed using NCA and SVM methods, has been identified as the most efficient model, balancing high accuracy with computational efficiency. Qualitative assessments further confirm the accuracy and reliability of the approach. [ABSTRACT FROM AUTHOR]

In this work, the application of three different Machine Learning algorithms, random forest (RF), support vector machine (SVM), and artificial neural network (ANN), to accurately classify ultra-low concentrations of Δ9-tetrahydrocannabinol in biological fluids such as saliva was successfully demonstrated. In doing so, experimental data consisting of the voltammetry signals of 0, 2, and 5 ng/mL of Δ9-tetrahydrocannabinol (THC) in synthetic and human saliva was employed. The dataset consists of person-to-person saliva variation and experimental variabilities in the procedure and artifacts. The results showed that RF was the most robust ML technique to classify different concentration levels of THC in the presence of a variety of variabilities in the experimental data, with an average training accuracy of 96% and an average testing accuracy of 87%. On the other hand, SVM and ANN models were susceptible to incoherencies in the experimental data. [ABSTRACT FROM AUTHOR]

Today, several tools and statistical techniques can be used to find profitable trading opportunities, particularly when it comes to predicting stock closing prices. Yet, a few studies have been done on daily low- and high-price predictions which are useful for estimating support and resistance prices and improving the timing of stock purchases and sales. In this paper, we suggest combining machine learning algorithms with seven statistical features to enhance the forecasts of the low and high prices for the upcoming 5 days. In the experiment, the performances of linear regression, k-nearest neighbor, support vector machine (SVM), and the enhanced bidirectional LSTM (Bi-LSTM) were compared. Our findings showed that the Bi-LSTM surpassed the competition with a low RMSE of 0.018, a decrease in the error of over 58% compared to SVM, and a reduction of 51% compared to the unimproved LSTM. The four implemented algorithms are accessible online through a web application that displays the trend for the upcoming 5 days together with projected lines for the best-selling price (the high price) and the best-purchasing price (the low price). [ABSTRACT FROM AUTHOR]

Convex optimization techniques are extensively applied to various models, algorithms, and applications of machine learning and data mining. For optimization-based classification methods, the sparsity principle can greatly help to select simple classifier models, while the single- and multi-kernel methods can effectively address nonlinearly separable problems. However, the limited sparsity and kernel methods hinder the improvement of the predictive accuracy, efficiency, iterative update, and interpretable classification model. In this paper, we propose a new Explainable Multi-sparsity Multi-kernel Nonconvex Optimization Least-squares Classifier (EM2NOLC) model, which is an optimization problem with a least-squares objective function and multi-sparsity multi-kernel nonconvex constraints, aiming to address the aforementioned issues. Based on reconstructed multiple kernel learning (MKL), the proposed model can extract important instances and features by finding the sparse coefficient and kernel weight vectors, which are used to compute importance or contribution to classification and obtain the explainable prediction. The corresponding EM2NOLC algorithm is implemented with the Alternating Direction Method of Multipliers (ADMM) method. On the real classification datasets, compared with the three ADMM classifiers of Linear Support Vector Machine Classifier, SVMC, Least Absolute Shrinkage and Selection Operator Classifier, the two MKL classifiers of SimpleMKL and EasyMKL, and the gradient descent classifier of Feature Selection for SVMC, our proposed EM2NOLC generally obtains the best predictive performance and explainable results with the least number of important instances and features having different contribution percentages. [ABSTRACT FROM AUTHOR]

Kernel methods are popular machine learning methods that provide automated pattern analysis of raw datasets. Of particular interest is Support Vector Machines that are used to solve supervised machine learning problems in many areas such as business, finance and healthcare. Nowadays, complex computations and data analytic tasks can be outsourced to specialized third parties. However, data owners might be reluctant to share their data especially when it includes sensitive information. Therefore, a need for privacy-preserving machine learning applications cannot be overstated. We present FHSVM: a Fast Homomorphic evaluation of non-linear SVM prediction on encrypted data using Fully Homomorphic Encryption. We provide design, implementation and several algorithmic and architectural optimizations such as novel packing strategies and parallel implementation to achieve real-time private prediction. We employed the CKKS FHE scheme to implement FHSVM under 128-bit security level. We evaluated FHSVM on a contemporary real-world large dataset compiled for anti-money laundering tasks in Bitcoin transactions. Empirical analysis demonstrates that homomorphic SVM prediction can be performed in 1.25 s on multi-core CPU platforms. In addition, FHSVM shows zero accuracy loss when compared to the non-privacy-preserving implementation. This shows that FHSVM is both computationally secure and fully utilizes the data. [ABSTRACT FROM AUTHOR]

Groundwater resources (GWR) play a crucial role in agricultural crop production, daily life, and economic progress. Therefore, accurate prediction of groundwater (GW) level will aid in the sustainable management of GWR. A comparative study was conducted to evaluate the performance of seven different ML models, such as random tree (RT), random forest (RF), decision stump, M5P, support vector machine (SVM), locally weighted linear regression (LWLR), and reduce error pruning tree (REP Tree) for GW level (GWL) prediction. The long-term prediction was conducted using historical GWL, mean temperature, rainfall, and relative humidity datasets for the period 1981–2017 obtained from two wells in the northwestern region of Bangladesh. The whole dataset was divided into training (1981–2008) and testing (2008–2017) datasets. The output of the seven proposed models was evaluated using the root mean square error (RMSE), mean absolute error (MAE), relative absolute error (RAE), root relative squared error (RRSE), correlation coefficient (CC), and Taylor diagram. The results revealed that the Bagging-RT and Bagging-RF models outperformed other ML models. The Bagging-RT models can effectively improve prediction precision as compared to other models with RMSE of 0.60 m, MAE of 0.45 m, RAE of 27.47%, RRSE of 30.79%, and CC of 0.96 for Rajshahi and RMSE of 0.26 m, MAE of 0.18 m, RAE of 19.87%, RRSE of 24.17%, and 0.97 for Rangpur during training, and RMSE of 0.60 m, MAE of 0.40 m, RAE of 24.25%, RRSE of 29.99%, and CC of 0.96 for Rajshahi and RMSE of 0.38 m, MAE of 0.24 m, RAE of 23.55%, RRSE of 31.77%, and CC of 0.95 for Rangpur during testing stages, respectively. Our study offers an effective and practical approach to the forecast of GWL that could help to formulate policies for sustainable GWR management. [ABSTRACT FROM AUTHOR]

Breast cancer is one of the common disease in female gender population all over the world. The classical methods of segmentation and classification for malignant cells are not only repetitive but also very time-consuming. Therefore, a computer-aided diagnosis is needed for automatic segmentation and classification of malignant cells in breast cytology images. In this article, a machine learning-based approach is proposed for malignant cell segmentation and classification in breast cytology images. In the proposed approach, the segmentation of cells is performed by a level set algorithm which is used to extract statistical information related to the malignant and benign cells. Similarly, the gray level co-occurrence matrix is computed to exploit the texture information, and support vector machine-based classification is used for the classification of malignant and benign cells. It has been observed through experiments that the proposed approach achieved high accuracy (96.3%) in the classification of malignant and benign cells. [ABSTRACT FROM AUTHOR]

The recognition of stomatological disorders and the classification of dental caries are important areas of biomedicine that can hugely benefit from machine learning tools for the construction of relevant mathematical models. This paper explores the possibility of using reflectivity data to distinguish between healthy tissues and caries by deep learning and multilayer convolutional neural networks. The experimental data set includes more than 700 observations recorded in the stomatology laboratory. For rigor, the results obtained from the deep learning systems are compared with those evaluated for selected sets of features estimated for each observation and classified by a decision tree, support vector machine (SVM), k-nearest neighbor, Bayesian methods, and two-layer neural networks. The classification accuracy obtained for the deep learning systems was 98.1% and 94.4% for data in the signal and spectral domains, respectively, in comparison with an accuracy of 97.2% and 87.2% evaluated by the SVM method. The proposed method conclusively demonstrates how the artificial intelligence and deep learning methodology can contribute to improved diagnosis of dental problem in stomatology. [ABSTRACT FROM AUTHOR]

Suspicious volumetric tumor (SVT) segmentation of a CT-image (CT i ) and analysing changes in the volume of tumor is a significantly challenging task for the identification of lung cancer. In this regard, we design a two-step suspicious volumetric tumor segmentation (SVTS) approach based on an adaptive multiple resolution contour (AMRC) models for effective SVT segmentation. First, the high-intensity-pixels edge centroid of SVT (HECS) method is designed to identify the SVT location in CT i , and these outcomes are subsequently conceding threshold values to fix the level set method (LSM). Second, HECS outcomes are recognised using particle swarm optimisation (PSO) which is harmonised twin support vector machines (TSVM) to achieve segmentation accuracy. An open-source tumor cancer imaging archive (TCIA) dataset, 529 abnormal tissues (ATs) of the lung from the lung image database consortium (LIDC), are conceded to assess the performance of the SVT segmentation approach. The average segmentation accuracy of NLTC, TCIA, and LIDC datasets are 73.19%, 76.21% and 75.89%, respectively, compared with standard benchmark approaches. Subsequently, our framework efficiently classified the normal and abnormal CT i based on the SVT segmentation accuracy rate. [ABSTRACT FROM AUTHOR]