Search

Pervasive computing, human–computer interaction, human behavior analysis, and human activity recognition (HAR) fields have grown significantly. Deep learning (DL)-based techniques have recently been effectively used to predict various human actions using time series data from wearable sensors and mobile devices. The management of time series data remains difficult for DL-based techniques, despite their excellent performance in activity detection. Time series data still has several problems, such as difficulties in heavily biased data and feature extraction. For HAR, an ensemble of Deep SqueezeNet (SE) and bidirectional long short-term memory (BiLSTM) with improved flower pollination optimization algorithm (IFPOA) is designed to construct a reliable classification model utilizing wearable sensor data in this research. The significant features are extracted automatically from the raw sensor data by multi-branch SE-BiLSTM. The model can learn both short-term dependencies and long-term features in sequential data due to SqueezeNet and BiLSTM. The different temporal local dependencies are captured effectively by the proposed model, enhancing the feature extraction process. The hyperparameters of the BiLSTM network are optimized by the IFPOA. The model performance is analyzed using three benchmark datasets: MHEALTH, KU-HAR, and PAMPA2. The proposed model has achieved 99.98%, 99.76%, and 99.54% accuracies on MHEALTH, KU-HAR, and PAMPA2 datasets, respectively. The proposed model performs better than other approaches from the obtained experimental results. The suggested model delivers competitive results compared to state-of-the-art techniques, according to experimental results on four publicly accessible datasets.

The diagnosis of different pathologies and stages of cancer using whole histopathology slide images (WSI) is the gold standard for determining the degree of tissue metastasis. The use of deep learning systems in the field of medical images, especially histopathology images, is becoming increasingly important. The training and optimization of deep neural network models involve fine-tuning parameters and hyperparameters such as learning rate, batch size (BS), and boost to improve the performance of the model in task-specific applications. Tuning hyperparameters is a major challenge in designing deep neural network models, having a large impact on the performance. This paper analyzes how the parameters and hyperparameters of a deep learning architecture affect the classification of colorectal cancer (CRC) histopathology images using the well-known VGG19 model. This paper also discusses the pre-processing of these images, such as the use of color normalization and stretching transformations on the data set. Among these hyperparameters, the most important neural network hyperparameter is the learning rate (LR). In this paper, different strategies for the optimization of LR are analyzed (both static and dynamic) and a new experiment based on the variation of LR is proposed (the relevance of dynamic strategies over fixed LR is highlighted), after each layer of the neural network together with decreasing variations according to the epochs. The results obtained are very remarkable, obtaining in the simulation an accurate system that achieves 96.4% accuracy on test images (for nine different tissue classes) using the triangular-cyclic learning rate.

Motor Imagery (MI) classification using electroencephalography (EEG) has been extensively applied in healthcare scenarios for rehabilitation aims. EEG signal decoding is a difficult process due to its complexity and poor signal-to-noise ratio. Convolutional neural networks (CNN) have demonstrated their ability to extract time–space characteristics from EEG signals for better classification results. However, to discover dynamic correlations in these signals, CNN models must be improved. Hyperparameter choice strongly affects the robustness of CNNs. It is still challenging since the manual tuning performed by domain experts lacks the high performance needed for real-life applications. To overcome these limitations, we presented a fusion of three optimum CNN models using the Average Ensemble strategy, a method that is utilized for the first time for MI movement classification. Moreover, we adopted the Bayesian Optimization (BO) algorithm to reach the optimal hyperparameters' values. The experimental results demonstrate that without data augmentation, our approach reached 92% accuracy, whereas Linear Discriminate Analysis, Support Vector Machine, Random Forest, Multi-Layer Perceptron, and Gaussian Naive Bayes achieved 68%, 70%, 58%, 64%, and 40% accuracy, respectively. Further, we surpassed state-of-the-art strategies on the BCI competition IV-2a multiclass MI database by a wide margin, proving the benefit of combining the output of CNN models with automated hyperparameter tuning. [ABSTRACT FROM AUTHOR]

This research aims to propose a version of Fast Genetic Algorithm (FGA), namely Fitness Value Memoization Genetic Algorithm (FVMGA). FVMGA uses the concept of memoization to cache the fitness value of chromosomes that have already been calculated before. It allows FVMGA to bypass unnecessary computation for redundant chromosome configurations, which is especially important when we use expensive fitness functions. For benchmarking purposes, the proposed FVMGA was compared to a traditional GA in the use case of optimizing Long Short-Term Memory (LSTM) hyperparameters for time-series forecasting. Four hyperparameters were being optimized in this study with a total of 38,000 possible combinations. However, the number was drastically reduced to 1,000 with the use of GA. The final results showed that FVMGA was able to compute up to 291% faster than traditional GA while maintaining the quality of the produced models. [ABSTRACT FROM AUTHOR]

Cement-based materials are widely used in transportation, construction, national defense, and other fields, due to their excellent properties. High performance, low energy consumption, and environmental protection are essential directions for the sustainable development of cement-based materials. To alleviate the environmental pressure caused by carbon emissions in cement production, this paper studies cement-based materials containing metakaolin by a comparison of prediction models for the compressive strength. To more accurately evaluate the compressive strength of metakaolin cement-based materials, this paper compares the prediction effects of four models, namely, support vector machine (SVM), decision tree (DT), k-nearest neighbor (KNN), and random forest (RF), with hyperparameters optimized by the Firefly Algorithm (FA) to study the compressive strength of cement-based materials containing metakaolin. The results demonstrated that the RF model showed the optimized prediction effect considering the lowest RSME value and the highest R value among the hybrid models for predicting metakaolin cement-based materials' compressive strength. The importance test showed that the cement grade and the water-to-binder ratio greatly influence the compressive strength of cement-based materials with metakaolin compared to the other design parameters. [ABSTRACT FROM AUTHOR]

Cement-based materials are widely used in construction engineering because of their excellent properties. With the continuous improvement of the functional requirements of building infrastructure, the performance requirements of cement-based materials are becoming higher and higher. As an important property of cement-based materials, compressive strength is of great significance to its research. In this study, a Random Forests (RF) and Firefly Algorithm (FA) hybrid machine learning model was proposed to predict the compressive strength of metakaolin cement-based materials. The database containing five input parameters (cement grade, water to binder ratio, cement-sand ratio, metakaolin to binder ratio, and superplasticizer) based on 361 samples was employed for the prediction. In this model, FA was used to optimize the hyperparameters, and RF was used to predict the compressive strength of metakaolin cement-based materials. The reliability of the hybrid model was verified by comparing the predicted and actual values of the dataset. The importance of five variables was also evaluated, and the results showed the cement grade has the greatest influence on the compressive strength of metakaolin cement-based materials, followed by the water-binder ratio. [ABSTRACT FROM AUTHOR]

To accurately estimate the dynamic properties of the asphalt mixtures to be used in the Mechanistic-Empirical Pavement Design Guide (MEPDG), a novel neural computing model using the improved beetle antennae search was developed. Asphalt mixtures were designed conventionally by eight types of aggregate gradations and two types of asphalt binders. The dynamic modulus (DM) tests were conducted under 3 temperatures and 3 loading frequencies to construct 144 datasets for the machine learning process. A novel neural network model was developed by using an improved beetle antennae search (BAS) algorithm to adjust the hyperparameters more efficiently. The predictive results of the proposed model were determined by R and RMSE and the importance score of the input parameters was assessed as well. The prediction performance showed that the improved BAS algorithm can effectively adjust the hyperparameters of the neural network calculation model, and built the asphalt mixture DM prediction model has higher reliability and effectiveness than the random hyperparameter selection. The mixture model can accurately evaluate and predict the DM of the asphalt mixture to be used in MEPDG. The dynamic shear modulus of the asphalt binder is the most important parameter that affects the DM of the asphalt mixtures because of its high correlation with the adhesive effect in the composition. The phase angle of the binder showed the highest influence on the DM of the asphalt mixtures in the remaining variables. The importance of these influences can provide a reference for the future design of asphalt mixtures. [ABSTRACT FROM AUTHOR]

Over the past few decades, convolutional neural networks (CNNs) have achieved outstanding results in addressing a broad scope of computer vision problems. Despite these improvements, fully convolutional Siamese neural networks (FCSNN) still hardly adapt to complex scenes, such as appearance change, scale change, similar objects interference, etc. The present study focuses on an enhanced FCSNN based on convolutional block hyperparameters optimization, a new activation function (ModReLU) and Gaussian low pass filter. The optimization of hyperparameters is an important task, as it has a crucial ascendancy on the tracking process performance, especially when it comes to the initialization of weights and bias. They have to work efficiently with the following activation function layer. Inadequate initialization can result in vanishing or exploding gradients. In the first method, we propose an optimization strategy for initializing weights and bias in the convolutional block to ameliorate the learning of features so that each neuron learns as much as possible. Next, the activation function normalizes the output. We implement the convolutional block hyperparameters optimization by setting the convolutional weights initialization to constant, the bias initialization to zero and the Leaky ReLU activation function at the output. In the second method, we propose a new activation, ModReLU, in the activation layer of CNN. Additionally, we also introduce a Gaussian low pass filter to minimize image noise and improve the structures of images at distinct scales. Moreover, we add a pixel-domain-based color adjustment implementation to enhance the capacity of the proposed strategies. The proposed implementations handle better rotation, moving, occlusion and appearance change problems and improve tracking speed. Our experimental results clearly show a significant improvement in the overall performance compared to the original SiamFC tracker. The first proposed technique of this work surpasses the original fully convolutional Siamese networks (SiamFC) on the VOT 2016 dataset with an increase of 15.42% in precision, 16.79% in AUPC and 15.93% in IOU compared to the original SiamFC. Our second proposed technique also reveals remarkable advances over the original SiamFC with 18.07% precision increment, 17.01% AUPC improvement and an increase of 15.87% in IOU. We evaluate our methods on the Visual Object Tracking (VOT) Challenge 2016 dataset, and they both outperform the original SiamFC tracker performance and many other top performers. [ABSTRACT FROM AUTHOR]

Deep learning techniques, particularly convolutional neural networks (CNNs), have exhibited remarkable performance in solving vision-related problems, especially in unpredictable, dynamic, and challenging environments. In autonomous vehicles, imitation-learning-based steering angle prediction is viable due to the visual imagery comprehension of CNNs. In this regard, globally, researchers are currently focusing on the architectural design and optimization of the hyperparameters of CNNs to achieve the best results. Literature has proven the superiority of metaheuristic algorithms over the manual-tuning of CNNs. However, to the best of our knowledge, these techniques are yet to be applied to address the problem of imitation-learning-based steering angle prediction. Thus, in this study, we examine the application of the bat algorithm and particle swarm optimization algorithm for the optimization of the CNN model and its hyperparameters, which are employed to solve the steering angle prediction problem. To validate the performance of each hyperparameters' set and architectural parameters' set, we utilized the Udacity steering angle dataset and obtained the best results at the following hyperparameter set: optimizer, Adagrad; learning rate, 0.0052; and nonlinear activation function, exponential linear unit. As per our findings, we determined that the deep learning models show better results but require more training epochs and time as compared to shallower ones. Results show the superiority of our approach in optimizing CNNs through metaheuristic algorithms as compared with the manual-tuning approach. Infield testing was also performed using the model trained with the optimal architecture, which we developed using our approach. [ABSTRACT FROM AUTHOR]

With the advancements in Internet technologies, a huge amount of images are transferred over the public networks. Therefore, during the transmission process, the images are prone to various security threats. To protect images against any unauthorized access, many researchers have designed various approaches such as encryption, stenography, and visual cryptography. Each approach has its own benefits over the others. The main objective of this paper is to design an efficient image encryption approach. Initially, various image encryption approaches have been studied. It is found that the majority of the existing image encryption approaches suffer from the hyperparameters tuning problem. Also, it is desirable to develop secret keys which are highly sensitive to plain images. Therefore, in this paper, an improved seven-dimensional hyperchaotic system (i7DHS) is adopted to generate secret keys. But, i7DHS is sensitive to its initial parameters. Therefore, a dual local search-based evolutionary algorithm (DEA) is utilized to tune the initial parameters of i7DHS. The computed optimal keys are utilized to encrypt the input images. Performance analysis shows that DEA-based i7DHS outperforms the competitive approaches. DEA-based i7DHS is highly sensitive to the input images and has large secret key space. It is found that DEA-based i7DHS can resist various security attacks. [ABSTRACT FROM AUTHOR]

Spiking neural networks are the third generation of artificial neural networks that are inspired by a new brain-inspired computational model of ANN. Spiking neural network encodes and processes neural information through precisely timed spike trains. eSNN is an enhanced version of SNN, motivated by the principles of Evolving Connectionist System (ECoS), which is relatively a new classifier in the neural information processing area. The performance of eSNN is highly influenced by the values of its significant hyperparameters' modulation factor (mod), threshold factor (c), and similarity factor (sim). In contrast to the manual tuning of hyperparameters, automated tuning is more reliable. Therefore, this research presents an optimizer-based eSNN architecture, intended to solve the issue regarding optimum hyperparameters' values' selection of eSNN. The proposed model is named eSNN-SSA where SSA stands for salp swarm algorithm, which is a metaheuristic optimization technique integrated with eSNN architecture. For the integration of eSNN-SSA, Thorpe's standard model of eSNN is used with population rate encoding. To examine the performance of eSNN-SSA, various benchmarking data sets from the UCR/UAE time-series classification repository are utilized. From the experimental results, it is concluded that the salp swarm algorithm plays an effective role in improving the flexibility of the eSNN. The proposed eSNN-SSA offers solutions to conquer the disadvantages of eSNN in determining the best number of pre-synaptic neurons for time-series classification problems. The performance accuracy obtained by eSNN-SSA was on datasets spoken Arabic digits, articulatory word recognition, character trajectories, wafer, and GunPoint, i.e., 0.96, 0.97, 0.94, 1.0, and 0.94, respectively. The proposed approach outperformed standard eSNN in terms of time complexity. [ABSTRACT FROM AUTHOR]

This study relates to an Optimized Convolutional Neural Network-based Multi-gas Optical Sensor (OCNN-MOS) developed using photonic crystals. A square-shaped dielectric rod with cubic lattice index was used for the detection of different gases, namely, N2, CH4 and CO. Three nanocavities were present in the proposed OCNN-MOS, with one nanocavity located at the centre (refractive index 2.6) and the other two were the sub-nanocavities located along the path of the output and input respectively. A grey wolf optimization technique was used for optimizing its hyperparameters and for the improvement of its performance. The proposed OCNN-MOS was connected with a clean air generator for diluting the flow of hydrocarbon, a flow controller, and three standard sample gas cylinders for the conduction of the experiment. A concentrated gas mixture of 60–200 ppm was used in the experiment. The proposed optimization achieved an improvement of 7.06% in the performance of CNN. [ABSTRACT FROM AUTHOR]

Considering the dynamics of the economic environment and the amount of data generated every second, the decision-making process is changing and becomes data driven, highly influencing the business strategies setup in order to keep the competitive advantage. However, without technology, data analysis would not be feasible, reason why machine learning is seen as a disruptive innovation for businesses, especially due to its capacity to convert data into actionable outcomes. Though, for a high-quality machine learning model result, algorithm selection and hyperparameters optimization play vital roles, hence became high-interest topics in the field. To achieve this, various automatic selection methods have been proposed and the aim of this paper is to compare two of them – GridSearch and RandomizedSearch - and assess their impact on the model accuracy by comparing with the results obtained when default hyperparameters were applied.

The sap flow of plants directly indicates their water requirements and provides farmers with a good understanding of a plant’s water consumption. Water management can be improved based on this information. This study focuses on forecasting tomato sap flow in relation to various climate and irrigation variables. The proposed study utilizes different machine learning (ML) techniques, including linear regression (LR), least absolute shrinkage and selection operator (LASSO), elastic net regression (ENR), support vector regression (SVR), random forest (RF), gradient boosting (GB) and decision tree (DT). The forecasting performance of different ML techniques is evaluated. The results show that RF offers the best performance in predicting sap flow. SVR performs poorly in this study. Given water/m2, room temperature, given water EC, humidity and plant temperature are the best predictors of sap flow. The data are obtained from the Ideal Lab greenhouse, in the Netherlands, in the framework of the European Funds for Regionale Ontwikkeling (EFRO) EVERGREEN Greenport Noord Holland Noord project (2018-2020).

In recent years, the penetration of solar power at residential and utility levels has progressed exponentially. However, due to its stochastic nature, the prediction of solar global horizontal irradiance (GHI) with higher accuracy is a challenging task; but, vital for grid management: planning, scheduling & balancing. Therefore, this paper proposes an ensemble model using the extended scope of wavelet transform (WT) and bidirectional long short term memory (BiLSTM) deep learning network to forecast 24-h ahead solar GHI. The WT decomposes the input time series data into different finite intrinsic model functions (IMF) to extract the statistical features of input time series. Further, the study reduces the number of IMF series by combining the wavelet decomposed components (D1-D6) series on the basis of comprehensive experimental analysis with an aim to improve the forecasting accuracy. Next, the trained standalone BiLSTM networks are allocated to each IMF sub-series to execute the forecasting. Finally, the forecasted values of each sub-series from BiLSTM networks are reconstructed to deliver the final solar GHI forecast. The study performed monthly solar GHI forecasting for one year dataset using one month moving window mechanism for the location of Ahmedabad, Gujarat, India. For the performance comparison, the naïve predictor as a benchmark model, standalone long short term memory (LSTM), gated recurrent unit (GRU), BiLSTM and two other wavelet-based BiLSTM models are also simulated. From the results, it is observed that the proposed model outperforms other models in terms of root mean square error (RMSE) & mean absolute percentage error (MAPE), coefficient of determination (R2) and forecast skill (FS). The proposed model reduces the monthly average RMSE by range from 26.04–58.89%, 5.17–31.35%, 23.26–56.06% & 21.08–57% in comparison with benchmark, standalone BiLSTM, GRU & LSTM networks respectively. On the other hand, the monthly average MAPE is reduced by range from 9 to 51.18%, 12.59–28.14%, 30.43–59.19% & 26.54–58.92% in comparison to benchmark, standalone BiLSTM, GRU & LSTM respectively. Further, the proposed model obtained the value of R2 equal to 0.94 and forecast skill (%) of 47% with reference to the benchmark model. [ABSTRACT FROM AUTHOR]

Recently, deep learning (DL) became one of the essential tools in bioinformatics. A modified convolutional neural network (CNN) is employed in this paper for building an integrated model for deoxyribonucleic acid (DNA) classification. In any CNN model, convolutional layers are used to extract features followed by max-pooling layers to reduce the dimensionality of features. A novel method based on downsampling and CNNs is introduced for feature reduction. The downsampling is an improved form of the existing pooling layer to obtain better classification accuracy. The two-dimensional discrete transform (2D DT) and two-dimensional random projection (2D RP) methods are applied for downsampling. They convert the high-dimensional data to low-dimensional data and transform the data to the most significant feature vectors. However, there are parameters which directly affect how a CNN model is trained. In this paper, some issues concerned with the training of CNNs have been handled. The CNNs are examined by changing some hyperparameters such as the learning rate, size of minibatch, and the number of epochs. Training and assessment of the performance of CNNs are carried out on 16S rRNA bacterial sequences. Simulation results indicate that the utilization of a CNN based on wavelet subsampling yields the best trade-off between processing time and accuracy with a learning rate equal to 0.0001, a size of minibatch equal to 64, and a number of epochs equal to 20. [ABSTRACT FROM AUTHOR]

An accurate forecasting of solar irradiation plays a vital role in grid balancing, scheduling, and maintenance. With this aim, a deep learning solar forecasting model based on dual decomposition with error correction strategy is proposed in this paper. In this model, historical time series of solar irradiance and error series are decomposed using complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN) and variational mode decomposition (VMD), respectively. The bidirectional long short-term memory (BiLSTM) deep learning (DL) network is used with each series to extract the different long- and short-term characteristics of the data. To observe the forecasting accuracy of the proposed model, nine contrast models are built to estimate one to three steps ahead solar irradiance for two different locations. The experimental results demonstrate that the proposed model achieved lower RMSE (1.81 W/m2–28.46 W/m2) and MAPE (0.2–4.40%) compared to the considered models. It improves the RMSE (17.55–72.82%) and MAPE (2.65–74.66%) over a non-error correction strategy-based hybrid model. In addition, the improvement in RMSE (13.82–65.10%) and MAPE (11.46–68.33%) are observed over single decomposition-based error correction model. Moreover, to validate the forecasting performance of the proposed model Diebold–Mariano Hypothesis (DMH) test, percentage improvement and its behavior in different weather conditions are also presented. [ABSTRACT FROM AUTHOR]

The work reported in this article explores a novel Particle Swarm Optimization (PSO) tuned Support Vector Regression (SVR) based technique to develop the small-signal behavioral model for GaN High Electron Mobility Transistor (HEMT). The proposed technique investigates issues such as kernel selection and model optimization usually encountered in the application of SVR to model the GaN based HEMT devices. Here, the PSO algorithm is utilized to find the optimal hyperparameters to minimize the fitness function. To enumerate the efficiency and the generalization capability of the predictors, the performance of the model is investigated in terms of mean square error (MSE) and mean relative error (MRE). A very good agreement is found between the measured S-parameters and the proposed model for multi-biasing sets over the complete frequency range of 1GHz-18GHz. The proposed technique is even used to test the frequency extrapolation capability of the model. A comparative analysis indicates that the proposed PSO-SVR predictor achieves significantly improved computational efficiency and the overall prediction accuracy. To demonstrate the ready usefulness of the modeling approach, the developed model has been incorporated in CAD environment using MATLAB Cosimulation in ADS Ptolemy. Subsequently, the small-signal stability analysis is performed and gain of a power amplifier configuration designed using the proposed GaN HEMT model is determined.

Aggregating multiple learners through an ensemble of models aim to make better predictions by capturing the underlying distribution of the data more accurately. Different ensembling methods, such as bagging, boosting, and stacking/blending, have been studied and adopted extensively in research and practice. While bagging and boosting focus more on reducing variance and bias, respectively, stacking approaches target both by finding the optimal way to combine base learners. In stacking with the weighted average, ensembles are created from weighted averages of multiple base learners. It is known that tuning hyperparameters of each base learner inside the ensemble weight optimization process can produce better performing ensembles. To this end, an optimization-based nested algorithm that considers tuning hyperparameters as well as finding the optimal weights to combine ensembles (Generalized Weighted Ensemble with Internally Tuned Hyperparameters (GEM-ITH)) is designed. Besides, Bayesian search was used to speed-up the optimizing process and a heuristic was implemented to generate diverse and well-performing base learners. The algorithm is shown to be generalizable to real data sets through analyses with ten publicly available data sets.

Compressive sensing is a sub-Nyquist sampling technique for efficient signal acquisition and reconstruction of sparse or compressible signals. In order to account for the sparsity of the underlying signal of interest, it is common to use sparsifying priors such as Bernoulli–Gaussian-inverse Gamma (BGiG) and Gaussian-inverse Gamma (GiG) priors on the components of the signal. With the introduction of variational Bayesian inference, the sparse Bayesian learning (SBL) methods for solving the inverse problem of compressive sensing have received significant interest as the SBL methods become more efficient in terms of execution time. In this paper, we consider the sparse signal recovery problem using compressive sensing and the variational Bayesian (VB) inference framework. More specifically, we consider two widely used Bayesian models of BGiG and GiG for modeling the underlying sparse signal for this problem. Although these two models have been widely used for sparse recovery problems under various signal structures, the question of which model can outperform the other for sparse signal recovery under no specific structure has yet to be fully addressed under the VB inference setting. Here, we study these two models specifically under VB inference in detail, provide some motivating examples regarding the issues in signal reconstruction that may occur under each model, perform comparisons and provide suggestions on how to improve the performance of each model.

The quality characteristic(s) are assumed to follow the normal distribution in many control chart constructions, although this assumption may not hold in some instances. This study proposes the Bayesian-I and Bayesian-II Shewhart-type control charts for monitoring the Maxwell scale parameter in the phase II study. The posterior and predictive distributions are used to construct the control limits for the proposed Bayesian-I and Bayesian-II Shewhart-type control charts, respectively. Various performance indicators, including average run length, quadratic loss, relative average run length, and performance comparison index, are utilized to evaluate the performance of the proposed control charts. The Bayesian-I and Bayesian-II Shewhart-type control charts are compared to their competitive CUSUMV, EWMAV and V control charts. Sensitivity analysis is also performed to study the effect of hyperparameter values on the performance behavior of the proposed control charts. Finally, real-life data is analyzed for the implementation of the proposed control charts.

The performance of predicted models is greatly affected when the dataset is highly imbalanced and the sample size increases. Imbalanced training data have a major negative impact on performance. Currently, machine learning algorithms continue to be developed so that they can be optimized using various methods to produce the model with the best performance. One way of optimization with apply hyperparameter tuning. In classification, most of the algorithms have hyperparameters. One of the popular hyperparameter methodologies is Grid Search. GridSearch using Cross Validation makes it easy to test each model parameter without having to do manual validation one by one. In this study, we will use a method in hyperparameter optimization, namely Grid Search. The purpose of this study is to find out the best optimization of hyperparameters for two machine learning classification algorithms that are widely used to handle imbalanced data cases. Validation of the experimental results uses the mean cross-validation measurement metric. The experimental results show that the KNN model gets the best value compared to the Decision Tree.

As a new type of riser connecting offshore platforms and submarine pipelines, steel catenary risers (SCRs) are generally subject to waves and currents for a long time, thus it is significant to fully evaluate the SCR structure’s safety. Aiming at the damage identification of the SCR, the acceleration time series signals at multiple locations are taken as the damage characteristics. The damage characteristics include spatial information of the measurement point location and time information of the acquisition signal. Therefore, a convolutional neural network (CNN) is employed to obtain spatial information. Considering the variable period characteristics of the acceleration time series of the SCR, a gated recurrent unit (GRU) neural network is utilized to study these characteristics. However, neither a single CNN nor GRU model can simultaneously obtain temporal and spatial data information. Therefore, by combining a CNN with a GRU, the CNN-GRU model is established. Moreover, the hyperparameters of deep learning models have a significant influence on their performance. Therefore, particle swarm optimization (PSO) is applied to solve the hyperparameter optimization problem of the CNN-GRU. Thus, the PSO-CNN-GRU (PCG) model is established. Subsequently, an SCR damage identification method based on the PCG model is presented to predict the damage location and degree by SCR acceleration time series. By analyzing the SCR acceleration data, the prediction performances of the PCG model and the PSO optimization capacity are verified. The experimental results indicate that the identification result of the proposed PCG model is better than that of several existing models (CNN, GRU, and CNN-GRU).

Cardiovascular disease (CVD) is connected with irregular cardiac electrical activity, which can be seen in ECG alterations. Due to its convenience and non-invasive aspect, the ECG is routinely exploited to identify different arrhythmias and automatic ECG recognition is needed immediately. In this paper, enhancement for the detection of CVDs such as Ventricular Tachycardia (VT), Premature Ventricular Contraction (PVC) and ST Change (ST) arrhythmia using different dimensionality reduction techniques and multiple classifiers are presented. Three-dimensionality reduction methods, such as Local Linear Embedding (LLE), Diffusion Maps (DM), and Laplacian Eigen (LE), are employed. The dimensionally reduced ECG samples are further feature selected with Cuckoo Search (CS) and Harmonic Search Optimization (HSO) algorithms. A publicly available MIT-BIH (Physionet) - VT database, PVC database, ST Change database and NSR database were used in this work. The cardiac vascular disturbances are classified by using seven classifiers such as Gaussian Mixture Model (GMM), Expectation Maximization (EM), Non-linear Regression (NLR), Logistic Regression (LR), Bayesian Linear Discriminant Analysis (BDLC), Detrended Fluctuation Analysis (Detrended FA), and Firefly. For different classes, the average overall accuracy of the classification techniques is 55.65 % when without CS and HSO feature selection, 64.36 % when CS feature selection is used, and 75.39 % when HSO feature selection is used. Also, to improve the performance of classifiers, the hyperparameters of four classifiers (GMM, EM, BDLC and Firefly) are tuned with the Adam and Grid Search Optimization (GSO) approaches. The average accuracy of classification for the CS feature-based classifiers that used GSO and Adam hyperparameter tuning was 79.92 % and 85.78 %, respectively. The average accuracy of classification for the HSO feature-based classifiers that used GSO and Adam hyperparameter tuning was 86.87 % and 93.77 %, respectively. The performance of the classifier is analyzed based on the accuracy parameter for both with and without feature selection methods and with hyperparameter tuning techniques. In the case of ST vs. NSR, a higher accuracy of 98.92 % is achieved for the LLE dimensionality reduction with HSO feature selection for the GMM classifier with Adam's hyperparameter tuning approach. The GMM classifier with the Adam hyperparameter tuning approach with 98.92 % accuracy in detecting ST vs. NSR cardiac disease is outperforming all other classifiers and methodologies., Competing Interests: The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (© 2024 The Authors.)

Implementing diabetes surveillance systems is paramount to mitigate the risk of incurring substantial medical expenses. Currently, blood glucose is measured by minimally invasive methods, which involve extracting a small blood sample and transmitting it to a blood glucose meter. This method is deemed discomforting for individuals who are undergoing it. The present study introduces an Explainable Artificial Intelligence (XAI) system, which aims to create an intelligible machine capable of explaining expected outcomes and decision models. To this end, we analyze abnormal glucose levels by utilizing Bi-directional Long Short-Term Memory (Bi-LSTM) and Convolutional Neural Network (CNN). In this regard, the glucose levels are acquired through the glucose oxidase (GOD) strips placed over the human body. Later, the signal data is converted to the spectrogram images, classified as low glucose, average glucose, and abnormal glucose levels. The labeled spectrogram images are then used to train the individualized monitoring model. The proposed XAI model to track real-time glucose levels uses the XAI-driven architecture in its feature processing. The model's effectiveness is evaluated by analyzing the performance of the proposed model and several evolutionary metrics used in the confusion matrix. The data revealed in the study demonstrate that the proposed model effectively identifies individuals with elevated glucose levels., Competing Interests: The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (© 2024 The Authors.)

An efficient fake news detector becomes essential as the accessibility of social media platforms increases rapidly. Previous studies mainly focused on designing the models solely based on individual data sets and might suffer from degradable performance. Therefore, developing a robust model for a combined data set with diverse knowledge becomes crucial. However, designing the model with a combined data set requires extensive training time and sequential workload to obtain optimal performance without having some prior knowledge about the model's parameters. The presented study here will help solve these issues by introducing the unified training strategy to have a base structure for the classifier and all hyperparameters from individual models using a pretrained transformer model. The performance of the proposed model is noted using three publicly available data sets, namely ISOT and others from the Kaggle website. The results indicate that the proposed unified training strategy surpassed the existing models such as Random Forests, convolutional neural networks, and long short-term memory, with 97% accuracy and achieved the F1 score of 0.97. Furthermore, there was a significant reduction in training time by almost 1.5 to 1.8 × by removing words lower than three letters from the input samples. We also did extensive performance analysis by varying the number of encoder blocks to build compact models and trained on the combined data set. We justify that reducing encoder blocks resulted in lower performance from the obtained results.

The number of Internet of Things devices generating data streams is expected to grow exponentially with the support of emergent technologies such as 5G networks. Therefore, the online processing of these data streams requires the design and development of suitable machine learning algorithms, able to learn online, as data is generated. Like their batch-learning counterparts, stream-based learning algorithms require careful hyperparameter settings. However, this problem is exacerbated in online learning settings, especially with the occurrence of concept drifts, which frequently require the reconfiguration of hyperparameters. In this article, we present SSPT, an extension of the Self Parameter Tuning (SPT) optimisation algorithm for data streams. We apply the Nelder–Mead algorithm to dynamically-sized samples, converging to optimal settings in a single pass over data while using a relatively small number of hyperparameter configurations. In addition, our proposal automatically readjusts hyperparameters when concept drift occurs. To assess the effectiveness of SSPT, the algorithm is evaluated with three different machine learning problems: recommendation, regression, and classification. Experiments with well-known data sets show that the proposed algorithm can outperform previous hyperparameter tuning efforts by human experts. Results also show that SSPT converges significantly faster and presents at least similar accuracy when compared with the previous double-pass version of the SPT algorithm. • Stream-based hyper-parameter optimisation algorithm. • Single pass data exploration mode. • Extended evaluation with three different machine learning tasks (recommendation, regression and classification). • Systematic literature review on automatic hyper-parameter tuning for AutoML. [ABSTRACT FROM AUTHOR]

In cyber physical system, the machine learning model is a competitive tool and has been successfully applied in this field. However, applying machine learning models to specific problems requires highly experienced manual tuning, which is a process of constant trial and error. Therefore, it often takes huge resources and time when faced with complex problems. In this paper, we propose an efficient method EAT-ML for automatically tuning machine learning models in cyber physical system. This method can automatically tune the hyperparameters of the machine learning model by using a controller with little human intervention. Specifically, the controller sequentially selects the hyperparameters of the machine learning model, and then uses the accuracy obtained on the verification set as the reward value signal. Finally, the PPO algorithm is used to calculate the loss function to update the internal parameters of the controller. In order to further improve the efficiency of the tuning method, we use the previous optimization experience by reconstructing the advantage function. In the experiment, our proposed method can show the best performance on most tasks by comparing other automatic tuning methods. In addition, the effectiveness and feasibility of the various components of the proposed method are also verified through ablation experiments. [ABSTRACT FROM AUTHOR]

The runtime behavior of Simulated Annealing (SA), similar to other metaheuristics, is controlled by hyperparameters. For SA, hyperparameters affect how "temperature" varies over time, and "temperature" in turn affects SA's decisions on whether or not to transition to neighboring states. It is typically necessary to tune the hyperparameters ahead of time. However, there are adaptive annealing schedules that use search feedback to evolve the "temperature" during the search. A classic and generally effective adaptive annealing schedule is the Modified Lam. Although effective, the Modified Lam can be sensitive to the scale of the cost function, and is sometimes slow to converge to its target behavior. In this paper, we present a novel variation of the Modified Lam that we call Self-Tuning Lam, which uses early search feedback to auto-adjust its self-adaptive behavior. Using a variety of discrete and continuous optimization problems, we demonstrate the ability of the Self-Tuning Lam to nearly instantaneously converge to its target behavior independent of the scale of the cost function, as well as its run length. Our implementation is integrated into Chips-n-Salsa, an open-source Java library for parallel and self-adaptive local search. [ABSTRACT FROM AUTHOR]

Featured Application: The described method can be applied for detecting cellular impurities in images. Automated detection of impurities is in demand for evaluating the quality and safety of human cell-processed therapeutic products in regenerative medicine. Deep learning (DL) is a powerful method for classifying and recognizing images in cell biology, diagnostic medicine, and other fields because it automatically extracts the features from complex cell morphologies. In the present study, we construct prediction models that recognize cancer-cell contamination in continuous long-term (four-day) cell cultures. After dividing the whole dataset into Early- and Late-stage cell images, we found that Late-stage images improved the DL performance. The performance was further improved by optimizing the DL hyperparameters (batch size and learning rate). These findings are first report for the implement of DL-based systems in disease cell-type classification of human cell-processed therapeutic products (hCTPs), that are expected to enable the rapid, automatic classification of induced pluripotent stem cells and other cell treatments for life-threatening or chronic diseases. [ABSTRACT FROM AUTHOR]

Existing dimensionality reduction (DR) techniques such as principal component analysis (PCA) and its variants are not suitable for target class mining due to the negligence of unique statistical properties of class-of-interest (CoI) samples. Conventionally, these approaches utilize higher or lower eigenvalued principal components (PCs) for data transformation; but the higher eigenvalued PCs may split the target class, whereas lower eigenvalued PCs do not contribute significant information and wrong selection of PCs leads to performance degradation. Considering these facts, the present research offers a novel target class-guided feature extraction method. In this approach, initially, the eigendecomposition is performed on variance–covariance matrix of only the target class samples, where the higher- and lower-valued eigenvectors are rejected via statistical analysis, and the selected eigenvectors are utilized to extract the most promising feature subspace. The extracted feature-subset gives a more tighter description of the CoI with enhanced associativity among target class samples and ensures the strong separation from nontarget class samples. One-class support vector machine (OCSVM) is evaluated to validate the performance of learned features. To obtain optimized values of hyperparameters of OCSVM a novel N -ary search-based autonomous method is also proposed. Exhaustive experiments with a wide variety of datasets are performed in feature-space (original and reduced) and eigenspace (obtained from original and reduced features) to validate the performance of the proposed approach in terms of accuracy, precision, specificity and sensitivity. [ABSTRACT FROM AUTHOR]

COVID-19 is an infectious disease caused by a novel coronavirus called SARS-CoV-2. The first case appeared in December 2019, and until now it still represents a significant challenge to many countries in the world. Accurately detecting positive COVID-19 patients is a crucial step to reduce the spread of the disease, which is characterize by a strong transmission capacity. In this work we implement a Residual Convolutional Neural Network (ResNet) for an automated COVID-19 diagnosis. The implemented ResNet can classify a patient´s Chest-Xray image into COVID-19 positive, pneumonia caused from another virus or bacteria, and healthy. Moreover, to increase the accuracy of the model and overcome the data scarcity of COVID-19 images, a personalized data augmentation strategy using a three-step Bayesian hyperparameter optimization approach is applied to enrich the dataset during the training process. The proposed COVID-19 ResNet achieves a 94% accuracy, 95% recall, and 95% F1-score in test set. Furthermore, we also provide an insight into which data augmentation operations are successful in increasing a CNNs performance when doing medical image classification with COVID-19 CXR.

Diagnosing a brain tumor takes a long time and relies heavily on the radiologist’s abilities and experience. The amount of data that must be handled has increased dramatically as the number of patients has increased, making old procedures both costly and ineffective. Many researchers investigated a variety of algorithms for detecting and classifying brain tumors that were both accurate and fast. Deep Learning (DL) approaches have recently been popular in developing automated systems capable of accurately diagnosing or segmenting brain tumors in less time. DL enables a pre-trained Convolutional Neural Network (CNN) model for medical images, specifically for classifying brain cancers. The proposed Brain Tumor Classification Model based on CNN (BCM-CNN) is a CNN hyperparameters optimization using an adaptive dynamic sine-cosine fitness grey wolf optimizer (ADSCFGWO) algorithm. There is an optimization of hyperparameters followed by a training model built with Inception-ResnetV2. The model employs commonly used pre-trained models (Inception-ResnetV2) to improve brain tumor diagnosis, and its output is a binary 0 or 1 (0: Normal, 1: Tumor). There are primarily two types of hyperparameters: (i) hyperparameters that determine the underlying network structure; (ii) a hyperparameter that is responsible for training the network. The ADSCFGWO algorithm draws from both the sine cosine and grey wolf algorithms in an adaptable framework that uses both algorithms’ strengths. The experimental results show that the BCM-CNN as a classifier achieved the best results due to the enhancement of the CNN’s performance by the CNN optimization’s hyperparameters. The BCM-CNN has achieved 99.98% accuracy with the BRaTS 2021 Task 1 dataset.

Due to an aging population, assisted-care options are required so that senior citizens may maintain their independence at home for a longer time and rely less on caretakers. Ambient Assisted Living (AAL) encourages the creation of solutions that can help to optimize the environment for senior citizens with assistance while greatly reducing their challenges. A framework based on the Internet of Medical Things (IoMT) is used in the current study for the implementation of AAL technology to help patients with Type-2 diabetes. A glucose oxide sensor is used to monitor diabetic elderly people continuously. Spectrogram images are created from the recorded data from the sensor to assess and detect aberrant glucose levels. DenseNet-169 examines and analyzes the spectrogram pictures, and messages are sent to caregivers when aberrant glucose levels are detected. The current work describes both the spectrogram image analysis and the signal-to-spectrogram generating method. The study presents a future perspective model for a mobile application for real-time patient monitoring. Benchmark metrics evaluate the application’s performances, including sensitivity, specificity, accuracy, and F1-score. Several cross--validations are used to evaluate the model’s performance. The findings demonstrate that the proposed model can correctly identify patients with abnormal blood glucose levels.

In this paper, we evaluate the performance of US manufacturing and service operations in the presence of information technology (IT) as measured by technical efficiency, using firm-level data from 133 companies over the period from 1999 to 2009. To gain insight into the phenomenon of the 'IT productivity paradox', or the history of inconsistent findings in the existing literature, we employ a Bayesian stochastic production frontier approach to model the relationship between performance and technical efficiency at the firm, industry and sector levels. Some results are indicative of a slight advantage of the manufacturing sector over the service sector in terms of technical efficiency and a significant positive contribution of IT-investment to firm output. However, other results do suggest the productivity paradox, because of a lack of any definitive association of high IT investment levels with either high- or low-technical efficiency. Indeed, the findings of this study suggest that the origin of some portion of the IT productivity paradox may exist at the industry level, in that the relationship between extreme levels of IT-investment and extreme levels of technical efficiency appear to work differently in sufficiently different industries. [ABSTRACT FROM AUTHOR]

This article presents a fully automated algorithm for the extraction of parameterized macromodels from frequency responses. The reference framework is based on a frequency-domain rational approximation combined with a parameter-space expansion into Gaussian radial basis functions (RBFs). An iterative least-squares fitting with positivity constraints is used to optimize model coefficients, with a guarantee of uniform stability over the parameter space. The main novel contribution of this work is a set of algorithms, supported by strong theoretical arguments with associated proofs, for the automated determination of all the hyperparameters that define model orders, placement, and width of RBFs. With respect to standard approaches, which tune these parameters using time-consuming tentative model extractions following a trial-and-error strategy, the presented technique allows much faster tuning of the model structure. The numerical results show that models with up to ten independent parameters are easily extracted in few minutes. [ABSTRACT FROM AUTHOR]

SVM with an RBF kernel is usually one of the best classification algorithms for most data sets, but it is important to tune the two hyperparameters C and γ to the data itself. In general, the selection of the hyperparameters is a non-convex optimization problem and thus many algorithms have been proposed to solve it, among them: grid search, random search, Bayesian optimization, simulated annealing, particle swarm optimization, Nelder Mead, and others. There have also been proposals to decouple the selection of γ and C. We empirically compare 18 of these proposed search algorithms (with different parameterizations for a total of 47 combinations) on 115 real-life binary data sets. We find (among other things) that trees of Parzen estimators and particle swarm optimization select better hyperparameters with only a slight increase in computation time with respect to a grid search with the same number of evaluations. We also find that spending too much computational effort searching the hyperparameters will not likely result in better performance for future data and that there are no significant differences among the different procedures to select the best set of hyperparameters when more than one is found by the search algorithms. [ABSTRACT FROM AUTHOR]

In India, approximately one-third of agricultural produce is wasted every year due to the different issues present in the post-harvest supply chain stages. The supply chain management of perishable products becomes complex and challenging due to the inclusion of its perishability dynamics. Quality is the main factor that governs the buying or discarding of perishable products by consumers. Therefore, the main aim of this research work is to develop an accurate and efficient image processing model for the classification of the product (Tomato) based on its quality for managing the supply chain. There are three novelties in this research work. A four-stage supply chain architecture integrated with the image processing system at mandi, and warehouses is proposed (First). This image processing system is developed in two stages. In stage I, the acquired images of tomato during its life cycle are labelled with the help of machine learning algorithms (Second). This labelled data is used in stage II for the development of a classification model to segregate the product into various grades. For this, an optimized architecture of seven-layer Convolutional Neural Network (CNN) model is developed followed by optimization of its hyperparameters simultaneously using Design of Experiments (DOE) technique (Third). The optimized CNN model achieved maximum accuracy of 88.40% and reported an execution time of 7 min. Further, the results of standard hyperparameter optimization techniques like Grid search, Random search, Bayesian, and Hyperband are compared with the proposed DOE technique on the optimized CNN architecture. The work done in this paper enables the supply chain managers to take accurate and rapid decisions for pricing, procurement, storage, and transportation at various stages of the supply chain leading to Industry 4.0. This will result in reduced post-harvest losses and simultaneously achieve the benefits across social, economic, and environmental dimensions of sustainability leading to better supply chain management. • A supply chain architecture integrated with image processing system is proposed. • Decisions related to pricing, procurement, storage and transportation can be taken. • The quality of product is modelled and labelled using Machine Learning algorithms. • A CNN model is developed for quality-based classification and optimized using DoE. • A comparison of DoE with Grid search, Bayesian and Hyperband is presented. [ABSTRACT FROM AUTHOR]

• A new IDBO algorithm is presented to optimize the hyperparameters of VMD. • The effective information related to rail corrugation can be separated from the acceleration signal by the presented method. • The experimental verification process is satisfactory, which has great practical engineering potential. Rail corrugation is a severe track damage and failure problem in metro lines. So, the accurate assessment of rail corrugation is significant for the safety and comfort of vehicles. It is an efficient means to detect rail corrugation through the acceleration signal. However, the acceleration signal contains the mixed signal caused by vehicle component noise and wheel polygonal wear, resulting in poor rail corrugation detection accuracy. Therefore, a new method is presented to extract the effective signal components and accurately identify the rail corrugation. Firstly, the Cubic mapping, modified sine algorithm, and Lévy flight are introduced into the dung beetle optimizer algorithm. A new improved dung beetle optimizer (IDBO) algorithm is presented to optimize the hyperparameters of the VMD algorithm, which can increase the signal decomposition performance of the VMD. Secondly, the fast independent component analysis method separates the independent components (ICs) from the VMD modes and original acceleration signal. Based on the selection criteria of ICs, the dominant signal components related to rail corrugation are determined. The rail corrugation amplitude can be obtained through the inertial reference method. The experimental results demonstrate that the presented method has better rail corrugation recognition accuracy, the root mean square error is smaller than the comparison method, and the corrugation wavelength of the straight track is larger than the curve track. [ABSTRACT FROM AUTHOR]

• - Proposing an evolutionary crow search algorithm (ECSA) to optimize the MLP hyperparameters. • - ECSA introduces an evolutionary search strategy and the self-adaptive flight length. • - Defining an interactive memory mechanism to improve the ECSA searchability. • - Experiments prove that ECSA is very competitive in solving global optimization problems. • - ECSA can boost MLP classifier for disease diagnosis compared to competitor algorithms. Artificial neural network (ANN) is an information processing paradigm that loosely models the thinking patterns of the human brain with specifications such as real-time learning, self-adaption, and self-organization. The learning process of ANNs is complex and tackles shortcomings such as a slow convergence rate, learning time-consuming, and local minimum trapping, especially when using gradient-based optimization techniques. Although many metaheuristics have been proposed to arm ANN and solve these weaknesses, ANN learning still needs solution quality. Therefore, this study proposes an evolutionary crow search algorithm (ECSA) to optimize the hyperparameters of ANNs for diagnosing chronic diseases. ECSA introduces an evolutionary search strategy, self-adaptive adaptive flight length, and an interactive memory mechanism to alleviate the canonical crow search algorithm's shortcomings. The evolutionary search strategy and self-adaptive flight length provide a meaningful search strategy in which crows effectively explore and exploit problem spaces by maintaining population diversity. During the search process, the interactive memory mechanism records the best solution obtained during optimization. The performance of ECSA was evaluated and compared with well-known metaheuristic algorithms in terms of local and global search abilities, local optima avoidance, and convergence speed towards the promising area. Then, the results were statistically analyzed. Ultimately, the effectiveness of an adaptation of ECSA named ECSA-MLP for optimizing hyperparameters of the multilayer perceptron network for diagnosing diseases including coronavirus, breast cancer, diabetes, cardiovascular, cervical cancer, Parkinson's, mammography, and acute inflammation was compared with state-of-the-art competitor algorithms. The experimental results indicated the superiority of ECSA over competitor algorithms in optimizing the network. [ABSTRACT FROM AUTHOR]

Applicability of neural nets in time series forecasting has been considered and researched. For this, training of neural network on various time series with preliminary selection of optimal hyperparameters has been performed. Comparative analysis of received neural networking forecasting model with linear regression has been performed. Conditions, affecting on accuracy and stability of results of the neural network, have been revealed.

Diabetic Maculopathy (DM) is considered the most common cause of permanent visual impairment in diabetic patients. The absence of clear pathological symptoms of DM hinders the timely diagnosis and treatment of such a critical condition. Early diagnosis of DM is feasible through eye screening technologies. However, manual inspection of retinography images by eye specialists is a time-consuming routine. Therefore, many deep learning-based computer-aided diagnosis systems have been recently developed for the automatic prognosis of DM in retinal images. Manual tuning of deep learning network’s hyperparameters is a common practice in the literature. However, hyperparameter optimization has shown to be promising in improving the performance of deep learning networks in classifying several diseases. This study investigates the impact of using the Bayesian optimization (BO) algorithm on the classification performance of deep learning networks in detecting DM in retinal images. In this research, we propose two new custom Convolutional Neural Network (CNN) models to detect DM in two distinct types of retinal photography; Optical Coherence Tomography (OCT) and fundus retinography datasets. The Bayesian optimization approach is utilized to determine the optimal architectures of the proposed CNNs and optimize their hyperparameters. The findings of this study reveal the effectiveness of using the Bayesian optimization for fine-tuning the model hyperparameters in improving the performance of the proposed CNNs for the classification of diabetic maculopathy in fundus and OCT images. The pre-trained CNN models of AlexNet, VGG16Net, VGG 19Net, GoogleNet, and ResNet-50 are employed to be compared with the proposed CNN-based models. Statistical analyses, based on a one-way analysis of variance (ANOVA) test, receiver operating characteristic (ROC) curve, and histogram, are performed to confirm the performance of the proposed models.