Search

Around a third of the total population of Europe suffers from mental disorders. The use of electroencephalography (EEG) together with Machine Learning (ML) algorithms to diagnose mental disorders has recently been shown to be a prominent research area, as exposed by several reviews focused on the field. Nevertheless, previous to the application of ML algorithms, EEG data should be correctly preprocessed and prepared via Feature Engineering (FE). In fact, the choice of FE techniques can make the difference between an unusable ML model and a simple, effective model. In other words, it can be said that FE is crucial, especially when using complex, non-stationary data such as EEG. To this aim, in this paper we present a Systematic Mapping Study (SMS) focused on FE from EEG data used to identify mental disorders. Our SMS covers more than 900 papers, making it one of the most comprehensive to date, to the best of our knowledge. We gathered the mental disorder addressed, all the FE techniques used, and the Artificial Intelligence (AI) algorithm applied for classification from each paper. Our main contributions are: (i) we offer a starting point for new researchers on these topics, (ii) we extract the most used FE techniques to classify mental disorders, (iii) we show several graphical distributions of all used techniques, and (iv) we provide critical conclusions for detecting mental disorders. To provide a better overview of existing techniques, the FE process is divided into three parts: (i) signal transformation, (ii) feature extraction, and (iii) feature selection. Moreover, we classify and analyze the distribution of existing papers according to the mental disorder they treat, the FE processes used, and the ML techniques applied. As a result, we provide a valuable reference for the scientific community to identify which techniques have been proven and tested and where the gaps are located in the current state of the art. [ABSTRACT FROM AUTHOR]

The image object recognition and detection technology are widely used in many scenarios. In recent years, big data has become increasingly abundant, and big data-driven artificial intelligence models have attracted more and more attention. Evolutionary computation has also provided a powerful driving force for the optimization and improvement of deep learning models. In this paper, we propose an image object detection method based on self-supervised and data-driven learning. Differ from other methods, our approach stands out due to its innovative use of multispectral data fusion and evolutionary computation for model optimization. Specifically, our method uniquely combines visible light images and infrared images to detect and identify image targets. Firstly, we utilize a self-supervised learning method and the AutoEncoder model to perform high-dimensional feature extraction on the two types of images. Secondly, we fuse the extracted features from the visible light and infrared images to detect and identify objects. Thirdly, we introduce a model parameter optimization method using evolutionary learning algorithms to enhance model performance. Validation on public datasets shows that our method achieves comparable or superior performance to existing methods. [ABSTRACT FROM AUTHOR]

To address the problems of low accuracy in fault diagnosis of oil-immersed transformers, poor state perception ability and real-time collaboration during diagnosis feedback, a fault diagnosis method for transformers based on the integration of digital twins is proposed. Firstly, fault sample balance is achieved through Iterative Nearest Neighbor Oversampling (INNOS), Secondly, nine-dimensional ratio features are extracted, and the correlation between dissolved gases in oil and fault types is established. Then, sparse principal component analysis (SPCA) is used for feature fusion and dimensionality reduction. Finally, the Aquila Optimizer (AO) is introduced to optimize the parameters of the Kernel Extreme Learning Machine (KELM), establishing the optimal AO-KELM diagnosis model. The final fault diagnosis accuracy reaches 98.1013%. Combining transformer digital twin models, real-time interaction mapping between physical entities and virtual space is achieved, enabling online diagnosis of transformer faults. Experimental results show that the method proposed in this paper has high diagnostic accuracy and strong stability, providing reference for the intelligent operation and maintenance of transformers. [ABSTRACT FROM AUTHOR]

Around 50 million individuals worldwide suffer from epilepsy, a chronic, non-communicable brain disorder. Several screening methods, including electroencephalography, have been proposed to identify epileptic episodes. EEG data, which are frequently utilised to enhance epilepsy analysis, offer essential information on the electrical processes of the brain. Prior to the emergence of deep learning (DL), feature extraction was accomplished by standard machine learning techniques. As a result, they were only as good as the people who made the features by hand. But with DL, both feature extraction and classification are fully automated. These methods have significantly advanced several fields of medicine, including the diagnosis of epilepsy. In this paper, the works focused on automated epileptic seizure detection using ML and DL techniques are presented as well as their comparative analysis is done. The UCI-Epileptic Seizure Recognition dataset is used for training and validation. Some of the conventional ML and DL algorithms are used with a proposed model which uses long short-term memory (LSTM) to find the best approach. Post that comparative analysis is performed on these algorithms to find the best approach for epileptic seizure detection. As a result, the proposed model LSTM gives a validation accuracy of 97% giving the most appropriate and precise result as compared to other mentioned algorithms used in this study. [ABSTRACT FROM AUTHOR]

Collecting and analyzing data from all devices to improve the efficiency of business processes is an important task of Industrial Internet of Things (IIoT). In the age of data explosion, extensive text data generated by the IIoT have given birth to a variety of text representation methods. The task of text representation is to convert the natural language to a form that computer can understand with retaining the original semantics. However, these methods are difficult to effectively extract the semantic features among words and distinguish polysemy in natural language. Combining the advantages of convolutional neural network (CNN) and variational autoencoder (VAE), this paper proposes an intelligent CNN-VAE text representation algorithm as an advanced learning method for social big data within next-generation IIoT, which help users identify the information collected by sensors and perform further processing. This method employs the convolution layer to capture the local features of the context and uses the variational technique to reconstruct feature space to make it conform to the normal distribution. In addition, the improved word2vec model based on topical word embedding (TWE) is utilized to add topical information to word vectors to distinguish polysemy. This paper takes the social big data as an example to illustrate the way of the proposed algorithm applied in the next-generation IIoT and utilizes Cnews dataset to verify the performance of proposed method with four evaluating metrics (i.e., recall, accuracy, precision, and F1-score). Experimental results indicate that the proposed method outperforms word2vec-avg and CNN-AE in K-nearest neighbor (KNN), random forest (RF), and support vector machine (SVM) classifiers and distinguishes polysemy effectively. [ABSTRACT FROM AUTHOR]

Underwater target detection and classification based on sonar images is a challenging task because of the complex underwater environment. In recent years, deep learning technology has effectively improved the detection accuracy of underwater targets compared to traditional sonar image target detection methods, which have a low accuracy and poor robustness. However, deep learning algorithms for sonar image target detection have fewer training samples and a low detection speed. To solve these problems, an improved YOLOv4 based sonar target detection and classification algorithm is proposed in this paper. First, the feature extraction network CSPDarknet-53 in YOLOv4 is improved to reduce both the model parameters and the network depth. Second, the PANet feature enhancement module in the YOLOv4 model is replaced by the adaptive spatial feature fusion module (ASFF) to obtain a better feature fusion effect. In addition, the number of fusion feature layers is increased to improve the receptive field and detection accuracy. Furthermore, this paper uses the k-means++ algorithm to cluster the sonar image dataset to obtain the appropriate size and number of anchor boxes for model training. The experimental results show that the proposed method has better performance in detection accuracy and detection speed compared to YOLOv4 and YOLOv4-tiny. [ABSTRACT FROM AUTHOR]

Background: Emotion is a complex phenomenon that greatly affects human behavior and thinking in daily life. Electroencephalography (EEG), one of the human physiological signals, has been emphasized by most researchers in emotion recognition as its specific properties are closely associated with human emotion. However, the number of human emotion recognition studies using computer games as stimuli is still insufficient as there were no relevant publicly available datasets provided in the past decades. Most of the recent studies using the Gameemo public dataset have not clarified the relationship between the EEG signal's changes and the emotion elicited using computer games. Thus, this paper is proposed to introduce the use of data mining techniques in investigating the relationships between the frequency changes of EEG signals and the human emotion elicited when playing different kinds of computer games. The data acquisition stage, data pre-processing, data annotation and feature extraction stage were designed and conducted in this paper to obtain and extract the EEG features from the Gameemo dataset. The cross-subject and subject-based experiments were conducted to evaluate the classifiers' performance. The top 10 association rules generated by the RCAR classifier will be examined to determine the possible relationship between the EEG signal's frequency changes and game-induced emotions. Results: The RCAR classifier constructed for cross-subject experiment achieved highest accuracy, precision, recall and F1-score evaluated with over 90% in classifying the HAPV, HANV and LANV game-induced emotions. The 20 experiment cases' results from subject-based experiments supported that the SVM classifier could accurately classify the 4 emotion states with a kappa value over 0.62, demonstrating the SVM-based algorithm's capabilities in precisely determining the emotion label for each participant's EEG features' instance. Conclusion: The findings in this study fill the existing gap of game-induced emotion recognition field by providing an in-depth evaluation on the ruleset algorithm's performance and feasibility of applying the generated rules on the game-induced EEG data for justifying the emotional state prediction result. [ABSTRACT FROM AUTHOR]

Deep learning has made substantial progress in crowd counting, but in practical applications, due to interference factors such as perspective distortion and complex background, the existing methods still have large errors in counting. In response to the above problems, this paper designs a multi-scale feature fusion network (IA-MFFCN) based on the reverse attention mechanism, which maps the image to the crowd density map for counting. The network consists of three parts: feature extraction module, inverse attention module, and back-end module. First, to overcome the problem of perspective distortion, deeper single-column CNNs was designed as a feature extraction module to extract multi-scale feature information and merge them; second, to avoid interference of complex backgrounds, the inverse attention module was designed, through the multi-scale inverse attention mechanism, reducing the influence of noise on counting accuracy. Finally, to generate a high-quality crowd density map, dilation convolution was introduced. Simultaneously, to enhance the sensitivity of the network to crowd counting, a comprehensive loss function based on Euclidean loss and predicted population loss is designed to improve training accuracy, to produce a more accurate density value. Experiments show that compared with the comparison algorithm, the algorithm in this paper has a significant reduction in the mean absolute error (MAE) and mean square error (MSE) on the ShanghaiTech dataset, UCF_CC_50 dataset and WorldExpo'10 dataset. [ABSTRACT FROM AUTHOR]

Pulse-coupled neural networks perform well in many fields such as information retrieval, depth estimation and object detection. Based on pulse coupled neural network (PCNN) theory, this paper constructs a visual perception model framework and builds a real image reproduction platform. The model firstly analyzes the structure and generalization ability of neural network multi-class classifier, uses the minimax criterion of feature space as the splitting criterion of visual perception decision node, which solves the generalization problem of neural network learning algorithm. In the simulation process, the initial threshold is optimized by the two-dimensional maximum inter-class variance method, and in order to improve the real-time performance of the algorithm, the fast recurrence formula of neural network is derived and given. The PCNN image segmentation method based on genetic algorithm is analyzed. The genetic algorithm improves the loop termination condition and the adaptive setting of model parameters of PCNN image segmentation algorithm, but the PCNN image segmentation algorithm still has the problem of complexity. In order to solve this problem, this paper proposed an IGA-PCNN image segmentation method combining the improved algorithm and PCNN model. Firstly, it used the improved immune genetic algorithm to adaptively obtain the optimal threshold, and then replaced the dynamic threshold in PCNN model with the optimal threshold, and finally used the pulse coupling characteristics of PCNN model to complete the image segmentation. From the coupling characteristics of PCNN, junction close space of image and gray level characteristics, it determined the local gray mean square error of image connection strength coefficient. The feature extraction and object segmentation properties of PCNN come from the spike frequency of neurons, and the number of neurons in PCNN is equal to the number of pixels in the input image. In addition, the spatial and gray value differences of pixels should be considered comprehensively to determine their connection matrix. Digital experiments show that the multi-scale multi-task pulse coupled neural network model can shorten the total training time by 17 h, improve the comprehensive accuracy of the task test data set by 1.04%, and shorten the detection time of each image by 4.8 s compared with the series network model of multiple single tasks. Compared with the traditional PCNN algorithm, it has the advantages of fast visual perception and clear target contour segmentation, and effectively improves the anti-interference performance of the model. [ABSTRACT FROM AUTHOR]

Automatic facial expression recognition (AFER), sometimes referred to as emotional recognition, is important for socializing. Automatic methods in the past two years faced challenges due to Covid-19 and the vital wearing of a mask. Machine learning techniques tremendously increase the amount of data processed and achieved good results in such AFER to detect emotions; however, those techniques are not designed for masked faces and thus achieved poor recognition. This paper introduces a hybrid convolutional neural network aided by a local binary pattern to extract features in an accurate way, especially for masked faces. The basic seven emotions classified into anger, happiness, sadness, surprise, contempt, disgust, and fear are to be recognized. The proposed method is applied on two datasets: the first represents CK and CK +, while the second represents M-LFW-FER. Obtained results show that emotion recognition with a face mask achieved an accuracy of 70.76% on three emotions. Results are compared to existing techniques and show significant improvement. [ABSTRACT FROM AUTHOR]

Cancer is the most fatal diseases in the world which has highest mortality rate as compared to other type's human diseases. The most common and dangerous types of cancers are lung cancer, skin cancer, brain tumors, breast cancer, Colorectal cancer, Prostate Cancer, Blood cancer and many other. The millions of person lose their life due to these highly dangerous, fatal types of disease. Hence it is required to provide the solution using computer added automatic cancer detection technique in early stage, for the research gap analysis is required. In this paper we have studied the various cancer detection techniques based on traditional machine learning (ML) and deep learning (DL) techniques and summarize the research gap for the various cancers detection techniques. The study has been conducted based the types of technique uses, types of features utilized, dataset used and accuracy of the cancer detection achieved using best technique. In this study we have conducted the reviewed over 100 recently published research papers and focused on 7 types of most fatal cancer types such as lung cancer, breast cancer, skin cancer, brain tumor, colorectal, prostate, and Leukemia (Blood cancer). The study also used the state-of-art table to compare the previous and current study conducted on cancer detection techniques. We have visualized using separate comparison table for 7 types of cancer detection using traditional ML method and DL methods also visualized through the bar chart. The best accuracy result obtained using ML and DL methods are 100% and the most commonly used ML classifier is Support Vector Machine whereas CNN is most commonly used DL classifier. The main challenges we observed are the data imbalance issue, varieties of feature extraction techniques, small medical dataset, classifier parameters optimizations, Execution time, Adaptive classifier, and common technique for segmentation and classification. The main objective of this review is to investigate the existing methods used for the various types of cancer detection and finding the research gap, challenges, and recent advancement mainly in the use of ML and DL models which may help the researchers to find the better solutions. [ABSTRACT FROM AUTHOR]

Automated and accurate detection of power quality (PQ) events is important from the point of view of safety as well as maintaining the reliability of the power transmission and distribution network. However, detection of multiple PQ events in a noisy environment is challenging task. Another important issue is the choice of meaningful features that can directly influence the accuracy of PQ detection. Considering these two aforesaid facts, this paper presents a novel framework for automated classification of PQ signals in a noisy environment employing cross Stockwell Transform (XST). The XST proposed in this paper has better noise suppression capability compared to conventional Stockwell Transform. Here, XST was used to convert 1D PQ signals to 2D time–frequency (T–F) images. To improve the accuracy of PQ detection, an automated feature extraction method employing deep learning is implemented in this work. The noise free T–F images obtained using XST were fed as inputs to several pre-trained convolutional neural networks (CNNs) for deep feature extraction. Transfer learning technique was implemented to reduce the computational cost. The extracted deep features were further undergone selection using one-way analysis of variance test followed by false discovery rate correction. The statistically significant deep features were subsequently fed to three benchmark machine learning classifiers for classification of PQ signals. In addition, tests were also carried out on real-life PQ signals to verify the practicability of the proposed framework. Investigations revealed that the proposed method returned mean accuracy of 99.72% and 96.45% for classification of simulated and real-life PQ signals, respectively. [ABSTRACT FROM AUTHOR]

Liver ultrasound is widely used in clinical practice due to its advantages of non-invasiveness, non-radiation, and real-time imaging. Accurate segmentation of the liver region in ultrasound images is essential for accelerating the auxiliary diagnosis of liver-related diseases. This paper proposes BACANet, a deep learning algorithm designed for real-time liver ultrasound segmentation. Our approach utilizes a lightweight network backbone for liver feature extraction and incorporates a convolutional attention mechanism to enhance the network's ability to capture global contextual information. To improve early localization of liver boundaries, we developed a selective large kernel convolution module for boundary feature extraction and introduced explicit liver boundary supervision. Additionally, we designed an enhanced attention gate to efficiently convey liver body and boundary features to the decoder to enhance the feature representation capability. Experimental results across multiple datasets demonstrate that BACANet effectively completes the task of liver ultrasound segmentation, achieving a balance between inference speed and segmentation accuracy. On a public dataset, BACANet achieved a DSC of 0.921 and an IOU of 0.854. On a private test dataset, BACANet achieved a DSC of 0.950 and an IOU of 0.907, with an inference time of approximately 0.32 s per image on a CPU processor. [ABSTRACT FROM AUTHOR]

The goal of few-shot learning is to use a small number of labeled samples to train a machine learning model and then classify the unlabeled samples. Recent works, especially the methods based on image local feature representation in metric learning have achieved superior performance by utilizing the local invariant features and their rich discriminative information. However, the learned local features in the existing methods are not aligned when calculating their similarities, resulting in larger intra-class divergence and smaller inter-class divergence. In fact, the dominant object (local feature) of one image should only compare with the semantically relevant local feature of the other image. To address these issues, this paper proposes a few-shot learning approach (SANet) based on semantic alignment of local features. Specifically, we firstly obtain the local features of the query and support images by using a feature extraction module, and then compute the relation matrices of these local features. Using the above relation matrices, we respectively design an intra-class divergence rectification (intraDR) module and an inter-class divergence rectification (interDR) module to implement the local feature alignment and reduce the effect of the noise local features. The experimental results on multiple datasets show that, by aligning the local features, the proposed model can effectively minimize the intra-class divergence while maximizing the inter-class divergence, thus achieving better classification performance. The code for this paper can be accessed via https://github.com/SongQCode/SANet. [ABSTRACT FROM AUTHOR]

There is a complex high-dimensional nonlinear mapping relationship between the compressive strength of High-Performance Concrete (HPC) and its components, which has great influence on the accurate prediction of compressive strength. In this paper, an efficient robust software calculation strategy combining BP Neural Network (BPNN), Support Vector Machine (SVM) and Genetic Algorithm (GA) is proposed for the prediction of compressive strength of HPC. 8 features were extracted from the previous literature, and a compressive strength database containing 454 sets of data was constructed. The model was trained and tested, and the performance of 4 Machine Learning (ML) models, namely BPNN, SVM, GA-BPNN and GA-SVM, was compared. The results show that the coupled model is superior to the single model. Moreover, because GA-SVM has better generalization ability and theoretical basis, its convergence speed and prediction accuracy are better than GA-BPNN. Then Grey Relational Analysis (GRA) and Shapley analysis were used to verify the interpretability of the GA-SVM model, which showed that the water-binder ratio had the most significant influence on the compressive strength. Finally, the combination of multiple input variables to evaluate the compressive strength supplemented this research, and again verified the significant influence of water-binder ratio, providing reference value for subsequent research. [ABSTRACT FROM AUTHOR]

Hepatitis C virus (HCV) is a major global health concern, affecting millions of individuals worldwide. While existing literature predominantly focuses on disease classification using clinical data, there exists a critical research gap concerning HCV genotyping based on genomic sequences. Accurate HCV genotyping is essential for patient management and treatment decisions. While the neural models excel at capturing complex patterns, they still face challenges, such as data scarcity, that exist a lot in computational genomics. To overcome this challenges, this paper introduces an advanced deep learning approach for HCV genotyping based on the graphical representation of nucleotide sequences that outperforms classical approaches. Notably, it is effective for both partial and complete HCV genomes and addresses challenges associated with imbalanced datasets. In this work, ten HCV genotypes: 1a, 1b, 2a, 2b, 2c, 3a, 3b, 4, 5, and 6 were used in the analysis. This study utilizes Chaos Game Representation for 2D mapping of genomic sequences, employing self-supervised learning using convolutional autoencoder for deep feature extraction, resulting in an outstanding performance for HCV genotyping compared to various machine learning and deep learning models. This baseline provides a benchmark against which the performance of the proposed approach and other models can be evaluated. The experimental results showcase a remarkable classification accuracy of over 99%, outperforming traditional deep learning models. This performance demonstrates the capability of the proposed model to accurately identify HCV genotypes in both partial and complete sequences and in dealing with data scarcity for certain genotypes. The results of the proposed model are compared to NCBI genotyping tool. [ABSTRACT FROM AUTHOR]

Historically, the analysis of stimulus-dependent time–frequency patterns has been the cornerstone of most electroencephalography (EEG) studies. The abnormal oscillations in high-frequency waves associated with psychotic disorders during sensory and cognitive tasks have been studied many times. However, any significant dissimilarity in the resting-state low-frequency bands is yet to be established. Spectral analysis of the alpha and delta band waves shows the effectiveness of stimulus-independent EEG in identifying the abnormal activity patterns of pathological brains. A generalized model incorporating multiple frequency bands should be more efficient in associating potential EEG biomarkers with first-episode psychosis (FEP), leading to an accurate diagnosis. We explore multiple machine-learning methods, including random-forest, support vector machine, and Gaussian process classifier (GPC), to demonstrate the practicality of resting-state power spectral density (PSD) to distinguish patients of FEP from healthy controls. A comprehensive discussion of our preprocessing methods for PSD analysis and a detailed comparison of different models are included in this paper. The GPC model outperforms the other models with a specificity of 95.78% to show that PSD can be used as an effective feature extraction technique for analyzing and classifying resting-state EEG signals of psychiatric disorders. [ABSTRACT FROM AUTHOR]

For the present, many technical problems exist in the convolution neural network for facial expression recognition, such as the complexity of convolutional face feature extraction, the difficulty in accurately recognizing the subtle feature changes of facial expressions, and the low automatic recognition rate of facial expressions. In this paper, a hybrid attention mechanism based on space and channel—Height Performance Module Implement(HPMI) attention mechanism is proposed to realize automatic facial expression recognition. The addition of this attention mechanism can enhance the weight of key features and make the model focused on the features which are useful for expression classification in the training process. An HPMI module based on spatial and channel-based mixed attention mechanism is embedded in VGG-16 network. This can effectively alleviate the overfitting phenomenon of the network, strengthen the useful information, suppress the useless information, promote the information flow between the key information of the image and the network model. At the same time, it can solve the problem of the inconsistency between the input dimension and the output dimension. The accuracy of the method in this paper is 98.97% and 88.44% on CK + and RAF-DB expression datasets. Experimental comparison shows that by embedding the HPMI module, the model can further enhance the learning of spatial and channel feature weight. Our experiments include 2 datasets for expression recognition and show an average improvement of 3.94% in the accuracy. [ABSTRACT FROM AUTHOR]

Purpose: There are millions of people who lose their life due to several types of fatal diseases. Cancer is one of the most fatal diseases which may be due to obesity, alcohol consumption, infections, ultraviolet radiation, smoking, and unhealthy lifestyles. Cancer is abnormal and uncontrolled tissue growth inside the body which may be spread to other body parts other than where it has originated. Hence it is very much required to diagnose the cancer at an early stage to provide correct and timely treatment. Also, manual diagnosis and diagnostic error may cause of the death of many patients hence much research are going on for the automatic and accurate detection of cancer at early stage. Methods: In this paper, we have done the comparative analysis of the diagnosis and recent advancement for the detection of various cancer types using traditional machine learning (ML) and deep learning (DL) models. In this study, we have included four types of cancers, brain, lung, skin, and breast and their detection using ML and DL techniques. In extensive review we have included a total of 130 pieces of literature among which 56 are of ML-based and 74 are from DL-based cancer detection techniques. Only the peer reviewed research papers published in the recent 5-year span (2018–2023) have been included for the analysis based on the parameters, year of publication, feature utilized, best model, dataset/images utilized, and best accuracy. We have reviewed ML and DL-based techniques for cancer detection separately and included accuracy as the performance evaluation metrics to maintain the homogeneity while verifying the classifier efficiency. Results: Among all the reviewed literatures, DL techniques achieved the highest accuracy of 100%, while ML techniques achieved 99.89%. The lowest accuracy achieved using DL and ML approaches were 70% and 75.48%, respectively. The difference in accuracy between the highest and lowest performing models is about 28.8% for skin cancer detection. In addition, the key findings, and challenges for each type of cancer detection using ML and DL techniques have been presented. The comparative analysis between the best performing and worst performing models, along with overall key findings and challenges, has been provided for future research purposes. Although the analysis is based on accuracy as the performance metric and various parameters, the results demonstrate a significant scope for improvement in classification efficiency. Conclusion: The paper concludes that both ML and DL techniques hold promise in the early detection of various cancer types. However, the study identifies specific challenges that need to be addressed for the widespread implementation of these techniques in clinical settings. The presented results offer valuable guidance for future research in cancer detection, emphasizing the need for continued advancements in ML and DL-based approaches to improve diagnostic accuracy and ultimately save more lives. [ABSTRACT FROM AUTHOR]

In order to improve the diagnosis and classification effect of pituitary tumors, this paper combines the current common machine learning methods and classification prediction methods to improve the traditional machine learning algorithms. Moreover, this paper analyzes the feature algorithm based on the feature extraction requirements of pituitary tumor pictures and compares a variety of commonly used algorithms to select a classification algorithm suitable for the model of this paper through comparison methods. In addition, this paper carries out the calculation of the prediction algorithm and verifies the algorithm according to the actual situation. Finally, based on the neural network algorithm, this paper designs and constructs the algorithm function module and combines the actual needs of pituitary tumors to build the model and verify the performance of the model. The research results show that the model system constructed in this paper meets the expected demand. [ABSTRACT FROM AUTHOR]

Arrhythmia is a subnormal heartbeat that causes Tachycardia or Bradycardia. ECG signal is extensively used for the analysis of heart diseases. The ECG is used to measure the rate and regularity of heartbeats. With the help of the study of the ECG signal, the presence of any damage to the heart can be identified. Arrhythmia classification is an important part of the research of medical images and signal processing. This paper aims to apply the K-SVD technique so that both the best features selected, and the accuracy of arrhythmia classification are improved. Additionally, the required space for storage has been reduced. For each ECG, we extracted 100 features of each ECG signal. Afterward, we applied statistical descriptors for extracted features which include Mean, Energy, Variance, Covariance, and Standard Deviation (S.D). The next step is the training process. We applied MLP neural networks. We have used two kinds of datasets in our research paper, UCI Machine Learning Repository and the MIT-BIH dataset. The accuracy rate of the proposed method is 98.90% and 99.14% for the UCI and MIT-BIH Dataset, respectively. [ABSTRACT FROM AUTHOR]

The identification of features that can improve classification accuracy is a major concern in land cover classification research. This paper compares deep learning and transform domain feature extraction techniques for land cover classification of SAR data on balanced and imbalanced training sets. Convolutional autoencoders (CAE), variational autoencoders (VAE), and Haar wavelet transforms (HWT) are used and evaluated for feature generation capability. Variations in features of CAE and HWT help gather more information about the image patch. The fusion of CAE and HWT features provides a combination of high- and low-frequency coefficients, respectively, which improves classification accuracy for various land covers. To assess features generated through fusion of features, RISAT-1 C-band and AIRSAR L-band datasets are used. Furthermore, agricultural/grass land has similar features with open forest which leads to misclassification of forest in agricultural/grass land. Increasing the number of samples in each class using the Synthetic Minority Oversampling Technique (SMOTE) increases training samples. Hierarchical classification of the above-mentioned features, where agricultural/grass land and forest classes are discriminated, improves classification results. This paper evaluates all the three types of features and fused features and provides a guidance for land cover classification. [ABSTRACT FROM AUTHOR]

In order to efficiently and automatically identify the faults of rotating machinery, so as to avoid the dangers and losses caused by them, this paper proposes a new fault feature extraction method for rotating machinery named Hierarchical Multi-variate Amplitude-aware Permutation Entropy (HmvAAPE), which has integrated the advantages of Amplitude-aware Permutation Entropy (AAPE), multi-channel analysis method and hierarchical decomposition method. Therefore, the features extracted by this feature extraction method can contain more complete fault information. The t-SNE algorithm is chosen to conduct dimensional reduction of features and the Kernel Extreme Learning Machine optimized by Von Neumann Topology Whale Optimization Algorithm (VNWOA-KELM) is proposed to learn fault characteristics and classify faults automatically. By designing bearing and gearbox fault experiments and collecting their fault data to verify the effectiveness of the proposed method, it can be obtained that the average classification accuracy of this method can reach 98.9%. Through comparative experiments, conclusions can be made that this method can get both higher accuracy and higher stability at the same time. [ABSTRACT FROM AUTHOR]

Artificial intelligence (AI) including symbolic AI with deep learning neural networks represents incredibly exciting and powerful machine learning-based techniques used to solve and explain many real-world problems. The synthetic feature XGBoost algorithm effectively integrates multi-source data information and obtains high GDP prediction accuracy. This paper by Dianjun Zhang et al. used two deep learning algorithms: the mask R-CNN algorithm and the faster R-CNN algorithm to build ship target feature extraction and recognition models based on deep convolutional neural networks. [Extracted from the article]

Tabular data analysis is a critical task in various domains, enabling us to uncover valuable insights from structured datasets. While traditional machine learning methods can be used for feature engineering and dimensionality reduction, they often struggle to capture the intricate relationships and dependencies within real-world datasets. In this paper, we present Multi-representation DeepInsight (MRep-DeepInsight), a novel extension of the DeepInsight method designed to enhance the analysis of tabular data. By generating multiple representations of samples using diverse feature extraction techniques, our approach is able to capture a broader range of features and reveal deeper insights. We demonstrate the effectiveness of MRep-DeepInsight on single-cell datasets, Alzheimer's data, and artificial data, showcasing an improved accuracy over the original DeepInsight approach and machine learning methods like random forest, XGBoost, LightGBM, FT-Transformer and L2-regularized logistic regression. Our results highlight the value of incorporating multiple representations for robust and accurate tabular data analysis. By leveraging the power of diverse representations, MRep-DeepInsight offers a promising new avenue for advancing decision-making and scientific discovery across a wide range of fields. [ABSTRACT FROM AUTHOR]

In the past decades, a variety of learning-based algorithms have been emerged to try to explore a better solution for stereo matching by leveraging various machine learning algorithms. For enriching learning-based stereo matching algorithm's methodologies, we cast the disparity estimation as a regression problem by leveraging Structured Support Vector Machine (SSVM) in this paper. There are three categories of features have been extracted on account of disparity cues for training the SSVM. Particularly, one of the three feature is named as 'Coarse-to-Fine PatchMatch Filtering', which effectively exploits region and pixel disparity cues. For attaining region disparity cues, we adopt MeshStereo and MeshStereo with Cross-Scale algorithms; for attaining pixel disparity cues, PatchMatch and Cross-Scale PatchMatch stereo matching algorithms are utilized. Performance evaluations on Middlebury v.2 and v.3 stereo data sets demonstrate that the proposed algorithm reveals comparable accuracy with other challenging learning-based ones. It is worth pointing out that our proposal performs over several orders of magnitude faster than others on training time. [ABSTRACT FROM AUTHOR]

Internet of Things (IoTs) has been playing an important role in many sectors, such as smart cities, smart agriculture, smart healthcare, and smart manufacturing. However, IoT devices are highly vulnerable to cyber-attacks, which may result in security breaches and data leakages. To effectively prevent these attacks, a variety of machine learning-based network intrusion detection methods for IoT networks have been developed, which often rely on either feature extraction or feature selection techniques for reducing the dimension of input data before being fed into machine learning models. This aims to make the detection complexity low enough for real-time operations, which is particularly vital in any intrusion detection systems. This paper provides a comprehensive comparison between these two feature reduction methods of intrusion detection in terms of various performance metrics, namely, precision rate, recall rate, detection accuracy, as well as runtime complexity, in the presence of the modern UNSW-NB15 dataset as well as both binary and multiclass classification. For example, in general, the feature selection method not only provides better detection performance but also lower training and inference time compared to its feature extraction counterpart, especially when the number of reduced features K increases. However, the feature extraction method is much more reliable than its selection counterpart, particularly when K is very small, such as K = 4 . Additionally, feature extraction is less sensitive to changing the number of reduced features K than feature selection, and this holds true for both binary and multiclass classifications. Based on this comparison, we provide a useful guideline for selecting a suitable intrusion detection type for each specific scenario, as detailed in Table 14 at the end of Sect. 4. Note that such the comparison between feature selection and feature extraction over UNSW-NB15 as well as theoretical guideline have been overlooked in the literature. [ABSTRACT FROM AUTHOR]

This paper provides a framework based on machine learning approach in I4.0 environment to predict the remaining useful life of an aviation engine. For illustration purpose, an industrial case study is presented which applies machine learning algorithms to analyze the data collected using the Commercial Modular Aero-Propulsion System Simulation (C-MAPSS) simulation which includes run-to-degradation data for a turbofan engine. The results obtained from the study validate the proposed framework to identify prominent features and perform sequential analysis on unstructured data for predicting the remaining useful life of an aviation engine. Six machine learning models are applied to the dataset containing four subsets: FD001, FD002, FD003 and FD004 in C-MAPSS dataset each working on different degradation conditions for turbofan engine. For FD001, random forest had the lowest RMSE (11.59), and for FD002, FD003 and FD004, the lowest RMSE was given by LGBM classifier (12.78, 7.95 and 11.04), respectively. From the findings, it is observed that LGBM performs better with higher AUC 89% and lowest RMSE. The proposed framework can be applied to a wide range of failure prediction applications. Regardless of the underlying physics, ML-based data-driven methodologies can be used to analyze a wide range of systems. [ABSTRACT FROM AUTHOR]

Effective management of dementia requires the timely detection of mild cognitive impairment (MCI). This paper introduces a multi-objective optimization approach for selecting EEG channels (and features) for the purpose of detecting MCI. Firstly, each EEG signal from each channel is decomposed into subbands using either variational mode decomposition (VMD) or discrete wavelet transform (DWT). A feature is then extracted from each subband using one of the following measures: standard deviation, interquartile range, band power, Teager energy, Katz's and Higuchi's fractal dimensions, Shannon entropy, sure entropy, or threshold entropy. Different machine learning techniques are used to classify the features of MCI cases from those of healthy controls. The classifier's performance is validated using leave-one-subject-out (LOSO) cross-validation (CV). The non-dominated sorting genetic algorithm (NSGA)-II is designed with the aim of minimizing the number of EEG channels (or features) and maximizing classification accuracy. The performance is evaluated using a publicly available online dataset containing EEGs from 19 channels recorded from 24 participants. The results demonstrate a significant improvement in performance when utilizing the NSGA-II algorithm. By selecting only a few appropriate EEG channels, the LOSO CV-based results show a significant improvement compared to using all 19 channels. Additionally, the outcomes indicate that accuracy can be further improved by selecting suitable features from different channels. For instance, by combining VMD and Teager energy, the SVM accuracy obtained using all channels is 74.24%. Interestingly, when only five channels are selected using NSGA-II, the accuracy increases to 91.56%. The accuracy is further improved to 95.28% when using only 8 features selected from 7 channels. This demonstrates that by choosing informative features or channels while excluding noisy or irrelevant information, the impact of noise is reduced, resulting in improved accuracy. These promising findings indicate that, with a limited number of channels and features, accurate diagnosis of MCI is achievable, which opens the door for its application in clinical practice. [ABSTRACT FROM AUTHOR]

Accurate state-of-health (SOH) estimation is critical for reliable and safe operation of lithium-ion batteries. However, reliable and stable battery SOH estimation remains challenging due to diverse battery types and operating conditions. In this paper, we propose a physics-informed neural network (PINN) for accurate and stable estimation of battery SOH. Specifically, we model the attributes that affect the battery degradation from the perspective of empirical degradation and state space equations, and utilize neural networks to capture battery degradation dynamics. A general feature extraction method is designed to extract statistical features from a short period of data before the battery is fully charged, enabling our method applicable to different battery types and charge/discharge protocols. Additionally, we generate a comprehensive dataset consisting of 55 lithium-nickel-cobalt-manganese-oxide (NCM) batteries. Combined with three other datasets from different manufacturers, we use a total of 387 batteries with 310,705 samples to validate our method. The mean absolute percentage error (MAPE) is 0.87%. Our proposed PINN has demonstrated remarkable performance in regular experiments, small sample experiments, and transfer experiments when compared to alternative neural networks. This study highlights the promise of physics-informed machine learning for battery degradation modeling and SOH estimation. Reliable lithium-ion battery health assessment is vital for safety. Here, authors present a physics-informed neural network for accurate and stable state-of-health estimation, overcoming challenges of varied battery types and usage conditions. [ABSTRACT FROM AUTHOR]

Treatment effect estimation (TEE) is widely adopted in various domains such as machine learning, dvertising and marketing, and medicine. During the TEE, there normally exist selection bias on counterfactual prediction, which results in different distributions of covariates between the treated and control groups. One important challenge in TEE is to mitigate the impact of selection bias, which has attracted a lot of research in recent years. To address this challenge, existing neural network-based methods generally aim to minimize the distribution differences using integral probability metrics. However, minimizing the distribution differences may inadvertently remove outcome-related information during the balancing procedure, which has negative impact on the accuracy of TEE. In this paper, we propose a novel self-supervised learning approach to conduct TEE. Rather than minimizing the distribution differences, we first introduce the concept of virtual samples which have identical covariates as observed samples but with different treatments. In this way, we aim to simulate the scenario where each sample receives both treatment and control. Next, we propose a self-supervised domain embedding learning (SDEL) approach to conduct TEE. In SDEL, we propose to learn both treated and control embeddings for observed and virtual samples, thereby learning the effects of different treatments. To the best of our knowledge, we are the first to introduce the concept of virtual samples and the first to conduct embedding learning in TEE. Building upon SDEL, we propose a feature extraction counterfactual regression network (FE-CFR), in which we propose a feature extraction module (FEM) to estimate the importance of different covariates. Compared with existing TEE methods, our proposed self-supervised learning approach to could improve the accuracy of TEE. Extensive experiments have been conducted on benchmark datasets for TEE, and the results demonstrate that our proposed approach outperforms the compared baseline approaches. [ABSTRACT FROM AUTHOR]

This in-depth study journey explores the context of natural language processing and text analysis in dementia detection, revealing their importance in a variety of fields. Beginning with an examination of the widespread and influence of text data. The dataset utilised in this study is from TalkBank's DementiaBank, which is basically a vast database of multimedia interactions built with the goal of examining communication patterns in the context of dementia. The various communication styles dementia patients exhibit when communicating with others are seen from a unique perspective by this specific dataset. Thorough data preprocessing procedures, including cleansing, tokenization, and structuring, are undertaken, with a focus on improving prediction capabilities through the combination of textual and non-textual information in the field of feature engineering. In the subsequent phase, the precision, recall, and F1-score metrics of Support Vector Machines (SVM), K-Nearest Neighbours (KNN), Random Forest, and Artificial Neural Networks (ANN) are assessed. Empirical facts are synthesized using text analysis methods and models to formulate a coherent conclusion. The significance of text data analysis, the revolutionary potential of natural language processing, and the direction for future research are highlighted in this synthesis. Throughout this paper, readers are encouraged to leverage text data to embark on their own adventures in the evolving, data-centric world of dementia detection. [ABSTRACT FROM AUTHOR]

Optical tracking sensor technology has been widely used in the field of motion. However, there are still some challenges in the recognition of badminton players, and more accurate methods are needed to capture the dynamic characteristics of badminton players. The aim of this study is to design an optical tracking sensor system based on image feature extraction for badminton player motion recognition. In this paper, a high resolution camera is used to collect the image sequence of badminton match. Then through image processing and computer vision technology, the key image features are extracted from the image sequence. Then, machine learning algorithm is used to classify and recognize the extracted features to achieve accurate recognition of badminton players' movements. The experimental results show that the optical tracking sensor system can effectively extract the movement features of badminton players and identify their movements accurately. Compared with the traditional method, the system in this paper has higher precision and real-time performance, and can meet the needs of practical applications. [ABSTRACT FROM AUTHOR]

Machine learning techniques aim to mimic the human ability to automatically learn how to perform tasks through training examples. They have proven capable of tasks such as prediction, learning and adaptation based on experience and can be used in virtually any scientific application, ranging from biomedical, robotic, to business decision applications, and others. However, the lack of domain knowledge for a particular application can make feature extraction ineffective or even unattainable. Furthermore, even in the presence of pre-processed datasets, the iterative process of optimizing Machine Learning parameters, which do not translate from one domain to another, maybe difficult for inexperienced practitioners. To address these issues, we present in this paper a Vectorized Automated ML Pre-processIng and post-pRocEssing framework, approximately named (VAMPIRE), which implements feature extraction algorithms capable of converting large time-series recordings into datasets. Also, it introduces a new concept, the Activation Engine, which is attached to the output of a Multi Layer Perceptron and extracts the optimal threshold to apply binary classification. Moreover, a tree-based algorithm is used to achieve multi-class classification using the Activation Engine. Furthermore, the internet of things gives rise to new applications such as remote sensing and communications, so consequently applying Machine Learning to improve operation accuracy, latency, and reliability is beneficial in such systems. Therefore, all classifications in this paper were performed on the edge in order to reach high accuracy with limited resources. Moreover, forecasts were applied on three unrelated biomedical datasets, and on two other pre-processed urban and activity detection datasets. Features were extracted when required, and training and testing were performed on the Raspberry Pi remotely, where high accuracy and inference speed were achieved in every experiment. Additionally, the board remained competitive in terms of power consumption when compared with a laptop which was optimized using a Graphical Processing Unit. [ABSTRACT FROM AUTHOR]

Hyperspectral imaging is a highly advanced and sophisticated method for capturing images in hundreds of narrow, contiguous spectral bands. However, processing and analyzing such large amounts of data are challenging. Deep learning algorithms, especially those based on convolutional neural networks (CNNs), effectively extract rich feature representations from complex datasets, such as hyperspectral images (HSIs). These representations capture high-level patterns and characteristics that can facilitate accurate classification. The success of this approach has led to its widespread use in various remote sensing applications. However, the standard CNN inputs and outputs are scalars, ignoring the relative position relationships between features. In this paper, we propose a hierarchical capsule network for HSI classification. This network incorporates a multi-level convolutional structure for feature extraction and fusion. It utilizes convolutional feature maps of various depths to generate initial capsules, followed by vector computation using capsule neurons and a weight matrix to encode spatial location relationships among features. Furthermore, the shallow convolution of the hierarchical capsule network is pre-trained based on transfer learning to further improve the performance of HSI classification. According to experimental results, the proposed method for hyperspectral image classification has been found to outperform other state-of-the-art deep learning models on four benchmark datasets. [ABSTRACT FROM AUTHOR]

With the increased use of social network sites, such as Twitter, attackers exploit these platforms to spread counterfeit content. Such content can be fake advertisements or illegal content. Classifying such content is a challenging task, especially in Arabic. The Arabic language has a complex structure and makes classification tasks more difficult. This paper presents an approach to classifying Arabic tweets using classical machine learning (non-deep machine learning) and deep learning techniques. Tweets corpus were collected through Twitter API and labelled manually to get a reliable dataset. For an efficient classifier, feature extraction is applied to the corpus dataset. Then, two learning techniques are used for each feature extraction technique on the created dataset using N-gram models (uni-gram, bi-gram, and char-gram). The applied classical machine learning algorithms are support vector machines, neural networks, logistics regression, and naïve Bayes. Global vector (GloVe) and fastText learning models are utilised for the deep learning approaches. The Precision, Recall, and F1-score are the suggested performance measures calculated in this paper. Afterwards, the dataset is increased using the synthetic minority oversampling technique class to create a balanced dataset. After applying the classical machine learning models, the experimental results show that the neural network algorithm outperforms the other algorithms. Moreover, the GloVe outperforms the fastText model for the deep learning approach. [ABSTRACT FROM AUTHOR]

Early diagnosis and treatment are the keys to managing patients with breast cancer. Identifying patients even before they present with symptoms is made possible through screening methods. Thermography is a tool for screening carcinoma breast to reduce the associated morbidity and mortality. This paper proposes a novel feature selection using a machine learning algorithm, namely, the Greedy search optimization algorithm. This algorithm is applied to compare various features selection techniques. These techniques are sequential backward (SBS), sequential forward feature selection, and exhaustive feature selection techniques. It is concluded from this comparison that sequential backward feature selection is the best technique for breast cancer diagnosis. Our average score of SBS comes 88.5714%, with a computational time of 87.4 s. For classification purposes, we have used an artificial neural network. The classification result varies according to the age group with the physiology of the breast. Considering this, we have selected features age-group wise by sequential backward technique. The classification accuracy of (20–40), (41–60), (61–80) years age group patients are 79.349%, 80.711%, and 74.76%. [ABSTRACT FROM AUTHOR]

Automatic rice variety identification or quality analysis is a challenging task in image processing and reflects advanced insights into agricultural research with the help of emerging computational technologies. It is the process of identifying the variety of the rice grains by matching them with the training dataset. It is an arduous task because the quality of rice grains is distinct from each other due to the availability of their numerous varieties in the market and unique inherent characteristics. Therefore, customers must identify the superior quality of rice from different available types in the market. This paper demonstrates an exhaustive and transparent perspective on the recent research studies for developing various identification systems using other techniques and a broad view towards this peculiar research area. The paper's main aim is to present in an organized way the related works on identification systems of rice and finally throws exposure on the synthesis analysis based on the research findings. This research study provides valuable and valuable assistance to novice researchers in the agricultural field by amalgamating the studies of various methods and techniques of feature extractions and classification required for automatic variety identification of rice. It is evident from the study that research work carried out on the automated variety identification systems with higher accuracy rates in deep learning using a conjunction of various features of rice is minimal as compared to other techniques and indeed presents a future direction. [ABSTRACT FROM AUTHOR]

Aerial image data are becoming more widely available, and analysis techniques based on supervised learning are advancing their use in a wide variety of remote sensing contexts. However, supervised learning requires training datasets which are not always available or easy to construct with aerial imagery. In this respect, unsupervised machine learning techniques present important advantages. This work presents a novel pipeline to demonstrate how available aerial imagery can be used to better the provision of services related to the built environment, using the case study of road traffic collisions (RTCs) across three cities in the UK. In this paper, we show how aerial imagery can be leveraged to extract latent features of the built environment from the purely visual representation of top-down images. With these latent image features in hand to represent the urban structure, this work then demonstrates how hazardous road segments can be clustered to provide a data-augmented aid for road safety experts to enhance their nuanced understanding of how and where different types of RTCs occur. [ABSTRACT FROM AUTHOR]

Feature extraction is one of most important steps in the control of multifunctional prosthesis based on surface electromyography (sEMG) pattern recognition. In this paper, a new sEMG feature extraction method based on muscle active region is proposed. This paper designs an experiment to classify four hand motions using different features. This experiment is used to prove that new features have better classification performance. The experimental results show that the new feature, active muscle regions (AMR), has better classification performance than other traditional features, mean absolute value (MAV), waveform length (WL), zero crossing (ZC) and slope sign changes (SSC). The average classification errors of AMR, MAV, WL, ZC and SSC are 13%, 19%, 26%, 24% and 22%, respectively. The new EMG features are based on the mapping relationship between hand movements and forearm active muscle regions. This mapping relationship has been confirmed in medicine. We obtain the active muscle regions data from the original EMG signal by the new feature extraction algorithm. The results obtained from this algorithm can well represent hand motions. On the other hand, the new feature vector size is much smaller than other features. The new feature can narrow the computational cost. This proves that the AMR can improve sEMG pattern recognition accuracy rate. [ABSTRACT FROM AUTHOR]

To improve the effect of landslide feature extraction, this paper improves the remote sensing image recognition algorithm with the support of a machine learning algorithm. Moreover, this paper combines UAV remote sensing images to extract landslide features, classifies and introduces the evaluation criteria for target detection and several representative target detectors. This paper also constructs the functional structure of the system according to the landslide feature extraction requirements and designs a set of optimization schemes for landslide feature data collection and control measurement suitable for field operations. In addition, this paper analyses the system kernel algorithm process and analyses the system function realization through simulation research. Finally, this paper designs an experiment to evaluate the practicability of the system constructed in this paper. From the results of experimental statistics, we can see that the system constructed in this paper has good practicability. [ABSTRACT FROM AUTHOR]

What are the best methods of capturing thematic similarity between literary texts? Knowing the answer to this question would be useful for automatic clustering of book genres, or any other thematic grouping. This paper compares a variety of algorithms for unsupervised learning of thematic similarities between texts, which we call "computational thematics". These algorithms belong to three steps of analysis: text pre-processing, extraction of text features, and measuring distances between the lists of features. Each of these steps includes a variety of options. We test all the possible combinations of these options. Every combination of algorithms is given a task to cluster a corpus of books belonging to four pre-tagged genres of fiction. This clustering is then validated against the "ground truth" genre labels. Such comparison of algorithms allows us to learn the best and the worst combinations for computational thematic analysis. To illustrate the difference between the best and the worst methods, we then cluster 5000 random novels from the HathiTrust corpus of fiction. [ABSTRACT FROM AUTHOR]

Currently, extensive research is being conducted in the application of Machine Learning (ML) algorithms in the medical domain and one such area is classifying Parkinson's Patients. Feature extraction methods play a critical part in the use of ML techniques in providing better accuracies. The earlier studies have used various feature extraction techniques like Principal Component Analysis (PCA), Independent Component Analysis (ICA), Region of Interest (ROIs), etc. This paper deals with the use of two feature extraction techniques - Canonical Independent Component Analysis (CanICA) and Dictionary Learning (DL) for the Functional Magnetic Resonance Imaging (fMRI) modality. Region of Interest (ROI) extraction of connected components and dimensionality reduction algorithms further refine the features. The features extracted are then applied to the Machine Learning models for the classification of individuals suffering from Parkinson's disease. The methodology adopted in the research provided accuracy of 87.5% and 86.6% using the CanICA and DL techniques respectively. The accuracies obtained are found to be better than the other research conducted using ML algorithms for the MRI data. [ABSTRACT FROM AUTHOR]

Internet of Things (IoT) devices are widely used but also vulnerable to cyberattacks that can cause security issues. To protect against this, machine learning approaches have been developed for network intrusion detection in IoT. These often use feature reduction techniques like feature selection or extraction before feeding data to models. This helps make detection efficient for real-time needs. This paper thoroughly compares feature extraction and selection for IoT network intrusion detection in machine learning-based attack classification framework. It looks at performance metrics like accuracy, f1-score, and runtime, etc. on the heterogenous IoT dataset named Network TON-IoT using binary and multiclass classification. Overall, feature extraction gives better detection performance than feature selection as the number of features is small. Moreover, extraction shows less feature reduction compared with that of selection, and is less sensitive to changes in the number of features. However, feature selection achieves less model training and inference time compared with its counterpart. Also, more space to improve the accuracy for selection than extraction when the number of features changes. This holds for both binary and multiclass classification. The study provides guidelines for selecting appropriate intrusion detection methods for particular scenarios. Before, the TON-IoT heterogeneous IoT dataset comparison and recommendations were overlooked. Overall, the research presents a thorough comparison of feature reduction techniques for machine learning-driven intrusion detection in IoT networks. [ABSTRACT FROM AUTHOR]

Malignant melanoma is one of the most serious and deadly types of skin cancer, fortunately it is treatable if detected at an early stage. Many Computer-Aided Diagnosis (CAD) systems are proposed in the literature to assist in detecting this type of cancer. The vast majority of them are performed in four main steps, which are preprocessing, image segmentation, features extraction, and classification. In this paper, we propose a new ensemble-learning scheme that uses three classifiers each one based, separately, on a different type of features: color, texture, and shape. Moreover, in order to be able to efficiently identify the lesion and safe skin region and thus extract the features, we proposed using, as a preprocessing step, a multi-scale image decomposition based on Partial Differential Equations (PDE) that will allow us to isolate the object and the texture from the image. Color and texture features will be extracted from both, the safe skin and the extracted lesion, while shape features will be extracted from only the detected lesion. We proposed using the SVM algorithm for the design of each of the three classifiers and the final diagnostic decision is obtained by applying the majority voting approach. The proposed model was validated and tested on the public PH2 database, achieving a classification accuracy of 98%, rappel of 95%, and precision of 95%; we can conclude that the proposed approach is very promising. [ABSTRACT FROM AUTHOR]

Cybersecurity has emerged as a critical global concern. Intrusion Detection Systems (IDS) play a critical role in protecting interconnected networks by detecting malicious actors and activities. Machine Learning (ML)-based behavior analysis within the IDS has considerable potential for detecting dynamic cyber threats, identifying abnormalities, and identifying malicious conduct within the network. However, as the number of data grows, dimension reduction becomes an increasingly difficult task when training ML models. Addressing this, our paper introduces a novel ML-based network intrusion detection model that uses Random Oversampling (RO) to address data imbalance and Stacking Feature Embedding based on clustering results, as well as Principal Component Analysis (PCA) for dimension reduction and is specifically designed for large and imbalanced datasets. This model's performance is carefully evaluated using three cutting-edge benchmark datasets: UNSW-NB15, CIC-IDS-2017, and CIC-IDS-2018. On the UNSW-NB15 dataset, our trials show that the RF and ET models achieve accuracy rates of 99.59% and 99.95%, respectively. Furthermore, using the CIC-IDS2017 dataset, DT, RF, and ET models reach 99.99% accuracy, while DT and RF models obtain 99.94% accuracy on CIC-IDS2018. These performance results continuously outperform the state-of-art, indicating significant progress in the field of network intrusion detection. This achievement demonstrates the efficacy of the suggested methodology, which can be used practically to accurately monitor and identify network traffic intrusions, thereby blocking possible threats. [ABSTRACT FROM AUTHOR]

Features of data are much critical to the classification. However, when only small data are available, suitable features can not be easily obtained, easily leading to the bad classification performance. This paper propose a novel approach to automatically learns features from the irrelevant domain with much discriminative features for the given classification task. It first computes as the learning objectives the central vectors of each class in the irrelevant domain, and then uses machine learning method to automatically learn features for each sample in the target domain from these objectives. The merits of our method lie in that unlike the transfer learning, our method does not require the similarity between two domains. It can learn features from much discriminative domains. Its learned features are not limited to its original ones, unlike feature selection and feature extraction methods, so that the classification performance with the learned features can be better. Finally, our method is much general, simple, and efficient. Lots of experimental results validated the proposed method. [ABSTRACT FROM AUTHOR]

Purpose: To propose a new quality scoring tool, METhodological RadiomICs Score (METRICS), to assess and improve research quality of radiomics studies. Methods: We conducted an online modified Delphi study with a group of international experts. It was performed in three consecutive stages: Stage#1, item preparation; Stage#2, panel discussion among EuSoMII Auditing Group members to identify the items to be voted; and Stage#3, four rounds of the modified Delphi exercise by panelists to determine the items eligible for the METRICS and their weights. The consensus threshold was 75%. Based on the median ranks derived from expert panel opinion and their rank-sum based conversion to importance scores, the category and item weights were calculated. Result: In total, 59 panelists from 19 countries participated in selection and ranking of the items and categories. Final METRICS tool included 30 items within 9 categories. According to their weights, the categories were in descending order of importance: study design, imaging data, image processing and feature extraction, metrics and comparison, testing, feature processing, preparation for modeling, segmentation, and open science. A web application and a repository were developed to streamline the calculation of the METRICS score and to collect feedback from the radiomics community. Conclusion: In this work, we developed a scoring tool for assessing the methodological quality of the radiomics research, with a large international panel and a modified Delphi protocol. With its conditional format to cover methodological variations, it provides a well-constructed framework for the key methodological concepts to assess the quality of radiomic research papers. Critical relevance statement: A quality assessment tool, METhodological RadiomICs Score (METRICS), is made available by a large group of international domain experts, with transparent methodology, aiming at evaluating and improving research quality in radiomics and machine learning. Key points: • A methodological scoring tool, METRICS, was developed for assessing the quality of radiomics research, with a large international expert panel and a modified Delphi protocol. • The proposed scoring tool presents expert opinion-based importance weights of categories and items with a transparent methodology for the first time. • METRICS accounts for varying use cases, from handcrafted radiomics to entirely deep learning-based pipelines. • A web application has been developed to help with the calculation of the METRICS score (https://metricsscore.github.io/metrics/METRICS.html) and a repository created to collect feedback from the radiomics community (https://github.com/metricsscore/metrics). [ABSTRACT FROM AUTHOR]

Hyperspectral image (HSI) classification has continued to be a hot research topic in recent years, and the broad learning system (BLS) has been considered by scholars for the classification of HSIs due to its superior internal structure. Different from the traditional HSI classification mechanism, this paper proposes an active broad learning system approach for HSI classification. The spectral and spatial features of the image are extracted using principal component analysis and local binary patterns, respectively. Then, the vector fusion of the above two features is utilized as the input of the BLS and trained to obtain pre-labels of the samples. The next training samples are selected among the pre-labels by active learning. Unlike other classification algorithms, the method proposed in this paper utilizes active learning (AL) to select high-quality samples for training, thereby reducing the number of samples used and the cost of sample labeling. In addition, the use of incremental learning in broad learning significantly reduces the training time and improves the classification accuracy. The algorithm proposed in this paper is more effective compared to other state-of-the-art algorithms on three HSI datasets. [ABSTRACT FROM AUTHOR]

Federated learning (FL) is an emerging technique used to preserve the privacy of users' data in training by a distributed machine learning approach. Previously, a client-edge-cloud hierarchical federated learning (HierFL) system was proposed to reduce the long communication latency between the client and the cloud. However, HierFL performs very poorly at extracting better features from the data in the client, which is also a common drawback of traditional FL architectures. HierFL also constrains the its hierarchy to server-edge-client three levels which is very restrictive. This paper proposes that the specifically designed FL architecture can naturally have an excellent effect on feature extraction. Specifically, this paper proposes a multibranch multilevel federated learning (MBMLFL) framework to perform a better job at feature extraction, and each branch and level has its own self specific effect. The proposed framework is also friendlier as well as further enhances the privacy. By extending FedAvg, we design an M2DCFedAvg algorithm for the framework to optimize its objective function distributedly, and by conducting numerous experiments and analyses, we propose a general epoch selection principle for all the FL methods: the 1 d T -n principle. Experiments with various data distributions are performed on MBMLFL to comprehensively research its characteristics. Moreover, to complete the personalization ability of our framework, we propose a plug-and-play dynamic-adjusting double flow personalization approach (DADFPA) for our MBMLFL method, which will further enhance the ability of the MBMLFL, such that it comprehensively and adaptively satisfies the generalization and personalization needs of clients. Experiments show that the MBMLFL and DADFPA can improve their baselines by an average of 5.26% and 2.24% points, which demonstrates their excellent performance. [ABSTRACT FROM AUTHOR]