Search

• A feature selection method based on binary dandelion algorithm is proposed. • The algorithm applies a sine-cosine operator and a restart strategy. • Mutual information and quick bit mutation improve the performance of the algorithm. • The algorithm performs well on datasets with larger dimensions. Feature selection (FS) is an important data preprocessing technology for machine learning and data mining. Metaheuristic algorithm (MH) has been widely used in feature selection because of its powerful search function. This paper presents an improved Binary Dandelion Algorithm using Sine Cosine operator and Restart strategy (SCRBDA) for feature selection. First, the sine cosine operator is used in the radius formula of the core dandelions (CD), which significantly enhances the ability of algorithm development and exploration. Secondly, the algorithm uses a restart strategy to increase its ability to get rid of local optimum. Thirdly, mutual information is used to guide the generation of some dandelions, which pays more attention to the correlation between the selected features and categories. Finally, quick bit mutation is used as the mutation strategy to improve the diversity of the population. The SCRBDA proposed in this paper was tested on 18 datasets of different sizes from UCI machine learning database. The SCRBDA was compared with 8 other classical feature selection algorithms, and the performance of the proposed algorithm was evaluated through feature subset size, classification accuracy, fitness value, and F1-score. The experimental results show that SCRBDA achieves the best performance, which has stronger feature reduction ability and achieves better overall performance on most datasets. Especially on large-scale datasets, SCRBDA can obtain extremely smaller feature subsets while maintaining much higher classification accuracy, and satisfactory F1-score. [ABSTRACT FROM AUTHOR]

Intelligent Fault-Tolerant Control (IFTC) refers to the applications of machine learning algorithms for fault diagnosis and design of Fault-Tolerant Control (FTC). The overall goal of the FTC is to accommodate defects in the system components while they are in use and maintain stability with little to no performance reduction. These systems are crucial for mission-critical and safety-related applications where the safety of people is at stake and service continuity is crucial. In this review paper, a systematic study has been done for the development of FTC with machine learning, deep learning, and transfer learning algorithms. The challenges and limitations faced with their possible solutions through machine learning theories for the IFTC model are lined up. This paper guides researchers on the different possible types of machine learning algorithms and their advanced forms like deep learning and transfer learning. The differences among these are highlighted by the challenges and limitations of each. The paper is significant such that most of the important literature references from the Scopus database particularly related to important electrical and mechanical industrial problems have been discussed to guide the researchers who want to apply IFTC for specific industrial problems, being the research gap. Finally, future research directions for the development of IFTC are highlighted. [ABSTRACT FROM AUTHOR]

Identifying the abnormal samples from a data set and determining their type are two key tasks of anomaly detection. However, the existing anomaly detection algorithms are generally faced with the defects of weak generalization ability and insufficient interpretation, the core reason of which is that they cannot mine specific features for different abnormal types. In this paper, a new anomaly detection algorithm aiming at feature selection for different abnormal types is developed. Inspired by self-supervised learning, we take the stationarity of variance changes of abnormal score similarity as a pretext task and combine it with wrapped search method. Then, the features and the corresponding parameters for different abnormal types can be screened to apply to the downstream task of anomaly integration detection. To verify the efficiency of the new algorithm, we conduct two sets of experiments to compare the new algorithm with 11 classical anomaly detection and 3 clustering anomaly detection algorithms on the data sets WDBC, WPBC and Wilt from DAMI database with the evaluation measures P@n , Adj- P@n , AP, Adj-AP and AUC. The experiment results show that, both in the identification and classification on abnormal samples, all performance measures of the new algorithm are explicitly better than that of the contrastive algorithms. Also, we apply the new algorithm to the Chinese auto insurance market, and find that the results can help managers to identify the main patterns of fraudulent claims and to summarize the feature combinations of fraud behaviors. In general, the new algorithm developed in this paper has the following advantages compared with traditional algorithms: 1) It can directly capture abnormal features and realize effective recognition of abnormal types, which effectively bridge the gap between abnormal judgement and feature screening. 2) Automatic screening of abnormal features can be completed under the condition of self-updating learning optimal strategy. 3) Only a few features are extracted from all features to reveal the abnormal characteristics, which significantly improves the interpretability and generalization ability of the algorithm and its results. In a word, through the novel self-supervised design method, feature screening is skillfully integrated into the anomaly detection task, which may provide a new way for anomaly detection research. [ABSTRACT FROM AUTHOR]

The mining of frequent itemsets and association rules is a core problem in data mining and an essential task in data analysis. In this paper, we present SufRec, a new algorithm for finding frequent itemsets and association rules. We give two versions. In both versions, the mining of the frequent itemsets is decomposed as a sequence of tasks. The first version (the SufRecDep algorithm) proceeds the tasks successively, each one using the results of the previous ones. The second version (the SufRecInd algorithm) performs the tasks independently of each other. Both versions are recursive with respect to the items and have thus the advantage to be particularly efficient for updating the mining process when new items are added to the database or when others are excluded. Moreover, the task-independent processing of SufRecInd makes it very easy to build parallel versions of SufRec. We present two parallel SufRec algorithms. With the first one, P-FIFO-SufRec, the processors perform the tasks according to the order in which the items appear in the database, preserving the recursive nature of SufRec. For second one, P-PAST-SufRec, the set of items is fixed and the tasks are pre-assigned to each processor. In order to evaluate the performance of SufRec, we carry out a consequent experimental study. In particular, we compare its running times with those of well-known parallel and non-parallel frequent itemsets mining algorithms. • Construction of SufRec, a new algorithm for frequent itemsets mining (FIM). • Construction of parallel versions of SufRec algorithm. • Experimental study comparing SufRec with well-known FIM algorithms. • Applications to the case where the list of items changes over time. [ABSTRACT FROM AUTHOR]

High utility pattern mining (HUPM) plays a significant role in data mining technologies. Traditional HUPM algorithms may produce a large number of high utility patterns (HUPs) when the database is dense or the data is massive. To address this issue, closed high utility pattern (CHUP) mining was proposed, providing a high-level overview of the HUPs and helpful information for decision-makers. However, CHUPs do not consider the factors of period and recency. Therefore, this paper is the first to introduce period and recency into closed high utility pattern mining and proposes the CPR-Miner algorithm to mine closed periodic recent high utility patterns. These patterns have more practical value since they are closed sets of HUPs. Due to the increasing number of factors to be considered, new upper bounds and pruning strategies are also proposed, significantly improving the algorithm's efficiency. To test the performance of our algorithm and our new pruning strategies, we improved the PHM algorithm to generate the PR-Miner algorithm. Experimental results show a significant efficiency of the new pruning strategies and demonstrate that CPR-Miner outperforms the PR-Miner algorithm in all aspects. • Periodicity and recency are introduced within closed high utility pattern mining. • New data structures are designed to store the utility, period, and recency information. • Novel pruning strategies are proposed to avoid unnecessary list joint operation. • The proposed algorithm gets significant results on several datasets. [ABSTRACT FROM AUTHOR]

This article proposes a novel design methodology for circular concrete-filled steel tubular (CFST) columns, combining a large experimental database, an artificial neural network, and the balancing-composite-motion-optimization algorithm. First, the experimental database consisting of 1245 compression tests was compiled from the available literature, involving five input parameters: cross-sectional outer diameter, thickness of steel tube, length of column, yield strength of steel and cylindrical compressive strength of concrete, and one output variable: the measured axial capacity of columns. Second, the artificial neural network model was trained and validated using that database, in combination with various error measurement criteria: mean-squared-error, mean-absolute-error, and coefficient of determination. The optimization problem to find the optimal design of circular CFST columns was then formulated as a function of material cost and the geometrical parameters of the cross-section. Finally, balancing-composite-motion-optimization was employed to solve the aforementioned nonlinear optimization problem. The proposed model's performance was compared with the widely used standards EC4, AISC, and DBJ, especially for scenarios exceeding the limitations of individual material strengths. Results showed that the proposed equation exhibited the best predictive performance. For practical application, we have derived an explicit prediction equation and implemented it in Excel, a user-friendly interface (the Excel file is appended to this paper). Thus, the proposed method in this study can assist existing codes in finding the optimal design of CFST columns, as the current standards have limitations as to the characteristic strength of the materials. [ABSTRACT FROM AUTHOR]

Driver pathways have been acknowledged to play critical roles in the initiation and progression of cancers►hence it is essential for precision medicine related studies to develop accurate and efficient methods to identify them. Although previous approaches have shown promising results by integrating multi-omics data, their preset artificial parameters may decrease the convenience to use and limit the application scalability. In this paper, a novel integration approach is proposed to incorporate four omics data, i.e., construct a weighted non-binary mutation matrix without presetting artificial parameters. A parameter-free identification model is put forward based on it. It takes advantage of the association between genes in the PPI network as well as balances the contribution of coverage and mutual exclusivity with the harmonic mean. Furthermore, a cooperative co-evolution algorithm is proposed for solving this model. In the algorithm, a particle swarm optimization algorithm suitable for solving combinatorial problems is presented. Three cooperative operators are devised to construct the cooperation among the populations and the swarm to increase the population diversity. Both real biological datasets and simulated ones were exerted to perform experimental comparisons among the proposed method and six other state-of-the-art ones. The gene sets identified by the presented method generally contain more genes involved in known signaling pathways than those obtained by the other methods. Simultaneously, both high accuracy and high efficiency of the proposed method were verified in experiments, making it practical in realistic applications and an effective supplementary tool to identify driver pathways. • A non-binary mutation matrix is constructed without artificial adjustable parameters. • The model incorporates gene association and balances coverage and mutual exclusivity. • A PSO algorithm suitable for solving combinatorial problems is presented. • A co-operative co-evolution algorithm is put forward for solving the presented model. • The performance is compared among the proposed method and seven state of the art ones. [ABSTRACT FROM AUTHOR]

• Apply dynamic utility calculation framework to mine closed high utility itemsets. • Dramatically reduce the cost of database scans by adopting the P-set structure. • Propose a new CHUIM algorithm, named iEFIM-Closed. • Conduct experiments to measure the performance of the proposed algorithm. The problem of discovering high-utility itemsets (HUIs) in transaction databases, which is an extension of Frequent Itemset Mining, is a commonly encountered mining task. Researchers have proposed algorithms to efficiently mine highly profitable itemsets in customer transaction databases, in which the unit profits of items are fixed. However, this assumption does not reflect the true nature of the utility measure of items in real-life transaction databases, which might vary over time. Moreover, since this important characteristic is ignored by all the current HUI mining algorithms, they are either not applicable to this type of database, or they generate inaccurate results. In addition, the HUI mining algorithms' traditional limitation is that they produce a huge number of HUIs for users. In this paper, we define the problem of mining a lossless, concise and compact representation of HUIs, called closed HUIs (CHUIs), in dynamic unit profit databases. Based on newly defined of utility measure, a novel algorithm, called iEFIM-Closed, is introduced. This relies on this new utility measure, a novel compact database format to reduce the cost of database scans and increase the efficiency of the mining process. Experimental evaluations show that iEFIM-Closed significantly outperforms state-of-the-art algorithms for mining CHUIs on sparse databases with dynamic profit, and has competitive performance in dense databases in terms of runtime, the cost of database scans and scalability. [ABSTRACT FROM AUTHOR]

• The new method of classifier selection for imbalanced data is proposed. • Selection rule uses the dominance in the FPR/FNR space and crowding distance. • Tests on two real datasets confirm that new method improves the prediction. The goal of the paper is to develop a new algorithm for predicting whether the company will go bankrupt on the base of unbalanced data. To do it, we propose to consider the classification as a multi-objective optimization problem and construct a prediction model as an ensemble while minimizing the parameters FPR (False Positive Rate) and FNR (False Negative Rate) at the same time. To create the ensemble, the proposed algorithm of a Multi-Objective Classifier Selection (MOCS) selects only classifiers that belong to the Pareto-optimal set in FPR/FNR space; that is, there is no dominance between them, and they satisfy some additional conditions. In the general case, MOCS is determined by three parameters: two threshold values that limit false rates (FNR and FPR), and the crowding distance, which defines the uniqueness of the classifier's results. We tested the proposed algorithm on data collected from 2457 Russian companies, 456 of which went bankrupt, and 5910 Polish companies, 410 of which received bankruptcy status. Datasets contain features such as financial ratios and business environment factors. In the testing, we used more than 70 combinations of under-sampling, over-sampling, and no sampling methods with static and dynamic classification models. Final ensembles include seven classifiers for the Russian dataset and four classifiers for the Polish dataset combined by soft voting rule. In both cases, the proposed algorithm produces a significant improvement of prediction results as in terms of standard metrics (geometric mean, the area under the ROC curve) and in the visual representation in the FNR/FPR space, namely in the shift from a Pareto-optimal set of classifiers. [ABSTRACT FROM AUTHOR]