Search

• The existing methods may lead to a contradictory in the transitivity. • A novel neighborhood geometric similarity was firstly defined. • Four new kinds of neighborhood similarities were proposed. • A new VPNRS model is constructed, and a novel decision tree algorithm is proposed. The decision tree algorithm has been widely used in data mining and machine learning due to its high accuracy, low computational cost and high interpretability. However, when dealing with the continuous data, the classical decision tree algorithm needs to replace continuous attributes with discretized attributes by the strategy of discretization. Discretization may cause a loss of information structure, which will affect the performance of classification. To tackle this problem, many researchers have proposed different decision tree methods based on variable precision neighborhood rough sets. However, these methods do not consider the geometric structure of neighborhood systems, which may lead to a contradiction in the transitivity of the equivalence relation. In this paper, we first define a novel neighborhood geometric similarity in a neighborhood system from the perspective of geometry. Second, by combining the neighborhood geometric similarity and the neighborhood algebraic similarity, we propose four new kinds of neighborhood similarities, which can solve the contradictory transitivity of the equivalence relation. Third, a variable precision neighborhood rough set model is constructed using the new similarities, and a novel decision tree algorithm is proposed based on this model, where the degree of attribute dependence is used as the partition measure. Experimental results on 14 selected datasets from the UCI Machine Learning Repository show that our algorithm is effective. The average accuracy of our algorithm is over 90%, which is 10% higher than the classical decision tree algorithms, and the number of leaf nodes increases slightly. [ABSTRACT FROM AUTHOR]

Clustering, as an essential technique in unsupervised learning, plays a pivotal role in the fields of data mining and machine learning. However, the classic K -means clustering algorithm has intrinsic drawbacks such as sensitivity to initial cluster centers, susceptibility to a local optimal solution, and challenges in handling data uncertainty. To address these problems, this paper proposes an artificial hummingbird algorithm (AHA)-based three-way K -means clustering algorithm, called AHA-3WKM. First, AHA is introduced to address the problems of sensitivity to initial cluster centers and local optima. Second, a fitness function of AHA is specifically constructed to find the best initial clustering centers so that the hummingbirds can search for high-quality food sources, i.e., the global optimum cluster centers. Third, a three-way clustering approach is utilized to capture information about data uncertainty. In this way, the results of clustering are divided into three distinct regions based on the relationship between objects and clusters. The experimental results demonstrate that AHA-3WKM has good performance, and enhances the stability and the accuracy of clustering results. • AHA is introduced to address the problems of the sensitivity to initial cluster centers and the proneness to local optima. Hummingbirds are treated as data points, which dynamically update their strategies and effectively find the optimal cluster centers during multiple iterations. • A fitness function is designed based on the clustering principle of "birds of a feather flock together", with the aim of simplifying calculations, which enhances the specificity and practicality of K-means algorithm. • An AHA-based three-way K-means clustering algorithm (i.e., AHA-3WKM) is proposed. The clustering process is initialized with cluster centers optimized by AHA, and the results are represented in three regions, which can capture the uncertainty within the datasets. [ABSTRACT FROM AUTHOR]

• We generalize the concepts of the conditional and decision attributes through concept hierarchy tree, and define a generalized hierarchical decision table. • We decompose and aggregate condition and decision attribute granules under different levels of granularity. • We propose the optimistic and pessimistic generalized multigranulation three-way decision models for hierarchical classification. • We compare the advantages under different sequential three-way decision models experimentally. Hierarchical classification is an important research hotspot in machine learning due to the widespread existence of data with hierarchical class structures. The existing sequential three-way decision models mainly constructed the hierarchical condition information granules via concept hierarchy tree to discuss the three probabilistic regions for flat classification. However, in real-world applications, one may face not only the tree-structured data with hierarchical condition attributes but also more often the multi-level data with hierarchical decision attribute (hierarchical class labels). How to obtain acceptable decisions under different levels of granularity is the most important issue within the multi-level and multi-view data. To this end, we construct a generalized hierarchical decision table and propose a generalized hierarchical multigranulation sequential three-way decision model by combining multi-granularity and sequential three-way decisions. Specifically, we first design a generalized hierarchical decision table using concept hierarchy trees of all conditional attributes and decision attribute, and explore some basic properties. Then we decompose and aggregate condition and decision granules under different levels of granularity, propose the optimistic and pessimistic generalized hierarchical multigranulation three-way decision models to update the three probabilistic regions for flat and hierarchical classification, and discuss the relationships between these two models. Finally, the experimental results demonstrate that the proposed models are more suitable for different applications. These models will provide a novel insight and enrich the development of multigranulation three-way decisions from the perspective of multi-level and multi-view. [ABSTRACT FROM AUTHOR]