Search

In the era of big data, the demand for multivariate time series prediction has surged, drawing increased attention to feature selection and neural networks in machine learning. However, certain feature selection methods neglect the alignment between actual data sample differences and clustering results, while neural networks lack automatic parameter adjustment in response to changing target features. This paper presents the MBSSA-Bi-AESN model, a Bi-directional Adaptive Echo State Network that utilizes the modified salp swarm algorithm (MBSSA) and feature selection to address the limitations of manually set parameters. Initial feature subset selection involves assigning weights based on the consistency of clustering results with differences. Subsequently, the four critical parameters in the Bi-AESN model are optimized using MBSSA. The optimized Bi-AESN model and selected feature subset are then integrated for simultaneous model learning and optimal feature subset selection. Experimental analysis on eight datasets demonstrates the superior prediction accuracy of the MBSSA-Bi-AESN model compared to benchmark models, underscoring its feasibility, validity, and universality. [ABSTRACT FROM AUTHOR]

In this article, we develop a residual-sparse Fuzzy C-Means (FCM) algorithm for image segmentation, which furthers FCM's robustness by realizing the favorable estimation of the residual (e.g., unknown noise) between an observed image and its ideal version (noise-free image). To achieve a sound tradeoff between detail preservation and noise suppression, morphological reconstruction is used to filter the observed image. By combining the observed and filtered images, a weighted sum image is generated. Tight wavelet frame decomposition is used to transform the weighted sum image into its corresponding feature set. Taking such feature set as data for clustering, we impose an $\ell _0$ regularization term on residual to FCM's objective function, thus resulting in residual-sparse FCM, where spatial information is introduced for improving its robustness and making residual estimation more reliable. To further enhance segmentation accuracy of the proposed FCM, we employ morphological reconstruction to smoothen the labels generated by clustering. Finally, based on the prototypes and smoothed labels, a segmented image is reconstructed by using tight wavelet frame reconstruction. Experimental results regarding synthetic, medical, and real-world images show that the proposed algorithm is effective and efficient, and outperforms its peers. [ABSTRACT FROM AUTHOR]

In this article, we introduce novel reinforced hybrid fuzzy rule-based neural networks (RHFNNs). This article is concerned with the development of the design methodologies of hybrid fuzzy rule-based model for constructing the network structure and enhancing its predictive abilities through the combination of inhomogeneous neurons [i.e., clustering-based polynomial neurons (CPNs) and polynomial neurons (PNs)] and tournament selection. The key points of the proposed RHFNN are enumerated as follows: The first layer of the proposed network consists of CPNs. CPN can effectively reflect the complex nonlinear structure encountered in the data space, and refine (granulate) it with the help of the clustering algorithm. Two types of CPNs including hard C-means (HCM) clustering-based polynomial neuron (HCPN) and fuzzy C-means (FCM) clustering-based polynomial neuron (FCPN) are designed. According to the type of CPN used in the first layer, RHFNN can be categorized into two types, namely, RHFNN based on HCPN (HRHFNN) and RHFNN based on FCPN (FRHFNN). We use PNs to construct the second and consecutive layers. PN can identify and approximate the nonlinear relationship among system's inputs and outputs. A tournament-based performance selection (TPS) algorithm stemming from evolutionary computation is used for selection of neuron. TPS not only ensures that the candidate nodes have sufficient fitting ability but also enhances the individual diversity in the node set and provides the abilities to generate better prediction nodes. In addition, L2-norm regularization is considered to reduce the deviation between coefficients and ameliorate overfitting as well as boost generalization ability. The performance of RHFNN is discussed through a variety of publicly available machine learning datasets. From the experimental results, we conclude that RHFNN achieves the best prediction accuracy on 13 of 15 datasets; the statistical analysis also confirms the superiority of RHFNN. [ABSTRACT FROM AUTHOR]

This study is devoted to the generalization of information granules by forming higher order, namely, order-2 information granules. Information granules are semantically meaningful entities, which play a central role in knowledge representation and system modeling in the framework of Granular Computing. The encountered information granules could exhibit significant heterogeneity because of the diversified formal formalisms. To facilitate an effective generalization of heterogeneous granular data when using clustering algorithms, an efficient scheme has been proposed to form a unified representation of various types of granular data by using Possibility–necessity measures. Once the clustering process has been completed in the possibility–necessity feature space, the higher order information granules come as results of decoding by involving the possibility–necessity metrics and fuzzy relational calculus. The extent to which the higher order information granules are supported by the granular data present at a lower level of hierarchy is quantified in terms of the membership degrees obtained in the clustering process. Experimental studies concerning a series of publicly available datasets coming from UCI and KEEL machine learning repositories are carried out in this study. • A novel encoding/decoding method for representing heterogeneous granular data. • Clustering algorithm can be applied to cluster encoded heterogeneous granular data. • Supported by fuzzy relational calculus theory and Possibility-necessity measures. [ABSTRACT FROM AUTHOR]

Abstract Fuzzy rule-based classifiers have been used in many applications showing better performance due to simple modular architectures and significant interpretability. Generally, researchers design this type of classifiers along with two incompatible directions: some of them devote to mine more rules from data for enhancing the accuracy of classifiers and others focus on reducing the number of rules for simplifying the classifier with high accuracy. However, from the perspective of practicability, the tradeoff between the accuracy of model and the number of rules including in the model should be carefully considered when designing classifiers. Further, these classifiers also encounter two evident limitations in the process of design: one is that the contribution of each sample versus individual attributions is equally important and another is that the concept of information granularity is not considered. These two limitations result in the reduction of accuracy of the ensuing classifier. To alleviate these two limitations and make compromise between the accuracy and the number of rules of formed classifier, in this study, a novel method is proposed to construct a fuzzy classifier by means of the principle of justifiable granularity with weighted data. The proposed method involves two main stages: the first stage concerns with the formation of an initial classification model. The initial model is constructed by engaging a synergy of Fuzzy C-Means clustering (FCM) and the principle of justifiable granularity with weighted data. The second stage focuses on the refinement of the initial classification model. The number of rules of the completely formed fuzzy classification model is equal to that of classes of experimental data. A series of experiments concerning synthetic datasets and ten UCI datasets are also implemented to exhibit the feasibility and effectiveness of the proposed classification method as well as reveal the impact of information granularity on resulting classification model. [ABSTRACT FROM AUTHOR]