Search

Fuzzy cognitive maps (FCMs) are convenient and widely used architectures for modeling dynamic systems, which are characterized by a great deal of flexibility and adaptability. Several recent works in this area concern strategies for the development of FCMs. Although a few fully automated algorithms to learn these models from data have been introduced, the resulting FCMs are structurally considerably different than those developed by human experts. In particular, maps that were learned from data are much denser (with the density over 90% versus about 40% density of maps developed by humans). The sparseness of the maps is associated with their interpretability: the smaller the number of connections is, the higher is the transparency of the map. To this end, a novel learning approach, sparse real-coded genetic algorithms (SRCGAs), to learn FCMs is proposed. The method utilizes a density parameter to guide the learning toward a formation of maps of a certain predefined density. Comparative tests carried out for both synthetic and real-world data demonstrate that, given a suitable density estimate, the SRCGA method significantly outperforms other state-of-the-art learning methods. When the density estimate is unknown, the new method can be used in an automated fashion using a default value, and it is still able to produce models whose performance exceeds or is equal to the performance of the models generated by other methods. [ABSTRACT FROM AUTHOR]

Feature selection plays an important role in pattern recognition and machine learning. Feature evaluation and classification complexity estimation arise as key issues in the construction of selection algorithms. To estimate classification complexity in different feature subspaces, a novel feature evaluation measure, called the neighborhood decision error rate (NDER), is proposed, which is applicable to both categorical and numerical features. We first introduce a neighborhood rough-set model to divide the sample set into decision positive regions and decision boundary regions. Then, the samples that fall within decision boundary regions are further grouped into recognizable and misclassified subsets based on class probabilities that occur in neighborhoods. The percentage of misclassified samples is viewed as the estimate of classification complexity of the corresponding feature subspaces. We present a forward greedy strategy for searching the feature subset, which minimizes the NDER and, correspondingly, minimizes the classification complexity of the selected feature subset. Both theoretical and experimental comparison with other feature selection algorithms shows that the proposed algorithm is effective for discrete and continuous features, as well as their mixture. [ABSTRACT FROM AUTHOR]

Multiagent systems are inherently associated with their distributivity, which enforces a great deal of communication mechanisms. To effectively arrive at meaningful solutions in a vast array of problem-solving tasks, it becomes imperative to establish a sound machinery of reconciling findings which might form partial solutions to an overall problem. In this paper, we focus on a broad category of problems of collaborative data analysis realized by a collection of agents having access to their individual data and exchanging findings through their collaboration activities. Such problems of data analysis arise in the context of building a global view at a certain phenomenon (process) by viewing it from different perspectives (and thus engaging various collections of attributes by various agents). Our goal is to develop some interaction between the agents so that they could form an overall perspective, where the knowledge available locally is shared and reconciled. The underlying format of knowledge built by the agents is that of information granules and fuzzy sets in particular. We develop a comprehensive optimization scheme and discuss its two-phase nature in which the communication phase of the granular findings intertwines with the local optimization being realized by the agents at the level of the individual datasite and exploits the evidence collected from other sites. We show how the mechanism of fuzzy granulation realized in the form of a well-known fuzzy c-means (FCM) clustering can be augmented to support collaborative activities required by the agents. For this purpose, we introduce augmented versions of the original objective function used in the FCM and derive algorithmic details. We also discuss an issue of optimizing the strength of collaborative linkages, so that the reconciled findings attain the highest level of consistency (agreement) The presented experimental studies include some synthetic data and selected data sets coming from the Machine Learning repository. [ABSTRACT FROM AUTHOR]

Multiagent systems are inherently associated with their distributivity, which enforces a great deal of communication mechanisms. To effectively arrive at meaningful solutions in a vast array of problem-solving tasks, it becomes imperative to establish a sound machinery of reconciling findings which might form partial solutions to an overall problem. In this paper, we focus on a broad category of problems of collaborative data analysis realized by a collection of agents having access to their individual data and exchanging findings through their collaboration activities. Such problems of data analysis arise in the context of building a global view at a certain phenomenon (process) by viewing it from different perspectives (and thus engaging various collections of attributes by various agents). Our goal is to develop some interaction between the agents so that they could form an overall perspective, where the knowledge available locally is shared and reconciled. The underlying format of knowledge built by the agents is that of information granules and fuzzy sets in particular. We develop a comprehensive optimization scheme and discuss its two-phase nature in which the communication phase of the granular findings intertwines with the local optimization being realized by the agents at the level of the individual datasite and exploits the evidence collected from other sites. We show how the mechanism of fuzzy granulation realized in the form of a well-known fuzzy c-means (FCM) clustering can be augmented to support collaborative activities required by the agents. For this purpose, we introduce augmented versions of the original objective function used in the FCM and derive algorithmic details. We also discuss an issue of optimizing the strength of collaborative linkages, so that the reconciled findings attain the highest level of consistency (agreement). The presented experimental studies include some synthetic data and selected data sets coming from the Machine Learning repository. [ABSTRACT FROM AUTHOR]

In this study, we are concerned with genetically optimized fuzzy decision trees (G-DTs). Decision trees are fundamental architectures of machine learning, pattern recognition, and system modeling. Starting with the generic decision tree with discrete or interval-valued attributes, we develop its fuzzy set-based generalization. In this generalized structure we admit the values of the attributes that are represented by some membership functions. Such fuzzy decision trees are constructed in the setting of genetic optimization. The underlying genetic algorithm optimizes the parameters of the fuzzy sets associated with the individual nodes where they play a role of fuzzy "switches" by distributing a flow of processing completed within the tree. We discuss various forms of the fitness function that help capture the essence of the problem at hand (that could be either of classification nature when the dealing with discrete outputs or regression-like when handling a continuous output variable). We quantify a nature of the generalization of the tree by studying an optimally adjusted spreads of the membership functions located at the nodes of the decision tree. A series of experiments exploiting synthetic and machine learning data is used to illustrate the performance of the G-DTs. [ABSTRACT FROM AUTHOR]