Search

Recently, the polynomial-based radial basis function neural networks (P-RBFNNs) have been successfully applied to regression tasks. However, the redundant and non-linear partitioned data easily interfere with accurate partitioning of clusters completed in P-RBFNNs, affecting the regression performance of this existing model. Because the squared error is used as the cost function of the learning method, P-RBFNNs are sensitive to noise interference. In order to cope with these problems, this study introduces a double iterative learning-based polynomial based-RBFNNs (DP-RBFNNs) modeling that focuses on the formation of architectures to improve the accuracy of regression performance as well as enhance the robustness through double iterative learning as follows: a) support vector-based Gaussian kernel fuzzy c-means (SV-GKFCM) as a kind of the support vector-based kernel fuzzy clustering are designed to determine connections (weights) between the input and hidden layers of the proposed model. SV-GKFCM helps effectively reduce the number of redundant data to re-modify the partitioning of clusters in the DP-RBFNNs. In addition, the cluster centers can be accurately updated from the non-linear partitioned data with the aid of Gaussian kernel distance in SV-GKFCM; b) least absolute shrinkage deviations (LASD) as a robust estimation are designed to update connection weights between the hidden and output layers. The SAE (sum of absolute error) function in the LASD method is used as a cost function to reduce the noise interference in the procedure of weight estimation as well as enhance the robustness of the DP-RBFNNs. The superiority of the proposed model is demonstrated through the experimental results. [ABSTRACT FROM AUTHOR]

Abstract: Fuzzy modeling of complex systems is a challenging task, which involves important problems of dimensionality reduction and calls for various ways of improving the accuracy of modeling. The IG-FRBFNN, a hybrid architecture of the IG-FIS (Fuzzy Inference System) and FRBFNN (Fuzzy Radial Basis Function Neural Networks), is proposed to address these problems. The paper is concerned with the analysis and design of IG-FRBFNNs and their optimization by means of the Hierarchical Fair Competition-based Parallel Genetic Algorithm (HFC-PGA). In the proposed network, the membership functions of the premise part of the fuzzy rules of the IG-based FRBFNN model directly rely on the computation of the relevant distance between data points and the use of four types of polynomials such as constant, linear, quadratic and modified quadratic are considered for the consequent part of fuzzy rules. Moreover, the weighted Least Square (WLS) learning is exploited to estimate the coefficients of the polynomial forming the conclusion part of the rules. Since the performance of the IG-RBFNN model is affected by some key design parameters, such as a specific subset of input variables, the fuzzification coefficient of the FCM, the number of rules, and the order of polynomial of the consequent part of fuzzy rules, it becomes beneficial to carry out both structural as well as parametric optimization of the network. In this study, the HFC-PGA is used as a comprehensive optimization vehicle. The performance of the proposed model is illustrated by means of several representative numerical examples. [Copyright &y& Elsevier]

Abstract: In this study, we introduce a new design methodology of fuzzy radial basis function-based polynomial neural networks. In many cases, these models do not come with capabilities to deal with granular information. With this regard, fuzzy sets offer several interesting and useful opportunities. This study presents the development of fuzzy radial basis function-based neural networks augmented with virtual input variables. The performance of the proposed category of models is quantified through a series of experiments, in which we use two machine learning data sets and two publicly available software development effort data. [Copyright &y& Elsevier]

Abstract: In this study, we design polynomial-based radial basis function neural networks (P-RBF NNs) based on a fuzzy inference mechanism. The essential design parameters (including learning rate, momentum coefficient and fuzzification coefficient of the underlying clustering method) are optimized by means of the particle swarm optimization. The proposed P-RBF NNs dwell upon structural findings about training data that are expressed in terms of a partition matrix resulting from fuzzy clustering in this case being the fuzzy C-means (FCM). The network is of functional nature as the weights between the hidden layer and the output are some polynomials. The use of the polynomial weights becomes essential in capturing the nonlinear nature of data encountered in regression or classification problems. From the perspective of linguistic interpretation, the proposed network can be expressed as a collection of “if–then” fuzzy rules. The architecture of the networks discussed here embraces three functional modules reflecting the three phases of input–output mapping realized in rule-based architectures, namely condition formation, conclusion creation, and aggregation. The proposed classifier is applied to some synthetic and machine learning datasets, and its results are compared with those reported in the previous studies. [Copyright &y& Elsevier]

This study is concerned with the concept of Ensemble Fuzzy Radial Basis Function Neural Networks (EFRBFNN) endowed with clustering techniques, polynomial-based LSE/WLSE learning as well as their optimization implemented by Multi-Objective Particle Swarm Optimization (MOPSO). The network architecture of the proposed EFRBFNN classifier is considered three types of clustering techniques and four forms of regression polynomials. The proposed classifier can not only fully capture the local distribution (feature) information contained in the data, but also choose effective network architecture for improving classification performance and compactness. Three classes of clustering techniques (such as iterative self-organizing data analysis techniques algorithm (ISODATA), affinity propagation (AP), and extended K-means) are considered to effectively produce membership degrees based on feature information extraction suitable to fit data characteristics. Least Square Error Estimation (LSE) and Weighted Least Square Error Estimation (WLSE)-based learning with four types of regression polynomials are considered to estimate to coefficients of polynomials. MOPSO is exploited for choosing the effective architecture among different clustering techniques, polynomials, and polynomial-based learning with multi-objective parametric optimization. MOPSO helps achieve a sound compromise between the preferred classification performance and the compactness realized with the aid of four objective functions such as a) classification accuracy (CA), b) complexity of clustering, c) complexity of polynomial and d) sum of squared coefficients (SSC). The improvement and effectiveness of the proposed network architecture are quantified on a basis of the comprehensive experimental results and also a comparative analysis is offered to demonstrate the superiority of the proposed classifier. [ABSTRACT FROM AUTHOR]