Search

In this study, we propose Hybrid Radial Basis Function Neural Networks (HRBFNNs) realized with the aid of fuzzy clustering method (Fuzzy C-Means, FCM) and polynomial neural networks. Fuzzy clustering used to form information granulation is employed to overcome a possible curse of dimensionality, while the polynomial neural network is utilized to build local models. Furthermore, genetic algorithm (GA) is exploited here to optimize the essential design parameters of the model (including fuzzification coefficient, the number of input polynomial fuzzy neurons (PFNs), and a collection of the specific subset of input PFNs) of the network. To reduce dimensionality of the input space, principal component analysis (PCA) is considered as a sound preprocessing vehicle. The performance of the HRBFNNs is quantified through a series of experiments, in which we use several modeling benchmarks of different levels of complexity (different number of input variables and the number of available data). A comparative analysis reveals that the proposed HRBFNNs exhibit higher accuracy in comparison to the accuracy produced by some models reported previously in the literature. [ABSTRACT FROM AUTHOR]

Abstract: Fuzzy modeling of complex systems is a challenging task, which involves important problems of dimensionality reduction and calls for various ways of improving the accuracy of modeling. The IG-FRBFNN, a hybrid architecture of the IG-FIS (Fuzzy Inference System) and FRBFNN (Fuzzy Radial Basis Function Neural Networks), is proposed to address these problems. The paper is concerned with the analysis and design of IG-FRBFNNs and their optimization by means of the Hierarchical Fair Competition-based Parallel Genetic Algorithm (HFC-PGA). In the proposed network, the membership functions of the premise part of the fuzzy rules of the IG-based FRBFNN model directly rely on the computation of the relevant distance between data points and the use of four types of polynomials such as constant, linear, quadratic and modified quadratic are considered for the consequent part of fuzzy rules. Moreover, the weighted Least Square (WLS) learning is exploited to estimate the coefficients of the polynomial forming the conclusion part of the rules. Since the performance of the IG-RBFNN model is affected by some key design parameters, such as a specific subset of input variables, the fuzzification coefficient of the FCM, the number of rules, and the order of polynomial of the consequent part of fuzzy rules, it becomes beneficial to carry out both structural as well as parametric optimization of the network. In this study, the HFC-PGA is used as a comprehensive optimization vehicle. The performance of the proposed model is illustrated by means of several representative numerical examples. [Copyright &y& Elsevier]

Abstract: In this study, we discuss a design of an optimized cascade fuzzy controller for the rotary inverted pendulum system and ball & beam system by using an optimization vehicle of differential evolution (DE). The structure of the differential evolution optimization environment is simple and a convergence to optimal values realized here is very good in comparison to the convergence reported for other optimization algorithms. DE is easy to use given its mathematical operators. It also requires a limited computing overhead. The rotary inverted pendulum system and ball & beam system are nonlinear systems, which exhibit unstable motion. The performance of the proposed fuzzy controller is evaluated from the viewpoint of several performance criteria such as overshoot, steady-state error, and settling time. Their values are obtained through simulation studies and practical, real-world experiments. We evaluate and analyze the performance of the proposed optimal fuzzy controller optimized by Genetic Algorithm (GA), and DE. In this setting, we show the superiority of DE versus other methods being used here as well as highlight the characteristics of this optimization tool. [Copyright &y& Elsevier]

Abstract: In this study, we introduce the design methodology of an optimized fuzzy controller with the aid of particle swarm optimization (PSO) for ball and beam system. The ball and beam system is a well-known control engineering experimental setup which consists of servo motor, beam and ball. This system exhibits a number of interesting and challenging properties when being considered from the control perspective. The ball and beam system determines the position of ball through the control of a servo motor. The displacement change of the position of ball leads to the change of the angle of the beam which determines the position angle of a servo motor. The fixed membership function design of type-1 based fuzzy logic controller (FLC) leads to the difficulty of rule-based control design when representing linguistic nature of knowledge. In type-2 FLC as the expanded type of type-1 FL, we can effectively improve the control characteristic by using the footprint of uncertainty (FOU) of the membership functions. Type-2 FLC exhibits some robustness when compared with type-1 FLC. Through computer simulation as well as real-world experiment, we apply optimized type-2 fuzzy cascade controllers based on PSO to ball and beam system. To evaluate performance of each controller, we consider controller characteristic parameters such as maximum overshoot, delay time, rise time, settling time, and a steady-state error. In the sequel, the optimized fuzzy cascade controller is realized and also experimented with through running two detailed comparative studies including type-1/type-2 fuzzy controller and genetic algorithms/particle swarm optimization. [Copyright &y& Elsevier]

Abstract: In this study, we develop a design methodology for a fuzzy PD cascade controller for a ball & beam system by using particle swarm optimization (PSO). The ball & beam system is a well-known control engineering experimental setup, which consists of servo motor, beam, and ball. This system exhibits a number of interesting and challenging properties when being considered from the control perspective. The ball & beam system determines the position of ball through the control of a servo motor. The displacement change of the position of ball leads to the change of the angle of the beam which determines the position angle of a servo motor. Consequently the variation of the position of the moving ball and the ensuing change of the angle of the beam results in the change of the position angle of a servo motor. We introduce a fuzzy PD cascade controller scheme which consists of the outer (1st) controller and the inner (2nd) controller arranged in a cascaded architecture. Auto-tuning of the parameters of the controller (scaling factors) as well as fuzzy rules of each fuzzy PD controller is realized with the use of the PSO. Moreover the comparative analysis of results of optimization realized by PSO and GA based on SGA (Serial Genetic Algorithms) is discussed from the viewpoint of control performance. The set-point value of the inner controller (the 2nd controller) corresponds to the position angle of a servo motor, and is given as reference value, which enters into the inner controller as the 2nd controller of the two cascaded controllers. The optimization process takes advantage of a rapid convergence of PSO being used here as a generic search mechanism. A detailed comparative analysis carried out from the viewpoint of the performance and the design methodology, is provided for the fuzzy PD cascade controller and the conventional PD cascade controller whose design exploited serial genetic algorithms. [ABSTRACT FROM AUTHOR]

Abstract: In this study, we present a design of an optimized fuzzy cascade controller based on Hierarchical Fair Competition-based Genetic Algorithms (HFCGA) for a rotary inverted pendulum system. In this system, one controls the movement of a pendulum through the adjustment of a rotating arm. The objective is to control the position of the rotating arm and to make the pendulum maintain the unstable equilibrium point at vertical position. To control the system, we design a fuzzy cascade controller scheme which consists of two fuzzy controllers arrange in a cascaded topology. The parameters of the controller are optimized by means of the HFCGA algorithm. The fuzzy cascade scheme comprises two controllers located in two loops. An inner loop controller governs the position of the rotating arm while an outer controller modifies a set point of the inner controller implied by the changes of the angle of pendulum. The HFCGA being a computationally effective scheme of the Parallel Genetic Algorithm (PGA) has been developed to eliminate an effect of premature convergence encountered in Serial Genetic Algorithms (SGA). It has emerged as an effective optimization vehicle to deal with very large search spaces. A comparative analysis involving computing simulations and practical experiment demonstrates that the proposed HFCGA based fuzzy cascade controller comes with superb performance in comparison with the conventional Linear Quadratic Regulator (LQR) controller as well as HFCGA-based PD cascade controller. [Copyright &y& Elsevier]

Abstract: The paper is concerned with a hybrid optimization of fuzzy inference systems based on hierarchical fair competition-based parallel genetic algorithms (HFCGA) and information granulation. The process of information granulation is realized with the aid of the C-Means clustering. HFCGA being a multi-population based parallel genetic algorithms (PGA) is exploited here to realize structure optimization and carry out parameter estimation of the fuzzy models. The HFCGA becomes helpful in the context of fuzzy models as it restricts a premature convergence encountered quite often in optimization problems. It concerns a set of parameters of the model including among others the number of input variables to be used, a specific subset of input variables, and the number of membership functions. In the hybrid optimization process, two general optimization mechanisms are explored. The structural development of the fuzzy model is realized via the HFCGA optimization and C-Means, whereas to deal with the parametric optimization we proceed with a standard least square method and the use of the HFCGA technique. A suite of comparative studies demonstrates that the proposed algorithm leads to the models whose performance is superior in comparison with some other constructs commonly used in fuzzy modeling. [Copyright &y& Elsevier]

Abstract: In this study, we introduce a design methodology for an optimized fuzzy cascade controller for ball and beam system by exploiting the use of hierarchical fair competition-based genetic algorithm (HFCGA). The ball and beam system is a well-known control engineering experimental setup which consists of servo motor, beam and ball and exhibits a number of interesting and challenging properties when considered from the control perspective. The position of ball is determined through the control of a servo motor. The displacement change of the position of ball requires the change of the angle of the beam which determines the position angle of a servo motor. Consequently, the variation of the position of the moving ball and the ensuing change of the angle of the beam results in the change of the position angle of a servo motor. We introduce the fuzzy cascade controller scheme which consists of the outer (1st) controller and the inner (2nd) controller in a cascaded architecture. Auto-tuning of the parameters of the controller (viz. scaling factors) of each fuzzy controller is realized with the use of the HFCGA. The set-point value of the inner controller (the 2nd controller) corresponds to the position angle of a servo motor, and is given as a reference value which enters into the inner controller as the 2nd controller of the two cascaded controllers. HFCGA is a kind of a parallel genetic algorithm (PGA), which helps alleviate an effect of premature convergence being a potential shortcoming present in conventional genetic algorithms (GAs). A detailed comparative analysis carried out from the viewpoint of the performance and the design methodology, is provided for the fuzzy cascade controller and the conventional PD cascade controller whose design relied on the use of the serial genetic algorithms. [Copyright &y& Elsevier]

In this study, we introduce an advanced architecture of genetically optimized Hybrid Fuzzy Neural Networks (gHFNN) and develop a comprehensive design methodology supporting their construction. A series of numeric experiments is included to illustrate the performance of the networks. The construction of gHFNN exploits fundamental technologies of Computational Intelligence (CI), namely fuzzy sets, neural networks, and genetic algorithms (GAs). The architecture of the gHFNNs results from a synergistic usage of the genetic optimization-driven hybrid system generated by combining Fuzzy Neural Networks (FNN) with Polynomial Neural Networks (PNN). In this tandem, a FNN supports the formation of the condition part of the rule-based structure of the gHFNN. The conclusion part of the gHFNN is designed using PNNs. We distinguish between two types of the simplified fuzzy inference rule-based FNN structures showing how this taxonomy depends upon the type of a fuzzy partition of input variables. As to the conclusion part of the gHFNN, the development of the PNN dwells on two general optimization mechanisms: the structural optimization is realized via GAs whereas in case of the parametric optimization we proceed with a standard least square method-based learning. To evaluate the performance of the gHFNN, we experimented with three representative numerical examples. A comparative analysis demonstrates that the proposed gHFNN come with higher accuracy as well as superb predictive capabilities when compared with other neurofuzzy models. [ABSTRACT FROM AUTHOR]

Abstract: In this study, we introduce and investigate a new topology of fuzzy-neural networks—fuzzy polynomial neural networks (FPNN) that is based on a genetically optimized multiplayer perceptron with fuzzy set-based polynomial neurons (FSPNs). We also develop a comprehensive design methodology involving mechanisms of genetic optimization and information granulation. In the sequel, the genetically optimized FPNN (gFPNN) is formed with the use of fuzzy set-based polynomial neurons (FSPNs) composed of fuzzy set-based rules through the process of information granulation. This granulation is realized with the aid of the C-means clustering (C-Means). The design procedure applied in the construction of each layer of an FPNN deals with its structural optimization involving the selection of the most suitable nodes (or FSPNs) with specific local characteristics (such as the number of input variable, the order of the polynomial, the number of membership functions, and a collection of specific subset of input variables) and address main aspects of parametric optimization. Along this line, two general optimization mechanisms are explored. The structural optimization is realized via genetic algorithms (GAs) and HCM method whereas in case of the parametric optimization we proceed with a standard least square estimation (learning). Through the consecutive process of structural and parametric optimization, a flexible neural network is generated in a dynamic fashion. The performance of the designed networks is quantified through experimentation where we use two modeling benchmarks already commonly utilized within the area of fuzzy or neurofuzzy modeling. [Copyright &y& Elsevier]

Abstract: In this study, we introduce a new architecture of hybrid fuzzy neural networks (gHFNNs) and offer a comprehensive design methodology that supports their development. The gHFNN rule-based architecture results from a synergistic usage of Fuzzy Neural Networks (FNNs) with Polynomial Neural Networks (PNNs). The FNN contributes to the formation of the premise part of the overall network of the gHFNN. The consequence part of the gHFNN is designed taking advantage of PNNs. The optimization of the FNN is realized with the aid of a standard back-propagation learning combined with genetic optimization. The development of the PNN dwells on the extended Group Method of Data Handling (GMDH) and Genetic Algorithms (GAs). Through the consecutive process of such structural and parametric optimization, an optimized topology of the PNN becomes generated in a dynamic fashion. The performance of the gHFNN is evaluated through a series of numeric experiments. A comparative analysis shows that the proposed gHFNN is characterized by higher accuracy as well as significant predictive capabilities when contrasted with other neurofuzzy models presented in the literature. [Copyright &y& Elsevier]

Abstract: We introduce a new architecture of hybrid fuzzy polynomial neural networks (HFPNN) that is based on a genetically optimized multi-layer perceptron and develop their comprehensive design methodology involving mechanisms of genetic optimization. The construction of HFPNN exploits fundamental technologies of computational intelligence (CI), namely fuzzy sets, neural networks, and genetic algorithms (GAs). The architecture of the resulting genetically optimized HFPNN (namely gHFPNN) results from a synergistic usage of the hybrid system generated by combining fuzzy polynomial neurons (FPNs)-based fuzzy neural networks (FNN) with polynomial neurons (PNs)-based polynomial neural networks (PNN). The design of the conventional HFPNN exploits the extended group method of data handling (GMDH) with some essential parameters of the network being provided by the designer and kept fixed throughout the overall development process. This restriction may hamper a possibility of producing an optimal architecture of the model. The augmented gHFPNN results in a structurally optimized structure and comes with a higher level of flexibility in comparison to the one we encounter in the conventional HFPNN. The GA-based design procedure being applied at each layer of HFPNN leads to the selection of preferred nodes (FPNs or PNs) available within the HFPNN. In the sequel, two general optimization mechanisms are explored. First, the structural optimization is realized via GAs whereas the ensuing detailed parametric optimization is carried out in the setting of a standard least square method-based learning. The performance of the gHFPNN is quantified through experimentation where we exploit data coming from processes of pH neutralization and NOx emission. These datasets have already been used quite intensively in fuzzy and neurofuzzy modeling. The obtained results demonstrate superiority of the proposed networks over the existing fuzzy and neural models. [Copyright &y& Elsevier]

Abstract: In this study, we introduce a concept of self-organizing neurofuzzy networks (SONFN), a hybrid modeling architecture combining relation-based neurofuzzy networks (NFN) and self-organizing polynomial neural networks (PNN). For such networks we develop a comprehensive design methodology and carry out a series of numeric experiments using data coming from the area of software engineering. The construction of SONFNs exploits fundamental technologies of computational intelligence (CI), namely fuzzy sets, neural networks, and genetic algorithms. The architecture of the SONFN results from a synergistic usage of NFN and PNN. NFN contributes to the formation of the premise part of the rule-based structure of the SONFN. The consequence part of the SONFN is designed using PNNs. We discuss two types of SONFN architectures with the taxonomy based on the NFN scheme being applied to the premise part of SONFN and propose a comprehensive learning algorithm. It is shown that this network exhibits a dynamic structure as the number of its layers as well as the number of nodes in each layer of the SONFN are not predetermined (as this is usually the case for a popular topology of a multilayer perceptron). The experimental results deal with well-known software data such as the NASA dataset concerning software cost estimation and the one describing software modules of the medical imaging system (MIS). In comparison with the previously discussed approaches, the self-organizing networks are more accurate and exhibit superb generalization capabilities. [Copyright &y& Elsevier]

In this paper, we introduce a category of Multi-Fuzzy-Neural Networks (Multi-FNNs) models, analyze the underlying architectures and propose a comprehensive identification framework. The proposed Multi-FNNs are based on a concept of fuzzy rule-based FNNs that use H ard C-M eans (HCM) clustering and evolutionary fuzzy granulation and exploit linear inference being treated as a generic inference mechanism of approximate reasoning. By this nature, this FNN model is geared toward capturing relationships between information granules–fuzzy sets. The form of the information granules themselves (in particular their distribution and a type of membership functions) becomes an important design feature of the FNN model that contributes to its structural and parametric optimization. The genetically guided global optimization is then augmented by more refined gradient-based learning mechanisms such as a standard back-propagation. The HCM algorithm, whose role is to carry out preprocessing of the experimental data, is utilized to determine the structure of Multi-FNNs. The detailed parameters of the Multi-FNN (such as apexes of membership functions, learning rates, and momentum coefficients) are adjusted using genetic algorithms. The proposed aggregate performance index helps achieve a sound balance between approximation and generalization (predictive) abilities of the model. To evaluate an effectiveness of the introduced model, several numeric data sets are experimented with. Those include a time-series data of gas furnace, NOx emission process of gas turbine power plant and some synthetic data. [Copyright &y& Elsevier]

This paper proposes an identification method for nonlinear models realized in the form of implicit rule-based fuzzy-neural networks (FNN). The design of the model dwells on the technologies of computational intelligence (CI), namely fuzzy sets, neural networks, and genetic algorithm. The FNN modeling and identification environment realizes parameter estimation through a synergistic usage of clustering techniques, genetic optimization and a complex search method. An HCM (Hard C-Means) clustering algorithm helps determine an initial location (parameters) of the membership functions of the information granules to be used in this fuzzy model. The parameters such as apexes of membership functions, learning rates, and momentum coefficients are then adjusted using the optimization algorithm of a GA hybrid scheme. The proposed GA hybrid scheme combines GA with the improved complex method to guarantee both global optimization and local convergence. An aggregate objective function (performance index) is used in the model design in order to achieve a sound balance between its approximation and generalization abilities. The proposed type of the model is experimented with several time series data (gas furnace, sewage treatment process, and NOx emission process data of gas turbine power plant). [Copyright &y& Elsevier]