Search

Normalization of objectives plays a crucial role in evolutionary multi-objective optimization (EMO) to handle objective functions with different scales, which can be found in real-world problems. Although the effect of normalization methods on the performance of EMO algorithms has been investigated in the literature, that of preference-based EMO (PBEMO) algorithms is poorly understood. Since PBEMO aims to approximate a region of interest, its population generally does not cover the Pareto front in the objective space. This property may make normalization of objectives in PBEMO difficult. This paper investigates the effectiveness of three normalization methods in three representative PBEMO algorithms. We present a bounded archive-based method for approximating the nadir point. First, we demonstrate that the normalization methods in PBEMO perform significantly worse than that in conventional EMO in terms of approximating the ideal point, nadir point, and range of the PF. Then, we show that PBEMO requires normalization of objectives on problems with differently scaled objectives. Our results show that there is no clear "best normalization method" in PBEMO, but an external archive-based method performs relatively well. • This paper investigates the effectiveness of three normalization methods in three representative PBEMO algorithms. • We demonstrate that the normalization methods in PBEMO perform significantly worse than that in conventional EMO in terms of approximating the ideal point, nadir point, and range of the PF. scaled objectives. • We show that there is no clear "best normalization method" in PBEMO, but an external archive-based method performs relatively well. [ABSTRACT FROM AUTHOR]

Many-objective optimization problems (MaOPs) are challenging tasks involving optimizing many conflicting objectives simultaneously. Decomposition-based many-objective evolutionary algorithms have effectively maintained a balance between convergence and diversity in recent years. However, these algorithms face challenges in accurately approximating the complex geometric structure of irregular Pareto fronts (PFs). In this paper, an information entropy-driven evolutionary algorithm based on reinforcement learning (RL-RVEA) for many-objective optimization with irregular Pareto fronts is proposed. The proposed algorithm leverages reinforcement learning to guide the evolution process by interacting with the environment to learn the shape and features of PF, which adaptively adjusts the distribution of reference vectors to cover the PFs structure effectively. Moreover, an information entropy-driven adaptive scalarization approach is designed in this paper to reflect the diversity of nondominated solutions, which facilitates the algorithm to balance multiple competing objectives adaptively and select solutions efficiently while maintaining individual diversity. To verify the effectiveness of the proposed algorithm, the RL-RVEA compared with seven state-of-the-art algorithms on the DTLZ, MaF, and WFG test suites and four real-world MaOPs. The results of the experiments demonstrate that the suggested algorithm provides a novel and practical method for addressing MaOPs with irregular PFs. • A novel RL-RVEA addresses many-objective optimization with irregular pareto fronts. • A reinforcement learning-based adaptive reference vector to guide the direction of convergence. • A scalarization approach preserves the diversity of solutions for next generation. • The RL-RVEA outperforms seven advanced many-objective optimization algorithms. [ABSTRACT FROM AUTHOR]

The recent multi-objective optimization problems are very complex which require an effective and robust evolutionary method for obtaining a global Pareto-optimal solutions. Most of these multi-objective evolutionary techniques are population-based methods which usually work on random search approaches and often trapped into local minima during their execution. A new fuzzy tuned mayfly algorithm (FTMA) is presented in this paper, to obtain the Pareto-optimal solutions for any complex multi-objective power system problem. It has a self-adapting global exploration capability to get the best Pareto-optimal solutions by varying two crucial parameters i.e., crossover (P c) and mutation P m probabilities. Moreover, a model of Pareto-dominance is employed to rank non-dominating solutions to maintain the diversity within the populations. The proposed evolutionary approach is examined on a standard ZDT benchmark test suite and its algorithmic performance is statistically compared with a few of the recent optimization techniques such as NSGA-II, NSGA-III, MMODE, MOAVOA and MMA algorithm. It is further applied to minimize two distinct objective functions (i.e., total transmission loss and voltage stability index) for IEEE-118 bus system and IEEE-24 bus RTS. A comprehensive statistical analysis is presented for the obtained numerical results, which proves that proposed FTMA has better convergence with better solution diversity in comparison to the other competing algorithms. A comprehensive analysis based on statistical results reveal that the proposed FTMA is superior for obtaining better non-dominating pareto-fronts as compared to other competing methods. [ABSTRACT FROM AUTHOR]

Adversarial sample generation problem is a hot issue in the security field of deep learning. Evolutionary algorithm has been widely used to solve this problem in recent years because of its good global search ability. However, existing methods still suffer from the "curse of dimensionality" when attacking high-resolution images. In this paper, a two-stage frequency domain generation algorithm of black-box adversarial samples based on differential evolution is proposed. In the first stage, a representative image-guided differential evolution method is proposed to quickly generate a universal adversarial perturbation with a high attack success rate in the frequency-domain. In the second stage, a space reduction strategy based on frequency-domain pixel blocks is designed to reduce the search space and alleviate the problem of "curse of dimensionality". In addition, a new space–frequency interaction sensitivity measure is introduced to evaluate the similarity between the adversarial samples and the original images. The adversarial perturbations obtained by the measure are more in line with the subjective perception of the human eye. Finally, compared with several typical black-box adversarial sample generation algorithms, experimental results show that the proposed algorithm can achieve higher attack success rate with less prediction times. • Proposing a two-stage evolutionary generation framework of adversarial samples. • Developing a space–frequency interaction sensitivity measure. • Presenting a representative image-guided differential evolutionary algorithm. • Designing an individual adversarial perturbation generation algorithm. [ABSTRACT FROM AUTHOR]

The key to solving constrained multiobjective optimization problems (CMOPs) lies in maintaining the feasibility, convergence, and diversity of the population. In recent years, various constraint handling techniques (CHTs) and strategies have been proposed to enhance the performance of constrained multiobjective evolutionary algorithms (CMOEAs). However, most of these algorithms face difficulties in dealing with problems that have large infeasible regions and discontinuous small feasible regions, as they have trouble crossing large infeasible regions while simultaneously maintaining the convergence and diversity of the population. To tackle this issue, this paper proposes a dual-population auxiliary coevolutionary algorithm with an enhanced operator, denoted as DAEAEO. Auxiliary population 1 employs an improved ϵ -constraint handling technique to provide high-quality feasible solutions for the main population. Auxiliary population 2 adopts the non-dominated sorting method to provide favorable objective information for the main population to help it cross the infeasible region. In addition, to further improve diversity, each population adopts an enhanced operator and a genetic operator to generate offspring, respectively. Finally, knowledge transfer between offspring is realized. Compared to six state-of-the-art CMOEAs on DASCMOPs, LIR-CMOPs, DOC test suites, and two real-world problems, the proposed DAEAEO achieved superior performance, especially for CMOPs with large infeasible regions and discontinuous small feasible regions. • A constrained multiobjective coevolutionary algorithm is proposed, termed DAEAEO. • A dual-population auxiliary evolutionary strategy is proposed. • The use of knowledge transfer promotes information interaction among offspring. • An enhanced search operator is developed to balance convergence and diversity. • The effectiveness of DAEAEO is verified on test suites and two real-world problems. [ABSTRACT FROM AUTHOR]

The challenge of high-dimensional feature selection (FS) lies in the search technique, which needs to consider both minimizing the size of feature subset and maximizing the classification accuracy. Recently, multi-objective evolutionary algorithms (MOEAs) have shown excellent performance in solving FS tasks. However, most existing MOEAs struggle to effectively balance these two conflicting objectives when solving high-dimensional FS tasks. To cover this issue, in this paper, a decomposition-based multi-population evolutionary algorithm is proposed, called MPEA-FS. In the initialization stage, a multi-population generation strategy (MGS) based on feature weights (MGS) was adopted, with each population corresponding to a search subspace, which can improve the algorithm's search ability. During the evolutionary stage, an external population is designed to integrate the excellent feature subsets of multiple populations to achieve knowledge sharing between them. In addition, to reduce the feature dimension, a feature reduction strategy (FRS) is proposed, which can remove unimportant features while maintaining classification accuracy. Extensive experiments are performed on 13 high-dimensional datasets, and the proposed algorithm is compared with 5 state-of-the-art FS methods proposed in the last 3 years on multiple metrics. The experimental results indicate that MPEA-FS can achieve higher classification accuracy on most datasets, and the number of selected features is also competitive. • A decomposition-based multi-population feature selection algorithm is proposed. • The generation of multi-population is based on a novel feature weight method. • Multi-population knowledge sharing strategy based on elite population is proposed. • Evolution operator based on guide vector can correct the feature subset effectively. • Obtained higher classification accuracy and competitive number of features. [ABSTRACT FROM AUTHOR]

Reinforcement Learning (RL) has gained significant popularity in recent years for its ability to solve complex control problems. However, most existing RL algorithms are designed to train policies for each environment in isolation, limiting their applicability to real-world scenarios with many related environments. Recently, many multitask optimization algorithms have been proposed and successfully applied to a wide range of optimization problems. However, existing studies mainly focus on solving multiple continuous function benchmarks and overlook the potential of tailoring towards RL. In this paper, we propose a simple multitask optimization algorithm called Multitask Augmented Random Search (MARS) that trains multiple RL agents together and exploits the performance surplus from highly correlated tasks. MARS is a modification of the simple random search Augmented Random Search (ARS) algorithm, which has been shown to outperform complicated methods in solving continuous control MuJoCo environments such as Soft Actor-Critic (SAC), Proximal Policy Optimization (PPO), and Trusted Region Policy Optimization (TRPO). The experimental results also demonstrate that our proposed algorithm is more consistent in solving different instances of MuJoCo benchmark than ARS, Multifactorial Evolution Algorithm (MFEA), and Adaptive MFEA RL (AMFEARL) within the same number of training episodes. • Propose a multitask extension of ARS for training related continuous control problems. • Derived an online data-driven measurement to preempt the transfer of solutions incomplementary. • Conduct experiments on synthetic benchmarks and in the multitask Mujoco environments. [ABSTRACT FROM AUTHOR]

This paper introduces a novel surrogate-assisted multi-objective nutcracker optimization algorithm. This algorithm is built upon the recently proposed nutcracker optimization algorithm, drawing inspiration from the behaviours observed in Clark's nutcrackers. The algorithm is developed based on two distinct behaviours exhibited by these birds. To comprehensively evaluate the performance of the proposed algorithm, a dual-pronged approach is adopted. On the one hand, a set of artificial test problems is employed to scrutinize the algorithm's capabilities, while on the other hand, a set of real-world problems is considered to assess its practical efficacy. The results of the proposed algorithm are evaluated in comparison to existing baseline algorithms and state-of-the-art algorithms, using well-recognized performance metrics, both qualitatively and quantitatively. The obtained results provide convincing evidence of the performance of the proposed algorithm. [ABSTRACT FROM AUTHOR]

This paper proposes a hybrid bio-inspired search and optimization algorithm that combines the strengths of the PB3C (Parallel Big Bang Big Crunch) and 3PGA (3 Parent Genetic Algorithm) algorithms. The hybrid algorithm employs a single population-based evolutionary search coupled with multi-population parallel processing techniques to address optimization problems. The proposed algorithm is implemented in MATLAB software. We evaluate the performance of the proposed algorithm on the CEC2021 standard test bench suite. The performance of the proposed approach is compared with that of the other nine algorithms. The comparative analysis shows that the proposed hybrid PB3C and 3PGA algorithms performed better than the other nine optimization algorithms. Furthermore, this chapter proposes an HPB3C-3PGA-based approach to evolve the near-optimal architecture of CNN. The proposed plant image classification approach is implemented in Python and compared with 12 other approaches. The proposed approach achieved an accuracy of 98.96% on the Mendeley dataset and 98.97% on the CVIP100 dataset. The proposed approach outperforms all other approaches for the plant leaf classification problem. This research significantly contributes to overcoming limitations in existing approaches, providing a robust solution for optimization problems and image classification tasks. • Proposed hybrid algorithm combines PB3C and 3PGA strengths for optimization problems. • Tested on CEC2021 benchmark functions, outperformed nine existing algorithms. • Synergy of parallel processing and advanced genetic operators drives success. • Promising solution for real-world applications requiring efficient optimization techniques. • Achieved impressive accuracy of 98.96% in plant leaf image classification. [ABSTRACT FROM AUTHOR]

The differential evolution (DE) algorithm is widely regarded as one of the most influential evolutionary algorithms for addressing complex optimization problems. However, the fixed mutation strategy limits the adaptive ability of DE, and the lack of utilization of historical information limits the optimization ability of DE. In this paper, an indicator-based self-learning differential evolution algorithm (ISDE) is proposed. A jump out mechanism based on deep reinforcement learning is adopted to control the mutation intensity of the population. The neural network in the jump out mechanism is designed as a decision maker. The mutation intensity of the population is controlled by the neural network, and the neural network are trained by a double deep Q network algorithm based on the continuous data generated during the evolution process. A population range indicator (PRI) is utilized to describe individual differences in the population. A diversity maintenance mechanism is designed to maintain individual differences according to the value of PRI. The experimental results reveal that the comprehensive performance of ISDE is superior to comparison algorithms on CEC 2017 real-parameter numerical optimization. [ABSTRACT FROM AUTHOR]

Prediction-based dynamic multiobjective optimization evolutionary algorithms have become one of the mainstream methods for solving dynamic multiobjective optimization problems. However, the unknown nonlinear relationships in sequential environments bring great challenge to the construction of prediction model and the inevitable error between the historical obtained solutions and the real pareto-optimal solutions troubles the prediction accuracy. In this paper, a gradient boosting regression tree based dynamic multiobjective optimization evolutionary algorithm is proposed, called MOEA/D-XGB. The time series solutions formed by subspace decomposition are trained in the XGBoost-based predictor to produce a high-quality initial population when environmental change occurs. And a novel population promotion strategy based on generalized additive model is proposed to improve the quality of historical obtained solutions. The performance comparisons with five state-of-the-art algorithms have shown that MOEA/D-XGB achieves best performance in 59 out of 70 experiments on MIGD and 60 out of 70 experiments on MHV, respectively, which demonstrates that the proposed design is capable of significantly improving the performance of dynamic multiobjective optimization. [ABSTRACT FROM AUTHOR]