Search

During the optimization process, a large number of data are generated through the search. Machine learning techniques and algorithms can be used to handle the generated data to contribute to the optimization process. The use of machine learning enhancing metaheuristics applied to optimization problems has been drawing attention due to their capacity to add domain knowledge during the search process. This knowledge can accelerate metaheuristics and lead to better and promising solutions. This work provides a systematic literature review of machine learning enhancing metaheuristics and summarizes the current state of the classification of the research field, main techniques and machine learning models, validations strategies, and real-world optimization problems that the approach was applied. Our keyword search found 1.960 papers, published in the last 10 years. After considering the inclusion and exclusion criteria and performing backward snowballing procedure, we have analyzed 111 primary studies. The results show the predominance of the use of surrogate-assisted evolutionary algorithms (SAEAs) for improving the efficiency of the optimization, and the use of estimation of distribution algorithms (EDAs) to increase the effectiveness of the optimization. The objective function value is the mostly applied evaluating criteria to validate the algorithm with other methods. The developed techniques of the studies found are applied in diverse real-world applications such as developing machine learning models, physics simulations with expensive function evaluation, and the variants of the classical job shop scheduling problem. We also discuss trends and opportunities of the research field. [ABSTRACT FROM AUTHOR]

This study proposes a new metaheuristic algorithm, which is called Artificial Locust Swarm Optimization (ALSO), inspired by random jumping and plant invasion behavior of locust swarms. Locusts interact in two different ways of searching for food: social and familial. In the familial phase, small locust groups search foods in a local area and the locusts share their information in the social phase. The proposed algorithm is less likely to trap into the local solution than other methods and has high performance in the sensitivity of the global solution. In addition, it is effective not only for the solution of black-box optimization problems but also for the solution of problems with an irregular objective function. The ALSO algorithm is compared with other recent and well-known optimization algorithms on 22 benchmark functions and 3 real engineering design problems. Simulation results prove that the ALSO algorithm is very competitive when compared to the other algorithms. Moreover, it even requires the less runtime and memory space under the same conditions. [ABSTRACT FROM AUTHOR]

In this article, we are presenting a new nature-inspired metaheuristic optimization algorithm that we call the Mycorrhiza Tree Optimization Algorithm (MTOA) focused on solving optimization problems. The algorithm is inspired by the relationship between trees and the Mycorrhiza Network (MN). In this relationship, there are interactions such as defense, communication, resource exchange and habitat colonization between the Trees and the MN. The Lotka–Volterra continuous systems (Predator–Prey, Cooperative and Competitive Models) were used for the design of the algorithm. To verify the efficiency of the algorithm, experiments with 36 mathematical functions were performed, but we are only presenting results of the functions with which comparisons were made with other methods. Hypothesis tests were also carried out, where in most of the results the MTOA algorithm was better by 70% and only in the experiments in 100 dimensions it was better by 60%. We believe that the algorithm has the potential to solve problems in control and optimization of neural networks, for which experimentation will be done as future work. [ABSTRACT FROM AUTHOR]

In recent decades, researches on optimizing the parameter of the artificial neural network (ANN) model has attracted significant attention from researchers. Hybridization of superior algorithms helps improving optimization performance and capable of solving complex applications. As a traditional gradient-based learning algorithm, ANN suffers from a slow learning rate and is easily trapped in local minima when training techniques such as gradient descent (GD) and back-propagation (BP) algorithm are used. The characteristics of randomization and selection of the best or near-optimal solution of metaheuristic algorithm provide an effective and robust solution; therefore, it has always been used in training of ANN to improve and overcome the above problems. New metaheuristic algorithms are proposed every year. Therefore, the review of its latest developments is essential. This article attempts to summarize the metaheuristic algorithms which have been proposed from the year 1975 to 2020 from various journals, conferences, technical papers, and books. The comparison of the popularity of the metaheuristic algorithm is presented in two time frames, such as algorithms proposed in the recent 20 years and those proposed earlier. Then, some of the popular metaheuristic algorithms and their working principle are reviewed. This article further categorizes the latest metaheuristic search algorithm in the literature to indicate their efficiency in training ANN for various industry applications. More and more researchers tend to develop new hybrid optimization tools by combining two or more metaheuristic algorithms to optimize the training parameters of ANN. Generally, the algorithm's optimal performance must be able to achieve a fine balance of their exploration and exploitation characteristics. Hence, this article tries to compare and summarize the properties of various metaheuristic algorithms in terms of their convergence rate and the ability to avoid the local minima. This information is useful for researchers working on algorithm hybridization by providing a good understanding of the convergence rate and the ability to find a global optimum. [ABSTRACT FROM AUTHOR]

This paper proposes a novel metaheuristic-based optimization technique called search space reduction (SSR) optimization algorithm. This algorithm attempts to solve the common pitfalls in the existing algorithms in the literature by randomly generating the search agents in every iteration instead of following the best solution. This new algorithm is simple, computationally efficient, which is based on the concept of reducing the search space. The performance of this algorithm is tested over classical test functions and CEC'17 benchmark test functions. The results are compared with well-established algorithms in the literature. The test results show that the proposed algorithm exhibits good exploration and exploitation capabilities. Further, this algorithm also outperforms other algorithms in solving multimodal optimization problems. In addition to this, the computational complexity of this algorithm is also presented according to CEC'17 guidelines. The proposed algorithm is also employed to solve three engineering design problems and a more complex re-entry trajectory optimization problem to show its effectiveness. [ABSTRACT FROM AUTHOR]

In this paper, a new optimization algorithm called the Hitchcock bird-inspired algorithm (HBIA) is proposed. It is inspired by the aggressive bird behavior portrayed by Alfred Hitchcock in the 1963 thriller "The Birds." It is noteworthy to emphasize that the bird's behavior as shown in the movie is itself inspired by a considered natural birds behavior when faced with extreme conditions. HBIA is a stochastic swarm intelligence algorithm that captures the essence of the fictional behavior of the phenomenon of birds throughout the Hitchcock's film and model an optimization mechanism. The algorithm is based on the attack pattern of birds in the film, which has the stages of lurking, attack and reorganization, defined by the initialization, movement strategies in the search space and strategy of local minimum escape, respectively. The technique has as differential the use of adaptive parameters, a discretized random initialization and the use of the beta distribution. In contrast to the existing ones, the proposed technique provides an efficient optimization in high-dimensionality cost functions, using adaptive parameters, a discretized random initialization and the use of the beta distribution. Its performance is analyzed and compared to classic techniques, such as PSO, ABC and CS, as well as to the existing adaptive techniques, such as sine cosine algorithm, whale optimization algorithm, teaching–learning-based optimization and vortex search. HBIA's performance is investigated by several experiments implemented through eight cost functions. The results show that the HBIA can find more satisfactory solutions in large search spaces and high dimensionality of the evaluated cost functions when compared to the existing optimization methods. [ABSTRACT FROM AUTHOR]