On the Combination of Coevolution and Novelty Search

This paper develops a new method for coevolution, named Fitness-Diversity Driven Coevolution (FDDC). This approach builds on existing methods by a combination of a (predator-prey) Coevolutionary Genetic Algorithm (CGA) and novelty search. The innovation lies in replacing the absolute novelty measure with a relative one, called Fitness-Diversity. FDDC overcomes problems common in both CGAs (premature convergence and unbalanced coevolution) and in novelty search (construction of an archive). As a proof of principle, Spring Loaded Inverted Pendulums (SLIPs) are coevolved with 2D-terrains the SLIPs must learn to traverse.