1. A benchmark of kriging-based infill criteria for noisy optimization
- Author
-
Tobias Wagner, David Ginsbourger, Victor Picheny, Unité de Mathématiques et Informatique Appliquées de Toulouse (MIAT INRA), Institut National de la Recherche Agronomique (INRA), Technische Universität Dortmund [Dortmund] (TU), University of Bern, Deutsche Forschungsgemeinschaft (DFG) [SFB/TR TRR 30] Funding Text : The contributions of Tobias Wagner to this paper are based on investigations of the project D5 of the Collaborative Research Center SFB/TR TRR 30, which is kindly supported by the Deutsche Forschungsgemeinschaft (DFG)., and Picheny, Victor
- Subjects
Mathematical optimization ,Control and Optimization ,Covariance function ,0211 other engineering and technologies ,02 engineering and technology ,Metamodeling ,symbols.namesake ,510 Mathematics ,DESIGN ,Kriging ,Homoscedasticity ,0202 electrical engineering, electronic engineering, information engineering ,[INFO]Computer Science [cs] ,[MATH]Mathematics [math] ,Gaussian process ,GLOBAL OPTIMIZATION ,Mathematics ,EGO ,021103 operations research ,[MATH.MATH-OC] Mathematics [math]/Optimization and Control [math.OC] ,Covariance ,Computer Graphics and Computer-Aided Design ,Computer Science Applications ,COMPUTER EXPERIMENTS ,Control and Systems Engineering ,Gaussian noise ,SIMULATION ,symbols ,020201 artificial intelligence & image processing ,Engineering design process ,Noise ,Software - Abstract
International audience; Responses of many real-world problems can only be evaluated perturbed by noise. In order to make an efficient optimization of these problems possible, intelligent optimization strategies successfully coping with noisy evaluations are required. In this article, a comprehensive review of existing kriging-based methods for the optimization of noisy functions is provided. In summary, ten methods for choosing the sequential samples are described using a unified formalism. They are compared on analytical benchmark problems, whereby the usual assumption of homoscedastic Gaussian noise made in the underlying models is meet. Different problem configurations (noise level, maximum number of observations, initial number of observations) and setups (covariance functions, budget, initial sample size) are considered. It is found that the choices of the initial sample size and the covariance function are not critical. The choice of the method, however, can result in significant differences in the performance. In particular, the three most intuitive criteria are found as poor alternatives. Although no criterion is found consistently more efficient than the others, two specialized methods appear more robust on average.
- Published
- 2013