1. Building high accuracy emulators for scientific simulations with deep neural architecture search
- Author
-
M F Kasim, D Watson-Parris, L Deaconu, S Oliver, P Hatfield, D H Froula, G Gregori, M Jarvis, S Khatiwala, J Korenaga, J Topp-Mugglestone, E Viezzer, S M Vinko, Universidad de Sevilla. Departamento de Física Atómica, Molecular y Nuclear, Engineering and Physical Sciences Research Council (EPSRC). United Kingdom, European Union (UE). H2020, and Natural Environment Research Council (NERC). United Kingdom
- Subjects
FOS: Computer and information sciences ,Computer Science - Machine Learning ,FOS: Physical sciences ,Machine Learning (stat.ML) ,Computational Physics (physics.comp-ph) ,01 natural sciences ,7. Clean energy ,Physics - Plasma Physics ,010305 fluids & plasmas ,Machine Learning (cs.LG) ,Human-Computer Interaction ,Plasma Physics (physics.plasm-ph) ,Physics - Atmospheric and Oceanic Physics ,Artificial Intelligence ,Statistics - Machine Learning ,0103 physical sciences ,Atmospheric and Oceanic Physics (physics.ao-ph) ,010306 general physics ,Physics - Computational Physics ,Software - Abstract
Computer simulations are invaluable tools for scientific discovery. However, accurate simulations are often slow to execute, which limits their applicability to extensive parameter exploration, large-scale data analysis, and uncertainty quantification. A promising route to accelerate simulations by building fast emulators with machine learning requires large training datasets, which can be prohibitively expensive to obtain with slow simulations. Here we present a method based on neural architecture search to build accurate emulators even with a limited number of training data. The method successfully emulates simulations in 10 scientific cases including astrophysics, climate science, biogeochemistry, high energy density physics, fusion energy, and seismology, using the same super-architecture, algorithm, and hyperparameters. Our approach also inherently provides emulator uncertainty estimation, adding further confidence in their use. We anticipate this work will accelerate research involving expensive simulations, allow more extensive parameters exploration, and enable new, previously unfeasible computational discovery. UK EPSRC Grant EP/P015794/1 and the Royal Society UK EPSRC (EP/M022331/1 and EP/N014472/1) European Union’s Horizon 2020 (Grant Agreement No. 805162) Natural Environment Research Council (NERC) NE/P013406/1 (A-CURE)
- Published
- 2021
- Full Text
- View/download PDF