Search

The Coupled Model Intercomparison Project (CMIP) is one of the biggest international efforts aimed at better understanding the past, present, and future of climate changes in a multi-model context. A total of 21 model intercomparison projects (MIPs) were endorsed in its sixth phase (CMIP6), which included 190 different experiments that were used to simulate 40 000 years and produced around 40 PB of data in total. This paper presents the main findings obtained from the CPMIP (the Computational Performance Model Intercomparison Project), a collection of a common set of metrics, specifically designed for assessing climate model performance. These metrics were exclusively collected from the production runs of experiments used in CMIP6 and primarily from institutions within the IS-ENES3 consortium. The document presents the full set of CPMIP metrics per institution and experiment, including a detailed analysis and discussion of each of the measurements. During the analysis, we found a positive correlation between the core hours needed, the complexity of the models, and the resolution used. Likewise, we show that between 5 %–15 % of the execution cost is spent in the coupling between independent components, and it only gets worse by increasing the number of resources. From the data, it is clear that queue times have a great impact on the actual speed achieved and have a huge variability across different institutions, ranging from none to up to 78 % execution overhead. Furthermore, our evaluation shows that the estimated carbon footprint of running such big simulations within the IS-ENES3 consortium is 1692 t of CO 2 equivalent. As a result of the collection, we contribute to the creation of a comprehensive database for future community reference, establishing a benchmark for evaluation and facilitating the multi-model, multi-platform comparisons crucial for understanding climate modelling performance. Given the diverse range of applications, configurations, and hardware utilised, further work is required for the standardisation and formulation of general rules. The paper concludes with recommendations for future exercises aimed at addressing the encountered challenges which will facilitate more collections of a similar nature. [ABSTRACT FROM AUTHOR]

The Coupled Model Intercomparison Project (CMIP) is one of the biggest international efforts to better understand past, present and future climate changes in a multi-model context. A total of 21 Model Intercomparison Projects (MIPs) were endorsed in its 6th phase (CMIP6), which included 190 different experiments that were used to simulate 40000 years and produced around 40 PB of data in total. This paper shows the main results obtained from the collection of performance metrics done for CMIP6 (CPMIP). The document provides the list of partners involved, the CPMIP metrics per institution/model, and the approach used for the collection and the coordination behind this process. Furthermore, a section has been included to analyze the results and prove the usefulness of the metrics for the community. Moreover, we describe the main difficulties faced during the collection and propose recommendations for future exercises. [ABSTRACT FROM AUTHOR]

Based on the fifth phase of the Coupled Model Intercomparison Project (CMIP5)-generation previous Institut Pierre Simon Laplace (IPSL) Earth system model, we designed a new version, IPSL-CM5A2, aiming at running multi-millennial simulations typical of deep-time paleoclimate studies. Three priorities were followed during the setup of the model: (1) improving the overall model computing performance, (2) overcoming a persistent cold bias depicted in the previous model generation and (3) making the model able to handle the specific continental configurations of the geological past. These developments include the integration of hybrid parallelization Message Passing Interface – Open Multi-Processing (MPI-OpenMP) in the atmospheric model of the Laboratoire de Météorologie Dynamique (LMDZ), the use of a new library to perform parallel asynchronous input/output by using computing cores as "I/O servers" and the use of a parallel coupling library between the ocean and the atmospheric components. The model, which runs with an atmospheric resolution of 3.75∘×1.875∘ and 2 to 0.5 ∘ in the ocean, can now simulate ∼100 years per day, opening new possibilities towards the production of multi-millennial simulations with a full Earth system model. The tuning strategy employed to overcome a persistent cold bias is detailed. The confrontation of a historical simulation to climatological observations shows overall improved ocean meridional overturning circulation, marine productivity and latitudinal position of zonal wind patterns. We also present the numerous steps required to run IPSL-CM5A2 for deep-time paleoclimates through a preliminary case study for the Cretaceous. Namely, specific work on the ocean model grid was required to run the model for specific continental configurations in which continents are relocated according to past paleogeographic reconstructions. By briefly discussing the spin-up of such a simulation, we elaborate on the requirements and challenges awaiting paleoclimate modeling in the next years, namely finding the best trade-off between the level of description of the processes and the computing cost on supercomputers. [ABSTRACT FROM AUTHOR]

A climate model represents a multitude of processes on a variety of timescales and space scales: a canonical example of multi-physics multi-scale modeling. The underlying climate system is physically characterized by sensitive dependence on initial conditions, and natural stochastic variability, so very long integrations are needed to extract signals of climate change. Algorithms generally possess weak scaling and can be I/O and/or memory-bound. Such weak-scaling, I/O, and memory-bound multi-physics codes present particular challenges to computational performance. Traditional metrics of computational efficiency such as performance counters and scaling curves do not tell us enough about real sustained performance from climate models on different machines. They also do not provide a satisfactory basis for comparative information across models. codes present particular challenges to computational performance. We introduce a set of metrics that can be used for the study of computational performance of climate (and Earth system) models. These measures do not require specialized software or specific hardware counters, and should be accessible to anyone. They are independent of platform and underlying parallel programming models. We show how these metrics can be used to measure actually attained performance of Earth system models on different machines, and identify the most fruitful areas of research and development for performance engineering. codes present particular challenges to computational performance. We present results for these measures for a diverse suite of models from several modeling centers, and propose to use these measures as a basis for a CPMIP, a computational performance model intercomparison project (MIP). [ABSTRACT FROM AUTHOR]

A climate model represents a multitude of processes on a variety of time and space scales; a canonical example of multi-physics multi-scale modeling. The underlying climate system is physically characterized by sensitive dependence on initial conditions, and natural stochastic variability, so very long integrations are needed to extract signals of climate change. Algorithms generally possess weak scaling and can be I/O and/or memory bound. Such weak-scaling, I/O and memory-bound multi-physics codes present particular challenges to computational performance. Traditional metrics of computational efficiency such as performance counters and scaling curves do not tell us enough about real sustained performance from climate models on different machines. They also do not provide a satisfactory basis for comparative information across models. We introduce a set of metrics that can be used for the study of computational performance of climate (and Earth System) models. These measures do not require specialized software or specific hardware counters, and should be accessible to anyone. They are independent of platform, and underlying parallel programming models. We show how these metrics can be used to measure actually attained performance of Earth system models on different machines, and identify the most fruitful areas of research and development for performance engineering. We present results for these measures for a diverse suite of models from several modeling centres, and propose to use these measures as a basis for a CPMIP, a computational performance MIP. [ABSTRACT FROM AUTHOR]