201. Looking beyond general metrics for model evaluation - lessons from an international model intercomparison study
- Author
-
de Boer-Euser, T., Bouaziz, L., Brauer, C., Drogue, G., Fenicia, F., Grelier, B., De Niel, J., Nossent, J., Pereira, F., Savenije, H., Thirel, Guillaume, Willems, P., Delft University of Technology (TU Delft), Deltares system, Wageningen University and Research Centre [Wageningen] (WUR), Centre d'Etude et de Recherche en Géographie de l'Aménagement des Paysages et de l'Environnement (CERGAPE - LOTERR), Université de Lorraine (UL), Swiss Federal Institute for Environmental Science and Technology [Dübendorf] (EAWAG), Catholic University of Leuven - Katholieke Universiteit Leuven (KU Leuven), Flanders Hydraulics Research, Vrije Universiteit [Brussels] (VUB), Hydrosystèmes et bioprocédés (UR HBAN), Institut national de recherche en sciences et technologies pour l'environnement et l'agriculture (IRSTEA), Wageningen University and Research [Wageningen] (WUR), Swiss Federal Insitute of Aquatic Science and Technology [Dübendorf] (EAWAG), Vrije Universiteit Brussel (VUB), Hydrosystèmes et Bioprocédés (UR HBAN), DELTARES NLD, Partenaires IRSTEA, Institut national de recherche en sciences et technologies pour l'environnement et l'agriculture (IRSTEA)-Institut national de recherche en sciences et technologies pour l'environnement et l'agriculture (IRSTEA), FACULTY OF CIVIL ENGINEERING AND GEOSCIENCES DELFT UNIVERSITY OF TECHNOLOGY DELFT NLD, HYDRAULICS DIVISION DEPARTMENT OF CIVIL ENGINEERING KU LEUVEN BEL, FLANDERS HYDRAULICS RESEARCH ANTWERP BEL, VUB DEPARTMENT OF HYDROLOGY AND HYDRAULIC ENGINEERING BRUSSEL BEL, and UL, LOTERR
- Subjects
[SDE]Environmental Sciences ,[SHS] Humanities and Social Sciences ,ComputingMilieux_MISCELLANEOUS ,[SHS]Humanities and Social Sciences - Abstract
International audience; International collaboration between institutes and universities is a promising way to reach consensus on hydrological model development. Education, experience and expert knowledge of the hydrological community have resulted in the development of a great variety of model concepts, calibration methods and analysis techniques. Although comparison studies are very valuable for international cooperation, they do often not lead to very clear new insights regarding the relevance of the modelled processes.We hypothesise that this is partly caused by model complexity and the used comparison methods, which focus on a good overall performance instead of focusing on specific events. We propose an approach that focuses on the evaluation of specific events. Eight international research groups calibrated their model for the Ourthe catchment in Belgium (1607 km2) and carried out a validation in time for the Ourthe (i.e. on two different periods, one of them on a blind mode for the modellers) and a validation in space for nested and neighbouring catchments of the Meuse in a completely blind mode. For each model, the same protocol was followed and an ensemble of best performing parameter sets was selected. Signatures were first used to assess model performances in the different catchments during validation. Comparison of the models was then followed by evaluation of selected events, which include: low flows, high flows and the transition from low to high flows. While the models show rather similar performances based on general metrics (i.e. Nash-Sutcliffe Efficiency), clear differences can be observed for specific events. While most models are able to simulate high flows well, large differences are observed during low flows and in the ability to capture the first peaks after drier months. The transferability of model parameters to neighbouring and nested catchments is assessed as an additional measure in the model evaluation. This suggested approach helps to select, among competing model alternatives, the most suitable model for a specific purpose.
- Published
- 2016