Search

Land models, which have been developed by the modeling community in the past few decades to predict future states of ecosystems and climate, have to be critically evaluated for their performance skills of simulating ecosystem responses and feedback to climate change. Benchmarking is an emerging procedure to measure performance of models against a set of defined standards. This paper proposes a benchmarking framework for evaluation of land model performances and, meanwhile, highlights major challenges at this infant stage of benchmark analysis. The framework includes (1) targeted aspects of model performance to be evaluated, (2) a set of benchmarks as defined references to test model performance, (3) metrics to measure and compare performance skills among models so as to identify model strengths and deficiencies, and (4) model improvement. Land models are required to simulate exchange of water, energy, carbon and sometimes other trace gases between the atmosphere and land surface, and should be evaluated for their simulations of biophysical processes, biogeochemical cycles, and vegetation dynamics in response to climate change across broad temporal and spatial scales. Thus, one major challenge is to select and define a limited number of benchmarks to effectively evaluate land model performance. The second challenge is to develop metrics of measuring mismatches between models and benchmarks. The metrics may include (1) a priori thresholds of acceptable model performance and (2) a scoring system to combine data–model mismatches for various processes at different temporal and spatial scales. The benchmark analyses should identify clues of weak model performance to guide future development, thus enabling improved predictions of future states of ecosystems and climate. The near-future research effort should be on development of a set of widely acceptable benchmarks that can be used to objectively, effectively, and reliably evaluate fundamental properties of land models to improve their prediction performance skills.

Terrestrial ecosystem models used for Earth system modelling show a significant divergence in future patterns of ecosystem processes, in particular the net land--atmosphere carbon exchanges, despite a seemingly common behaviour for the contemporary period. An in-depth evaluation of these models is hence of high importance to better understand the reasons for this disagreement. Here, we develop an extension for existing benchmarking systems by making use of the complementary information contained in the observational records of atmospheric CO2 and remotely sensed vegetation activity to provide a novel set of diagnostics of ecosystem responses to climate variability in the last 30yr at different temporal and spatial scales. The selection of observational characteristics (traits) specifically considers the robustness of information given that the uncertainty of both data and evaluation methodology is largely unknown or difficult to quantify. Based on these considerations, we introduce a baseline benchmark - a minimum test that any model has to pass - to provide a more objective, quantitative evaluation framework. The benchmarking strategy can be used for any land surface model, either driven by observed meteorology or coupled to a climate model. We apply this framework to evaluate the offline version of the MPI Earth System Model's land surface scheme JS-BACH. We demonstrate that the complementary use of atmospheric CO2 and satellite-based vegetation activity data allows pinpointing of specific model deficiencies that would not be possible by the sole use of atmospheric CO2 observations. [ABSTRACT FROM AUTHOR]

Terrestrial ecosystem models used for Earth system modelling show a significant divergence in future patterns of ecosystem processes, in particular carbon exchanges, despite a seemingly common behaviour for the contemporary period. An in-depth evaluation of these models is hence of high importance to achieve a better understanding of the reasons for this disagreement. Here, we develop an extension for existing benchmarking systems by making use of the complementary information contained in the observational records of atmospheric CO2 and remotely-sensed vegetation activity to provide a firm set of diagnostics of ecosystem responses to climate variability in the last 30 yr at different temporal and spatial scales. The selection of observational characteristics (traits) specifically considers the robustness of information given the uncertainties in both data and evaluation analysis. In addition, we provide a baseline benchmark, a minimum test that the model under consideration has to pass, to provide a more objective, quantitative evaluation framework. The benchmarking strategy can be used for any land surface model, either driven by observed meteorology or coupled to a climate model. We apply this framework to evaluate the offline version of the MPI-Earth system model's land surface scheme JSBACH. We demonstrate that the complementary use of atmospheric CO2 and satellite based vegetation activity data allows to pinpoint specific model failures that would not be possible by the sole use of atmospheric CO2 observations. [ABSTRACT FROM AUTHOR]

Land models, which have been developed by the modeling community in the past two decades to predict future states of ecosystems and climate, have to be critically evaluated for their performance skills of simulating ecosystem responses and feedback to climate change. Benchmarking is an emerging procedure to measure and evaluate performance of models against a set of defined standards. This paper proposes a benchmarking framework for evaluation of land models. The framework includes (1) targeted aspects of model performance to be evaluated; (2) a set of benchmarks as defined references to test model performance; (3) metrics to measure and compare performance skills among models so as to identify model strengths and deficiencies; and (4) model improvement. Component 4 may or may not be involved in a benchmark analysis but is an ultimate goal of general modeling research. Land models are required to simulate exchange of water, energy, carbon and sometimes other trace gases between the atmosphere and the land-surface, and should be evaluated for their simulations of biophysical processes, biogeochemical cycles, and vegetation dynamics across timescales in response to both weather and climate change. Benchmarks that are used to evaluate models generally consist of direct observations, data-model products, and data-derived patterns and relationships. Metrics of measuring mismatches between models and benchmarks may include (1) a priori thresholds of acceptable model performance and (2) a scoring system to combine data-model mismatches for various processes at different temporal and spatial scales. The benchmark analyses should identify clues of weak model performance for future improvement. Iterations between model evaluation and improvement via benchmarking shall demonstrate progress of land modeling and help establish confidence in land models for their predictions of future states of ecosystems and climate. [ABSTRACT FROM AUTHOR]

Stand age significantly influences the functioning of forest ecosystems by shaping structural and physiological plant traits, affecting water and carbon budgets. Forest age distribution is determined by the interplay of tree mortality and regeneration, influenced by both natural and anthropogenic disturbances. Unfortunately, human-driven alteration of tree age distribution presents an underexplored avenue for enhancing forest stability and resilience. In our study, we investigated how age impacts the stability and resilience of the forest carbon budget under both current and future climate conditions. We employed a state-of-the-science biogeochemical, biophysical, validated process-based model on historically managed forest stands, projecting their future as undisturbed systems, i.e., left at their natural evolution with no management interventions (i.e., forests are left to develop undisturbed). Such a model, forced by climate data from five Earth System Models under four representative climate scenarios and one baseline scenario to disentangle the effect of climate change, spanned several age classes as representative of the current European forests' context, for each stand. Our findings indicate that Net Primary Production (NPP) peaks in the young and middle-aged classes (16- to 50-year-old), aligning with longstanding ecological theories, regardless of the climate scenario. Under climate change, the beech forest exhibited an increase in NPP and maintained stability across all age classes, while resilience remained constant with rising atmospheric CO 2 and temperatures. However, NPP declined under climate change scenarios for the Norway spruce and Scots pine sites. In these coniferous forests, stability and resilience were more influenced. These results underscore the necessity of accounting for age class diversity -lacking in most, if not all, the current Global Vegetation Models - for reliable and robust assessments of the impacts of climate change on future forests' stability and resilience capacity. We, therefore, advocate for customized management strategies that enhance the adaptability of forests to changing climatic conditions, taking into account the diverse responses of different species and age groups to climate., Competing Interests: Declaration of competing interest The authors declare the following financial interests/personal relationships which may be considered as potential competing interests:Elia Vangi reports financial support was provided by Horizon Europe. Paulina Puchi reports financial support was provided by Ministry of Education and Merit. Alessio Collalti, reports financial support was provided by Horizon Europe. If there are other authors, they declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 The Authors. Published by Elsevier Ltd.. All rights reserved.)

Process-based forest models combine biological, physical, and chemical process understanding to simulate forest dynamics as an emergent property of the system. As such, they are valuable tools to investigate the effects of climate change on forest ecosystems. Specifically, they allow testing of hypotheses regarding long-term ecosystem dynamics and provide means to assess the impacts of climate scenarios on future forest development. As a consequence, numerous local-scale simulation studies have been conducted over the past decades to assess the impacts of climate change on forests. These studies apply the best available models tailored to local conditions, parameterized and evaluated by local experts. However, this treasure trove of knowledge on climate change responses remains underexplored to date, as a consistent and harmonized dataset of local model simulations is missing. Here, our objectives were (i) to compile existing local simulations on forest development under climate change in Europe in a common database, (ii) to harmonize them to a common suite of output variables, and (iii) to provide a standardized vector of auxiliary environmental variables for each simulated location to aid subsequent investigations. Our dataset of European stand- and landscape-level forest simulations contains over 1.1 million simulation runs representing 135 million simulation years for more than 13,000 unique locations spread across Europe. The data were harmonized to consistently describe forest development in terms of stand structure (dominant height), composition (dominant species, admixed species), and functioning (leaf area index). Auxiliary variables provided include consistent daily climate information (temperature, precipitation, radiation, vapor pressure deficit) as well as information on local site conditions (soil depth, soil physical properties, soil water holding capacity, plant-available nitrogen). The present dataset facilitates analyses across models and locations, with the aim to better harness the valuable information contained in local simulations for large-scale policy support, and for fostering a deeper understanding of the effects of climate change on forest ecosystems in Europe., (© 2024 The Authors.)

Tree mortality and forest dieback episodes are increasing due to drought and heat stress. Nevertheless, a comprehensive understanding of mechanisms enabling trees to withstand and survive droughts remains lacking. Our study investigated basal area increment (BAI), and δ 13 C-derived intrinsic water-use-efficiency ( i WUE), to elucidate beech resilience across four healthy stands in Italy with varying climates and soil water availability. Additionally, fist-order autocorrelation (AR1) analysis was performed to detect early warning signals for potential tree dieback risks during extreme drought events. Results reveal a negative link between BAI and vapour pressure deficit (VPD), especially in southern latitudes. After the 2003 drought, BAI decreased at the northern site, with an increase in δ 13 C and i WUE, indicating conservative water-use. Conversely, the southern sites showed increased BAI and i WUE, likely influenced by rising CO 2 and improved water availability. In contrast, the central site sustained higher transpiration rates due to higher soil water holding capacity (SWHC). Despite varied responses, most sites exhibited reduced resilience to future extreme events, indicated by increased AR1. Temperature significantly affected beech i WUE and BAI in northern Italy, while VPD strongly influenced the southern latitudes. The observed increase in BAI and i WUE in southern regions might be attributed to an acclimation response., (© 2024. The Author(s).)

Mediterranean pine plantations provide several ecosystem services but are vulnerable to climate change. Forest management might play a strategic role in the adaptation of Mediterranean forests, but the joint effect of climate change and diverse management options have seldom been investigated together. Here, we simulated the development of a Laricio pine (Pinus nigra subsp. laricio) stand in the Bonis watershed (southern Italy) from its establishment in 1958 up to 2095 using a state-of-the-science process-based forest model. The model was run under three climate scenarios corresponding to increasing levels of atmospheric CO 2 concentration and warming, and six management options with different goals, including wood production and renaturalization. We analysed the effect of climate change on annual carbon fluxes (i.e., gross and net primary production) and stocks (i.e., basal area, standing and harvested carbon woody stocks) of the autotrophic compartment, as well as the impact of different management options compared to a no management baseline. Results show that higher temperatures (+3 to +5 °C) and lower precipitation (-20 % to -22 %) will trigger a decrease in net primary productivity in the second half of the century. Compared to no management, the other options had a moderate effect on carbon fluxes over the whole simulation (between -14 % and +11 %). While standing woody biomass was reduced by thinning interventions and the shelterwood system (between -5 % and -41 %), overall carbon stocks including the harvested wood were maximized (between +41 % and +56 %). Results highlight that management exerts greater effects on the carbon budget of Laricio pine plantations than climate change alone, and that climate change and management are largely independent (i.e., no strong interaction effects). Therefore, appropriate silvicultural strategies might enhance potential carbon stocks and improve forest conditions, with cascading positive effects on the provision of ecosystem services in Mediterranean pine plantations., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2022 Elsevier B.V. All rights reserved.)

Forest models are instrumental for understanding and projecting the impact of climate change on forests. A considerable number of forest models have been developed in the last decades. However, few systematic and comprehensive model comparisons have been performed in Europe that combine an evaluation of modelled carbon and water fluxes and forest structure. We evaluate 13 widely used, state-of-the-art, stand-scale forest models against field measurements of forest structure and eddy-covariance data of carbon and water fluxes over multiple decades across an environmental gradient at nine typical European forest stands. We test the models' performance in three dimensions: accuracy of local predictions (agreement of modelled and observed annual data), realism of environmental responses (agreement of modelled and observed responses of daily gross primary productivity to temperature, radiation and vapour pressure deficit) and general applicability (proportion of European tree species covered). We find that multiple models are available that excel according to our three dimensions of model performance. For the accuracy of local predictions, variables related to forest structure have lower random and systematic errors than annual carbon and water flux variables. Moreover, the multi-model ensemble mean provided overall more realistic daily productivity responses to environmental drivers across all sites than any single individual model. The general applicability of the models is high, as almost all models are currently able to cover Europe's common tree species. We show that forest models complement each other in their response to environmental drivers and that there are several cases in which individual models outperform the model ensemble. Our framework provides a first step to capturing essential differences between forest models that go beyond the most commonly used accuracy of predictions. Overall, this study provides a point of reference for future model work aimed at predicting climate impacts and supporting climate mitigation and adaptation measures in forests., (© 2022 The Authors. Global Change Biology published by John Wiley & Sons Ltd.)