1. Species distributions models may predict accurately future distributions but poorly how distributions change: A critical perspective on model validation
- Author
-
Sirke Piirainen, Aleksi Lehikoinen, Magne Husby, John Atle Kålås, Åke Lindström, Otso Ovaskainen, Finnish Museum of Natural History, Biosciences, Helsinki Institute of Sustainability Science (HELSUS), Faculty Common Matters (Faculty of Biology and Environmental Sciences), Zoology, Organismal and Evolutionary Biology Research Programme, and Otso Ovaskainen / Principal Investigator
- Subjects
mallintaminen ,model validation ,Temporal transferability ,forecasting ,Birds ,species traits ,temporal transferability ,Species distribution modelling ,Climate change ,lajit ,Ecology, Evolution, Behavior and Systematics ,Model validation ,Fennoscandia ,land use ,ennusteet ,levinneisyys ,prediction ,ilmastonmuutokset ,species distribution modelling ,climate change ,birds ,validointi ,Land use ,1181 Ecology, evolutionary biology ,linnut ,mallit (mallintaminen) ,Species traits ,Prediction ,Forecasting - Abstract
Aim: Species distribution models (SDMs) are widely used to make predictions on how species distributions may change as a response to climatic change. To assess the reliability of those predictions, they need to be critically validated with respect to what they are used for. While ecologists are typically interested in how and where distributions will change, we argue that SDMs have seldom been evaluated in terms of their capacity to predict such change. Instead, typical retrospective validation methods estimate model's ability to predict to only one static time in future. Here, we apply two validation methods, one that predicts and evaluates a static pattern, while the other measures change and compare their estimates of predictive performance. Location: Fennoscandia.Methods: We applied a joint SDM to model the distributions of 120 bird species in four model validation settings. We trained models with a dataset from 1975 to 1999 and predicted species' future occurrence and abundance in two ways: for one static time period (2013- 2016, "static validation') and for a change between two time periods (difference between 1996- 1999 and 2013- 2016, "change validation'). We then measured predictive performance using correlation between predicted and observed values. We also related predictive performance to species traits. Results: Even though static validation method evaluated predictive performance as good, change method indicated very poor performance. Predictive performance was not strongly related to any trait.Main Conclusions: Static validation method might overestimate predictive performance by not revealing the model's inability to predict change events. If species' distributions remain mostly stable, then even an unfit model can predict the near future well due to temporal autocorrelation. We urge caution when working with forecasts of changes in spatial patterns of species occupancy or abundance, even for SDMs that are based on time series datasets unless they are critically validated for forecasting such change.
- Published
- 2023