Search

Numerical weather forecasts can exhibit systematic errors due to simplifying model assumptions and computational approximations. Statistical postprocessing is a statistical approach to correcting such biases. A statistical postprocessing model takes input data from a numerical forecast model, and outputs a parametric predictive distribution of a real-world observation, with model parameters learned from past forecast-observation pairs. In this paper we develop and discuss methods for postprocessing of gridded data. We show that estimates of postprocessing parameters on a spatial grid can be improved by Bayesian hierarchical modelling with spatial priors. We use the "Max-and-Smooth" approach [Hrafnkelsson et al., 2021] to approximate a fully Bayesian inference in two steps. First we calculate maximum-likelihood estimates (MLEs) of postprocessing parameters at individual grid points. Second we smooth the MLEs using a measurement error model with a spatial prior. Our approach provides the theoretical basis for the parameter smoothing approach by Kharin et al. [2017], and simplifies and generalises the Bayesian hierarchical modelling approach by Moeller et al. [2015]. A new derivation of Max-and-Smooth is presented. The method is applicable to arbitrary postprocessing models, as illustrated on Model Output Statistics, Logistic Regression, and Nonhomogeneous Gaussian Regression. We report consistent improvements in forecast accuracy, calibration, and probabilistic skill in postprocessing of temperature and precipitation forecasts.

The power-law rating curve has been used extensively in hydraulic practice and hydrology. It is given by $Q(h)=a(h-c)^b$, where $Q$ is discharge, $h$ is water elevation, $a$, $b$ and $c$ are unknown parameters. We propose a novel extension of the power-law rating curve, referred to as the generalized power-law rating curve. It is constructed by linking the physics of open channel flow to a model of the form $Q(h)=a(h-c)^{f(h)}$. The function $f(h)$ is referred to as the power-law exponent and it depends on the water elevation. The proposed model and the power-law model are fitted within the framework of Bayesian hierarchical models. By exploring the properties of the proposed rating curve and its power-law exponent, we find that cross sectional shapes that are likely to be found in nature are such that the power-law exponent $f(h)$ will usually be in the interval $[1.0,2.67]$. This fact is utilized for the construction of prior densities for the model parameters. An efficient Markov chain Monte Carlo sampling scheme, that utilizes the lognormal distributional assumption at the data level and Gaussian assumption at the latent level, is proposed for the two models. The two statistical models were applied to four datasets. In the case of three datasets the generalized power-law rating curve gave a better fit than the power-law rating curve while in the fourth case the two models fitted equally well and the generalized power-law rating curve mimicked the power-law rating curve., Comment: Main paper 29 pages, 4 tables, 7 figures. Supplementary material 5 pages, 4 figures

With modern high-dimensional data, complex statistical models are necessary, requiring computationally feasible inference schemes. We introduce Max-and-Smooth, an approximate Bayesian inference scheme for a flexible class of latent Gaussian models (LGMs) where one or more of the likelihood parameters are modeled by latent additive Gaussian processes. Max-and-Smooth consists of two-steps. In the first step (Max), the likelihood function is approximated by a Gaussian density with mean and covariance equal to either (a) the maximum likelihood estimate and the inverse observed information, respectively, or (b) the mean and covariance of the normalized likelihood function. In the second step (Smooth), the latent parameters and hyperparameters are inferred and smoothed with the approximated likelihood function. The proposed method ensures that the uncertainty from the first step is correctly propagated to the second step. Since the approximated likelihood function is Gaussian, the approximate posterior density of the latent parameters of the LGM (conditional on the hyperparameters) is also Gaussian, thus facilitating efficient posterior inference in high dimensions. Furthermore, the approximate marginal posterior distribution of the hyperparameters is tractable, and as a result, the hyperparameters can be sampled independently of the latent parameters. In the case of a large number of independent data replicates, sparse precision matrices, and high-dimensional latent vectors, the speedup is substantial in comparison to an MCMC scheme that infers the posterior density from the exact likelihood function. The proposed inference scheme is demonstrated on one spatially referenced real dataset and on simulated data mimicking spatial, temporal, and spatio-temporal inference problems. Our results show that Max-and-Smooth is accurate and fast., Comment: This is version 2 of the Max-and-Smooth paper. Minor changes have been made to this version with respect to version 1 of the Max-and-Smooth paper. The order of the authors was changed

Extreme floods cause casualties, and widespread damage to property and vital civil infrastructure. We here propose a Bayesian approach for predicting extreme floods using the generalized extreme-value (GEV) distribution within gauged and ungauged catchments. A major methodological challenge is to find a suitable parametrization for the GEV distribution when covariates or latent spatial effects are involved. Other challenges involve balancing model complexity and parsimony using an appropriate model selection procedure, and making inference using a reliable and computationally efficient approach. Our approach relies on a latent Gaussian modeling framework with a novel multivariate link function designed to separate the interpretation of the parameters at the latent level and to avoid unreasonable estimates of the shape and time trend parameters. Structured additive regression models are proposed for the four parameters at the latent level. For computational efficiency with large datasets and richly parametrized models, we exploit an accurate and fast approximate Bayesian inference approach. We applied our proposed methodology to annual peak river flow data from 554 catchments across the United Kingdom (UK). Our model performed well in terms of flood predictions for both gauged and ungauged catchments. The results show that the spatial model components for the transformed location and scale parameters, and the time trend, are all important. Posterior estimates of the time trend parameters correspond to an average increase of about $1.5\%$ per decade and reveal a spatial structure across the UK. To estimate return levels for spatial aggregates, we further develop a novel copula-based post-processing approach of posterior predictive samples, in order to mitigate the effect of the conditional independence assumption at the data level, and we show that our approach provides accurate results., Comment: 33 pages, 12 figures, 5 tables

In this paper, we extend and analyze a Bayesian hierarchical spatio-temporal model for physical systems. A novelty is to model the discrepancy between the output of a computer simulator for a physical process and the actual process values with a multivariate random walk. For computational efficiency, linear algebra for bandwidth limited matrices is utilized, and first-order emulator inference allows for the fast emulation of a numerical partial differential equation (PDE) solver. A test scenario from a physical system motivated by glaciology is used to examine the speed and accuracy of the computational methods used, in addition to the viability of modeling assumptions. We conclude by discussing how the model and associated methodology can be applied in other physical contexts besides glaciology., Comment: Revision accepted for publication by the Journal of Agricultural, Biological, and Environmental Statistics

We propose a comprehensive Bayesian hierarchical model for monthly maxima of instantaneous flow in river catchments. The Gumbel distribution is used as the probabilistic model for the observations, which are assumed to come from several catchments. Our suggested latent model is Gaussian and designed for monthly maxima, making better use of the data than the standard approach using annual maxima. At the latent level, linear mixed models are used for both the location and scale parameters of the Gumbel distribution, accounting for seasonal dependence and covariates from the catchments. The specification of prior distributions makes use of penalised complexity (PC) priors, to ensure robust inference for the latent parameters. The main idea behind the PC priors is to shrink toward a base model, thus avoiding overfitting. PC priors also provide a convenient framework for prior elicitation based on simple notions of scale. Prior distributions for regression coefficients are also elicited based on hydrological and meteorological knowledge. Posterior inference was done using the MCMC split sampler, an efficient Gibbs blocking scheme tailored to latent Gaussian models. The proposed model was applied to observed data from eight river catchments in Iceland. A cross-validation study demonstrates good predictive performance.

A novel computationally efficient Markov chain Monte Carlo (MCMC) scheme for latent Gaussian models (LGMs) is proposed in this paper. The sampling scheme is a two block Gibbs sampling scheme designed to exploit the model structure of LGMs. We refer to the proposed sampling scheme as the MCMC split sampler. The principle idea behind the MCMC split sampler is to split the latent Gaussian parameters into two vectors. The former vector consists of latent parameters which appear in the data density function, while the latter vector consists of latent parameters which do not appear in it. The former vector is placed in the first block of the proposed sampling scheme and the latter vector is placed in the second block along with any potential hyperparameters. The resulting conditional posterior density functions within the blocks allow the MCMC split sampler to handle, by design, LGMs with latent models imposed on more than just the mean structure of the data density function. The MCMC split sampler is also designed to be applicable for any choice of a parametric data density function. Moreover, it scales well in terms of computational efficiency when the dimension of the latent model increase.

We propose a computationally efficient statistical method to obtain distributional properties of annual maximum 24 hour precipitation on a 1 km by 1 km regular grid over Iceland. A latent Gaussian model is built which takes into account observations, spatial variations and outputs from a local meteorological model. A covariate based on the meteorological model is constructed at each observational site and each grid point in order to assimilate available scientific knowledge about precipitation into the statistical model. The model is applied to two data sets on extreme precipitation, one uncorrected data set and one data set that is corrected for phase and wind. The observations are assumed to follow the generalized extreme value distribution. At the latent level, we implement SPDE spatial models for both the location and scale parameters of the likelihood. An efficient MCMC sampler which exploits the model structure is constructed, which yields fast continuous spatial predictions for spatially varying model parameters and quantiles., Comment: 32 pages, 16 figures, submitted to Environmetrics