Search

Regional reanalyses provide a dynamically consistent recreation of past weather observations at scales useful for local-scale environmental applications. The development of convection-permitting models (CPMs) in numerical weather prediction has facilitated the creation of kilometre-scale (1–4 km) regional reanalysis and climate projections. The Bureau of Meteorology Atmospheric high-resolution Regional Reanalysis for Australia (BARRA) also aims to realize the benefits of these high-resolution models over Australian sub-regions for applications such as fire danger research by nesting them in BARRA's 12 km regional reanalysis (BARRA-R). Four midlatitude sub-regions are centred on Perth in Western Australia, Adelaide in South Australia, Sydney in New South Wales (NSW), and Tasmania. The resulting 29-year 1.5 km downscaled reanalyses (BARRA-C) are assessed for their added skill over BARRA-R and global reanalyses for near-surface parameters (temperature, wind, and precipitation) at observation locations and against independent 5 km gridded analyses. BARRA-C demonstrates better agreement with point observations for temperature and wind, particularly in topographically complex regions and coastal regions. BARRA-C also improves upon BARRA-R in terms of the intensity and timing of precipitation during the thunderstorm seasons in NSW and spatial patterns of sub-daily rain fields during storm events. BARRA-C reflects known issues of CPMs: overestimation of heavy rain rates and rain cells, as well as underestimation of light rain occurrence. As a hindcast-only system, BARRA-C largely inherits the domain-averaged bias pattern from BARRA-R but does produce different climatological extremes for temperature and precipitation. An added-value analysis of temperature and precipitation extremes shows that BARRA-C provides additional skill over BARRA-R when compared to gridded observations. The spatial patterns of BARRA-C warm temperature extremes and wet precipitation extremes are more highly correlated with observations. BARRA-C adds value in the representation of the spatial pattern of cold extremes over coastal regions but remains biased in terms of magnitude.

The Bureau of Meteorology Atmospheric high-resolution Regional Reanalysis for Australia (BARRA) is the first atmospheric regional reanalysis over a large region covering Australia, New Zealand, and Southeast Asia. The production of the reanalysis with approximately 12 km horizontal resolution – BARRA-R – is well underway with completion expected in 2019. This paper describes the numerical weather forecast model, the data assimilation methods, the forcing and observational data used to produce BARRA-R, and analyses results from the 2003–2016 reanalysis. BARRA-R provides a realistic depiction of the meteorology at and near the surface over land as diagnosed by temperature, wind speed, surface pressure, and precipitation. Comparing against the global reanalyses ERA-Interim and MERRA-2, BARRA-R scores lower root mean square errors when evaluated against (point-scale) 2 m temperature, 10 m wind speed, and surface pressure observations. It also shows reduced biases in daily 2 m temperature maximum and minimum at 5 km resolution and a higher frequency of very heavy precipitation days at 5 and 25 km resolution when compared to gridded satellite and gauge analyses. Some issues with BARRA-R are also identified: biases in 10 m wind, lower precipitation than observed over the tropical oceans, and higher precipitation over regions with higher elevations in south Asia and New Zealand. Some of these issues could be improved through dynamical downscaling of BARRA-R fields using convective-scale ( km) models.

The high spatio-temporal variability of precipitation is often difficult to characterise due to limited measurements. The available low-resolution global reanalysis datasets inadequately represent the spatio-temporal variability of precipitation relevant to catchment hydrology. The Bureau of Meteorology Atmospheric high-resolution Regional Reanalysis for Australia (BARRA) provides a high-resolution atmospheric reanalysis dataset across the Australasian region. For hydrometeorological applications, however, it is essential to properly evaluate the sub-daily precipitation from this reanalysis. In this regard, this paper evaluates the sub-daily precipitation from BARRA for a period of 6 years (2010–2015) over Australia against point observations and blended radar products. We utilise a range of existing and bespoke metrics for evaluation at point and spatial scales. We examine bias in quantile estimates and spatial displacement of sub-daily rainfall at a point scale. At a spatial scale, we use the Fractions Skill Score as a spatial evaluation metric. The results show that the performance of BARRA precipitation depends on spatial location with poorer performance in tropical relative to temperate regions. A possible spatial displacement during large rainfall is also found at point locations. This displacement, evaluated by comparing the distribution of rainfall within a day, could be quantified by considering the neighbourhood grids. On spatial evaluation, hourly precipitation from BARRA are found to be skilful at a spatial scale of less than 100 km (150 km) for a threshold of 75 % quantile (90 % quantile) at most of the locations. The performance across all the metrics improves significantly at time resolutions higher than 3 h. Our evaluations illustrate that the BARRA precipitation, despite discernible spatial displacements, serves as a useful dataset for Australia, especially at sub-daily resolutions. Users of BARRA are recommended to properly account for possible spatio-temporal displacement errors, especially for applications where the spatial and temporal characteristics of rainfall are deemed very important.

An accurate temporal and spatial characterization of errors is required for the efficient processing, evaluation, and assimilation of remotely-sensed surface soil moisture retrievals. However, empirical evidence exists that passive microwave soil moisture retrievals are prone to periodic artifacts which may complicate their application in data assimilation systems (which commonly treat observational errors as being temporally white). In this paper, the link between such temporally-periodic errors and spatial land surface heterogeneity is examined. Both the synthetic experiment and site-specified cases reveal that, when combined with strong spatial heterogeneity, temporal periodicity in satellite sampling patterns (associated with exact repeat intervals of the polar-orbiting satellites) can lead to spurious high frequency spectral peaks in soil moisture retrievals. In addition, the global distribution of the most prominent and consistent 8-day spectral peak in the Advanced Microwave Scanning Radiometer – Earth Observing System soil moisture retrievals is revealed via a peak detection method. Three spatial heterogeneity indicators – based on microwave brightness temperature, land cover types, and long-term averaged vegetation index – are proposed to characterize the degree to which the variability of land surface is capable of inducing periodic error into satellite-based soil moisture retrievals. Regions demonstrating 8-day periodic errors are generally consistent with those exhibiting relatively higher heterogeneity indicators. This implies a causal relationship between spatial land surface heterogeneity and temporal periodic error in remotely-sensed surface soil moisture retrievals.

Real-time de-noising of satellite-derived soil moisture observations presents opportunities to deliver more accurate and timely satellite data for direct satellite users. So far, the most commonly used techniques for reducing the impact of noise in the retrieved satellite soil moisture observations have been based on moving average filters and Fourier based methods. This paper introduces a new alternative wavelet based approach called Wiener-Wavelet-Based Filter (WiW), which uses an entropy based de-noising method to design a causal version of the filter. WiW is used as a post-retrieval processing tool to enhance the quality of observations derived from one active (the Advanced Scatterometer, ASCAT) and one passive (the Advanced Microwave Scanning Radiometer for Earth Observing System, AMSRE) satellite sensors. The filter is then compared with two candidate de-noising techniques, namely: i) a Wiener causal filter introduced by Su et al. (2013) and ii) a conventional moving average filter. The validation is carried out globally at 173 (for AMSRE) and 243 (for ASCAT) soil moisture stations. Results show that all the three de-noising techniques can increase the agreement between satellite and in situ measurements in terms of correlation and signal-to-noise ratio. The Wiener-based methods show least signal distortion and demonstrate to be conservative in retaining the signal information in de-noised data. Importantly, the Wiener filters can be calibrated with the data at hand, without the need for auxiliary data.

The Advanced Microwave Scanning Radiometer 2 (AMSR2), a follow-up microwave sensor to the AMSR for Earth Observing System (AMSR-E), was launched on the Global Change Observation Mission 1 – Water (GCOM-W1) satellite in May 2012. It is as yet unclear if instrumental improvements in AMSR2 over AMSR-E have led to better soil moisture (SM) estimates, especially since there is no overlapping period of data between the sensors. This study focuses on comparing the results of AMSR2 and AMSR-E SM over Australia, distinguishing four Koppen climate zones to determine if AMSR2 is better than AMSR-E. This is achieved by selecting two year-long comparative time periods from the operating periods of AMSR-E and AMSR2, based on their statistical similarities in modeled SM as a proxy, using Modern Era Retrospective-analysis for Research and Applications-Land (MERRA-L). The AMSR2 and AMSR-E C- and X-band SM derived from the Land Parameter Retrieval Model (LPRM) was evaluated. Both AMSR2 C- and X-band SM products were found to show similar temporal patterns and spatial agreement with AMSR-E C- and X-band SM, supported by unbiased root mean square difference (ubRMSD) and R-values with MERRA-L SM, respectively. Using lag-based instrumental variable analysis to estimate the random error component of SM retrievals, the noise-to-signal ratios in AMSR2 X-band SM were found to be slightly higher than their AMSR-E counterparts. The improvements in AMSR2, such as the superior radiometric sensitivity and spatial resolution, have therefore not led to statistically significant differences in performance for LPRM retrievals at 1/2° × 1/2° grid resolution, when compared with AMSR-E. However, similarities in the metrics for AMSR2 and AMSR-E SM suggest that AMSR2 provides a valuable continuation to AMSR-E.

For Earth observation data to be useful for a wide range of land surface applications, a kilometer or finer resolution is required. Unfortunately, passive microwave observations at low microwave frequencies (1-10 GHz), already providing important information on soil moisture and vegetation dynamics, are generally only available at a resolution of tens of kilometers. This letter presents a new downscaling method relating L-band radiometer and C-band radar observations for downscaling purposes. The data were obtained from two extensive airborne field experiments across a 80 000-km2 catchment in south-eastern Australia and coinciding Envisat Advanced Synthetic Aperture Radar acquisitions, performed during the Austral summer and spring of 2010. The novel approach of this study is in the downscaling of coarse-scale emissivities as observed by the radiometer with a new interpretation of the change detection methodology for the radar signal to relate the spatiotemporal changes of those two types of observations at 1 km. It is shown that, for most land surface conditions, a good spatial representation at high resolution is achieved, without considering land surface specific parameterizations, which is promising for using very high resolution radar data from the Sentinel-1 platform for downscaling of passive microwave data from current missions, such as National Aeronautics and Space Administration's Soil Moisture Active Passive and European Space Agency's SMOS.

Soil moisture is one of the essential climate variables for the Global Climate Observing System (GCOS) that has been prioritized by the ESA's Climate Change Initiative to construct its homogeneous long-term climate record. This requires a consistent characterization of the error structures in the individual data sets, which vary due to changes in instrument configuration and calibration, and retrieval algorithm design. In this paper, the random error and systematic differences in nine passive and active microwave satellite soil moisture products over Australia (time coverage: 1978–present) are estimated in a same manner for SM components at subseasonal and seasonal-to-interannual timescales separately. The multi-scale error structures are found to be non-trivial and vary between the products, giving cause for conducting multi-scale merging with awareness of these differences. Noticeable similarities between the error structures of the satellite products derived from same retrieval algorithm and same measuring frequency however suggest transferability of error parameters between them. Using partial rank correlation analysis, the error maps are linked to statistics on vegetation index, digital elevation, soil moisture and soil temperature, and land cover fractions and mixing in order to explain the observed variability and the similarities between the products.

This paper explores the use of active and passive microwave satellite soil moisture products for improving streamflow prediction within four large (>5000km2) semiarid catchments in Australia. We use the probability distributed model (PDM) under a data-scarce scenario and aim at correcting two key controlling factors in the streamflow generation: the rainfall forcing data and the catchment wetness condition. The soil moisture analysis rainfall tool (SMART) is used to correct a near real-time satellite rainfall product (forcing correction scheme) and an ensemble Kalman filter is used to correct the PDM soil moisture state (state correction scheme). These two schemes are combined in a dual correction scheme and we assess the relative improvements of each. Our results demonstrate that the quality of the satellite rainfall product is improved by SMART during moderate-to-high daily rainfall events, which in turn leads to improved streamflow prediction during high flows. When employed individually, the soil moisture state correction scheme generally outperforms the rainfall correction scheme, especially for low flows. Overall, the combined dual correction scheme further improves the streamflow predictions (reduction in root mean square error and false alarm ratio, and increase in correlation coefficient and Nash-Sutcliffe efficiency). Our results provide new evidence of the value of satellite soil moisture observations within data-scarce regions. We also identify a number of challenges and limitations within the schemes.

The error characterization of soil moisture products, for example, obtained from microwave remote sensing data, is a key requirement for using these products in applications like numerical weather prediction. The error variance and root-mean-square error are among the most popular metrics: they can be estimated consistently for three datasets using triple collocation (TC) without assuming any dataset to be free of errors. This technique can account for additive and multiplicative biases; that is, it assumes that the three products are linearly related. However, its susceptibility to nonlinear relations (e.g., due to sensor saturation and scale mismatch) has not been addressed. Here, a simulation study investigates the impact of quadratic relations on the TC error estimates [also when the products are first rescaled using the nonlinear cumulative distribution function (CDF) matching technique] and on those by two novel methods. These methods—based on error-in-variables regression and probabilistic factor analysis—extend standard TC by also accounting for nonlinear relations using quadratic polynomials. The relative differences between the error estimates of the ASCAT remotely sensed product by the quadratic and the linear methods are predominantly smaller than 10% in a case study based on remotely sensed, reanalysis, and in situ measured soil moisture over the contiguous United States. Exceptions with larger discrepancies indicate that nonlinear relations can pose a challenge to traditional TC analyses, as the simulations show they can introduce biases of either sign. In such cases, the use of nonlinear methods may complement traditional approaches for the error characterization of soil moisture products.

To date, triple collocation (TC) analysis is one of the most important methods for the global-scale evaluation of remotely sensed soil moisture data sets. In this study we review existing implementations of soil moisture TC analysis as well as investigations of the assumptions underlying the method. Different notations that are used to formulate the TC problem are shown to be mathematically identical. While many studies have investigated issues related to possible violations of the underlying assumptions, only few TC modifications have been proposed to mitigate the impact of these violations. Moreover, assumptions, which are often understood as a limitation that is unique to TC analysis are shown to be common also to other conventional performance metrics. Noteworthy advances in TC analysis have been made in the way error estimates are being presented by moving from the investigation of absolute error variance estimates to the investigation of signal-to-noise ratio (SNR) metrics. Here we review existing error presentations and propose the combined investigation of the SNR (expressed in logarithmic units), the unscaled error variances, and the soil moisture sensitivities of the data sets as an optimal strategy for the evaluation of remotely-sensed soil moisture data sets.

Global soil moisture records are essential for studying the role of hydrologic processes within the larger earth system. Various studies have shown the benefit of assimilating satellite-based soil moisture data into water balance models or merging multisource soil moisture retrievals into a unified data set. However, this requires an appropriate parameterization of the error structures of the underlying data sets. While triple collocation (TC) analysis has been widely recognized as a powerful tool for estimating random error variances of coarse-resolution soil moisture data sets, the estimation of error cross covariances remains an unresolved challenge. Here we propose a method—referred to as extended collocation (EC) analysis—for estimating error cross-correlations by generalizing the TC method to an arbitrary number of data sets and relaxing the therein made assumption of zero error cross-correlation for certain data set combinations. A synthetic experiment shows that EC analysis is able to reliably recover true error cross-correlation levels. Applied to real soil moisture retrievals from Advanced Microwave Scanning Radiometer-EOS (AMSR-E) C-band and X-band observations together with advanced scatterometer (ASCAT) retrievals, modeled data from Global Land Data Assimilation System (GLDAS)-Noah and in situ measurements drawn from the International Soil Moisture Network, EC yields reasonable and strong nonzero error cross-correlations between the two AMSR-E products. Against expectation, nonzero error cross-correlations are also found between ASCAT and AMSR-E. We conclude that the proposed EC method represents an important step toward a fully parameterized error covariance matrix for coarse-resolution soil moisture data sets, which is vital for any rigorous data assimilation framework or data merging scheme.

Remote sensing, in situ networks and models are now providing unprecedented information for environmental monitoring. To conjunctively use multi-source data nominally representing an identical variable, one must resolve biases existing between these disparate sources, and the characteristics of the biases can be non-trivial due to spatio-temporal variability of the target variable, inter-sensor differences with variable measurement supports. One such example is of soil moisture (SM) monitoring. Triple collocation (TC) based bias correction is a powerful statistical method that is increasingly being used to address this issue, but is only applicable to the linear regime, whereas the non-linear method of statistical moment matching is susceptible to unintended biases originating from measurement error. Since different physical processes that influence SM dynamics may be distinguishable by their characteristic spatio-temporal scales, we propose a multi-timescale linear bias model in the framework of a wavelet-based multi-resolution analysis (MRA). The joint MRA-TC analysis was applied to demonstrate scale-dependent biases between in situ, remotely sensed and modelled SM, the influence of various prospective bias correction schemes on these biases, and lastly to enable multi-scale bias correction and data-adaptive, non-linear de-noising via wavelet thresholding.

Triple collocation (TC) is routinely used to resolve approximated linear relationships between different measurements (or representations) of a geophysical variable that are subject to errors. It has been utilized in the context of calibration, validation, bias correction, and error characterization to allow comparisons of diverse data records from various direct and indirect measurement techniques including in situ remote sensing and model-based approaches. However, successful applications of TC require sufficiently large numbers of coincident data points from three independent time series and, within the analysis period, homogeneity of their linear relationships and error structures. These conditions are difficult to realize in practice due to infrequent spatiotemporal sampling of satellite and ground-based sensors. TC can, however, be generalized within the framework of instrumental variable (IV) regression theory to address some of the conceptual constraints of TC. We review the theoretics of IV and consider one possible strategy to circumvent the three-data constraint by use of lagged variables (LV) as instruments. This particular implementation of IV is suitable for circumstances where multiple data records are limited and the geophysical variable of interest is sampled at time intervals shorter than its temporal correlation length. As a demonstration of utility, the LV method is applied to microwave satellite soil moisture data sets to recover their errors over Australia and to estimate temporal properties of their relationships with in situ and model data. These results are compared against standard two-data linear estimators and the TC estimator as benchmark.

International audience; Climate Data Records (CDR) that blend multiple satellite products are invaluable for climate studies, trend analysis and risk assessments. Knowledge of any inhomogeneities in the CDR is therefore critical for making correct inferences. This work proposes a methodology to identify the spatiotemporal extent of the inhomogeneities in a 36 year, global multisatellite soil moisture CDR as the result of changing observing systems. Inhomogeneities are detected at up to 24% of the tested pixels with spatial extent varying with satellite changeover times. Nevertheless, the contiguous periods without inhomogeneities at changeover times are generally longer than 10 years. Although the inhomogeneities have measurable impact on the derived trends, these trends are similar to those observed in ground data and land surface reanalysis, with an average error less than 0.003 m 3 m −3 y −1. These results strengthen the basis of using the product for long-term studies and demonstrate the necessity of homogeneity testing of multisatellite CDRs in general.

Remote sensing of soil moisture has reached a level of maturity and accuracy for which the retrieved products can be used to improve hydrological and meteorological applications. In this study, the soil moisture product from the Soil Moisture and Ocean Salinity (SMOS) satellite is used for improving satellite rainfall estimates obtained from the Tropical Rainfall Measuring Mission multi-satellite precipitation analysis product (TMPA) using three different “bottom up” techniques: SM2RAIN, SMART and API-mod. The implementation of these techniques aims at improving the well-known “top down” rainfall estimate derived from TMPA products (version 7) available in near real time. Ground observations provided by the Australian Water Availability Project (AWAP) are considered as a separate validation dataset. The three algorithms are calibrated against the gauge-corrected TMPA re-analysis product, 3B42, and used for adjusting the TMPA real-time product, 3B42RT, using SMOS soil moisture data. The study area covers the entire Australian continent and the analysis period ranges from January 2010 to November 2013. Results show that all the SMOS-based rainfall products improve the performance of 3B42RT, even at daily time scale (differently from previous investigations). The major improvements are obtained in terms of estimation of accumulated rainfall with a reduction of the root mean square error of more than 25%. Also in terms of temporal dynamic (correlation) and rainfall detection (categorical scores) the SMOS-based products provide slightly better results with respect to 3B42RT, even though the relative performance between the methods is not always the same. The strengths and weaknesses of each algorithm and the spatial variability of their performances are identified in order to indicate the ways forward for this promising research activity. Results show that the integration of “bottom up” and “top down” approaches has the potential to improve the quality of near real-time rainfall estimates from remote sensing in the near future.