Search

This work examines the diurnal and seasonal variability of near-surface temperature and humidity at several large areas with high population density within the Maritime Continent using the Bureau of Meteorology Atmospheric Regional Reanalysis (BARRA) 12-km-resolution dataset that covers the period 1990–2019. The diurnal cycle is examined in detail, with a key feature being the relatively small diurnal variation of the wet-bulb temperature TWB when compared with the temperature and dewpoint temperature TD. The diurnal variability is strongly modulated by the monsoons with their increased rainfall and cloud cover. The near-surface signals associated with the Madden–Julian oscillation across the domains are relatively weak. Dry and humid temperature extremes are examined for regional and seasonal variability. The dry and moist variable extremes occur at different times of year, but each have spatially coherent structure. Significance Statement This paper examines the climatological variations of near-surface temperature and humidity and their extremes in four locations in the “Maritime Continent.” This is important because there are significant variations potentially affecting human and ecosystem health and its resilience to climate change.

Reanalyses are important tools for understanding past weather and climate variability, but detailed verification of near surface humidity variables have not been published. This is particularly concerning in tropical regions where humid conditions impact meteorology and human activities. In this study, we used screen level temperature and humidity data from a high-resolution atmospheric regional reanalysis, the Bureau of Meteorology Atmospheric high-resolution Regional Reanalysis for Australia (BARRA), validated against automatic weather stations (AWS) data for 32 sites across northern Australia. Overall, the BARRA data was reliable, with the time series from the AWS and BARRA being very highly correlated, but there were some seasonal and diurnally varying biases. The variability of the differences also changed from location to location and as a function of time of day and season, but much less than the biases. This variability was less than the ‘weather signal’ as evidenced by the high correlations. In particular, the amplitude of the diurnal cycle was overestimated, particularly in the dry (winter) season. In general, the differences in temperature were larger than those of the dew point temperature, and the wet bulb temperature had the least uncertainty. Overall, this study contributes to a better understanding of the effectiveness of reanalyses for examining the impact of moist variables on tropical climate variability.

The European Space Agency’s Climate Change Initiative (ESA CCI) Soil Moisture (SM) COMBINED product is a more than 40-year-long data record on global SM for climate studies and applications. It merges SM observations derived from multiple active and passive satellite remote sensing instruments in the microwave domain. Differences in sensor characteristics (such as frequency or polarization) can cause structural breaks in the product, which are not completely removed during the merging process. These artificially caused discontinuities can adversely affect studies using the long-term data set. In this article, we compare three adjustment methods in terms of reducing the number of detected breaks in the SM record. We investigate their impact on the data with multiple validation metrics. Their potential (negative) influence is examined by comparing trends in the data before and after homogenization. We find that all three presented methods can reduce the number of detected breaks in ESA CCI SM. Differences between the methods mainly concern their ability to handle inhomogeneities in variance. Evaluation of the corrected data shows the limited impact of homogenization in terms of quantitative validation metrics. Changes in SM trends due to removing breaks are found in some areas. We find that break correction overall improves the already rather homogeneous data set while preserving its climate describing characteristics. Quantile category matching is identified as the preferred method in terms of correcting breaks in ESA CCI SM.

Regional reanalyses provide a dynamically consistent recreation of past weather observations at scales useful for local-scale environmental applications. The development of convection-permitting models (CPMs) in numerical weather prediction has facilitated the creation of kilometre-scale (1–4 km) regional reanalysis and climate projections. The Bureau of Meteorology Atmospheric high-resolution Regional Reanalysis for Australia (BARRA) also aims to realize the benefits of these high-resolution models over Australian sub-regions for applications such as fire danger research by nesting them in BARRA's 12 km regional reanalysis (BARRA-R). Four midlatitude sub-regions are centred on Perth in Western Australia, Adelaide in South Australia, Sydney in New South Wales (NSW), and Tasmania. The resulting 29-year 1.5 km downscaled reanalyses (BARRA-C) are assessed for their added skill over BARRA-R and global reanalyses for near-surface parameters (temperature, wind, and precipitation) at observation locations and against independent 5 km gridded analyses. BARRA-C demonstrates better agreement with point observations for temperature and wind, particularly in topographically complex regions and coastal regions. BARRA-C also improves upon BARRA-R in terms of the intensity and timing of precipitation during the thunderstorm seasons in NSW and spatial patterns of sub-daily rain fields during storm events. BARRA-C reflects known issues of CPMs: overestimation of heavy rain rates and rain cells, as well as underestimation of light rain occurrence. As a hindcast-only system, BARRA-C largely inherits the domain-averaged bias pattern from BARRA-R but does produce different climatological extremes for temperature and precipitation. An added-value analysis of temperature and precipitation extremes shows that BARRA-C provides additional skill over BARRA-R when compared to gridded observations. The spatial patterns of BARRA-C warm temperature extremes and wet precipitation extremes are more highly correlated with observations. BARRA-C adds value in the representation of the spatial pattern of cold extremes over coastal regions but remains biased in terms of magnitude.

The Bureau of Meteorology Atmospheric high-resolution Regional Reanalysis for Australia (BARRA) is the first atmospheric regional reanalysis over a large region covering Australia, New Zealand, and Southeast Asia. The production of the reanalysis with approximately 12 km horizontal resolution – BARRA-R – is well underway with completion expected in 2019. This paper describes the numerical weather forecast model, the data assimilation methods, the forcing and observational data used to produce BARRA-R, and analyses results from the 2003–2016 reanalysis. BARRA-R provides a realistic depiction of the meteorology at and near the surface over land as diagnosed by temperature, wind speed, surface pressure, and precipitation. Comparing against the global reanalyses ERA-Interim and MERRA-2, BARRA-R scores lower root mean square errors when evaluated against (point-scale) 2 m temperature, 10 m wind speed, and surface pressure observations. It also shows reduced biases in daily 2 m temperature maximum and minimum at 5 km resolution and a higher frequency of very heavy precipitation days at 5 and 25 km resolution when compared to gridded satellite and gauge analyses. Some issues with BARRA-R are also identified: biases in 10 m wind, lower precipitation than observed over the tropical oceans, and higher precipitation over regions with higher elevations in south Asia and New Zealand. Some of these issues could be improved through dynamical downscaling of BARRA-R fields using convective-scale ( km) models.

The high spatio-temporal variability of precipitation is often difficult to characterise due to limited measurements. The available low-resolution global reanalysis datasets inadequately represent the spatio-temporal variability of precipitation relevant to catchment hydrology. The Bureau of Meteorology Atmospheric high-resolution Regional Reanalysis for Australia (BARRA) provides a high-resolution atmospheric reanalysis dataset across the Australasian region. For hydrometeorological applications, however, it is essential to properly evaluate the sub-daily precipitation from this reanalysis. In this regard, this paper evaluates the sub-daily precipitation from BARRA for a period of 6 years (2010–2015) over Australia against point observations and blended radar products. We utilise a range of existing and bespoke metrics for evaluation at point and spatial scales. We examine bias in quantile estimates and spatial displacement of sub-daily rainfall at a point scale. At a spatial scale, we use the Fractions Skill Score as a spatial evaluation metric. The results show that the performance of BARRA precipitation depends on spatial location with poorer performance in tropical relative to temperate regions. A possible spatial displacement during large rainfall is also found at point locations. This displacement, evaluated by comparing the distribution of rainfall within a day, could be quantified by considering the neighbourhood grids. On spatial evaluation, hourly precipitation from BARRA are found to be skilful at a spatial scale of less than 100 km (150 km) for a threshold of 75 % quantile (90 % quantile) at most of the locations. The performance across all the metrics improves significantly at time resolutions higher than 3 h. Our evaluations illustrate that the BARRA precipitation, despite discernible spatial displacements, serves as a useful dataset for Australia, especially at sub-daily resolutions. Users of BARRA are recommended to properly account for possible spatio-temporal displacement errors, especially for applications where the spatial and temporal characteristics of rainfall are deemed very important.

An accurate temporal and spatial characterization of errors is required for the efficient processing, evaluation, and assimilation of remotely-sensed surface soil moisture retrievals. However, empirical evidence exists that passive microwave soil moisture retrievals are prone to periodic artifacts which may complicate their application in data assimilation systems (which commonly treat observational errors as being temporally white). In this paper, the link between such temporally-periodic errors and spatial land surface heterogeneity is examined. Both the synthetic experiment and site-specified cases reveal that, when combined with strong spatial heterogeneity, temporal periodicity in satellite sampling patterns (associated with exact repeat intervals of the polar-orbiting satellites) can lead to spurious high frequency spectral peaks in soil moisture retrievals. In addition, the global distribution of the most prominent and consistent 8-day spectral peak in the Advanced Microwave Scanning Radiometer – Earth Observing System soil moisture retrievals is revealed via a peak detection method. Three spatial heterogeneity indicators – based on microwave brightness temperature, land cover types, and long-term averaged vegetation index – are proposed to characterize the degree to which the variability of land surface is capable of inducing periodic error into satellite-based soil moisture retrievals. Regions demonstrating 8-day periodic errors are generally consistent with those exhibiting relatively higher heterogeneity indicators. This implies a causal relationship between spatial land surface heterogeneity and temporal periodic error in remotely-sensed surface soil moisture retrievals.

Real-time de-noising of satellite-derived soil moisture observations presents opportunities to deliver more accurate and timely satellite data for direct satellite users. So far, the most commonly used techniques for reducing the impact of noise in the retrieved satellite soil moisture observations have been based on moving average filters and Fourier based methods. This paper introduces a new alternative wavelet based approach called Wiener-Wavelet-Based Filter (WiW), which uses an entropy based de-noising method to design a causal version of the filter. WiW is used as a post-retrieval processing tool to enhance the quality of observations derived from one active (the Advanced Scatterometer, ASCAT) and one passive (the Advanced Microwave Scanning Radiometer for Earth Observing System, AMSRE) satellite sensors. The filter is then compared with two candidate de-noising techniques, namely: i) a Wiener causal filter introduced by Su et al. (2013) and ii) a conventional moving average filter. The validation is carried out globally at 173 (for AMSRE) and 243 (for ASCAT) soil moisture stations. Results show that all the three de-noising techniques can increase the agreement between satellite and in situ measurements in terms of correlation and signal-to-noise ratio. The Wiener-based methods show least signal distortion and demonstrate to be conservative in retaining the signal information in de-noised data. Importantly, the Wiener filters can be calibrated with the data at hand, without the need for auxiliary data.

Due to the limited availability of discharge data in many catchments globally, it is important to develop a calibration method that does not rely solely on discharge data. Motivated by this limitation, two calibration approaches using water level data directly in hydrological calibrations are proposed in the study. The first is a Spearman Rank correlation (SRC) based scheme, which calibrates modelled streamflow against observed water level using Spearman Rank correlation. The second is an Inverse Rating Curve (IRC) function based scheme, which introduces three more parameters to simulate water level from an inverse rating curve. The new approaches are tested in 11 catchments in Australia and the resulting discharge predictions show good correlation with observations. However, the results present large biases between observations and estimated discharge data due to the inherent limitation of the approach: absence of information on the true discharge range in the calibration process. To mitigate the biases, the magnitude-sensitive SRC/IRC-based schemes that incorporate a small number of observations are developed in this study. The bias issue is then mitigated significantly, but the improvement is not consistent throughout the examined catchments. One of the most critical challenges of the bias correction is that the whole dynamic range of discharge is constrained by a few observed discharge data, but overall, the new calibration approaches using only water level data prove to be promising.

The Advanced Microwave Scanning Radiometer 2 (AMSR2), a follow-up microwave sensor to the AMSR for Earth Observing System (AMSR-E), was launched on the Global Change Observation Mission 1 – Water (GCOM-W1) satellite in May 2012. It is as yet unclear if instrumental improvements in AMSR2 over AMSR-E have led to better soil moisture (SM) estimates, especially since there is no overlapping period of data between the sensors. This study focuses on comparing the results of AMSR2 and AMSR-E SM over Australia, distinguishing four Koppen climate zones to determine if AMSR2 is better than AMSR-E. This is achieved by selecting two year-long comparative time periods from the operating periods of AMSR-E and AMSR2, based on their statistical similarities in modeled SM as a proxy, using Modern Era Retrospective-analysis for Research and Applications-Land (MERRA-L). The AMSR2 and AMSR-E C- and X-band SM derived from the Land Parameter Retrieval Model (LPRM) was evaluated. Both AMSR2 C- and X-band SM products were found to show similar temporal patterns and spatial agreement with AMSR-E C- and X-band SM, supported by unbiased root mean square difference (ubRMSD) and R-values with MERRA-L SM, respectively. Using lag-based instrumental variable analysis to estimate the random error component of SM retrievals, the noise-to-signal ratios in AMSR2 X-band SM were found to be slightly higher than their AMSR-E counterparts. The improvements in AMSR2, such as the superior radiometric sensitivity and spatial resolution, have therefore not led to statistically significant differences in performance for LPRM retrievals at 1/2° × 1/2° grid resolution, when compared with AMSR-E. However, similarities in the metrics for AMSR2 and AMSR-E SM suggest that AMSR2 provides a valuable continuation to AMSR-E.

An accurate representation of spatio-temporal characteristics of precipitation fields is fundamental for many hydro-meteorological analyses but is often limited by the paucity of gauges. Reanalysis models provide systematic methods of representing atmospheric processes to produce datasets of spatio-temporal precipitation estimates. The precipitation from the reanalysis datasets should, however, be evaluated thoroughly before use because it is inferred from physical parameterization. In this paper, we evaluated the precipitation dataset from the Bureau of Meteorology Atmospheric high-resolution Regional Reanalysis for Australia (BARRA) and compared it against (a) gauged point observations, (b) an interpolated gridded dataset based on gauged point observations (AWAP), and (c) a global reanalysis dataset (ERA-Interim). We utilized a range of evaluation metrics such as continuous metrics (correlation, bias, variability, modified Kling-Gupta efficiency), categorical metrics, and other statistics (wet day frequency, transition probabilities and quantiles) to ascertain the quality of the dataset. BARRA, in comparison with ERA-Interim, shows a better representation of rainfall of larger magnitude at both point and grid scale of 5 km. BARRA also consistently reproduces the distribution of wet days and transition probabilities. The performance of BARRA varies spatially, with better performance in the temperate zone than in the arid and tropical zones. A point-to-grid evaluation based on correlation, bias and modified Kling-Gupta efficiency (KGE') indicates that ERA-Interim performs on par or better than BARRA. However, on a spatial scale, BARRA outperforms AWAP in terms of KGE' score and the components of the KGE' score. Our evaluation illustrates that BARRA, with richer spatial variations in climatology of daily precipitation, provides an improved representation of precipitation compared with the coarser ERA-Interim. It is a useful complement to existing precipitation datasets for Australia, especially in sparsely gauged regions.

For Earth observation data to be useful for a wide range of land surface applications, a kilometer or finer resolution is required. Unfortunately, passive microwave observations at low microwave frequencies (1-10 GHz), already providing important information on soil moisture and vegetation dynamics, are generally only available at a resolution of tens of kilometers. This letter presents a new downscaling method relating L-band radiometer and C-band radar observations for downscaling purposes. The data were obtained from two extensive airborne field experiments across a 80 000-km2 catchment in south-eastern Australia and coinciding Envisat Advanced Synthetic Aperture Radar acquisitions, performed during the Austral summer and spring of 2010. The novel approach of this study is in the downscaling of coarse-scale emissivities as observed by the radiometer with a new interpretation of the change detection methodology for the radar signal to relate the spatiotemporal changes of those two types of observations at 1 km. It is shown that, for most land surface conditions, a good spatial representation at high resolution is achieved, without considering land surface specific parameterizations, which is promising for using very high resolution radar data from the Sentinel-1 platform for downscaling of passive microwave data from current missions, such as National Aeronautics and Space Administration's Soil Moisture Active Passive and European Space Agency's SMOS.

Soil moisture is one of the essential climate variables for the Global Climate Observing System (GCOS) that has been prioritized by the ESA's Climate Change Initiative to construct its homogeneous long-term climate record. This requires a consistent characterization of the error structures in the individual data sets, which vary due to changes in instrument configuration and calibration, and retrieval algorithm design. In this paper, the random error and systematic differences in nine passive and active microwave satellite soil moisture products over Australia (time coverage: 1978–present) are estimated in a same manner for SM components at subseasonal and seasonal-to-interannual timescales separately. The multi-scale error structures are found to be non-trivial and vary between the products, giving cause for conducting multi-scale merging with awareness of these differences. Noticeable similarities between the error structures of the satellite products derived from same retrieval algorithm and same measuring frequency however suggest transferability of error parameters between them. Using partial rank correlation analysis, the error maps are linked to statistics on vegetation index, digital elevation, soil moisture and soil temperature, and land cover fractions and mixing in order to explain the observed variability and the similarities between the products.

Estimation of baseflow from streamflow hydrographs has been a major challenge in hydrology for decades, leading to developments of baseflow separation filters. When without tracer or groundwater data to calibrate the filters, the standard approach to apply these filters in practice involves some degrees of subjectivity in choosing the filter parameters. This paper investigates the use of signature-based calibration in implementing baseflow filtering by testing seven possible hydrological signatures of baseflow against modelled daily baseflow produced by Li et al. [2014] for a range of synthetic catchments simulated with HydroGeoSphere. Our evaluation demonstrates that such a calibration method with few selected signatures as objectives is capable of calibrating a filter - Eckhardt filter - to yield satisfactory baseflow estimates at daily, monthly and long-term time scales, outperforming the standard approach. The best performing signatures can be readily derived from streamflow timeseries. While their performance depends on the catchment characteristics, the catchments where the signature method performs can be distinguished using commonly-used descriptors of flow dynamics. This article is protected by copyright. All rights reserved.

This paper explores the use of active and passive microwave satellite soil moisture products for improving streamflow prediction within four large (>5000km2) semiarid catchments in Australia. We use the probability distributed model (PDM) under a data-scarce scenario and aim at correcting two key controlling factors in the streamflow generation: the rainfall forcing data and the catchment wetness condition. The soil moisture analysis rainfall tool (SMART) is used to correct a near real-time satellite rainfall product (forcing correction scheme) and an ensemble Kalman filter is used to correct the PDM soil moisture state (state correction scheme). These two schemes are combined in a dual correction scheme and we assess the relative improvements of each. Our results demonstrate that the quality of the satellite rainfall product is improved by SMART during moderate-to-high daily rainfall events, which in turn leads to improved streamflow prediction during high flows. When employed individually, the soil moisture state correction scheme generally outperforms the rainfall correction scheme, especially for low flows. Overall, the combined dual correction scheme further improves the streamflow predictions (reduction in root mean square error and false alarm ratio, and increase in correlation coefficient and Nash-Sutcliffe efficiency). Our results provide new evidence of the value of satellite soil moisture observations within data-scarce regions. We also identify a number of challenges and limitations within the schemes.

Recursive digital filters (RDFs) are widely used for estimating base flow from streamflow hydrographs, and various forms of RDFs have been developed based on different physical models. Numerical experiments have been used to objectively evaluate their performance, but they have not been sufficiently comprehensive to assess a wide range of RDFs. This paper extends these studies to understand the limitations of a generalized RDF method as a pathway for future field calibration. Two formalisms are presented to generalize most existing RDFs, allowing systematic tuning of their complexity. The RDFs with variable complexity are evaluated collectively in a synthetic setting, using modeled daily base flow produced by Li et al. (2014) from a range of synthetic catchments simulated with HydroGeoSphere. Our evaluation reveals that there are optimal RDF complexities in reproducing base flow simulations but shows that there is an inherent physical inconsistency within the RDF construction. Even under the idealized setting where true base flow data are available to calibrate the RDFs, there is persistent disagreement between true and estimated base flow over catchments with small base flow components, low saturated hydraulic conductivity of the soil and larger surface runoff. The simplest explanation is that low base flow “signal” in the streamflow data is hard to distinguish, although more complex RDFs can improve upon the simpler Eckhardt filter at these catchments.

The error characterization of soil moisture products, for example, obtained from microwave remote sensing data, is a key requirement for using these products in applications like numerical weather prediction. The error variance and root-mean-square error are among the most popular metrics: they can be estimated consistently for three datasets using triple collocation (TC) without assuming any dataset to be free of errors. This technique can account for additive and multiplicative biases; that is, it assumes that the three products are linearly related. However, its susceptibility to nonlinear relations (e.g., due to sensor saturation and scale mismatch) has not been addressed. Here, a simulation study investigates the impact of quadratic relations on the TC error estimates [also when the products are first rescaled using the nonlinear cumulative distribution function (CDF) matching technique] and on those by two novel methods. These methods—based on error-in-variables regression and probabilistic factor analysis—extend standard TC by also accounting for nonlinear relations using quadratic polynomials. The relative differences between the error estimates of the ASCAT remotely sensed product by the quadratic and the linear methods are predominantly smaller than 10% in a case study based on remotely sensed, reanalysis, and in situ measured soil moisture over the contiguous United States. Exceptions with larger discrepancies indicate that nonlinear relations can pose a challenge to traditional TC analyses, as the simulations show they can introduce biases of either sign. In such cases, the use of nonlinear methods may complement traditional approaches for the error characterization of soil moisture products.

To date, triple collocation (TC) analysis is one of the most important methods for the global-scale evaluation of remotely sensed soil moisture data sets. In this study we review existing implementations of soil moisture TC analysis as well as investigations of the assumptions underlying the method. Different notations that are used to formulate the TC problem are shown to be mathematically identical. While many studies have investigated issues related to possible violations of the underlying assumptions, only few TC modifications have been proposed to mitigate the impact of these violations. Moreover, assumptions, which are often understood as a limitation that is unique to TC analysis are shown to be common also to other conventional performance metrics. Noteworthy advances in TC analysis have been made in the way error estimates are being presented by moving from the investigation of absolute error variance estimates to the investigation of signal-to-noise ratio (SNR) metrics. Here we review existing error presentations and propose the combined investigation of the SNR (expressed in logarithmic units), the unscaled error variances, and the soil moisture sensitivities of the data sets as an optimal strategy for the evaluation of remotely-sensed soil moisture data sets.

Global soil moisture records are essential for studying the role of hydrologic processes within the larger earth system. Various studies have shown the benefit of assimilating satellite-based soil moisture data into water balance models or merging multisource soil moisture retrievals into a unified data set. However, this requires an appropriate parameterization of the error structures of the underlying data sets. While triple collocation (TC) analysis has been widely recognized as a powerful tool for estimating random error variances of coarse-resolution soil moisture data sets, the estimation of error cross covariances remains an unresolved challenge. Here we propose a method—referred to as extended collocation (EC) analysis—for estimating error cross-correlations by generalizing the TC method to an arbitrary number of data sets and relaxing the therein made assumption of zero error cross-correlation for certain data set combinations. A synthetic experiment shows that EC analysis is able to reliably recover true error cross-correlation levels. Applied to real soil moisture retrievals from Advanced Microwave Scanning Radiometer-EOS (AMSR-E) C-band and X-band observations together with advanced scatterometer (ASCAT) retrievals, modeled data from Global Land Data Assimilation System (GLDAS)-Noah and in situ measurements drawn from the International Soil Moisture Network, EC yields reasonable and strong nonzero error cross-correlations between the two AMSR-E products. Against expectation, nonzero error cross-correlations are also found between ASCAT and AMSR-E. We conclude that the proposed EC method represents an important step toward a fully parameterized error covariance matrix for coarse-resolution soil moisture data sets, which is vital for any rigorous data assimilation framework or data merging scheme.

The correct interpretation of ensemble information obtained from the parallel implementation of multiple land surface models (LSMs) requires information concerning the LSM ensemble's mutual error covariance. Here we propose a technique for obtaining such information using an instrumental variable (IV) regression approach and comparisons against a long-term surface soil moisture data set acquired from satellite remote sensing. Application of the approach to multimodel ensemble soil moisture output from Phase 2 of the North American Land Data Assimilation System (NLDAS-2) and European Space Agency (ESA) Soil Moisture (SM) Essential Climate Variable (ECV) data set allows for the calculation of optimal weighting coefficients for individual members of the NLDAS-2 LSM ensemble and a biased-minimized estimate of uncertainty in a deterministic soil moisture analysis derived via optimal averaging. As such, it provides key information required to accurately condition soil moisture expectations using information gleaned from a multimodel LSM ensemble. However, existing continuity and rescaling concerns surrounding the generation of long-term, satellite-based soil moisture products must likely be resolved before the proposed approach can be applied with full confidence.

Assimilation of remotely sensed soil moisture data (SM-DA) to correct soil water stores of rainfall-runoff models has shown skill in improving streamflow prediction. In the case of large and sparsely monitored catchments, SM-DA is a particularly attractive tool. Within this context, we assimilate satellite soil moisture (SM) retrievals from the Advanced Microwave Scanning Radiometer (AMSR-E), the Advanced Scatterometer (ASCAT) and the Soil Moisture and Ocean Salinity (SMOS) instrument, using an Ensemble Kalman filter to improve operational flood prediction within a large (> 40 000 km2) semi-arid catchment in Australia. We assess the importance of accounting for channel routing and the spatial distribution of forcing data by applying SM-DA to a lumped and a semi-distributed scheme of the probability distributed model (PDM). Our scheme also accounts for model error representation by explicitly correcting bias in soil moisture and streamflow in the ensemble generation process, and for seasonal biases and errors in the satellite data. Before assimilation, the semi-distributed model provided a more accurate streamflow prediction (Nash–Sutcliffe efficiency, NSE = 0.77) than the lumped model (NSE = 0.67) at the catchment outlet. However, this did not ensure good performance at the "ungauged" inner catchments (two of them with NSE below 0.3). After SM-DA, the streamflow ensemble prediction at the outlet was improved in both the lumped and the semi-distributed schemes: the root mean square error of the ensemble was reduced by 22 and 24%, respectively; the false alarm ratio was reduced by 9% in both cases; the peak volume error was reduced by 58 and 1%, respectively; the ensemble skill was improved (evidenced by 12 and 13% reductions in the continuous ranked probability scores, respectively); and the ensemble reliability was increased in both cases (expressed by flatter rank histograms). SM-DA did not improve NSE. Our findings imply that even when rainfall is the main driver of flooding in semi-arid catchments, adequately processed satellite SM can be used to reduce errors in the model soil moisture, which in turn provides better streamflow ensemble prediction. We demonstrate that SM-DA efficacy is enhanced when the spatial distribution in forcing data and routing processes are accounted for. At ungauged locations, SM-DA is effective at improving some characteristics of the streamflow ensemble prediction; however, the updated prediction is still poor since SM-DA does not address the systematic errors found in the model prior to assimilation.

Remote sensing, in situ networks and models are now providing unprecedented information for environmental monitoring. To conjunctively use multi-source data nominally representing an identical variable, one must resolve biases existing between these disparate sources, and the characteristics of the biases can be non-trivial due to spatio-temporal variability of the target variable, inter-sensor differences with variable measurement supports. One such example is of soil moisture (SM) monitoring. Triple collocation (TC) based bias correction is a powerful statistical method that is increasingly being used to address this issue, but is only applicable to the linear regime, whereas the non-linear method of statistical moment matching is susceptible to unintended biases originating from measurement error. Since different physical processes that influence SM dynamics may be distinguishable by their characteristic spatio-temporal scales, we propose a multi-timescale linear bias model in the framework of a wavelet-based multi-resolution analysis (MRA). The joint MRA-TC analysis was applied to demonstrate scale-dependent biases between in situ, remotely sensed and modelled SM, the influence of various prospective bias correction schemes on these biases, and lastly to enable multi-scale bias correction and data-adaptive, non-linear de-noising via wavelet thresholding.

Error characterisation of satellite-retrieved soil moisture (SM) is crucial for maximizing their utility in research and applications in hydro-meteorology and climatology. It can provide insights for retrieval development and validation, and inform suitable strategies for data fusion and assimilation. Su et al. (2013a) proposed a potential Fourier method for quantifying the errors based on the difference between the empirical power spectra of these SM data and a water balance model via spectral fitting (SF), circumventing the need for any ancillary data. This work first evaluates its utility by estimating the errors in two passive and active microwave satellite SM over Australia, and comparing the results against the triple collocation (TC) estimator. The SF estimator shows very good agreement with TC in terms of error standard deviation and signal-to-noise ratio, with strong linear correlations of 0.80–0.92 but with lower error estimates. As the two estimators are not strictly comparable, their strong agreement suggests a strong complementarity between time-domain and frequency-domain analyses of errors. A better understanding of the spectral characteristics of the error is still needed to understand their differences. Next, spatial analyses of the derived (SF and TC) error maps, in terms of error standard deviation and noise-to-signal ratio, for the two satellite data are performed with principal component analysis to identify influence of vegetation/leaf-area index (LAI), rainfall, soil wetness, and spatial heterogeneity in topography and soil type on retrieval errors. Lastly, seasonal analysis of the errors discovers systematic temporal variability in errors due to variability in rainfall amount, and less so with changing LAI.

Triple collocation (TC) is routinely used to resolve approximated linear relationships between different measurements (or representations) of a geophysical variable that are subject to errors. It has been utilized in the context of calibration, validation, bias correction, and error characterization to allow comparisons of diverse data records from various direct and indirect measurement techniques including in situ remote sensing and model-based approaches. However, successful applications of TC require sufficiently large numbers of coincident data points from three independent time series and, within the analysis period, homogeneity of their linear relationships and error structures. These conditions are difficult to realize in practice due to infrequent spatiotemporal sampling of satellite and ground-based sensors. TC can, however, be generalized within the framework of instrumental variable (IV) regression theory to address some of the conceptual constraints of TC. We review the theoretics of IV and consider one possible strategy to circumvent the three-data constraint by use of lagged variables (LV) as instruments. This particular implementation of IV is suitable for circumstances where multiple data records are limited and the geophysical variable of interest is sampled at time intervals shorter than its temporal correlation length. As a demonstration of utility, the LV method is applied to microwave satellite soil moisture data sets to recover their errors over Australia and to estimate temporal properties of their relationships with in situ and model data. These results are compared against standard two-data linear estimators and the TC estimator as benchmark.

[1] Satellite microwave retrievals and in situ measurements of surface soil moisture are usually compared in the time domain. This paper examines their differences in the conjugate frequency domain to develop a spectral description of the satellite data, suggesting the presence of stochastic random and systematic periodic errors. Based on a semiempirical model of the observed power spectral density, we describe systematic designs of causal and noncausal filters to remove these erroneous signals. The filters are applied to the retrievals from active and passive satellite sensors and evaluated against field data from the Murrumbidgee Basin, southeast Australia, to show substantive increase in linear correlations.

The use of satellite-based soil moisture retrievals for hydrologic, meteorological and climatological applications is advancing significantly due to increasing capability and temporal coverage of current and future missions. Characterisation of the relative skill of soil moisture products from different satellite sensors on a common spatial grid is crucial to achieve synergetic applications. This paper therefore evaluates three soil moisture products from AMSR-E (Advanced Microwave Scanning Radiometer — Earth Observing System), ASCAT (Advanced Scatterometer) and SMOS (Soil Moisture and Ocean Salinity) in absolute soil moisture units and on a common grid, against in-situ observations from southeast Australia. Before renormalisation, the three products yield correlations of 0.63–0.71 and a similar root-mean-square difference (RMSD) in the order of 0.1 m3 m− 3, although showing different levels of error contributions from bias, variance and correlations. The results are compared with land and precipitation data to investigate the sensitivity of their errors to land surface features. Three renormalisation strategies – minimum–maximum matching, mean/standard-deviation (μ–σ) matching and cumulative distribution function (CDF) matching – are considered for correcting systematic differences between ground and satellite data. The renormalised satellite data is found to retain RMSDs of 0.04–0.06 m3 m− 3 on average. The CDF method produces only marginal further improvements to correlations (0.67–0.75) and RMSDs compared to the μ–σ approach. The renormalisations by μ–σ and CDF methods also bring three products into better agreements with each other, but lead to strong correlations between RMSD and the dynamic range of in-situ soil moisture.

International audience; Climate Data Records (CDR) that blend multiple satellite products are invaluable for climate studies, trend analysis and risk assessments. Knowledge of any inhomogeneities in the CDR is therefore critical for making correct inferences. This work proposes a methodology to identify the spatiotemporal extent of the inhomogeneities in a 36 year, global multisatellite soil moisture CDR as the result of changing observing systems. Inhomogeneities are detected at up to 24% of the tested pixels with spatial extent varying with satellite changeover times. Nevertheless, the contiguous periods without inhomogeneities at changeover times are generally longer than 10 years. Although the inhomogeneities have measurable impact on the derived trends, these trends are similar to those observed in ground data and land surface reanalysis, with an average error less than 0.003 m 3 m −3 y −1. These results strengthen the basis of using the product for long-term studies and demonstrate the necessity of homogeneity testing of multisatellite CDRs in general.

Active and passive microwave satellite remote sensing are enabling sub-daily global observations of surface soil moisture (SM) for hydrological, meteorological and climatological studies. Because the retrieved SM data can be quite noisy, post-retrieval processing such as de-noising can play an important role to aid interpretation of the observed dynamics or enhance their utility for data assimilation. To date, the merits of such techniques have not yet been fully evaluated. Here we consider the applications of Fourier-based de-noising filters of Su et al. (2013a) for improving SM retrieved by AMSR-E (Advanced Microwave Scanning Radiometer for Earth Observing System) and ASCAT (Advanced Scatterometer of MetOp-A) sensors. The filters are calibrated in the frequency domain based on a water-balance model, without the need for ancillary data. The evaluation of the de-noising methods was conducted globally against in situ data distributed via the International Soil Moisture Network (ISMN) at 277 AMSR-E and 385 ASCAT pixels. Systematic improvements were found for all considered metrics, namely root-mean-square deviation, linear correlation and signal-to-noise ratio, for both SM products, with improvements more striking for AMSR-E. However, the originally proposed implementation of the filters can induce undesirable over-smoothing and distortion of SM timeseries. To overcome this, based on a simple heuristic argument, we propose the use of ancillary precipitation data in the filtering process, although at some expense of overall agreements with the in situ data.

The land parameter retrieval model (LPRM) is a methodology that retrieves soil moisture from low frequency dual polarized microwave measurements and has been extensively tested on C-, X- and Ku-band frequencies. Its performance on L-band is tested here by using observations from the Soil Moisture and Ocean Salinity (SMOS) satellite. These observations have potential advantages compared to higher frequencies: a low sensitivity to cloud and vegetation contamination, an increased thermal sampling depth and a greater sensitivity to soil moisture fluctuations. These features make it desirable to add SMOS-derived soil moisture retrievals to the existing European Space Agency (ESA) long-term climatological soil moisture data record, to be harmonized with other passive microwave soil moisture estimates from the LPRM. For multi-channel observations, LPRM infers the effective soil temperature (Teff) from higher frequency channels. This is not possible for a single channel mission like SMOS and therefore two alternative sources for Teff were tested: (1) MERRA-Land and (2) ECMWF numerical weather prediction systems, respectively. SMOS measures brightness temperature at a range of incidence angles, different incidence angle bins (45°, 52.5° and 60°) were tested for both ascending and descending swaths. Three LPRM algorithm parameters were optimized to match remotely sensed soil moisture with ground based observations: the single scattering albedo, roughness and polarization mixing factor. The soil moisture retrievals were optimized and evaluated against ground-based data from the Murrumbidgee Soil Moisture Monitoring Network (OzNet) in southeast Australia. The agreement with single-angle SMOS LPRM retrievals was close to the official SMOS L3 product, provided the three parameters were optimized for the OzNet dataset, with linear correlation of 0.70–0.75 (0.75–0.77 for SMOS L3), root-mean-square error of 0.069–0.085 m3 m− 3 (0.084–0.106 m3 m− 3 for SMOS L3) and small bias of − 0.02–0.01 m3 m− 3 (0.03–0.06 m3 m− 3 for SMOS L3). These results suggest that the LPRM can be applied successfully to single-angle SMOS L-band observations, but further testing is required to determine if the same set of parameters can be used in other geographic areas.

Remote sensing of soil moisture has reached a level of maturity and accuracy for which the retrieved products can be used to improve hydrological and meteorological applications. In this study, the soil moisture product from the Soil Moisture and Ocean Salinity (SMOS) satellite is used for improving satellite rainfall estimates obtained from the Tropical Rainfall Measuring Mission multi-satellite precipitation analysis product (TMPA) using three different “bottom up” techniques: SM2RAIN, SMART and API-mod. The implementation of these techniques aims at improving the well-known “top down” rainfall estimate derived from TMPA products (version 7) available in near real time. Ground observations provided by the Australian Water Availability Project (AWAP) are considered as a separate validation dataset. The three algorithms are calibrated against the gauge-corrected TMPA re-analysis product, 3B42, and used for adjusting the TMPA real-time product, 3B42RT, using SMOS soil moisture data. The study area covers the entire Australian continent and the analysis period ranges from January 2010 to November 2013. Results show that all the SMOS-based rainfall products improve the performance of 3B42RT, even at daily time scale (differently from previous investigations). The major improvements are obtained in terms of estimation of accumulated rainfall with a reduction of the root mean square error of more than 25%. Also in terms of temporal dynamic (correlation) and rainfall detection (categorical scores) the SMOS-based products provide slightly better results with respect to 3B42RT, even though the relative performance between the methods is not always the same. The strengths and weaknesses of each algorithm and the spatial variability of their performances are identified in order to indicate the ways forward for this promising research activity. Results show that the integration of “bottom up” and “top down” approaches has the potential to improve the quality of near real-time rainfall estimates from remote sensing in the near future.