Search

Process-based modelling offers interpretability and physical consistency in many domains of geosciences but struggles to leverage large datasets efficiently. Machine-learning methods, especially deep networks, have strong predictive skills yet are unable to answer specific scientific questions. In this Perspective, we explore differentiable modelling as a pathway to dissolve the perceived barrier between process-based modelling and machine learning in the geosciences and demonstrate its potential with examples from hydrological modelling. ‘Differentiable’ refers to accurately and efficiently calculating gradients with respect to model variables or parameters, enabling the discovery of high-dimensional unknown relationships. Differentiable modelling involves connecting (flexible amounts of) prior physical knowledge to neural networks, pushing the boundary of physics-informed machine learning. It offers better interpretability, generalizability, and extrapolation capabilities than purely data-driven machine learning, achieving a similar level of accuracy while requiring less training data. Additionally, the performance and efficiency of differentiable models scale well with increasing data volumes. Under data-scarce scenarios, differentiable models have outperformed machine-learning models in producing short-term dynamics and decadal-scale trends owing to the imposed physical constraints. Differentiable modelling approaches are primed to enable geoscientists to ask questions, test hypotheses, and discover unrecognized physical relationships. Future work should address computational challenges, reduce uncertainty, and verify the physical significance of outputs.

Learning management systems (LMSs) are ubiquitous components of the academic technology experience for learners across a wide variety of instructional contexts. Learners' interactions within an LMS are often contingent upon how instructors architect a module, course, or program of study. Patterns related to these learner interactions, often referred to as learning analytics implementation (LAI), can be represented by combining system-level LMS data with course-level design decisions to inform more granular insights into learner behaviour. The purpose of this paper is to use the LAI framework, specifically the principles of coordination and comparison (Wise & Vytasek, 2017), to examine how learner interaction patterns associated with LMS-use variables correspond to deliberate learning design decisions and course outcomes for a group of courses in the same undergraduate writing program. Visualizations of learner activity exhibited similar patterns of learner engagement across courses, corroborating the observation that design decisions heavily influence learner behaviour. Predictive analyses demonstrated strong influence of LMS use on final grades while accounting for course instructor. That is, while page views were not related to final grade, the length of discussion entries was often predictive. These results suggest that students who practised writing more -- the main learning objective of this course -- had higher final grades, regardless of variations in instructor and semester.

As droughts have widespread social and ecological impacts, it is critical to develop long-term adaptation and mitigation strategies to reduce drought vulnerability. Climate models are important in quantifying drought changes. Here, we assess the ability of 285 CMIP6 historical simulations, from 17 models, to reproduce drought duration and severity in three observational data sets using the Standardized Precipitation Index (SPI). We used summary statistics beyond the mean and standard deviation, and devised a novel probabilistic framework, based on the Hellinger distance, to quantify the difference between observed and simulated drought characteristics. Results show that many simulations have less than ±10% error in reproducing the observed drought summary statistics. The hypothesis that simulations and observations are described by the same distribution cannot be rejected for more than 80% of the grids based on our H distance framework. No single model stood out as demonstrating consistently better performance over large regions of the globe. The variance in drought statistics among the simulations is higher in the tropics compared to other latitudinal zones. Though the models capture the characteristics of dry spells well, there is considerable bias in low precipitation values. Good model performance in terms of SPI does not imply good performance in simulating low precipitation. Our study emphasizes the need to probabilistically evaluate climate model simulations in order to both pinpoint model weaknesses and identify a subset of best-performing models that are useful for impact assessments.

The Community Land Model (CLM) is the land component of the Community Earth System Model (CESM) and is used in several global and regional modeling systems. In this paper, we introduce model developments included in CLM version 5 (CLM5), which is the default land component for CESM2. We assess an ensemble of simulations, including prescribed and prognostic vegetation state, multiple forcing data sets, and CLM4, CLM4.5, and CLM5, against a range of metrics including from the International Land Model Benchmarking (ILAMBv2) package. CLM5 includes new and updated processes and parameterizations: (1) dynamic land units, (2) updated parameterizations and structure for hydrology and snow (spatially explicit soil depth, dry surface layer, revised groundwater scheme, revised canopy interception and canopy snow processes, updated fresh snow density, simple firn model, and Model for Scale Adaptive River Transport), (3) plant hydraulics and hydraulic redistribution, (4) revised nitrogen cycling (flexible leaf stoichiometry, leaf N optimization for photosynthesis, and carbon costs for plant nitrogen uptake), (5) global crop model with six crop types and time-evolving irrigated areas and fertilization rates, (6) updated urban building energy, (7) carbon isotopes, and (8) updated stomatal physiology. New optional features include demographically structured dynamic vegetation model (Functionally Assembled Terrestrial Ecosystem Simulator), ozone damage to plants, and fire trace gas emissions coupling to the atmosphere. Conclusive establishment of improvement or degradation of individual variables or metrics is challenged by forcing uncertainty, parametric uncertainty, and model structural complexity, but the multivariate metrics presented here suggest a general broad improvement from CLM4 to CLM5.

Accurate discharge values form the foundation of effective water resource planning and management. Unfortunately, these data are often perceived as absolute and deterministic by users, modelers, and decision-makers, despite the inherent subjectivity and uncertainty in the data preparation processes. This study is undertaken to examine the discharge estimation methods used by the Water Survey of Canada (WSC) and their impacts on reported discharge values. First, we explain the hydrometric station network, essential terminologies, and fundamental concepts of rating curves. Subsequently, we examine WSC's standard operating procedures (SOPs), including shift, temporary shift, and override, in discharge estimation. Based on WSC's records of ∼ 1800 active hydrometric stations for discharge monitoring, we evaluated sample rating curves and their correlation with stage and discharge measurement. We investigate under-ice measurements, ice condition periods and frequency, and extreme values in contrast to rating curves. Employing an independent workflow, we demonstrate that 69 % of existing records align with the rating curve and temporary shift concept, while the remaining 31 % follow alternative discharge estimation methods (override). Selected example stations illustrate discharge estimation methods over time. We also demonstrate the impact of override and temporary shifts on commonly assumed uncertainty models. Given the practices of override and temporary shifts within WSC, there is a need to explore innovative methods for discharge uncertainty estimation. We hope our research helps in the critical challenge of estimating and communicating uncertainty in published discharge values. [ABSTRACT FROM AUTHOR]

The diversity in hydrologic models has historically led to great controversy on the "correct" approach to process-based hydrologic modeling, with debates centered on the adequacy of process parameterizations, data limitations and uncertainty, and computational constraints on model analysis. In this paper, we revisit key modeling challenges on requirements to (1) define suitable model equations, (2) define adequate model parameters, and (3) cope with limitations in computing power. We outline the historical modeling challenges, provide examples of modeling advances that address these challenges, and define outstanding research needs. We illustrate how modeling advances have been made by groups using models of different type and complexity, and we argue for the need to more effectively use our diversity of modeling approaches in order to advance our collective quest for physically realistic hydrologic models.

Seasonal streamflow forecasts provide key information for decision-making in fields such as water supply management, hydropower generation, and irrigation scheduling. The predictability of streamflow on seasonal timescales relies heavily on initial hydrological conditions, such as the presence of snow and the availability of soil moisture. In high-latitude and high-altitude headwater basins in North America, snowmelt serves as the primary source of runoff generation. This study presents and evaluates a data-driven workflow for probabilistic seasonal streamflow forecasting in snow-fed river basins across North America (Canada and the USA). The workflow employs snow water equivalent (SWE) measurements as predictors and streamflow observations as predictands. Gap-filling of SWE datasets is accomplished using quantile mapping from neighboring SWE and precipitation stations, and principal component analysis is used to identify independent predictor components. These components are then utilized in a regression model to generate ensemble hindcasts of streamflow volumes for 75 nival basins with limited regulation from 1979 to 2021, encompassing diverse geographies and climates. Using a hindcast evaluation approach that is user-oriented provides key insights for snow-monitoring experts, forecasters, decision-makers, and workflow developers. The analysis presented here unveils a wide spectrum of predictability and offers a glimpse into potential future changes in predictability. Late-season snowpack emerges as a key factor in predicting spring and summer volumes, while high precipitation during the target period presents challenges to forecast skill and streamflow predictability. Notably, we can predict lower-than-normal and higher-than-normal streamflows during spring to early summer with lead times of up to 5 months in some basins. Our workflow is available on GitHub as a collection of Jupyter Notebooks, facilitating broader applications in cold regions and contributing to the ongoing advancement of methodologies. [ABSTRACT FROM AUTHOR]

Recent advances in differentiable modeling, a genre of physics-informed machine learning that trains neural networks (NNs) together with process-based equations, have shown promise in enhancing hydrological models' accuracy, interpretability, and knowledge-discovery potential. Current differentiable models are efficient for NN-based parameter regionalization, but the simple explicit numerical schemes paired with sequential calculations (operator splitting) can incur numerical errors whose impacts on models' representation power and learned parameters are not clear. Implicit schemes, however, cannot rely on automatic differentiation to calculate gradients due to potential issues of gradient vanishing and memory demand. Here we propose a "discretize-then-optimize" adjoint method to enable differentiable implicit numerical schemes for the first time for large-scale hydrological modeling. The adjoint model demonstrates comprehensively improved performance, with Kling–Gupta efficiency coefficients, peak-flow and low-flow metrics, and evapotranspiration that moderately surpass the already-competitive explicit model. Therefore, the previous sequential-calculation approach had a detrimental impact on the model's ability to represent hydrological dynamics. Furthermore, with a structural update that describes capillary rise, the adjoint model can better describe baseflow in arid regions and also produce low flows that outperform even pure machine learning methods such as long short-term memory networks. The adjoint model rectified some parameter distortions but did not alter spatial parameter distributions, demonstrating the robustness of regionalized parameterization. Despite higher computational expenses and modest improvements, the adjoint model's success removes the barrier for complex implicit schemes to enrich differentiable modeling in hydrology. [ABSTRACT FROM AUTHOR]

Lakes and reservoirs are an integral part of the terrestrial water cycle. In this work, we present the implementation of different water balance models of lakes and reservoirs into mizuRoute, a vector‐based routing model, termed mizuRoute‐Lake. As the main advantage of mizuRoute‐Lake, users can choose between various parametric models implemented in mizuRoute‐Lake. So far, three parametric models of lake and reservoir water balance, namely Hanasaki, HYPE, and Döll are implemented in mizuRoute‐Lake. In general, the parametric models relate the outflow from lakes or reservoirs to the storage and various parameters including inflow, demand, volume of storage, etc. Additionally, this flexibility allows users to easily evaluate and compare the effect of various water balance models for a lake without needing to reconfigure the routing model or change the parameters of other lakes or reservoirs in the modeling domain. Users can also use existing data such as historical observations or water management models to specify the behavior of a selected number of lakes and reservoirs within the modeling domain using the data‐driven capability of mizuRoute‐Lake. We demonstrate the flexibility of mizuRoute‐Lake by presenting global, regional, and local scale applications. The development of mizuRoute‐Lake paves the way for better integration of water management models, locally measured, and remotely sensed data sets in the context of Earth system modeling. Plain Language Summary: Lakes and reservoirs impact the hydrological cycle. While there are many lake and reservoir models, a modeling framework typically encompasses a single selected lake and/or reservoir model representation. Including various lake discharge models in one model framework is useful for many applications of water resources. In this study, we present the implementation of various lake and reservoir water balance models in the mizuRoute‐Lake. mizuRoute‐Lake provides the flexibility to use and evaluate different lake and reservoir water balance models in river basins. Such flexibility can facilitate the integration with Earth system models, land surface models, water management models, and in situ or remote sensing observations. Additionally, it can help shed light on often neglected interactions and uncertainties in lake and reservoir models and their parameterizations within the hydrological cycle. Key Points: mizuRoute‐Lake offers the flexibility to select from multiple parametric models for lakes and reservoirs' water balanceUsers can leverage existing data, historical observations, water management models, and remotely sensed data, to specify lake behaviorThe versatility of mizuRoute‐Lake is demonstrated through its application at different scales, global to local [ABSTRACT FROM AUTHOR]

Editors of several journals in the field of hydrology met during the General Assembly of the European Geosciences Union-EGU in Vienna in April 2017. This event was a follow-up of similar meetings held in 2013 and 2015. These meetings enable the group of editors to review the current status of the journals and the publication process, and to share thoughts on future strategies. Journals were represented at the 2017 meeting by their editors, as shown in the list of authors. The main points on invigorating hydrological research through journal publications are communicated in this joint editorial published in the above journals.

Recent advances in differentiable modeling, a genre of physics-informed machine learning that trains neural networks (NNs) together with process-based equations, has shown promise in enhancing hydrologic models' accuracy, interpretability, and knowledge-discovery potential. Current differentiable models are efficient for NN-based parameter regionalization, but the simple explicit numerical schemes paired with sequential calculations (operator splitting) can incur large numerical errors whose impacts on models' representation power and learned parameters are not clear. Implicit schemes, however, cannot rely on automatic differentiation to calculate gradients due to potential issues of gradient vanishing and memory demand. Here we propose a "discretize-then-optimize" adjoint method to enable differentiable implicit numerical schemes for the first time for large-scale hydrologic modeling. The adjoint model demonstrates comprehensively improved performance, with Kling-Gupta efficiency coefficients, peak-flow and low-flow metrics, and evapotranspiration that moderately surpass the already-competitive explicit model. Therefore, the previous sequential-calculation approach had a detrimental impact on the model's ability to represent hydrologic dynamics. Furthermore, with a structural update that describes capillary rise, the adjoint model can better describe baseflow in arid regions and also produce low and peak flows that outperform even pure machine learning methods such as long short-term memory networks. The adjoint model rectified some parameter distortions but did not alter spatial parameter distributions, demonstrating the robustness of regionalized parameterization. Despite higher computational expenses and modest improvements, the adjoint model's success removes the barrier for complex implicit schemes to enrich differentiable modeling in hydrology. [ABSTRACT FROM AUTHOR]

Ensemble geophysical datasets are foundational for research to understand the Earth System in an uncertainty-aware context, and to drive applications that require quantification of uncertainties, such as probabilistic hydro-meteorological estimation or prediction. Yet ensemble estimation is more challenging than single-value spatial interpolation, and open-access routines and tools are limited in this area, hindering the generation and application of ensemble geophysical datasets. A notable exception in the last decade has been the Gridded Meteorological Ensemble Tool (GMET), which is implemented in FORTRAN and has typically been configured for ensemble estimation of precipitation, mean air temperature, and daily temperature range, based on station observations. GMET has been used to generate a variety of local, regional, national and global meteorological datasets, which in turn have driven multiple retrospective and real-time hydrological applications. Motivated by an interest in expanding GMET flexibility, application scope and range of methods, we have developed a Python based Geospatial Probabilistic Estimation Package (GPEP) that offers GMET functionality along with additional methodological and usability improvements, including variable independence and flexibility, an efficient alternative cross validation strategy, internal parallelization, and the availability of the scikit-learn machine learning library for both local and global regression. This paper describes GPEP and illustrates some of its capabilities using several demonstration experiments, including the estimation of precipitation, temperature, and snow water equivalent ensemble analyses on various scales. [ABSTRACT FROM AUTHOR]

Accurate discharge values play a critical role in water resource planning and management. However, it is common for users, modelers, and decision-makers to consider these values as true and deterministic, despite the subjective and uncertain nature of the estimation process. To address the issue, this study was conducted to identify the discharge estimation methods and associated uncertainties of hydrometric measurements in Canada. The study involved an exploration of multiple operating procedures for rating curve construction and discharge estimation across 1800 active Water Survey of Canada (WSC) hydrometric stations using an independent workflow. The first step involved understanding the discharge estimation process used by the WSC and the standard operating procedures (SOP) for inferring discharge from stage measurements. During the implementation of the workflow, it was observed that manual intervention and interpretation by hydrographers were required for time-series sequences labeled as "override" and/or "temporary shift". The workflow demonstrated that 67 % of existing records could be adequately recreated following the rating curve and temporary shift concept, while 33 % followed the other discharge estimation methods (override). Novel methods for discharge uncertainty estimation should be sought given the practices of override and temporary shift by the WSC. This study attempts to reconcile the significant issue of estimating uncertainty in published discharge values, particularly in the context of open science and Earth System modeling. By collaborating with the WSC, this research aims to improve the understanding of the processes used for discharge estimation and promote wider access to metadata and measurements for more accurate uncertainty quantification. [ABSTRACT FROM AUTHOR]

Transitions from university study to graduate work in new industries such as information technology (IT) are not well understood. As the IT industry is a significant recruiter of graduates and an important component of the UK economy, the transition into the IT profession needs to be understood better. In addition, understanding the transition into IT work may contribute to a broader understanding of transitions in the new industries more generally. We focus on three cases selected from a broader longitudinal project and take as our starting point graduates' perspectives on their transitions. We use Bourdieu's conceptions of field, habitus and capital to move beyond existing policy discourses which tend to concentrate exclusively on the qualities of graduates. Specifically, we argue that, to understand transitions we need to focus on the work and the organisational context (field), the habitus of the individual making the transition, and the resources (capital) that individuals may deploy. That is, individual transitions are better understood by considering field, habitus and capital and the interactions between them.