Geology topics

Jeffrey Michael Sadler

Publications and source records attributed to Jeffrey Michael Sadler.

10 recordsLinked to original sources

USGS2022

Near-term forecasts of stream temperature using deep learning and data assimilation in support of management decisions

Deep learning (DL) models are increasingly used to make accurate hindcasts of management-relevant variables, but they are less commonly used in forecasting applications. Data assimilation (DA) can be used for forecasts to leverage real-time observations, where the difference between model predictions and observations today is used to adjust the model to make better predictions tomorrow. In this use case, we developed a process-guided DL and DA approach to make 7-day probabilistic forecasts of daily maximum water temperature in the Delaware River Basin in support of water management decisions. Our modeling system produced forecasts of daily maximum water temperature with an average root mean squared error (RMSE) from 1.1 to 1.4°C for 1-day-ahead and 1.4 to 1.9°C for 7-day-ahead forecasts across all sites. The DA algorithm marginally improved forecast performance when compared with forecasts produced using the process-guided DL model alone (0%–14% lower RMSE with the DA algorithm). Across all sites and lead times, 65%–82% of observations were within 90% forecast confidence intervals, which allowed managers to anticipate probability of exceedances of ecologically relevant thresholds and aid in decisions about releasing reservoir water downstream. The flexibility of DL models shows promise for forecasting other important environmental variables and aid in decision-making.

Journal of the American Water Resources Associatio↗

USGS2022

Can machine learning accelerate process understanding and decision-relevant predictions of river water quality?

The global decline of water quality in rivers and streams has resulted in a pressing need to design new watershed management strategies. Water quality can be affected by multiple stressors including population growth, land use change, global warming, and extreme events, with repercussions on human and ecosystem health. A scientific understanding of factors affecting riverine water quality and predictions at local to regional scales, and at sub-daily to decadal timescales are needed for optimal management of watersheds and river basins. Here, we discuss how machine learning (ML) can enable development of more accurate, computationally tractable, and scalable models for analysis and predictions of river water quality. We review relevant state-of-the art applications of ML for water quality models and discuss opportunities to improve the use of ML for emerging computational and mathematical methods for model selection, hyperparameter optimization, incorporating process knowledge into ML models, improving explainablity, uncertainty quantification, and model-data integration. We then present considerations for using ML to address water quality problems given their scale and complexity, available data and computational resources, and stakeholder needs. When combined with decades of process understanding, interdisciplinary advances in knowledge-guided ML, information theory, data integration, and analytics can help address fundamental science questions and enable decision-relevant predictions of riverine water quality.

Hydrological Processes↗

USGS2022

Machine learning for understanding inland water quantity, quality, and ecology

This chapter provides an overview of machine learning models and their applications to the science of inland waters. Such models serve a wide range of purposes for science and management: predicting water quality, quantity, or ecological dynamics across space, time, or hypothetical scenarios; vetting and distilling raw data for further modeling or analysis; generating and exploring hypotheses; estimating physically or biologically meaningful parameters for use in further modeling; and revealing patterns in complex, multidimensional data or model outputs. An important research frontier is the injection of limnological knowledge into machine-learning models, which has shown great promise for increasing such models’ accuracy, trustworthiness, and interpretability. Here we describe a few of the most powerful machine learning tools, describe best practices for employing these tools and injecting knowledge guidance, and give examples of their applications to advance understanding of inland waters.

Book chapter↗

USGS2022

Multi-task deep learning of daily streamflow and water temperature

Deep learning (DL) models can accurately predict many hydrologic variables including streamflow and water temperature; however, these models have typically predicted hydrologic variables independently. This study explored the benefits of modeling two interdependent variables, daily average streamflow and daily average stream water temperature, together using multi-task DL. A multi-task scaling factor controlled the relative contribution of the auxiliary variable's error to the overall loss during training. Our experiments examined the improvement in prediction accuracy of the multi-task approach using paired streamflow and water temperature data from sites across the conterminous United States. Our results showed that for 56 out of 101 sites, the best performing multi-task models performed better overall than the single-task models in terms of Nash-Sutcliffe efficiency for predicting streamflow with single-site models. For 43 sites, the best multi-task, single-site models made no significant difference in predicting streamflow. The multi-task approach had a smaller effect when applied to a model trained with data from 101 sites together, significantly improving performance for only 17 sites. The multi-task scaling factor was consequential in determining to what extent the multi-task approach was beneficial. A naïve selection of this factor led to significantly worse-performing models for 3 of 101 sites when predicting streamflow as the primary variable, and 47 of 53 sites when predicting stream temperature as the primary variable. We conclude that a multi-task approach can make more accurate predictions by leveraging information from interdependent hydrologic variables, but only for some sites, variables, and model configurations.

Water Resources Research↗

USGS2022

Physics-guided machine learning from simulation data: An application in modeling lake and river systems

This paper proposes a new physics-guided machine learning approach that incorporates the scientific knowledge in physics-based models into machine learning models. Physics-based models are widely used to study dynamical systems in a variety of scientific and engineering problems. Although they are built based on general physical laws that govern the relations from input to output variables, these models often produce biased simulations due to inaccurate parameterizations or approximations used to represent the true physics. In this paper, we aim to build a new data-driven framework to monitor dynamical systems by extracting general scientific knowledge embodied in simulation data generated by the physics-based model. To handle the bias in simulation data caused by imperfect parameterization, we propose to extract general physical relations jointly from multiple sets of simulations generated by a physics-based model under different physical parameters. In particular, we develop a spatio-temporal network architecture that uses its gating variables to capture the variation of physical parameters. We initialize this model using a pre-training strategy that helps discover common physical patterns shared by different sets of simulation data. Then we fine-tune it using limited observation data via a contrastive learning process. By leveraging the complementary strength of machine learning and domain knowledge, our method has been shown to produce accurate predictions, use less training samples and generalize to out-of-sample scenarios. We further show that the method can provide insights about the variation of physical parameters over space and time in two domain applications: predicting temperature in streams and predicting temperature in lakes.

Conference Paper↗

USGS2021

Physics-guided recurrent graph model for predicting flow and temperature in river networks

This paper proposes a physics-guided machine learning approach that combines machine learning models and physics-based models to improve the prediction of water flow and temperature in river networks. We first build a recurrent graph network model to capture the interactions among multiple segments in the river network. Then we transfer knowledge from physics-based models to guide the learning of the machine learning model. We also propose a new loss function that balances the performance over different river segments. We demonstrate the effectiveness of the proposed method in predicting temperature and streamflow in a subset of the Delaware River Basin. In particular, the proposed method has brought a 33%/14% accuracy improvement over the state-of-the-art physics-based model and 24%/14% over traditional machine learning models (e.g., LSTM) in temperature/streamflow prediction using very sparse (0.1%) training data. The proposed method has also been shown to produce better performance when generalized to different seasons or river segments with different streamflow ranges.

Conference Paper↗

USGS2021

Graph-based reinforcement learning for active learning in real time: An application in modeling river networks

Effective training of advanced ML models requires large amounts of labeled data, which is often scarce in scientific problems given the substantial human labor and material cost to collect labeled data. This poses a challenge on determining when and where we should deploy measuring instruments (e.g., in-situ sensors) to collect labeled data efficiently. This problem differs from traditional pool-based active learning settings in that the labeling decisions have to be made immediately after we observe the input data that come in a time series. In this paper, we develop a real-time active learning method that uses the spatial and temporal contextual information to select representative query samples in a reinforcement learning framework. To reduce the need for large training data, we further propose to transfer the policy learned from simulation data which is generated by existing physics-based models. We demonstrate the effectiveness of the proposed method by predicting streamflow and water temperature in the Delaware River Basin given a limited budget for collecting labeled data. We further study the spatial and temporal distribution of selected samples to verify the ability of this method in selecting informative samples over space and time.

Conference Paper↗

USGS2021

Partial differential equation driven dynamic graph networks for predicting stream water temperature

This paper presents a physics-guided machine learning approach that incorporates partial differential equations (PDEs) in a graph neural network model to improve the prediction of water temperature in river networks. The standard graph neural network model often uses pre-defined edge weights based on distance or similarity measures. Such static graph structure can be limited in capturing multiple processes in a physical system that interact and evolve over time. The limitation to represent underlying physical processes can severely affect the performance of the predictive model, especially when we have access to limited training data. To better capture the dynamic interactions among multiple segments in a river network, we built a dynamic graph model, where the graph structure is driven by the PDE that describes underlying physical processes. We further combine the dynamic graph structure and the recurrent layers to model temporal dependencies and improve the prediction. We demonstrate the effectiveness of the proposed method in a subnetwork of the Delaware River Basin. In particular, we show that the proposed method outperforms existing physics-based and machine learning models in temperature prediction using sparse observation data for training. The proposed method has also been shown to produce better performance when generalized to different seasons.

Conference Paper↗

USGS2021

Heterogeneous stream-reservoir graph networks with data assimilation

Accurate prediction of water temperature in streams is critical for monitoring and understanding biogeochemical and ecological processes in streams. Stream temperature is affected by weather patterns (such as solar radiation) and water flowing through the stream network. Additionally, stream temperature can be substantially affected by water releases from man-made reservoirs to downstream segments. In this paper, we propose a heterogeneous recurrent graph model to represent these interacting processes that underlie stream-reservoir networks and improve the prediction of water temperature in all river segments within a network. Because reservoir release data may be unavailable for certain reservoirs, we further develop a data assimilation mechanism to adjust the deep learning model states to correct for the prediction bias caused by reservoir releases. Our evaluation for the Delaware River Basin has demonstrated the superiority of our proposed method over multiple existing methods. We have extensively studied the effect of the data assimilation mechanism under different scenarios.

IEEE International Conference on Data Mining (ICDM↗

USGS2021

Using machine learning to develop a predictive understanding of the impacts of extreme water cycle perturbations on river water quality

This whitepaper addresses to two focal areas – (3) Insight gleaned from complex data using Artificial Intelligence (AI), and other advanced techniques (primary), and (2) Predictive modeling through the use of AI techniques and AI-derived model components (secondary). This topic is directly relevant to four DOE Earth and Environmental Systems Science Division Grand Challenges: integrated water cycle, biogeochemistry, drivers and responses in the Earth system, and data-model integration.

Technical Report↗