Search USGS⌕ Search
Home/Archive/USGS

USGS · 70239275

HydroBench: Jupyter supported reproducible hydrological model benchmarking and diagnostic tool

Edom Moges·Benjamin Ruddell·Liang Zhang·Jessica M. Driscoll·Parker A. Norton·Fernando Perez·Laurel Larsen
View original source ↗Export metadata ↓

Abstract

Evaluating whether hydrological models are right for the right reasons demands reproducible model benchmarking and diagnostics that evaluate not just statistical predictive model performance but also internal processes. Such model benchmarking and diagnostic efforts will benefit from standardized methods and ready-to-use toolkits. Using the Jupyter platform, this work presents HydroBench, a model-agnostic benchmarking tool consisting of three sets of metrics: 1) common statistical predictive measures, 2) hydrological signature-based process metrics, including a new time-linked flow duration curve and 3) information-theoretic diagnostics that measure the flow of information among model variables. As a test case, HydroBench was applied to compare two model products (calibrated and uncalibrated) of the National Hydrologic Model - Precipitation Runoff Modeling System (NHM-PRMS) at the Cedar River watershed, WA, United States. Although the uncalibrated model has the highest predictive performance, particularly for high flows, the signature-based diagnostics showed that the model overestimates low flows and poorly represents the recession processes. Elucidating why low flows may have been overestimated, the information-theoretic diagnostics indicated a higher flow of information from precipitation to snowmelt to streamflow in the uncalibrated model compared to the calibrated model, where information flowed more directly from precipitation to streamflow. This test case demonstrated the capability of HydroBench in process diagnostics and model predictive and functional performance evaluations, along with their tradeoffs. Having such a model benchmarking tool not only provides modelers with a comprehensive model evaluation system but also provides an open-source tool that can further be developed by the hydrological community.

Explore related subjects

Frontiers in Earth SciencesArticle

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Edom Moges, Benjamin Ruddell, Liang Zhang, Jessica M. Driscoll, Parker A. Norton, Fernando Perez, Laurel Larsen. 2022-09-30. HydroBench: Jupyter supported reproducible hydrological model benchmarking and diagnostic tool. https://doi.org/10.3389/feart.2022.884766

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related USGS reports

USGS2020

A long-term geothermal observatory across subseafloor gas hydrates, IODP Hole U1364A, Cascadia accretionary prism

We report 4 years of temperature profiles collected from May 2014 to May 2018 in Integrated Ocean Drilling Program Hole U1364A in the frontal accretionary prism of the Cascadia subduction zone. The temperature data extend to depths of nearly 300 m below seafloor (mbsf), spanning the gas hydrate stability zone at the location and a clear bottom-simulating reflector (BSR) at ∼230 mbsf. When the hole was drilled in 2010, a pressure-monitoring Advanced CORK (ACORK) observatory was installed, sealed at the bottom by a bridge plug and cement below 302 mbsf. In May 2014, a temperature profile was collected by lowering a probe down the hole from the ROV ROPOS. From July 2016 through May 2018, temperature data were collected during a nearly two-year deployment of a 24-thermistor cable installed to 268 m below seafloor (mbsf). The cable and a seismic-tilt instrument package also deployed in 2016 were connected to the Ocean Networks Canada (ONC) NEPTUNE cabled observatory in June of 2017, after which the thermistor temperatures were logged by Ocean Networks Canada at one-minute intervals until failure of the main ethernet switch in the integrated seafloor control unit in May 2018. The thermistor array had been designed with concentrated vertical spacing around the bottom-simulating reflector and two pressure-monitoring screens at 203 and 244 mbsf, with wider thermistor spacing elsewhere to document the geothermal state up to seafloor. The 4 years of data show a generally linear temperature gradient of 0.055°C/m consistent with a heat flux of 61–64 mW/m 2 . The data show no indications of thermal transients. A slight departure from a linear gradient provides an approximate limit of ∼10 −10 m/s for any possible slow upward advection of pore fluids. In-situ temperatures are ∼15.8°C at the BSR position, consistent with methane hydrate stability at that depth and pressure.

Cascadia subduction zone↗