Skip to main content
U.S. flag

An official website of the United States government

HydroBench: Jupyter supported reproducible hydrological model benchmarking and diagnostic tool

September 30, 2022

Evaluating whether hydrological models are right for the right reasons demands reproducible model benchmarking and diagnostics that evaluate not just statistical predictive model performance but also internal processes. Such model benchmarking and diagnostic efforts will benefit from standardized methods and ready-to-use toolkits. Using the Jupyter platform, this work presents HydroBench, a model-agnostic benchmarking tool consisting of three sets of metrics: 1) common statistical predictive measures, 2) hydrological signature-based process metrics, including a new time-linked flow duration curve and 3) information-theoretic diagnostics that measure the flow of information among model variables. As a test case, HydroBench was applied to compare two model products (calibrated and uncalibrated) of the National Hydrologic Model - Precipitation Runoff Modeling System (NHM-PRMS) at the Cedar River watershed, WA, United States. Although the uncalibrated model has the highest predictive performance, particularly for high flows, the signature-based diagnostics showed that the model overestimates low flows and poorly represents the recession processes. Elucidating why low flows may have been overestimated, the information-theoretic diagnostics indicated a higher flow of information from precipitation to snowmelt to streamflow in the uncalibrated model compared to the calibrated model, where information flowed more directly from precipitation to streamflow. This test case demonstrated the capability of HydroBench in process diagnostics and model predictive and functional performance evaluations, along with their tradeoffs. Having such a model benchmarking tool not only provides modelers with a comprehensive model evaluation system but also provides an open-source tool that can further be developed by the hydrological community.

Citation Information

Publication Year 2022
Title HydroBench: Jupyter supported reproducible hydrological model benchmarking and diagnostic tool
DOI 10.3389/feart.2022.884766
Authors Edom Moges, Benjamin Ruddell, Liang Zhang, Jessica M. Driscoll, Parker A. Norton, Fernando Perez, Laurel Larsen
Publication Type Article
Publication Subtype Journal Article
Series Title Frontiers in Earth Sciences
Index ID 70239275
Record Source USGS Publications Warehouse
USGS Organization New Mexico Water Science Center; South Dakota Water Science Center; WMA - Integrated Modeling and Prediction Division