Search USGSSearch

USGS · sir20105211

Approaches to highly parameterized inversion: A guide to using PEST for model-parameter and predictive-uncertainty analysis

Abstract

Analysis of the uncertainty associated with parameters used by a numerical model, and with predictions that depend on those parameters, is fundamental to the use of modeling in support of decisionmaking. Unfortunately, predictive uncertainty analysis with regard to models can be very computationally demanding, due in part to complex constraints on parameters that arise from expert knowledge of system properties on the one hand (knowledge constraints) and from the necessity for the model parameters to assume values that allow the model to reproduce historical system behavior on the other hand (calibration constraints). Enforcement of knowledge and calibration constraints on parameters used by a model does not eliminate the uncertainty in those parameters. In fact, in many cases, enforcement of calibration constraints simply reduces the uncertainties associated with a number of broad-scale combinations of model parameters that collectively describe spatially averaged system properties. The uncertainties associated with other combinations of parameters, especially those that pertain to small-scale parameter heterogeneity, may not be reduced through the calibration process. To the extent that a prediction depends on system-property detail, its postcalibration variability may be reduced very little, if at all, by applying calibration constraints; knowledge constraints remain the only limits on the variability of predictions that depend on such detail. Regrettably, in many common modeling applications, these constraints are weak. Though the PEST software suite was initially developed as a tool for model calibration, recent developments have focused on the evaluation of model-parameter and predictive uncertainty. As a complement to functionality that it provides for highly parameterized inversion (calibration) by means of formal mathematical regularization techniques, the PEST suite provides utilities for linear and nonlinear error-variance and uncertainty analysis in these highly parameterized modeling contexts. Availability of these utilities is particularly important because, in many cases, a significant proportion of the uncertainty associated with model parameters-and the predictions that depend on them-arises from differences between the complex properties of the real world and the simplified representation of those properties that is expressed by the calibrated model. This report is intended to guide intermediate to advanced modelers in the use of capabilities available with the PEST suite of programs for evaluating model predictive error and uncertainty. A brief theoretical background is presented on sources of parameter and predictive uncertainty and on the means for evaluating this uncertainty. Applications of PEST tools are then discussed for overdetermined and underdetermined problems, both linear and nonlinear. PEST tools for calculating contributions to model predictive uncertainty, as well as optimization of data acquisition for reducing parameter and predictive uncertainty, are presented. The appendixes list the relevant PEST variables, files, and utilities required for the analyses described in the document.

Explore related subjects

90° N90° S · 180° W ← longitude → 180° E
Source-reported bounding extent: 42.95° to 42.9675° latitude; -84.85° to -84.81694444444445° longitude. This indicates report coverage, not an exact sampling location. View area on OpenStreetMap.

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

John E. Doherty, Randall J. Hunt, Matthew J. Tonkin. 2010. Approaches to highly parameterized inversion: A guide to using PEST for model-parameter and predictive-uncertainty analysis. https://doi.org/10.3133/sir20105211

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related USGS reports

Monitoring recreation on federally managed lands and waters—Aspects of visitor use

Federally managed public lands and waters receive around 1 billion recreational visits each year. Data on these visitors can aid in guiding policy decisions, managing resources effectively, and communicating the economic contributions of lands and waters. This report explores the methods used by agencies to collect data on aspects of recreational visitor use to Federal lands and waters (apart from visitation numbers, which are the focus of a companion publication). Aspects of recreational visitor use include visitor demographics, recreational activity participation, visitor satisfaction, visitor attitudes and experiences, trip characteristics, and economic contributions. We review practices used to understand aspects of visitor use across seven Federal agencies, revealing similarities such as the use of visitor intercept surveys and coverage of similar topic areas, and differences in how survey programs are operationalized and how specific questions on visitor surveys are worded. We also evaluate emerging technologies, such as geolocated social media and mobile device location data, for their potential to aid in understanding aspects of visitor use. This report concludes with potential opportunities to enhance data collection and coordination, ensuring cost-effective data collection and informed decision making.

Scientific Investigations Report

Evaluation of best management practices at an edge-of-field site in the Eagle Creek watershed, Ohio, 2012–20

In 2010, the U.S. Geological Survey worked in partnership with the Great Lakes Restoration Initiative and the Natural Resources Conservation Service to identify farm fields in priority watersheds—watersheds critically important to Great Lake health. Intensive best management practices were implemented in five States to test the efficacy of best management practices, also referred to as agricultural conservation practices, to reduce sediment and nutrient runoff on agricultural fields. These fields were chosen as representatives of the priority watersheds because their farming practices and geographical conditions were common among farms in those watersheds. A farm site located near Findlay, Ohio, in the Eagle Creek watershed used two conservation practices, cover crop (Natural Resources Conservation Service practice standard 340) and variable rate technology (VRT; Natural Resources Conservation Service practice standard 590), which represent common practices in the Maumee priority watershed. This study monitored surface runoff and subsurface tile runoff at the Eagle Creek watershed site. The effects of cover crop and VRT nutrient application on sediment and nutrient runoff were assessed from October 2012 to September 2020. Cover crops were applied in fall of 2016, 2017, and 2018, coinciding with VRT applications. The following parameters were analyzed as part of the study: runoff discharge; peak discharge; and concentrations and loads of total phosphorus, particulate phosphorus, dissolved reactive phosphorus, and suspended sediment. High peak runoff events disproportionally affected nutrient concentrations and loads in runoff. A threshold of the 85th percentile of the peak discharge was chosen to assess the effect of cover crop and VRT nutrient application on nutrient mitigation at each gage. Runoff events below the 85th percentile were considered small, and runoff events over the 85th percentile were considered large. Concentrations from collected water-quality samples were used for the analysis; estimated concentrations were excluded from the statistical evaluation. All surface runoff parameters during small runoff events, except surface runoff volume, were significantly lower in the period with cover crops and VRT implementation. Contrarily, subsurface runoff parameters during small events were not statistically different between the periods with and without cover crops and VRT implementation. Surface and subsurface parameters during large events were also not statistically different between the periods with and without cover crops and VRT implementation. These results indicate cover crops and VRT may improve water quality during small runoff events, but additional best management practices that mitigate large runoff events may lead to greater water-quality improvement given the contribution of large events to overall losses.

Ohio

Continuous monitoring and temporal variability of fluorescence of dissolved organic matter in karst groundwater of the Edwards aquifer, south-central Texas, 2019–24

Widespread urbanization on the Edwards aquifer recharge zone in south-central Texas has prompted the development of new approaches and tools for evaluating the current and future status of water quality in the San Antonio and Barton Springs segments of the Edwards aquifer. The U.S. Geological Survey, in cooperation with the San Antonio Water System and the City of Austin, applied continuous monitoring of fluorescence of dissolved organic matter (fDOM) to characterize the sources and transport of dissolved organic matter and associated constituents in the Edwards aquifer. Continuous fDOM time-series data were adjusted using empirically derived temperature, turbidity, and inner-filter-effect correction factors prior to analysis and interpretation. Fully corrected fDOM time-series data from the study sites were evaluated for short- and long-term temporal variability in fDOM in the context of the hydrologic and climatic conditions that occurred during the 5-year study period to understand vulnerability of the aquifer to potential contaminants in recharge. Study results indicate that fDOM is an effective proxy for dissolved organic carbon that, in turn, is indicative of the influx of recent surface water and associated contaminants, and thus, aquifer vulnerability to those contaminants. Although other continuously monitored water-quality parameters provide insights into changes in water quality in response to varying hydrologic conditions, the quantitative relation between fDOM and dissolved organic carbon directly indicates the timing and magnitude of pulses of organic constituents derived from the land surface, whereas other water-quality parameters do not.

Texas