Jennifer Courtwright | Search USGS

USGS2024

A data exchange standard for wadeable stream habitat monitoring data

Data from wadeable streams collected by monitoring programs are used to assess watershed condition status and trends. Federally managed programs collect a suite of similar habitat measurements using compatible methods and produce individual program datasets for their prescribed geographic and temporal range. We identified four programs that produce similar data: the Bureau of Land Management Assessment, Inventory, and Monitoring lotic division, the U.S. Environmental Protection Agency National Aquatic Resource Surveys National Rivers and Streams Assessment survey section, the Federal interagency Aquatic and Riparian Effectiveness Monitoring Program, and the PacFish/InFish Biological Opinion Monitoring Program. Their datasets answer agency-specific management questions and fulfill reporting requirements, but the datasets are not released in full, or at all, and in some cases, there was no method to integrate data from the four programs to provide data at a larger spatial scale. The Pacific Northwest Aquatic Monitoring Partnership (PNAMP) led a working group of experts from the four monitoring programs to determine data compatibility, develop a Stream Habitat Metrics Integration (SHMI) data exchange standard, and integrate compatible wadeable stream data. The resulting SHMI data exchange standard contains a data mapping file used to transform data from the source program data to a conformed format based on a controlled vocabulary. After extensive discussions assessing and comparing program collection and analyses methods, the working group found 26 stream habitat metrics to be sufficiently comparable to be integrated into a meaningful dataset. Furthermore, a subset of PIBO MP data previously available only by request and AREMP data available only as a proprietary ESRI ArcGIS geodatabase were made publicly available in non-proprietary formats via the integrated SHMI dataset. A selection of data from the four programs determined to be compatible among 14 datasets were filtered, transformed, standardized, and combined using R code to create the integrated SHMI dataset containing about 12,000 locations, 19,000 events, and 200,000 measurements from 2000 to 2022. This report describes the SHMI data exchange standard and its development, the metric compatibility assessment, and the data integration process, so that others may reuse the SHMI data exchange standard and its components as well as the data integration processes.

Techniques and Methods↗

USGS2022

Ten practical questions to improve data quality

High-quality rangeland data are critical to supporting adaptive management. However, concrete, cost-saving steps to ensure data quality are often poorly defined and understood. Data quality is more than data management. Ensuring data quality requires 1) clear communication among team members; 2) appropriate sample design; 3) training of data collectors, data managers, and data users; 4) observer and sensor calibration; and 5) active data management. Quality assurance and quality control are ongoing processes to help rangeland managers and scientists identify, prevent, and correct errors in past, current, and future monitoring data. We present 10 guiding data quality questions to help managers and scientists identify appropriate workflows to improve data quality by 1) describing the data ecosystem, 2) creating a data quality plan, 3) identifying roles and responsibilities, 4) building data collection and data management workflows, 5) training and calibrating data collectors, 6) detecting and correcting errors, and 7) describing sources of variability. Iteratively improving rangeland data quality is a key part of adaptive monitoring and rangeland data collection. All members of the rangeland community are invited to participate in ensuring rangeland data quality.

Rangelands↗