Search USGS⌕ Search

Geology topics

David L. Blodgett

Publications and source records attributed to David L. Blodgett.

17 recordsLinked to original sources
USGS2023

Restructuring and serving web-accessible streamflow data from the NOAA National Water Model historic simulations

In 2016, the National Oceanic and Atmospheric Administration deployed the first iteration of an operational National Water Model (NWM) to forecast the water cycle in the continental United States. With many versions, an hourly, multi-decadal historic simulation is made available to the public. In all released to date, the files containing simulated streamflow contain a snapshot of model conditions across the entire domain for a single timestep which makes accessing time series a technical and resource-intensive challenge. In the most recent release, extracting a complete streamflow time series for a single location requires managing 367,920 files (~16.2 TB). In this work we describe a reproducible process for restructuring a sequential set of NWM steamflow files for efficient time series access and provide restructured datasets for versions 1.2 (1993–2018), 2.0 (1993–2020), and 2.1 (1979–2022). These datasets have been made accessible via an OPeNDAP enabled THREDDS data server for public use and a brief analysis highlights the latest version of the model should not be assumed best for all locations. Lastly we describe an R package that expedites data retrieval with examples for multiple use-cases.

Nature, Scientific Data↗
USGS2023

Generating a reference flow network with improved connectivity to support durable data integration and reproducibility in the coterminous US

This report presents a reference flow network for the conterminous United States that is built from the best available information from the U.S. Geological Survey, the National Oceanic and Atmospheric Administration National Weather Service, and the U.S. Environmental Protection Agency. The work is intended to support durable data integration and reproducibility. Originating from the National Hydrography Dataset Plus (NHDPlus) V2.1, the reference flow network incorporates network connectivity enhancements from federal agency efforts. After incorporating these network improvements, many original NHDPlus attributes were regenerated to enable network navigation and related operations. After introducing the motivation and background for this work, this report describes the attribute generation workflow and data quality checks that were performed in preparation of the dataset. The reference flow network follows the NHDPlus data model and is described using terms defined in the Mainstem and Drainage Basin logical model and WaterML2 Part3: Surface Hydrology Features conceptual model.

Environmental Modelling and Software↗
USGS2023

Hydrologic modeling and river corridor applications of HY_Features concepts

The WaterML2: Part 3 - Surface Hydrology Features (HY_Features) Conceptual Model was published by OGC in 2018. This report documents the use of HY_Features concepts in support of two key tasks: (1) local to continental hydrologic modeling; and (2) referencing river corridor data to hydrographic networks. The presented use cases are applicable in hydroscience research and assessments, water resources engineering practices, and drought and flood responses. Before the HY_Features conceptual model there was no internationally recognized standard for the design of software and data for the hydroscience and engineering community. This report presents progress towards a logical data model that interprets the abstract HY_Features concepts for use in geospatial workflows, modeling applications, and web data systems that integrate hydrologic data. The use cases addressed include: (1) hydrologic model control volume definition; (2) hydrologic network connectivity; (3) characterization of catchments with landscape and atmospheric data; (4) river corridor characterization; (5) hydrologic location; and (6) flow network location. Each use case is described briefly along with an analysis of the information requirements. This report presents a summary of the logical model designed to satisfy the needs of these use cases and a summary of updates and changes proposed for HY_Features. Changes for consideration by the HY_Features Standards Working Group include the following. Provide more clarity on the inherited properties and associations of features that "realize" the catchment and nexus concepts from HY_Features. Add nexus realization feature types to represent the outlet of catchments that are "frontal" (terminate to the ocean or a large waterbody) or "inland sinks." Add a "HY_Flowline" feature as a superclass of HY_Flowpath providing linear referencing on waterbodies that are not catchment realizations. Add an association or interface to support connection between surface catchments and hydrogeologic units.

OGC Public Engineering Report↗
USGS2021

Mainstems: A logical data model implementing mainstem and drainage basin feature types based on WaterML2 Part 3: HY Features concepts

The Mainstems data model implements the catchment and flowpath concepts from WaterML2 Part 3: Surface Hydrology Features (HY_Features) for persistent, cross-scale, identification of hydrologic features. The data model itself provides a focused and lightweight method to describe hydrologic networks with minimum but sufficient information. The design is intended to provide a model for data integration that can be used for network navigation and persistent hydrologic indexing (hydrographic addressing) functionality. Mainstems is designed to provide long-term stability with minimal maintenance requirements. The data model is not meant to advance hydrologic process representation or uniquely represent geomorphic characteristics. The principle assumption in Mainstems is that all drainage basins have one - and only one - headwater source area and a single mainstem that flows to a single outlet . Using these base feature types, ( headwater , outlet , mainstem , and drainage basin ) a nested set of drainage basins - and the associated dendritic network of mainstems - can be identified.

Environmental Modelling and Software↗
USGS2018

Continuing progress toward a national assessment of water availability and use

Executive Summary The Omnibus Public Land Management Act of 2009 (Public Law 111—11) was passed into law on March 30, 2009. Subtitle F, also known as the SECURE Water Act, calls for the establishment of a “national water availability and use assessment program” within the U.S. Geological Survey (USGS). The USGS issued the first report on the program in 2013. Program progress over the period 2013–17 is reported herein to fulfill the requirement to inform Congress on implementation of the national water availability and use assessment program, also referred to as the USGS National Water Census (the Water Census). Much work has been accomplished during 2013–17 on producing water budgets for the nation, a goal USGS outlined in its first report on program progress to Congress. The USGS has completed three geographic focus area studies and has begun three others. Work has advanced on nationwide efforts in streamflow analysis, groundwater assessment and research, evapotranspiration studies, water use, environmental water science, and drought science. The USGS works with Federal and non-Federal agencies, universities, and other organizations to ensure that the information can be aggregated with other types of water-availability and socioeconomic information, such as data on food and energy production. The USGS has also made great strides in measures for delivering data and information on the Water Census to stakeholders and the public. Much work remains to be accomplished for the Nation to have a comprehensive, ongoing Water Census. In this report, the USGS lays out activities to be accomplished in the next 5 years (2017–22), based upon current funding levels. These include selecting new focus area studies, conducting hydrologic modeling to complete water budgets for the conterminous United States, expanding groundwater modeling efforts, mapping a national classification system for environmental water science, and developing an inventory of interbasin water transfers. All of these steps are necessary in order for the Water Census to achieve the goals outlined by Congress in the SECURE Water Act.

Circular↗
USGS2018

Open hydrology courseware using the United States Geological Survey’s National Water Census Data Portal

The U.S. Geological Survey (USGS) is the primary U.S. Government agency for water data collection and dissemination. In this role, the USGS has recently created and deployed a National Water Census Data Portal (NWC-DP) which provides access to streamflow, evapotransporation, precipitation, aquatic biology and other data at the national level. Recognizing the value of these data sets for hydrologic science education, this paper presents an effort to bridge the gap between pencil–and-paper-based hydrology curriculum and the USGS NWC-DP resource. Specifically, we have developed an R package, National Water Census Education (NWCEd), and five associated laboratory exercises that integrate R- and web-services-based access to the NWC-DP data sets. Using custom functions built into the NWCEd, students are able to access unprecedented amounts of hydrologic data from the NWC-DP, which can be applied to current hydrology curriculum and analyzed using NWCEd and a number of other open-source R tools.

Open Water Journal↗
USGS2016

An analysis of water data systems to inform the Open Water Data Initiative

Improving access to data and fostering open exchange of water information is foundational to solving water resources issues. In this vein, the Department of the Interior's Assistant Secretary for Water and Science put forward the charge to undertake an Open Water Data Initiative (OWDI) that would prioritize and accelerate work toward better water data infrastructure. The goal of the OWDI is to build out the Open Water Web (OWW). We therefore considered the OWW in terms of four conceptual functions: water data cataloging, water data as a service, enriching water data, and community for water data. To describe the current state of the OWW and identify areas needing improvement, we conducted an analysis of existing systems using a standard model for describing distributed systems and their business requirements. Our analysis considered three OWDI-focused use cases—flooding, drought, and contaminant transport—and then examined the landscape of other existing applications that support the Open Water Web. The analysis, which includes a discussion of observed successful practices of cataloging, serving, enriching, and building community around water resources data, demonstrates that we have made significant progress toward the needed infrastructure, although challenges remain. The further development of the OWW can be greatly informed by the interpretation and findings of our analysis.

Journal of the American Water Resources Associatio↗
USGS2015

geoknife: Reproducible web-processing of large gridded datasets

Geoprocessing of large gridded data according to overlap with irregular landscape features is common to many large-scale ecological analyses. The geoknife R package was created to facilitate reproducible analyses of gridded datasets found on the U.S. Geological Survey Geo Data Portal web application or elsewhere, using a web-enabled workflow that eliminates the need to download and store large datasets that are reliably hosted on the Internet. The package provides access to several data subset and summarization algorithms that are available on remote web processing servers. Outputs from geoknife include spatial and temporal data subsets, spatially-averaged time series values filtered by user-specified areas of interest, and categorical coverage fractions for various land-use types.

Ecography↗
USGS2015

Progress on water data integration and distribution: a summary of select U.S. Geological Survey data systems

Critical water-resources issues ranging from flood response to water scarcity make access to integrated water information, services, tools, and models essential. Since 1995 when the first water data web pages went online, the U.S. Geological Survey has been at the forefront of water data distribution and integration. Today, real-time and historical streamflow observations are available via web pages and a variety of web service interfaces. The Survey has built partnerships with Federal and State agencies to integrate hydrologic data providing continuous observations of surface and groundwater, temporally discrete water quality data, groundwater well logs, aquatic biology data, water availability and use information, and tools to help characterize the landscape for modeling. In this paper, we summarize the status and design patterns implemented for selected data systems. We describe how these systems contribute to a U.S. Federal Open Water Data Initiative and present some gaps and lessons learned that apply to global hydroinformatics data infrastructure.

Journal of Hydroinformatics↗
USGS2015

Community for Data Integration 2013 Annual Report

The U.S. Geological Survey (USGS) conducts earth science to help address complex issues affecting society and the environment. In 2006, the USGS held the first Scientific Information Management Workshop to bring together staff from across the organization to discuss the data and information management issues affecting the integration and delivery of earth science research and investigate the use of “communities of practice” as mechanisms to share expertise about these issues. Out of this effort emerged the Council for Data Integration, which was conceived as an official organizational function that would help guide data integration activities and formalize communities of practice into working groups. However by 2009, it became apparent that many members of the council had an interest in developing data integration solutions and sharing expertise in a less formal grassroots perspective, thus transforming the “Council” into a “Community” for Data Integration (CDI). Today, the CDI represents a dynamic community of practice focused on advancing science data and information management and integration capabilities across the USGS and the CDI community. The CDI fosters an environment for collaboration and sharing by bringing together expertise from external partners and representatives across USGS who are involved in research, data management, and information technology. Membership is voluntary and open to USGS employees and other individuals and organizations willing to contribute to the community (if interested, contact cdi@usgs.gov). The purpose of the CDI is to advance understanding of Earth systems through enhanced use of data and information including associated tools and techniques provide a forum for people doing work with data integration to come together to share ideas as well as learn new skills and techniques, and grow overall USGS capabilities with data and information by increasing visibility of the work of many people throughout the USGS and the CDI community. To achieve these goals, the CDI operates within four applied areas: monthly forums, annual workshop/webinar series, working groups, and projects. The monthly forums, also known as the Opportunity/Challenge of the Month, provide an open dialogue to share and learn about data integration efforts or to present problems that invite the Community to offer solutions, advice, and support. Since 2010, the CDI has also sponsored annual workshops/webinar series to encourage the exchange of ideas, sharing of activities, presentations of current projects, and networking among members. Stemming from common interests, the working groups are focused on efforts to address data management and technical 2 challenges, including the development of standards and tools, improving interoperability and information infrastructure, and data preservation within USGS and its partners. The growing support for the activities of the working groups led to the CDI’s first formal request for proposals (RFP) process in 2013 to fund projects that produced tangible products. Today the CDI continues to hold an annual RFP that create data management tools and practices, collaboration tools, and training in support of data integration and delivery.

Open-File Report↗
USGS2014

Downscaled climate projections for the Southeast United States: evaluation and use for ecological applications

Climate change is likely to have many effects on natural ecosystems in the Southeast U.S. The National Climate Assessment Southeast Technical Report (SETR) indicates that natural ecosystems in the Southeast are likely to be affected by warming temperatures, ocean acidification, sea-level rise, and changes in rainfall and evapotranspiration. To better assess these how climate changes could affect multiple sectors, including ecosystems, climatologists have created several downscaled climate projections (or downscaled datasets) that contain information from the global climate models (GCMs) translated to regional or local scales. The process of creating these downscaled datasets, known as downscaling, can be carried out using a broad range of statistical or numerical modeling techniques. The rapid proliferation of techniques that can be used for downscaling and the number of downscaled datasets produced in recent years present many challenges for scientists and decisionmakers in assessing the impact or vulnerability of a given species or ecosystem to climate change. Given the number of available downscaled datasets, how do these model outputs compare to each other? Which variables are available, and are certain downscaled datasets more appropriate for assessing vulnerability of a particular species? Given the desire to use these datasets for impact and vulnerability assessments and the lack of comparison between these datasets, the goal of this report is to synthesize the information available in these downscaled datasets and provide guidance to scientists and natural resource managers with specific interests in ecological modeling and conservation planning related to climate change in the Southeast U.S. This report enables the Southeast Climate Science Center (SECSC) to address an important strategic goal of providing scientific information and guidance that will enable resource managers and other participants in Landscape Conservation Cooperatives to make science-based climate change adaptation decisions.

Open-File Report↗
USGS2013

The U.S. Geological Survey Climate Geo Data Portal: an integrated broker for climate and geospatial data

The increasing availability of downscaled climate projections and other data products that summarize or predict climate conditions, is making climate data use more common in research and management. Scientists and decisionmakers often need to construct ensembles and compare climate hindcasts and future projections for particular spatial areas. These tasks generally require an investigator to procure all datasets of interest en masse, integrate the various data formats and representations into commonly accessible and comparable formats, and then extract the subsets of the datasets that are actually of interest. This process can be challenging and time intensive due to data-transfer, -storage, and(or) -processing limits, or unfamiliarity with methods of accessing climate data. Data management for modeling and assessing the impacts of future climate conditions is also becoming increasingly expensive due to the size of the datasets. The Climate Geo Data Portal (http://cida.usgs.gov/climate/gdp/) addresses these limitations, making access to numerous climate datasets for particular areas of interest a simple and efficient task.

Fact Sheet↗
USGS2013

New service interface for River Forecasting Center derived quantitative precipitation estimates

For more than a decade, the National Weather Service (NWS) River Forecast Centers (RFCs) have been estimating spatially distributed rainfall by applying quality-control procedures to radar-indicated rainfall estimates in the eastern United States and other best practices in the western United States to producea national Quantitative Precipitation Estimate (QPE) (National Weather Service, 2013). The availability of archives of QPE information for analytical purposes has been limited to manual requests for access to raw binary file formats that are difficult for scientists who are not in the climatic sciences to work with. The NWS provided the QPE archives to the U.S. Geological Survey (USGS), and the contents of the real-time feed from the RFCs are being saved by the USGS for incorporation into the archives. The USGS has applied time-series aggregation and added latitude-longitude coordinate variables to publish the RFC QPE data. Web services provide users with direct (index-based) data access, rendered visualizations of the data, and resampled raster representations of the source data in common geographic information formats.

Fact Sheet↗
USGS2012

Description of the U.S. Geological Survey Geo Data Portal data integration framework

The U.S. Geological Survey has developed an open-standard data integration framework for working efficiently and effectively with large collections of climate and other geoscience data. A web interface accesses catalog datasets to find data services. Data resources can then be rendered for mapping and dataset metadata are derived directly from these web services. Algorithm configuration and information needed to retrieve data for processing are passed to a server where all large-volume data access and manipulation takes place. The data integration strategy described here was implemented by leveraging existing free and open source software. Details of the software used are omitted; rather, emphasis is placed on how open-standard web services and data encodings can be used in an architecture that integrates common geographic and atmospheric data.

IEEE Journal of Selected Topics in Applied Earth O↗
USGS2011

Description and testing of the Geo Data Portal: Data integration framework and Web processing services for environmental science collaboration

Interest in sharing interdisciplinary environmental modeling results and related data is increasing among scientists. The U.S. Geological Survey Geo Data Portal project enables data sharing by assembling open-standard Web services into an integrated data retrieval and analysis Web application design methodology that streamlines time-consuming and resource-intensive data management tasks. Data-serving Web services allow Web-based processing services to access Internet-available data sources. The Web processing services developed for the project create commonly needed derivatives of data in numerous formats. Coordinate reference system manipulation and spatial statistics calculation components implemented for the Web processing services were confirmed using ArcGIS 9.3.1, a geographic information science software package. Outcomes of the Geo Data Portal project support the rapid development of user interfaces for accessing and manipulating environmental data.

Open-File Report↗