Search USGSSearch

USGS · 70046984

The challenge of archiving and preserving remotely sensed data

Abstract

Few would question the need to archive the scientific and technical (S&T) data generated by researchers. At a minimum, the data are needed for change analysis. Likewise, most people would value efforts to ensure the preservation of the archived S&T data. Future generations will use analysis techniques not even considered today. Until recently, archiving and preserving these data were usually accomplished within existing infrastructures and budgets. As the volume of archived data increases, however, organizations charged with archiving S&T data will be increasingly challenged (U.S. General Accounting Office, 2002). The U.S. Geological Survey has had experience in this area and has developed strategies to deal with the mountain of land remote sensing data currently being managed and the tidal wave of expected new data. The Agency has dealt with archiving issues, such as selection criteria, purging, advisory panels, and data access, and has met with preservation challenges involving photographic and digital media. That experience has allowed the USGS to develop management approaches, which this paper outlines.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

John Faundeen. 2003. The challenge of archiving and preserving remotely sensed data. https://doi.org/10.2481/dsj.2.159

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related USGS reports

State of the data: Assessing the FAIRness of USGS data

In response to recent shifts towards open science that emphasize transparency, reproducibility, and access to research data, the US Geological Survey (USGS) conducted a study to assess the degree to which USGS data assets meet the FAIR data principles (Findable, Accessible, Interoperable, and Reusable). The USGS designed and applied a methodology for quantitative analysis of FAIR characteristics. A new rubric was derived from a crosswalk of existing FAIR evaluation frameworks and customized for the USGS. The rubric, consisting of 62 yes/no questions, was applied to 392 metadata records of USGS data products published between 1987 and 2022. Results were analyzed to show which FAIR characteristics were most and least present in the metadata and how these scores changed after the implementation of data policy requirements in 2016. Aggregated scores showed specific areas of strength and needed improvements. The greatest increases in FAIR scores over time were for elements that were required by new data policies, especially in the ‘Findable’ category. Based on the results, this paper presents strategies to further improve USGS alignment with FAIR. The suggested strategies are organized in four key areas: USGS data repository characteristics, training and communities of practice, data management policy considerations, and metadata standards, tools, and best practices.

Data Science Journal

Are researchers citing their data? A case study from the U.S. Geological Survey

Data citation promotes accessibility and discoverability of data through measures carried out by researchers, publishers, repositories, and the scientific community. This paper examines how a data citation workflow has been implemented by the U.S. Geological Survey (USGS) by evaluating publication and data linkages. Two different methods were used to identify data citations: examining publication structural metadata and examining the full text of the publication. A growing number of USGS researchers are complying with publisher data sharing policies aimed to capture data citation information in a standardized way within associated publications. However, inconsistencies in how data citation information is documented in publications has limited the accessibility and discoverability of the data. This paper demonstrates how organizational evaluations of publication and data linkages can be used to identify obstacles in advancing data citation efforts and improve data citation workflows.

Data Science Journal

Developing criteria to establish Trusted Digital Repositories

This paper details the drivers, methods, and outcomes of the U.S. Geological Survey’s quest to establish criteria by which to judge its own digital preservation resources as Trusted Digital Repositories. Drivers included recent U.S. legislation focused on data and asset management conducted by federal agencies spending $100M USD or more annually on research activities. The methods entailed seeking existing evaluation criteria from national and international organizations such as International Standards Organization (ISO), U.S. Library of Congress, and Data Seal of Approval upon which to model USGS repository evaluations. Certification, complexity, cost, and usability of existing evaluation models were key considerations. The selected evaluation method was derived to allow the repository evaluation process to be transparent, understandable, and defensible; factors that are critical for judging competing, internal units. Implementing the chosen evaluation criteria involved establishing a cross-agency, multi-disciplinary team that interfaced across the organization.

Data Science Journal