Skip to main content
U.S. flag

An official website of the United States government

USGS Data at Risk: Expanding Legacy Data Inventory and Preservation Strategies

Completed
By Community for Data Integration (CDI) February 28, 2017

As one of the largest and oldest science organizations in the world, USGS has produced more than a century of earth science data, much of which  is currently unavailable to the greater scientific community due to inaccessible or obsolescent media, formats, and technology. Tapping this vast wealth of “dark data” requires 1) a complete inventory of legacy data and 2) methods and tools to effectively evaluate, prioritize, and preserve the data with the greatest potential impact to society. Recognizing these truths and the potential value of legacy data, USGS has been investigating legacy data management and preservation since 2006, including the 2016 “DaR” project, which developed legacy data inventory and evaluation methods and then tested them while preserving and releasing 5 at-risk USGS legacy datasets. This FY17 project will build on those FY16 project successes by:

  1. Improving the legacy data evaluation and prioritization algorithms and increasing user workflow efficiency.
  2. Promoting and expanding the USGS legacy data inventory.
  3. Continuing to preserve and publish critical, at-risk USGS legacy products.

The methods and tools developed through this project will enable USGS Mission Areas, Programs and science centers to efficiently evaluate their legacy data inventories and cost-effectively preserve their highest-priority legacy data products.

Principal Investigator : Anthony L Everette, Tara M Bell

Image of the contents of a repeat photo stake folder.

Developing a USGS Legacy Data Inventory to Preserve and Release Historical USGS Data

Legacy data (n) - Information stored in an old or obsolete format or computer system that is, therefore, difficult to access or process. (Business Dictionary, 2016) For over 135 years, the U.S. Geological Survey has collected diverse information about the natural world and how it interacts with society. Much of this legacy information is one-of-a-kind and in danger of being lost forever...
By
Core Science Systems Mission Area, Science Analytics and Synthesis (SAS), Community for Data Integration (CDI), Earth Resources Observation and Science (EROS) Center, Fort Collins Science Center, Great Lakes Science Center
Developing a USGS Legacy Data Inventory to Preserve and Release Historical USGS Data

Developing a USGS Legacy Data Inventory to Preserve and Release Historical USGS Data

Legacy data (n) - Information stored in an old or obsolete format or computer system that is, therefore, difficult to access or process. (Business Dictionary, 2016) For over 135 years, the U.S. Geological Survey has collected diverse information about the natural world and how it interacts with society. Much of this legacy information is one-of-a-kind and in danger of being lost forever through
Learn More
Little brown bat with white-nose syndrome

North American Bat Data Integration

The purpose of this project was to integrate the Bat Banding Program data (1932-1972) and the U.S. and Canada diagnostic data for white-nose syndrome with the USGS Bat Population Data (BPD) Project and provide the bat research community with secure, role-based access to these previously unavailable datasets. The objectives of this project were to: 1) integrate WNS diagnostic data into...
By
Core Science Systems Mission Area, Science Analytics and Synthesis (SAS), Community for Data Integration (CDI), Fort Collins Science Center
North American Bat Data Integration

North American Bat Data Integration

The purpose of this project was to integrate the Bat Banding Program data (1932-1972) and the U.S. and Canada diagnostic data for white-nose syndrome with the USGS Bat Population Data (BPD) Project and provide the bat research community with secure, role-based access to these previously unavailable datasets. The objectives of this project were to: 1) integrate WNS diagnostic data into the BPD
Learn More
Paper punch tapes from Illinois stream gauge data.

Mining the USGS Data Landscape

The scientific legacy of the USGS is the data and the scientific knowledge derived from it gathered over 130 years of research. However, it is widely assumed, and in some cases known, that high quality data, particularly legacy data critical for large time-scale analyses such as climate change and habitat change, is hidden away in case files, file cabinets, and hard drives housed in USGS...
By
Core Science Systems Mission Area, Science Analytics and Synthesis (SAS), Community for Data Integration (CDI), Fort Collins Science Center
Mining the USGS Data Landscape

Mining the USGS Data Landscape

The scientific legacy of the USGS is the data and the scientific knowledge derived from it gathered over 130 years of research. However, it is widely assumed, and in some cases known, that high quality data, particularly legacy data critical for large time-scale analyses such as climate change and habitat change, is hidden away in case files, file cabinets, and hard drives housed in USGS science
Learn More

Central Mojave Desert Vegetation Mapping Project, California, 1997-1999: Plots Points and Photographs Central Mojave Desert Vegetation Mapping Project, California, 1997-1999: Plots Points and Photographs

The Mojave Plots Points data are 1,219 plot locations in the Central Mojave Desert where field data were recorded and photographs were taken from 1997-1999 to provide context for the classification of the Central Mojave Desert into various vegetation classes. The 1,219 plot locations in the plots points shapefile (plots_points.shp) are each assigned a unique identifier called the...
By
Core Science Systems Mission Area, Science Analytics and Synthesis (SAS), Community for Data Integration (CDI), Fort Collins Science Center, Great Lakes Science Center, Southwest Biological Science Center, Communications and Publishing

Magnetotelluric Data from the San Andreas Fault, Parkfield CA, 1990 Magnetotelluric Data from the San Andreas Fault, Parkfield CA, 1990

The U.S. Geological Survey (USGS) Geology, Geophysics and Geochemistry Science Center (GGGSC) collaborated with the USGS Data at Risk (DaR) team to preserve and release a subset of magnetotelluric data from the San Andreas Fault in Parkfield, California. The San Andreas Fault data were collected by the Branch of Geophysics, a precursor to the now GGGSC, between 1989 and 1994. The...
By
Core Science Systems Mission Area, Science Analytics and Synthesis (SAS), Community for Data Integration (CDI), Fort Collins Science Center, Great Lakes Science Center

Migrating Bird Survey Data Along the San Pedro River and its Tributaries, Southeastern Arizona, 1989-1994 Migrating Bird Survey Data Along the San Pedro River and its Tributaries, Southeastern Arizona, 1989-1994

Data files in this data series represent migrating bird count and habitat information collected during 1989, 1991, 1993, and 1994 field seasons at 13 riparian sites along the San Pedro River and its tributaries in southeastern Arizona, USA. At each site observations were made at up to 20 points, separated by 100 m arrayed along the riparian zone. Observation periods started at 20 minutes...
By
Community for Data Integration (CDI), Fort Collins Science Center

Community for Data Integration 2017 annual report Community for Data Integration 2017 annual report

The Community for Data Integration (CDI) is a group that helps members grow their expertise on all aspects of working with scientific data. The CDI’s activities advance data and information integration capabilities in the U.S. Geological Survey and in the wider Earth and biological sciences. This annual report describes the presentations, activities, collaboration areas, workshop, and...
Authors
Leslie Hsu, Madison L. Langseth
By
Science Synthesis, Analysis, and Research Program, Science Analytics and Synthesis (SAS), Community for Data Integration (CDI), Science Data Management

Software to Process and Preserve Legacy Magnetotelluric Data Software to Process and Preserve Legacy Magnetotelluric Data

The USGS Crustal Geophysics and Geochemistry Science Center (CGGSC) collaborated with the USGS Data at Risk (DaR) team to preserve and release a subset of magnetotelluric data from the San Andreas Fault in Parkfield, California. The San Andreas Fault data were collected by the Branch of Geophysics, a precursor to the now CGGSC, between 1989 and 1994. The magnetotelluric data selected for...
By
Core Science Systems Mission Area, Science Analytics and Synthesis (SAS), Community for Data Integration (CDI), Fort Collins Science Center

Lance Everette (Former Employee)

Technical Information Specialist
Communications and Publishing

Tara M Bell

Librarian (Data Scientist)
Great Lakes Science Center
Phone
734-214-7210

As one of the largest and oldest science organizations in the world, USGS has produced more than a century of earth science data, much of which  is currently unavailable to the greater scientific community due to inaccessible or obsolescent media, formats, and technology. Tapping this vast wealth of “dark data” requires 1) a complete inventory of legacy data and 2) methods and tools to effectively evaluate, prioritize, and preserve the data with the greatest potential impact to society. Recognizing these truths and the potential value of legacy data, USGS has been investigating legacy data management and preservation since 2006, including the 2016 “DaR” project, which developed legacy data inventory and evaluation methods and then tested them while preserving and releasing 5 at-risk USGS legacy datasets. This FY17 project will build on those FY16 project successes by:

  1. Improving the legacy data evaluation and prioritization algorithms and increasing user workflow efficiency.
  2. Promoting and expanding the USGS legacy data inventory.
  3. Continuing to preserve and publish critical, at-risk USGS legacy products.

The methods and tools developed through this project will enable USGS Mission Areas, Programs and science centers to efficiently evaluate their legacy data inventories and cost-effectively preserve their highest-priority legacy data products.

Principal Investigator : Anthony L Everette, Tara M Bell

Image of the contents of a repeat photo stake folder.

Developing a USGS Legacy Data Inventory to Preserve and Release Historical USGS Data

Legacy data (n) - Information stored in an old or obsolete format or computer system that is, therefore, difficult to access or process. (Business Dictionary, 2016) For over 135 years, the U.S. Geological Survey has collected diverse information about the natural world and how it interacts with society. Much of this legacy information is one-of-a-kind and in danger of being lost forever...
By
Core Science Systems Mission Area, Science Analytics and Synthesis (SAS), Community for Data Integration (CDI), Earth Resources Observation and Science (EROS) Center, Fort Collins Science Center, Great Lakes Science Center
Developing a USGS Legacy Data Inventory to Preserve and Release Historical USGS Data

Developing a USGS Legacy Data Inventory to Preserve and Release Historical USGS Data

Legacy data (n) - Information stored in an old or obsolete format or computer system that is, therefore, difficult to access or process. (Business Dictionary, 2016) For over 135 years, the U.S. Geological Survey has collected diverse information about the natural world and how it interacts with society. Much of this legacy information is one-of-a-kind and in danger of being lost forever through
Learn More
Little brown bat with white-nose syndrome

North American Bat Data Integration

The purpose of this project was to integrate the Bat Banding Program data (1932-1972) and the U.S. and Canada diagnostic data for white-nose syndrome with the USGS Bat Population Data (BPD) Project and provide the bat research community with secure, role-based access to these previously unavailable datasets. The objectives of this project were to: 1) integrate WNS diagnostic data into...
By
Core Science Systems Mission Area, Science Analytics and Synthesis (SAS), Community for Data Integration (CDI), Fort Collins Science Center
North American Bat Data Integration

North American Bat Data Integration

The purpose of this project was to integrate the Bat Banding Program data (1932-1972) and the U.S. and Canada diagnostic data for white-nose syndrome with the USGS Bat Population Data (BPD) Project and provide the bat research community with secure, role-based access to these previously unavailable datasets. The objectives of this project were to: 1) integrate WNS diagnostic data into the BPD
Learn More
Paper punch tapes from Illinois stream gauge data.

Mining the USGS Data Landscape

The scientific legacy of the USGS is the data and the scientific knowledge derived from it gathered over 130 years of research. However, it is widely assumed, and in some cases known, that high quality data, particularly legacy data critical for large time-scale analyses such as climate change and habitat change, is hidden away in case files, file cabinets, and hard drives housed in USGS...
By
Core Science Systems Mission Area, Science Analytics and Synthesis (SAS), Community for Data Integration (CDI), Fort Collins Science Center
Mining the USGS Data Landscape

Mining the USGS Data Landscape

The scientific legacy of the USGS is the data and the scientific knowledge derived from it gathered over 130 years of research. However, it is widely assumed, and in some cases known, that high quality data, particularly legacy data critical for large time-scale analyses such as climate change and habitat change, is hidden away in case files, file cabinets, and hard drives housed in USGS science
Learn More

Central Mojave Desert Vegetation Mapping Project, California, 1997-1999: Plots Points and Photographs Central Mojave Desert Vegetation Mapping Project, California, 1997-1999: Plots Points and Photographs

The Mojave Plots Points data are 1,219 plot locations in the Central Mojave Desert where field data were recorded and photographs were taken from 1997-1999 to provide context for the classification of the Central Mojave Desert into various vegetation classes. The 1,219 plot locations in the plots points shapefile (plots_points.shp) are each assigned a unique identifier called the...
By
Core Science Systems Mission Area, Science Analytics and Synthesis (SAS), Community for Data Integration (CDI), Fort Collins Science Center, Great Lakes Science Center, Southwest Biological Science Center, Communications and Publishing

Magnetotelluric Data from the San Andreas Fault, Parkfield CA, 1990 Magnetotelluric Data from the San Andreas Fault, Parkfield CA, 1990

The U.S. Geological Survey (USGS) Geology, Geophysics and Geochemistry Science Center (GGGSC) collaborated with the USGS Data at Risk (DaR) team to preserve and release a subset of magnetotelluric data from the San Andreas Fault in Parkfield, California. The San Andreas Fault data were collected by the Branch of Geophysics, a precursor to the now GGGSC, between 1989 and 1994. The...
By
Core Science Systems Mission Area, Science Analytics and Synthesis (SAS), Community for Data Integration (CDI), Fort Collins Science Center, Great Lakes Science Center

Migrating Bird Survey Data Along the San Pedro River and its Tributaries, Southeastern Arizona, 1989-1994 Migrating Bird Survey Data Along the San Pedro River and its Tributaries, Southeastern Arizona, 1989-1994

Data files in this data series represent migrating bird count and habitat information collected during 1989, 1991, 1993, and 1994 field seasons at 13 riparian sites along the San Pedro River and its tributaries in southeastern Arizona, USA. At each site observations were made at up to 20 points, separated by 100 m arrayed along the riparian zone. Observation periods started at 20 minutes...
By
Community for Data Integration (CDI), Fort Collins Science Center

Community for Data Integration 2017 annual report Community for Data Integration 2017 annual report

The Community for Data Integration (CDI) is a group that helps members grow their expertise on all aspects of working with scientific data. The CDI’s activities advance data and information integration capabilities in the U.S. Geological Survey and in the wider Earth and biological sciences. This annual report describes the presentations, activities, collaboration areas, workshop, and...
Authors
Leslie Hsu, Madison L. Langseth
By
Science Synthesis, Analysis, and Research Program, Science Analytics and Synthesis (SAS), Community for Data Integration (CDI), Science Data Management

Software to Process and Preserve Legacy Magnetotelluric Data Software to Process and Preserve Legacy Magnetotelluric Data

The USGS Crustal Geophysics and Geochemistry Science Center (CGGSC) collaborated with the USGS Data at Risk (DaR) team to preserve and release a subset of magnetotelluric data from the San Andreas Fault in Parkfield, California. The San Andreas Fault data were collected by the Branch of Geophysics, a precursor to the now CGGSC, between 1989 and 1994. The magnetotelluric data selected for...
By
Core Science Systems Mission Area, Science Analytics and Synthesis (SAS), Community for Data Integration (CDI), Fort Collins Science Center

Lance Everette (Former Employee)

Technical Information Specialist
Communications and Publishing

Tara M Bell

Librarian (Data Scientist)
Great Lakes Science Center
Phone
734-214-7210
Was this page helpful?