Enterprise GIS for the NCGMP Community
Integrating GIS data
Modernizing Mapping Techniques
We are focused on modernizing digital infrastructure by implementing a web-services based, enterprise GIS architecture focused on enabling scientific collaboration across geographically dispersed FEDMAP scientists. This project supports geologic mapping goals set forth by the National Geologic Mapping Act of 1992 and the vision of the National Cooperative Geologic Mapping Program (NCGMP). Prior to 2019, scientists collaborated on editing and referencing geologic vector and raster data across offices, using ‘on-premise’, direct connect database architecture. Due to the growth of USGS IT infrastructure, complex security configurations, and the speed of technological evolution, the NCGMP developed a need for dedicated Geographic Information Systems Technology staff to implement a scalable solution.
We've built relationships among the USGS Office of the Associate Chief Information Officer, Cloud Hosted Services, End User Services, Core Science Systems, National Geospatial Program, National Geospatial Technic
Science Issue and Relevance:
Previous geologic mapping workflows and database schemas employed by most FEDMAP projects have typically been implemented by individuals or on a project-by-project basis. While these methods have produced significant scientific research, the customized processes resulted in geologic map databases with different schemas, attributes, and symbology, which are difficult to integrate. In addition, each field geologist has his or her own way of collecting field data (usually a hybrid digital/analog process). These project-level databases and associated field data commonly reside on desktop computers, further hindering collaborative use. These factors increase the amount of time it takes to complete a map from field to publication, hinders collaboration with other scientists, and can affect the quality of the data and science. Data management, typically, is handled on an individual, or project-by-project basis, which may result in duplication of data, wasted resources and data security risks. Project-specific data organization structures and schema make it difficult to efficiently combine data from adjacent areas and provinces. Together with standards set forth by the National Geologic Map Database (NGMDB) this project aims to address these issues by implementing an enterprise GIS system with a two-pronged approach: modernizing infrastructure and expanding workforce capacity.
With diverse mapping projects and NCGMP-supported staff distributed in seven western US field offices, the Geology, Minerals, Energy, and Geophysics Science Center (GMEGSC) is an ideal candidate for developing and testing the capabilities of enterprise GIS infrastructure and workflows for geologic mapping. If a web-based enterprise GIS can be successfully applied within GMEGSC, it has the potential to expand to interface with all FEDMAP projects, and potentially to the non-federal (STATEMAP and EDMAP) components of the NCGMP.
Modernizing Infrastructure
Research Deployment and Integration of Cloud and/or On-Premise GIS Server Roles as part of an Enterprise GIS for a Distributed Work Group
The primary objective of this task is to implement the Server GIS component of an enterprise GIS solution to provide a viable means for geographically distributed geologic-mapping staff to collaboratively access and edit off-premise geospatial data (i.e. data hosted on remote servers). Phase 1 of project funding (FY19-FY22) focuses on designing the needed architecture of ArcGIS Enterprise and the installation, configuration, deployment, and maintenance of the ‘testing and development environment’ within EROS Infrastructure with an eye toward automation. Longer term integrations such with ‘staging’ and ‘production’ environments or hybridized infrastructure with the USGS Cloud Hosted Service’s (CHS) Virtual Private Cloud (VPC) are envisioned. The work of this project is operational in nature yet dove-tailed with research. Phases 2 and 3, the remaining 8 years of an NCGMP 12-year project cycle, are dependent on outcomes of Phase 1.
Our methods employ cycles of research, development, and testing, followed by refinement and maintenance, and are underpinned by an automation framework and a standardized GIS platform.
A successful deployment of a larger longer-term system will improve the efficiency of geologic map compilation within distributed mapping projects and enhance collaboration among projects and science centers. This outcome will support the Program’s decadal goals of maximizing beneficial partnering between all Program components, developing the technology infrastructure for constructing a seamless 2D / 3D geologic framework model, and by increasing map production through efficiencies. It should be noted that Online GIS (i.e. ArcGIS Online for Organizations) while part of the planned enterprise GIS solution, does not enable advanced editing workflows nor the serving of project imagery utilized by a geologic mapper. These and other advanced functionalities are only enabled via Server GIS (i.e. ArcGIS Enterprise).
Expanding Workforce Capacity
Modernization of geologic mapping workflows, from field data collection to data compilation and data sharing using an Enterprise GIS for a Distributed Workgroup
The objectives of this task focus on building collective community, and providing training and resources for individual geoscientists and project teams to modernize their workflows as desired/needed to effectively collaborate on data curation and derived map products.
Primary objectives are:
- to modernize the technical workflows used by the mapping projects (from field data collection to publication) to leverage the enhanced/modern functionalities of Desktop, Online, Mobile and Server GIS.
- to improve schema and attribute standardization by assisting in the application of Geologic Map Schema (GeMS) data model and Federal Geographic Data Community (FGDC) cartographic standards to improve integration of geologic map databases.
- to develop standards, train project chiefs and enable the serving of up-to-date mapping ‘status’ datasets to improve collaboration and project planning for reference in an Online GIS (i.e.: ArcGIS Online for Organizations).
We employ community education focused on increased and aligned technical capability.
Using the USGS ArcGIS Online for Organizations subscription and mobile data collection apps such as, but not limited to "Survey123" and "Collector for ArcGIS", scientists can collect data more efficiently using customizable preset fields. This significantly decreases the time it takes to translate otherwise handwritten data, manually cataloged GPS points and photos collected on a handheld camera. Once back in the office, scientists can utilize ArcGIS Pro to stream in their field collection data as well as ancillary datasets, such as feature services enabled with versioning for project database collaboration and image services, with the latter items broadcasted for reference by the server implementation outlined in Task 1.
Success in these efforts will improve the efficiency of geologic map development/publication and will improve collaborative efforts between projects and science centers within the greater FEDMAP geologic mapping community. The ability to integrate databases for analytical purposes, or to produce derivative databases and maps, would also improve.
Moving forward we hope to:
Improve Data Accessibility
-
Mapping teams view datasets of other relevant work in progress, informing field work and analyses, and fostering synthesis of science within or across province areas.
-
Mapping teams stream raster and vector base data (such as LiDAR) as a Service rather than manually downloading project area data, duplicating storage costs, and failing to employ metadata best practices.
-
3D web scenes of geologic information, for internal viewing, eventually become external with an implemented vetting process and adopted standardized format.
-
Internal viewing of geospatial data is used within web maps and Story Map templates to improve general understanding of projects and ties to mission areas.
-
Curation and vetting of Project Story Maps will be enabled for public viewing through Programmatic standards.
Improve Accuracy and Integrity of Geographic Information
-
Improve quality of geospatial information (geologic map data), employ metadata standards, lessen the time from field collection to map production, improve workflows, integrate with larger program data processes.
Improve Data Storage, Data Management Best Practices, and Database Schema Standardization
-
Reduce redundancy of data, utilize storage efficiently
-
Establish System Data Management Plan(s)
Promote Data Management Plan curation among FEDMAP projects
-
Accelerate implementation of the GeMS data model for individual geologic map products (differing from multi-map or regional geologic map compilations)
-
Integrate use of mobile field data collection workflow into geologic map compilation
Improved Digital Integration with all NCGMP Components
-
Establish ‘Distributed Collaboration’ with State/Academic ArcGIS Enterprise entities to promote: sharing of data (as living services, not copies), collaboration on datasets (as living services, not copies), story maps/apps of combined projects to unite science synthesis message for the public and enable collective understanding of geologic provinces.
-
Establish ‘Distributed Collaboration’ with STATEMAP and EDMAP ArcGIS Enterprise entities as described above.
Development of Technology Framework to Support Decadal Program Goal of Creating a National 2D/3D Geologic Framework Model
-
Improve data collaboration through geospatial workflows that will advance the long-term Program goal of developing a national 2D/3D geologic framework model.
-
Integrate the geospatial infrastructure needs of the science centers and Program collectively rather than individually.
-
Deploy a technology that can support national multi-map 2D geologic databases
-
Deploy a technology that can support national 3D geologic map databases
-
Deploy a technology that can serve 3D data as a web service
Informed Society, and Improved Public Perception
-
Visual, digital, interactive web and mobile technology engages citizens and grows collective knowledge and understanding of geologic processes. Sharing and interacting with the public as a Science, Technology, Engineering, and Math.field will encourage future generations to become active in science and technology.
Below are other science projects associated with this project.
San Andreas Fault System in Southern California
Geologic Mapping of the Lower Colorado River System
Pacific Northwest Geologic Mapping: Northern Pacific Border, Cascades and Columbia
Geologic Framework of the Intermountain West
Western Basin & Range - Eastern California Shear Zone
Appalachian Basin Geologic Mapping Project
GeoMapping for Integrated Science
Geologic Mapping in the Southern Pacific Border and Sierras provinces, California
We are focused on modernizing digital infrastructure by implementing a web-services based, enterprise GIS architecture focused on enabling scientific collaboration across geographically dispersed FEDMAP scientists. This project supports geologic mapping goals set forth by the National Geologic Mapping Act of 1992 and the vision of the National Cooperative Geologic Mapping Program (NCGMP). Prior to 2019, scientists collaborated on editing and referencing geologic vector and raster data across offices, using ‘on-premise’, direct connect database architecture. Due to the growth of USGS IT infrastructure, complex security configurations, and the speed of technological evolution, the NCGMP developed a need for dedicated Geographic Information Systems Technology staff to implement a scalable solution.
We've built relationships among the USGS Office of the Associate Chief Information Officer, Cloud Hosted Services, End User Services, Core Science Systems, National Geospatial Program, National Geospatial Technic
Science Issue and Relevance:
Previous geologic mapping workflows and database schemas employed by most FEDMAP projects have typically been implemented by individuals or on a project-by-project basis. While these methods have produced significant scientific research, the customized processes resulted in geologic map databases with different schemas, attributes, and symbology, which are difficult to integrate. In addition, each field geologist has his or her own way of collecting field data (usually a hybrid digital/analog process). These project-level databases and associated field data commonly reside on desktop computers, further hindering collaborative use. These factors increase the amount of time it takes to complete a map from field to publication, hinders collaboration with other scientists, and can affect the quality of the data and science. Data management, typically, is handled on an individual, or project-by-project basis, which may result in duplication of data, wasted resources and data security risks. Project-specific data organization structures and schema make it difficult to efficiently combine data from adjacent areas and provinces. Together with standards set forth by the National Geologic Map Database (NGMDB) this project aims to address these issues by implementing an enterprise GIS system with a two-pronged approach: modernizing infrastructure and expanding workforce capacity.
With diverse mapping projects and NCGMP-supported staff distributed in seven western US field offices, the Geology, Minerals, Energy, and Geophysics Science Center (GMEGSC) is an ideal candidate for developing and testing the capabilities of enterprise GIS infrastructure and workflows for geologic mapping. If a web-based enterprise GIS can be successfully applied within GMEGSC, it has the potential to expand to interface with all FEDMAP projects, and potentially to the non-federal (STATEMAP and EDMAP) components of the NCGMP.
Modernizing Infrastructure
Research Deployment and Integration of Cloud and/or On-Premise GIS Server Roles as part of an Enterprise GIS for a Distributed Work Group
The primary objective of this task is to implement the Server GIS component of an enterprise GIS solution to provide a viable means for geographically distributed geologic-mapping staff to collaboratively access and edit off-premise geospatial data (i.e. data hosted on remote servers). Phase 1 of project funding (FY19-FY22) focuses on designing the needed architecture of ArcGIS Enterprise and the installation, configuration, deployment, and maintenance of the ‘testing and development environment’ within EROS Infrastructure with an eye toward automation. Longer term integrations such with ‘staging’ and ‘production’ environments or hybridized infrastructure with the USGS Cloud Hosted Service’s (CHS) Virtual Private Cloud (VPC) are envisioned. The work of this project is operational in nature yet dove-tailed with research. Phases 2 and 3, the remaining 8 years of an NCGMP 12-year project cycle, are dependent on outcomes of Phase 1.
Our methods employ cycles of research, development, and testing, followed by refinement and maintenance, and are underpinned by an automation framework and a standardized GIS platform.
A successful deployment of a larger longer-term system will improve the efficiency of geologic map compilation within distributed mapping projects and enhance collaboration among projects and science centers. This outcome will support the Program’s decadal goals of maximizing beneficial partnering between all Program components, developing the technology infrastructure for constructing a seamless 2D / 3D geologic framework model, and by increasing map production through efficiencies. It should be noted that Online GIS (i.e. ArcGIS Online for Organizations) while part of the planned enterprise GIS solution, does not enable advanced editing workflows nor the serving of project imagery utilized by a geologic mapper. These and other advanced functionalities are only enabled via Server GIS (i.e. ArcGIS Enterprise).
Expanding Workforce Capacity
Modernization of geologic mapping workflows, from field data collection to data compilation and data sharing using an Enterprise GIS for a Distributed Workgroup
The objectives of this task focus on building collective community, and providing training and resources for individual geoscientists and project teams to modernize their workflows as desired/needed to effectively collaborate on data curation and derived map products.
Primary objectives are:
- to modernize the technical workflows used by the mapping projects (from field data collection to publication) to leverage the enhanced/modern functionalities of Desktop, Online, Mobile and Server GIS.
- to improve schema and attribute standardization by assisting in the application of Geologic Map Schema (GeMS) data model and Federal Geographic Data Community (FGDC) cartographic standards to improve integration of geologic map databases.
- to develop standards, train project chiefs and enable the serving of up-to-date mapping ‘status’ datasets to improve collaboration and project planning for reference in an Online GIS (i.e.: ArcGIS Online for Organizations).
We employ community education focused on increased and aligned technical capability.
Using the USGS ArcGIS Online for Organizations subscription and mobile data collection apps such as, but not limited to "Survey123" and "Collector for ArcGIS", scientists can collect data more efficiently using customizable preset fields. This significantly decreases the time it takes to translate otherwise handwritten data, manually cataloged GPS points and photos collected on a handheld camera. Once back in the office, scientists can utilize ArcGIS Pro to stream in their field collection data as well as ancillary datasets, such as feature services enabled with versioning for project database collaboration and image services, with the latter items broadcasted for reference by the server implementation outlined in Task 1.
Success in these efforts will improve the efficiency of geologic map development/publication and will improve collaborative efforts between projects and science centers within the greater FEDMAP geologic mapping community. The ability to integrate databases for analytical purposes, or to produce derivative databases and maps, would also improve.
Moving forward we hope to:
Improve Data Accessibility
-
Mapping teams view datasets of other relevant work in progress, informing field work and analyses, and fostering synthesis of science within or across province areas.
-
Mapping teams stream raster and vector base data (such as LiDAR) as a Service rather than manually downloading project area data, duplicating storage costs, and failing to employ metadata best practices.
-
3D web scenes of geologic information, for internal viewing, eventually become external with an implemented vetting process and adopted standardized format.
-
Internal viewing of geospatial data is used within web maps and Story Map templates to improve general understanding of projects and ties to mission areas.
-
Curation and vetting of Project Story Maps will be enabled for public viewing through Programmatic standards.
Improve Accuracy and Integrity of Geographic Information
-
Improve quality of geospatial information (geologic map data), employ metadata standards, lessen the time from field collection to map production, improve workflows, integrate with larger program data processes.
Improve Data Storage, Data Management Best Practices, and Database Schema Standardization
-
Reduce redundancy of data, utilize storage efficiently
-
Establish System Data Management Plan(s)
Promote Data Management Plan curation among FEDMAP projects
-
Accelerate implementation of the GeMS data model for individual geologic map products (differing from multi-map or regional geologic map compilations)
-
Integrate use of mobile field data collection workflow into geologic map compilation
Improved Digital Integration with all NCGMP Components
-
Establish ‘Distributed Collaboration’ with State/Academic ArcGIS Enterprise entities to promote: sharing of data (as living services, not copies), collaboration on datasets (as living services, not copies), story maps/apps of combined projects to unite science synthesis message for the public and enable collective understanding of geologic provinces.
-
Establish ‘Distributed Collaboration’ with STATEMAP and EDMAP ArcGIS Enterprise entities as described above.
Development of Technology Framework to Support Decadal Program Goal of Creating a National 2D/3D Geologic Framework Model
-
Improve data collaboration through geospatial workflows that will advance the long-term Program goal of developing a national 2D/3D geologic framework model.
-
Integrate the geospatial infrastructure needs of the science centers and Program collectively rather than individually.
-
Deploy a technology that can support national multi-map 2D geologic databases
-
Deploy a technology that can support national 3D geologic map databases
-
Deploy a technology that can serve 3D data as a web service
Informed Society, and Improved Public Perception
-
Visual, digital, interactive web and mobile technology engages citizens and grows collective knowledge and understanding of geologic processes. Sharing and interacting with the public as a Science, Technology, Engineering, and Math.field will encourage future generations to become active in science and technology.
Below are other science projects associated with this project.