Evaluations are a key part of USGS culture and are critical to maintaining our reputation for scientific excellence and credibility. The USGS conducts both peer and management reviews to evaluate our activities, consisting of both internal and external reviews by USGS and non-USGS scientists, technicians, or specialists who are not involved in the specific proposal, project, program, or product under review. The USGS goal is to seek an independent external peer review of ongoing programs about every five years, combined with more frequent independent internal management reviews. The evaluations are used for a number of purposes, including to: improve the accountability and quality of programs; identify and address gaps in programs; redirect or reaffirm program directions; identify and provide guidance for development of new programs; and reward and/or motivate managers and scientists.
A major partner in USGS external reviews is the National Research Council, which is conducting a study of the role of the USGS in the 21st Century, and has provided evaluations of USGS scientific activities in mineral and energy resources, volcanoes, and coastal and marine studies. The USGS also has a strong relationship with the National Academy of Public Administration (NAPA), which has conducted a review of our mapping programs; evaluated factors that may limit access to USGS disaster information; and conducted a functional review of USGS human resources roles and responsibilities as part of continuing efforts to streamline.
The program evaluations that contributed to the Strategic Plan are listed in the following table.
| Program Evaluation | Reviewer | 1Goal | Completed |
|---|---|---|---|
| Coastal and Marine Program | External Review by National Research Council | HAZ ENR |
1999 |
| Energy Program | External Revew by the National Research Council | ENR | 1999 |
| Earthquake Hazards: The Advanced National Seismic System | Internal Report prepared for Congress | HAZ | 1999 |
| Federal Advisory Committee on National Cooperative Geologic Mapping | Internal/External Panel | ENR | 1999 |
| Federal-State Cooperative Water Program | External Review by the National Research Council | ENR HAZ |
1999 |
| Fisheries and Aquatic Resources Program Review | Internal/External Review | ENR | 1999 |
| Gateway to the Earth Workshop | Internal/External Review by technical specialists from USGS, university and State governments | HAZ ENR |
1999 |
| Global Change Wetlands Program Review | Internal External Review | ENR | 1998 |
| Global Disaster Information Network | External Review by National Academy of Public Administration (NAPA) | HAZ | 1999 |
| Ground Water Resources Program | Internal Report prepared for Congress | ENR | 1999 |
| Human Resources Roles and Responsibilities | National Academy of Public Administration | HAZ ENR |
1999 |
| Hydrologic Hazards at USGS | External Review by the NRC | HAZ | 1999 |
| Landslide Hazards at USGS | Internal Report prepared for Congress | HAZ | 1999 |
| Meeting U.S. Energy Resource Needs - The Energy Resources Program of the USGS | Committee on Earth Resources, Commission on Geosciences, Environment, and Resources | ENR | 1999 |
| Mineral Resources and Society | A Review of the USGS Mineral Resource Surveys Program Plan, Natural Resource Council, Committee on Earth Resources, Commission on Geosciences, Environment, and Resources | ENR | 1996 |
| Mineral Resource Surveys | National Research Council | ENR | 1996 |
| Mineral Resources and Sustainability - Challenges for Earth Scientists | National Research Council, Committee on Earth Resources, Commission on Geosciences, Environment, and Resources | ENR | 1996 |
| National Digital Orthophoto Program (NDOP) | Internal/External Review with multiple Federal agencies and National States Geographic Information Council | HAZ ENR |
1999 |
| National Mapping Program Private Sector Relationships | Internal/External Review by senior management and private sector partners | ENR | 1999 |
| National Water Quality Assessment Program; the Challenge of National Synthesis | National Research Council, Committee on USGS, Water Resources Research, Water Science and Technology Board | ENR | 1994 |
| Preparing for the 21st Century; a Report to the USGS Water Resources Division | National Research Council, Committee on USGSS, Water Resources Research, Water Science and Technology Board | HAZ ENR |
1992 |
| Regional Hydrology and the USGS Stream Gaging Network | National Research Council, Committee on USGS, Water Resources Research, Water Science and Technology Board | HAZ ENR |
1992 |
| Science for Decisionmaking - Coastal and Marine Geology at the USGS | National Research Council, Ocean Studies Board, Commission on Geosciences, Environment, and Resources | ENR | 1999 |
| Status and Trends Program Review | Internal/External Review | ENR | 1999 |
| Strategic Directions for the USGS | Internal Review | HAZ ENR |
1999 |
| Water Resources Division Streamgage Program | Internal Report prepared for Congress | HAZ ENR |
1998 |
| Activities of the USGS Upper Midwest Environmental Sciences Center | DOI Inspector General to support Corps of Engineers management requirements | ENR | 1998 |
These reviews and evaluations collectively shaped this plan. In particular, many evaluations stressed the need for more integrated and coordinated science at the USGS. For example:
The above bulleted recommendations contributed to the development of revised performance measures for real-time hazards information and support the plan´s emphasis on predictive modeling and decision support systems development. In addition, the Bureau´s internal review of its streamgaging network revealed that the previous long-term goal related to streamgaging, which counted the number of streamgages with telemetry, was not the best assessment of the utility of the network. As a result, a revised long-term target was developed based on the average number of gages reporting data on the World Wide Web.
Another important theme of these evaluations that was incorporated into the Strategic Plan is that of partnerships and collaboration. For example:
This emphasis on partnerships and customers is reflected in our performance measures for stakeholder meetings and customer satisfaction and in the many listening sessions held by USGS program managers to enhance USGS partnerships.
The following table shows evaluations planned for 2000 and 2001.
| Program Evaluation | Scope | Methodology | USGS Goal | Schedule |
|---|---|---|---|---|
| Alaska Programs and Projects | Explore ways to work with stakeholders to document Alaska's landscape and natural resources | Internal/External Reviews with partners and customers | HAZ ENR |
Annual |
| Cooperative Programs | Annual review of data collection program strategies and plans by cooperators and partners |
External Reviews Partnership Biennial Meetings
|
ENR HAZ |
Annual |
| EPA Superfund Support | Maintenance of complete, accurate, and current site-specific cost records for Superfund projects; billing documentation; aappropriate reimbursements. | DOI IG audit | ENR | Annual |
| Exotic and Invasive Species Program Review | Entire Program | Internal/External Review | ENR | 2000 |
| Gateway to the Earth | Help USGS identify needs, framework, scope, standards, linkage to partners | Internal Review and External Reviews by DOI, OMB, Congress, and technical specialists from university and private sectors | HAZ ENR |
Annual |
| Ground-water Resources | Entire program -- review of regional ground-water studies | External Review by the NRC, DOI, OMB, Congress | ENR | 2001 |
| South Florida Ecosystems Restoration | Government-wide | GAO Audit and Programmatic Evaluation | ENR | 2000 |
| Upper Mississippi River system Environmental Management Program | Activities of the USGS Environmental Management Technical Center | DOI Inspector General Survey Report | ENR | 2000 |
| USGS Strategic Directions | Help USGS identify:
|
External Review by the National Research Council | HAZ ENR |
2000 |
| Volcano Hazards Program | Entire program | External Review by the National Research Council | HAZ | 2000 |
| Previous - Mission Goals -- Environment and Natural Resources | Next - Consultations |