PubTalk - 9/2021: Modernizing the National Water Information System

Video Transcript
Download Video
Right-click and save to download

Detailed Description

Modernizing the National Water Information System: Charting the Course for Delivering Water Data in the 21st Century

By: Daniel Pearson, USGS NWIS Modernization Program Manager, Water Mission Area

  • More rapid and accessible data delivery that will support the prediction of water hazards and water availability in near-real time.
  • Decision support tools that will aid the managing water supplies, flooding, drought, inundation, debris flow, water quality degradation, and other water-related hazards during extreme events and under future scenarios of changing population and climate.
  • A lean, consistent portfolio of national scale water web applications will be available through a mobile friendly and unified online presence, including expansion of the National Water Dashboard.

Details

Date Taken:

Length: 00:59:51

Location Taken: US

Transcript

Hello everybody and welcome

to EU S Geological Surveys

virtual public lecture series.

My name is William Selig and I

will be your host and moderator

tonight before we get started.

I have a few announcements to

make for next month's lecture.

We're going to have Laura

Thompson and Abigail Lynch,

who will be discussing climate

impacts on species there talk is

titled Zombie Salmon and Ghost Moose.

These spooky implications of climate

change and that talk will naturally be on.

Thursday, October 28th at 7:00 PM

for a very timely Halloween theme

talks so make sure to put that in

your calendars and now for anyone

new to our our our lectures.

Just a few tips on how to use some of

the features of our platform to turn

on closed captioning on your desktop.

You can do so by clicking on the

gear shaped icon which is located on

the upper right hand corner of your

screen's toward the end of the lecture.

We're going to open it up to the.

Question and answer session.

If you have any question for

tonight's speaker,

you can submit them through the Q&A chat

window to find the Q&A chat window.

I'll look forward the question

Mark Icon on the upper right hand

corner of your screen and that

will bring up the Q&A panel where

you can type in your question.

And if you're on a mobile device or an iPad,

you can click on the question Mark icon,

which is also located on the upper right

hand corner of the screen and submit

your question in the ask a question.

Toolbox do understand we may not have

time to answer all questions tonight,

just we appreciate your understanding in

advance and now a time for introductions.

So tonight we have Daniel Pearson

and Daniel will be discussing the

National Water Information System and

the USGS National Water dashboard.

So a little background on Daniel.

So Daniel Pearson has been with

the USGS since 2002.

In his current role with the

National Water Information System.

Modernization program manager.

He's leading a team that will

provide the necessary improvements

to that information system,

which we call in West.

In West is the world's largest

authoritative enterprise water

information system and is

foundational to advancing USGS water,

missionaria priorities and

meeting the needs of USGS water,

missionaria stakeholders and the

three million public users of water

information direct from the USGS.

Daniel earned his Bachelors of Science

from Texas State University in San Marcos

in GIS science and cartographic design.

So without further ado Daniel

I will hand you the floor.

K. Should have my screen now.

OK, great, thank you very much.

Will in Amelia for hosting.

I want to thank some folks just up

the top off the top and just say

thank you to the office communication

publications for hosting this event and

for allowing us to get this message out.

I also want to thank, UM, the, uh,

the employees of the water missionary and

our stakeholders for endless as a whole.

The National Water Information System is a

data management and data delivery system,

and the program that I am leading

stands on the shoulders of some pretty

big giants within the water missionary

that have gotten us to this point.

But this talk is going to be specifically

about how we're modernizing both

our data management systems and.

Our delivery systems over the next

five years and we're excited to

tell this story and excited to

answer questions about it.

So the just kind of overview of the talk

I'm going to give some context aware

this program actually emanates from.

We're going to talk about the USGS.

The water mission area we're going to

talk about some of the other programs

within the water missionary umbrella,

and then we'll talk about what endless is,

and then how we're modernizing it,

and what our future goals look like,

and we'll have some time for Q&A.

So to give context,

I think it's very important to

just kind of understand you all are

joining this lecture understanding.

I would assume a little bit about the USGS,

but just to explain how this program

is embedded within the USGS umbrella

in the water missionary umbrella.

And to remind folks about the mission

of the entire USGS is to say that our

lineages goes back quite some time

now to 1879 and that we are those soul

science agency within the Department

of Interior in our mission has evolved

over the decades really matching

our talent and our knowledge to the

progress of science and technology.

So we've had this evolution of since 1879,

but you know the goals here.

Of the mission or to monitor,

analyze, and predict.

The evolving dynamics of our human

and natural earth systems and then

deliver actionable intelligence.

This is really important because

endless at its root is core to

those mission statements.

Uhm,

the USGS is organized into these

five now 5 mission areas, hazards,

ecosystems, core science systems,

energy measurement,

minerals and water resources.

Core sign systems in charge of the

civilian mapping for the nation

ecosystems providing that science

and understanding of the biological

resources of the United States.

Energies and minerals.

Conducting the research and assessments

of the quantity and quality.

Of those resources and then hazards,

most folks know volcanoes, earthquakes.

But you know,

an understanding of the natural

hazards that threaten the citizens

in the United States and then lastly,

we have the water resources and

I'll talk about the missionary,

but the given context to the

water resources missionaria,

there's about 9000 employees,

roughly nationwide,

about 3000 of those sit in the water

mission area and we have not 100,

but we have over 1000.

Hydro text that actually do the

hard work of collecting data that

gets into endless for both our

partners and other federal agencies.

The USGS Water Resources missionary

also has 28 science centers

that are collecting data and

contributing data to endless

covering all 50 states of the nation.

So the important part, I guess,

drilling down into the water resources

mission area is that their statement

here states that we will provide and I

would kind of say deliver hydrologic

information and understanding needed

by others to achieve the best use

of our nation's water resources.

And I mentioned previously

that we do that with partners,

but those 28 water science centers worked

with hundreds and hundreds of state,

federal and local.

Entities to collect the appropriate

untimely water data to make these decisions.

So we're talking about a grassroots and

and really a shared effort to collect

water resources data for the nation.

Within the water missionaria.

Uhm we are organized via 14 science programs.

They're charges to fund research,

do monitoring develop these tools,

provide decision support and technical

assistance to manage those resources,

and we do that through a planning

and programming effort that

is funded via Congress.

All of these programs that

are doing the hard work of the

water Resources Mission area.

Are really aimed at two aspects.

One is our water missionaria science

strategy that lays out the next

several years of goals for the water

missionary and then responding to

the 2018 National Academy of Sciences

report that stated the future

priorities of the nation for water.

So in order to respond to those,

are science strategy lays

out these long term goals.

The position of agency to meet these

current and future needs and at the

heart of those are the observed,

the ability to basically collect

the data we need,

make predictions based on those

data collections,

do assessments at the national

and regional level,

and then deliver that to the public.

Now ten of the 14 programs are

very topically specific.

That collect data and do analysis

based on water quality processes,

droughts, echo flows,

hazards within water,

socioeconomic drivers associated with water,

water use and water budget as well as the

national hydrologic monitoring program.

These ten programs really are new in nature,

but delivering the goals that

are laid out in the science,

strategy and National Academy of Sciences.

Report to meet the four pieces at the center.

Here we have four additional programs and

this is where endless modernization fits in.

So to meet the observe strategic goal,

we have the next generation

water observing system.

This is really a program pointed

at high density networks,

new sensors,

new sensor technology that allows us

to make real time decisions and more

rapid decisions about water resources.

We also have a modeling program.

The integrated Water Prediction

Program that is taking those data.

Sets and building modeling tools that

allow us to make predictions on quantity,

quality of water, and understanding of

of natural systems that exist within EU.

S in addition, we also have this

integrated watershed assessments program,

which is the big picture assessment.

So looking at regional national assessments.

Really the tail end of all of our

science and data collection is to

make some make some assessments.

Of those resources at the end,

and then the last piece is where endless

fits in or endless modernization fits in.

And we're not only maintaining

and curating existing data systems

for public data dissemination.

Now, modernization brings into the

aspect of taking our existing systems,

building off of them,

and building for the future.

So let's talk about what is endless,

what is in those currently?

And then we're going to talk

about how we're modernizing it,

and how the tools that were developing.

So I know this is a system that honestly

has its roots in the very beginnings of

the water mission area within the GS.

In 1888, the USGS initiated the

National Stream Gauging program on the

Rio Grande near Embudo, New Mexico,

under the direction of our second director,

John Wesley Powell.

Uh, in 1894 Congress appropriated

dollars to undertake the reliable

and automated water stage recorders

installed at stream gauges to collect,

start to collect these data streams.

In the 60s we saw Luna Leopold's

bold vision that really looked at the

investment in research and science

related to hydrology in in our agency,

and then in 1972 the USGS began

experimenting with satellite

telemetry in its data collection,

as well as delivering that

information to the World Wide Web.

The Internet in the 80s so from 1988.

To 819 eight from 1888 to 1980,

we moved from our first stream

gauge to delivering data on the web.

Uhm, endless web, which is the web

interface for this data system has

existed obviously for a long time.

We started delivering our real time

data to the web and the national sense

in 1994 we were actually delivering

data at the state level before this,

but the national water information

system delivering data began in 1994 and

and really this was the first attempt.

The nationalized that data system

and get it out to the public

via one singular website.

Uh today uh, USGS is the largest

provider of this data in the world.

In the water mission area remains

absolutely committed to continuing.

The success of endless and pushing

it forward for the benefit of

our partners and the public.

Endless is described as a.

It says an ecosystem of both data

collections and software systems.

So this slide represents the

two parts of endless invoices.

Basically,

the authoritative data holdings

that include the majority of our

observed and computer water data.

But it's also the software and computing

systems that curate those data holdings

and allow the public release of our

end quality assured data at the end.

And there are two thematic

data areas that we operate in.

One is our discrete data,

right?

So these are measurements that

are collected in the field.

You see representation of our

hydrotec hydrotec in the field

collecting data whether it's sediment,

groundwater data,

field level measurements or even

water chemistry information.

These one time measurements are part

of potentially recurring studies or

something that requires laboratory analysis.

And I mentioned some of those data.

Seems the ground water level measurements,

water quality and sediment

samples as well as ecology data.

Then we have our automated data assets.

These are time series data,

so these are continuous data

that are collected via sensors.

In automated recorders you see a couple

examples of a meteorological station,

stream gauges that are set up,

USGS staff manage and maintain these systems.

We have about 13 and a half

thousand real time systems,

and the landscape.

Currently those are transmitted via

satellite or cellular networks and

can cover a lot of different arenas.

Of data types,

but stream and river levels.

Very common stream flow or discharge data.

Reservoir and lake levels as well

as water quality and rainfall.

So those two data themes really are part

of a sensor network that is pushing data

into our data systems every minute,

and I have a an animation here that

shows the data latency associated

with our endless database.

So in some manner we see enlists

as a single site collecting data,

but in actuality it's kind of a living,

breathing Organism that's collecting data

and providing that to users every minute,

and I'm just going to forward through this,

but you'll see that the.

A color shown in green are showing

new transmissions come from

these screenshots that are fresh

into our database and you'll see

when we hit the top of an hour.

In general terms,

you'll see the number of green dots

increase as data is flowing into our

national water information system.

So when I think about endless,

I think about the hard work of our Hydro

Tex collecting the data in partnership.

But I also think about the data

management and software system that

is providing the latest information

to the public that we can provide.

The endless art vast on.

Needless to say, there is a a number of

a thematic areas that I'll describe here,

but our time series data we have

about 3 million time series

datasets and about four million

discharge measurements available.

Discrete water quality.

We have about 7,000,000 samples

with 135 million results.

We have about 10 million

groundwater levels in about 500,000

groundwater discharge measurements.

We have about 2,000,000 unique locations.

This database and more than 200,000 water

use site records in addition to that,

we provide data out to the public

through water data for the nation,

and so I won't go through those.

But you see the vast amount of daily

data that is available to the public

via our web delivery products.

So how are we modernizing so you know,

the charge and the program goal of

INR modernization is one of those 14

programs within the water mission area

is to really provide the necessary

improvements, so that's a really.

That's a key statement here to make sure

that our enterprise water information

system is available and then forward

looking aspects include being able to

advance or or basically advance the

water missionary product priorities.

And meeting the needs of our

stakeholders in the future.

So the important part here is not just

making the improvements to the software,

it's actually answering the future needs of

the water resource information delivery.

When we talk about it with modernization,

we have to kind of talk about the business

a little bit about software management.

So a lot of my background is in

managing software solutions that within

the USPS to deliver data the public.

And overtime software systems and software

solutions accrue what we call technical debt,

which means the code becomes a little

less flexible and the ability to

maintain that code diminishes over time.

Whether this is public sector

or private sector,

these are things that software

systems have to consider to make sure

that they're viable for future use,

so knowing that in with web was

originally published in 1994,

R Web delivery footprint is largely

unchanged, even though we have had.

Many version releases to keep it current.

UM,

the increasing technical debt on

those solutions as well as the

cost of change increasing,

has become what the USGS is

a top priority to replace.

Uhm,

if we juxtapose that against the evolution

evolving technology in both code languages,

libraries,

databases,

and infrastructure over,

that time will understand that

there's value in modernizing.

And that is helping our systems

grow in the future.

So the growth between growth potential

of our science and our technology is

that evolves is going to include things

like modern sensors that we want to use,

and modern telemetry and transmission

that we want to use for future use.

This program has three defined goals.

One is to retire the code that we have

managed and maintained for a long time.

The second priority outcome or

priority goal of this program is to

build those modern data pipelines.

So think forward looking with regards to

sensor data management and data delivery,

and then take this program in the

investments made and transition those

into what we call sustainment engineering.

So management of our code long term,

being able to respond to the technology.

Changes.

Uhm,

obviously I mentioned at the top the

the folks that are contributing to this,

but I have a slide specifically pointed

at mentioning the good efforts of our

internal team and our contractor teams

that are helping to make this happen.

We have about 150 staff and

contractors that work on this effort

on lucky to have a very strong

program management team that helps

support this effort and in addition

to that we have strong project management.

Ranks within the water mission

area covering about 20 distinct

projects ongoing currently.

The USGS is, uh, uh.

The USGS endless modernization seemed

includes subject matter experts,

so folks that are familiar with

our data workflows or our data

collection methods provide valuable

information that informed this program

and then our software engineers

that are helping write that code.

I want to tip my hat to our Hydro

Tex who are collecting the data in

the field for endless and I also

want to tip my hat to our operations

staff that manage the existing

software solutions that we have.

They do an incredible work keeping

these data available in a near 24/7

manner so that our public and our Co

operators can access this data as needed.

And here's just a screenshot of,

you know what we see is folks in the field.

These books,

or less employees managing sites,

collecting data,

and helping develop the answers

that really the the nation and our

partners are looking at for for

with regards to water resources.

To execute the program,

we have actually divided this

program into ten sub program.

So this is where there are ten bins,

essentially where work happens we

have our telemetry system where we're

looking at our satellite sensors,

time series data collection,

discrete data collection.

We call that samples are field

software that our staff are using

in the field to collect data.

We have a subprogram pointed at groundwater

in hydrogeology information water use.

Imagery and remote sensing.

Web delivery, which we'll talk about here

in a bit or monitoring location registry,

as well as our reference list

management and to give you a window,

some very brief window into our modernization

efforts within these subprograms with.

Within telemetry we're

developing a new software system.

The handle,

both satellite and cellular transmissions.

We with regards to time series

in R discrete data collection,

we're working on new and efficient

workflows through our software solutions.

We are unifying our data collection

platforms into a single stream

for our field data collection.

We're going to publish more

groundwater information nationally,

as well as develop or water used system to

respond to Congress needs for information.

For the first time,

we're taking him,

we're going to talk about it

here in a second,

but we're taking on storing images and videos

from our gauges of four for archival use,

but for future water use.

We're updating our web delivery systems

and then we are managing our sites

information and a reference list.

Information in new and modern ways.

All of that comes together to build

this picture and I'm going to show

this here in a little bit, but this is

called the national water dashboard,

so as modernization happens in these arenas,

it allows us to bring that data

together in new and exciting ways

like the national water dashboard that

allows us to answer these national

questions about water resources.

Step away from that. For now.

It's kind of a teaser to get

back to down the road,

but the behind the scenes of this

really emanates from endless

and endless modernization.

So we talk about endless modernization.

Now we talk about two different assets.

We're going to talk about data

management and then we're going

to talk about as data delivery,

so we're going to talk about now,

how we manage our data and the

modernization efforts that are

being undertaken that ingest data

into a data system and allow us to

QC that data and do our business

of managing that information.

What we do within in West we talk

about it's like sensor to web page

is essentially a is the is the.

Workflow and it follows the USGS

data lifecycle that the USGS

published back in 2013.

There are multiple steps to this,

but essentially there is a plan to collect

data that is really bound by water.

Missionaria policy and procedures

that are published.

We acquire that data in the field.

We process that data through rigorous

software that the water missionaria uses.

We analyze that we preserve it

in our data system. Then we.

Published that out to the web.

We follow this life cycle to make

sure that quality data is hitting

our end products on the web and

then following that we have the

the charge that provide metadata.

Manage the quality of that data

and backup and secure that data.

So at the end of the day,

our data management system is really

more than stream gauges, right?

We have field data collection

and data processing.

We have updates to our telemetry systems.

We're having new ways to govern and curate

the descriptive lists that endless uses.

We are managing now an authoritative list

of endless sites through our monitoring

location registry and we're updating

QA and QC policies and procedures.

All the while testing new sensors in

developing new data management protocols.

So I'm gonna I'm gonna focus on a few

efforts within the data management

arena that I think are exciting.

In the spirit of a better software

management and better data management,

we currently have about 15 pieces of

individual software that collect data

from the field and and put that into

the national water information system.

And as we look forward within

this program about areas that we

could really take advantage of

and take opportunity with,

it was an effort to unify.

Our field software into a Singleton

so we are moving out on a project

beginning next fiscal year.

That will be a multiyear

effort to consolidate all of

that data collection into a single platform.

This is going to enable us to

manage our code better to make long

term enhancements and really easy.

The burden on the operations

of that software.

So at the end of the day,

we hope to improve our data entry in

our validation procede procedures and.

And shown here is kind of a graphic of those

six elements that we figure are we we,

we feel are important for success.

But to improve the upload to improve

our policies and procedure verification,

validate our data and then basically

use that to information to monitor

our locations better in the field.

So there's a lot of integration

and a lot of opportunity.

We're talking bout 15 software

solutions moving into a single.

Solution.

We're making significant upgrades

to the telemetry system,

so we the majority of our gauge transmissions

happen using the goes satellite.

Cemetery,

but as new sensors come on board and

there's a request for a higher frequency,

transmissions were expanding.

That telemetry management system for

our internal operations into newer

technologies like other satellite

networks and cellular based systems.

We're also improving the district

distribution of our of our data via

these satellite telemetry systems to

our federal partners and upgrading

that system will allow for better

decision making specifically related

to natural hazards and emergencies.

One last exciting part of data

management that I want to mention

is the move out on the imagery

subprogram so we are currently

in a design phase to build out a

national cyberinfrastructure for

USGS to support data streams coming

in from cameras installed engages.

This system will actually leverage

both cloud and on premise and

the future of this is to have not

only transmissions that.

Find their way to the web images and

videos that find their way to the web,

but also to provide a national archive

of images available on streams,

lakes and reservoirs across EU S.

This is very exciting.

Ave for us and we're like we're

excited to see it grow.

The last piece I'll mention is

just our modern data feeds.

There's a number of efforts that

are ongoing on the internal side

for data management that allow for

more frequent transmissions or more

coherent transmissions between systems,

and I'm just going to name a few here.

I mentioned imagery and I mentioned the

big picture that we have with the dashboard,

but there is an internal component

called data Hub that is essentially

a translator between our systems.

So now we have.

This this neural network,

this internal network that provides

connections between all of the aspects

of our sub program and those pipelines

are are are a major piece of how

we're modernizing those data feeds.

Uhm,

the field data gateway is another

effort that is internal facing but

is going to make more succinct and

more direct communications between

field software systems and endless.

Uh,

and then the last two that are on here

that I did not mention or the

addition of geospatial services

as a set of modern feeds as well

as a modern web service catalog.

And I'll talk about some

of those here in a minute.

So let's pivot to how you get the data.

Uh, we're going to talk a little bit

about web delivery from endless,

and the efforts that are we are being

undertaken to modernize products that you

probably know and have used previously.

There are five tiers to web delivery or what

we call endless brand delivery from endless.

Alerts web services monitoring locations,

robust search and a national view.

And those are represented by shown in blue.

Here titles of products that you may have

heard of May have used in the past or

will hopefully use here in the future,

but will start with water alert that

provides SMS and email messages based

on current conditions at stream gauges.

We have water services from USGS that

provides a set of rest services currently

allowing access programmatically

to the holdings within endless.

We have monitoring locations.

These are single site web pages

formerly known as and was well.

Uh, as part of a effort here,

we'll talk about search in a minute,

and then I'm going to skip to the

last one here and just talk about

the national water dashboard.

So that is a national view,

real time weather and water

conditions giving context.

So everything we're doing here is a kind

of in the spirit of the Internet of water,

or some of you may be familiar with

the Internet of water efforts.

There are some foundational statements,

and really some charges that they have

laid out that resonate into the National

Academy of Sciences report in terms

of how we deliver our water information.

But this this this code

here really struck with me.

There's some of them keywords here when

it comes to water or critical decisions

that are made every day regardless of of.

Data availability,

but what if the we could harness more

data and make better informed decisions?

This is the call in the end

goal of the Internet of water,

so our delivery products at

the end of the day.

What we want to do is provide those

better context to what data we have

available for more informed decision

making and to do that we have to know

about our audience and who our audience

is for our web delivery products.

The public is a large,

obviously a large footprint

with our web delivery products,

but we have partner agencies,

state agencies, federal agencies,

local agencies,

river authorities that are

also part of our audience.

We have municipalities and regional managers.

We also have heard first responders

that come to get data from the USGS.

And then you know,

we kind of have to know their

data needs overtime.

We've learned that a lot of folks are

interested in what's happening now,

or what changing conditions

we have in terms of water,

what the historical context is?

They they they're doing some strategic

planning for water resources.

Maybe there's some private use

for business operations.

There's a vast multitude of basically needs

that come when it will come together.

When it comes to web delivery.

So with our audience and their needs.

In drawing upon that spirit of Internet

wolf water for better decision making

from the USGS data science team has

been putting out for several years now.

Great displays of water information

that really take the strength of

analysts and a lot of those use

cases and bring them together

for better decision making here.

This is a recent graphic that

was produced that looks at stream

gauge levels and water levels in

relation to Hurricane Ida.

It just came online so you can

see the path of the storm and the

impact to our water resources as

well as stream flows in relation

to the life and property safety.

These are the products that we want

to see come from a robust data system.

We're making some changes.

I mentioned endless web and the

initial operation date in 1994.

This is, you know,

we've provided this rudimentary

data delivery capability for single

site locations for a long time.

It has some graphing and analytical

capabilities, but unfortunately

it was not built for mobile.

So as part of endless modernization we

have had the next generation monitoring

location pages available in beta since 2018.

This new set.

Of web pages is user centered design

as well as implemented via Agile

software development approaches.

It's a mobile first product

and we're using utilizing EU.

S. Web delivery standards.

There's a link here where you can

find out more information about how

we're modernizing those single site

page views and will answer a large

number of questions about that effort.

We're excited about this.

And we see it as an opportunity

to continue to build off these

for single site stream gauges.

Water alert so water alert is

the text and email notification

system it is currently undergoing.

Modernization with a projected

rollout of next fiscal year,

so after October one of next year.

Uhm, we heard from our users.

We surveyed about 3500 users and they

told us how important this product was

and we really thank folks for their

contributions to our development.

What we got out of that is that

the text message solution is

absolutely critical and this product,

which provides real time information

about gauges of interest,

is important for the protection

of life and property.

So you will see this product modernized.

We will continue to be able to subscribe

to this solution in the future,

so we're going to have a improved interface,

and we're modernizing the way

we send our text messages out.

Water services water services.

This is set of rest services

programmatic versus allow software

developers and other entities

to access our data through code.

This set of services has been

available for quite some time now,

but we're actually going to modernize

water services and the goal here is to

not only modernize the set of services,

but expand the set of services.

Into a modern suite,

we're going to add geospatial

services to this,

and this footprint will include

will be a central repo for published

API's as well as code libraries

that the water missionary has.

So what you see now is a set

of rest services.

What you'll see in the future is a

set of more comprehensive services

that include geospatial in code.

The one of the tears that I skipped over

in description of endless brand delivery

is robust search for the nation and robust

search for the nation includes access

to the whole archive of endless data.

So I've got some screenshots here of product

called just labeled search and filter,

but essentially will allow allow you

to query in access the repository of

water information more readily in kind

of an Amazon search style interface.

So this is a product that is in the

design phase currently and expect to

hear more about this in the future.

One last graphic and I just want to say,

you know, this is again credit

to the USGS data science team.

Endless is really more than just

sensor data, so water quality,

water use sediment ecology data.

What we want to do is

improve the data discovery,

data access and data usability and we

want to enable 21st century science.

So this is another one of the

visualizations that tells the narrative

about water use at a national scale.

In the last census that was done in 2015.

So you can look at the division and

the use of water across the nation.

A very compelling in critical story.

So that brings me to the final

product within data delivery and

that is the national water dashboard.

It is really to me at this point.

It is one of those next generation

tools that allows us to look at current

conditions from analysts and look at

it in context with weather information

to help make better decisions.

And I'm going to end my show.

I'm going to try and switch to this display

and if Amelia if you can make sure.

Good there.

Second I'm gonna share that whole screen.

That's probably not the way we want to do it,

but I'm going to go with it for now.

How are we doing Amelia were OK, thank you.

This is OK, so I'm gonna do a quick demo.

I won't take too much time,

but I want to mention a few things.

The National water dashboard provides access

to about seven different category areas

of sensor data available from the USGS,

and you'll see here over

on the right hand side.

I've got stream flow turned on and I've

got the current status of stream flow.

If I look at the legend here,

we can see that anything in blue or black

is anything is above normal for today.

Anything in Green is a normal

stream flow condition for today,

and anything in red and orange

is below normal.

This gives me a good view of what's

happening at the national scale,

fed every minute by new information

from in West through our data management

systems and our data delivery systems.

A couple things to point out here.

The blue and black on the East Coast is

still water flowing out from Hurricane Ida.

The water that was dumped during that last

event has raised an elevated stream flow.

Conditions on the East Coast,

so we're watching a number of those in flood

stage and a number of those at all time.

Highs for today.

If you see the Midwest of the of

the country is a lot of green.

Their normal conditions for this time

of year and then as we move out West

we can look at some drought conditions.

Folks know about fires out West,

but to provide some context,

I'm going to turn on the drought

monitor and you can see some pretty

good correlation between those low flow

values and what is shown as higher or

elevated drought conditions for the nation.

This tool is very powerful.

It can help make some decisions.

There's a large number of datasets

and data themes that are available.

I'll point out just one last feature

that I think is really important.

You can do some name search can

change an area of interest to a

specific state or specific region,

and then you can also use this

get link function function so you

can share this information.

If we click on a single site.

Can hone in on one here we get

more information about this site,

including any parameter data

streams that are available,

and then you can access more information

through the next generation site pages.

Explore this,

we're excited to have it out.

Expect new changes and updates to

this product as it is one of the

Keystone delivery products from

the water resources missionary from

USGS for the next several years.

I'm going to share my slides and

bring this to a close.

Uh, sure, getting back on the presenter.

And there we go. Let's see here next slide.

OK, I think I will share some of these links.

I just wanted to make sure

they were embedded in here.

If you want to grab a screenshot of these,

these are the products for delivery

that I had mentioned previously.

Let's talk about next steps.

Let's talk about where we go from

here and what the benefits are.

So I'm gonna I I have on here some estimated

timelines based on some of the products

tools that we've already discussed.

In 2021 we had to release in the National

water dashboard and on the internal

side we had our management system,

the monitoring location registry put

into operations this next fiscal year

we're going to have our discrete data

management and telemetry systems updated,

as well as to the public.

A modernized water alert.

In 2023,

we intend to have the imagery

infrastructure in place and really

release or modern web services as well

as authoritative geospatial services from

the USGS Water Resources Mission area.

2024 will hold the release of our unified

field app and full decommissioning of

our historical legacy software systems.

This will be a landmark time for the

USGS to move away from the existing

technology into full operations for

our modernized systems and then in 2025

we're going to transition to sustainment,

engineering,

and management of those new systems.

We hope that the benefit is very

vast and is very impactful for both

water managers and the public.

Uhm,

we intend to deliver more data in to

support prediction of water hazards and

water availability in near real time.

We want to provide those tools that

support decisions across the nation

thinking about things like water supply,

floods,

droughts,

water quality conditions as well

as hazards and extreme events.

We we believe that the national water

Information system modernization

will support that and then we

want to continue to lean.

Our portfolio of web product.

So the public comes into a limited

set of web tools to access water

information as well as expand

the very important national water

dashboard for future use.

Uhm,

we will continue to reach out to both

internal and external stakeholders

through a variety of opportunities.

And I have a picture of the little

feedback button you're going to

see a feedback button on.

A lot of these modern products.

Whether it's our new site pages or

it's in the national water dashboard

and we want to hear from you,

we want to hear what your needs are

and how we can meet those needs.

Using the resources that we have currently.

Uh,

I mentioned the blog that we have

that explains the utility of our

new water stream gauge site pages.

I also have a link here to the

upcoming live event that we will

be hosting October 13th.

That's going to talk about more

specific changes to the data

delivery and get into the weeds a

little bit more about how we're

modernizing water data for the nation

products. And with that, uhm,

I've got some contact information.

UM, I'd love to take some questions.

That is my final slide.

And again, I thank you for

your time and your patience.

Excellent, thanks again Dan.

And yeah, lucky for you,

we do have several questions that have

come through from our audience members.

Just a reminder for anyone else

if you'd like to ask a question,

remember you can click on

the little QA chat window,

look for the question Mark icon that's

on the upper right hand corner string,

and then you can type in your question there.

So then our first question

from the audience is.

Someone's asking how does the USGS

decide which rivers and streams

to monitor as part of the program.

Yeah, it's a great question.

It's not over.

I won't have a very direct answer,

but what I will say is at the state

level right there I mentioned

a number of state partners,

other federal agencies,

local entities in December.

Please that partner on gauges

rivers of interest,

so whether they're attempting to

manage a waterway or water resources,

they may work in partnership with

our agency or Bureau to to basically

identify locations for stream gauges.

Beyond that,

the USGS has the national stream

Flow Information program that

looks at the federal priority areas

where those stream gauges are.

I would say if there's interest

in additional monitoring.

Reach out to your local water

Science Center and ask them about

your waterway of interest and if

there is future monitoring plan.

Alright, thank you our next

question is from Greg.

Greg Gas will be national water

dashboard integrate with Noah

Slash NWN flood alerts and modeling

National Weather Service alerts you

any other kind of alert services?

Yeah that's a great question.

So we we've had some pretty strong

partnership with the National

Weather Service both at the national

and local level and the current.

Creations include access to data services,

web services provided by the

National Weather Service.

So in general context,

the USGS in many cases,

provides current conditions,

information and the National Weather

Service provides that forecast information.

We work in direct collaboration during

events to provide information back and forth.

The USGS has a program called the

flood Inundation Mapping Initiative

that provides some modeled flood

in Dacian aspects as well as

other regional efforts to include

inundacion forecasts as well.

I would I will make a statement here that

is going to take some time to play out,

but I believe that there will be

future integrations with those

inundacion products in the dashboard.

And we're eager to have those

conversations with National

Weather Service when appropriate.

Great, thank you.

Our next question from one of our viewers

is our open source metadata formats

being considered in this entire process.

You know they are.

I would say that's an area of

opportunity for the USGS.

You know, we've we've long been

part of the Effed community,

but that is definitely ISO and other

standards are in play for the USGS.

A lot of that is available through science.

Base and analysts gotta make some

strides forward for metadata.

On download.

I think that's an area of opportunity for us,

but to be to answer very directly,

we are considering those.

Got it, thank you.

Let's see. Well, so we have.

Oh, uh, my next question is from Jimmy,

who's asking will the new version

of in West be able to provide well

data that currently resides in GWS?

I an example is screening intervals

of a well and and well other ID's.

I'm not sure if I had this makes

sense to you. Yeah no, we're good.

So that's a very specific

kind of internal GWS.

I as an internal data management.

System for groundwater data.

It is also one of our legacy systems.

We currently have a project to migrate

a lot of that lithology screen in

full information about how well is

constructed into a national platform.

That project has not started yet,

but over the next year or two,

expect to hear more.

Got it, thank you at another

good question from Wendy.

Wendy's asking will be new stream

gauge pages have the webcams.

At some point.

Wendy loves watching the Happy

Isles webcam in Yosemite,

but the beta page does not have it.

Yes, yes where we're standing up

that national infrastructure to

do just that and we're happy to

hear more about how people are

using images from our existing

systems are existing images.

Or put into our existing stream

gauge pages using a variety of

sources and as part of modernization,

we're bringing that all under one

umbrella to deliver on those next Gen pages.

So we excited to hear that,

and we're excited to hear more about

how those cameras are being used.

Got it, thank you and this question

might you might have already answered

with the national water dashboard,

but someone's asking is there.

It was a public dashboard or some other

website that shows past rainfall and

snowfall records that does not need to

be downloaded as a data set or a file.

Yeah, you know.

So the the dashboard really

doesn't provide a great like it

doesn't provide historical context.

That product is really pointed

at what's happening right now.

I do believe those use cases are

being considered from our team and

just stay tuned for more development.

We have a label on that product

called it that says experimental

for now and very deliberately

because we're learning from the

national water dashboard has been.

Publicly available for now.

A year or so,

so we continue to learn and I

think we continue to evolve that

product to meet a greater needs.

Got it,

so essentially saying with the water

dashboard the effort is being put into

real time so that you know if there's

any kind of historical dashboard that

would be a separate project essentially,

or maybe an extension of what

we currently have, you know,

but I think that's to be

determined and and like I said,

I think we're still learning from its

initial release what those use cases are.

So I think just stay tuned

for more developments there,

but currently will I think the

appropriate way to answer it is.

It's happy it's about.

What's happening now?

Not necessarily what's happened in the past.

Got it thank you.

Thank you.

And our next question is,

UM,

a user asking about what data are available,

but they they seem to have the

impression that disagree slash sample

data are on a different website in

the time series or sensor data.

Is that correct?

Yeah,

some of our water quality data is

available via the water quality portal,

which is a combined data access

tool between USGS and EPA.

So if folks aren't able to find

the information they're looking

for and I'll send you the link

here in a second wheel on that.

But the water quality Portal does

provide a plethora of discrete

water quality data as well

as data from EPA too.

Got it, thank you.

And our next question is from Bill,

Bill is a good very good question.

Actually, he's asking if you've heard

about the recent announcement of

NASA's Earth System Observatory or ES.

Oh, I mean, so does USGS have any

plans to partner with NASA to

share and explain that satellite

data in regard to water resources?

You know, I don't have the answer.

There will come what I will say is,

uhm, what we consider an imagery

and remote sensing subprogram to

endless modernization is really

pointed at cameras and video cameras

at installed it stream gauges,

but remote sensing of water quality is

an aspect of ngwa sore next generation

water observing system and so the

science behind satellite derived.

Water chemistry, water quality.

Water availability is part of the portfolio.

The water mission area,

not necessarily specifically to endless

modernization. But but feel free.

I don't know if that individual would

like to contact me and discuss that more.

My contact information is here and can

make connections as necessary there.

Got it, thank you.

Uh, another oh. There we go.

OK, we can see Daniel's contact

information and just a reminder to.

I did put the links that Daniel

put in this slides.

I also put in the chat window

so those are hyperlinked there.

If anyone needs to.

Wants to take a look at those they.

Everything that was mentioned

in the lecture is there as well,

awesome.

Uhm and one last question looks

like let me see what we have.

This is kind of more general water question.

I'm not sure you you went away

and become a Ramesh.

Is asking which countries the world will

have water problems in the near future.

Yeah, I I don't know if I'm the best

person equipped to answer that honestly.

Uh,

so I probably would defer that to others,

but again,

you know my contact information is

there folks want I can definitely

traffic direct that traffic or

that question in the right place.

Well,

I I I should add in the question

that that came up about discrete

water quality and the water

quality portal as an access point

for that type of information.

It is in our intentions as a

program to provide discrete water

quality data via the new next

generation monitoring pages.

So stay tuned for additional

capabilities there,

but the access point currently if

somebody was looking for information,

would be through the water quality portal.

Got it,

thank you and you know that actually

to spend on it just for folks who

you know don't have a hydrology

back underwater background,

could you can just give a quick explanation,

discrete measurements versus like

continuous instantaneous data.

Yeah,

and it's just to reiterate a few

points that were in my slides.

But you know what we call time

series data is basically a sensor

at a stream site that automatically

collects that data in a series

of data points and we.

Provide that as a as a graph right uvj of

data and information to to boil it down.

It's the simplest parts of discrete

measurement is potentially somebody

going to a stream and grabbing a

bucket of water and taking it back,

doing an analysis, or doing a one

time measurement down a well, right?

What's a water level? Currently?

That's a discrete measurement,

not a series of measurements

like the time series would be.

So think about discrete one time time series,

multiple collective.

Autonomously or or in a record.

Got it, thank you, yeah.

And it looks like that's all art are

questions for modern audience again.

So Daniel, I want to thank you

again for the the great talk today.

Just letting us get a glimpse in the future.

The future.

You know what's on the horizon

for water data and for answering

the questions from our audience.

So again,

you know if anyone didn't get any

of the links to the data pages,

feel free to send in the chat like and I

can put those hyperlinks in there for you.

And again,

thank you to everyone out there tonight for.

For joining us for dance talk,

just a reminder that dens lecture

will be available later on.

We hope to have it done by next week

for on demand viewing on our website.

That website isusgs.gov/PLS

and another reminder,

we hope to see everyone back

again next month on October 28th.

Same time.

7:00 PM Pacific for our lecture

on climate impacts on species

and that's our poster up there.

Even if you blow points and you

can also see look at our website

and and get a glimpse into what

that talks going to be about.

So with that we'll go ahead

and wrap up tonight.

And thanks again everyone and take care.

Have a good night.

Thank you,

thank you Dan.