Dynamic Styling for NHD and WBD REST Web Services

Video Transcript
Download Video
Right-click and save to download

Detailed Description

National Hydrography Advisory Call Oct 27, 2020

Rob Dollison and Sergio Rodriguez discuss web services available for hydrography data. Topics include:

  • Introduction to National Map Web Services
  • Resources for Connecting to Web Services
  • What the Dynamic Styling Web Service Is
  • Dynamic Styling in ArcGIS Online (AGOL)
  • Dynamic Styling in ArcGIS Pro


Date Taken:

Length: 00:43:07

Location Taken: US


This is Al Rea with the USGS national geospatial program and this is   the Hydrography Advisory Call. Today we have Rob Dollison and  Sergio Rodriguez will be talking to us about web services that we have for hydrography data. And so Rob is going to start Rob, you want to just go ahead  and introduce yourself and what role you have and get started.  Thanks, yeah my name's Rob Dollison and I'm out of our USGS  headquarters in Reston and my role is delivering our National  Map data through data download and services as well as the applications to help us do that. I'm looking forward to today, to being able to share with you just some of the applications and services we have available and will dive deeper into some of the styling things you can take advantage of on the vector services that in NHD and WBD offer. I'll do a pretty quick overview of of some of the product services things that we offer, but will be glad to dive in further into any one of those as questions come up. I think we will have plenty of time to address questions so I may cover some more at a high level, but later on it if you want me to dive further into one or two of, you know a couple of them. I'll be glad to. And I'll be passing it off to Sergio after some introductory  overviews and he will dive. He will dive into the how to do things in AGOL and in Arc with these web services. Really glad he got him available to assist me with this right. I'm trying to see what OK here we go so. This is some of the things will be covering. I'll just dive in a little bit into  overview. so in this I'll probably take go to show you, but this is our basically our page for data delivery and access for core services. and let me go do a quick just go to that page. I think it's. So we group things. We have some of our applications featured here at the top and we've grouped things about going to topo. If you're trying to get to topo maps or GIS data as well as applications and services, and this is where we'll spend more time today on our services. So just hopefully some of you are most familiar with some of these. This is our data download application where we go download the GIS data. That's its primary focus. We have a viewer for visualizing and work with our data through web services and to be able to mash up some of your own data with- if you need to. Um This is a new one. You may not be aware of. It is specifically focused on lidar explorer. It's focused on more focused on elevation and Lidar data, and the nice thing with this application you can actually go in and visualize the Lidar data before you decide to download it. so it's really optimized to help work with point cloud and DEM data. And we have a demonstration viewer for elevation service. These services you can, but dynamic service you can pull into Arcgis or others, but this demonstration viewer lets you go in and look at some of the templates. We have standard, you can get a variety. This is the aspect, you can have slope, different hillshade you can all dynamically generated and used in your application. I'll ask hopefully folks are pretty aware about the Topo view, which is an application that lets you go back and search our historical map collection. There's an effort we worked with our geology program on this application. Um. So I just wanted to at least introduce you to this page and some of the ways you can get two things from the downloader. will be spending more on the applications and services piece. And service list is a key area you can get to it through the URL or through this web page that will be doing so. I'll go back to the slides a little bit. Well, maybe now I'll stay here on the service list for a minute since we're here. So if I launch the service list which we had earlier, you can see. We have a variety, almost 50 services web services available, so cached based maps. As as well as index services and themes. So under these and these are the theme overlays which these themes are the things we primarily are responsible for through the national map. We had that elevation service I showed. Just brief glimpse of that application. Contours these should all look pretty familiar. NAIP services these are all dynamic services and here's the hydrography dataset service as well as the new NHDPlus  High Res service. Al, while I'm here, do you want to talk a little about it? I think we can do it later. Yeah, we we could talk about the NHDPlus service a little bit sure. Go ahead and I have it up in Arcmap Here and I'll let you talk about that a little bit. Maybe a bit sooner than you expected, but yeah. No, that's cool. Actually, could you change the base map? Maybe too, like the dark grey, you'll make it a little easier to see what we have here. Yeah, yeah. Right, so so the NHDPlus you know. It includes all the hydro features you know from the NHD as well as the WBD watershed boundaries. But it also has additional features like the catchment areas, which are the pink ones that you're seeing there. So that's the area that drains to each segment in the stream network, essentially. derived from the elevation model. Right now NHDPlus is all done from the 10 meter elevation DEMs. Uh, and if you- Rob can you click on one of the flow lines? And. And bring up the pop- up. You might have to enable a pop-up in your. Yeah, that might be so. If you go to the content, come down here and open it up. Yeah, flow lines. Not the network flowline network flow line. Yeah, so you need to enable the pop-up there. OK, you gotta say modify map a phone, right? Upper right. No, all the way up in the upper right of the window. Oh yeah, yeah yeah, you want to modify, yeah? Playing in here and look up the flow line. And should be there alright enable pop. Yep. OK. Alright, so the. Yeah, if you just click on one of those, yeah, so you'll see the pop-up come up with all the attributes. Now what we've done with this data set in with this service is we've added a whole bunch of attributes. so we've we've joined the tables because it's difficult to do joins in a web environment. So we've preloaded or pre-joined those tables. so the value-added attribute table, the flow estimate tables are already joined in here. So if you Scroll down through. You'll see lots and lots of attributes, so we have all these value-added attributes that are part of the NHDPlus there are flow estimates down. Yeah, there's some of those flow estimates there. Uh, so every Flowline has these flow estimates from the EROM Method. The enhanced run-off method, little model that is run as part of the NHDPlus High Res. so it makes it really easy to find all of this information. You know, if you're. If you're only interested in some of those attributes, it's easy enough to customize the attribute display in a pop-up here in ArcGIS online. So let's say you were just interested in the total drainage area. For those you could go in. Yeah Rob, if you wanna do that, you can hit that and customize configure the pop-up right, yeah? And you can get the configure attributes there right under that box where you are. Oh yeah. You can just turn 'em up, turn off all of them. Display is diplaying yeah and then go down, let's see. Sometimes it's hard to find them will just pick one. Because there is a variety, yeah, there we go. Oops, drainage. I miss it. It doesn't matter what, just just click one of those like drainage area, right? Yeah, that's it. Whoops Where did it go? I clicked it on, it disappeared. Jumped away from you there, Yeah, but that's that's how you would do it is just, you know, choose the attributes that you want to see in that pop-up and say OK. I need to rename them as well, right? You can get rid of the. That's right, you can do. You can do lots of customizing here. You need to click the little OK down in the lower left corner. To update that and now now if you hit that. Then we're only seeing just that thing that we wanted to see which is. So that's 3 three square kilometers stream area for that that stream. So that's that's a real quick overview of what's there for the NHDPlus High Res. we have this now. We completed almost all of CONUS. The conterminous US. So it's almost all in there. Some of the last data sets that were loading from the Great Lakes region might not be in this service yet there. And there may be a few other stragglers that haven't made it into the service yet. Is there some delay between when we actually post the,  the data sets out on our staged products to when it gets loaded in the database behind the service. But it should be at least very soon. We should have all of CONUS in there, plus Hawaii, Puerto Rico and several of the territorial islands out in the Pacific. And there are a few places in Alaska. A few HUCs a few hydrologic units in Alaska that we've done. So. Be kind of a big milestone that we're getting through CONUS now and from now on will be focusing efforts on Alaska as well as going back an updating and fixing problems in the NHDPlus High Res so. That's that's that's that. That makes it really easy to find. All these attributes very, very fast. Thanks Al and it's really a lot of detailed data in the High Res. It's really the service is designed to work at larger scales. It doesn't turn on until you zoomed in quite a bit, because there's quite a bit of information there to. Try to work with. Right, yeah, that's another good point, Rob. Another thing you can do here is you can add a service which Rob can show you on the on the service list. Call our tile  cache service for Hydro. And that that way when you're zoomed out, you can still see. You'll still see a map of the hydrography. So we'll come up to our base Maps and you'll see the hydrography tiled cache, which is designed to be fast for visualization. And. I can go ahead and. Grab the URL. Arcmap will add a service from the web. Pasted on in add a layer. And then. As I zoom out. As High Res goes away, you're still able to use this too. Navigate and work with as well. Lastly, zoom in. We should see the high res. Starting to draw the WBD. Yep, there we get it. That's yeah, that's high res NHDPlus. Alright. OK, go ahead. The problem, yeah, go back to little bit of the presentation. I tend to do more of it. Directly from the. Like hearing from live more than the power points, but will go through some of these a little bit. app services list that I showed you the URLs there highlighted and we have a variety of service, even some coverage services for elevation, which is a whole different presentation. I think Jason might have given one of taking advantage of the elevation coverage service where you can go in and even do some flow analysis on the raster from the service, but that's a. Probably a more detailed presentation then we would get into here, but we have a variety of, of service here here some which we feature from other agencies as well but. OK, so quick view of some of these are just quick images of the five or actually six different basemaps we offer and one is even a blank base map that you can have something completely blank of. Just boundaries of the US that helps you show your science data or others, but we have a topo on hydrography cache we just looked at and imagery-only as well. Its imagery topo base map. All available for shaded relief available for your use. These index services are important pieces that look at where in this case the Topo availability index on the upper right let's you see the vintage of the data where we're building Maps now and what vintage of the map is available. But especially important where we haven't covered the whole country yet and if you look down at the elevation index you can see some of those darker colors or the higher resolution 1 meter data that we have. But enables you to look at what product might be available over your area, and I think we have plans to try to offer one more for index service for NHDPlus in the future here to help with knowing what, whether you're working, whether their beta is available or the next generation product over an area. And this is a little bit showing some contour will go into this further. These services are dynamically dynamics dialing enabled, so you can change variety of labels or colors with those with those services. Show briefly the national map downloader, which is mostly about getting to the actual GIS data products. And this is one thing I want to make sure to let you know about. We have a way to subscribe. So if you're using one of our services in an application you're building, I highly suggest subscribing to this little SNS messages a lot, like a list-serv, right? It lets us and we try to send out notices if we're going to make a change, something they could break your application. Sometimes we have to move a service or adding layers like adding topobathy into the elevation service might change the layer numbering in order and this is the way we can communicate out with you. Ahead of time so that we so that you know your application can be up and working before we break it or something. So I just want to make sure. Make this link is also available on. That service is an application page. Alright, we talked a little bit about this demonstration viewer. I wasn't going to demo it. Now we can later for questions we people want to dive into this, but having more focus on hydro today. Just showing that service this is a slope. This slope view enabled. It's just in our viewer with the hydrography data set. So yeah, you can call this dynamic service up. And any old application or directly into your Arc online or or even QGIS. Yeah. GIS. Just a little bit. well Al touched on some of the refresh about when for example. New data might be showing up in the service, so our cache based Maps they they take quite a bit to build their more built on a biannual every I mean every twice a year. The imagery service is at least yearly, sometimes twice a year. Depends on our NAIP cycle and when we're doing it. But most of these, like the imagery, cache, the hydro cache you would see. Get updated twice a year. Whereas our index services are pretty continuous. As a new product becomes available, they usually show up in the next day. Within that index, and these other services are vector services, we try to refresh quarterly so. Datasets you know changes in hydrography. In some of our staged product might get there little sooner, but they will certainly be reflected in the service on a quarterly quarterly basis. Alright, so I think this is part is some of that. Sergio is going to start going into. Sergio, you wanna take over from here? Thanks everyone, my name is Sergio Rodriguez. I work with Rob at the National Geospatial Program. Helping out with delivery. So we'll go over some dynamic styling for the web services now. if you saw the There are a couple overlay themes on the previous slide that had little asterisks next to them and those those layers with the asterisks are dynamically enabled so you can go in there and change. As you can see right there, some of the. 3DEP Elevation contours, GNIS and then NHD&WBD, which are the ones will be focusing on today. So you might be asking what is this new function? This function is more of a web function, so it doesn't work very well in applications such as QGIS or ArcMap. Just because those are heavily reliant on local data. So what these,what this dynamics styling service allows you to do? It allows you to change the labeling and it also allows you to change the symbology and it also gives you access to the attributes and helps you and allows you to identify those attributes within each layer. Rob if you don't mind going to next slide, and here is a brief overview of how you can use the services. As I mentioned earlier, it's really geared towards. ArcGIS online and Arcpro just because those are web functions that can take advantage of? That allows you to change that symbology in that labeling. And yeah, I'm just there's just a little bit of caveats that will go over for ArcGIS Pro. Rob, you could go to the next slide please. And this is just a real quick view on the left side. Here we see, The NHD web service, just as. As it would come with whether it is a web service or or or the dynamic service as we see here an on the right is. I just really quickly change some symbology trying to emphasize some inundacion areas and some of the canals in the area. And so now we can actually go into it. I said the presentation here, let me. stop sharing OK, let's see. Hopefully everyone is able to see it. See my screen now should be seeing the service endpoints. OK, great and so just as Rob showed earlier, I'll go here into the NHD and I'll just copy that web rest service. And will start an arcgis online. I will go in here. And I've opened up a map and I will. Add a layer from the web and here I will paste that that NHD web service. And so in here if I would like, I can add whether I can choose to add an NHD in NHDPlus as we saw earlier and WBD whichever one you would prefer. I already have in NHD loaded, so I'll just go ahead and turn that layer on. Let's see if it works OK. Here we go and so the nice thing about the services that now. We can go in here and. We're going to expand the service. And we can go ahead and, as Al mentioned earlier, we can enable our pop-ups here and so we want to identify anything. Now it should pop-up. OK, let's see. Like I enabled the wrong one. But it should be showing up. OK, sorry for the delay. I guess My Internet is a little slow. Remove that out of the way. Yeah, so you can, just as Al mentioned, you can configure the pop-ups too in case you really just want the length of that feature or you know anything you you, you require on, there it is. OK, and then just to build off of what Al said. You can also go in here and let's say for example I wanted to change the name of this style. This like so I can go here into our area. Then I can go ahead and change. I'm sorry. You want waterbody. OK, I'm sorry. Yeah, no, it would just go in here, and although Even so, the issue with Arcgis Online is that has limited font  styles. So. An you can leave it as it is right there and it will stay at this font but if you wanted to change it you would have to. Turn it on to Arial but. As you can see, we can change the color, the font size. jusr anything in the Halo as well you can turn off the Halo if you'd like? Uh. And as long as you save your map, it should load the service just as you save the symbology as well. And another thing you can also do is change the. the symology. So here I'll just click on change symbology. I'll go to options. And. Once this loads I will be able to modify any of these. These shades that I doubt I would like. For example, since this is imagery I would most likely just want the outline of the Lake here. Let's see if it will load. It's funny when I was testing it earlier it was faster on ArcGIS online and slower and in Pro. So this is why I started then. in ArcGIS Online first. Stretching your Internet connection. Yeah, well, this is how it goes with demonstrations, right? How? OK, so I think this is going to take a little bit more time, but I can show you the same functionality and Arcpro. Let's see if that works any better. So now in ArcPro. It it functions very similarly to Arcgis online. If I go to my catalog, I go to my projects, I can. Add that service you typically you would add the REST service as a Arcgis service. Just copy it on there, but I already have it loaded, so I'll go ahead and cancel here. And So what you can. The one caveat and the biggest difference from pro to Arcgis Online is that in arcgis online you can add the service all by itself and it will load and you will be able to expand it and change your attribute. Change your labeling as you'd like, but. In pro, if you add the service by itself. You don't get that functionality. See here. OK, I guess My Internet just really slow today. Oh Let's see if ArcGIS online worked. Any easier? OK here we go. Yeah sorry the backtrack here, but you can change the symbology just as a layer was hosted on your local machine. But what since it's a service it will. As as long as as soon as we update our service, your map will be updated as well. So that is the the nice thing about having it as a service. OK, let's see. There you go. You can see the imagery and you you can symbolize there as you'd like. Now let's go back to pro. Let's see if that worked any better and you can OK, and so I've added just a service by itself, and as you can see I have access to these. But if I wanted to change it, I don't get that ribbon for changing symbology. So instead of adding the service by itself, you want to expand that service. And from here we can add. I mean click these out. Uh, we can add these waterbody features right? And so. We can do is we can add those to our map. And since we added the layer by itself, I will also add. some flow lines. Just so we get a good feel for NHD  here and just like in arcgis online, I can go in here and say I don't want. a fill for that and then click OK. And I get that outline just like I did in arcgis online. Um? Let's see and the. The other thing is that I find in Arcpro the symbology works a lot better. You know we could label the Maps. I'm sorry the rivers to be larger or smaller. And, you have more variety of. Font sizes. Depending on what what best suits your needs. And. There's anything else I wanted to show. You can also carry out some very light analysis on these web. Web what features. So if we highlight. I'll just highlight some artificial lines here. And what we can do is go to. our geoprocessing and I'll just create a quick buffer on our flow lines that are selected. And let's make a. Let's make it 100 feet buffer. And I hope this shows. Clear it and zoom into my selected features and as you can see. It was able to create a buffer on just the selected. features. Um? And I think with that said, if there's any questions we can go ahead and and ask them. Yeah, if anybody has questions, go ahead and find your name in the participant list or turn off your mute. Unmute your microphone. In a little. The little pop-up bar. for teams or if you were having trouble with that, you can go into the chat and. And add your question there. So I'll read. There's from Ann Fritzer question already there in chat. Are some standard USGS style layers out there that they can grab? Oh yeah, so when you first load the the service it comes with the default symbols. And so you can load the service and not change anything and you can utilize it that way. But you can also customize it if you want in case. For whatever reason, you want. I'm sorry, for example, if you don't want artificial paths to show up, you can. You can go in there an make those transparent so they don't show up on your map, but the service itself does come with Standard symbology. Hey Sergio, I think you mentioned that you could do light analysis with an NHD services. What restrictions are there on the sort of analysis that you can do with that data? OK, I will, It just really depends on the amount of data right? Because? What I find is that if there's if you're trying to do buffers on too many streams, it will bog down and I've had it crash sometimes. So you just want to limit the amount of. Analysis I haven't really tested it too much, but I know you can do some light buffering and analysis like that. OK thanks. Are you able to export a selection? I know you just showed using a buffer tool, but if you want to just export a selection to local geodatabase, is that possibility? OK, I actually have not tried, but. When I've done it in the past, it hasn't worked, but I think there's been a couple of updates since. If you if you want I can, we can learn together if you want. It's always fun. Alright, let's see. Let me grab some artificial paths here, since these are the easiest to grab. So let's see here. Oh no, it doesn't look like it. Typically I would just export it from here. OK, what about using the select tool? Is that a possibility with will let you do that? Do you mean like a like selecting it and know if you click back on the arrow where in the geoprocessing window and then do a search for select OK? Yeah, select analysis. I'm curious if that would. OK yeah, let's see. And I think this will just do the entire. Oh oh, it won't work on your selection? Oh yeah, you're right, sorry. Might take a little bit of time. Oh sorry, there is one thing I did forget. I forgot to mention that well, I won't do it on that one since we're running analysis, but let's say for example, you only wanted to show. The Lake here. I could go in here and. In ArcPro, go into a definition query. And I can. Let me see if it'll go through. Think if I, I can query if I just want to show just one feature. I might be asking too much. of my computer here. but you can query the service as well in case you don't want it to be bogged down trying to symbolize everything. The entirety of NHD or whatever layer you're working with. The only thing with this is I find that if you do multiple queries, it doesn't really like multiple queries, so you typically. If I just do one it works best. Not sure if this is gonna work, but are there any other questions? OK, here we go. Yeah, there you go. That's the way I usually roll. I break things. So you're welcome. No problem, well, at least we know it can be done. Yeah so. I've got a question and. I don't know. I don't actually know the answer this to have you guys experimented any with feature services. Uh. Which would which would in theory give you a little more flexibility and power than what you were just showing? Yeah, I actually have not had a chance to work with. With those I've mostly been focusing on on this new, This new feature for web service. It's a good challenge for us Al. what you can do with the web feature  services we have. We had one for WBD. But not for NHD yet. Any other questions from? Turn on. I do have a couple of. announcements. so if we are done with the questions. I just really like to thank Rob and Sergio for their presentation today I think are really good, really interesting. I learned some things. Uh. And I have a couple of other announcements. One is that we are. Not quite there yet, but expect to see some changes to our mailing list and the way that you are subscribed to get these calendar invitations for this meeting. And for our newsletter. Uh, we are experimenting with setting up a Listserv, which hopefully will let you. You know, kind of manage your subscription to the Advisory call and newsletter on your own without sending us emails, so we will hopefully be transitioning to that soon, so stay tuned. What we'll do as well. Will import our current list into that when we start it, and so you won't really have to do anything. If you want to stay subscribed, but then later if you want to unsubscribe or. Wanna share it with someone else? You'd be able to just give them a link to the Listserv, so look For more information about that in our newsletter. Pretty soon. Uh, let's see. OK, there was a question here. Could you provide the link to the site where the recording will be posted? Yes, it's on our YouTube channel. I added the link in the chat above, but I can re-paste it 'cause I'm sure it made its way up away. OK, yeah yeah, sure sure. Uh, OK. In the other announcement that I had is that we just got word as we were on this call that we have finished posting the last of the Great Lakes and NHDPlus Hi Res Beta datasets. So they're out now and we are complete for all of CONUS Plus Hawaii. Puerto Rico. And some of the territories and then of course some of Alaska, so big milestone that we just hit today. really, really happy to be able to announce that just now. So great news Al. Yipee! Lotta work. Yeah, it's been about five years coming, so that's that's great news. Uh, alright well. I think we're done for today.