Using USGS TNM Vector Data to Create Seamless Topographic Maps in ArcGIS

One of the most popular download on this site is how to convert USGS geopdf to geotiffs using ArcGIS.  So I started to thinking about why not use the USGS Topo Vector Data to create seamless maps that are very similar to the USGS geopdfs? Why do I want to use the USGS Topo Vector Data to create topographic maps? Because it’s a hassle and a pain in neck to get USGS GeoPDFs into a GIS, and sometimes the web mapping services just don’t cut it (e.g. resolution not good enough, limited control over styling, etc.).

This post is a follow up post to the previous, USGS TNM Style Template ArcGIS. Data for Hawaii is now available to use with the ArcGIS map document template. I like the USGS TNM Topographic maps as basemaps – it provides an informative but clean background for whatever data layers I overlay on top of it and plus most people are familiar with it. If you are looking to recreate a USGS Topographic Quadrangle maps (7.5-Minute topo quads) in ArcGIS – I suggest you follow the instructions given on the USGS site. What I want is to assemble a statewide dataset for use with the TNM style template to create a seamless USGS topo maps. You should read the USGS FAQ on using the USGS TNM style template.

Step 1: Download Datasets and TNM Style Template

So, the first step is to download the datasets needed for Hawaii and the style template.

1. A good place to look for data is here: https://viewer.nationalmap.gov/basic/ or go directly to https://viewer.nationalmap.gov/tools/topotemplate/

First you should download the TNM Style template and Topo Map Vector Data GDBs for all the 7.5-Minute quads of interest. Here I have the Topo_TNM_Style Template which contains the ArcMap map document that will be used for the styling and map making later.

Fig0002.png

Also I have downloaded all the vector data by island. Make sure you download data as file geodatabases and not shapefiles. If you know what you're doing then you can go directly to the Cloud Browse FTP site and download what you need. Unfortunately the listing of staged vector data doesn't include Hawaii so I have use the data download service instead.

 Topo Vector Data for 7.5-Minute cells for Oahu

Topo Vector Data for 7.5-Minute cells for Oahu

If you look at the topo vector data GDB file you'll see that it contains the following data - shown below is a example for Pearl Harbor quad, but all the GDBs should contains the same datasets. Using this as a reference I'm going to download the statewide (Hawaii) equivalents to created my Statewide Topo Vector Data GDB.

Fig0004.png

You will need to download the following datasets:

Fig0005.png
  • GOVTUNIT_Hawaii_State_GDB.gdb - file GDB containing boundary layers for Hawaii
  • MAPINDICES_Hawaii_State_GDB.gdb - file GDB containing map indices for Hawaii. You'll want to use the 7.5-Minute map index
  • NHD_H_Hawaii_GDB.gdb - file GDB containing the National Hydro Dataset for Hawaii
  • STRUCT_Hawaii_State.GDB.gdb - file GDB containing point structures for Hawaii
  • TRAN_15_Hawaii_GU_STATEORTERRITORY.gdb - file GDB containing transportation layers for Hawaii
  • WOODLAND_15_Hawaii_GU_STATEORTERRITORY.gdb - file GDB containing woodland land use for Hawaii

For the Elevation Data - you can download the contour data directly from the Cloud Browse FTP site or use the Download GIS Data web service. Here I am using the data download service.

Fig0006.png
Fig0007.png

Step 2: Create an empty geodatabase schema

So after downloading the data I need, I going to create an empty geodatabase schema based on one of the Vector Data Quad GDB (e.g. Vector_34545_Pearl_Harbor_7_5_Min.gdb). I'm going to then load the statewide datasets into this new GDB and this will be my new Topo Vector Data GDB for Hawaii.

Export existing Vector_xxx_7_5_Min.gdb schema

1. In ArcCatalog, right click on the Vector_xxx_7_5_Min.gdb >> Export >> XML Workspace Document

2. In the Export XML Workspace window: Select only the schema to export and give the output xml a name. Click Next and make sure you Select all features to included in the export

Fig0008.png
Fig0009.png

Create a new file geodatabase with existing schema

1. In ArcCatalog, create a new file geodatabase then import the existing XML schema your exported previously (Right click on file GDB >> Import >> XML Workspace Document)

2. In the Import XML Workspacec Document, select to import only the schema

Fig0010.png

Step 3: Load Data into the New Statewide GDB

1. You should now have an empty file GDB with the proper schema to load data into.

Fig0011.png

2. In ArcCatalog start loading the corresponding statewide data into the correct feature classes. For example, here I'm going to load the features from my MAPINDICES_Hawaii_State_GDB.gdb\Cells\CellGrid_7_5Minute layer into the corresponding TopoVectorDataHawaii_2017.gdb\CELLS\CellGrid_7_5Minute layer. Right click on the feature class for which you want to load features into >> Load >> Load Data. In the Simple Data Loader window: input your parameters.

Fig0012.png
Fig0013.png
Fig0014.png
Fig0015.png

3. Use the Simple Loader method to load features into all the corresponding feature classes - exceptions below. You can load features from multiple layers -- see example below for elev_contours.

Note: For Transportation Road features the Target Fields and Matching Source Fields will not all match (some Source Fields will be blank or None) - this should be ok since the fields for display (TNMFRC) and label (FULL_STREET_NAME) match. Also the TNMDerivedNames feature class does not have a statewide equivalent (explained further below) - follow Step 3A below for a work around solution.

Fig0016.png

Step 3A: Batch Selecting and Merging TNM Derived Names Points

The USGS TNM Style guide says that "TNM Derived Names is a filtered and enriched dataset intended specifically to be used for labeling named features. TNM Derived Names data are provided only in conjunction with Topo Map Vector Data products." So there are no national or statewide data for TNMDerivedNames layer - you'll have to merged all the points from each of the Vector Quad GDB. Note that you can't just merged the points together because a quad can contain points for other adjacent quads as well so you'll end up having duplicates if you don't filter them first. What you'll need to do is select only the points in the quad of interest then do the merge so the resulting layer won't contain duplicates (see example image below:

Fig0017.png

Batch Selecting TNM Derived Names Points of Interest

The example shown here is batch selecting features for all 6 quads for Lanai.

1. Create a new file GDB for the data staging (e.g. LanaiStaging.gdb)

2. In ArcToolbox, go to Analysis Tools >> Extract >> Right click on Select >> Batch

3. In the Batch Select grid: (there are 6 quad cells so there should be 6 output feature classes)

  • Input Features: TNMDerivedNames layer from each quad
  • Setup your Environment settings to use your staging GDB as the Scratch Workspace (e.g. LanaiStaging.gdb)
  • Output Feature Class: Use the default or input a name
Fig0018.png

Here is an example for the LanaiStaging.gdb

Fig0019.png

Merging or Loading the TNMDerivedNames Output Feature Classes

After you are done with the batch feature selections, use the Simple Data Loader (right click on the target layer >> Load >> Load Data) to load in the features from your staging GDB into the TNMDerivedNames feature class. Alternatively you could also use the Merge Tool in ArcCatalog.

Fig0020.png

Once you are done with the merging or feature loading, you can then link the data sources in the TNM Style Template MXD.

Step 4: Linking Data Sources to TNM Style Template

1. Open the TNM Style Template map document (e.g. TopoTNMStyleTemplate_v10_0.mxd)

2. Modify the map document to fit your needs:

  • Delete data frames that you don't need - I only kept the Map Layers and Images Data Frames
  • Change the coordinate system of the Map Layers Data Frame
  • Set the Data Source links for layers with missing data links. Note PLSS does not exist for Hawaii.
  • Save a copy of the map document
Fig0021.png

3. "Layers" under the Images Data Frame are web services. Note that the WetlandsTopoService needs fixing (exising URL to service is doesn't work).

  • In a web browser, go to https://viewer.nationalmap.gov/services/ and scroll down to Themed Overlays  >> FWS Wetlands - Topo Symbols >> Click on REST - this should open a new page to the REST service - copy this URL up to "...services/"
Fig0022.png
  • In ArcCatalog, add this web service. Go to GIS Servers >> Add ArcGIS Server. In the Add GIS Server window: select use GIS server >> Next. Then Paste the Server URL you copied and click Finish
Fig0023.png

You should now have the FWS Wetlands Topo Services added to your GIS server in ArcCaalog - see below.

Fig0024.png

4. Back in the ArcMap document, what you have to do is remove the existing WetlandsTopoService then add it back in using the new FWS GIS Server. Note: Setting the data source/link to the existing WetlandsTopoService didn't seem to work for me - not sure why (I'm using ArcGIS Desktop 10.5.1).

Fig0027.png

5. Modify your map document and map layout to fit your needs. That's it.

 Example showing a "seamless" TNM Style map -- very similar to the USGS topo quad maps

Example showing a "seamless" TNM Style map -- very similar to the USGS topo quad maps

 Another example showing a more close up view with no modifications of labels or symbology - note since this is all vector data (with exception of web services) everything looks sharp and can be modified as needed.

Another example showing a more close up view with no modifications of labels or symbology - note since this is all vector data (with exception of web services) everything looks sharp and can be modified as needed.