Category Archives: data & visualization

Treasure of data access for GIS&T domain

I was about to jump into my regularly scheduled workday when I came across this data visualization tool for educational statistics, whose primary sources are EXACTLY the same ones that I’d been exploring yesterday. How weird is that. And that they had data about “Geographic Information Science & Cartography” at the 6-digit level (much more specific), much more interesting than what they consider its default “comparison” group, “social sciences” at the 2-digit level.

The measurements of “skills” for GIS&T showed a tremendous revealed comparative advantage (RCA) for negotiation, critical thinking, coordination, plus many management of (time/material resources/financial resources) ones. Complex problem solving is the only one that’s also high from another group of skills. RCA is “how much greater or lesser that skill’s rating is than the average,” which I guess means the average rating for that skill for other employment areas (?).  It’s not a surprise that these are high, but it it is interesting that programming and technology design have such a little RCA for us.

ScreenHunter_491 Apr. 24 08.06

Data from O’NET, Department of Labor.

And then there are the tree diagrams of the number of degrees awarded themselves. What’s not very helpful are how they’ve lumped things together into the shaded groups. There is much diversity within each group when you scan across the yellowish ones and the hospital-scrubs-green ones. Like in 2013 when both Texas State University and University of Maine at Machias (hi Tora) are both in the yellow set.  Orange-shaded ones seem to consistently be the community college set.

For the year 20132013 Tree Map of Institutions for Geographic Information Science & Cartography Majors

and for the year 2016:

2016 Tree Map of Institutions for Geographic Information Science & Cartography Majors

Much to explore further here and how lovely that we can download the data themselves. Thank you, open government.

Live ocean mapping in the South Pacific

Just today I learned about NOAA’s Okeanos Explorer current trip in the Pacific. Apart from the live (and previously recorded) narration that I’m finding mesmerizing, I can’t stop watching the “live” mapping taking place on one of the media feeds.  For someone who has spent her entire professional career accessing geospatial data to use in mapping projects, that fact that I’m watching new digital data being produced – LIVE – where there was no data before – is blowing my mind.  About 8 or 9 yrs ago, I actually watched people buy shoes from Zappos in real-time. We’ve come a long way, baby.

Elevation data: Where to go and what to know

Digital representations of the surface of the earth are a key data set for many GIS projects, but locating, identifying, downloading and manipulating digital elevation data is not for the faint of heart. There are many different skills required and hundreds of tools, systems and instruments from which to choose. In this article, author Diana Sinton highlights available resources and need-to-know information.

Introduction to the digital elevation model

The most common form of digital representation of the surface of the earth is presented as values of elevation above sea level, often derived from sampled point measurements and represented in raster formats as a digital terrain model or digital elevation model (DEM), or as a vector triangulated irregular network (TIN). Apart from generating a topographical surface itself, these data are also the basis for deriving slope gradient, slope aspect and hillshade relief.  Digital elevation data are central to transportation planning, land use planning, and geological and hydrological analyses, among countless others.  For this article, we’ll focus on DEMs as a generic format of elevation data in digital form.

For many years, the most common source and scale for a DEM were the 10-meter and 30-meter resolution data organized and distributed by the US Geological Survey to align with their 7 ½ minute topographic quad sheets. These original DEMs were derived from traditional photogrammetric methods or reverse-engineered from contour lines. Errors and inaccuracies abound. Nine times out of ten, one’s area of interest was situated at the intersection of four quad sheets, so there was great rejoicing when it became possible to download “seamless” elevation data, foregoing the need to edge-match or mosaic multiple data sets together. 

Measuring the horizontal resolution of elevation data often refers to spherical units of arc seconds, or 1/3600 of a degree. One arc second represents approximately a 30-meter grid cell.  Accordingly, a one-third arc second of measurement is approximately ten meters in distance, and a one-ninth arc second is three meters. However, these measurements hold true at the equator, when both latitudes and longitudes are evenly spaced.  Once distances are measured towards the poles, longitude measurements begin to converge and regular grid spacing becomes distorted.  By the time one is measuring in arc seconds at 49 degrees latitude, an arc second of longitude has shrunk to 20.25 meters and grid cells have become elongated in shape. 

Becoming familiar with the arc second system of horizontal measurements is a worthwhile investment of time when navigating elevation data sites, but it may be even more important to understand the absolute and relative vertical errors within DEM data. The original production goal of the 7 ½ minute USGS quads included a vertical accuracy standard of 7 meters, and up to 15 m variability was permitted (USGS Data Users Guide, pdf).

DEM meets Big Data in the US

Fast forward to 2015 and digital elevation information has intersected with the Big Data movement. In the United States, the National Elevation Dataset (NED) has replaced the former system of quad-based DEMs.  Significant efforts have been made to ensure that the horizontal and vertical datums, elevation units and projections or coordinate systems have been made consistent or, where needed, optimized for that locale. Root mean square errors for vertical accuracy have fallen to less than 2 meters within much of the NED collection.  Light Detecting and Ranging, aka LIDAR, data, and interferometric synthetic aperture radar, aka IfSAR, have become the standard approaches for high resolution data collection, and this has allowed for improvements and upgrades throughout the United States. Unlike the bare-earth presumption of DEM data, these new sources also provide detailed data for what is on the surface of the earth, for example the heights of vegetation and structures. The use of new technologies has been particularly important in states such as Alaska, where conditions had never previously permitted consistent and high quality data to be collected.

Of course there are times when it is both desirable and necessary to access older data, particularly when needing to make comparisons between before-and-after geomorphic changes following earthquakes and volcanic eruptions. For such purposes, the USGS also maintains a collection of historic DEMs.

Global data resources

When elevation data outside of the U.S. is needed, two important sources include data derived originally from NASA’s Shuttle Radar Topography Mission, as well as the more Advanced Spaceborne Thermal Emission and Reflection Radiometer global digital elevation model, now at Version 2.  Since its original collection in the year 2000, the SRTM data has been corrected and revised, and its 90-meter resolution coverage is some of the most comprehensive world-wide.  ASTER's Global DEM data has also undergone revisions and corrections, and its one arc second, 30-meter, resolution extends to even broader global coverage. 

New satellite technologies and demand for higher resolution and more consistent data are driving the growth in digital elevation data advancement today.  In 2010, DLR, Germany’s national aeronautics and space research center, launched the TanDEM-x satellite to partner with the already-orbiting European TerraSAR-X and is now producing data designed to be high resolution, with great vertical accuracy, and as consistent and reliable as possible in their coverage.

In the U.S., the current 3D Elevation Program has brought together multiple funding entities to produce and distribute nation-wide LIDAR data coverage, with IfSAR-based data in Alaska. Acquiring and processing these data will take years, but there is wide agreement that it is a wise investment with extensive benefits for the public and private sectors alike. The specter of sea level change has also compelled NOAA to prioritize LIDAR-based topographic data for coastal regions

Locating, identifying, downloading and manipulating digital elevation data is not for the faint of heart.  New interfaces for data discovery such as Reverb|ECHO come complete with 317 platforms, 658 instruments and 717 sensors from which to choose. Even the simpler National Map and Earth Explorer assume that users are familiar with the optimal spacing of LIDAR point clouds, arc second measurements, and the deciphering of acronyms.  OpenTopography is specifically designed to lower the access barriers to high resolution data, but to date the availability is limited. 

My advice? Give yourself plenty of time to sort out what’s available for your area of interest and what you really need for your project or application. Being able to find exactly the data you seek, download it, figure out and manipulate its compression format, modify its projection or coordinate system and successfully add it to your project is likely to require persistence, patience and the knowledge of a rocket scientist.  Or two. 

the Golden Era of Visual Storytelling

What I like about this notion of the Golden Era of Visual Storytelling is that it’s seen in the here and now as being special,  and it suggests that we might even consider this period an extraordinary one, even from a future perspective. That its value and worth are widely enough recognized that the energy can go into refinement and production, rather than basic awareness building.

Surely the tremendous growth and maturation of infographics reflects this too.  I think infographics are some where on this Gartner Hype Cycle, maybe on the slope of enlightenment?   Or have they yet to reach that stage, and maybe are still stuck in the disillusionment trough?

Visual story telling is an element of visual reasoning and visual literacy, which is grounded in spatial reasoning and spatial literacy. An idea that will one day reach its own plateau of productivity, I know.  I tried pointing out the spatial thinking behind the visual thinking identified in the ASIDE blog, but no responses yet.

 

Maps as Organizational Templates

There’s a hip trend going around, making simple maps with labeled spaces. At least one or two a week have been crossing my computer screen lately. I’ve always referred to this approach as using maps as organizational templates. In most cases the map-makers don’t go into telling a story about why the data are where they are. They’re just labeling a place with its information, and leaving the rest up to us. The map is serving as a way to represent data by virtue of its geographical location. That is, we start with some data, and that data happens to have a 1-to-1 relationship with some location, like a state in the US, or a country in the world.

We could use a spreadsheet as an organizational template instead. In fact, many of these maps started that way. Start with a spreadsheet with an alphabetical list of all 50 states (plus D.C., which often gets overlooked), and then another column in the spreadsheet has some information about each state (let’s call it an “attribute” of that State).  And maybe we know different attributes for different years.

Problem: looking at an Excel spreadsheet is boring. And it’s virtually impossible for us to envision a “pattern” from a spreadsheet. States or countries arranged alphabetically tells us nothing about the geospatial relationships among those places. Did I already mention it’s boring. Our eyes glaze over. Who wants to have glazed eyes?

Instead, by labeling each state – or country – or region – with the attribute, we can appreciate the geographic pattern of said information.  When the data are categorical or nominal, you might get a map like what the most popular boy’s name has been in each state over the last 60 years, or the girls’ names, or surnames in Europe, how the Russian language engenders the names of world countries, or what each world country is “best at” (which is a wonderfully subjective way to begin a discussion), with the label being a word or a phrase.

Such data can often be represented pictorially or through icons, like the “most famous book” in each State (again, who gets to decide that?!), or the Food of the States. At least they remembered D.C.!

I don’t know, maybe it’s just me. But I’m seeing these maps all over the place these days.

Metropolitain, some beauty behind the Paris metro

Here’s a beautiful visualization of the Parisian metro system.  I particularly like the 3d version with the density / heatmap underlay.

Thought I’d gotten this via FlowingData, but maybe not?

next generation of digital “knowledge network” maps

This year we’re supporting several faculty projects that involve mapping “knowledge” – collections of ideas, groups of people, collections of objects. They have both geographic and non-geographic attributes.  Eventually the faculty, and their students, will use spatial thinking to extract meaning from the representations: what are the relationships among the components, based on distance, connections, sequences.

To begin, we’re playing with NodeXL, but are likely to branch out to more customized tools later.

I like Flash-based interfaces, like this one that lets you explore the Abstraction movement of art history, from MoMA.  Sites like these have matured. Instead of just including the graphical network itself, it’s now a multi-media experience, with other text, images, audio, etc., to expand and illustrate.  I really like these.

an idea worth supporting: an innovative, well-designed, and community-sourced Food Atlas

New to me: the current project being undertaken by “guerrilla cartographers” to create a food atlas. I love the premise, I love the process, and I know I’ll like the product. Go mappers!

more examples of linking geography and history via maps, some digital

My friends at the UVa Scholar’s Lab shared with me their new Neatline project earlier this week. I don’t know much about Omeka, but I always trust these guys to do good work with a wide range of OS tools. I do like the interface, the rapid loading of georeferenced maps, and the additional interactive functionality on the main screen. If I can figure out more about this, I have a stack of projects ready to try!

In Time & Place is oriented to secondary school learning. This will be a good resource for my Spatial Literacy students, and I’ll see about modifying things for my higher ed students too.  Not sure how I wandered across this site this week. I need to click on fewer windows to make h/t’ipping easier.

Conflict History is a Google Maps mashup. I like the timeline and the thorough “info” available.  This interface and collection really highlights the disparity between how few military conflicts we’ve had on US soil versus the rest of the world, and how relatively high Europe and Asia are. Not news, but interesting to see it in this way.  H/t to Google Maps Mania.

 

data for mapping farmers’ markets

During a workshop today, I came across this USDA collection of data for farmers’ markets.  Easy to download, easy to map.  Don’t know how currently or accurately it’s maintained, but it’s enough to start with!   Somewhere this mashup image was already part of it too.