A&H Data: Creating Mapping Layers from Historic Maps

Some of you know that I’m rather delighted by maps. I find them fascinating for many reasons, from their visual beauty to their use of the lie to impart truth, to some of their colors and onward. I think that maps are wonderful and great and superbulous even as I unhappily acknowledge that some are dastardly examples of horror.

What I’m writing about today is the process of taking a historical map (yay!) and pinning it on a contemporary street map in order to use it as a layer in programs like StoryMaps JS or ArcGIS, etc. To do that, I’m going to write about
Picking a Map from Wikimedia Commons
Wikimedia accounts and “map” markup
Warping the map image
Loading the warped map into ArcGIS Online as a layer

But! Before I get into my actual points for the day, I’m going to share one of my very favorite maps:

Stunning 16th century map from a northern projection with the continents spread out around the north pole in greens, blues, and reds. A black border with golds surround the circular maps.
Urbano Monte, Composite: Tavola 1-60. [Map of the World], World map, 40x51cm (Milan, Italy, 1587), David Rumsey Map Collection, http://www.davidrumsey.com.
Just look at this beauty! It’s an azimuthal projection, centered on the North Pole (more on Wikipedia), from a 16th century Italian cartographer. For a little bit about map projections and what they mean, take a look at NASA’s example Map Projections Morph. Or, take a look at the above map in a short video from David Rumsey to watch it spin, as it was designed to.

What is Map Warping

While this is in fact one of my favorite maps and l use many an excuse to talk about it, I did actually bring it up for a reason: the projection (i.e., azimuthal) is almost impossible to warp.

As stated, warping a map is when one takes a historical map and pins it across a standard, contemporary “accurate” street map following a Mercator projection, usually for the purpose of analysis or use in a GIS program, etc.

Here, for example, is the 1913 Sanborn fire insurance map layered in ArcGIS Online maps.

Image of historical Sandborn map warped across the streetmap
Screen capture of ArcGIS with rectified Sanborn map.

I’ll be writing about how I did that below. For the moment, note how the Sanborn map is a bit pinched at the bottom and the borders are tilted. The original map wasn’t aligned precisely North and the process of pinning it (warping it) against an “accurate” street map resulted in the tilting.

That was possible in part because the Sanborn map, for all that they’re quite small and specific, was oriented along a Mercator projection, permitting a rather direct rectification (i.e., warping).

In contrast, take a look at what happens in most GIS programs if one rectifies a map—including my favorite above—which doesn’t follow a Mercator projection:

Weird looking, pulled streams of reds, greens, and blues that are swept across the top and yanked down toward the bottom.
Warped version of the Monte map against a Mercator projection in David Rumsey’s Old Maps Online connection in 2024. You can play with it in Old Maps Online.

Warping a Mercator Map

This still leaves the question: How can one warp a map to begin with?

There are several programs that you can use to “rectify” a map. Among others, many people use QGIS (open access; Windows, macOS, Linux) or ArcGIS Pro (proprietary;Windows only).

Here, I’m going to use Wikimaps Warper (for more info), which connects up with Wikimedia Commons. I haven’t seen much documentation on the agreements and I don’t know what kind of server space the Wikimedia groups are working with, but recently Wikimedia Commons made some kind of agreement with Map Warper (open access, link here) and the resulting Wikimaps Warper is (as of the writing of this post in November 2024) in beta.

I personally think that the resulting access is one of the easiest to currently use.

And on to our steps!

Picking a Map from Wikimedia Commons

To warp a map, one has to have a map. At the moment, I recommend heading over to Wikimedia Commons (https://commons.wikimedia.org/) and selecting something relevant to your work.

Because I’m planning a multi-layered project with my 1950s publisher data, I searched for (san francisco 1950 map) in the search box. Wikimedia returned dozens of Sanborn Insurance Maps. At some point (22 December 2023) a previous user (Nowakki) had uploaded the San Francisco Sanborn maps from high resolution digital surrogates from the Library of Congress.

Looking through the relevant maps, I picked Plate 0000a (link) because it captured several areas of the city and not just a single block.

When looking at material on Wikimedia, it’s a good idea to verify your source. Most of us can upload material into Wikimedia Commons and the information provided on Wikimedia is not always precisely accurate. To verify that I’m working with something legitimately useful, I looked through the metadata and checked the original source (LOC). Here, for example, the Wikimedia map claims to be from 1950 and in the LOC, the original folder says its from 1913.

Feeling good about the legality of using the Sanborn map, I was annoyed about the date. Nonetheless, I decided to go for it.

Moving forward, I checked the quality. Because of how georecification and mapping software works, I wanted as high a quality of map as I could get so that it wouldn’t blur if I zoomed in.

If there wasn’t a relevant map in Wikimedia Commons already, I could upload a map myself (and likely will later). I’ll likely talk about uploading images into Wikimedia Commons in … a couple months maybe? I have so many plans! I find process and looking at steps for getting things done so fascinating.

Wikimedia Accounts and Tags

Form in whites and blacks with options for a username, password.
Signup form for the Wikimedia suite, including Wikimedia Commons and Wikimaps.

Before I can do much with my Sanborn map, I need to log in to Wikimedia Commons as a Wiki user. One can set up an account attached to one of one’s email accounts at no charge. I personally use my work email address.

Note: Wikimedia intentionally does not ask for much information about you and states that they are committed to user privacy. Their info pages (link) states that they will not share their users’ information.

I already had an account, so I logged straight in as “AccidentlyDigital” … because somehow I came up with that name when I created my account.

Once logged in, a few new options will appear on most image or text pages, offering me the opportunity to add or edit material.

Once I picked the Sanborn map, I checked

  1. Was the map already rectified?
  2. Was it tagged as a map?

If the specific map instance has already been rectified in Wikimaps, then there should be some information toward the end of the summary box that has a note about “Geotemporal data” and a linked blue bar at the bottom to “[v]iew the georeferenced map in the Wikimaps Warper.”

WikiMaps screen capture of the "Summary" with the geobox information showing the map's corner cordinants and a link to viewing it on Wikimaps.
Screen capture of “Summary” box with geocordinates from 2024.

If that doesn’t exist, then one might get a summary box that is limited to a description, links, dates, etc., and no reference to georeferencing.

In consequence, I needed to click the “edit” link next to “Summary” above the description. Wikimedia will then load the edit box for only the summary section, which will appear with all the text from the public-facing box surrounded by standard wiki-language markup.

Summary box showing a limited amount of information with purple headers to the left and information to the right on a grey background.
Screen capture of Wikimedia Commons box with limited information for an image.

All I needed to do was change the “{{Information” to “{{Map” and then hit the “Publish” button toward the bottom of the edit box to release my changes.

Screen capture of wikimedia commons edit screen showing what the text for updating a summary looks like.
Screen capture of Wikimedia Commons edit screen for the summary.

The updated, public-facing view will now have a blue button offering to let users “Georeference the map in Wikimaps Warper.”

Once the button appeared, I clicked that lovely, large, blue button and went off to have some excellent fun (my version thereof).

Summary box with map added as object type with blue box for options for georeferencing.
Example of Wikimedia Commons Summary box prior to georeferencing.

Warping the map

When I clicked the “Georefence” button, Wikimedia sent me away to Wikimaps Warper (https://warper.wmflabs.org/). The Wikimaps interface showed me a thumbnail of my chosen map and offered to let me “add this map.”

I, delighted beyond measure, clicked the button and then went and got some tea. Depending on how many users are in the Wikimaps servers and how big the image file for the map is, adding the file into the Wikimaps servers can take between seconds and minutes. I have little patience for uploads and almost always want more tea, so the upload time is a great tea break.

Once the map loaded (I can get back to the file through Wikimedia Commons if I leave), I got an image of my chosen map with a series of options as tabs above the map.

Most of the tabs attempt to offer options for precisely what they say. The “Show” tab offers an image of the loaded map.

Wikimaps Warper navigation tabs in beiges and white tabs showing the selected tabs.
2024 screen capture showing navigation tabs.
  • Edit allows me to edit the metadata (i.e., title, cartographer, etc.) associated with the map.
  • Rectify allows me to pin the map against a contemporary street map.
  • Crop allows me to clip off edges and borders of the map that I might not want to appear in my work.
  • Preview allows me to see where I’m at with the rectification process.
  • Export provides download options and HTML links for exporting the rectified map into other programs.
  • Trace would take me to another program with tracing options. I usually ignore the tab, but there are times when it’s wonderful.

The Sanborn map didn’t have any information I felt inclined to crop, so I clicked straight onto the “Rectify” tab and got to work.

As noted above, the process of rectification involves matching the historic map against a contemporary map. To start, one needs at least four pins matching locations on each map. Personally, I like to start with some major landmarks. For example, I started by finding Union Square and putting pins on the same location in both maps. Once I was happy with my pins’ placement on both maps, I clicked the “add control point” button below the two maps.

split screen showing a historic, streetmap on the left with a
Initial pins set in the historic map on the left and the OpenStreetMap on the right. note the navigation tools in the upper right corner of each panel.

Once I had four pins, I clicked the gray “warp image!” button. The four points were hardly enough and my map curled badly around my points.

To straighten out the map, I went back in and pinned the four corners of the map against the contemporary map. I also pinned several street corners because I wanted the rectified map to be as precisely aligned as possible.

All said, I ended up with more than 40 pins (i.e., control points). As I went, I warped the image every few pins in order to save it and see where the image needed alignment.

Split screen example showing dozens of aligned points in green, yellow, and red.
Screen capture of Wikimaps with example of pins for warping.

As I added control points and warped my map, the pins shifted colors between greens, yellows, and reds with the occasional blue. The colors each demonstrated where the two maps were in exact alignment and where they were being pinched and, well, warped, to match.

Loading the warped map into ArcGIS Online as a layer

Once I was happy with the Sanborn image rectified against the OpenStreetMap that Wikimaps draws in, I was ready to export my work.

In this instance, I eventfully want to have two historic maps for layers and two sets of publisher data (1910s and 1950s).

To work with multiple layers, I needed to move away from Google My Maps and toward a more complex GIS program. Because UC Berkeley has a subscription to ArcGIS Online, I headed there. If I hadn’t had access to that online program, I’d have gone to QGIS. For an access point to ArcGIS online or for more on tools and access points, head to the UC Berkeley Library Research Guide for GIS (https://guides.lib.berkeley.edu/gis/tools).

I’d already set up my ArcGIS Online (AGOL) account, so I jumped straight in at https://cal.maps.arcgis.com/ and then clicked on the “Map” button in the upper-left navigation bar.

Green and white navigation bar with map, screen, groups, content, and more
2024 Screen capture of ArcGIS Online Navigation Bar from login screen
ArcGIS Online add layer list in white and blacks, offering options for layer sourcing from URL, file, sketching, route, or other media.
2024 add layer list in ArcGIS Online

On the Map screen, ArcGIS defaulted to a map of the United States in a Mercator projection. ArcGIS also had the “Layers” options opened in the left-hand tool bars.

Because I didn’t yet have any layers except for my basemap, ArcGIS’s only option in “Layers” was “Add.”

Clicking on the down arrow to the right of “Add,” I selected “Add layer from URL.”

In response, ArcGIS Online gave me a popup box with a space for a URL.

I flipped back to my Wikimaps screen and copied the “Tiles (Google/OSM scheme),” which in this case read https://warper.wmflabs.org/maps/tile/7258/{z}/{x}/{y}.png.

Flipping back to ArcGIS Online, I pasted the tile link into the URL text box and made sure that the auto-populating “Type” information about the layer was accurate. I then hit a series of next to assure ArcGIS Online that I really did want to use this map.

Warning: Because I used a link, the resulting layer is drawn from Wikimaps every time I load my ArcGIS project. That does mean that if I had a poor internet connection, the map might take a hot minute to load or fail entirely. On UC Berkeley campus, that likely won’t be too much of an issue. Elsewhere, it might be.

Once my image layer loaded, I made sure I was aligned with San Francisco, and I saved my map with a relevant title. Good practice means that I also include a map description with the citation information to the Sanborn map layer so that viewers will know where my information is coming from.

Image of historical Sandborn map warped across the streetmap
2024 Screen capture of ArcGIS maps edit screen with rectified Sanborn map.

Once I’ve saved it, I can mess with share settings and begin offering colleagues and other publics the opportunity to see the lovely, rectified Sanborn map. I can also move toward adding additional layers.

Next Time

Next post, I plan to write about how I’m going to add my lovely 1955 publisher dataset on top of a totally different, 1950 San Francisco map as a new layer. Yay!


Mapping the Italian Language(s) — The Atlante Linguistico Italiano

With its tenth volume recently added to the UC Berkeley Library, the Atlante Linguistico Italiano is a unique piece of the Library’s map collections. Each entry in the atlas begins with a single concept, notion or phrase in standard Italian such as cuore, heart. Accompanying this is a map of the Italian peninsula (along with Sicily and Sardinia) that contains the equivalent term, rendered in IPA, as heard in communes all across the country. The lexical and phonetic variations of a single word play out in gradients across the landscape with small changes from one commune to the next that give way to seismic ones from one region to another. The result is a condensed roadmap of the immense linguistic diversity of Italy.

Bambino
Entry for the world “bambino”, showing variants across Tuscany, Emilia-Romagna and Liguria.

As of now, the ten available volumes cover lexical items in the following spheres: the human body, clothing, the home, food, family, and society, with many other spheres such as fauna, commerce, and agriculture yet to be published. While this work is comprehensive in its treatment of geographic variants, it says unfortunately very little about diastratic variation or the relative social capital of the varieties it contains. With its data now over 30 years old, and many of its constituent dialects likely under the threat of extinction, the Atlante may soon start to take on historic and diachronic intrigue as well.

 

Oggi
Entry for the word “oggi” showing showing variants Lombardy, Liguria, Piedmont, and the Aosta Valley.

And if you’re thinking of taking these volumes home with you, think twice. They won’t fit in your backpack. They are big and heavy, measuring 49 x 71 centimeters each, and best consulted in the comfort of the Main Stacks.

 

Pellis, Ugo, and L. (Lorenzo) Massobrio. Atlante linguistico italiano  / materiali raccolti da U. Pellis [and others] ; redatto da L. Massobrio [and others]. Roma: Istituto Poligrafico e Zecca dello Stato, Libreria dello Stato, 1995.
Main (Gardner) Stacks fff PC1711 .A89 1995 v.1-10


Coming Soon: Love Your Data, from Editathons to Containers!

UC Berkeley has been loving its data for a long time, and has been part of the international movement which is Love Data Week (LDW) since at least 2016, even during the pandemic!  This year is no exception—the UC Berkeley Libraries and our campus partners are offering some fantastic workshops (four of which are led by our very own librarians) as part of the University of California-wide observance.

Love Data Week 2023 is happening next month, February 13-17 (it’s always during the week of Valentine’s Day)!

University of California 2023 Love Data Week calendar with UC Berkeley offerings

UC Berkeley Love Data Week offerings for 2023 include:

GIS & Mapping: Where to Start

Wikipedia Edit-a-thon (you can also dip into Wikidata at other LDW events)

Introduction to Containers

Textual Analysis with Archival Materials

Getting Started with Qualitative Data Analysis

All members of the UC community are welcome—we hope you will join us!  Registration links for our offerings are above, and the full UC-wide calendar is here.   If you are interested in learning more about what the library is doing with data, check out our new Data + Digital Scholarship Services page.  And, feel free to email us at librarydataservices@berkeley.edu.   Looking forward to data bonding next month!


Event: Map the Bay Student Mapmaking Contest for Bay Area students

Welcome to the UC Berkeley Earth Sciences & Map Library 2021 Mapmaking contest
 

The UC Berkeley Library is hosting our second annual Map the Bay Student Mapmaking Contest for Bay Area students. Online submissions are welcome from March 1, 2021 – April 9, 2021. Maps can be real or imaginary, hand drawn or created on a computer, as long as they have some Bay Area connection. Finalists will be featured in the virtual exhibit, Mapping the Bay. The winning entries (selected through public voting) are eligible for a $50 gift card!

Follow these TWO steps to enter the contest:

Find more contest details here: Map the Bay: 2021 Student Mapmaking Contest

View the online exhibit and past entries here: Mapping the Bay

Questions? Email us at: map-contest@berkeley.edu

Susan Powell, On behalf of the UC Berkeley Earth Sciences & Map Library


Primary Sources: Diseños Collection at the California State Archives

hand drawn map of Aguajito Rancho
“Aguajito Rancho,” California State Archives Exhibits, accessed November 27, 2019, http://exhibits.sos.ca.gov/items/show/11154.

“Within the Diseños Collection there are 493 hand-drawn sketch maps, or diseños, that were created from approximately 1866-1871. These sketch maps were hand-copied from originals that were created from approximately 1827-1846. These are part of a larger collection that makes up the Spanish and Mexican Land Grant Records that also include expedientes, or written documents regarding the grant petition, and other related documents. Each diseño includes naturally occurring boundaries such as rivers, mountains, rock outcropping, and trees as markers. Many of the diseños have labeled neighboring properties and as part of the initial land grant process all boarders were agreed upon by surrounding landowners. The diseños also show existing travel routes, locations of houses and local place names.

“At the end of the Mexican-American War in 1848, California became a territory of the United States after Mexico and the United States signed the Treaty of Guadalupe Hidalgo. Among other things, the treaty directed the U.S. government to honor legitimate land claims of Mexican citizens in the territory. Following California’s statehood in 1850, Congress passed the Land Act of 1851 creating the Board of Land Commissioners. The Board used the diseños, expedientes, U.S. Surveyor General surveys, and other related title documents from landowners to verify individual land ownership and boundaries. Over a period of five years, the Board of Land Commissioners reviewed 813 grant claims, but only approved 553. The Mexican land grant process had a major influence on the development of California land by shaping settlement patterns and land ownership. As some of the earliest maps in California, diseños are essential to understanding the complex system of land ownership in the state today.”

California State Archives: https://www.sos.ca.gov/archives/collections/disenos-collection/


Trial: Fire Insurance Maps Online

section of fire insurance map of university of californiaThe Library has a trial for Fire Insurance Maps Online (FIMo) through February 28. The trial is set up for access on campus but not via EZProxy so you will need to be on campus or use the VPN to access the resource.

Fire insurance maps were originally created to assist fire insurance companies with assessing their liability in urban areas. They contain detailed information about properties and individual buildings.

Go to https://fims.historicalinfo.com  Use the interactive map search or search by place name.  During the trial you can search and view historical map coverage throughout the U.S., but will not be able to download full resolution imagery.


Event: Cartographic Materialities: Mapping the Pre-Modern World (A Symposium)

The Andrew W. Mellon Fellowship of Scholars in Critical Bibliography and the Designated Emphasis in Renaissance and Early Modern Studies Present:

 Cartographic Materialities: Mapping the Pre-Modern World (A Symposium)

THURSDAY, MARCH 2

3:30-5:00 – Cartographic Objects Workshop at the Bancroft Library (David Faulds)

Please RSVP to jraisch@berkeley.edu

 

FRIDAY, MARCH 3

1:15-2:45 – Graduate Student Panel, 308A Doe Library

Keith Budner (Comparative Literature) – “From Geography to Chorography: Representing Pomponius Mela, Ptolemy and Strabo in Two Spanish Renaissance Maps”

Jason Rozumalski (History) – “Kaleidoscopes of Time and Place: Images of places as events in sixteenth-century England”

Grace Harpster (Art History) – “Pastoral Maps: Devotional and Administrative Itineraries in Rural Sixteenth-Century Milan”

Moderator: Diego Pirillo (Italian)

 

3:00-5:00 – Plenary Panel, 308A Doe Library

Tom Conley (Romance Languages, Harvard) – “Baroque Hydrographies”

Ricardo Padrón (Spanish, UVA) – “The Indies and the Printed Page: Inventing America on the Ramusio Map of 1534”

Valerie Kivelson (History, Michigan) – “An Early Modern Great Game: Maps of Siberia and their Circulation in the 17th and 18th century”

Moderator: Timothy Hampton (French and Comparative Literature)

http://guides.lib.berkeley.edu/cartographic-materialities