SF Film locations conversion tool to GeoJson using data from sfgov.org via SF Film commission filmsf.org.
Raw Data: https://data.sfgov.org/Culture-and-Recreation/Film-Locations-in-San-Francisco/yitu-d5am
Last updated: 2019-08-24 Total GeoJSON Records: 3299
This tool will convert the 3200+ raw locations from the RDF-ish JSON format from SFgov.org into GeoJSON format. The locations are looked up using Google Cloud Platform (GCP) geolocation service. Even using the GCP gelocation server, there's still 10-15 locations that have be edited by hand to correctly resolve the location successfully. See LOCATION_OVERRIDES
in converter.py
for details.
The output (SF-Film-Locations.geojson
) is using the open GeoJSON standard as a FeatureCollection
.
A CSV file of the results is here:
The raw GeoJSON file is here:
Github provides a simple view of GeoJSON (example shown below).
Pulling the raw data from sfgov.
wget "https://data.sfgov.org/api/views/yitu-d5am/rows.json?accessType=DOWNLOAD" --output-document Film_Locations_in_San_Francisco.json
The raw locations are loose text descriptions of the film location site and is not easily or robustly consumed for plotting purposes.
Examples of raw film site locations:
- "Bayshore Blvd near Cesar Chavez (Bayview)"
- "420 Jones St. at Ellis St."
- "Hayes Street at Laguna"
- "City Hall"
- "Leavenworth from Filbert & Francisco St"
Note, this requires a Google Cloud Platform (GCP) API key. The GCP service is used to take the raw location description to resolve to lat/long and well formatted address values.
./converter.py -k "${API_KEY}" --sf-json Film_Locations_in_San_Francisco.json -c geolocation-cache.json -o SF-Film-Locations.geojson --log-level=DEBUG --log-file=output.log
The output (SF-Film-Locations.geojson
) is using the open GeoJSON standard as a FeatureCollection
.
Github provides a view of GeoJSON. I've also checked in the output CSV which provides a high level overview of the data in tabular form.
One of the many locations from Bullitt
(1968).
{
"geometry":{
"coordinates":[
37.7502159,
-122.3839432
],
"type":"Point"
},
"id":"C51901DF-25CE-4B50-A369-6BE660D38C2B",
"properties":{
"Director":"Peter Yates",
"Distributor":"Warner Brothers",
"Fun Facts":null,
"Locations":"Bayshore Blvd near Cesar Chavez (Bayview)",
"Production Company":"Warner Brothers / Seven Arts\nSeven Arts",
"Release Year":1968,
"Title":"Bullitt",
"Writer":"Alan R. Trustman",
"actors":[
"Steve McQueen",
"Jacqueline Bisset",
"Robert Vaughn"
],
"created_at":1509143469,
"created_meta":"881420",
"formatted_address":"601 Cesar Chavez, San Francisco, CA 94124, USA",
"id":"C51901DF-25CE-4B50-A369-6BE660D38C2B",
"meta":null,
"place_id":"ChIJawtxxrp_j4AR22luIA2ccZ4",
"plus_code":{
"compound_code":"QJ28+3C Bayview, San Francisco, CA, United States",
"global_code":"849VQJ28+3C"
},
"position":211,
"sid":211,
"updated_at":1509143469,
"updated_meta":"881420"
},
"type":"Feature"
}
One of the locations from a more recent film, Ant-Man
(2015).
{
"geometry":{
"coordinates":[
37.7852042,
-122.412723
],
"type":"Point"
},
"id":"7807E6F8-0428-41C4-92FA-3EA8A1782113",
"properties":{
"Director":"Peyton Reed",
"Distributor":"Walt Disney Studios Motion Pictures",
"Fun Facts":null,
"Locations":"420 Jones St. at Ellis St.",
"Production Company":"PYM Particles Productions, LLC",
"Release Year":2015,
"Title":"Ant-Man",
"Writer":"Gabriel Ferrari ",
"actors":[
"Michael Douglas",
"Paul Rudd"
],
"created_at":1509143469,
"created_meta":"881420",
"formatted_address":"420 Jones St, San Francisco, CA 94102, USA",
"id":"7807E6F8-0428-41C4-92FA-3EA8A1782113",
"meta":null,
"place_id":"ChIJmQ0U34-AhYARQODKYn8PKzU",
"plus_code":{
"compound_code":"QHPP+3W Tenderloin, San Francisco, CA, United States",
"global_code":"849VQHPP+3W"
},
"position":78,
"sid":78,
"updated_at":1509143469,
"updated_meta":"881420"
},
"type":"Feature"
}