Conflating TfNSW Traffic Lights dataset with OSM in JOSM
Posted by aharvey on 18 July 2020 in English. Last updated on 19 July 2020.Conflation
- Download the XLSX from https://opendata.transport.nsw.gov.au/dataset/traffic-lights-location
- Open the XLSX in LibreOffice and add an extra column
start_date
with formula=IF(C2, CONCAT(YEAR(C2), "-", TEXT(MONTH(C2), "00"), "-", TEXT(DAY(C2), "00")), "")
. - Convert the XLSX to CSV
- Open the CSV in JOSM (may need open data plugin)
- Select all the CSV nodes and then update
Equiptment_ID
toref
, deleteDate_install
,Suburb
. - Edit > Search, with search string
Asset_Type=VEH
with results set to select. Add the taghighway=traffic_signals
and delete the tagAsset_Type
. - Edit > Search, with search string
Asset_Type=PED
with results set to select. Add the tagshighway=crossing
+crossing=traffic_signals
and delete the tagAsset_Type
. - Add a new layer and download from OSM via Overpass using the wizard text
(highway=traffic_signals or (highway=crossing and crossing=traffic_signals)) in "NSW, AU"
- Active the conflation plugin, and configure. Select all the TfNSW nodes and then freeze that as the reference, then select all the OSM nodes and freeze that as the subject.
- Change the distance to 50 (in meters)
- Set merge tags and list
highway,crossing,ref,start_date
and then exceptSTREET_1,STREET_2
. - The other options should be Simple, Disambiguating method.
- Generate matches
Now in the conflation tab there is “Reference only” which are ones in TfNSW but not OSM. Subject only are ones that are in OSM but not TfNSW, and matches shows ones that were found in both but have have a different location and/or tags.
At the time of writing there were 768 found in TfNSW not found in OSM and 5,306 found in OSM not found in TfNSW. But take this with a gain of salt as there are differences in how they are modelled in OSM.
Building a Maproulette Challenge
- From JOSM I exported the nodes missing in OSM as a .osm file.
- Following the example at https://github.com/maproulette/mr-cli#example-1-adding-new-unrelated-osm-nodes using mr-cli run
mr-cli cooperative change --out challenge.json josm-export.osm
- Create a new challenge on Maproulette using the challenge.json file you just created, eg https://maproulette.org/challenge/13925
Discussion