Reflections on 10 years of a changing Open Source Map

It was ten years ago today that I registered to map the highway!

With apologies to the Beatles, on 2007-12-28, I registered an account with OSM, started editing the map, and after returning from Falkirk to Cramlington, uploaded my first GPS survey data.

The map has changed rather a lot in that time, and not just in completeness, but in the diversity of the usage of OSM data. I was surprised a few years ago when visiting Lichfield that the Council was using OSM to show car parks, but shouldn’t have been surprised at all when preparing for a walk up Simonside when the Forestry Commission linked to an OSM map based in a small way on my previous visit!

… See full entry

Another round of Ordnance Survey data has been released and processed by ITO! to produce a very useful comparison against OSM. Once again, their very usable web slippy map, and JOSM layer this has shown up a new building site I didn’t know existed ready for survey.

ITO World Open Data Tools

As well as missing developments, the comparison also showed up a fat-fingered typo from one of my past surveys - quickly fixed!

As usual, don’t assume OSM mappers are any better or worse than the professionals - OS data feeds from local authorities don’t always match the ‘ground truth’ signage and so don’t accept the OS Locator data has to be correct without a check particularly if OSM is marked source=survey.

If there’s no signage out there to contradict or correct, then an attributed name from OS is better than none (source:name=OS Locator). If Locator is wrong, use the tag ‘not:name=’ to show the issue to comparison sites like ITO, and also to OS so they can check themselves.

So once again, raise a glass to OS Open data, ITO for the service, and the local groups of fellow mappers slowly increasing the comparison UK Percentage Complete beyond the current 97.60%.

Help turn all UK counties UK cyan on the overview map - a 100% match!

Hi,

About every six months, ITO process road name data published from the UK Ordnance Survey and run a comparison against OSM. This is an interesting time as the differences show up new building sites you didn’t know existed and are prime for survey.

The ITO service is not the only tool that does this, but I like the colour coding and overall view of both the UK as a whole, and individual differences.

ITO World Open Data Tools

The comparison also shows up fat-fingered mistakes, but don’t assume OSM mappers are any better or worse than the professionals - OS data feeds from local authorities don’t always match the ‘ground truth’ signage actually on the ground!

In particular, this means don’t blindly accept the OS Locator data is correct and add a ‘source:name=OS Locator’ tag, particularly if OSM is marked source=survey. Take the time for a ground survey, and if there’s no signage out there to contradict or correct, then an attributed name from OS is better than none. If Locator is wrong, use the tag ‘not:name=' to show the issue to comparison sites like ITO, and also to OS so they can check themselves.

The indeterminate cases are harder - North Tyneside has a street with four signs on walls next to each other saying both ‘EDWINS AVENUE’ and ‘EDWIN’S AVENUE’. As the apostrophe signage is newer, I’ve added it to the highway, with alt_name for the version without as the ‘ground truth’ really is both versions!

Looking at my local areas, Wansbeck had a couple of additions which are already surveyed so will update to a 100% match in a few days. Blyth Valley survey locations will be an easy cycle tomorrow to Seaton Delaval, leaving Castle Morpeth and North Tyneside to catch up over the next few weeks.

… See full entry

Over the past few years, I’ve been a regular user of ITO World’s very useful map analysis and comparison tools. One tool (not unique, but well done) compares OS Street View data with OSM highway names and produces both a completeness report, and also a set of map tiles which show differences.

This diff layer is very useful in JOSM to spot errors in both map databases, be it simple typos or show areas for physical survey. In my area North of Newcastle, this has typically shown up schools being closed and turned into small development plots for housing which I’ve worked into my cycle training runs to make a physical survey.

As I know my local patch well, these areas are often already tracked as landuse=brownfield, of highway=construction so it’s just a case of adding in the street names once the developer has bothered to actually put the name plates up!

One such diff intrigued me - close to where my old University digs used to be (Ethel Williams Halls were demolished years ago!), a very small stub off a residential close started changing name.

Penfold Close became Whitby Crescent which ITO dutifully reported on. I though this to be a plausible omission, so added the name change and gave the credit to OS using the source:name=OS_OpenData_Locator tag. As this is about 12 miles away, and the road section in question about 20m long, I didn’t undertake a physical survey - slapped wrists all round!

Recently, it changed again to Whitbay Crescent, which seemed strange - had a mapper in OS Towers lost a key from their keyboard? Well, as this seemed so strange and my Winter fitness improving, I cycled out from Cramlington to find out.

Off a small residential road, a t-shaped stub is surrounded by 5 blocks of semi-detached homes. Only one has a name plate showing Penfold Close, but the door numbers show odd and even consistently showing they are in the same street.

… See full entry

After going out and about on two wheels around Blyth, I noticed that the Coast and Castles long distance cycle route, NCN1 has moved. It no longer threads North West through the South Beach estate and across the River Blyth with the A189, and follows the coast.

… See full entry

For several years, I have been cycling past a series of open cast coal mines to the West of my home town of Cramlington. The Banks Shotton Surface Mine has created a few jobs, and now is getting national intrest as the spoil heap has been imaginatively been formed into a visitor attraction in the shape of a female figure: http://www.banksgroup.co.uk/northumberlandia-site/

Northumberlandia, (or the “Turf Tart” to her friends :-) ), is close to opening to the public next week after the Princess Royal cuts the ribbon in Monday. http://www.journallive.co.uk/north-east-news/todays-news/2012/08/30/princess-royal-to-open-northumberlandia-sculpture-on-monday-61634-31727458/

The extent of the 400m landform and the nearby live mine site has been mapped from Bing imagery for some time, however the detail of the many paths, view points, and hard landscaping forming the face itself needs boots and GPS on the ground to capture in its full glory.

Anyone fancy a mapping party in Cramlington? :-)

TTFN,

James PS A few features have been added by eye as a taster of the curves to come.

The donation of good quality aerial imagery by [[Bing]] can make a real difference to the detail it is possible to map in OSM.

After mapping roads and main points of interest using various physical GPS methods, I thought the map of [[Cramlington]] Northburn looked pretty good. All the roads were well geo-located, and some building outlines were mapped where their location could be inferred from GPS tracks.

Image:osm.wiki/File:Cramlington_northburn.gif

As you can see, good imagery opens up the possibility of including mapping right down to individual houses. Details mapped via GPS stay put, however previously inaccessible features such as complex building outlines make a dramatic appearance! After a bit of work gathering house numbers, searching for a house number and street in the nominatim gazeteer search now goes straight to the individual building.

With enough effort, it is quite possible to achieve a level of detail better than Ordnance Survey 1:10k Street View using [[Bing]] tracing. The hard part is putting in enough effort - tracing and tagging at this level takes a lot of time to get spot on.

Two estates done, another thousand to complete... :-)

Judgling from a very muddy survey expedition today, Sustrans have a lot of work on to link [[Cramlington]] to Bedlington via the old Humford Mill stepping stones over the River Blyth.

The project publicity concentrates on the exciting river crossing, but the section to the South leading to East Hartford will be the real challenge.

The first section starts out in a plantation NE of Hartford. Dropping down a flight of wooden steps, the path lowers down to the flood level of a small river and turns into a muddy swamp.

Heavy rains must swell the 1m wide stream considerably as man-made rubbish hangs in scrubby trees. A small metal bridge crosses the water and the adventure proper starts. The path hugs the side of a V-shaped dean cut by water and the sound of the flow is never far away.

The Council improved the path many years ago with wooden posts forming steps up the steep valley side and small foot bridges crossing drainage pipes. Nature has worked unseen on these foreign structures and most are rotten.

Several large trees now lie across the wet path adding to the obstacle course of briars and muddy scrub. In one spot, a topped trees have formed a considerable dam and forced the water to eat away at the bank path.

Once through the dean, the much larger River Blyth takes control of the terrain and things level out. 18 stepping stones take you across to Humford Mill and on to the first bit of tarmac. This is an ideal cycling spot, with a car park and a quiet road leading up hill to St Cuthberts Church in Bedlington main street.

A information board proclaims this area as Bedlington Country Park, and if Sustrans can get through the mud, fallen trees and scrub, this will be a great cycle route. It avoids both Plessey and Bedlington bridges which have steep hills with narrow bridges that cars have trouble staying on, making cycling rather dangerous.
http://www.sustransconnect2.org.uk/schemes/project_detail.php?id=137

To celebrate mapping Cramlington by bicycle, I decided to treat myself to a new steed. After Wiggle delivered a large box containing a new Focus Red Falls, I have been itching to get out and about on the newly mapped Cramlington Cycleway Network.

Tonight, I decided to ignore the 7C air temperature and winter night to do something different. Starting at Cramlington, I followed National Cycle Route 1 down past Horton Grange, and through new housing developments to Blyth Adsa. What is normally a horrible place to visit by car (bad traffic!), is well appointed with excellent cycleways.

Coming back though Bebside, I decided against the easy route and turned off past an old civic amenity site to follow an old road pre-dating the modern A189 trunk route.

Pedalling along on tarmac being slowly reclaimed by nature, my head torch was the only shaft of light piercing the winter night. Slowing only where a flash of hedge showed a sharp bend, the cold night was quickly forgotten as the exhilaration of exploring the unknown took hold.

The orange sodium skyglow of Cramlington confirmed the Garmin GPS was pointing true, as eerie pinpricks of light appeared. Ah- horses have white eyes!

The glow from The Three Horse Shoes pub looked inviting, but I left the empty picnic tables and headed for home.

Hathery Lane is now mapped. Unused by vehicles for many years, but a great short cut for cycles.

As a break from mapping my home town of Cramlington, I uploaded a short trace made aboard my canal boat cruising the Grand Union Canal.

Navigating a 57" (17m) boat along a narrow waterway is actually not that difficult as the typical speed is a mere 4mph (6km/h) and after 150 years of development, most hazards have been resolved. Although the UK canal network extends throughout country, a typical day's cruising may only encounter a junction every few days.

So, if navigational hazard avoidance and routing are easy peasy, what role is there for digital mapping and GPS?

Well, canals were planned in the 18th Century when roads were terrible and many towns did not exist. What may have been a busy coal mine wharf has been forgotten and is now the middle of nowhere. The feeling of traveling along a secret route is one of the main charms of canals, except when you run out of toothpaste need to find a shop on foot!

Mass market GPS navigation devices have useful Points of Interest, but usually omit waterways and public footpaths to concentrate solely on roads. Other digital maps may include canals, but exclude details such as bridges and locks which are used as reference points.

The ability to add domain specific features to the OSM map and then render the result for your needs is a killer feature, and one that got me started mapping cycle routes in Cramlington.

My short trace around Blisworth Tunnel on the Grand Union Canal was limited to half an hour by the the rainy weather rather than the capacity of my Nokia N800, but logging once a second at 4mph gives impressively dense data points.

The current canal data is missing several sections from Norton Junction to Wedon Bec, but it's good to see that one of the best pubs I visited is mapped. The Narrow Boat on the A5 (Watling Street) is included, along with amenities such as pharmacies in nearby towns.

… See full entry