Average number of tags per way in OpenStreetMap
Posted by baditaflorin on 23 September 2015 in English.That is, the average number of tags that each highway type have, per continents.
That is, the average number of tags that each highway type have, per continents.
There are 12 ways that have over 200 tags attached to them in asia
you can see them in overpass-turbo using this link http://overpass-turbo.eu/s/bAD
Thanks sandert17 for the suggestion to use overpass-turbo links
Ever wandered how many POI over 100 tags ? Now you can know.
There are 33 nodes that have over 100 tags, mostly if not all being lighthouse
https://gist.github.com/baditaflorin/8a30a5f45c94f4d2bf8d
I am not able to save the list with the tags also, at least not in OpenJump ( SHP will truncate at 255, other extension does not work ) , QGIS ( Error after the forth value ) ( filled bug request ) Pgadmin (don`t know how to save directly so that i could open it
[Update] A list with all the nodes tags that have over 50 tags
https://gist.github.com/baditaflorin/53db974195c2d1e95745
My hypothesis is that we could reduce the planet file with 10-100 MB by only removing the unnecessary points that exist on the map.
I am trying to figure it out the correct postgis query to find out exactly this.
I am trying to compare the points of a linesting, and if the degrees between 3 adjacent points is 0 degrees, that means that the point in the middle can be deleted.
The only check in place that i see is to check that the point in the middle is not connected to a point and check that the hstore tag of that node is empty, meaning that there is no value added to the node ( pedestrian crossing, motorway_jucntion, exit_to, etc )
This is just a dump of some ideas and stats that you should not take for granted, the data its most of the time inaccurate , because i run 2 commands at the same time.
But anyhow, its a point of conversation First, i had filtered with osmconvert and osmfilter so i remained with a planet dump, composed of only the tag highway I am trying to import all the roads in the world, after i tried with a direct attempt and did not scale up, i had now spitted the world into each continent
Size = only the highway , saved as a osm.pbf
africa_highway ( 356 MB ) = 46 Minute to import into postgis Asia_highway ( 1318 MB ) = 213 Minute to import into postgis Australia_highway ( 259 MB ) = 14 Minute to import into postgis Central America ( 63 MB ) = 10 Minute to import into postgis
I am now in day 6 of waiting
There is a 16 GB RAM server, octacore environment, running ubuntu 14.10 ( don`t ask why )
I have a 317 GB file generated called copy********n
And there is a file called copy******w that is still being generated, growing by 10-20 GB per day , now is at 76 GB
And a file called copy*******wn at 30 GB
i am guessing that the n means nodes and w means ways, but how much should it grow, procentualy compared with the 317 GB n file ?
The command that i had used to give the command looks like this
sudo osmosis –rbf latest-planet.osm.pbf –wp host=localhost database=mydatabase user=*** password=****
Have you ever asked yourself what are the TOP 25 cities in the world, based on the number of POI in OpenStreetMap ?
To my surprise, the number 1 city is not a European one, but a city in Japan, that have 121.154 POI
I have calculated all the poi from the following category’s : amenity, leisure, shop, sport, tourism, man_made, office
I did not include the historic POI, because when i filtered the world planet, i had extracted the history tag, instead of historic
I had converter the ways into polygons, and then combined the 2 data-sets into one.
Then i had counted, based on the bbox of the city, the number of POI in each of the cities. I will give here the TOP 25 cities by the number of POI
Waiting for your opinions, comments, etc
Yokohama 121154 Paris 113165 Tokio 97078 Kawasaki 90576 Rio Grande 85238 London 84681 Saitama 75783 Berlin 74002 Birmingham 65093 Moskau 61579 München 54533 Essen 53935 Dusseldorf 52342 Stuttgart 50712 Madrid 48335 Vienna 47396 Toronto 47324 Köln 45018 Dortmund 44534 Lyon 44441 Hamburg 44334 Sete 41723 Milan 41317 Osaka 40756 Frankfurt 38128
Short Legend : Bigger green means bigger version, bigger red ways means that the way contains more tags inside. The same with the points
In Romania, we are planning to add the relations for all the national Roads
I made this youtube video-clip to show how easy is to add a relation
Playing with Mapbox Studio and the ability to use the osm_id of a POI, i managed to make a historic map of the POI of 24 selected cities around the world
In a totally random way i will show some of the different type of cities that we have in OSM, in the terms of relevance to people that are interested in going in that city and using osm for POI
The map was created by exporting using Qgis Print Composer in 4 different 24806x17716px , because of the limitations of QGIS that does not allow the export of bigger files yet.
The date was obtained using overpass-api, but for simplicity, if you want to do something similar, use the europe planet extract.
There where over 7 million shop,amenity, tourism and leisure POI in Europe that where combined in a single file using the Qgis Plugin > Vector > Data Management Tools > Merge ShapeFiles to one
Using Qgis plugin mmqgis i created a network of around 800.000 hexagons, and using the Qgis plugin “count in polygon” i was able to figure it how many POI are in each hexagon. To get to a more correct answer, i calculated the area for each of the 800.000 hexagons, that is ranging from about 18 square kilometers in south of Sweden to 28 sq km in Madrid, Spain and did a POI/area to get a more exact answer, POI per sq km
i was using this into the overpass api
[timeout:86400]; (way(34.759984,-12.216797,71.587596,36.298828)[shop];); out meta;
instead of
[timeout:86400]; (way(34.759984,-12.216797,71.587596,36.298828)[shop];); /added by auto repair/ (._;>;); /end of auto repair/ out meta;
I made some visualizations of the nodes density of roads in OpenStreetMap
For Romania, there where 379.445 ways that generated over 4.7 milions points that where counted in a grid of over 31000 polygons , with area between 7.43 square kilometers to 8.08 square kilometers
I would really love to just import and play with the data in the planet extract, or the data for Romania, and try to do some statistics, but it`s to impossible just to install and make the software work.
I i know a thing or 2 about linux, but it still to complicated.
I really believe we should try and have a more integrated way of exploring the data, with GUI Tools, not complicated as is now.
For the sake of simplicity, this for now can be accomplished by ready to go, VirtualBox or VMware image disk, where i should only put the extract that i get from geofabrik
https://github.com/MaZderMind/osm-history-renderer/blob/master/TUTORIAL.md
I was today on the field, to map this area http://mapcraft.nanodesu.ru/pie/407
The focus was on house-numbers. In total i added over 300 housenumbers, 18 pedestrian crossing, and 2 POI`s
Time spend :
2 Hours on the field, and 1 hour adding the data into JOSM
One of the roads was a oneway, that was not added on the map.
The final result can be seen here osm.org/#map=18/44.44068/26.14206
The mapping party will take place on the 17 and 18th of may
In total we imported over 5000 buildings, 3000 postal adresses and 2500 properties
Full list of pictures with slider
194,859 kilometers of road in total
73,207 kilometers added in 2013 12,986 bridge`s
16,331 different street names
231,991 - number of buildings,
47 % of them added in 2013
27,237 buildings with names
44,608 buildings with type of building defined
If somebody is from Romania, i just want to let them know that i did a facebook page for OSM https://www.facebook.com/OsmRomania
And because i don`t know what to post when the local autorities are not so great at allowing us to import data into OSM (except Targu Frumos i started making stats about the evolution of OSM in Romania from 2008 until now.
POI evolution per year Link
openstreetmap.org is and will remain a demonstration map, not a real website, an end user mapping tool, so this is why 90 % more people use and will comtinue to use google maps
And i want to change that.
So let`s build an openstreetmap.org on steroids.
What this website has to contain :
Clickable POI`s Simple and Straightforward . You see a place, you click on it, you find information about it. And you have the possibility to send a link to the place, etc.
Link to search results. This simple yet non-existing feature. I want to give a link to somebody to 120 Avenue Street . Or to the Museum. I don`t want to give him a permanent link that shows the map, i want to give him the exact location that we will find, without telling him, go to osm.org and search for 120 Avenue Street and you will find it. https://trac.openstreetmap.org/ticket/4408
Render all the shops. rigth now on mapnik more than half the POIs are not rendered, including dentist shops, amenity=veterinary ,shop=electronics , shop=kiosk
Those 4 tags alone represent 35000 new POI
s that could be shown on the map
https://trac.openstreetmap.org/ticket/4403
Opening_hours filter. Opening_hours is a great tool, very usefull when you are in a new town, city, etc. Imagine yourself at 3 AM, wanting to find a non-stop shop to buy cigarettes. Or a beer, juice, etc.
The same example is useful for a tourist, in a foreign country, on a Sunday, and wants to see a museum. But at least in my country, more then half the museums are closed on sunday. And Some of them are open only 3 days a week. And only for 6 hours.
Sub task proposition : Alert me when a place opens. Mail alert when amenity X is Open.