[IAEP] [XSCE] RE: [UKids] Re: [support-gang] Taking OpenStreetMap Offline - DESIGN Call - Thur June 11, 10AM EDT / 2PM UTC

[Anish Mangal]

I didn't quite understand the question but will try and answer.

In the call, it was discussed to generate the metatiles for a small
country, using the same old process. That I did, and am reporting the
results - expectedly it got generated pretty fast (Nepal's pbf is 105 MB
compared to 27 GB for the planet).

I had gotten stuck while doing this for the planet. The planet.pbf file
took 1.5 weeks to go into the postgres, but it did import into the db
successfully. However, tile generation was VERY slow (much slower than last
time), possibly because the nodecache is stored on normal hdd disk
separately (the SSD ran out of space).

So, I guess what I am looking for is a more optimized approach, or someone
to help tune the system up. I have been exploring mbtiles (from mapbox) but
haven't gotten around to any experiments just yet.

One thing that would be really great if there was a service which would
generate and host mbtiles or metatiles. One can download png tiles, but not
these two formats.

On Sun, Jun 14, 2015 at 7:54 AM, Jérôme Gagnon-Voyer <gagnonje at gmail.com>
wrote:

> Hi Anish
>
> Could you clarify what is different in that way of doing things, compared
> to the old way (which would essentially take weeks to generate?). I know
> it's just a small country, compared to the planet, but what else is
> significantly different?
>
> On Sat, Jun 13, 2015 at 10:06 PM, Anish Mangal <anishmg at umich.edu> wrote:
>
>> Hi,
>>
>> Following from the skype call this week, I uploaded Nepal's OSM data in
>> postgres and render tiles to see performance, and as expected, everything
>> is blazing fast.
>>
>> The pbf file went into the postgress in less than 5 minutes, and tiles
>> are being rendered pretty fast as well.
>>
>> You can check it yourself by going to
>> http://home.braddock.com:28112/osm/slippymap.html
>>
>> * Select Mapnik
>> * Zoom out and center over Nepal
>> * Select Local tiles
>> * Zoom in
>>
>> I don't know what this "proves" as the bottleneck still is doing this for
>> the entire planet, which we need to figure out a way for anyway.
>>
>> Best,
>> Anish
>>
>>
>>
>> On Sun, Jun 14, 2015 at 6:02 AM, Anish Mangal <anishmg at umich.edu> wrote:
>>
>>> Hi Jérôme,
>>>
>>> I incorporated one of your comments; as for the other I think Timm, Nick
>>> would be better suited for the discussion (python backend v/s frontend js).
>>> :-)
>>>
>>> Best,
>>> Anish
>>>
>>> On Sun, Jun 14, 2015 at 3:22 AM, Jérôme Gagnon-Voyer <gagnonje at gmail.com
>>> > wrote:
>>>
>>>> Hi Anish
>>>>
>>>> Great document. I've added 2 comments to the document, feel free to
>>>> incorporate into the document if that makes sense.
>>>>
>>>> Also added a TODO for myself to do more research about the various
>>>> search solutions.
>>>> I've used Nominatim in the past (on the client side, not the server
>>>> infrastructure) and it was overall very good, but I'll want to know more
>>>> about the other ones.
>>>>
>>>> On Sat, Jun 13, 2015 at 12:51 PM, Tim Moody <tim at timmoody.com> wrote:
>>>>
>>>>> Thanks, Anish for an excellent start at getting this down on paper (so
>>>>> to speak).  I think this covers things pretty well and gives us the
>>>>> necessary hooks on which to hang the details as we begin fleshing out
>>>>> solutions to the requirements you documented.
>>>>>
>>>>>
>>>>>
>>>>> Under issues I added one point about rendering non-Roman character
>>>>> sets.
>>>>>
>>>>>
>>>>>
>>>>> *From:* unleashkids at googlegroups.com [mailto:
>>>>> unleashkids at googlegroups.com] *On Behalf Of *Anish Mangal
>>>>> *Sent:* Saturday, June 13, 2015 12:15 PM
>>>>> *To:* Community Support Volunteers -- who help respond to help AT
>>>>> laptop.org
>>>>> *Cc:* Unleash Kids!; server-devel; xsce-devel; iaep; Internet In a
>>>>> Box Working Group; Jaakko Helleranta
>>>>> *Subject:* [UKids] Re: [support-gang] Taking OpenStreetMap Offline -
>>>>> DESIGN Call - Thur June 11, 10AM EDT / 2PM UTC
>>>>>
>>>>>
>>>>>
>>>>> Okay, so I tried to encapsulate whatever we discussed into a design
>>>>> document, which can hopefully serve as a base for reaching out to the OSM
>>>>> community and to better organize our own thoughts.
>>>>>
>>>>>
>>>>> https://docs.google.com/document/d/1LWsN-cPH3lvMuXS-f0Tk8IWVh-3X808WoIt0OJ-QNt8/edit#
>>>>> <https://docs.google.com/document/d/1LWsN-cPH3lvMuXS-f0Tk8IWVh-3X808WoIt0OJ-QNt8/edit>
>>>>>
>>>>> Please feel free to edit the information there as I may have missed
>>>>> some points, or interpreted them differently than as intended.
>>>>>
>>>>> Best,
>>>>>
>>>>> Anish
>>>>>
>>>>>
>>>>>
>>>>> On Fri, Jun 5, 2015 at 12:00 AM, Adam Holt <holt at laptop.org> wrote:
>>>>>
>>>>> Who's attending http://stateofthemap.us at the UN in NYC this weekend?
>>>>>
>>>>> Who's most serious about bringing OpenStreetMap's opportunities and
>>>>> rapid progress into the hands of the world's offline poor -- kids and all,
>>>>> American and Swahili?  Wanna Take This Map Outside, offline and off the
>>>>> grid, where we all belong/began?
>>>>>
>>>>> http://Internet-in-a-Box.org and similar efforts have made a gigantic
>>>>> 1st step: in Ghana and Rwanda I could never have imagined better reviews to
>>>>> our 2015 deployments begun there in recent months.  Many are now changing
>>>>> the game increasingly for the Bottom BillionS, among many who've literally
>>>>> never seen a globe before, nevermind a map of their own towns.  Both in
>>>>> OLPC (school) contexts, in libraries, on Nepali hillsides where folks don't
>>>>> have proper homes, and far beyond --- perspectives (literally) are about to
>>>>> change.
>>>>>
>>>>> But modern phones today contain more than enough gigabytes to display
>>>>> ALL OpenStreetMap map detail within most countries, and yet they do not
>>>>> yet, WHY?  Where are the Khan Academies and KA Lites of OSM (OpenStreetMap)
>>>>> bringing new classroom/journalistic rubrics, freeing everyone's "brain
>>>>> software" to explore and document our own communities in our own languages?
>>>>>
>>>>> *Who Will Take The Next Steps?*
>>>>> *What engineering middleware, distribution vectors, community/economic
>>>>> models, and final field packagings will get us all there & beyond?*
>>>>>
>>>>> *Will offline edit-contributions prove impossible, much like with
>>>>> Wikipedia in Peru, when offline kids edit overly stale
>>>>> OpenStreetMap/Wikipedia images a year before/later?*
>>>>>
>>>>>
>>>>>
>>>>> As such the wider OLPC community is hosting a DESIGN Call to bring
>>>>> forward ideas across the OpenStreetMap landscape, fertilizing our immediate
>>>>> work with school server projects like http://schoolserver.org,
>>>>> http://xsce.org, https://en.opensuse.org/openSUSE:Education-Li-f-e
>>>>> ETC.  Ministries of Education in India elsewhere are watching closely,
>>>>> expressly eager to help if we can point the way.  All giving our "2020
>>>>> Vision" questions very practical and immediate "customers" well before
>>>>> 2020, much like Garmin GPS units fed a wonderful ecosystem of geo-specific
>>>>> "gmapsupp.img" offline map files over the past decade:
>>>>> http://wiki.openstreetmap.org/wiki/OSM_Map_On_Garmin/Download
>>>>>
>>>>> That decade's now done: what IS our framework for the coming decade?
>>>>> Please join us if you have strategic/partnership ideas towards making
>>>>> Offline OSM Designs happen, *Thank You !!*
>>>>>
>>>>>
>>>>>
>>>>> 10AM New York Time / 2PM UTC
>>>>>
>>>>> Thursday, June 11th
>>>>>
>>>>> RSVP with your Skype username, if we are more than 15-20 we'll use an
>>>>> industrial conference call system instead!
>>>>>
>>>>>
>>>>> CONCLUSION: Could OpenStreetMap be the very ultimate in
>>>>> Constructionist Learning Projects, replacing OLPC in coming years, on a
>>>>> quickly shrinking/endangered but still green-in-parts planet?  Regardless,
>>>>> how to build the OLPC Movement's offline/civic learning successes,
>>>>> consciously learning from its community infrastructural mistakes?  Nick
>>>>> Doiron (http://mapmeld.com) and Anish Mangal (
>>>>> https://in.linkedin.com/in/anishmangal) who've spent years thinking
>>>>> about this topic will lead the discussion, agenda is entirely yours!
>>>>> OPTIONAL: submit agenda items in advance right here:
>>>>>
>>>>>
>>>>> https://docs.google.com/document/d/1o6QtzLb6e58YKWqMf_junux2XyBRLFm31un8YLcYslg
>>>>>
>>>>>
>>>>>
>>>>> *< forward invitation to Twitter/wherever as appropriate >*
>>>>>
>>>>>
>>>>> --
>>>>>
>>>>> Unsung Heroes of OLPC, interviewed live @ http://unleashkids.org !
>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> support-gang mailing list
>>>>> support-gang at lists.laptop.org
>>>>> http://lists.laptop.org/listinfo/support-gang
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Unsung Heroes of OLPC, interviewed live @ http://unleashkids.org !
>>>>> ---
>>>>> You received this message because you are subscribed to the Google
>>>>> Groups "Unleash Kids" group.
>>>>> To unsubscribe from this group and stop receiving emails from it, send
>>>>> an email to unleashkids+unsubscribe at googlegroups.com.
>>>>> For more options, visit https://groups.google.com/d/optout.
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Jérôme Gagnon-Voyer
>>>>
>>>
>>>
>>>
>>> --
>>>
>>>
>>
>>
>>
>
>
> --
> Jérôme Gagnon-Voyer
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.sugarlabs.org/archive/iaep/attachments/20150614/30df54f9/attachment-0001.html>