<div dir="ltr"><div><div><div><div>I didn't quite understand the question but will try and answer.<br><br></div>In the call, it was discussed to generate the metatiles for a small country, using the same old process. That I did, and am reporting the results - expectedly it got generated pretty fast (Nepal's pbf is 105 MB compared to 27 GB for the planet). <br><br></div>I had gotten stuck while doing this for the planet. The planet.pbf file took 1.5 weeks to go into the postgres, but it did import into the db successfully. However, tile generation was VERY slow (much slower than last time), possibly because the nodecache is stored on normal hdd disk separately (the SSD ran out of space). <br><br></div>So, I guess what I am looking for is a more optimized approach, or someone to help tune the system up. I have been exploring mbtiles (from mapbox) but haven't gotten around to any experiments just yet. <br><br></div>One thing that would be really great if there was a service which would generate and host mbtiles or metatiles. One can download png tiles, but not these two formats. <br><div><div><div><div><div><div class="gmail_extra"><br><div class="gmail_quote">On Sun, Jun 14, 2015 at 7:54 AM, Jérôme Gagnon-Voyer <span dir="ltr"><<a href="mailto:gagnonje@gmail.com" target="_blank">gagnonje@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi Anish<div><br></div><div>Could you clarify what is different in that way of doing things, compared to the old way (which would essentially take weeks to generate?). I know it's just a small country, compared to the planet, but what else is significantly different?</div></div><div class="gmail_extra"><div><div class="h5"><br><div class="gmail_quote">On Sat, Jun 13, 2015 at 10:06 PM, Anish Mangal <span dir="ltr"><<a href="mailto:anishmg@umich.edu" target="_blank">anishmg@umich.edu</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><div>Hi,<br><br></div>Following from the skype call this week, I uploaded Nepal's OSM data in postgres and render tiles to see performance, and as expected, everything is blazing fast. <br><br></div><div>The pbf file went into the postgress in less than 5 minutes, and tiles are being rendered pretty fast as well.<br><br></div><div>You can check it yourself by going to <br><a href="http://home.braddock.com:28112/osm/slippymap.html" target="_blank">http://home.braddock.com:28112/osm/slippymap.html</a><br><br></div><div>* Select Mapnik<br></div><div>* Zoom out and center over Nepal<br></div><div>* Select Local tiles<br></div><div>* Zoom in<br><br></div><div>I don't know what this "proves" as the bottleneck still is doing this for the entire planet, which we need to figure out a way for anyway.<br><br></div><div>Best,<br></div><div>Anish<br><br></div><div><div><div><br></div><div class="gmail_extra"><br><div class="gmail_quote">On Sun, Jun 14, 2015 at 6:02 AM, Anish Mangal <span dir="ltr"><<a href="mailto:anishmg@umich.edu" target="_blank">anishmg@umich.edu</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><div><div>Hi Jérôme,<br><br></div>I incorporated one of your comments; as for the other I think Timm, Nick would be better suited for the discussion (python backend v/s frontend js). :-)<br><br></div>Best,<br></div>Anish<br><div class="gmail_extra"><div><div><br><div class="gmail_quote">On Sun, Jun 14, 2015 at 3:22 AM, Jérôme Gagnon-Voyer <span dir="ltr"><<a href="mailto:gagnonje@gmail.com" target="_blank">gagnonje@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi Anish<div><br></div><div>Great document. I've added 2 comments to the document, feel free to incorporate into the document if that makes sense.</div><div><br></div><div>Also added a TODO for myself to do more research about the various search solutions. </div><div>I've used Nominatim in the past (on the client side, not the server infrastructure) and it was overall very good, but I'll want to know more about the other ones.</div><div class="gmail_extra"><div><div><br><div class="gmail_quote">On Sat, Jun 13, 2015 at 12:51 PM, Tim Moody <span dir="ltr"><<a href="mailto:tim@timmoody.com" target="_blank">tim@timmoody.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div link="blue" vlink="purple" lang="EN-US"><div><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d">Thanks, Anish for an excellent start at getting this down on paper (so to speak). I think this covers things pretty well and gives us the necessary hooks on which to hang the details as we begin fleshing out solutions to the requirements you documented.<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d">Under issues I added one point about rendering non-Roman character sets.<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d"><u></u> <u></u></span></p><p class="MsoNormal" style="margin-left:.5in"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> <a href="mailto:unleashkids@googlegroups.com" target="_blank">unleashkids@googlegroups.com</a> [mailto:<a href="mailto:unleashkids@googlegroups.com" target="_blank">unleashkids@googlegroups.com</a>] <b>On Behalf Of </b>Anish Mangal<br><b>Sent:</b> Saturday, June 13, 2015 12:15 PM<br><b>To:</b> Community Support Volunteers -- who help respond to help AT <a href="http://laptop.org" target="_blank">laptop.org</a><br><b>Cc:</b> Unleash Kids!; server-devel; xsce-devel; iaep; Internet In a Box Working Group; Jaakko Helleranta<br><b>Subject:</b> [UKids] Re: [support-gang] Taking OpenStreetMap Offline - DESIGN Call - Thur June 11, 10AM EDT / 2PM UTC<u></u><u></u></span></p><div><div><p class="MsoNormal" style="margin-left:.5in"><u></u> <u></u></p><div><div><div><div><p class="MsoNormal" style="margin-right:0in;margin-bottom:12.0pt;margin-left:.5in">Okay, so I tried to encapsulate whatever we discussed into a design document, which can hopefully serve as a base for reaching out to the OSM community and to better organize our own thoughts. <br><br><a href="https://docs.google.com/document/d/1LWsN-cPH3lvMuXS-f0Tk8IWVh-3X808WoIt0OJ-QNt8/edit" target="_blank">https://docs.google.com/document/d/1LWsN-cPH3lvMuXS-f0Tk8IWVh-3X808WoIt0OJ-QNt8/edit#</a><u></u><u></u></p></div><p class="MsoNormal" style="margin-right:0in;margin-bottom:12.0pt;margin-left:.5in">Please feel free to edit the information there as I may have missed some points, or interpreted them differently than as intended. <u></u><u></u></p></div><p class="MsoNormal" style="margin-left:.5in">Best,<u></u><u></u></p></div><p class="MsoNormal" style="margin-right:0in;margin-bottom:12.0pt;margin-left:.5in">Anish<u></u><u></u></p><div><p class="MsoNormal" style="margin-left:.5in"><u></u> <u></u></p><div><p class="MsoNormal" style="margin-left:.5in">On Fri, Jun 5, 2015 at 12:00 AM, Adam Holt <<a href="mailto:holt@laptop.org" target="_blank">holt@laptop.org</a>> wrote:<u></u><u></u></p><blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in"><div><div><p class="MsoNormal" style="margin-left:.5in">Who's attending <a href="http://stateofthemap.us" target="_blank">http://stateofthemap.us</a> at the UN in NYC this weekend?<br><br>Who's most serious about bringing OpenStreetMap's opportunities and rapid progress into the hands of the world's offline poor -- kids and all, American and Swahili? Wanna Take This Map Outside, offline and off the grid, where we all belong/began?<br><br><a href="http://Internet-in-a-Box.org" target="_blank">http://Internet-in-a-Box.org</a> and similar efforts have made a gigantic 1st step: in Ghana and Rwanda I could never have imagined better reviews to our 2015 deployments begun there in recent months. Many are now changing the game increasingly for the Bottom BillionS, among many who've literally never seen a globe before, nevermind a map of their own towns. Both in OLPC (school) contexts, in libraries, on Nepali hillsides where folks don't have proper homes, and far beyond --- perspectives (literally) are about to change.<br><br>But modern phones today contain more than enough gigabytes to display ALL OpenStreetMap map detail within most countries, and yet they do not yet, WHY? Where are the Khan Academies and KA Lites of OSM (OpenStreetMap) bringing new classroom/journalistic rubrics, freeing everyone's "brain software" to explore and document our own communities in our own languages?<br><br><i>Who Will Take The Next Steps?</i><br><i>What engineering middleware, distribution vectors, community/economic models, and final field packagings will get us all there & beyond?</i><u></u><u></u></p></div><p class="MsoNormal" style="margin-left:.5in"><i>Will offline edit-contributions prove impossible, much like with Wikipedia in Peru, when offline kids edit overly stale OpenStreetMap/Wikipedia images a year before/later?</i><br clear="all"><u></u><u></u></p><div><div><div><p class="MsoNormal" style="margin-left:.5in"><u></u> <u></u></p></div><div><p class="MsoNormal" style="margin-left:.5in">As such the wider OLPC community is hosting a DESIGN Call to bring forward ideas across the OpenStreetMap landscape, fertilizing our immediate work with school server projects like <a href="http://schoolserver.org" target="_blank">http://schoolserver.org</a>, <a href="http://xsce.org" target="_blank">http://xsce.org</a>, <a href="https://en.opensuse.org/openSUSE:Education-Li-f-e" target="_blank">https://en.opensuse.org/openSUSE:Education-Li-f-e</a> ETC. Ministries of Education in India elsewhere are watching closely, expressly eager to help if we can point the way. All giving our "2020 Vision" questions very practical and immediate "customers" well before 2020, much like Garmin GPS units fed a wonderful ecosystem of geo-specific "gmapsupp.img" offline map files over the past decade: <a href="http://wiki.openstreetmap.org/wiki/OSM_Map_On_Garmin/Download" target="_blank">http://wiki.openstreetmap.org/wiki/OSM_Map_On_Garmin/Download</a><br><br>That decade's now done: what IS our framework for the coming decade? Please join us if you have strategic/partnership ideas towards making Offline OSM Designs happen, <i>Thank You !!</i><u></u><u></u></p></div><div><p class="MsoNormal" style="margin-left:.5in"><u></u> <u></u></p></div><div style="margin-left:30.0pt"><p class="MsoNormal" style="margin-left:.5in">10AM New York Time / 2PM UTC<u></u><u></u></p></div><div style="margin-left:30.0pt"><p class="MsoNormal" style="margin-left:.5in">Thursday, June 11th<u></u><u></u></p></div><div style="margin-left:30.0pt"><p class="MsoNormal" style="margin-left:.5in">RSVP with your Skype username, if we are more than 15-20 we'll use an industrial conference call system instead!<u></u><u></u></p></div><div><p class="MsoNormal" style="margin-right:0in;margin-bottom:12.0pt;margin-left:.5in"><br>CONCLUSION: Could OpenStreetMap be the very ultimate in Constructionist Learning Projects, replacing OLPC in coming years, on a quickly shrinking/endangered but still green-in-parts planet? Regardless, how to build the OLPC Movement's offline/civic learning successes, consciously learning from its community infrastructural mistakes? Nick Doiron (<a href="http://mapmeld.com" target="_blank">http://mapmeld.com</a>) and Anish Mangal (<a href="https://in.linkedin.com/in/anishmangal" target="_blank">https://in.linkedin.com/in/anishmangal</a>) who've spent years thinking about this topic will lead the discussion, agenda is entirely yours! OPTIONAL: submit agenda items in advance right here:<u></u><u></u></p><div style="margin-left:30.0pt"><p class="MsoNormal" style="margin-left:.5in"><a href="https://docs.google.com/document/d/1o6QtzLb6e58YKWqMf_junux2XyBRLFm31un8YLcYslg" target="_blank">https://docs.google.com/document/d/1o6QtzLb6e58YKWqMf_junux2XyBRLFm31un8YLcYslg</a><u></u><u></u></p></div><p class="MsoNormal" style="margin-left:.5in"><u></u> <u></u></p></div><p class="MsoNormal" style="margin-left:.5in"><i>< forward invitation to Twitter/wherever as appropriate ></i><br clear="all"><u></u><u></u></p><div><p class="MsoNormal" style="margin-left:.5in"><br>--<u></u><u></u></p><div><div><p class="MsoNormal" style="margin-left:.5in">Unsung Heroes of OLPC, interviewed live @ <a href="http://unleashkids.org" target="_blank">http://unleashkids.org</a> !<u></u><u></u></p></div></div></div></div></div></div><p class="MsoNormal" style="margin-right:0in;margin-bottom:12.0pt;margin-left:.5in"><br>_______________________________________________<br>support-gang mailing list<br><a href="mailto:support-gang@lists.laptop.org" target="_blank">support-gang@lists.laptop.org</a><br><a href="http://lists.laptop.org/listinfo/support-gang" target="_blank">http://lists.laptop.org/listinfo/support-gang</a><u></u><u></u></p></blockquote></div><p class="MsoNormal" style="margin-left:.5in"><br><br clear="all"><u></u><u></u></p></div></div><p class="MsoNormal" style="margin-left:.5in">-- <br>Unsung Heroes of OLPC, interviewed live @ <a href="http://unleashkids.org" target="_blank">http://unleashkids.org</a> !<br>--- <br>You received this message because you are subscribed to the Google Groups "Unleash Kids" group.<br>To unsubscribe from this group and stop receiving emails from it, send an email to <a href="mailto:unleashkids+unsubscribe@googlegroups.com" target="_blank">unleashkids+unsubscribe@googlegroups.com</a>.<br>For more options, visit <a href="https://groups.google.com/d/optout" target="_blank">https://groups.google.com/d/optout</a>.<u></u><u></u></p></div></div></div></div></blockquote></div><br><br clear="all"><div><br></div></div></div><span><font color="#888888">-- <br><div>Jérôme Gagnon-Voyer<br></div>
</font></span></div></div>
</blockquote></div><br><br clear="all"><br></div></div>-- <br><div><div dir="ltr"><br></div></div>
</div></div>
</blockquote></div><br><br><div dir="ltr"><div><br></div></div>
</div></div></div></div>
</blockquote></div><br><br clear="all"><div><br></div></div></div><span class="HOEnZb"><font color="#888888">-- <br><div>Jérôme Gagnon-Voyer<br></div>
</font></span></div>
</blockquote></div><br><br><div dir="ltr"><div><br></div></div>
</div></div></div></div></div></div></div>