[Sugar-devel] [Systems] Broken ASLO mirrors

[Bernie Innocenti]

On 08/09/2014 06:26 PM, Bernie Innocenti wrote:
> On 08/09/2014 06:16 PM, Bernie Innocenti wrote:
>> (dropping a bunch of redundant addresses from the cc list)
>>
>> I noticed a strange pattern: all the rsync mirrors appear to be broken,
>> but in fact they're all responsive and up to date (the timestamp.txt
>> file is fresh).
>>
>> Looks like Mirmon's health check over rsync is broken in some way.
> 
> Ok, found the cause with strace:
> 
> $ strace -f -e execve mirmon -v -get all -c /etc/mirmon.conf
> [...]
> [pid 11135] execve("/usr/bin/wget", ["/usr/bin/wget", "-q", "-O", "-",
> "-T", "30", "-t", "1", "rsync://mirror.aarnet.edu.au/pub"...], [/* 40
> vars */]Process 11124 detached
> 
> It's using wget with an rsync url :-(

Ok, looks like the default /etc/mirmon.conf shipped with the Ubuntu
package doesn't support rsync. After reading the f...ine manual, I
changed it like so:

  probe /usr/bin/probe -q -t %TIMEOUT% %URL%timestamp.txt

This seems to do the right thing. Mirrors with rsync probing urls have
started to go green, and will go back online in a few hours (mirmon does
not declare them healthy until it has seen them up for long enough).


>> On 08/09/2014 06:08 PM, Bernie Innocenti wrote:
>>> Our CDN works like this:
>>>
>>> 1. mirmon checks periodically if mirrors are responding and up to date
>>>
>>> 2. clients send queries to download.sugarlabs.org (sunjammer)
>>>
>>> 3. mod_mirrorbrain in apache uses geoip to find the closest *WORKING* mirror
>>>
>>> 4. apache sends back a 302 redirect to the chosen mirror
>>>
>>> 5. user downloads the file from the mirror
>>>
>>>
>>> So, no matter how many mirrors are broken, you should *never* get
>>> redirected to an error page. Can anyone show me a "wget --save-headers"
>>> showing the problem?
>>>
>>>
>>> On 08/07/2014 08:32 AM, Martin Abente wrote:
>>>>
>>>>
>>>> On Wed, Aug 6, 2014 at 5:54 PM, Sam Parkinson <sam.parkinson3 at gmail.com
>>>> <mailto:sam.parkinson3 at gmail.com>> wrote:
>>>>
>>>>     We really should perge the mirrors list of dead mirrors. 
>>>>     http://mirrors.sugarlabs.org
>>>>
>>>>
>>>> +1, I was thinking more like disabling temporarily those who haven't
>>>> been working since a few days. 
>>>>
>>>>     Maybe we should contact arrnet (the one in question) - they might
>>>>     fix it if you ask nicely :) 
>>>>
>>>>     I will try to setup a mirror myself - I have like 1tb unused
>>>>     internet on my new aslo server (digitalocean in Singapore).
>>>>
>>>>     On Aug 7, 2014 7:50 AM, "Ignacio Rodríguez" <ignacio at sugarlabs.org
>>>>     <mailto:ignacio at sugarlabs.org>> wrote:
>>>>
>>>>         Sebastian, did you remember in sugar camp?
>>>>
>>>>         We got the same problem..
>>>>
>>>>         You fixed it?
>>>>
>>>>         Or that was automatic?
>>>>
>>>>         Ignacio Rodríguez
>>>>
>>>>
>>>>         2014-08-06 18:44 GMT-03:00 Sebastian Silva
>>>>         <sebastian at fuentelibre.org <mailto:sebastian at fuentelibre.org>>:
>>>>
>>>>             Hi,
>>>>             I have experienced the same thing. Not sure it was the same
>>>>             mirror.
>>>>
>>>>             Regards,
>>>>             Sebastian
>>>>
>>>>             El mié, 6 de ago 2014 a las 2:47 PM, Martin Abente
>>>>             <martin.abente.lahaye at gmail.com
>>>>             <mailto:martin.abente.lahaye at gmail.com>> escribió:
>>>>
>>>>>             Hello everyone,
>>>>>
>>>>>             Has anybody else noticed that some ASLO mirrors are broken?
>>>>>
>>>>>             In example:
>>>>>
>>>>>                 The
>>>>>                 URL http://download.sugarlabs.org/activities/4040/finance-11.xo,
>>>>>                 sometimes redirects
>>>>>                 to http://mirror.aarnet.edu.au/pub/sugarlabs/activities/4040/finance-11.xo
>>>>>                 which is broken.
>>>>>
>>>>>             Ideas?
>>>>>
>>>>>             tch.
>>>>
>>>>             _______________________________________________
>>>>             Systems mailing list
>>>>             Systems at lists.sugarlabs.org <mailto:Systems at lists.sugarlabs.org>
>>>>             http://lists.sugarlabs.org/listinfo/systems
>>>>
>>>>
>>>>
>>>>         _______________________________________________
>>>>         Sugar-devel mailing list
>>>>         Sugar-devel at lists.sugarlabs.org
>>>>         <mailto:Sugar-devel at lists.sugarlabs.org>
>>>>         http://lists.sugarlabs.org/listinfo/sugar-devel
>>>>
>>>>
>>>
>>>
>>
>>
> 
> 


-- 
 _ // Bernie Innocenti
 \X/  http://codewiz.org