[Systems] [Sugar-devel] bugs-testing.sugarlabs.org confusing people

[Sascha Silbe]

Excerpts from Bernie Innocenti's message of Wed Sep 15 16:37:32 +0200 2010:

> > Seems to be indexed by google, along with some bugmail coming from there.
> 
> How could we prevent google from indexing all our *-testing and *-devel
> sites?

Put a /robots.txt on them. I've now adjusted the ones for
bugs-{testing,devel} to disallow automated access to all of the
site. Previously we used the same rule set as for the production site,
i.e. only prevented access to forms and expensive reports.

Anyone working with tools obeying robots.txt (e.g. wget) on our
test / development sites will now have to manually override robots.txt
compliance.

Sascha

--
http://sascha.silbe.org/
http://www.infra-silbe.de/
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 490 bytes
Desc: not available
Url : http://lists.sugarlabs.org/private/systems/attachments/20100915/718239ed/attachment.pgp