[Rivet] [Fastjet] FastJet "robot" downloads blocked

[Matteo Cacciari]

Hi Andy.

As far as I remember we are not doing eny explicit blocking. I don't even
think we have a robots.txt file there.

We'll look into it asap. Thank you for the mail.

Matteo


On 19/04/2013 12:42, Andy Buckley wrote:
> Hi Gregory, Gavin, et al,
> 
> We've noticed recently that the FastJet website blocks "robot" downloads
> of the FastJet tarball, e.g. http://fastjet.fr/repo/fastjet-3.0.3.tar.gz
> 
> Unfortunately this means that the Rivet bootstrap script can fail if it
> tries to download and build FastJet, rather than using the LCG installed
> copy from AFS. We're using Python's urllib2 to do the fetching... is
> there anything weor you can do to not fall foul of this blocking? (I'm
> not sure if urllib2 automatically respects robots.txt files, but if you
> want to give us a special unblocked User-Agent name to use, I'm sure we
> can manage to update our script accordingly)
> 
> Thanks!
> Andy & co
> 

-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 2945 bytes
Desc: S/MIME Cryptographic Signature
URL: <http://www.hepforge.org/lists-archive/rivet/attachments/20130419/e0a93748/attachment.bin>