[Rivet] [Fastjet] FastJet "robot" downloads blocked

Matteo Cacciari cacciari at lpthe.jussieu.fr
Fri Apr 19 13:13:58 BST 2013


Follow up: can you please give me the IP from which you are running your
script, so that I can look into the logs?

Matteo


On 19/04/2013 14:03, Matteo Cacciari wrote:
> Hi Andy.
> 
> As far as I remember we are not doing eny explicit blocking. I don't even
> think we have a robots.txt file there.
> 
> We'll look into it asap. Thank you for the mail.
> 
> Matteo
> 
> 
> On 19/04/2013 12:42, Andy Buckley wrote:
>> Hi Gregory, Gavin, et al,
>>
>> We've noticed recently that the FastJet website blocks "robot" downloads
>> of the FastJet tarball, e.g. http://fastjet.fr/repo/fastjet-3.0.3.tar.gz
>>
>> Unfortunately this means that the Rivet bootstrap script can fail if it
>> tries to download and build FastJet, rather than using the LCG installed
>> copy from AFS. We're using Python's urllib2 to do the fetching... is
>> there anything weor you can do to not fall foul of this blocking? (I'm
>> not sure if urllib2 automatically respects robots.txt files, but if you
>> want to give us a special unblocked User-Agent name to use, I'm sure we
>> can manage to update our script accordingly)
>>
>> Thanks!
>> Andy & co
>>
> 
> 
> 
> _______________________________________________
> Fastjet mailing list
> Fastjet at projects.hepforge.org
> http://www.hepforge.org/lists/listinfo/fastjet
> 

-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 2945 bytes
Desc: S/MIME Cryptographic Signature
URL: <http://www.hepforge.org/lists-archive/rivet/attachments/20130419/7bd97723/attachment.bin>


More information about the Rivet mailing list