|
[Rivet] [Fastjet] FastJet "robot" downloads blockedMatteo Cacciari cacciari at lpthe.jussieu.frFri Apr 19 13:13:58 BST 2013
Follow up: can you please give me the IP from which you are running your script, so that I can look into the logs? Matteo On 19/04/2013 14:03, Matteo Cacciari wrote: > Hi Andy. > > As far as I remember we are not doing eny explicit blocking. I don't even > think we have a robots.txt file there. > > We'll look into it asap. Thank you for the mail. > > Matteo > > > On 19/04/2013 12:42, Andy Buckley wrote: >> Hi Gregory, Gavin, et al, >> >> We've noticed recently that the FastJet website blocks "robot" downloads >> of the FastJet tarball, e.g. http://fastjet.fr/repo/fastjet-3.0.3.tar.gz >> >> Unfortunately this means that the Rivet bootstrap script can fail if it >> tries to download and build FastJet, rather than using the LCG installed >> copy from AFS. We're using Python's urllib2 to do the fetching... is >> there anything weor you can do to not fall foul of this blocking? (I'm >> not sure if urllib2 automatically respects robots.txt files, but if you >> want to give us a special unblocked User-Agent name to use, I'm sure we >> can manage to update our script accordingly) >> >> Thanks! >> Andy & co >> > > > > _______________________________________________ > Fastjet mailing list > Fastjet at projects.hepforge.org > http://www.hepforge.org/lists/listinfo/fastjet > -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 2945 bytes Desc: S/MIME Cryptographic Signature URL: <http://www.hepforge.org/lists-archive/rivet/attachments/20130419/7bd97723/attachment.bin>
More information about the Rivet mailing list |