<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">
Hi Andy,
<div class=""><br class="">
</div>
<div class="">very good on the yodamerge. that'll come in handy :). </div>
<div class=""><br class="">
</div>
<div class="">Regarding the lxplus batch and python environment. Im just sourcing the following scripts: </div>
<div class="">
<div class="">source /afs/<a href="http://cern.ch/sw/lcg/contrib/gcc/4.7.2/x86_64-slc6/setup.sh" class="">cern.ch/sw/lcg/contrib/gcc/4.7.2/x86_64-slc6/setup.sh</a></div>
<div class="">source /afs/<a href="http://cern.ch/sw/lcg/external/MCGenerators_lcgcmt67c/rivet/2.4.1/x86_64-slc6-gcc47-opt/rivetenv.sh" class="">cern.ch/sw/lcg/external/MCGenerators_lcgcmt67c/rivet/2.4.1/x86_64-slc6-gcc47-opt/rivetenv.sh</a></div>
<div class="">export RIVET_ANALYSIS_PATH=/afs/<a href="http://cern.ch/work/r/rkunnawa/JEWEL/ANALYSIS/:$RIVET_ANALYSIS_PATH" class="">cern.ch/work/r/rkunnawa/JEWEL/ANALYSIS/:$RIVET_ANALYSIS_PATH</a></div>
</div>
<div class=""><br class="">
</div>
<div class="">after sourcing this, if i ask for which python, i still get </div>
<div class="">
<div class="">/usr/bin/python</div>
</div>
<div class="">when locally on lxplus if i source the following scripts and ask for which python i get <span style="color: rgb(217, 209, 173); font-family: Monaco; font-size: 10px; background-color: rgb(0, 0, 0);" class="">/cvmfs/<a href="http://sft.cern.ch/lcg/releases/LCG_84/Python/2.7.10/x86_64-slc6-gcc48-opt/bin/python" class="">sft.cern.ch/lcg/releases/LCG_84/Python/2.7.10/x86_64-slc6-gcc48-opt/bin/python</a></span></div>
<div class=""><br class="">
</div>
<div class="">and then i try to run my jobs and this is what i get: </div>
<div class=""><br class="">
</div>
<div class="">
<div class="">'import site' failed; use -v for traceback</div>
<div class="">Traceback (most recent call last):</div>
<div class=""> File "/afs/<a href="http://cern.ch/sw/lcg/external/MCGenerators_lcgcmt67c/rivet/2.4.1/x86_64-slc6-gcc47-opt/bin/rivet" class="">cern.ch/sw/lcg/external/MCGenerators_lcgcmt67c/rivet/2.4.1/x86_64-slc6-gcc47-opt/bin/rivet</a>", line 20, in <module></div>
<div class=""> import os, sys</div>
<div class="">ImportError: No module named os</div>
<div class="">'import site' failed; use -v for traceback</div>
<div class="">Traceback (most recent call last):</div>
<div class=""> File "/afs/<a href="http://cern.ch/sw/lcg/external/MCGenerators_lcgcmt67c/rivet/2.4.1/x86_64-slc6-gcc47-opt/bin/rivet-mkhtml" class="">cern.ch/sw/lcg/external/MCGenerators_lcgcmt67c/rivet/2.4.1/x86_64-slc6-gcc47-opt/bin/rivet-mkhtml</a>", line
17, in <module></div>
<div class=""> import rivet, sys, os</div>
<div class=""> File "/afs/<a href="http://cern.ch/sw/lcg/external/MCGenerators_lcgcmt67c/rivet/2.4.1/x86_64-slc6-gcc47-opt/lib/python2.7/site-packages/rivet/__init__.py" class="">cern.ch/sw/lcg/external/MCGenerators_lcgcmt67c/rivet/2.4.1/x86_64-slc6-gcc47-opt/lib/python2.7/site-packages/rivet/__init__.py</a>",
line 7, in <module></div>
<div class=""> import dl</div>
<div class="">ImportError: No module named dl</div>
</div>
<div class=""><br class="">
</div>
<div class="">So im not sure what is happening also here. Im also asking the CERN service desk and in the meanwhile if anyone has successfully submitted batch jobs from lxplus running rivet, please let me know if Im missing something. </div>
<div class=""><br class="">
</div>
<div class="">Cheers</div>
<div class="">Raghav<br class="">
<div>
<blockquote type="cite" class="">
<div class="">On Jun 9, 2016, at 2:16 PM, Andy Buckley <<a href="mailto:a.g.buckley@gmail.com" class="">a.g.buckley@gmail.com</a>> wrote:</div>
<br class="Apple-interchange-newline">
<div class=""><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">On
09/06/16 13:07, Raghav Kunnawalkam Elayavalli wrote:</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
Hi Rivet Experts,<br class="">
<br class="">
My current analysis has exploded into quite the complicated one<br class="">
leading to a large run time ~25 seconds per 100 events. It would be<br class="">
very useful if i can submit jobs to run this in parallel say 100 job<br class="">
running over 1000 events each. In leu of this requirement, i would<br class="">
need to add the output yoda files together similar to the hadd script<br class="">
that does root files.<br class="">
</blockquote>
<br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">This
is no problem: that's what the yodamerge script does.</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
Im also having several difficulties with the proper python<br class="">
environment at the node where my batch jobs end up (for rivet -a<br class="">
ANALYSIS input.hepmc). this is what i used in my rivet installation<br class="">
on lxplus in the rivet-bootstrap-lcg SETUPCMD_PYTHON="source<br class="">
$LCGDIR/Python/2.7.10/x86_64-slc6-gcc48-opt/Python-env.sh" and this<br class="">
is what i set in my job source<br class="">
/cvmfs/<a href="http://sft.cern.ch/lcg/releases/LCG_84/Python/2.7.10/x86_64-slc6-gcc48-opt/Python-env.sh" class="">sft.cern.ch/lcg/releases/LCG_84/Python/2.7.10/x86_64-slc6-gcc48-opt/Python-env.sh</a><br class="">
<br class="">
when i submit a job with this python and rivet setup, i get a<br class="">
</blockquote>
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">>
following error</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<blockquote type="cite" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<br class="">
@(#)CERN job starter $Date: 2010/06/23 14:22:16 $ Working directory<br class="">
is </pool/lsf/rkunnawa/809932193> on <<a href="http://b64f2daace.cern.ch" class="">b64f2daace.cern.ch</a>> Started<br class="">
running the job<br class="">
<br class="">
this error is for sourcing that python env.<br class="">
<br class="">
'import site' failed; use -v for traceback Traceback (most recent<br class="">
call last): File<br class="">
"/cvmfs/<a href="http://sft.cern.ch/lcg/releases/LCG_84/lcgenv/1.3.2.1/x86_64-centos7-gcc49-dbg/lcgenv" class="">sft.cern.ch/lcg/releases/LCG_84/lcgenv/1.3.2.1/x86_64-centos7-gcc49-dbg/lcgenv</a>",<br class="">
line 11, in <module> import os ImportError: No module named os<br class="">
<br class="">
# output of which python: /usr/bin/python<br class="">
<br class="">
these are for the following error messages when it comes to the rivet<br class="">
-a 'import site' failed; use -v for traceback Traceback (most recent<br class="">
call last): File<br class="">
"/afs/<a href="http://cern.ch/work/r/rkunnawa/JEWEL/local/bin/rivet" class="">cern.ch/work/r/rkunnawa/JEWEL/local/bin/rivet</a>", line 20, in<br class="">
<module> import os, sys ImportError: No module named os 'import site'<br class="">
failed; use -v for traceback Traceback (most recent call last): File<br class="">
"/afs/<a href="http://cern.ch/work/r/rkunnawa/JEWEL/local/bin/rivet-mkhtml" class="">cern.ch/work/r/rkunnawa/JEWEL/local/bin/rivet-mkhtml</a>", line 17,<br class="">
in <module> import rivet, sys, os ImportError: No module named rivet<br class="">
</blockquote>
<br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">Hmm,
I don't really know what's going on. So you set up the same Python environment for your job as used in the build? If you just set up that Python without setting up the Rivet environment, can you open a Python interpreter, import os, etc. without getting these
errors?</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">This
isn't really a Rivet problem, though -- the environment is always a pain on lxplus and other SLC6 systems, since the system compilers and Python are not the ones that are actually supported by LCG.</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">Andy</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">--<span class="Apple-converted-space"> </span></span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">Dr
Andy Buckley, Lecturer / Royal Society University Research Fellow</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">Particle
Physics Expt Group, University of Glasgow</span></div>
</blockquote>
</div>
<br class="">
</div>
</body>
</html>