[Rivet] HepData consistency

[David Grellscheid]

Hi Holger,

Thanks for getting out all the details! It looks really bad.

The original design assumption was that we could resync our refdata
directory from Hepdata at any time, and that we were just caching the
files for local convenience.

We need to work out where the divergence came in. When we receive new
analyses, they usually come with a refdata file that the submitter gives
us, right? At that point we never checked against Hepdata ourselves.

Some initial points that need clarification:

- Do the submitters check that the data matches?
- Does Hepdata renumber things once in a while?
- How can we find out about corrections to Hepdata?
- How should they be applied, given that the original was already
presumably a validated line?

I'm sure there's more, let's collect a few questions and contact Graeme.

See you,

  David







On 04/10/16 11:39, Holger Schulz wrote:
> Hi,
> 
> I wrote a script that does some trivial checks for the reference
> data files shipped with rivet and their counterpart obtainable from
> HepData.
> 
> It generates reports which can be found here:
> 
>     https://users.hepforge.org/~holsch/HepDataRivetReports/
> 
> There is quite a number of inconsistencies.
> 
> Quite often in LHC analyses the dxy tags differ, a number of
> ref data sets differ in the number of data points between rivet and hepdata
> and of course there are several analyses where the data is not in hepdata
> at all.
> 
> And then there are some "goodness of fit" issues where I compare
> two scatters as such (can clearly be improved):
> 
> 
>     def gof(P1, P2):
>         chi=0.0
>         for num, p in enumerate(P1):
>             chi += (p.y - P2[num].y)
>             chi += (p.yErrAvg - P2[num].yErrAvg)
>             chi += (p.x - P2[num].x)
>             chi += (p.xErrAvg - P2[num].xErrAvg)
>         return chi
> 
> 
> So yeah I don't really know what course of action to take but it seem
> quite clear
> that HepData and rivet have diverged quite substantially.
> 
> Holger
> 
> 
> 
> 
> 
> _______________________________________________
> Rivet mailing list
> Rivet at projects.hepforge.org
> https://www.hepforge.org/lists/listinfo/rivet
>