Yadage and Packtivity - analysis preservation using parametrized workflows - INSPIRE

DataBETA

Yadage and Packtivity - analysis preservation using parametrized workflows

Kyle Cranmer
(
- New York U.
)
,
Lukas Heinrich
(
- New York U.
)

Jun 6, 2017

8 pages

Part of Proceedings, 22nd International Conference on Computing in High Energy and Nuclear Physics (CHEP2016) : San Francisco, CA, October 14-16, 2016

Published in:

J.Phys.Conf.Ser. 898 (2017) 10, 102019

Contribution to:

- CHEP 2016

Published: Nov 21, 2017

e-Print:

1706.01878 [physics.data-an]

DOI:

10.1088/1742-6596/898/10/102019

View in:

ADS Abstract Service

reference search26 citations

Citations per year

Abstract: (IOP)

Preserving data analyses produced by the collaborations at LHC in a parametrized fashion is crucial in order to maintain reproducibility and re-usability. We argue for a declarative description in terms of individual processing steps – “packtivities” – linked through a dynamic directed acyclic graph (DAG) and present an initial set of JSON schemas for such a description and an implementation – “yadage” – capable of executing workflows of analysis preserved via Linux containers.

Note:

9 pages

CERN LHC Coll
programming
data preservation

References(14)

Figures(0)

[1]

GAUDI - A software architecture and framework for building HEP data processing applications

et al.

- Comput.Phys.Commun. 140 (2001) 45-55
•
DOI:
- 10.1016/S0010-4655(01)00254-5

[2]

RECAST: Extending the Impact of Existing Analyses

Kyle Cranmer
(
- New York U., CCPP
)
,
Itay Yavin
(
- New York U., CCPP
)

- JHEP 04 (2011) 038
•
e-Print:
- 1010.2506
•
DOI:
- 10.1007/JHEP04(2011)038

[3]

The ATLAS metadata interface

- J.Phys.Conf.Ser. 219 (2010) 042030
•
DOI:
- 10.1088/1742-6596/219/4/042030

[4]

: The prov data model Tech. rep. URL

Moreau L
,
Missier P
,
Belhajjame K
,
B'Far R
,
Cheney J

et al.

- http://www.w3.org/TR/prov-dm/

[5]

diana-hep/yadage-schemas: Initial zenodo release

Heinrich L
,
Cranmer K

[6]

diana-hep/packtivity: Initial zenodo release

Heinrich L
,
Cranmer K

[7]

Distributed computing in practice: the Condor experience

- Concurrency Comput.Pract.Exp. 17 (2005) 2-4, 323-356
•
DOI:
- 10.1002/cpe.938

[8]

URL

Amstutz P
,
Crusoe M. R
,
Tijani N
,
Chapman B
,
Chilton J

et al.

[9]

diana-hep/yadage: Initial zenodo release

Heinrich L
,
Cranmer K

[10]

Summary of the ATLAS experiment’s sensitivity to supersymmetry after LHC Run 1 — interpreted in the phenomenological MSSM

ATLAS

Collaboration

•

Georges Aad
(
- Marseille, CPPM
)

et al.

- JHEP 10 (2015) 134
•
e-Print:
- 1508.06608
•
DOI:
- 10.1007/JHEP10(2015)134

[11]

Dark matter interpretations of ATLAS searches for the electroweak production of supersymmetric particles in $\sqrt{s}=8$ TeV proton-proton collisions

ATLAS

Collaboration

•

Morad Aaboud
(
- Oujda U.
)

et al.

- JHEP 09 (2016) 175
•
e-Print:
- 1608.00872
•
DOI:
- 10.1007/JHEP09(2016)175

[14]

A re-interpretation of $\sqrt{s}=8~$ TeV ATLAS results on electroweak supersymmetry production to explore general gauge mediated models

ATLAS

Collaboration

[13]

CERN Analysis Preservation: A Novel Digital Library Service to Enable Reusable and Reproducible Research

et al.

- Lect.Notes Comput.Sci. 9819 (2016) 347-356
•
DOI:
- 10.1007/978-3-319-43997-6_27

[14]

A re-interpretation of $\sqrt{s}=8~$ TeV ATLAS results on electroweak supersymmetry production to explore general gauge mediated models

ATLAS

Collaboration