High-Performance I/O: HDF5 for Lattice QCD
Jan 27, 2015
7 pages
Published in:
- PoS LATTICE2014 (2015) 045
Contribution to:
- , 045
- Lattice 2014
- Published: Jan 27, 2015 by SISSA
e-Print:
- 1501.06992 [hep-lat]
DOI:
Report number:
- NT@WM-15-02,
- JLAB-THY-15-2007
View in:
Citations per year
Abstract: (arXiv)
Practitioners of lattice QCD/QFT have been some of the primary pioneer users of the state-of-the-art high-performance-computing systems, and contribute towards the stress tests of such new machines as soon as they become available. As with all aspects of high-performance-computing, I/O is becoming an increasingly specialized component of these systems. In order to take advantage of the latest available high-performance I/O infrastructure, to ensure reliability and backwards compatibility of data files, and to help unify the data structures used in lattice codes, we have incorporated parallel HDF5 I/O into the SciDAC supported USQCD software stack. Here we present the design and implementation of this I/O framework. Our HDF5 implementation outperforms optimized QIO at the 10-20% level and leaves room for further improvement by utilizing appropriate dataset chunking.Note:
- Contribution to the 32nd International Symposium on Lattice Field Theory (Lattice 2014), 23-28 June 2014, Columbia University, New York, NY, USA
- lattice field theory
- field theory
- programming
- structure
- lattice
- computer: performance
- numerical calculations
- scaling
References(10)
Figures(11)
- [1]
- [2]
- [3]
- [4]
- [5]
- [6]
- [7]
- [8]
- [9]
- [10]