bigfile: A reproducible massively parallel IO library for hierarchical data
Abstract
bigfile stores data from cosmology simulations from HPC systems and beyond. It provides a hierarchical structure of data columns via File, Dataset and Column. A Column stores a two dimensional table. Numerical typed columns are supported; attributes can be attached to a Column and both numerical attributes and string attributes are supported. Type casting is performed on-the-fly if read/write operations request a different data type than the file has stored.
- Publication:
-
Astrophysics Source Code Library
- Pub Date:
- July 2024
- Bibcode:
- 2024ascl.soft07011F
- Keywords:
-
- Software