Operational Change within IRIS Data Services

IRIS and UNAVCO are beginning the process of merging their geophysical data holdings, products, and services into a new, joint organization. Robust UNAVCO and IRIS legacy data exchange systems will be critical to the Earthscope Consortium merge. IRIS is preparing for this migration of digital assets by modernizing the observability of its data pipelines, and by supporting new and updated data formats that are cleaned prior to archival. These enhancements will provide insight into system dynamics to inform infrastructure design, and will increase flexibility when handling data generated by the Earthscope instrument repository. Archive growth and user statistics are collected and stored in new ways to improve not only performance monitoring and the services provided to users, but also to enable our facility to provide data utilization reports to the National Science Foundation. Data from a multitude of geophysical instruments can be validated and exchanged using defined protocols. Data exchange containers, such as HDF5 and Zarr, are being leveraged to store time series and metadata. Data validators are being expanded to test for consistency within nodal and magnetotelluric experiments. Validation tools improve error handling throughout the IRIS system and allow users to generate clean data. A cleaned and merged Earthscope Consortium archive will be a valuable resource for current and future generations of interdisciplinary scientists.