NetDRMS: A Shared Data Management System for SDO and VSO
Abstract
The Joint Science Operations Center of the Solar Dynamic Observatory has built an integrated Data Record Management System (DRMS) and Storage Unit Management System (SUMS) to manage the analysis, archiving, and distribution of the massive amount of data flowing from the AIA and HMI instruments. Both DRMS and SUMS use the open source PostgreSQL database to manage the metadata. Locally developed Unix tools and C and Fortran libraries are used by DRMS and SUMS to manage data storage, retrieval, and transfer. They also provide an Applications Programming Interface to the databases. NetDRMS has been designed as an extension of DRMS/SUMS to simplify the automatic sharing of metadata and transport of image data among multiple data servers. It uses Slony, an open-source PostgreSQL replication system, and the DRMS/SUMS API. It has been adopted by the Virtual Solar Observatory as the mechanism for mirroring of key SDO data sets for distribution throughout the scientific community. In this paper we present a description of the architecture and features of NetDRMS, the mechanisms for data distribution, requirements for installation and operation, and the current status of the system.
- Publication:
-
AAS/Solar Physics Division Meeting #40
- Pub Date:
- May 2009
- Bibcode:
- 2009SPD....40.1705B