Did I Say Terabyte? I Meant Petabyte: Data Archiving in the Era of SDO
Abstract
Even solar missions of modest size in the next half decade will produce terabytes (Tbyte = 1012 byte) of data. The Solar Data Analysis Center is already dealing with mission archives of similar volumes, and is serving the entire archives to the community over the Internet (Gurman 1999). With the Solar Dynamics Observatory (SDO) scheduled for launch at the end of 2006, archiving and serving the data from a primarily solar physics mission begins to get interesting: one Tbyte of data a day, or over a petabyte (Pbyte) of data in three years.We examine whether current data archiving and service strategies can be scaled to such volumes,and enumerate other challenges associated with distributed access to so much data.
- Publication:
-
AGU Spring Meeting Abstracts
- Pub Date:
- May 2001
- Bibcode:
- 2001AGUSM..SP21B01G
- Keywords:
-
- 7594 Instruments and techniques;
- 9820 Techniques applicable in three or more fields