Data extraction tool and colocation database for satellite and model product evaluation (Invited)
Abstract
The Satellite Product Evaluation Center (SPEC) is an ongoing project to integrate operational monitoring of data products from satellite and model analysis, with support for quantitative calibration, validation and algorithm improvement. The system uniquely allows scientists and others to rapidly access, subset, visualize, statistically compare and download multi-temporal data from multiple in situ, satellite, weather radar and model sources without reference to native data and metadata formats, packaging or physical location. Although still in initial development, the SPEC database and services will contain a wealth of integrated data for evaluation, validation, and discovery science activities across many different disciplines. The SPEC data extraction architecture departs from traditional dataset and research driven approaches through the use of standards and relational database technology. The NetCDF for Java API is used as a framework for data decoding and abstraction. The data are treated as generic feature types (such as Grid or Swath) as defined by the NetCDF Climate and Forecast (CF) metadata conventions. Colocation data for various field measurement networks, such as the Climate Reference Network (CRN) and Ameriflux network, are extracted offline, from local disk or distributed sources. The resulting data subsets are loaded into a relational database for fast access. URL-based (Representational State Transfer (REST)) web services are provided for simple database access to application programmers and scientists. SPEC supports broad NOAA, U.S. Global Change Research Program (USGCRP) and World Climate Research Programme (WCRP) initiatives including the National Polar-orbiting Operational Environmental Satellite System (NPOESS) and NOAA’s Climate Data Record (CDR) programs. SPEC is a collaboration between NOAA’s National Climatic Data Center (NCDC) and DOE’s Oak Ridge National Laboratory (ORNL). In this presentation we will describe the data extraction architecture, current and future database contents and web service access methods.
- Publication:
-
AGU Fall Meeting Abstracts
- Pub Date:
- December 2009
- Bibcode:
- 2009AGUFMIN11E..01A
- Keywords:
-
- 1910 INFORMATICS / Data assimilation;
- integration and fusion;
- 1916 INFORMATICS / Data and information discovery;
- 1996 INFORMATICS / Web Services