LSD: Large Survey Database framework
Abstract
The Large Survey Database (LSD) is a Python framework and DBMS for distributed storage, cross-matching and querying of large survey catalogs (>10^9 rows, >1 TB). The primary driver behind its development is the analysis of Pan-STARRS PS1 data. It is specifically optimized for fast queries and parallel sweeps of positionally and temporally indexed datasets. It transparently scales to more than >10^2 nodes, and can be made to function in "shared nothing" architectures.
- Publication:
-
Astrophysics Source Code Library
- Pub Date:
- September 2012
- Bibcode:
- 2012ascl.soft09003J
- Keywords:
-
- Software