Big Data Architectures for Logging and Monitoring the ASTRI Mini-Array
Abstract
The ASTRI Mini-Array is being developed by INAF as a pathfinder array for Cherenkov astronomy in the TeV energy range. The array is expected to produce a large volume of technical and logging data. In the last few years several "Big Data" technologies have been developed to deal with a huge amount of data, e.g. in the Internet of Things (IoT) framework. We are comparing different stacks of Big Data/IoT architectures including high performance distributed messaging systems, time series databases, streaming systems, interactive data visualization. The main aim is to classify these technologies based on a set of use cases typically related to the data produced in the astronomical environment, with the objective to have a system that can be updated, maintained and customized with a minimal programming effort. We present the preliminary results obtained, using different Big Data stack solution to manage some use cases related to quasi real-time collection, processing and storage of the technical data, logging and technical alert produced by the ASTRI Mini-Array.
- Publication:
-
Astronomical Data Analysis Software and Systems XXIX
- Pub Date:
- 2020
- Bibcode:
- 2020ASPC..527..335S