Milky Way Analysis through a Science Gateway: Workflows and Resource Monitoring
Abstract
This paper presents the latest developments on the VIALACTEA Science Gateway in the context of the FP7 VIALACTEA project. This science gateway operates as a central workbench for the VIALACTEA community in order to allow astronomers to process the new-generation (from Infrared to Radio) surveys of the Galactic Plane to build and deliver a quantitative 3D model of our Milky Way Galaxy. The final model will be used as a template for external galaxies to study star formation across the cosmic time. The adopted AGILE software development process allowed to fulfill the community needs in terms of required workflows and underlying resources monitoring. The scientific requirements arose during the process highlighted the needs for easy parameter setting, fully embarrassingly parallel computations and large-scale input dataset processing. Therefore the science gateway based on the WS-PGRADE/gUSE framework has been able to fulfill the requirements mainly exploiting the parameter sweep paradigm and parallel jobs execution of the workflow management system. Moving from the development to the production environment an efficient resource monitoring system has been implemented to easily analyse and debug sources of failure due to workflows computations. The results of the resource monitoring system are exploitable not only for IT experts administrators and workflow developers but also for the
- Publication:
-
8th International Workshop on Science Gateways (IWSG 2016)
- Pub Date:
- June 2016
- Bibcode:
- 2016scga.confE..12S