A Demonstration Study Comparing the Utility of Different Metrics in Validating SAMI3
Abstract
The increasing number of efforts to develop ionosphere/thermosphere (I/T) models from research tools into operational systems has created a critical need to define appropriate metrics to assess the performance and suitability of the models for transition to operations. A suite of metrics must be carefully chosen to evaluate the specifications and forecasts of the I/T system that are most relevant to operational communities. In this study, we assess the performance of SAMI3 with respect to state-of-the-art empirical models comprised of truth data sets, as well as vetted ground-, and space-based measurements. We also demonstrate the utility of several established and newly identified metrics. In particular, we focus on metrics that evaluate ionospheric forecasts intended for the use of predicting the propagation of radio wave signals.
- Publication:
-
AGU Fall Meeting Abstracts
- Pub Date:
- December 2019
- Bibcode:
- 2019AGUFMSH32B..08B
- Keywords:
-
- 4323 Human impact;
- NATURAL HAZARDS;
- 7594 Instruments and techniques;
- SOLAR PHYSICS;
- ASTROPHYSICS;
- AND ASTRONOMY;
- 7924 Forecasting;
- SPACE WEATHER;
- 7934 Impacts on technological systems;
- SPACE WEATHER