Real-time SWMF-Geospace at CCMC: assessing the quality of output from continuous operational simulations

The ground-based magnetometer index Dst is a decent measure of the near-Earth current systems, in particular those in the storm-time inner magnetosphere. The ability of a large-scale, physics-based model to reproduce, or even predict, this index is therefore a tangible measure of the overall validity of the code for space weather research and space weather operational usage. Experimental real-time simulations of the Space Weather Modeling Framework (SWMF) are conducted at the Community Coordinated Modeling Center (CCMC), with results available there (http://ccmc.gsfc.nasa.gov/realtime.php), through the CCMC Integrated Space Weather Analysis (iSWA) site (http://iswa.ccmc.gsfc.nasa.gov/IswaSystemWebApp/), and the Michigan SWMF site (http://csem.engin.umich.edu/realtime). Presently, two configurations of the SWMF are running in real time at CCMC, both focusing on the geospace modules, using the BATS-R-US magnetohydrodynamic model, the Ridley Ionosphere Model, and with and without the Rice Convection Model for inner magnetospheric drift physics. While both have been running for several years, nearly continuous results are available since July 2015. Dst from the model output is compared against the Kyoto real-time Dst. Various quantitative measures are presented to assess the goodness of fit between the models and observations. In particular, correlation coefficients, RMSE and prediction efficiency are calculated and discussed. In addition, contingency tables are presented, demonstrating the ability of the model to predict "disturbed times" as defined by Dst values below some critical threshold. It is shown that the SWMF run with the inner magnetosphere model is significantly better at reproducing storm-time values, with prediction efficiencies above 0.25 and Heidke skill scores above 0.5. This work was funded by NASA and NSF grants, and the European Union's Horizon 2020 research and innovation programme under grant agreement 637302 PROGRESS.