Data Mining of the MMS Data using Python
Abstract
Data mining is the process of discovering patterns in large data sets involving methods at the intersection of machine learning, statistics, and database systems. For our needs, we have developed techniques to mine the entirety of MMS CDF data looking for specific scientific phenomena.
We have used data mining to search for specific spacecraft locations including the plume, the warm plasma cloak, bow shock and magnetopause crossings, and periods within the pristine solar wind. Time of flight data is mined to search for minor species both in the solar wind and within the Earth's magnetosphere. The versatility of this technique makes it highly applicable to these, and many as yet untapped data sets as the modular approach is usable with any time series data. In addition to Python, we make use of SpacePy and MySQL to accomplish our data mining.- Publication:
-
AGU Fall Meeting Abstracts
- Pub Date:
- December 2018
- Bibcode:
- 2018AGUFMIN11B0620M
- Keywords:
-
- 1904 Community standards;
- INFORMATICSDE: 1936 Interoperability;
- INFORMATICSDE: 1976 Software tools and services;
- INFORMATICSDE: 7599 General or miscellaneous;
- SOLAR PHYSICS;
- ASTROPHYSICS;
- AND ASTRONOMY