Long-term series forecasting with Query Selector -- efficient model of sparse attention
Abstract
Various modifications of TRANSFORMER were recently used to solve time-series forecasting problem. We propose Query Selector - an efficient, deterministic algorithm for sparse attention matrix. Experiments show it achieves state-of-the art results on ETT, Helpdesk and BPI'12 datasets.
- Publication:
-
arXiv e-prints
- Pub Date:
- July 2021
- DOI:
- 10.48550/arXiv.2107.08687
- arXiv:
- arXiv:2107.08687
- Bibcode:
- 2021arXiv210708687K
- Keywords:
-
- Computer Science - Machine Learning
- E-Print:
- 10 pages