Long-term series forecasting with Query Selector -- efficient model of sparse attention
Long-term series forecasting with Query Selector -- efficient model of sparse attention
Jacek Klimek Jakub Klimek Witold Kraskiewicz Mateusz Topolewski

Abstract
Various modifications of TRANSFORMER were recently used to solve time-series forecasting problem. We propose Query Selector - an efficient, deterministic algorithm for sparse attention matrix. Experiments show it achieves state-of-the art results on ETT, Helpdesk and BPI'12 datasets.
Code Repositories
Benchmarks
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.