Memory-based Transformer with shorter window and longer horizon for multivariate time series forecasting
Memory-based Transformer with shorter window and longer horizon for multivariate time series forecasting
复制标题
基于内存的 Transformer，具有更短的窗口和更长的视野，用于多元时间序列预测
DOI：
10.1016/j.patrec.2022.05.010
复制
发表时间：
2022-05
影响因子：
5.1
通讯作者：
Meijun Sun
中科院分区：
文献类型：
--
作者：
Yang Liu;Zheng Wang;Xinyang Yu;Xin Chen;Meijun Sun
• SWLHT obtains longer prediction length via a shorter input length. • An efficient memory module can capture the correlation between input segments. • A multi-segment forecasting method is proposed to reduce the accumulation of errors. • A linear autoregressive module is integrated to improve the robustness of the model. Multivariate time series forecasting is an important problem that spans many fields. One challenge of this problem is the complex and non-linear interdependence between time steps and different variables. Recent studies have shown that Transformer has potential in capturing long-term dependencies. However, in the field of time series forecasting, Transformer still has some problems to solve, such as prediction fragmentation and insensitivity to data scale. In addition, traditional forecasting models often require a large amount of input data to support the training of the model when predicting long-term data. However, it is hard to provide sufficient time series input data due to equipment damage or weather situation. To solve these limitations, a memory-based Transformer with shorter window and longer horizon is proposed, called SWLHT. It uses the memory mechanism to make the model no longer only rely on a single input, but can combine the previous forecast results to assist in capturing long-term dependencies, thereby avoiding the requirement of excessively long input sequence. Furthermore, the memory mechanism can alleviate the prediction fragmentation to some extent. The experimental results and comparison of baselines on several real-world multivariate time series datasets have verified the effectiveness of the proposed model.
登录
查看更多内容
DOI：
10.1016/j.engappai.2010.09.007
发表时间：
2011-02-01
影响因子：
8
作者：
Fu, Tak-chung
通讯作者：
Fu, Tak-chung
影响因子：
2.9
作者：
Bruno Fernandes;Fábio Silva;H. Alaiz-Moretón;P. Novais;J. Neves;Cesar Analide
通讯作者：
Bruno Fernandes;Fábio Silva;H. Alaiz-Moretón;P. Novais;J. Neves;Cesar Analide
DOI：
10.1098/rsta.2011.0550
发表时间：
2013-02-13
影响因子：
5
作者：
Roberts, S.;Osborne, M.;Aigrain, S.
通讯作者：
Aigrain, S.
影响因子：
2.5
作者：
A. E. Hoerl;R. Kennard
通讯作者：
A. E. Hoerl;R. Kennard
DOI：
10.1111/j.1467-985x.2004.298_6.x
发表时间：
2004-02
影响因子：
2
作者：
Kuldeep Kumar
通讯作者：
Kuldeep Kumar