A carregar...
Publicação
Deep learning in time series forecasting with transformer models and RNNs
| Nome: | Descrição: | Tamanho: | Formato: | |
|---|---|---|---|---|
| 13.48 MB | Adobe PDF |
Orientador(es)
Resumo(s)
Given the increasing need for accurate weather forecasts, the use of neural networks, especially transformer and recurrent neural networks (RNNs), has been highlighted for their ability to capture complex patterns in time series. This study examined 14 neural network models applied to forecast weather variables, evaluated using metrics such as median absolute error (MedianAbsE), mean absolute error (MeanAbsE), maximum absolute error (MaxAbsE), root mean squared percent error (RMSPE), and root mean square error (RMSE). Transformer-based models such as Informer, iTransformer, Former, and patch time series transformer (PatchTST) stood out for their accuracy in capturing long-term patterns, with Informer showing the best performance. In contrast, RNN models such as auto-temporal convolutional networks (TCN) and bidirectional TCN (BiTCN) were better suited to short-term forecasting, despite being more prone to significant errors. Using iTransformer it was possible to achieve a MedianAbsE of 1.21, MeanAbsE of 1.24, MaxAbsE of 2.86, RMSPE de 0.66, and RMSE de 1.43. This study demonstrates the potential of neural networks, especially transformers, to improve accuracy, providing a practical and theoretical basis for selecting the most suitable models for predictive applications.
Descrição
Funding information:
This research has received funding from the European Union’s Horizon-MSCA-2023-SE-01 Programme (ANTIDOTE project) under grant agreement number 101183162. This work was also supported by the Portuguese Agency FCT (Fundação para a Ciência e Tecnologia), under Grants LASIGE Research Unit, ref. UID/00408/2025. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Publisher Copyright:
© Copyright 2025 Santos et al. Distributed under Creative Commons CC-BY 4.0. https://creativecommons.org/licenses/by/4.0/
Palavras-chave
Accuracy in forecasting Algorithms and Analysis of Algorithms Artificial Intelligence Data Mining and Machine Learning Deep learning Neural networks Predictive applications Programming Languages Recurrent neural networks (RNNs) Scientific Computing and Simulation Transformer models General Computer Science