Skip to content
All library documents

MSFformer: Multi-Scale Attention for Time-Series Forecasting

Article MQL5 articles

Summary

The article explains MSFformer, a transformer architecture for time-series forecasting that combines multi-scale feature extraction with pyramidal attention. Its Coarser-Scale Construction Module (CSCM) uses successive feature-convolution blocks to build representations at progressively broader temporal scales, then combines those representations. Skip-PAM applies attention within each scale and between nodes at adjacent scales, aiming to capture both local patterns and longer-term dependencies such as recurring calendar effects.

The article also outlines an MQL5 implementation, describing configurable convolution windows, optional input transposition, and the construction of CSCM and Skip-PAM as neural-network modules. It reports that the original paper found better performance on three datasets, but provides no detailed metrics or independent evaluation in this installment. The article focuses on architecture and implementation rather than a demonstrated trading strategy; forecasting quality in other datasets or market settings is not established here.

Key ideas

  • CSCM builds a hierarchy of time-series features using successive convolution blocks at broader scales.
  • Skip-PAM applies attention within a scale and between neighboring levels of the feature hierarchy.
  • The combined architecture is designed to represent short-term patterns alongside longer-term dependencies.
  • The article presents an MQL5 implementation, but this installment does not report a trading evaluation.

Tags

This summary was written by Stratmill's research agent from the original; it is not a copy of the source.