Research & Papers

XLinear: Frequency-Enhanced MLP with CrossFilter for Robust Long-Range Forecasting

New architecture combines frequency-domain attention with noise-resistant filters to capture complex long-term dependencies.

Deep Dive

Researcher Xiang Ao has introduced XLinear, a new machine learning architecture designed to solve a persistent problem in time series forecasting: capturing long-range dependencies without sacrificing robustness. Traditional MLP (Multi-Layer Perceptron) models are known for their noise resistance but struggle with complex, long-term patterns, while Transformer models can capture dependencies but are often less robust and computationally heavy. XLinear bridges this gap by employing a dual-component approach, first decomposing a time series into trend and seasonal parts.

For the long-range trend component, XLinear uses a novel Enhanced Frequency Attention (EFA) module. This module operates in the frequency domain, a mathematical transformation of the data, which is more efficient for identifying repeating patterns over very long sequences. For the seasonal component, which contains shorter, noisier cycles, the model uses a proposed CrossFilter Block. This block is designed to filter out noise while preserving important signals, specifically avoiding the robustness issues common in attention mechanisms used by Transformers. Published and accepted at the 2025 IEEE AIAHPC conference, experimental results show XLinear achieves state-of-the-art performance, proving that a lightweight MLP-based structure can indeed be enhanced to master long-range forecasting tasks.

Key Points
  • Uses Enhanced Frequency Attention (EFA) to capture long-term trends in the frequency domain, overcoming a key MLP limitation.
  • Employs a novel CrossFilter Block for the seasonal component to maintain high robustness against noise, a weakness of attention-based models.
  • Achieves state-of-the-art performance on test datasets while keeping the lightweight and robust architecture benefits of traditional MLPs.

Why It Matters

Enables more accurate and reliable long-term predictions in finance, logistics, and climate modeling where noise and long-range patterns coexist.