Giter VIP home page Giter VIP logo

mlgn's Introduction

MLGN (Please stay tuned for further updates on our progress. Thank you for your interest in our work.)

Code release of paper "Multi-Scale Local-Global Feature Learning Network for Long-term Series Forecasting" MLGN achieve SOTA on six benchmarks.

state-of-the-artpytorch

Overall Architecture

As shown in Figure 1, we decompose the time series into seasonal part and trend part by Multi-scale Sequence Decomposition. For seasonal part, we use Seasonal Component Prediction block to predict. For trend part, we use a simple full-connected layer to predict.



Seasonal Prediction block

The seasonal part contains several different patterns after Multi-scale Sequence Decomposition. For each pattern, we use local-global module to discovery local temporal features and global relations.



Local-Global module

We use down-sampling interactive learning convolution to capture local features and causal frequency enhancement module to discover global correlations.



Interactive learning convolution

We use downsampling convolution to capture local features.



Causal frequency enhancement module

We use causal frequency enhancement module to discover global correlations



Get Started

  1. pip install -r requirements.txt

  2. Data. All the six benchmark datasets can be obtained from Google Drive or Tsinghua Cloud.

  3. Reproducibility. We provide the experiment scripts of all benchmarks under the folder ./scripts. You can reproduce the experiments results by:

bash ./scipts/ETTm.sh
bash ./scipts/ETTh.sh
bash ./scipts/ECL.sh
bash ./scipts/Exchange.sh
bash ./scipts/Traffic.sh
bash ./scipts/WTH.sh
bash ./scipts/ILI.sh

Experiments

Main Results

Multivariate results

arch

Univariate results

arch

Model Analysis

ILC vs. RC

arch

CFE vs. Masked self-attention, Isometric convolution

arch

Visualization

Visualization of forecasting results: The forecasting results from the test set of univariate datasets, Electricity and Traffic, are visualized in Figure.9 and Figure.10. The forecasting results from the test set of multivariate datasets, ETTm1 and ETTm2, are visualized in Figure.11 and Figure.12.

arch Figure 9: Univariate forecasting cases using the Electricity dataset with model MLGN. Input-length = 96, Prediction-length = (96, 192, 336, 720). arch Figure 10: Univariate forecasting cases using the Traffic dataset with model MLGN. Input-length = 96, Prediction-length = (96, 192, 336, 720). arch Figure 11: Multivariate forecasting cases using the ETTm1 dataset with model MLGN. Input-length = 96, Prediction-length = (96, 192, 336, 720). arch Figure 12: Multivariate forecasting cases using the ETTm2 dataset with model MLGN. Input-length = 96, Prediction-length = (96, 192, 336, 720).

Contact

If you have any questions, please contact [email protected]. Welcome to discuss together.

Citation

If you find this repo useful, please cite our paper

@article{mlgn,
  title={MLGN: Multi-Scale Local-Global Feature Learning Network for Long-term Series Forecasting},
  year={2023}
}

Acknowledgement

We appreciate the following github repos a lot for their valuable code base or datasets:

https://github.com/thuml/Autoformer

https://github.com/zhouhaoyi/Informer2020

https://github.com/zhouhaoyi/ETDataset

https://github.com/laiguokun/multivariate-time-series-data

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.