Giter VIP home page Giter VIP logo

tl-dcrnn's Introduction

TL-DCRNN: Transfer Learning with Graph Neural Networks for Short-Term Highway Traffic Forecasting

TL-DCRN, a new transfer learning approach for DCRNN, where a single model trained on a highway network can be used to forecast traffic on unseen highway networks. Given a traffic network with a large amount of traffic data, our approach consists of partitioning the traffic network into a number of subgraphs and using a new training scheme that utilizes subgraphs to marginalize the location-specific information, thus learning the traffic as a function of network connectivity and temporal patterns alone. The resulting trained model can be used to forecast traffic on unseen networks. We demonstrate that TL-DCRN can learn from San Francisco regional traffic data and can forecast traffic on the Los Angeles region and vice versa.

Requirements

  • scipy>=0.19.0
  • numpy>=1.12.1
  • pandas>=0.19.2
  • tensorflow>=1.13.1
  • pyaml

Data Preparation

LA and SFO dataset is 'here'

Download the traffic data files for entire California 'speed.h5', adjacency matrix 'adj_mat.pkl' and distance between sensors 'distances.csv', and keep in the data/input_files/ folder.

# Generate TFrecord dataset for 64 graph partitions

python hdf_to_tfrecord.py --config_filename=input_files/tf_record_config.yaml

The script will generate a data/TFrecords/ folder with the train, test, and validation dataset for 64 partitions

Model Training

# Run the TL-DCRNN model

python dcrnn_train.py --config_filename=data/dcrnn_config_32transfer.yaml

The generated prediction of TL-DCRNN will be in data/results/

Citation

If you find this repository, e.g., the code and the datasets, useful in your research, please cite the following paper:

@inproceedings{mallick2021transfer,
  title={Transfer learning with graph neural networks for short-term highway traffic forecasting},
  author={Mallick, Tanwi and Balaprakash, Prasanna and Rask, Eric and Macfarlane, Jane},
  booktitle={2020 25th International Conference on Pattern Recognition (ICPR)},
  pages={10367--10374},
  year={2021},
  organization={IEEE}
}

tl-dcrnn's People

Contributors

tanwimallick avatar

Stargazers

Aobo Liang avatar Liu Yuanhao avatar HengZhang avatar Can Ozkan avatar  avatar  avatar Liyue-Chen avatar  avatar  avatar sunchongqi avatar zhuhaojia avatar yummy avatar  avatar Liz Liu avatar JingyanLI avatar Tong Nie avatar  avatar qingqinliu avatar Zilin Li avatar Mingxi Li avatar  avatar Élise Zhang avatar Sourish Bhattacharyya avatar Tianyi Li avatar  avatar Hang Hoo avatar  avatar cunzhu avatar  avatar  avatar Xingxin HE avatar Jean-Marc Alkazzi avatar  avatar Jákup Svøðstein avatar  avatar Lijun Sun avatar  avatar resuly avatar YC avatar 杨海宏 avatar

Watchers

 avatar  avatar

tl-dcrnn's Issues

Failed to download the PeMS speed dataset

Hi,

Currently I am following this amazing work and would like to reproduce the results that are presented in the paper. However, I found that it is difficult to download the full dataset speed.h5 from the shared link of box.com. When the size of the file reached about 6GB, it showed message like "timeout and fail to download". I repeated several times and still failed to download the full dataset. Is there any other way to get the dataset beyond box.com? Thank you!

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.