A PyTorch implementation of Curvature Graph Neural Network

Graph neural networks (GNNs) have achieved great success in many graph-based tasks. Muchwork is dedicated to empowering GNNs with adaptive locality ability, which enables the mea-surement of the importance of neighboring nodes to the target node by a node-specific mecha-nism. However, the current node-specific mechanisms are deficient in distinguishing the impor-tance of nodes in the topology structure. We believe that the structural importance of neighboringnodes is closely related to their importance in aggregation. In this paper, we introduce discretegraph curvature (the Ricci curvature) to quantify the strength of the structural connection of pair-wise nodes. We propose Curvature Graph Neural Network (CGNN), which effectively improvesthe adaptive locality ability of GNNs by leveraging the structural properties of graph curvature.To improve the adaptability of curvature on various datasets, we explicitly transform curvatureinto the weights of neighboring nodes by the necessary Negative Curvature Processing Moduleand Curvature Normalization Module. Then, we conduct numerous experiments on various syn-thetic and real-world datasets. The experimental results on synthetic datasets show that CGNN effectively exploits the topology structure information, and that the performance is significantly improved. CGNN outperforms the baselines on 5 dense node classification benchmark datasets. This study deepens the understanding of how to utilize advanced topology information and assignthe importance of neighboring nodes from the perspective of graph curvature and encourages usto bridge the gap between graph theory and neural networks. This repository provides an implementation of Curvature Graph Neural Network as described in the paper:

Curvature Graph Neural Network

All of datasets is loaded and processed by Pytorch-Geometric. Note that the version of Pytorch-Geometric is 1.5.0, which has a slight difference with the latest version on loading these dataset.
The Ricci Curvature of these datasets is saved on data/Ricci. To compute curvature, please refer to the Python library GraphRicciCurvature.

Training the model is handled by the main.py script which provides the following command line arguments.

  --data_path        STRING    Path of saved processed data files.                  Required is False    Default is ./data.
  --dataset          STRING    Name of the datasets.                                Required is True.
  --NCTM             STRING    Type of Negative Curvature Transformation Module.    Required is True     Choices are ['linear', 'exp'].
  --CNM              STRING    Type of Curvature Normalization Module.              Required is True     Choices are ['symmetry-norm', '1-hop-norm', '2-hop-norm'].
  --d_hidden         INT       Dimension of the hidden node features.               Required is False    Default is 64.
  --epochs           INT       The maximum iterations of training.                  Required is False    Default is 200.
  --num_expriment    INT       The number of the repeating expriments.              Required is False    Default is 50.
  --early_stop       INT       Early stop.                                          Required is False    Default is 20.
  --dropout          FLOAT     Dropout.                                             Required is False    Default is 0.5.
  --lr               FLOAT     Learning rate.                                       Required is False    Default is 0.005.
  --weight_decay     FLOAT     Weight decay.                                        Required is False    Default is 0.0005.

The following commands learn the weights of a curvature graph neural network.

python main.py --dataset Cora --NCTM linear --CNM symmetry-norm

Another examples is that the following commands learn the weights of the curvature graph neural network with 2-hop normalization on Citeseer.

python main.py --dataset Citeseer --NCTM linear --CNM 2-hop-norm

If our repo is useful to you, please cite our published paper as follow:

Bibtex
@article{li2021cgnn,
    title={Curvature Graph Neural Network},
    author={Li, Haifeng and Cao, Jun and Zhu, Jiawei and Liu, Yu and Zhu, Qing and Wu, Guohua},
    journal={Information Sciences},
    DOI = {10.1016/j.ins.2021.12.077},
    year={2021},
    type = {Journal Article}
}
  
Endnote
%0 Journal Article
%A Li, Haifeng
%A Cao, Jun
%A Zhu, Jiawei
%A Liu, Yu
%A Zhu, Qing
%A Wu, Guohua
%D 2021
%T Curvature Graph Neural Network
%B Information Sciences
%R 10.1016/j.ins.2021.12.077
%! Curvature Graph Neural Network