Graph neural networks (GNNs) are rapidly advancing progress in ML for complex graph data applications. I've composed this concise recipe (i.e., studysheet) dedicated to students who are lookin to learn and keep up-to-date with GNNs. It's non-exhaustive but it aims to get students familiar with the topic.

There are several introductory content to learn about GNNs. The following are some useful ones:

🔗 Foundations of GNNs (by Petar Veličković)

🔗 Gentle Introduction to GNNs (by Distill)

🔗 Understanding Convolutions on Graphs (by Distill)

🔗 Math Behind Graph Neural Networks (by Rishabh Anand)

🔗 Graph Convolutional Networks (by Thomas Kipf)

🔗Graph Neural Networks for Geometric Graphs - Chaitanya K. Joshi, Simon V. Mathis

Here are two fantastic survey papers on the topic to get a broader and concise picture of GNNs and recent progress:

🔗 Graph Neural Networks: A Review of Methods and Applications (Jie Zhou, Ganqu Cui, Shengding Hu, Zhengyan Zhang, Cheng Yang, Zhiyuan Liu, Lifeng Wang, Changcheng Li, Maosong Sun)

🔗 Graph Neural Networks: Methods, Applications, and Opportunities (Lilapati Waikhom, Ripon Patgiri)

🔗 A Comprehensive Survey on Graph Neural Networks (Zonghan Wu, Shirui Pan, Fengwen Chen, Guodong Long, Chengqi Zhang, Philip S. Yu)

After going through quick high-level introductory content, here are some great material to go deep:

🔗 Geometric Deep Learning (by Michael M. Bronstein, Joan Bruna, Taco Cohen, Petar Veličković)

🔗 Graph Representation Learning Book (by William Hamilton)

🔗 CS224W: ML with Graphs (by Jure Leskovec)

If you want to keep up-to-date with popular recent methods and paper implementations for GNNs, the Papers with Code community maintains this useful collection:

🐙 Graph Models by Papers with Code

If you are interested in benchmarks/leaderboards and graph datasets that evaluate GNNs, the Papers with Code community also maintains such content here:

🔗 Datasets by Papers with Code

🔗 Graph Benchmarks by Papers with Code

Here are a few useful tools to get started with GNNs:

🔥 PyTorch Geometric

🔗 Deep Graph Library

🦒 jraph

🟠 Spektral

I will be posting several tutorials on GNNs, here is the first of the series. More coming soon!

Introduction to GNNs with PyTorch Geometric

To get regular updates on new ML and NLP resources, follow me on Twitter.