A curated list of awesome Self-Supervised Learning resources. Inspired by awesome-deep-vision, awesome-adversarial-machine-learning, awesome-deep-learning-papers, and awesome-architecture-search

Self-Supervised Learning has become an exciting direction in Computer Vision, Machine Learning, and Robotics community. These are some of the awesome resources!

Please help contribute this list by contacting me or add pull request

Markdown format:

- Paper Name [[pdf]](link) [[code]](link)
  - Author 1, Author 2 and Author 3. *Conference'Year*

• Computer Vision
  • Image Representation Learning
  • Video Representation Learning
  • Geometry
• Machine Learning
  • Reinforcement Learning
• Robotics
• Talks

• Unsupervised Visual Representation Learning by Context Prediction. [pdf] [code]

  • Doersch, Carl and Gupta, Abhinav and Efros, Alexei A. ICCV 2015

• Unsupervised Learning of Visual Representations using Videos. [pdf] [code]

  • Wang, Xiaolong and Gupta, Abhinav. ICCV 2015

• Learning to See by Moving. [pdf] [code]

  • Agrawal, Pulkit and Carreira, Joao and Malik, Jitendra. ICCV 2015

• Learning image representations tied to egomotion. [pdf] [code]

  • Jayaraman, Dinesh and Grauman, Kristen. ICCV 2015

• Slow and steady feature analysis: higher order temporal coherence in video. [pdf]

  • Jayaraman, Dinesh and Grauman, Kristen. CVPR 2016

• Context Encoders: Feature Learning by Inpainting. [pdf] [code]

  • Pathak, Deepak and Krahenbuhl, Philipp and Donahue, Jeff and Darrell, Trevor and Efros, Alexei A. CVPR 2016

• Colorful Image Colorization. [pdf] [code]

  • Zhang, Richard and Isola, Phillip and Efros, Alexei A. ECCV 2016

• Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzles. [pdf] [code]

  • Noroozi, Mehdi and Favaro, Paolo. ECCV 2016

• Ambient Sound Provides Supervision for Visual Learning. [pdf] [code]

  • Owens, Andrew and Wu, Jiajun and McDermott, Josh and Freeman, William and Torralba, Antonio. ECCV 2016

• Learning Representations for Automatic Colorization. [pdf] [code]

  • Larsson, Gustav and Maire, Michael and Shakhnarovich, Gregory. ECCV 2016

• Adversarial Feature Learning. [pdf] [code]

  • Donahue, Jeff and Krahenbuhl, Philipp and Darrell, Trevor. ICLR 2017

• Self-supervised learning of visual features through embedding images into text topic spaces. [pdf] [code]

  • L. Gomez* and Y. Patel* and M. Rusiñol and D. Karatzas and C.V. Jawahar. CVPR 2017

• Split-Brain Autoencoders: Unsupervised Learning by Cross-Channel Prediction. [pdf] [code]

  • Zhang, Richard and Isola, Phillip and Efros, Alexei A. CVPR 2017

• Learning Features by Watching Objects Move. [pdf] [code]

  • Pathak, Deepak and Girshick, Ross and Dollar, Piotr and Darrell, Trevor and Hariharan, Bharath. CVPR 2017

• Colorization as a Proxy Task for Visual Understanding. [pdf] [code]

  • Larsson, Gustav and Maire, Michael and Shakhnarovich, Gregory. CVPR 2017

• Unsupervised Learning by Predicting Noise. [pdf] [code]

  • Bojanowski, Piotr and Joulin, Armand. ICML 2017

• Multi-task Self-Supervised Visual Learning. [pdf]

  • Doersch, Carl and Zisserman, Andrew. ICCV 2017

• Representation Learning by Learning to Count. [pdf]

  • Noroozi, Mehdi and Pirsiavash, Hamed and Favaro, Paolo. ICCV 2017

• Transitive Invariance for Self-supervised Visual Representation Learning. [pdf]

  • Wang, Xiaolong and He, Kaiming and Gupta, Abhinav. ICCV 2017

• Look, Listen and Learn. [pdf]

  • Relja, Arandjelovic and Zisserman, Andrew. ICCV 2017

• Unsupervised Representation Learning by Predicting Image Rotations. [pdf]

  • Spyros Gidaris and Praveer Singh and Nikos Komodakis. ICLR 2018

• Improvements to context based self-supervised learning. [pdf]

  • Terrell Mundhenk and Daniel Ho and Barry Chen. CVPR 2018

• Self-Supervised Feature Learning by Learning to Spot Artifacts.

  • Simon Jenni and Universität Bern and Paolo Favaro. CVPR 2018

• Boosting Self-Supervised Learning via Knowledge Transfer. [pdf]

  • Mehdi Noroozi and Ananth Vinjimoor and Paolo Favaro and Hamed Pirsiavash. CVPR 2018

• Cross-domain Self-supervised Multi-task Feature Learning Using Synthetic Imagery. [pdf]

  • Zhongzheng Ren and Yong Jae Lee. CVPR 2018

• Shuffle and Learn: Unsupervised Learning using Temporal Order Verification. [pdf] [code]

  • Ishan Misra, C. Lawrence Zitnick and Martial Hebert. ECCV 2016

• Self-Supervised Video Representation Learning With Odd-One-Out Networks. [pdf]

  • Basura Fernando and Hakan Bilen and Efstratios Gavves and Stephen Gould. CVPR 2017

• Geometry Guided Convolutional Neural Networks for Self-Supervised Video Representation Learning. [pdf]

  • Chuang Gan and Boqing Gong and Kun Liu and Hao Su and Leonidas J. Guibas. CVPR 2018

• Self-Supervised Depth Learning for Urban Scene Understanding. [pdf]
  • Huaizu Jiang and Erik Learned-Miller and Gustav Larsson and Michael Maire and Greg Shakhnarovich. Arxiv 2017

• Curiosity-driven Exploration by Self-supervised Prediction. [pdf] [code]

  • Deepak Pathak, Pulkit Agrawal, Alexei A. Efros, and Trevor Darrell. ICML 2017

• coming soon...

• The Curious Robot: Learning Visual Representations via Physical Interactions. [pdf]

  • Lerrel Pinto and Dhiraj Gandhi and Yuanfeng Han and Yong-Lae Park and Abhinav Gupta. ECCV 2016

• Time-Contrastive Networks: Self-Supervised Learning from Video. [pdf] [Project]

  • Pierre Sermanet and Corey Lynch and Yevgen Chebotar and Jasmine Hsu and Eric Jang and Stefan Schaal and Sergey Levine. ICRA 2018

• Supersizing Self-Supervision: Learning Perception and Action without Human Supervision. Abhinav Gupta (CMU) [link]

To the extent possible under law, Zhongzheng Ren has waived all copyright and related or neighboring rights to this work.