Awesome works and resources relevant to 360 vision. Suggestions or pull requests are welcome. Inspired by awesome-deep-vision, awesome-adversarial-machine-learning, awesome-deep-learning-papers, and awesome-architecture-search.

• Paper
  • Field of View Piloting, Saliency View Detection
  • 6DOF, 3D, SLAM, Navigation
  • Stabilization
  • Natural Language
  • Spherical DNN
  • Human Interaction
  • Multi-camera
• Dataset
• Media

• A Deep Ranking Model for Spatio-Temporal Highlight Detection from a 360 Video [PDF]
  • Youngjae Yu et al., AAAI, 2018.
• SaltiNet: Scan-path Prediction on 360 Degree Images using Saliency Volumes [PDF] [Project]
  • Assens M et al., ICCVW, 2017.
• SalNet360: Saliency Maps for omni-directional images with CNN [PDF]
  • Rafael Monroy et al., arXiv, 2017.
• Deep 360 Pilot: Learning a Deep Agent for Piloting through 360° Sports Video [PDF] [Project]
  • Hou-Ning Hu et al., CVPR, 2017.
• Making 360° Video Watchable in 2D: Learning Videography for Click Free Viewing [PDF] [Project]
  • Yu-Chuan Su et al., CVPR, 2017.
• Semantic-driven Generation of Hyperlapse from 360° Video [PDF] [Project]
  • Wei-Sheng Lai et al., TVCG, 2017.
• Viewport-aware adaptive 360° video streaming using tiles for virtual reality [PDF]
  • Cagri Ozcinar et al., ICIP, 2017.
• Visual Attention in Omnidirectional Video for Virtual Reality Applications [PDF] [Project]
  • Cagri Ozcinar and Aljosa Smolic, QoMEX, 2018.
• Look around you: Saliency maps for omnidirectional images in VR applications [PDF]
  • Ana De Abreu et al., QoMEX, 2017.
• Viewport-adaptive navigable 360-degree video delivery [PDF]
  • Xavier Corbillon et al., ICC, 2017.
• Pano2vid: Automatic cinematography for watching 360° videos [PDF] [Project]
  • Yu-Chuan Su et al., ACCV, 2016.

• Omnidirectional CNN for Visual Place Recognition and Navigation [PDF]
  • Tsun-Hsuan Wang et al. arXiv, 2018.
• Structure-From-Motion in Spherical Video Usingthe von Mises-Fisher Distribution [PDF]
  • HaoGua et al., TIP, 2017.
• 6-DOF VR videos with a single 360-camera [PDF]
  • Jingwei Huang et al., IEEE VR, 2017.
• Depth augmented stereo panorama for cinematic virtual reality with head-motion parallax [PDF]
  • Jayant Thatte et al., ICME, 2016.
• 3D reconstruction of structures using spherical cameras with small motion [PDF]
  • Sarthak Pathak et al., ICCAS, 2016.
• Large-scale direct slam for omnidirectional cameras [PDF]
  • David Caruso et al., IROS, 2015.
• Omnidirectional 3D reconstruction in augmented Manhattan worlds [PDF]
  • Miriam Sch ̈onbein et al., IROS, 2014.
• Moving object detection, tracking and following using an omnidirectional camera on a mobile robot [PDF]
  • Ivan Markovic et al., ICRA, 2014.
• Structure from Motion using full spherical panoramic cameras [PDF]
  • Alain Pagani et al., ICCVW, 2011.

• 360° video stabilization [PDF]
  • Johannes Kopf et al., TOG, 2016

• Self-view Grounding Given a Narrated 360 Video [PDF]
  • Shih-Han Chou et al., AAAI, 2017.

• Spherical CNNs [PDF]
  • Taco S. Cohen et al., ICLR, 2018.
• Learning Spherical Convolution for Fast Features from 360° Imagery [PDF]
  • Yu-Chuan Su et al., NIPS, 2017.

• Tell Me Where to Look: Investigating Ways for Assisting Focus in 360° Video [PDF] [Project]
  • Yen-Chen Lin et al., CHI, 2017.
• Outside-In: Visualizing Out-of-Sight Regions-of-Interest in a 360 Video Using Spatial Picture-in-Picture Previews [PDF]
  • Yung-Ta Lin et al., UIST, 2017.

• A Multi-View Stereo Benchmark with High-Resolution Images and Multi-Camera Videos in Unstructured Scenes [PDF]
  • T. Schöps et al., CVPR, 2017.
• 3D Visual Perception for Self-Driving Cars using a Multi-Camera System: Calibration, Mapping, Localization, and Obstacle Detection [PDF]
  • C. Häne et al., IMAVIS, 2017.

• Visual Attention in Omnidirectional Video for Virtual Reality Applications [Website]
• synthia-dataset [Website]
  • 8 RGB cameras forming a binocular 360º camera, 8 depth sensors -> RGB & Depth in 360º
  • 2018
• SALIENT 360! [Website]
  • A Dataset of Head and Eye Movements for 360 Degree Images, Rai et al., MMSys, 2017.
• 360-Degree Videos Head Movements Dataset [Website]
  • 360-Degree Video Head Movement Dataset, Corbillon et al., MMSys, 2017.
• SUN360 [Website]
  • Recognizing Scene Viewpoint using Panoramic Place Representation, Xiao et al., CVPR, 2012.

• facebook 360 [Website]
• facebook cubemap [Website]
• facebook 360 heatmap [Website]
• youtube 360 heatmap [Website]