This project is a collection of the open source pytorch code for knowledge distillation, especially for the perception tasks, including semantic segmentation, depth estimation, object detection and instance segmentation.

• Structured Knowledge Distillation for Semantic Segmentation, CVPR2019 [paper] [code]
• Intra-class Feature Variation Distillation for Semantic Segmentation, ECCV2020 [paper] [code]
• Channel-wise Knowledge Distillation for Dense Prediction, ICCV2021 [paper] [code]
• Knowledge Distillation based on MMsegmentation [code]

• Knowledge Distillation based on MMdetection [code]
• Knowledge Distillation based on Adet [code]

• 2021.08.20 Release the code for channel-wise distillation for semantic segmentation

We are integrating more of our work and other great studies into this project.

• Distillation on FCOS
• Distillation on CondInst

To contribute, PR is appreciated and suggestions are welcome to discuss with.