KD_Lib

A Pytorch Library to help extend all Knowledge Distillation works. I am the lead for this project. In future the library will help to benchmark for all the research works in this domain using minimalistic code.

Currently implemented works

• Distilling the Knowledge in a Neural Network
• Improved Knowledge Distillation via Teacher Assistant
• Relational Knowledge Distillation
• Distilling Knowledge from Noisy Teachers
• Paying More Attention To The Attention - Improving the Performance of CNNs via Attention Transfer