Shypd.aiThe largest open index of AI toolsKnowledge-Distillation-Zoo is an Open Source research tool that provides PyTorch implementations of various Knowledge Distillation (KD) methods. It serves as a reference for basic knowledge distillation and transfer techniques.
Trending
About
Knowledge-Distillation-Zoo is an open-source repository offering PyTorch implementations of numerous Knowledge Distillation (KD) methods. It is designed as a simple reference, primarily focusing on fundamental knowledge distillation and transfer techniques rather than advanced variations like step-by-step training or data-free distillation. The repository includes implementations for methods such as Logits mimic learning, Attention Transfer, Fitnet, Relational Knowledge Distillation, and Deep Mutual Learning. It supports datasets like CIFAR10 and CIFAR100, and networks such as Resnet-20 and Resnet-110. Researchers and developers can use this tool to explore and compare different KD approaches, with provided training scripts and detailed notes on implementation differences from original papers.
Capabilities
Pricing & Plans
Open Source · Free
Free
FAQs
Trending
