• Efficient Transformer Knowledge Distillation: A Performance Review https://arxiv.org/abs/2311.13657 5 comments 7/12/2023
• CoRF: Colorizing Radiance Fields Using Knowledge Distillation https://arxiv.org/abs/2309.07668 4 comments 24/9/2023
• Distilling knowledge from neural networks to build smaller and faster models https://blog.floydhub.com/knowledge-distillation/ 16 comments 15/11/2019

• [R] Does Knowledge Distillation Really Work? https://arxiv.org/abs/2106.05945 7 comments 20/9/2021 machinelearning
• [R] Simon Says: Evaluating and Mitigating Bias in Pruned Neural Networks with Knowledge Distillation https://arxiv.org/abs/2106.07849 3 comments 27/7/2021 machinelearning
• [R] Knowledge distillation: A good teacher is patient and consistent https://arxiv.org/abs/2106.05237 2 comments 10/6/2021 machinelearning
• [R][P] distillKitPlus: High Performent Knowledge Distillation for LLMs https://github.com/agokrani/distillkitplus 2 comments 7/1/2025 machinelearning