发展趋势 

知识蒸馏代码库

OpenMMLab模型压缩工具MMRazor

GitHub - open-mmlab/mmrazor: OpenMMLab Model Compression Toolbox and Benchmark.

MMRazor is a model compression toolkit for model slimming and AutoML, which includes 4 mainstream technologies:

  • Neural Architecture Search (NAS)  神经架构搜索
  • Pruning 减枝
  • Knowledge Distillation (KD) 知识蒸馏
  • Quantization 量化

OpenMMLab模型转换与部署工具箱MMDeploy

把各种算法变成各种厂商支持的中间格式

GitHub - open-mmlab/mmdeploy: OpenMMLab Model Deployment Framework

12个SOTA知识蒸馏算法的Pytorch复现

GitHub - HobbitLong/RepDistiller: [ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methods

扩展阅读

 

 

Logo

技术共进,成长同行——讯飞AI开发者社区

更多推荐