research
∙
08/13/2023
Token-Scaled Logit Distillation for Ternary Weight Generative Language Models
Generative Language Models (GLMs) have shown impressive performance in t...
share
research
∙
02/03/2023
Revisiting Intermediate Layer Distillation for Compressing Language Models: An Overfitting Perspective
Knowledge distillation (KD) is a highly promising method for mitigating ...
research
∙
11/20/2022
