Are Intermediate Layers and Labels Really Necessary? A General Language Model Distillation Method

Shicheng Tan | Weng Lam Tam | Yuanchun Wang | Wenwen Gong | Shu Zhao | Peng Zhang | Jie Tang |

Paper Details:

Month: July
Year: 2023
Location: Toronto, Canada
Venue: F | i | n | d | i | n | g | s | - | A | C | L |

Citations

URL

No Citations Yet

Field Of Study