A Study on Knowledge Distillation from Weak Teacher for Scaling Up Pre-trained Language Models

Hayeon Lee | Rui Hou | Jongpil Kim | Davis Liang | Sung Ju Hwang | Alexander Min |

Paper Details:

Month: July
Year: 2023
Location: Toronto, Canada
Venue: F | i | n | d | i | n | g | s | - | A | C | L |

Citations

URL

No Citations Yet

No URLs Found

Field Of Study