NLPExplorer
Papers
Venues
Authors
Authors Timeline
Field of Study
URLs
ACL N-gram Stats
TweeNLP
API
Team
VE-KD: Vocabulary-Expansion Knowledge-Distillation for Training Smaller Domain-Specific Language Models
Pengju Gao
|
Tomohiro Yamasaki
|
Kazunori Imoto
|
Paper Details:
Month: November
Year: 2024
Location: Miami, Florida, USA
Venue:
F |
i |
n |
d |
i |
n |
g |
s |
- |
E |
M |
N |
L |
P |
Citations
URL
No Citations Yet
https://github.com/tensorflow/tensor2tensor
https://microsoft.github.io/BLURB/leaderboard.html
https://github.com/google-research/bert
https://github.com/pZvfkv3t8PA9vAc/VE-KD
https://huggingface.co/openai-community/gpt2
https://huggingface.co/google-t5/t5-small
Field Of Study