NLPExplorer
Papers
Venues
Authors
Authors Timeline
Field of Study
URLs
ACL N-gram Stats
TweeNLP
API
Team
Baby Llama: knowledge distillation from an ensemble of teachers trained on a small dataset with no performance penalty
Inar Timiryasov
|
Jean-Loup Tastet
|
Paper Details:
Month: December
Year: 2023
Location: Singapore
Venue:
CoNLL |
Citations
URL
No Citations Yet
https://huggingface.co/timinar/baby-llama-58m
https://github.com/timinar/BabyLlama
https://github.com/
https://huggingface.co/babylm
https://github.com/karpathy/nanoGPT
https://github.com/davda54/sam
Field Of Study