NLPExplorer
Papers
Venues
Authors
Authors Timeline
Field of Study
URLs
ACL N-gram Stats
TweeNLP
API
Team
Efficient Training of Language Models with Compact and Consistent Next Token Distributions
Ashutosh Sathe
|
Sunita Sarawagi
|
Paper Details:
Month: August
Year: 2024
Location: Bangkok, Thailand and virtual meeting
Venue:
F |
i |
n |
d |
i |
n |
g |
s |
- |
A |
C |
L |
Citations
URL
No Citations Yet
https://github.com/ashutoshbsathe/CoCoNTs
https://docs.python.org/3/library/collections.html#collections
https://docs.python.org/3/library/pickle.html
https://huggingface.co/gpt2
https://huggingface.co/EleutherAI/gpt-neo-125m
https://huggingface.co/facebook/opt-125m
https://huggingface.co/facebook/opt-1.3B
https://github.com/babylm/evaluation-pipeline
https://github.com/pytorch/xla/issues/898
https://github.com/
https://pytorch.org/docs/stable/generated/torch.scatter.html
Field Of Study