NLPExplorer
Papers
Venues
Authors
Authors Timeline
Field of Study
URLs
ACL N-gram Stats
TweeNLP
API
Team
Do All Languages Cost the Same? Tokenization in the Era of Commercial Language Models
Orevaoghene Ahia
|
Sachin Kumar
|
Hila Gonen
|
Jungo Kasai
|
David Mortensen
|
Noah Smith
|
Yulia Tsvetkov
|
Paper Details:
Month: December
Year: 2023
Location: Singapore
Venue:
EMNLP |
Citations
URL
No Citations Yet
https://github.com/orevaahia/l
https://openai.com/p
https://platform.openai.com/tokenizer
https://help.openai.com/en/articles/674236
https://huggingface.co/docs/api-inference/q
https://github.com/openai/ti
https://huggingface.co/pricing#endpoints
https://help.opena
Field Of Study