NLPExplorer
  • Papers
  • Venues
  • Authors
  • Authors Timeline
  • Field of Study
  • URLs
  • ACL N-gram Stats
  • TweeNLP
  • API
  • Team

MERA: A Comprehensive LLM Evaluation in Russian

Alena Fenogenova | Artem Chervyakov | Nikita Martynov | Anastasia Kozlova | Maria Tikhonova | Albina Akhmetgareeva | Anton Emelyanov | Denis Shevelev | Pavel Lebedev | Leonid Sinev | Ulyana Isaeva | Katerina Kolomeytseva | Daniil Moskovskiy | Elizaveta Goncharova | Nikita Savushkin | Polina Mikhailova | Anastasia Minaeva | Denis Dimitrov | Alexander Panchenko | Sergey Markov |

Paper Details:

Month: August
Year: 2024
Location: Bangkok, Thailand
Venue: ACL |

Citations

URL

No Citations Yet

  • https://mera.a-ai.ru/en
  • https://a-ai.ru/
  • https://github.com/google/BIG-bench
  • https://crfm.stanford.edu/helm/classic/latest
  • https://declare-lab.github.io/instruct-eval
  • https://openai.com/research/gpt-4
  • https://lmsys.org
  • https://github.com/kuk/rulm-sbs2
  • https://github.com/EleutherAI/lm-evaluation-
  • https://github.com/ai-forever/MERA
  • https://github.com/ai-forever/MERA/blob/v1.1.0/lm-
  • https://toloka.ai
  • https://elementary.activebc.ru
  • https://mera.a-ai.ru/en
  • https://mera.a-ai.ru/en/tasks
  • https://github.com/google-
  • https://github.com/google/BIG-
  • https://github.com/google/BIG-
  • https://plato.stanford.edu/entries/turing-test
  • https://cs.nyu.edu/faculty/davise/papers/Winograd-
  • https://github.com/google/BIG-bench/simple_arithmetic
  • https://www.jeopardy.com
  • https://github.com/google/BIG-
  • https://huggingface.co/datasets/openai_humaneval
  • https://huggingface.co/datasets/cais/mmlu
  • https://fipi.ru/ege
  • https://github.com/s-nlp/russe_detox_2022/dev.tsv
  • https://github.com/google/BIG-
  • https://fipi.ru/ege
  • https://russiansuperglue.com/leaderboard/2
  • https://www.nvidia.com/en-us/data-center/a100
  • https://doc.fipi.ru/ege/analiticheskie-i-metodicheskie-

Field Of Study