Research
Benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
309,131 benchmarksPage 1491 of 12,366
Benchmarks
| Task | Dataset | Domain | Trend | Results | Last update |
|---|---|---|---|---|---|
| LLM Inference | MBPP | 21 | Feb 26, 2026 | ||
| LLM Inference | Math500 | 21 | Feb 26, 2026 | ||
| LLM Inference | LiveCodeBench | 21 | Feb 26, 2026 | ||
| Language Understanding | MMLU o=1 (Semantic-level) | 21 | Feb 26, 2026 | ||
| Question Answering | TruthfulQA o=1 Domain-level split | 21 | Feb 26, 2026 | ||
| Question Answering | TruthfulQA o=1 Semantic-level | 21 | Feb 26, 2026 | ||
| Question Answering | TruthfulQA o=1 (Exact split) | 21 | Feb 26, 2026 | ||
| Multitask Language Understanding | MMLU Semantic-level split, o=3 | 21 | Feb 26, 2026 | ||
| Question Answering | TruthfulQA Domain-level split, o=3 | 21 | Feb 26, 2026 | ||
| Question Answering | TruthfulQA Semantic-level split o=3 | 21 | Feb 26, 2026 | ||
| Question Answering | TruthfulQA Exact split, o=3 | 21 | Feb 26, 2026 | ||
| Automatic Speech Recognition | LibriSpeech (LS) clean | 21 | Jun 11, 2026 | ||
| Automatic Speech Recognition | WenetSpeech Chuan hard | 21 | Apr 21, 2026 | ||
| Automatic Speech Recognition | WenetSpeech Chuan easy | 21 | Apr 21, 2026 | ||
| Document Retrieval | BEIR 15 | 21 | Feb 26, 2026 | ||
| Code generation | HEval | 21 | Jun 17, 2026 | ||
| General Task Performance | Macro-average (Mathematics, Multi-Hop QA, Code Generation) | 21 | Feb 26, 2026 | ||
| Code Generation | Code Generation | 21 | Feb 26, 2026 | ||
| Hallucination evaluation | MMLU-Pro Law (test) | 21 | Feb 26, 2026 | ||
| Jailbreak Defense | JailbreakBench and AdvBench | 21 | Feb 26, 2026 | ||
| Scientific Reasoning | GPQA Diamond | 21 | Feb 26, 2026 | ||
| Code Question Answering | Python Code Question Answering downstream | 21 | Feb 26, 2026 | ||
| Code Completion | Python Code Completion downstream | 21 | Feb 26, 2026 | ||
| Knowledge Editing | EVK-Bench | 21 | Feb 26, 2026 | ||
| Optimization Modeling | ComplexOR | 21 | May 29, 2026 |