List your company

Research

Benchmarks

Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.

309,131 benchmarksPage 1247 of 12,366

Benchmarks

TaskDatasetDomainTrendResultsLast update
Personalization EditingUPQA balanced 100-samplellm chat instruction24Feb 26, 2026
General Capability Evaluation (Held-out Benchmarks)OlmoBaseEval LBPP BBH MMLU Pro MC Deepmind Math (HeldOut)llm chat instructionnlp24Feb 26, 2026
Jailbreak AttackClaude 3.5adversarial safety security24May 19, 2026
Mathematical ReasoningGSM-Symbolic (test)llm chat instructionnlp24Feb 26, 2026
Speech RecognitionLibriSpeech 960 clean (test)speech audio24May 29, 2026
Text-to-SpeechInstructTTSEval ZHspeech audio24Apr 10, 2026
Question AnsweringMerged QA HotpotQA, NarrativeQA, WikiHop (test)nlp24Feb 26, 2026
Question AnsweringHotpotQA (test)nlp24Feb 26, 2026
Mathematical ReasoningGSM8K (test)llm chat instructionnlp24Feb 26, 2026
Deep ResearchDeepResearch Bench official 100-task-subset 1.0miscellaneous24Feb 26, 2026
Financial AnalysisMCP-Universe Financial Analysisnlptabular time series24Feb 26, 2026
Repository ManagementMCP-Universe Repository Managementcode developer ai24Feb 26, 2026
Location NavigationMCP-Universe Location Navigationrobotics embodied ai24Feb 26, 2026
Tool ReasoningToolBench (G3)agents tool use24Feb 26, 2026
Tool ReasoningToolBench G2agents tool use24Feb 26, 2026
Tool ReasoningToolBench (G1)agents tool use24Feb 26, 2026
Deep SearchGAIA text-only (val)retrieval search ragagents tool use24Feb 26, 2026
Mathematical ReasoningMATH (test)llm chat instructionnlp24Feb 26, 2026
Mathematical ReasoningMATH (test)llm chat instructionnlp24Feb 26, 2026
Mathematical ReasoningGSM8K zero-shot (test)llm chat instructionnlp24Feb 26, 2026
Dialogue Memory AccuracyLongMemEval-S (N=500)llm chat instructionnlp24Apr 21, 2026
Question AnsweringStrQAnlp24Feb 26, 2026
Multi-Domain KnowledgeGPQAnlp24Feb 26, 2026
Multi-Domain KnowledgeMMLU-Pronlp24Feb 26, 2026
Math & LogicMUSRllm chat instructionnlp24Feb 26, 2026