List your company

Research

Benchmarks

Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.

309,131 benchmarksPage 1926 of 12,366

Benchmarks

TaskDatasetDomainTrendResultsLast update
Compositional GeneralizationEvaluation Dataset (Unseen Average)nlp18Feb 26, 2026
Compositional GeneralizationEvaluation Dataset Seen Averagenlp18Feb 26, 2026
Compositional GeneralizationEvaluation Dataset Unseen (Fold 3)nlp18Feb 26, 2026
Compositional GeneralizationEvaluation Dataset (Fold 3 Seen)nlp18Feb 26, 2026
Compositional GeneralizationEvaluation Dataset Unseen (Fold 2)nlp18Feb 26, 2026
Compositional GeneralizationEvaluation Dataset (Fold 2 Seen)nlp18Feb 26, 2026
Compositional GeneralizationEvaluation Dataset Unseen (Fold 1)nlp18Feb 26, 2026
Compositional GeneralizationEvaluation Dataset (Fold 1 Seen)nlp18Feb 26, 2026
Compositional GeneralizationEvaluation Dataset (Full)nlp18Feb 26, 2026
Question AnsweringPubMedQAnlp18Feb 26, 2026
Instruction followingGeneral Domain AlpacaEval Arena-Hard LLaMA3-8B (10% selection)llm chat instruction18Feb 26, 2026
Math problem solvingMath Domain (AIME24, Math-OAI, Minerva, Olympiad, ACM23) Qwen2.5-7B (10% selection)llm chat instructionnlp18Feb 26, 2026
Code GenerationCode Domain HumanEval, HumanEval+, MBPP, MBPP+, Bigcode (test)code developer ai18Feb 26, 2026
Molecular CaptioningMolReasoner original (test)bio medicalnlp18Feb 26, 2026
Speech ReconstructionSalmon Sentiment Consistency emotional 2025b (OOD)speech audio18Feb 26, 2026
Video Preference EvaluationShareGPT-Videovideo generation editingllm chat instruction18Feb 26, 2026
Mathematical ReasoningGSM8kllm chat instructionnlp18Feb 26, 2026
Code GenerationMBPPcode developer ai18Feb 26, 2026
Reward ModelingPPE-IFEvalllm chat instruction18Feb 26, 2026
Prompt ClassificationSEA-SafeguardBench Englishadversarial safety securityllm chat instruction18Feb 26, 2026
Multi-Hop Question AnsweringHotpotQA (test val)nlpretrieval search rag18Jul 8, 2026
Factual Knowledge EvaluationWikidata knowledge infusionllm chat instructionnlp18Feb 26, 2026
Mathematical ReasoningAIME 24llm chat instructionnlp18Feb 26, 2026
Mathematical ReasoningAMC23llm chat instructionnlp18Feb 26, 2026
Mathematical ReasoningMATHllm chat instructionnlp18Feb 26, 2026