List your company

Research

Benchmarks

Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.

309,131 benchmarksPage 1921 of 12,366

Benchmarks

TaskDatasetDomainTrendResultsLast update
Multi-input ciphertext multiplicationMulti-input ciphertext multiplication hardware_complexity L=K=24, N=2^16, w=64miscellaneous18Feb 26, 2026
2D LocalizationIndoor lab environment (5m x 5m) 5 locations v1 (test)computer vision18Feb 26, 2026
Jailbreak Attack EvaluationHarmBench (400 random samples)adversarial safety security18Feb 26, 2026
Mobile GUI AutomationPrivScreenagents tool userobotics embodied ai18Feb 26, 2026
Question AnsweringHotpotQA (test)nlp18Feb 26, 2026
Natural Language UnderstandingZero-shot Downstream Benchmarks (BoolQ, ARC-E, ARC-C, HellaSwag)nlp18Feb 26, 2026
Web ResearchXbench DeepSearchagents tool useretrieval search rag18Feb 26, 2026
Language ModelingFineWeb-Edu 500M-token (val)nlp18Feb 26, 2026
LLM InferenceToolBenchllm chat instruction18Feb 26, 2026
LLM InferenceMergellm chat instruction18Feb 26, 2026
Authorship segmentationMAS (entire corpus)nlp18Feb 26, 2026
Attribution FaithfulnessAGNewscomputer vision18Feb 26, 2026
Attribution FaithfulnessSent140computer vision18Feb 26, 2026
Language Modeling and Question AnsweringShort-context task suite (WikiText, LAMBADA, TriviaQA, PIQA, HellaSwag, WinoGrande, ARC-Easy, GPQA, Social IQA, OpenBookQA, SciQ) (test)nlpllm chat instruction18Feb 26, 2026
Argumentative Fallacy ClassificationArgumentative Fallacy Classification (AFC)nlp18Feb 26, 2026
Decision CorrectnessHMDA (test)tabular time series18Feb 26, 2026
Process VerificationProcessBench Without Standard Answersnlp18Feb 26, 2026
Process VerificationProcessBench With Standard Answersnlp18Feb 26, 2026
SummarizationRAGTruth summarization (test)nlp18Feb 26, 2026
Zero-shot NLP EvaluationAggregatenlp18Feb 26, 2026
Commonsense ReasoningCOMMnlp18Feb 26, 2026
Language ModelingNLP Standard Suitenlp18Feb 26, 2026
Scientific ReasoningGPQA Diamondnlp18Feb 26, 2026
Mathematical ReasoningAIME'25llm chat instructionnlp18Feb 26, 2026
Mathematical ReasoningAIME'24llm chat instructionnlp18Feb 26, 2026