Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

BEHEMOTH dataset and benchmarks · SOTA2 Research

Research Datasets

BEHEMOTH

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

BEHEMOTH ToolBench (out-of-distribution)

26.82Success Rate

6

Graduate-level Reasoning

BEHEMOTH GPQA Diamond (out-of-distribution)

50Accuracy

6

Long-context Memory Evaluation

BEHEMOTH LongMemEval (out-of-distribution)

63.07Accuracy

6

Memory Extraction

BEHEMOTH in-distribution (test)

65.72Personalization (MA)

6

Popular tasks

Tool Use Graduate-Level Reasoning Long-context Memory Evaluation Memory Extraction

Follow for updates

Join SOTA2 Contact