Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Mercury dataset and benchmarks · SOTA2 Research

Research Datasets

Mercury

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Code Efficiency

Mercury

83.6Beyond@1

29

Out-of-distribution AI-generated text detection

Mercury Out-of-distribution (OOD) 2 (test unseen domains)

95.7Legal Accuracy

16

Code Generation

Mercury (test)

90.3Pass Rate (Easy)

8

Black-box Vulnerability Detection

Mercury

22Vulnerabilities Found Count

4

Popular tasks

Code Generation Code Efficiency Black-box Vulnerability Detection Out-of-distribution AI-generated text detection

Follow for updates

Join SOTA2 Contact