Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

CRUX dataset and benchmarks · SOTA2 Research

Research Datasets

CRUX

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Code Understanding

CRUX (test)

69.3Pass@1

30

CRUX

55.08Accuracy @5

27

CRUX

87.37Accuracy

26

CRUX official (test)

51.1Pass@1 Accuracy

20

Code Generation

CRUX

57.2Score (%)

18

Nugget-based retrieval

CRUX Multi-News

38Precision@10

14

Nugget-based retrieval

CRUX DUC04

73.8Precision@10

14

CRUX

25.75CRUX Score

6

Popular tasks

Code Reasoning Nugget-based retrieval Code Generation Code Code Understanding

Follow for updates

Join SOTA2 Contact