Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

CodeMMLU dataset and benchmarks · SOTA2 Research

Research Datasets

CodeMMLU

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Code Understanding

CodeMMLU

53.52Exact Match (EM)

28

Code Evaluation

CodeMMLU software principles

24.9Accuracy

12

Coding Reasoning

CodeMMLU

82.8Pass@4

6

Popular tasks

Coding Reasoning Code evaluation Code Understanding

Follow for updates

Join SOTA2 Contact