List your company

ResearchFormerly WizWand

CodeMMLU

Benchmarks

TaskDatasetSOTA resultTrendResults

Code Understanding

CodeMMLU

53.52Exact Match (EM)

28

Code Evaluation

CodeMMLU software principles

24.9Accuracy

12

Coding Reasoning

CodeMMLU

82.8Pass@4

6