List your company

ResearchFormerly WizWand

xCodeEval

Benchmarks

TaskDatasetSOTA resultTrendResults

Code Generation

xCodeEval

81.13Pass@1

36

Code Generation

xCodeEval (sample 500)

0.831Accuracy (Easy)

17

Code Generation

xCodeEval Rust

23.6Pass@1

3

Code Generation

xCodeEval C

24.5Pass@1

3

Code Generation

xCodeEval Python

27.4Pass@1

3