List your company

ResearchFormerly WizWand

ClassEval

Benchmarks

TaskDatasetSOTA resultTrendResults

Code Generation

ClassEval

4.28Spd

33

Code Generation and Watermark Detection

ClassEval (test)

21Pass@5

14

Code Generation

ClassEval

27Pass@1 (Class-level)

9

Class-level Code Translation

ClassEval-T

28.4Functional Correctness

4