Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Code Synthesis research benchmarks · SOTA2 Research

Code Synthesis

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

64.59Accuracy

12

Mar 9, 2026

81.7pass@1

11

May 12, 2026

Ag-LiveCodeBench-X 5.0 (derived)

Llama 3.3 70B Ins

7OCaml Pass@1

8

Mar 4, 2026

81.2Pass@1

6

Apr 21, 2026

68Success Rate (Lua)

5

Mar 4, 2026

HumanEval-Hard (100-item)

Uncoded single call

75.7Baseline Score

1

May 12, 2026

Popular datasets

HumanEval MBPP LiveCodeBench MultiPL-E

Follow for updates

Join SOTA2 Contact