List your company

ResearchFormerly WizWand

LiveCodeBench

Benchmarks

TaskDatasetSOTA resultTrendResults

Code Generation

LiveCodeBench

3.52Speedup

24

Code generation

LiveCodeBench Jan-Apr 2025

47.25Accuracy (pass@1)

24

Code Generation

LiveCodeBench (LCB)

99.1Accuracy

24

Code Generation

LiveCodeBench Medium

96.79Accuracy

23

LiveCodeBench

79Task Accuracy

23

Code Generation

LiveCodeBench v1 (test)

34.9Accuracy

23

Code Generation

LiveCodeBench

10.28Mean Acceptance Length (τ)

22

Competitive Programming

LiveCodeBench v5

82.8Score

22

Code Generation

LiveCodeBench

46.7Signal Score

21

Competitive Programming

LiveCodeBench

65.65Accuracy

21

Code Generation

LiveCodeBench (LCB)

73.1FUNC Score

21

Code Generation

LiveCodeBench (LCB)

20.79LCB Score

21

Code Generation

LiveCodeBench

87.24Overall Accuracy

21

LiveCodeBench

2.81Speedup

21

Code Generation

LiveCodeBench v6

62.9Pass@4

20

Code Generation

LiveCodeBench v5 (test)

72.1Pass@1

20

Code Generation

LiveCodeBench v6 (test)

21.1Avg@4

20

Competitive Programming

LiveCodeBench Pro 2025Q2

71.9Pass@1

19

Code Generation

LiveCodeBench

95.9Easy Score

19

Competitive Programming

LiveCodeBench 2408 - 2505 v6

80.2Score

19

LiveCodeBench

69.11Pass@1

19

Code Generation

LiveCodeBench v5 (held-out)

46.8Pass@1

18

Code Generation

LiveCodeBench Aug 2024–Feb 2025 v5

98.6Easy Success Rate

18

LiveCodeBench

3,413Throughput

18

LiveCodeBench 1.0 (test)

47.2Accuracy

18