List your company

ResearchFormerly WizWand

LiveCodeBench

Benchmarks

TaskDatasetSOTA resultTrendResults

LiveCodeBench v1-v6 cumul

89.9Score

4

LiveCodeBench February-May 2025 (evaluation window)

36.6Accuracy

4

Code Generation

LiveCodeBench

46.18Pass@1

3

Code generation

LiveCodeBench

54Pass Rate

3

Multi-agent Selection (Pairwise Resolution)

LiveCodeBench (test)

89.5Pairwise Resolution

3

Code Generation

LiveCodeBench v6

24.57Score

3

LiveCodeBench (test)

4.63Accuracy

3

LiveCodeBench 24.08-25.01

63.8Pass Rate

3

LiveCodeBench

28.7Pass@1

3

Code Generation

LiveCodeBench (LCB)

9.54TPS (Tokens/s)

3

Code generation

LiveCodeBench

36.8LCB Avg@16

3

LiveCodeBench hard v2

26.1Pass Rate

3

LiveCodeBench medium v2

63.3Pass Rate

3

LiveCodeBench easy v2

89Pass Rate

3

LiveCodeBench 2024-07↔2024-12 v5

88Pass@1

3

LiveCodeBench 2023.05-2025.04 v6

42.6Accuracy

3

Competitive Programming

LiveCodeBench v2

88.1Score

3

LiveCodeBench 1-shot v6

31.94Accuracy

3

LiveCodeBench

0.813Reward

2

LLM hierarchy attribution

LiveCodeBench (all 880 problems)

0.98Kendall Tau

2

Code Generation

LiveCodeBench

32.07Pass@k

2

Algorithmic Problem Solving

LiveCodeBench Pro

10Acceptance Rate

2

Code Generation

LiveCodeBench Pro (2025Q2)

8.98AC Rate

2

Code Generation

LiveCodeBench Pro 2025Q1

9.64AC Rate

2

Code Generation

LiveCodeBench Pro (2020Q4)

8.7Acceptance Rate (AC)

2