List your company

ResearchFormerly WizWand

LiveCodeBench

Benchmarks

TaskDatasetSOTA resultTrendResults

Code Generation

LiveCodeBench (LCB)

83Accuracy

8

Code Generation

LiveCodeBench

80.97Pass@1

8

Code Generation

LiveCodeBench v6

61.82Mean@8

8

LiveCodeBench (LCB) v6

15.3Accuracy

8

Ag-LiveCodeBench-X 5.0 (derived)

7OCaml Pass@1

8

LiveCodeBench

46.7Accuracy

8

Code Generation

LiveCodeBench Overall 2025-02-01 – present

80.9Pass@1 Accuracy

8

Code Generation

LiveCodeBench Hard 2025-02-01 – present

63.9Pass@1

8

Code Generation

LiveCodeBench Medium 2025-02-01 – present

0.923Pass@1

8

Code Generation

LiveCodeBench Easy 2025-02-01 – present

100Pass@1

8

Code Generation

LiveCodeBench October 2024 to January 2025 (test)

46.1Pass@1

8

LiveCodeBench v4

28.71Pass@1

7

Code Generation

LiveCodeBench v6

58.86LCB.v6 Score

7

Code Generation

LiveCodeBench

61.92Mean@8

7

LiveCodeBench (train)

61.79Success Rate (SR)

7

Code Generation

LiveCodeBench 8/1/24-2/1/25 (test)

61.2Pass@1

7

Code generation

LiveCodeBench

57Score

6

Code Generation

LiveCodeBench v6

52.2Pass Ratio

6

Code Generation

LiveCodeBench (train)

19.63Metric m Score

6

Coding Reasoning

LiveCodeBench

73.5Medium Pass@1

6

Code Generation

LiveCodeBench

2.1Acceptance Length

6

Code Generation

LiveCodeBench

4.7Acceptance Length

6

LiveCodeBench v6

73.8Accuracy avg@32

6

Code Generation

LiveCodeBench

42.8Accuracy

6

Code Generation

LiveCodeBench

21.1Average@4 Score

6