Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

LiveCodeBench dataset and benchmarks – Page 7 · SOTA2 Research

Research Datasets

LiveCodeBench

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Code Generation

LiveCodeBench (LCB)

83Accuracy

8

Code Generation

LiveCodeBench

80.97Pass@1

8

Code Generation

LiveCodeBench v6

61.82Mean@8

8

LiveCodeBench (LCB) v6

15.3Accuracy

8

Ag-LiveCodeBench-X 5.0 (derived)

7OCaml Pass@1

8

LiveCodeBench

46.7Accuracy

8

Code Generation

LiveCodeBench Overall 2025-02-01 – present

80.9Pass@1 Accuracy

8

Code Generation

LiveCodeBench Hard 2025-02-01 – present

63.9Pass@1

8

Code Generation

LiveCodeBench Medium 2025-02-01 – present

0.923Pass@1

8

Code Generation

LiveCodeBench Easy 2025-02-01 – present

100Pass@1

8

Code Generation

LiveCodeBench October 2024 to January 2025 (test)

46.1Pass@1

8

LiveCodeBench v4

28.71Pass@1

7

Code Generation

LiveCodeBench v6

58.86LCB.v6 Score

7

Code Generation

LiveCodeBench

61.92Mean@8

7

LiveCodeBench (train)

61.79Success Rate (SR)

7

Code Generation

LiveCodeBench 8/1/24-2/1/25 (test)

61.2Pass@1

7

Code generation

LiveCodeBench

57Score

6

Code Generation

LiveCodeBench v6

52.2Pass Ratio

6

Code Generation

LiveCodeBench (train)

19.63Metric m Score

6

Coding Reasoning

LiveCodeBench

73.5Medium Pass@1

6

Code Generation

LiveCodeBench

2.1Acceptance Length

6

Code Generation

LiveCodeBench

4.7Acceptance Length

6

LiveCodeBench v6

73.8Accuracy avg@32

6

Code Generation

LiveCodeBench

42.8Accuracy

6

Code Generation

LiveCodeBench

21.1Average@4 Score

6

Page 7 of 11

Popular tasks

Code Generation Coding Competitive Programming Code Reasoning Code

Follow for updates

Join SOTA2 Contact