Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

LCB dataset and benchmarks – Page 2 · SOTA2 Research

Research Datasets

LCB

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Coding Reasoning

LCB v6

93.28Avg@4

8

Code Generation

LCB-Hard (171)

62.6Accuracy

8

LCB v6

7.7Pass@1

8

Code Generation

LCB-IO

81.7Pass@1

8

LCB Pro Med 25Q2

10.5pass@1

7

LCB 08/24-02/25 v5

77.5pass@1

7

LCB v6

31.43Pass@1

6

LCB v5

58.42Pass@1

6

Code Generation

LCB v6 (fixed 500-problem slice)

53.5Pass@4

6

LCBv5 LCBv6 (test)

49LCBv5 Score

6

LCB v5

42.1Pass@1

6

Code Generation

LCB monolingual

96.44RPR

5

Code Generation

LCB cross-lingual

58.28RPR

5

Language Adherence

LCB monolingual

99.9RPR

5

Language Adherence

LCB cross-lingual

97.68RPR

5

Code Generation

LCB v6

42.18Accuracy

5

Code Generation

LCB v5 (evaluation)

19.93Pass@1

5

Uncertainty Quantification

LCB Hard

91.1PRR

4

Uncertainty Quantification

LCB Medium

84.2PRR

4

Code Generation

LCB

41.4LCB Score

4

LCB

2.8Accuracy

3

Coding reasoning

LCB

53.4Avg@4

3

Verified Program Synthesis

LCB-Pro-Dafny

56.4Verification Success Rate

2

Verified Program Synthesis

LCB-Pro-Dafny Hard

28Verification Success Rate

2

Code Generation

LCB

48Winrate

1

Page 2 of 2

Popular tasks

Code Generation Coding Code Code Reasoning Reasoning

Follow for updates

Join SOTA2 Contact