Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

BigCodeBench dataset and benchmarks – Page 3 · SOTA2 Research

Research Datasets

BigCodeBench

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Code Generation

BigCodeBench

0.555Score

3

Multi-agent Selection (Pairwise Resolution)

BigCodeBench (test)

70.9Pairwise Resolution

3

Code Generation

BigCodeBench Full 1.0

459Pass@1

3

BigCodeBench

40BigCodeBench Score

3

Code Generation

BigCodeBench

77.5Quality Score

2

BigCodeBench

49.1Quality Score (%)

2

Code Generation

BigCodeBench

0.07Cost (cents)

2

Page 3 of 3

Popular tasks

Code Generation Coding Code Completion Skill retrieval Sabotage detection

Follow for updates

Join SOTA2 Contact