Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

MBPP dataset and benchmarks – Page 13 · SOTA2 Research

Research Datasets

MBPP

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Code Generation

MBPP

38NFE (Number of Failed Executions)

2

Source Code Watermarking

MBPP

97.85Bit Accuracy

2

Code Generation

MBPP-G

71.28Pass Rate Before

2

Code Generation

MBPP

69.8Accuracy

2

Code Generation

MBPP

0.58Inference Cost (USD)

2

Code Generation

MBPP-plus

48.7Pass@1

2

Code Generation

MBPP

720Throughput (tok/s)

2

Code Generation

MBPP

65.76Score

2

Code Generation

MBPP Rust MultiPL-E translation (test)

75.4Pass@1

2

Code Generation

MBPP

60Winrate

1

Code Generation

MBPP

—Pass@1

0

Page 13 of 13

Popular tasks

Code Generation Coding Code Watermark Detection Code Reasoning

Follow for updates

Join SOTA2 Contact