Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

MBPP dataset and benchmarks – Page 3 · SOTA2 Research

Research Datasets

MBPP

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Code Generation

MBPP

70.42Average Score

30

Code Generation

MBPP v1 (plus)

86.86Pass@1

30

Code Generation

MBPP base v1

88.57Pass@1

30

Code Generation

MBPP

59.8MBPP Accuracy

30

MBPP

80.8Accuracy

30

Code Generation

MBPP+

76.9Accuracy

29

Code Generation

MBPP

66.2Accuracy @ t1

29

Code Generation

MBPP-S (test)

69.25Pass@1

29

Code Generation

MBPP standard (test)

94.2Pass@1

29

Code Generation

MBPP (3)

43.6Pass@1

28

Code Generation

MBPP

56.4Accuracy

28

Code Generation

MBPP

71.98MBPP Performance Score

28

Code Generation

MBPP

81.1Accuracy

27

Code Generation

MBPP

47.6MBPP Accuracy

26

Code generation

MBPP

90.8Accuracy

26

MBPP

94.55Accuracy

26

Code Generation

MBPP

74.7Pass@1

24

MBPP sanitized

2.44Throughput (tokens/s)

24

MBPP (val)

92nDCG@5

24

LLM Inference Acceleration

MBPP

6.26Speedup

24

Code Generation

MBPP+

72.7Pass Rate

24

Code Generation

MBPP+

54.2MB+ Score

23

Python Programming

MBPP

95.5MBPP Score

23

MBPP

94.16Score

23

Code Generation

MBPP

85.2MBPP Accuracy

22

Page 3 of 13

Popular tasks

Code Generation Coding Code Watermark Detection Code Reasoning

Follow for updates

Join SOTA2 Contact