Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

PY150 dataset and benchmarks · SOTA2 Research

Research Datasets

PY150

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Next token prediction

py150

67.2MRR

16

Code Summarization

Py150 (test)

81.36ASR

12

Method Name Prediction

Py150 (test)

77.52ASR

12

Code Summarization

Py150

100Recall

12

Method Name Prediction

Py150

99.99Recall

12

Code Completion

py150 OOD WILDS (test)

68.3MethodClass Accuracy

7

Line-level code completion

PY150

44.86EM

7

Code Generation

Py150

10.57Accuracy

4

PY150 (test)

62.1Accuracy

2

Popular tasks

Code Summarization Method Name Prediction Code Generation Next-token prediction Line-level code completion

Follow for updates

Join SOTA2 Contact