Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

CSN-Python dataset and benchmarks · SOTA2 Research

Research Datasets

CSN-Python

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Retrieval-Augmented Code Generation

CSN-Python Non-target Queries (test)

0.318Similarity (GPT-4o)

19

Retrieval-Augmented Code Generation

CSN-Python Target Queries (test)

41.44Verification Rate (GPT-4o)

19

CSN-Python Non-target Queries (test)

0.669MRR

19

CSN-Python Target Queries (test)

17.64ASR@1

18

Popular tasks

Code Retrieval Retrieval-Augmented Code Generation

Follow for updates

Join SOTA2 Contact