Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Code Retrieval research benchmarks · SOTA2 Research

Code Retrieval

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

MTEB Code Retrieval Average (val)

Retriever Fine-tuning

74nDCG@5

24

Apr 8, 2026

FreshStack (val)

Retriever Fine-tuning

43.8nDCG@5

24

Apr 8, 2026

Policy Optimization

63.8nDCG@5

24

Apr 8, 2026

Retriever Fine-tuning

92nDCG@5

24

Apr 8, 2026

HumanEval (val)

Policy Optimization

98.5nDCG@5

24

Apr 8, 2026

80.07nDCG@10

21

May 14, 2026

CSN-Python Non-target Queries (test)

0.669MRR

19

Feb 26, 2026

CSN-Python Target Queries (test)

17.64ASR@1

18

Feb 26, 2026

47.5MRR

16

Feb 27, 2026

MTEB Code (test)

98.1Apps Score

12

Mar 24, 2026

48.3nDCG@10

10

Jun 2, 2026

SANTA (Hard Negative)

48.6MRR

9

Feb 27, 2026

32.05NDCG@10

8

Apr 8, 2026

MTEB Code v1 (test)

Gemini Embedding 2

84Mean Score

2

May 27, 2026

CodeSearch (test)

—

—MRR

0

Feb 26, 2026

Popular datasets

MTEB CodeSearch CSN-Python HumanEval MBPP

Follow for updates

Join SOTA2 Contact