Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Search Relevance research benchmarks · SOTA2 Research

Search Relevance

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

Minor Language family Qwen2.5 series benchmark (test)

84.99NDCG@1

18

Feb 26, 2026

Romance language family Qwen2.5 series benchmark (test)

88.14NDCG@1

18

Feb 26, 2026

Germanic language family Qwen2.5 series benchmark (test)

87.56NDCG@1

18

Feb 26, 2026

DeBERTa-v3-large

61.03Macro F1

14

Mar 25, 2026

DeBERTa-v3-large

91.39Macro F1

12

Mar 25, 2026

JD.com Search Traffic Online Evaluation (A/B test)

11.39Bad Case Rate

3

Apr 29, 2026

Taobao Visual Search (Offline Evaluation Set)

66.56Top-1 Relevance

2

Mar 5, 2026

Manual Annotation Queries Knowledge 2,000 queries

18.45GSB

1

Mar 11, 2026

Manual Annotation Queries Negative 2,000 queries

10.92GSB Score

1

Mar 11, 2026

Manual Annotation Queries Alternative 2,000 queries

34.43GSB Score

1

Mar 11, 2026

Manual Annotation Queries Q&A 2,000 queries

16.62GSB

1

Mar 11, 2026

Online Search Platform Longtail Traffic Current

SERM (Distilled Qwen2.5-7B)

-0.131Change Query Ratio

1

Feb 26, 2026

Online Search Platform Overall Current (Live Traffic)

SERM (Distilled Qwen2.5-7B)

-1.208User Negative Feedback

1

Feb 26, 2026

Popular datasets

Manual Annotation Queries Online Search Platform ESCI Germanic language family Romance language family

Follow for updates

Join SOTA2 Contact