Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Semantic Caching research benchmarks · SOTA2 Research

Semantic Caching

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

SemCacheLMArena

LD1 (Logistic regression to compute threshold)

70Static Origin Served Fraction

13

Feb 26, 2026

1,504.43End-to-End Latency (min)

4

May 26, 2026

1,866.58End-to-End Latency (min)

4

May 26, 2026

SemCacheClassification

383.32Latency (min)

4

May 26, 2026

SemCacheSearchQueries

6,345.61Cumulative End-to-End Inference Latency (minutes)

4

May 26, 2026

Popular datasets

QNLI SemCacheLMArena SemCacheSearchQueries SemCacheClassification PromptBench

Follow for updates

Join SOTA2 Contact