Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Deduplication research benchmarks · SOTA2 Research

Deduplication

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

RealNews 1M documents

Standard MinHash

289,229Unique Document Count

4

May 19, 2026

RealNews 0.1M documents

7,158Duplication Ratio

4

May 19, 2026

C4 100 GB (sampled)

58.9Generation Time (s)

3

May 19, 2026

RealNews 100 GB

49Generation Time (s)

3

May 19, 2026

Simulated CRM Dataset 1000-row (test)

Baseline (String Match)

100Precision

2

Mar 6, 2026

Popular datasets

RealNews C4 Simulated CRM Dataset

Follow for updates

Join SOTA2 Contact