Near-duplicate identification on RealNews 30M documents
5,426,172Number of DuplicatesSEDD
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| SEDD2025.01 | 5,426,172 | 5,329,713 | 98.2 | |
| GPU baseline (NeMo Curator)2025.01 | 5,426,170 | — | — |
Loading the SOTA2 catalog…
| Method | Links | |||
|---|---|---|---|---|
| SEDD2025.01 | 5,426,172 | 5,329,713 | 98.2 | |
| GPU baseline (NeMo Curator)2025.01 | 5,426,170 | — | — |