Near-duplicate identification on RealNews 30M documents
5,426,172Number of DuplicatesSEDD
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SEDD2025.01 | 5,426,172 | 5,329,713 | 98.2 | |
| GPU baseline (NeMo Curator)2025.01 | 5,426,170 | — | — |
| Method | Links | |||
|---|---|---|---|---|
| SEDD2025.01 | 5,426,172 | 5,329,713 | 98.2 | |
| GPU baseline (NeMo Curator)2025.01 | 5,426,170 | — | — |