Zero-shot Evaluation on DCLM CORE V2
48CORE_V2 ScoreUnion (Random)
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Union (Random)Training Scale=7B-2x (276B Tokens), fastText Thresholds=(0.11, 0.15, 0.15)2026.02 | 48 | — | |
| Union (Manual)Training Scale=7B-2x (276B Tokens), fastText Thresholds=(0.11, 0.11, 0.11)2026.02 | 47.9 | — | |
| Union (Random)Training Scale=7B-2x (276B Tokens), fastText Thresholds=(0.11, 0.11, 0.11)2026.02 | 47.8 | — | |
| resiliparseTraining Scale=7B-2x (276B Tokens), fastText Thresholds=0.152026.02 | 47.6 | — | |
| Union (Manual)Training Scale=7B-2x (276B Tokens), fastText Thresholds=(0.11, 0.15, 0.15)2026.02 | 47.6 | — | |
| resiliparseTraining Scale=7B-2x (276B Tokens), fastText Thresholds=0.112026.02 | 47.4 | — | |
| resiliparseTraining Scale=7B-2x (276B Tokens), fastText Thresholds=0.182026.02 | 47.1 | — | |
| Union (Manual)Training Scale=7B-1x (138B Tokens), fastText Thresholds=(0.11, 0.11, 0.11)2026.02 | 43.1 | — | |
| resiliparseTraining Scale=7B-1x (138B Tokens), fastText Thresholds=0.112026.02 | 42.6 | — | |
| trafilaturaTraining Scale=7B-1x (138B Tokens), fastText Thresholds=0.112026.02 | 41.9 | — | |
| Union (Random)Training Scale=7B-1x (138B Tokens), fastText Thresholds=(0.11, 0.11, 0.11)2026.02 | 41.3 | — | |
| jusTextTraining Scale=7B-1x (138B Tokens), fastText Thresholds=0.112026.02 | 41.2 | — | |
| trafilaturaTraining Scale=1B-1x (29B Tokens), fastText Thresholds=0.112026.02 | 29.6 | — | |
| jusTextTraining Scale=1B-1x (29B Tokens), fastText Thresholds=0.112026.02 | 29.3 | — | |
| Union (Manual)Training Scale=1B-1x (29B Tokens), fastText Thresholds=(0.11, 0.11, 0.11)2026.02 | 29.2 | — | |
| resiliparseTraining Scale=1B-1x (29B Tokens), fastText Thresholds=0.112026.02 | 28.5 | — | |
| Union (Random)Training Scale=1B-1x (29B Tokens), fastText Thresholds=(0.11, 0.11, 0.11)2026.02 | 28.1 | — |