Multitask Language Understanding on MMLU (MMLU, Average)
78.5MMLU ScoreLing-mini-2.0
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Ling-mini-2.0Model=Ling-mini-2.0 (16B), Base Model=Ling-mini-2.0, Truncation Length=2048, Data Selection Ratio=100%, Number of parallel runs=52026.02 | 78.5 | 83.25 | |
| CRDS-WModel=Ling-mini-2.0 (16B), Base Model=Ling-mini-2.0, Truncation Length=2048, Data Selection Ratio=5%, Number of parallel runs=52026.02 | 77.99 | 83.86 | |
| CRDS-RModel=Ling-mini-2.0 (16B), Base Model=Ling-mini-2.0, Truncation Length=2048, Data Selection Ratio=5%, Number of parallel runs=52026.02 | 77.54 | 83.31 | |
| Mid PPLModel=Ling-mini-2.0 (16B), Base Model=Ling-mini-2.0, Truncation Length=2048, Data Selection Ratio=5%, Number of parallel runs=52026.02 | 76.5 | 82.49 | |
| RandomModel=Ling-mini-2.0 (16B), Base Model=Ling-mini-2.0, Truncation Length=2048, Data Selection Ratio=5%, Number of parallel runs=52026.02 | 76.44 | 82.55 | |
| RDS+Model=Ling-mini-2.0 (16B), Base Model=Ling-mini-2.0, Truncation Length=2048, Data Selection Ratio=5%, Number of parallel runs=52026.02 | 76.44 | 82.28 | |
| LengthModel=Ling-mini-2.0 (16B), Base Model=Ling-mini-2.0, Truncation Length=2048, Data Selection Ratio=5%, Number of parallel runs=52026.02 | 74.77 | 74.53 |