Multitask Language Understanding on GMMLU c
30.75Acc (Normalized)HQ seed (LLM Training)
Evaluation Results
| Method | Links | |
|---|---|---|
| HQ seed (LLM Training)Filtering Strategy=HQ seed (LLM Training)2026.04 | 30.75 | |
| NordicFiltering Strategy=Nordic2026.04 | 30.75 | |
| ML (Q3)Filtering Strategy=ML (Q3)2026.04 | 30.75 | |
| Q3 negativesFiltering Strategy=Q3 negatives2026.04 | 30.25 | |
| HQFiltering Strategy=HQ2026.04 | 29.25 | |
| HQ seedFiltering Strategy=HQ seed2026.04 | 29 | |
| MLFiltering Strategy=ML2026.04 | 29 | |
| HQ allFiltering Strategy=HQ all2026.04 | 28.75 | |
| ML (15%)Filtering Strategy=ML (15%)2026.04 | 28.75 | |
| HQ Romance (No Fra)Filtering Strategy=HQ Romance (No Fra)2026.04 | 27.5 | |
| ML (10%)Retention=10%2026.04 | 27.25 | |
| ML2026.04 | 27 | |
| MKC-eFiltering Strategy=MKC-e2026.04 | 26.5 | |
| No FilteringFiltering Strategy=No Filtering2026.04 | 26.25 | |
| HQ2026.04 | 25.75 | |
| ML (Q3)Sampling Strategy=Q32026.04 | 25.75 | |
| MKC-e2026.04 | 25.5 | |
| HQ (20%)Retention=20%2026.04 | 25.5 | |
| ML (20%)Retention=20%2026.04 | 25.25 | |
| No Filtering2026.04 | 24.75 | |
| HQ (10%)Retention=10%2026.04 | 24.75 | |
| HQ seedVariant=Seed2026.04 | 24.5 |