Language Understanding on MMLU 1-order
55.2AccuracyRaw
Evaluation results
| Method | Links | |
|---|---|---|
| RawModel=Llama-3.1-8B2026.03 | 55.2 | |
| MOSAICModel=Llama-3.1-8B2026.03 | 55.1 | |
| ORPOModel=Llama-3.1-8B2026.03 | 54.9 | |
| SFTModel=Llama-3.1-8B2026.03 | 54.7 | |
| In-contextModel=Llama-3.1-8B2026.03 | 53.4 | |
| RawModel=Llama-3.2-3B2026.03 | 50.7 | |
| MOSAICModel=Llama-3.2-3B2026.03 | 49.8 | |
| SFTModel=Llama-3.2-3B2026.03 | 49.2 | |
| In-contextModel=Llama-3.2-3B2026.03 | 48.9 | |
| ORPOModel=Llama-3.2-3B2026.03 | 48.9 |