Language Understanding on MMLU 2-order
55.2AccuracyRaw
Evaluation results
| Method | Links | |
|---|---|---|
| RawModel=Llama-3.1-8B2026.03 | 55.2 | |
| MOSAICModel=Llama-3.1-8B2026.03 | 55.2 | |
| SFTModel=Llama-3.1-8B2026.03 | 54.4 | |
| ORPOModel=Llama-3.1-8B2026.03 | 54.2 | |
| In-contextModel=Llama-3.1-8B2026.03 | 52.9 | |
| RawModel=Llama-3.2-3B2026.03 | 50.7 | |
| MOSAICModel=Llama-3.2-3B2026.03 | 50.1 | |
| ORPOModel=Llama-3.2-3B2026.03 | 49.2 | |
| SFTModel=Llama-3.2-3B2026.03 | 48.7 | |
| In-contextModel=Llama-3.2-3B2026.03 | 48.5 |