Mathematical Reasoning on MMLU Math
51.4ScoreChunkFT
Evaluation results
| Method | Links | |
|---|---|---|
| ChunkFTBackbone=Llama 3-8B2026.05 | 51.4 | |
| APOLLOBackbone=Llama 3-8B2026.05 | 50.7 | |
| BAdamBackbone=Llama 3-8B2026.05 | 50.5 | |
| HiFTBackbone=Llama 3-8B2026.05 | 48.4 | |
| LoRABackbone=Llama 3-8B2026.05 | 45.3 | |
| AdamBackbone=Llama 3-8B2026.05 | 44.3 | |
| GaloreBackbone=Llama 3-8B2026.05 | 41.2 | |
| LOMOBackbone=Llama 3-8B2026.05 | 40 | |
| VanillaBackbone=Llama 3-8B2026.05 | 33.7 |