Mathematical Problem Solving on MATH (val)
31.33AccuracyPiSSA
Evaluation results
| Method | Links | |
|---|---|---|
| PiSSAModel=Gemma-7B, Params=400M2026.02 | 31.33 | |
| LoRAModel=Gemma-7B, Params=400M2026.02 | 30.41 | |
| LoRA + OursModel=Gemma-7B, Params=200M2026.02 | 28.59 | |
| PiSSA + OursModel=Gemma-7B, Params=200M2026.02 | 27.75 | |
| PiSSAModel=Mistral-7B, Params=335M2026.02 | 23.12 | |
| Full FTModel=Gemma-7B, Params=8540M2026.02 | 22.71 | |
| LoRA + OursModel=Mistral-7B, Params=167M2026.02 | 20.85 | |
| PiSSA + OursModel=Mistral-7B, Params=167M2026.02 | 20.77 | |
| LoRAModel=Mistral-7B, Params=335M2026.02 | 20.08 | |
| Full FTModel=Mistral-7B, Params=7240M2026.02 | 18.64 | |
| PiSSA + OursModel=LLaMA 2-7B, Params=159M2026.02 | 8.83 | |
| PiSSAModel=LLaMA 2-7B, Params=320M2026.02 | 7.47 | |
| Full FTModel=LLaMA 2-7B, Params=6738M2026.02 | 7.29 | |
| LoRA + OursModel=LLaMA 2-7B, Params=159M2026.02 | 6.45 | |
| LoRAModel=LLaMA 2-7B, Params=320M2026.02 | 5.5 |