Mathematical Reasoning on MATH (test) (EM, Avg.)
24.68Exact Match (EM)FFT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| FFTBackbone=OLMoE, Params. (%)=1002026.07 | 24.68 | 38.54 | |
| ESFTBackbone=OLMoE, Params. (%)=5.082026.07 | 22.49 | 38.06 | |
| LoRA (static)Backbone=OLMoE, Params. (%)=0.722026.07 | 21.9 | 36.7 | |
| EPnGBackbone=OLMoE, Params. (%)=0.722026.07 | 21.4 | 38.43 |