Mathematical Reasoning on MATH500 @4 (test)
87.33AccuracyLoRA-RLPO
Evaluation results
| Method | Links | |
|---|---|---|
| LoRA-RLPOB0 initialization=0, A0 initialization=V_{r}^T, training steps=500, learning rate decay=cosine2026.06 | 87.33 | |
| LoRA-RLMOB0 initialization=0, A0 initialization=V_{-r}^T, training steps=500, learning rate decay=cosine2026.06 | 86.8 | |
| LoRAB0 initialization=0, A0 initialization=N(0, 1/n), training steps=500, learning rate decay=cosine2026.06 | 81.93 | |
| MiLoRAB0 initialization=U_{-r}Σ_{-r}^{1/2}, A0 initialization=Σ_{-r}^{1/2}V_{-r}^T, training steps=500, learning rate decay=cosine2026.06 | 76.47 | |
| PiSSAB0 initialization=U_{r}Σ_{r}^{1/2}, A0 initialization=Σ_{r}^{1/2}V_{r}^T, training steps=500, learning rate decay=cosine2026.06 | 13.2 |