Mathematical Reasoning on AIME23@32 (test)
42.22AccuracyLoRA-RLPO
Evaluation Results
| Method | Links | |
|---|---|---|
| LoRA-RLPOB0 initialization=0, A0 initialization=V_{r}^T, training steps=500, learning rate decay=cosine2026.06 | 42.22 | |
| LoRA-RLMOB0 initialization=0, A0 initialization=V_{-r}^T, training steps=500, learning rate decay=cosine2026.06 | 41.11 | |
| LoRAB0 initialization=0, A0 initialization=N(0, 1/n), training steps=500, learning rate decay=cosine2026.06 | 38.89 | |
| MiLoRAB0 initialization=U_{-r}Σ_{-r}^{1/2}, A0 initialization=Σ_{-r}^{1/2}V_{-r}^T, training steps=500, learning rate decay=cosine2026.06 | 30 | |
| PiSSAB0 initialization=U_{r}Σ_{r}^{1/2}, A0 initialization=Σ_{r}^{1/2}V_{r}^T, training steps=500, learning rate decay=cosine2026.06 | 0 |