Mathematical Reasoning on MATH (Accuracy and Learning (pp))
26.2AccuracyLALoRA
Evaluation results
| Method | Links | ||
|---|---|---|---|
| LALoRAλ=12025.12 | 26.2 | 1.4 | |
| L2λ=10^-52025.12 | 26.2 | 1.4 | |
| LALoRAλ=10^42025.12 | 25.8 | 1 | |
| Flat-LoRAρ=0.0052025.12 | 25.5 | 0.8 | |
| LALoRAλ=10^12025.12 | 25.3 | 0.6 | |
| MIGUt=0.72025.12 | 25.3 | 0.6 | |
| Flat-LoRAρ=0.012025.12 | 25.3 | 0.5 | |
| Flat-LoRAρ=0.12025.12 | 25 | 0.2 | |
| LALoRAλ=10^52025.12 | 24.9 | 0.1 | |
| LoRA (Baseline)λ=02025.12 | 24.8 | 0 | |
| L2λ=5 x 10^-42025.12 | 24.8 | 0.1 | |
| LALoRAλ=10^22025.12 | 24.6 | -0.2 | |
| L2λ=10^-72025.12 | 24.4 | -0.4 | |
| LALoRAλ=10^32025.12 | 24 | -0.8 | |
| Flat-LoRAρ=0.00052025.12 | 23.9 | -0.9 | |
| MIGUt=0.82025.12 | 23.8 | -1 | |
| L2λ=10^-62025.12 | 23.8 | -1 | |
| MiLoRA2025.12 | 23.8 | -1 | |
| MIGUt=0.52025.12 | 23.7 | -1.1 | |
| MIGUt=0.752025.12 | 23.5 | -1.3 | |
| Flat-LoRAρ=0.0012025.12 | 23.1 | -1.7 | |
| MIGUt=0.852025.12 | 22.7 | -2.1 | |
| Flat-LoRAρ=0.52025.12 | 22.7 | -2.1 | |
| L2λ=10^-32025.12 | 22.6 | -2.2 | |
| Flat-LoRAρ=0.052025.12 | 22.5 | -2.3 | |
| LALoRAλ=10^62025.12 | 22.3 | -2.5 | |
| MIGUt=0.62025.12 | 22 | -2.8 | |
| MIGUt=0.92025.12 | 21.3 | -3.4 | |
| L2λ=0.012025.12 | 19.1 | -5.7 | |
| L2λ=0.12025.12 | 18.4 | -6.4 |