Mathematical Reasoning on Source domain
65.9AccuracyLALoRA
Evaluation results
| Method | Links | ||
|---|---|---|---|
| LALoRAλ=10^62025.12 | 65.9 | 5 | |
| LALoRAλ=10^52025.12 | 65.7 | 4.9 | |
| L2λ=0.12025.12 | 65.7 | 4.8 | |
| L2λ=0.012025.12 | 65.7 | 4.8 | |
| LALoRAλ=10^42025.12 | 65.2 | 4.3 | |
| LALoRAλ=10^32025.12 | 64.9 | 4 | |
| L2λ=10^-32025.12 | 64.5 | 3.7 | |
| LALoRAλ=10^22025.12 | 64 | 3.1 | |
| MIGUt=0.92025.12 | 63.8 | 2.9 | |
| MIGUt=0.72025.12 | 63.8 | 2.9 | |
| MIGUt=0.752025.12 | 63.6 | 2.7 | |
| LALoRAλ=10^12025.12 | 63.5 | 2.7 | |
| L2λ=5 x 10^-42025.12 | 63.3 | 2.4 | |
| MIGUt=0.852025.12 | 63.2 | 2.4 | |
| LALoRAλ=12025.12 | 62.7 | 1.9 | |
| MIGUt=0.62025.12 | 62.7 | 1.8 | |
| MIGUt=0.52025.12 | 62.7 | 1.8 | |
| MIGUt=0.82025.12 | 62.5 | 1.6 | |
| L2λ=10^-52025.12 | 62.4 | 1.5 | |
| MiLoRA2025.12 | 62.3 | 1.4 | |
| L2λ=10^-72025.12 | 62.2 | 1.4 | |
| L2λ=10^-62025.12 | 61.7 | 0.9 | |
| Flat-LoRAρ=0.012025.12 | 61.6 | 0.7 | |
| Flat-LoRAρ=0.00052025.12 | 61 | 0.1 | |
| LoRA (Baseline)λ=02025.12 | 60.9 | 0 | |
| Flat-LoRAρ=0.052025.12 | 60.8 | -0.1 | |
| Flat-LoRAρ=0.0052025.12 | 60.8 | -0.1 | |
| Flat-LoRAρ=0.0012025.12 | 60.8 | 0 | |
| Flat-LoRAρ=0.12025.12 | 60.7 | -0.2 | |
| Flat-LoRAρ=0.52025.12 | 59.4 | -1.4 |