Accuracy Evaluation on Source domain LLAMA-3.1-8B (final)
70.8AccuracyLALoRA
Evaluation results
| Method | Links | ||
|---|---|---|---|
| LALoRAlambda=100002025.12 | 70.8 | 9.2 | |
| LALoRAlambda=50002025.12 | 70.6 | 9 | |
| LALoRAlambda=500002025.12 | 70.5 | 8.9 | |
| L2value=12025.12 | 70.4 | 8.8 | |
| L2value=0.12025.12 | 70.4 | 8.7 | |
| L2value=0.0012025.12 | 70.4 | 8.8 | |
| LALoRAlambda=10002025.12 | 70.1 | 8.5 | |
| L2value=0.012025.12 | 70 | 8.4 | |
| MIGUt=0.92025.12 | 69.7 | 8 | |
| MIGUt=0.952025.12 | 69.5 | 7.9 | |
| L2value=0.0000752025.12 | 69.4 | 7.7 | |
| MIGUt=0.852025.12 | 69.3 | 7.7 | |
| LALoRAlambda=1002025.12 | 68.9 | 7.2 | |
| MIGUt=0.82025.12 | 68.7 | 7.1 | |
| MIGUt=0.752025.12 | 68.7 | 7.1 | |
| LALoRAlambda=502025.12 | 68.4 | 6.8 | |
| L2value=0.000052025.12 | 67.5 | 5.9 | |
| MIGUt=0.62025.12 | 66.5 | 4.9 | |
| MIGUt=0.72025.12 | 66.2 | 4.6 | |
| LALoRAlambda=12025.12 | 65 | 3.3 | |
| MiLoRA2025.12 | 63.7 | 2.1 | |
| L2value=0.000012025.12 | 63.5 | 1.8 | |
| LoRA (Baseline)lambda=02025.12 | 61.6 | 0 |