Accuracy Evaluation on Target domain LLAMA-3.1-8B (final)
40.9AccuracyLALoRA
Evaluation results
| Method | Links | ||
|---|---|---|---|
| LALoRAlambda=50002025.12 | 40.9 | 6 | |
| MIGUt=0.752025.12 | 40.5 | 5.6 | |
| MIGUt=0.82025.12 | 39.4 | 4.5 | |
| LALoRAlambda=10002025.12 | 39.3 | 4.4 | |
| MIGUt=0.92025.12 | 39.2 | 4.3 | |
| LALoRAlambda=1002025.12 | 39.1 | 4.2 | |
| LALoRAlambda=502025.12 | 38.9 | 4 | |
| MIGUt=0.852025.12 | 38.5 | 3.6 | |
| L2value=0.012025.12 | 37.6 | 2.7 | |
| MIGUt=0.62025.12 | 37.2 | 2.3 | |
| LALoRAlambda=500002025.12 | 36.9 | 2 | |
| LALoRAlambda=100002025.12 | 36.7 | 1.8 | |
| MIGUt=0.72025.12 | 36.6 | 1.7 | |
| L2value=0.000052025.12 | 36.6 | 1.7 | |
| LALoRAlambda=12025.12 | 36.3 | 1.4 | |
| L2value=0.0012025.12 | 35.6 | 0.7 | |
| MIGUt=0.952025.12 | 35.3 | 0.4 | |
| LoRA (Baseline)lambda=02025.12 | 34.9 | 0 | |
| MiLoRA2025.12 | 34.9 | 0 | |
| L2value=0.000012025.12 | 32.9 | -2 | |
| L2value=12025.12 | 30.6 | -4.4 | |
| L2value=0.0000752025.12 | 30.4 | -4.5 | |
| L2value=0.12025.12 | 25.7 | -9.2 |