Question Answering on ARC-E (Accuracy $\Delta$)
1.3Accuracy DeltaLoRA
Evaluation Results
| Method | Links | |
|---|---|---|
| LoRAModel=Llama-2-13B, Params=410K, Learning Rate=10−32026.04 | 1.3 | |
| LoRAModel=Llama-2-70B, Params=1.3M, Learning Rate=10−32026.04 | 0.9 | |
| LoRAModel=Llama-2-13B, Params=410K, Learning Rate=3×10−42026.04 | 0.7 | |
| LoRAModel=Mistral-7B, Params=262K, Learning Rate=10−32026.04 | 0.6 | |
| LoRAModel=Llama-2-70B, Params=1.3M, Learning Rate=3×10−42026.04 | 0.6 | |
| LoRAModel=Mistral-7B, Params=262K, Learning Rate=3×10−42026.04 | 0.4 | |
| GAINModel=Mistral-7B, Params=131K2026.04 | 0.3 | |
| GAINModel=Llama-2-13B, Params=205K2026.04 | 0.1 | |
| GAINModel=Llama-2-70B, Params=655K2026.04 | 0 |