List your company
ResearchFormerly WizWand

Question Answering on ARC-E (Accuracy $\Delta$)

1.3Accuracy DeltaLoRA
-0.0520.2990.651.001Apr 6, 2026
Updated 7mo ago

Evaluation results

MethodLinks
LoRAModel=Llama-2-13B, Params=410K, Learning Rate=10−32026.041.3
LoRAModel=Llama-2-70B, Params=1.3M, Learning Rate=10−32026.040.9
LoRAModel=Llama-2-13B, Params=410K, Learning Rate=3×10−42026.040.7
LoRAModel=Mistral-7B, Params=262K, Learning Rate=10−32026.040.6
LoRAModel=Llama-2-70B, Params=1.3M, Learning Rate=3×10−42026.040.6
LoRAModel=Mistral-7B, Params=262K, Learning Rate=3×10−42026.040.4
GAINModel=Mistral-7B, Params=131K2026.040.3
GAINModel=Llama-2-13B, Params=205K2026.040.1
GAINModel=Llama-2-70B, Params=655K2026.040