Commonsense Question Answering on ARC Challenge
83.24AccuracyLoRA-Mixer(ours)
Evaluation Results
| Method | Links | |
|---|---|---|
| LoRA-Mixer(ours)Base Model=LLaMA-3 (8B)2025.06 | 83.24 | |
| MixLoRABase Model=LLaMA-3 (8B)2025.06 | 82.9 | |
| LoRABase Model=LLaMA-3 (8B)2025.06 | 82.15 | |
| MOLEBase Model=LLaMA-3 (8B)2025.06 | 81.77 | |
| LoRAHubBase Model=LLaMA-3 (8B)2025.06 | 80.14 | |
| LoRA-Mixer (ours)Base Model=Falcon-Mamba (7B)2025.06 | 77.19 | |
| MOLEBase Model=Falcon-Mamba (7B)2025.06 | 76.61 | |
| LoRABase Model=Falcon-Mamba (7B)2025.06 | 76.51 | |
| LoRAHubBase Model=Falcon-Mamba (7B)2025.06 | 72.37 | |
| LoRA-Mixer (ours)Base Model=Mistral (7B)2025.06 | 71.22 | |
| LoRABase Model=Mistral (7B)2025.06 | 70.53 | |
| LoRAHubBase Model=Mistral (7B)2025.06 | 69.21 | |
| MixLoRABase Model=Mistral (7B)2025.06 | 69.15 | |
| MOLEBase Model=Mistral (7B)2025.06 | 68.77 | |
| FP16Bits=-, Backbone=LLAMA-2-7B, Zero-shot=true2026.04 | 40.53 | |
| LBLLMBits=W(1+1)A4, Backbone=LLAMA-2-7B, Zero-shot=true2026.04 | 32.51 | |
| CBQBits=W4A4, Backbone=LLAMA-2-7B, Zero-shot=true2026.04 | 31.56 | |
| BWABits=W(1+1)A4, Backbone=LLAMA-2-7B, Zero-shot=true2026.04 | 30.55 | |
| ARB-LLMBits=W(1+1)A4, Backbone=LLAMA-2-7B, Zero-shot=true2026.04 | 27.05 | |
| BiLLMBits=W(1+1)A4, Backbone=LLAMA-2-7B, Zero-shot=true2026.04 | 26.54 | |
| QuaRotBits=W2A4, Backbone=LLAMA-2-7B, Zero-shot=true2026.04 | 23.21 |