List your company
ResearchFormerly WizWand

Commonsense Question Answering on ARC Challenge

83.24AccuracyLoRA-Mixer(ours)
20.808837.016953.22569.4331Jun 17, 2025Aug 7, 2025Sep 27, 2025Nov 18, 2025Jan 8, 2026Feb 28, 2026Apr 21, 2026
Updated 5mo ago

Evaluation results

MethodLinks
LoRA-Mixer(ours)Base Model=LLaMA-3 (8B)2025.0683.24
MixLoRABase Model=LLaMA-3 (8B)2025.0682.9
LoRABase Model=LLaMA-3 (8B)2025.0682.15
MOLEBase Model=LLaMA-3 (8B)2025.0681.77
LoRAHubBase Model=LLaMA-3 (8B)2025.0680.14
LoRA-Mixer (ours)Base Model=Falcon-Mamba (7B)2025.0677.19
MOLEBase Model=Falcon-Mamba (7B)2025.0676.61
LoRABase Model=Falcon-Mamba (7B)2025.0676.51
LoRAHubBase Model=Falcon-Mamba (7B)2025.0672.37
LoRA-Mixer (ours)Base Model=Mistral (7B)2025.0671.22
LoRABase Model=Mistral (7B)2025.0670.53
LoRAHubBase Model=Mistral (7B)2025.0669.21
MixLoRABase Model=Mistral (7B)2025.0669.15
MOLEBase Model=Mistral (7B)2025.0668.77
FP16Bits=-, Backbone=LLAMA-2-7B, Zero-shot=true2026.0440.53
LBLLMBits=W(1+1)A4, Backbone=LLAMA-2-7B, Zero-shot=true2026.0432.51
CBQBits=W4A4, Backbone=LLAMA-2-7B, Zero-shot=true2026.0431.56
BWABits=W(1+1)A4, Backbone=LLAMA-2-7B, Zero-shot=true2026.0430.55
ARB-LLMBits=W(1+1)A4, Backbone=LLAMA-2-7B, Zero-shot=true2026.0427.05
BiLLMBits=W(1+1)A4, Backbone=LLAMA-2-7B, Zero-shot=true2026.0426.54
QuaRotBits=W2A4, Backbone=LLAMA-2-7B, Zero-shot=true2026.0423.21