List your company
ResearchFormerly WizWand

Science Question Answering on ARC (Easy/Challenge Breakdown)

92.11ARC Easy AccuracyLD-MoLE
74.315678.935383.55588.1747May 26, 2024Aug 16, 2024Nov 6, 2024Jan 27, 2025Apr 19, 2025Jul 10, 2025Sep 30, 2025
Updated 8mo ago

Evaluation results

MethodLinks
LD-MoLEModel=Qwen3-1.7B, TP=4.23 %2025.0992.1178.67
ReMoLEModel=Qwen3-1.7B, TP=4.12 %2025.0991.7579.6
ReMoLEModel=Llama3.1-8B, TP=2.17 %2025.0991.6182
LD-MoLEModel=Llama3.1-8B, TP=2.33 %2025.0991.6183.67
LD-MoLEModel=Llama3.2-3B, TP=3.28 %2025.0989.4774.58
ReMoLEModel=Llama3.2-3B, TP=3.11 %2025.0989.375.25
MoLA(8888)Model=Qwen3-1.7B, TP=4.12 %2025.0988.676.59
MoLA(2468)Model=Qwen3-1.7B, TP=2.39 %2025.0988.4276.92
MoLA(2468)Model=Llama3.1-8B, TP=1.26 %2025.0987.3777.9
MoLA(8888)Model=Llama3.1-8B, TP=2.17 %2025.0986.3276.79
MoLA(2468)Model=Llama3.2-3B, TP=1.80 %2025.0983.8671.91
MoLA(8888)Model=Llama3.2-3B, TP=3.11 %2025.0983.5171.57
RPOChain-of-thought=false, Few-shots=false, Backbone=Gemma2024.0579.149.8
zephyr-gemma-7bChain-of-thought=false, Few-shots=false2024.0577.648.6
DPOChain-of-thought=false, Few-shots=false, Backbone=Gemma2024.0575.750
zephyr-7b-gemma-sftChain-of-thought=false, Few-shots=false, Backbone=Gemma2024.057545.8