List your company
ResearchFormerly WizWand

Common Sense Reasoning on SWAG

92.29AccuracyLD-MoLE
62.348470.121777.89585.6683May 16, 2025Jun 7, 2025Jun 30, 2025Jul 23, 2025Aug 15, 2025Sep 7, 2025Sep 30, 2025
Updated 8mo ago

Evaluation results

MethodLinks
LD-MoLEModel=Llama3.1-8B, TP=2.33 %2025.0992.29
ReMoLEModel=Llama3.1-8B, TP=2.17 %2025.0992.22
LD-MoLEModel=Llama3.2-3B, TP=3.28 %2025.0991.37
ReMoLEModel=Llama3.2-3B, TP=3.11 %2025.0990.45
MoLA(8888)Model=Llama3.1-8B, TP=2.17 %2025.0989.15
MoLA(2468)Model=Llama3.1-8B, TP=1.26 %2025.0986.97
LD-MoLEModel=Qwen3-1.7B, TP=4.23 %2025.0986.72
ReMoLEModel=Qwen3-1.7B, TP=4.12 %2025.0986.37
MoLA(2468)Model=Qwen3-1.7B, TP=2.39 %2025.0984.17
MoLA(8888)Model=Qwen3-1.7B, TP=4.12 %2025.0984.11
MoLA(2468)Model=Llama3.2-3B, TP=1.80 %2025.0983.96
MoLA(8888)Model=Llama3.2-3B, TP=3.11 %2025.0983.56
GenKnowSubSetting=De, Zero-shot=true, Base Model=Phi-32025.0573.3
GenKnowSubSetting=Avg, Zero-shot=true, Base Model=Phi-32025.0572.7
Mean NormZero-shot=true, Base Model=Phi-32025.0571.9
GenKnowSubSetting=Fr, Zero-shot=true, Base Model=Phi-32025.0571.64
SharedZero-shot=true, Base Model=Phi-32025.0571
GenKnowSubSetting=En, Zero-shot=true, Base Model=Phi-32025.0570
Phi-3Zero-shot=true, Base Model=Phi-32025.0568.99
ArrowZero-shot=true, Base Model=Phi-32025.0568.95
GenKnowSubBase Model=Phi-2, Setting=Avg, Evaluation Protocol=zero-shot2025.0566.1
ArrowBase Model=Phi-2, Evaluation Protocol=zero-shot2025.0565.75
GenKnowSubBase Model=Phi-2, Setting=En, Evaluation Protocol=zero-shot2025.0565.58
Phi-2Base Model=Phi-2, Evaluation Protocol=zero-shot2025.0563.5