Common Sense Reasoning on SWAG
92.29AccuracyLD-MoLE
Evaluation Results
| Method | Links | |
|---|---|---|
| LD-MoLEModel=Llama3.1-8B, TP=2.33 %2025.09 | 92.29 | |
| ReMoLEModel=Llama3.1-8B, TP=2.17 %2025.09 | 92.22 | |
| LD-MoLEModel=Llama3.2-3B, TP=3.28 %2025.09 | 91.37 | |
| ReMoLEModel=Llama3.2-3B, TP=3.11 %2025.09 | 90.45 | |
| MoLA(8888)Model=Llama3.1-8B, TP=2.17 %2025.09 | 89.15 | |
| MoLA(2468)Model=Llama3.1-8B, TP=1.26 %2025.09 | 86.97 | |
| LD-MoLEModel=Qwen3-1.7B, TP=4.23 %2025.09 | 86.72 | |
| ReMoLEModel=Qwen3-1.7B, TP=4.12 %2025.09 | 86.37 | |
| MoLA(2468)Model=Qwen3-1.7B, TP=2.39 %2025.09 | 84.17 | |
| MoLA(8888)Model=Qwen3-1.7B, TP=4.12 %2025.09 | 84.11 | |
| MoLA(2468)Model=Llama3.2-3B, TP=1.80 %2025.09 | 83.96 | |
| MoLA(8888)Model=Llama3.2-3B, TP=3.11 %2025.09 | 83.56 | |
| GenKnowSubSetting=De, Zero-shot=true, Base Model=Phi-32025.05 | 73.3 | |
| GenKnowSubSetting=Avg, Zero-shot=true, Base Model=Phi-32025.05 | 72.7 | |
| Mean NormZero-shot=true, Base Model=Phi-32025.05 | 71.9 | |
| GenKnowSubSetting=Fr, Zero-shot=true, Base Model=Phi-32025.05 | 71.64 | |
| SharedZero-shot=true, Base Model=Phi-32025.05 | 71 | |
| GenKnowSubSetting=En, Zero-shot=true, Base Model=Phi-32025.05 | 70 | |
| Phi-3Zero-shot=true, Base Model=Phi-32025.05 | 68.99 | |
| ArrowZero-shot=true, Base Model=Phi-32025.05 | 68.95 | |
| GenKnowSubBase Model=Phi-2, Setting=Avg, Evaluation Protocol=zero-shot2025.05 | 66.1 | |
| ArrowBase Model=Phi-2, Evaluation Protocol=zero-shot2025.05 | 65.75 | |
| GenKnowSubBase Model=Phi-2, Setting=En, Evaluation Protocol=zero-shot2025.05 | 65.58 | |
| Phi-2Base Model=Phi-2, Evaluation Protocol=zero-shot2025.05 | 63.5 |