Question Answering on OpenBookQA (Open)
88Open AccuracyLD-MoLE
Evaluation Results
| Method | Links | |
|---|---|---|
| LD-MoLEModel=Llama3.1-8B, TP=2.33 %2025.09 | 88 | |
| MoLA(2468)Model=Llama3.1-8B, TP=1.26 %2025.09 | 87.6 | |
| ReMoLEModel=Llama3.1-8B, TP=2.17 %2025.09 | 87.6 | |
| MoLA(8888)Model=Llama3.1-8B, TP=2.17 %2025.09 | 86.4 | |
| LD-MoLEModel=Qwen3-1.7B, TP=4.23 %2025.09 | 85 | |
| ReMoLEModel=Qwen3-1.7B, TP=4.12 %2025.09 | 84.8 | |
| LD-MoLEModel=Llama3.2-3B, TP=3.28 %2025.09 | 84 | |
| MoLA(2468)Model=Llama3.2-3B, TP=1.80 %2025.09 | 83.6 | |
| ReMoLEModel=Llama3.2-3B, TP=3.11 %2025.09 | 83.4 | |
| MoLA(2468)Model=Qwen3-1.7B, TP=2.39 %2025.09 | 83 | |
| MoLA(8888)Model=Qwen3-1.7B, TP=4.12 %2025.09 | 82.4 | |
| MoLA(8888)Model=Llama3.2-3B, TP=3.11 %2025.09 | 81 |