Reasoning on ARC-E Corrupt Setting
60.9Accuracy (ARC-E Corrupt)USMoE
Evaluation Results
| Method | Links | |
|---|---|---|
| USMoEModel=Qwen3-30B-A3B-Instruct, Evaluation Protocol=0-shot2025.03 | 60.9 | |
| USMoEModel=Qwen3-30B-A3B-Thinking, Evaluation Protocol=0-shot2025.03 | 55.8 | |
| Expert Choice (EC)Model=Qwen3-30B-A3B-Instruct, Evaluation Protocol=0-shot2025.03 | 48.3 | |
| Expert Choice (EC)Model=Qwen3-30B-A3B-Thinking, Evaluation Protocol=0-shot2025.03 | 44.2 | |
| OriginalModel=Qwen3-30B-A3B-Instruct, Selection Strategy=Token Choice (TC), Evaluation Protocol=0-shot2025.03 | 36.1 | |
| OriginalModel=Qwen3-30B-A3B-Thinking, Selection Strategy=Token Choice (TC), Evaluation Protocol=0-shot2025.03 | 34.1 | |
| MoEEModel=Qwen3-30B-A3B-Instruct, Selection Strategy=Token Choice (TC), Evaluation Protocol=0-shot2025.03 | 23.9 | |
| MoEEModel=Qwen3-30B-A3B-Thinking, Selection Strategy=Token Choice (TC), Evaluation Protocol=0-shot2025.03 | 23.7 |