Science Knowledge on SciQ
90.9AccuracySYNPRO
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| SYNPROModel Size=1.1B, Alpha (organic token ratio)=10%2026.05 | 90.9 | — | — | — | |
| VGLR-MFMoE Architecture=Granite-MoE, Category=Ours2026.03 | 88.4 | 0.297 | 1.9 | 38.7 | |
| VGLR-FCMoE Architecture=Granite-MoE, Category=Ours2026.03 | 88.4 | 0.298 | 1.3 | 32 | |
| MCDRMoE Architecture=Granite-MoE, Category=Weight2026.03 | 88 | 0.296 | 2.9 | 36.6 | |
| SWAGMoE Architecture=Granite-MoE, Category=Weight2026.03 | 87.9 | 0.291 | 3.1 | 39.2 | |
| Temp-ScaleMoE Architecture=Granite-MoE, Category=Base2026.03 | 87.8 | 0.309 | 4.7 | 64.9 | |
| Temp-ScaleMoE Architecture=Qwen-MoE, Category=Base2026.03 | 87.6 | 1.123 | 11.1 | 66.9 | |
| VTSRMoE Architecture=Granite-MoE, Category=Ours2026.03 | 87.4 | 0.299 | 2.2 | 35.2 | |
| MAPMoE Architecture=Qwen-MoE, Category=Base2026.03 | 87.2 | 1.32 | 27.4 | 64.8 | |
| VTSRMoE Architecture=Qwen-MoE, Category=Ours2026.03 | 87 | 0.659 | 4 | 43 | |
| VGLR-MFMoE Architecture=Qwen-MoE, Category=Ours2026.03 | 86.2 | 0.674 | 9.5 | 44.3 | |
| VGLR-FCMoE Architecture=Qwen-MoE, Category=Ours2026.03 | 85.8 | 0.668 | 2.3 | 33.9 | |
| MCDRMoE Architecture=Qwen-MoE, Category=Weight2026.03 | 85.4 | 0.884 | 19.9 | 58.6 | |
| MAPMoE Architecture=Granite-MoE, Category=Base2026.03 | 85 | 0.791 | 22.3 | 45.2 | |
| VGLR-FCMoE Architecture=DeepSeek-MoE, Category=Ours2026.03 | 84 | 0.292 | 1.6 | 22 | |
| VGLR-MFMoE Architecture=DeepSeek-MoE, Category=Ours2026.03 | 83.8 | 0.297 | 9.5 | 48.4 | |
| MAPMoE Architecture=DeepSeek-MoE, Category=Base2026.03 | 83.2 | 1.124 | 27.9 | 89.8 | |
| VTSRMoE Architecture=DeepSeek-MoE, Category=Ours2026.03 | 83 | 0.291 | 4.7 | 36 | |
| SWAGMoE Architecture=Qwen-MoE, Category=Weight2026.03 | 82.9 | 0.875 | 20.3 | 51.1 | |
| Temp-ScaleMoE Architecture=DeepSeek-MoE, Category=Base2026.03 | 82.8 | 0.642 | 12.1 | 51.1 | |
| SWAGMoE Architecture=DeepSeek-MoE, Category=Weight2026.03 | 82.8 | 0.298 | 21.2 | 59.2 | |
| MCDRMoE Architecture=DeepSeek-MoE, Category=Weight2026.03 | 82.6 | 0.296 | 20.4 | 64.8 |