Question Answering on SimpleQA (Score)
56.3ScoreMoMA Router
Evaluation results
| Method | Links | |
|---|---|---|
| MoMA RouterRouting Strategy=Performance-priority, Cost=10.042026.05 | 56.3 | |
| Qwen3-235B-A22BCost=14.652026.05 | 54.3 | |
| SFT-based Classification RouterRouting Strategy=Auto-routing, Cost=8.6672026.05 | 40.7 | |
| Contrastive learning based RouterRouting Strategy=Performance-priority, Cost=12.4982026.05 | 38.7 | |
| Deepseek-R1Cost=12.3272026.05 | 27.8 | |
| Deepseek-V3Cost=9.4982026.05 | 24.9 | |
| MoMA RouterRouting Strategy=Auto-routing, Cost=6.3062026.05 | 19.5 | |
| Contrastive learning based RouterRouting Strategy=Auto-routing, Cost=6.9402026.05 | 17.8 | |
| Contrastive learning based RouterRouting Strategy=Cost-priority, Cost=1.6672026.05 | 14.2 | |
| MoMA RouterRouting Strategy=Cost-priority, Cost=1.3572026.05 | 12.1 | |
| Qwen3-32BCost=14.652026.05 | 8 |