General Question Answering on PopQA (Accuracy)
48.8AccuracySkillOrchestra+
Evaluation results
| Method | Links | |
|---|---|---|
| SkillOrchestra+Routing Strategy=Skill-based Routing, Orchestrator Configuration=Best/Multiple2026.02 | 48.8 | |
| SkillOrchestraRouting Strategy=Skill-based Routing, Orchestrator Configuration=Single2026.02 | 42.6 | |
| Router-R1Routing Strategy=RL-based Routing2026.02 | 38.4 | |
| RAGRouting Strategy=No Routing2026.02 | 36.6 | |
| FrugalGPTRouting Strategy=Heuristic & Discriminative Routing2026.02 | 36.2 | |
| Largest LLMRouting Strategy=Heuristic & Discriminative Routing2026.02 | 35.4 | |
| Prompt LLMRouting Strategy=Heuristic & Discriminative Routing2026.02 | 34 | |
| Search-R1Routing Strategy=No Routing2026.02 | 32.4 | |
| RouterDCRouting Strategy=Heuristic & Discriminative Routing2026.02 | 28.2 | |
| GraphRouterRouting Strategy=Heuristic & Discriminative Routing2026.02 | 28 | |
| Prompt LLM+Routing Strategy=Heuristic & Discriminative Routing, Turn Protocol=multi turn2026.02 | 25.6 | |
| KNN Router+Routing Strategy=Heuristic & Discriminative Routing, Turn Protocol=multi turn2026.02 | 23.2 | |
| KNN RouterRouting Strategy=Heuristic & Discriminative Routing2026.02 | 22.2 | |
| MLP RouterRouting Strategy=Heuristic & Discriminative Routing2026.02 | 22.2 | |
| BERT RouterRouting Strategy=Heuristic & Discriminative Routing2026.02 | 19.2 | |
| SFTRouting Strategy=No Routing2026.02 | 16 | |
| CoTRouting Strategy=No Routing2026.02 | 16 | |
| VanillaRouting Strategy=No Routing2026.02 | 12.2 |