# General Question Answering on PopQA (Accuracy) Source: [General Question Answering on PopQA (Accuracy)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:33:22.007Z Evaluation of model performance on the PopQA dataset for General Question Answering, measured using Accuracy. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | General Question Answering | | Dataset (including any stated split) | PopQA | | Metric | Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 18 of 18 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy](): Higher is better; unit: PERCENT. ## Recorded results | Method | Accuracy | Result date | Report paper | | --- | --- | --- | --- | | SkillOrchestra+ | 48.8 | Not recorded | 699d30a46017c4460ffab56f | | SkillOrchestra | 42.6 | Not recorded | 699d30a46017c4460ffab56f | | Router-R1 | 38.4 | Not recorded | 699d30a46017c4460ffab56f | | RAG | 36.6 | Not recorded | 699d30a46017c4460ffab56f | | FrugalGPT | 36.2 | Not recorded | 699d30a46017c4460ffab56f | | Largest LLM | 35.4 | Not recorded | 699d30a46017c4460ffab56f | | Prompt LLM | 34 | Not recorded | 699d30a46017c4460ffab56f | | Search-R1 | 32.4 | Not recorded | 699d30a46017c4460ffab56f | | RouterDC | 28.2 | Not recorded | 699d30a46017c4460ffab56f | | GraphRouter | 28 | Not recorded | 699d30a46017c4460ffab56f | | Prompt LLM+ | 25.6 | Not recorded | 699d30a46017c4460ffab56f | | KNN Router+ | 23.2 | Not recorded | 699d30a46017c4460ffab56f | | KNN Router | 22.2 | Not recorded | 699d30a46017c4460ffab56f | | MLP Router | 22.2 | Not recorded | 699d30a46017c4460ffab56f | | BERT Router | 19.2 | Not recorded | 699d30a46017c4460ffab56f | | SFT | 16 | Not recorded | 699d30a46017c4460ffab56f | | CoT | 16 | Not recorded | 699d30a46017c4460ffab56f | | Vanilla | 12.2 | Not recorded | 699d30a46017c4460ffab56f | ### SkillOrchestra+ Accuracy: 48.8. Result ID: 699e525c5698665ec411c0e8. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Routing Strategy":"Skill-based Routing","Orchestrator Configuration":"Best/Multiple"}. This record does not assert independent reproduction. ### SkillOrchestra Accuracy: 42.6. Result ID: 699e525c5698665ec411c0e7. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Routing Strategy":"Skill-based Routing","Orchestrator Configuration":"Single"}. This record does not assert independent reproduction. ### Router-R1 Accuracy: 38.4. Result ID: 699e525c5698665ec411c0e6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Routing Strategy":"RL-based Routing"}. This record does not assert independent reproduction. ### RAG Accuracy: 36.6. Result ID: 699e525c5698665ec411c0d9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Routing Strategy":"No Routing"}. This record does not assert independent reproduction. ### FrugalGPT Accuracy: 36.2. Result ID: 699e525c5698665ec411c0e5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Routing Strategy":"Heuristic & Discriminative Routing"}. This record does not assert independent reproduction. ### Largest LLM Accuracy: 35.4. Result ID: 699e525c5698665ec411c0dc. [Reporting paper]() Recorded evaluation configuration: {"Routing Strategy":"Heuristic & Discriminative Routing"}. This record does not assert independent reproduction. ### Prompt LLM Accuracy: 34. Result ID: 699e525c5698665ec411c0dd. [Reporting paper]() Recorded evaluation configuration: {"Routing Strategy":"Heuristic & Discriminative Routing"}. This record does not assert independent reproduction. ### Search-R1 Accuracy: 32.4. Result ID: 699e525c5698665ec411c0db. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Routing Strategy":"No Routing"}. This record does not assert independent reproduction. ### RouterDC Accuracy: 28.2. Result ID: 699e525c5698665ec411c0e3. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Routing Strategy":"Heuristic & Discriminative Routing"}. This record does not assert independent reproduction. ### GraphRouter Accuracy: 28. Result ID: 699e525c5698665ec411c0e4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Routing Strategy":"Heuristic & Discriminative Routing"}. This record does not assert independent reproduction. ### Prompt LLM+ Accuracy: 25.6. Result ID: 699e525c5698665ec411c0de. [Reporting paper]() Recorded evaluation configuration: {"Routing Strategy":"Heuristic & Discriminative Routing","Turn Protocol":"multi turn"}. This record does not assert independent reproduction. ### KNN Router+ Accuracy: 23.2. Result ID: 699e525c5698665ec411c0e0. [Reporting paper]() Recorded evaluation configuration: {"Routing Strategy":"Heuristic & Discriminative Routing","Turn Protocol":"multi turn"}. This record does not assert independent reproduction. ### KNN Router Accuracy: 22.2. Result ID: 699e525c5698665ec411c0df. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Routing Strategy":"Heuristic & Discriminative Routing"}. This record does not assert independent reproduction. ### MLP Router Accuracy: 22.2. Result ID: 699e525c5698665ec411c0e1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Routing Strategy":"Heuristic & Discriminative Routing"}. This record does not assert independent reproduction. ### BERT Router Accuracy: 19.2. Result ID: 699e525c5698665ec411c0e2. [Reporting paper]() Recorded evaluation configuration: {"Routing Strategy":"Heuristic & Discriminative Routing"}. This record does not assert independent reproduction. ### SFT Accuracy: 16. Result ID: 699e525c5698665ec411c0d8. [Reporting paper]() Recorded evaluation configuration: {"Routing Strategy":"No Routing"}. This record does not assert independent reproduction. ### CoT Accuracy: 16. Result ID: 699e525c5698665ec411c0da. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Routing Strategy":"No Routing"}. This record does not assert independent reproduction. ### Vanilla Accuracy: 12.2. Result ID: 699e525c5698665ec411c0d7. [Reporting paper]() Recorded evaluation configuration: {"Routing Strategy":"No Routing"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.