Multi-hop Question Answering on MuSiQue (% Cost Saving)
159.2Cost SavingAdaptive-RAG (Extended)
Evaluation Results
| Method | Links | |
|---|---|---|
| Adaptive-RAG (Extended)Accuracy Goal=95%2026.05 | 159.2 | |
| Adaptive-RAG (Extended)Accuracy Goal=90%2026.05 | 159.2 | |
| CARROT-RoBERTa (LLM-only)Accuracy Goal=90%2026.05 | 92.3 | |
| BRANEAccuracy Goal=100%2026.05 | 89.4 | |
| CARROT-KNN (Extended)Accuracy Goal=95%2026.05 | 77 | |
| CARROT-RoBERTa (Extended)Accuracy Goal=95%2026.05 | 59.2 | |
| CARROT-KNN (Extended)Accuracy Goal=90%2026.05 | 57.5 | |
| CARROT-RoBERTa (Extended)Accuracy Goal=90%2026.05 | 44.6 | |
| BRANEAccuracy Goal=90%2026.05 | 40.7 | |
| BRANEAccuracy Goal=95%2026.05 | 17.3 | |
| CARROT-RoBERTa (Extended)Accuracy Goal=100%2026.05 | 2.4 | |
| Most Accurate Static (Murakkab)Accuracy Goal=100%2026.05 | 0 | |
| Most Accurate Static (Murakkab)Accuracy Goal=95%2026.05 | 0 | |
| Most Accurate Static (Murakkab)Accuracy Goal=90%2026.05 | 0 |