Question Answering on MS-MARCO (ACC, ACC_clean, ASR)
74Accuracy (Clean)ASTUTE RAG
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ASTUTE RAGBase Model=Vicuna-7B2026.05 | 74 | 63 | 14 | |
| Vanilla RAGBase Model=Vicuna-7B2026.05 | 73 | 35 | 33 | |
| RAGForensicsBase Model=Vicuna-7B2026.05 | 68 | 71 | 4 | |
| TrustRAGBase Model=Mistral-7B2026.05 | 67 | 64 | 8 | |
| PRA-RAGBase Model=Vicuna-7B, Variant=cat2026.05 | 65 | 71 | 2 | |
| PRA-RAGBase Model=Vicuna-7B2026.05 | 63 | 68 | 1 | |
| RAGForensicsBase Model=Mistral-7B2026.05 | 62 | 65 | 3 | |
| TrustRAGBase Model=Vicuna-7B2026.05 | 62 | 55 | 6 | |
| RobustRAGBase Model=Mistral-7B, Variant=Keyword2026.05 | 61 | 66 | 12 | |
| PRA-RAGBase Model=Mistral-7B, Variant=cat2026.05 | 59 | 59 | 4 | |
| RobustRAGBase Model=Vicuna-7B, Variant=Keyword2026.05 | 59 | 40 | 7 | |
| Vanilla RAGBase Model=Mistral-7B2026.05 | 58 | 33 | 18 | |
| ASTUTE RAGBase Model=Mistral-7B2026.05 | 58 | 48 | 5 | |
| PRA-RAGBase Model=Mistral-7B2026.05 | 57 | 63 | 1 | |
| InstructRAGBase Model=Vicuna-7B, Variant=ICL2026.05 | 54 | 33 | 20 | |
| InstructRAGBase Model=Mistral-7B, Variant=ICL2026.05 | 48 | 23 | 12 |