Question Answering on NQ PIA Attack (test)
66.2AccuracyRobustRAG
Evaluation results
| Method | Links | ||
|---|---|---|---|
| RobustRAGPos=50, top-k=502026.05 | 66.2 | 2.6 | |
| ReliabilityRAGPos=50, top-k=502026.05 | 66.2 | 3 | |
| RADARPos=50, top-k=502026.05 | 66.2 | 4.2 | |
| RobustRAGPos=25, top-k=502026.05 | 65.4 | 2.6 | |
| RADARPos=25, top-k=502026.05 | 65.4 | 4.2 | |
| RADARPos=1, top-k=502026.05 | 65 | 6.6 | |
| RobustRAGPos=1, top-k=502026.05 | 62 | 66 | |
| InstructRAGPos=50, top-k=502026.05 | 59.6 | 4.8 | |
| InstructRAGPos=25, top-k=502026.05 | 58.6 | 2.6 | |
| ReliabilityRAGPos=25, top-k=502026.05 | 56.6 | 1.8 | |
| ReliabilityRAGPos=1, top-k=502026.05 | 51.2 | 15.4 | |
| Vanilla RAGPos=25, top-k=502026.05 | 47.6 | 40 | |
| Vanilla RAGPos=50, top-k=502026.05 | 41 | 48.2 | |
| AstuteRAGPos=25, top-k=502026.05 | 29 | 0.8 | |
| InstructRAGPos=1, top-k=502026.05 | 27.8 | 57 | |
| AstuteRAGPos=50, top-k=502026.05 | 27.4 | 1.4 | |
| AstuteRAGPos=1, top-k=502026.05 | 22 | 5.2 | |
| Vanilla RAGPos=1, top-k=502026.05 | 15.2 | 83.4 |