Question Answering on TQA Poison Attack (test)
75.6AccuracyReliabilityRAG
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| ReliabilityRAGPos=50, top-k=502026.05 | 75.6 | 4.4 | |
| ReliabilityRAGPos=25, top-k=502026.05 | 74.2 | 7.8 | |
| Vanilla RAGPos=50, top-k=502026.05 | 73.8 | 15.6 | |
| RADARPos=50, top-k=502026.05 | 70.4 | 15.2 | |
| RADARPos=25, top-k=502026.05 | 69.6 | 16.8 | |
| Vanilla RAGPos=25, top-k=502026.05 | 68.8 | 26 | |
| RobustRAGPos=50, top-k=502026.05 | 68.8 | 11.4 | |
| RobustRAGPos=25, top-k=502026.05 | 68.6 | 11.8 | |
| RADARPos=1, top-k=502026.05 | 65 | 23.2 | |
| ReliabilityRAGPos=1, top-k=502026.05 | 59.8 | 33.4 | |
| RobustRAGPos=1, top-k=502026.05 | 59.4 | 26.2 | |
| InstructRAGPos=50, top-k=502026.05 | 58.4 | 15.2 | |
| InstructRAGPos=25, top-k=502026.05 | 57 | 17.2 | |
| AstuteRAGPos=25, top-k=502026.05 | 43.4 | 5 | |
| AstuteRAGPos=50, top-k=502026.05 | 43.2 | 4.4 | |
| AstuteRAGPos=1, top-k=502026.05 | 38.6 | 10.6 | |
| InstructRAGPos=1, top-k=502026.05 | 38.2 | 43 | |
| Vanilla RAGPos=1, top-k=502026.05 | 37.4 | 58.4 |