Question Answering on RQA (test)
79AccuracySampling + MIS
Evaluation results
| Method | Links | |
|---|---|---|
| Sampling + MISModel=GPT-4o-mini, Attack Position=@Pos 25, k=502025.09 | 79 | |
| Sampling + MISModel=GPT-4o-mini, Attack Position=Benign, k=502025.09 | 77 | |
| Sampling + MISModel=GPT-4o-mini, Attack Position=@Pos 50, k=502025.09 | 77 | |
| Sampling + MISModel=Mistral-7B, Attack Position=Benign, k=502025.09 | 72 | |
| Sampling + MISModel=Mistral-7B, Attack Position=@Pos 50, k=502025.09 | 72 | |
| InstructRAGModel=Llama3.2-3B, Attack Position=Benign, k=502025.09 | 72 | |
| Sampling + MISModel=Llama3.2-3B, Attack Position=Benign, k=502025.09 | 71 | |
| Sampling + MISModel=Llama3.2-3B, Attack Position=@Pos 50, k=502025.09 | 71 | |
| Vanilla RAGModel=GPT-4o-mini, Attack Position=Benign, k=502025.09 | 71 | |
| InstructRAGModel=Mistral-7B, Attack Position=Benign, k=502025.09 | 69 | |
| Sampling + MISModel=GPT-4o-mini, Attack Position=@Pos 1, k=502025.09 | 69 | |
| Sampling + MISModel=Mistral-7B, Attack Position=@Pos 25, k=502025.09 | 68 | |
| AstuteRAGModel=Llama3.2-3B, Attack Position=Benign, k=502025.09 | 68 | |
| Sampling + MISModel=Llama3.2-3B, Attack Position=@Pos 25, k=502025.09 | 68 | |
| Vanilla RAGModel=Mistral-7B, Attack Position=Benign, k=502025.09 | 67 | |
| Vanilla RAGModel=GPT-4o-mini, Attack Position=@Pos 25, k=502025.09 | 66 | |
| RobustRAGModel=GPT-4o-mini, Attack Position=Benign, k=502025.09 | 66 | |
| Sampling + MISModel=Llama3.2-3B, Attack Position=@Pos 1, k=502025.09 | 65 | |
| InstructRAGModel=GPT-4o-mini, Attack Position=Benign, k=502025.09 | 65 | |
| RobustRAGModel=GPT-4o-mini, Attack Position=@Pos 1, k=502025.09 | 63 | |
| RobustRAGModel=GPT-4o-mini, Attack Position=@Pos 50, k=502025.09 | 63 | |
| Vanilla RAGModel=Llama3.2-3B, Attack Position=Benign, k=502025.09 | 62 | |
| InstructRAGModel=GPT-4o-mini, Attack Position=@Pos 50, k=502025.09 | 62 | |
| RobustRAGModel=GPT-4o-mini, Attack Position=@Pos 25, k=502025.09 | 61 | |
| AstuteRAGModel=GPT-4o-mini, Attack Position=@Pos 25, k=502025.09 | 58 | |
| InstructRAGModel=GPT-4o-mini, Attack Position=@Pos 25, k=502025.09 | 58 | |
| InstructRAGModel=GPT-4o-mini, Attack Position=@Pos 1, k=502025.09 | 56 | |
| RobustRAGModel=Llama3.2-3B, Attack Position=Benign, k=502025.09 | 55 | |
| RobustRAGModel=Llama3.2-3B, Attack Position=@Pos 50, k=502025.09 | 55 | |
| Vanilla RAGModel=GPT-4o-mini, Attack Position=@Pos 50, k=502025.09 | 55 | |
| Sampling + MISModel=Mistral-7B, Attack Position=@Pos 1, k=502025.09 | 54 | |
| RobustRAGModel=Llama3.2-3B, Attack Position=@Pos 1, k=502025.09 | 54 | |
| AstuteRAGModel=GPT-4o-mini, Attack Position=Benign, k=502025.09 | 54 | |
| RobustRAGModel=Llama3.2-3B, Attack Position=@Pos 25, k=502025.09 | 52 | |
| RobustRAGModel=Mistral-7B, Attack Position=Benign, k=502025.09 | 51 | |
| RobustRAGModel=Mistral-7B, Attack Position=@Pos 25, k=502025.09 | 51 | |
| RobustRAGModel=Mistral-7B, Attack Position=@Pos 50, k=502025.09 | 51 | |
| AstuteRAGModel=GPT-4o-mini, Attack Position=@Pos 1, k=502025.09 | 50 | |
| AstuteRAGModel=GPT-4o-mini, Attack Position=@Pos 50, k=502025.09 | 50 | |
| RobustRAGModel=Mistral-7B, Attack Position=@Pos 1, k=502025.09 | 48 | |
| Vanilla RAGModel=GPT-4o-mini, Attack Position=@Pos 1, k=502025.09 | 44 | |
| Vanilla RAGModel=Mistral-7B, Attack Position=@Pos 1, k=502025.09 | 41 | |
| Vanilla RAGModel=Llama3.2-3B, Attack Position=@Pos 1, k=502025.09 | 39 | |
| AstuteRAGModel=Llama3.2-3B, Attack Position=@Pos 50, k=502025.09 | 30 | |
| InstructRAGModel=Mistral-7B, Attack Position=@Pos 25, k=502025.09 | 27 | |
| Vanilla RAGModel=Llama3.2-3B, Attack Position=@Pos 25, k=502025.09 | 27 | |
| AstuteRAGModel=Mistral-7B, Attack Position=Benign, k=502025.09 | 26 | |
| InstructRAGModel=Mistral-7B, Attack Position=@Pos 1, k=502025.09 | 24 | |
| InstructRAGModel=Llama3.2-3B, Attack Position=@Pos 50, k=502025.09 | 24 | |
| Vanilla RAGModel=Llama3.2-3B, Attack Position=@Pos 50, k=502025.09 | 23 | |
| AstuteRAGModel=Mistral-7B, Attack Position=@Pos 1, k=502025.09 | 22 | |
| Vanilla RAGModel=Mistral-7B, Attack Position=@Pos 25, k=502025.09 | 20 | |
| AstuteRAGModel=Llama3.2-3B, Attack Position=@Pos 25, k=502025.09 | 20 | |
| InstructRAGModel=Llama3.2-3B, Attack Position=@Pos 25, k=502025.09 | 20 | |
| AstuteRAGModel=Mistral-7B, Attack Position=@Pos 25, k=502025.09 | 17 | |
| InstructRAGModel=Mistral-7B, Attack Position=@Pos 50, k=502025.09 | 13 | |
| AstuteRAGModel=Mistral-7B, Attack Position=@Pos 50, k=502025.09 | 11 | |
| Vanilla RAGModel=Mistral-7B, Attack Position=@Pos 50, k=502025.09 | 9 | |
| InstructRAGModel=Llama3.2-3B, Attack Position=@Pos 1, k=502025.09 | 5 | |
| AstuteRAGModel=Llama3.2-3B, Attack Position=@Pos 1, k=502025.09 | 4 |