Multiple-choice QA on RQA-MC
81AccuracyDecoding_r
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Decoding_rLLM=Mistral-I7B, Defense=Decoding_r2024.05 | 81 | 71 | — | |
| VanillaLLM=Mistral-I7B, Defense=Vanilla2024.05 | 80 | — | — | |
| VanillaLLM=Llama2-C7B, Defense=Vanilla2024.05 | 79 | — | — | |
| Decoding_rLLM=Llama2-C7B, Defense=Decoding_r2024.05 | 78 | 69 | — | |
| No RAGLLM=Llama2-C7B, Defense=No RAG2024.05 | 21 | — | — | |
| No RAGLLM=Mistral-I7B, Defense=No RAG2024.05 | 9 | — | — | |
| No RAGLLM=GPT-3.5, Retrieved passages (k)=0, Corruption size (k')=12024.05 | — | — | 8 | |
| RobustRAG (Keyword)LLM=GPT-3.5, Retrieved passages (k)=10, Corruption size (k')=12024.05 | — | 69.6 | 76.4 | |
| VanillaLLM=GPT-3.5, Retrieved passages (k)=10, Corruption size (k')=12024.05 | — | 0 | 80.4 |