Retrieval-Augmented Question Answering on NQ (PIA/PoisonedRAG Evaluation)
89Clean AccuracyVanillaRAG
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| VanillaRAGModel=Llama-3.1-8B, Retriever=DPR2026.05 | 89 | 31 | 65 | 84 | 68 | |
| VanillaRAGModel=Llama-3.1-8B, Retriever=ANCE2026.05 | 88 | 21 | 72 | 83 | 78 | |
| VanillaRAGModel=Llama-3.1-8B, Retriever=Contriever2026.05 | 87 | 30 | 77 | 85 | 76 | |
| InstructRAGModel=Llama-3.1-8B, Retriever=ANCE, Venue=ICLR ’252026.05 | 83 | 34 | 81 | 59 | 67 | |
| InstructRAGModel=Llama-3.1-8B, Retriever=Contriever, Venue=ICLR ’252026.05 | 83 | 31 | 81 | 57 | 68 | |
| VanillaRAGModel=Mistral-7B, Retriever=DPR2026.05 | 80 | 29 | 56 | 91 | 18 | |
| BiRDModel=Llama-3.1-8B, Retriever=Contriever, Venue=Ours2026.05 | 79 | 29 | 80 | 19 | 82 | |
| InstructRAGModel=Llama-3.1-8B, Retriever=DPR, Venue=ICLR ’252026.05 | 78 | 34 | 75 | 69 | 62 | |
| VanillaRAGModel=Qwen2.5-7B, Retriever=Contriever2026.05 | 77 | 26 | 69 | 89 | 34 | |
| VanillaRAGModel=Mistral-7B, Retriever=ANCE2026.05 | 77 | 16 | 60 | 93 | 16 | |
| BiRDModel=Llama-3.1-8B, Retriever=DPR, Venue=Ours2026.05 | 77 | 38 | 66 | 28 | 75 | |
| VanillaRAGModel=Qwen2.5-7B, Retriever=ANCE2026.05 | 76 | 20 | 59 | 87 | 37 | |
| VanillaRAGModel=Mistral-7B, Retriever=Contriever2026.05 | 76 | 20 | 59 | 91 | 20 | |
| VanillaRAGModel=Qwen2.5-7B, Retriever=DPR2026.05 | 73 | 29 | 58 | 87 | 44 | |
| BiRDModel=Llama-3.1-8B, Retriever=ANCE, Venue=Ours2026.05 | 72 | 18 | 72 | 15 | 79 | |
| InstructRAGModel=Qwen2.5-7B, Retriever=ANCE, Venue=ICLR ’252026.05 | 68 | 55 | 49 | 77 | 29 | |
| BiRDModel=Mistral-7B, Retriever=DPR, Venue=Ours2026.05 | 66 | 29 | 55 | 24 | 65 | |
| BiRDModel=Mistral-7B, Retriever=Contriever, Venue=Ours2026.05 | 65 | 20 | 64 | 10 | 72 | |
| BiRDModel=Qwen2.5-7B, Retriever=DPR, Venue=Ours2026.05 | 64 | 25 | 60 | 30 | 63 | |
| InstructRAGModel=Qwen2.5-7B, Retriever=Contriever, Venue=ICLR ’252026.05 | 63 | 51 | 57 | 79 | 24 | |
| InstructRAGModel=Qwen2.5-7B, Retriever=DPR, Venue=ICLR ’252026.05 | 63 | 54 | 48 | 79 | 32 | |
| RobustRAGModel=Qwen2.5-7B, Retriever=Contriever, Venue=arXiv ’242026.05 | 62 | 79 | 49 | 62 | 42 | |
| BiRDModel=Qwen2.5-7B, Retriever=Contriever, Venue=Ours2026.05 | 62 | 25 | 71 | 16 | 62 | |
| BiRDModel=Mistral-7B, Retriever=ANCE, Venue=Ours2026.05 | 62 | 19 | 61 | 6 | 71 | |
| BiRDModel=Qwen2.5-7B, Retriever=ANCE, Venue=Ours2026.05 | 61 | 22 | 64 | 8 | 75 | |
| RobustRAGModel=Qwen2.5-7B, Retriever=ANCE, Venue=arXiv ’242026.05 | 60 | 74 | 48 | 61 | 40 | |
| RobustRAGModel=Qwen2.5-7B, Retriever=DPR, Venue=arXiv ’242026.05 | 60 | 70 | 50 | 62 | 43 | |
| ReliabilityRAGModel=Qwen2.5-7B, Retriever=DPR, Venue=NeurIPS ’252026.05 | 55 | 32 | 50 | 70 | 41 | |
| ReliabilityRAGModel=Qwen2.5-7B, Retriever=Contriever, Venue=NeurIPS ’252026.05 | 54 | 40 | 44 | 70 | 53 | |
| ReliabilityRAGModel=Qwen2.5-7B, Retriever=ANCE, Venue=NeurIPS ’252026.05 | 48 | 41 | 44 | 61 | 43 | |
| InstructRAGModel=Mistral-7B, Retriever=ANCE, Venue=ICLR ’252026.05 | 38 | 48 | 39 | 63 | 27 | |
| RobustRAGModel=Llama-3.1-8B, Retriever=ANCE, Venue=arXiv ’242026.05 | 36 | 75 | 52 | 50 | 45 | |
| ReliabilityRAGModel=Llama-3.1-8B, Retriever=Contriever, Venue=NeurIPS ’252026.05 | 31 | 64 | 44 | 46 | 33 | |
| InstructRAGModel=Mistral-7B, Retriever=DPR, Venue=ICLR ’252026.05 | 30 | 34 | 48 | 55 | 31 | |
| RobustRAGModel=Llama-3.1-8B, Retriever=Contriever, Venue=arXiv ’242026.05 | 30 | 79 | 57 | 45 | 33 | |
| InstructRAGModel=Mistral-7B, Retriever=Contriever, Venue=ICLR ’252026.05 | 25 | 39 | 51 | 54 | 33 | |
| RobustRAGModel=Llama-3.1-8B, Retriever=DPR, Venue=arXiv ’242026.05 | 25 | 72 | 59 | 51 | 44 | |
| ReliabilityRAGModel=Llama-3.1-8B, Retriever=DPR, Venue=NeurIPS ’252026.05 | 24 | 64 | 39 | 52 | 42 | |
| ReliabilityRAGModel=Llama-3.1-8B, Retriever=ANCE, Venue=NeurIPS ’252026.05 | 22 | 68 | 44 | 50 | 39 | |
| RobustRAGModel=Mistral-7B, Retriever=ANCE, Venue=arXiv ’242026.05 | 21 | 33 | 15 | 40 | 17 | |
| RobustRAGModel=Mistral-7B, Retriever=Contriever, Venue=arXiv ’242026.05 | 17 | 33 | 14 | 49 | 18 | |
| RobustRAGModel=Mistral-7B, Retriever=DPR, Venue=arXiv ’242026.05 | 16 | 34 | 18 | 45 | 14 | |
| ReliabilityRAGModel=Mistral-7B, Retriever=ANCE, Venue=NeurIPS ’252026.05 | 12 | 29 | 17 | 40 | 18 | |
| ReliabilityRAGModel=Mistral-7B, Retriever=DPR, Venue=NeurIPS ’252026.05 | 12 | 28 | 11 | 41 | 15 | |
| ReliabilityRAGModel=Mistral-7B, Retriever=Contriever, Venue=NeurIPS ’252026.05 | 9 | 18 | 15 | 35 | 14 |