List your company
ResearchFormerly WizWand

Question Answering on NQ (Natural Questions) (test)

68.6AccuracySampling + MIS
8.2823.9439.655.26Sep 27, 2025
Updated 8mo ago

Evaluation results

MethodLinks
Sampling + MISModel=GPT-4o-mini, Attack Position=Benign, k=502025.0968.6
Sampling + MISModel=GPT-4o-mini, Attack Position=@Pos 50, k=502025.0968.6
Sampling + MISModel=GPT-4o-mini, Attack Position=@Pos 25, k=502025.0967.4
InstructRAGModel=Mistral-7B, Attack Position=Benign, k=502025.0965.8
Vanilla RAGModel=GPT-4o-mini, Attack Position=Benign, k=502025.0965.4
AstuteRAGModel=Llama3.2-3B, Attack Position=Benign, k=502025.0964.2
InstructRAGModel=Llama3.2-3B, Attack Position=Benign, k=502025.0963.8
RobustRAGModel=GPT-4o-mini, Attack Position=Benign, k=502025.0963.4
RobustRAGModel=GPT-4o-mini, Attack Position=@Pos 25, k=502025.0963.4
RobustRAGModel=GPT-4o-mini, Attack Position=@Pos 50, k=502025.0963
Sampling + MISModel=Mistral-7B, Attack Position=Benign, k=502025.0962.8
Vanilla RAGModel=Mistral-7B, Attack Position=Benign, k=502025.0960.8
Sampling + MISModel=GPT-4o-mini, Attack Position=@Pos 1, k=502025.0960.8
RobustRAGModel=GPT-4o-mini, Attack Position=@Pos 1, k=502025.0960.6
Sampling + MISModel=Mistral-7B, Attack Position=@Pos 50, k=502025.0960
AstuteRAGModel=GPT-4o-mini, Attack Position=Benign, k=502025.0959.6
Sampling + MISModel=Mistral-7B, Attack Position=@Pos 25, k=502025.0959
AstuteRAGModel=GPT-4o-mini, Attack Position=@Pos 50, k=502025.0958.2
Sampling + MISModel=Llama3.2-3B, Attack Position=Benign, k=502025.0958
AstuteRAGModel=GPT-4o-mini, Attack Position=@Pos 1, k=502025.0957.2
Sampling + MISModel=Llama3.2-3B, Attack Position=@Pos 50, k=502025.0956
AstuteRAGModel=GPT-4o-mini, Attack Position=@Pos 25, k=502025.0955.6
Sampling + MISModel=Llama3.2-3B, Attack Position=@Pos 25, k=502025.0955.4
Vanilla RAGModel=GPT-4o-mini, Attack Position=@Pos 25, k=502025.0955.2
Vanilla RAGModel=Llama3.2-3B, Attack Position=Benign, k=502025.0955
InstructRAGModel=GPT-4o-mini, Attack Position=Benign, k=502025.0954.6
RobustRAGModel=Llama3.2-3B, Attack Position=@Pos 50, k=502025.0954.4
AstuteRAGModel=Mistral-7B, Attack Position=Benign, k=502025.0954.2
RobustRAGModel=Llama3.2-3B, Attack Position=Benign, k=502025.0953.6
RobustRAGModel=Llama3.2-3B, Attack Position=@Pos 25, k=502025.0953.4
RobustRAGModel=Llama3.2-3B, Attack Position=@Pos 1, k=502025.0952.8
Sampling + MISModel=Mistral-7B, Attack Position=@Pos 1, k=502025.0951.6
Sampling + MISModel=Llama3.2-3B, Attack Position=@Pos 1, k=502025.0950.4
InstructRAGModel=GPT-4o-mini, Attack Position=@Pos 1, k=502025.0949.6
Vanilla RAGModel=GPT-4o-mini, Attack Position=@Pos 50, k=502025.0949.4
InstructRAGModel=GPT-4o-mini, Attack Position=@Pos 50, k=502025.0949.4
InstructRAGModel=Mistral-7B, Attack Position=@Pos 1, k=502025.0948.2
AstuteRAGModel=Mistral-7B, Attack Position=@Pos 1, k=502025.0947.6
RobustRAGModel=Mistral-7B, Attack Position=Benign, k=502025.0947.4
RobustRAGModel=Mistral-7B, Attack Position=@Pos 50, k=502025.0947
RobustRAGModel=Mistral-7B, Attack Position=@Pos 25, k=502025.0946.6
RobustRAGModel=Mistral-7B, Attack Position=@Pos 1, k=502025.0946.4
InstructRAGModel=GPT-4o-mini, Attack Position=@Pos 25, k=502025.0946
AstuteRAGModel=Mistral-7B, Attack Position=@Pos 25, k=502025.0943.6
Vanilla RAGModel=Mistral-7B, Attack Position=@Pos 1, k=502025.0940.4
Vanilla RAGModel=Llama3.2-3B, Attack Position=@Pos 1, k=502025.0939.4
InstructRAGModel=Mistral-7B, Attack Position=@Pos 25, k=502025.0937.8
AstuteRAGModel=Mistral-7B, Attack Position=@Pos 50, k=502025.0937.2
Vanilla RAGModel=GPT-4o-mini, Attack Position=@Pos 1, k=502025.0930.2
InstructRAGModel=Mistral-7B, Attack Position=@Pos 50, k=502025.0927.6
AstuteRAGModel=Llama3.2-3B, Attack Position=@Pos 50, k=502025.0926
AstuteRAGModel=Llama3.2-3B, Attack Position=@Pos 25, k=502025.0922.4
Vanilla RAGModel=Mistral-7B, Attack Position=@Pos 25, k=502025.0920.6
Vanilla RAGModel=Llama3.2-3B, Attack Position=@Pos 25, k=502025.0915.2
InstructRAGModel=Llama3.2-3B, Attack Position=@Pos 1, k=502025.0914.2
Vanilla RAGModel=Llama3.2-3B, Attack Position=@Pos 50, k=502025.0913.8
InstructRAGModel=Llama3.2-3B, Attack Position=@Pos 50, k=502025.0913.4
Vanilla RAGModel=Mistral-7B, Attack Position=@Pos 50, k=502025.0911.8
InstructRAGModel=Llama3.2-3B, Attack Position=@Pos 25, k=502025.0911.4
AstuteRAGModel=Llama3.2-3B, Attack Position=@Pos 1, k=502025.0910.6