Adversarial Attack on NQ
100ASRnanoGCG-OPT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| nanoGCG-OPTLLM=Llama-3.1-8B2026.04 | 100 | 85.8 | 1,387 | |
| FlashRTLLM=Llama-3.1-8B2026.04 | 100 | 29.8 | 488.7 | |
| nanoGCG-OPTLLM=Llama-3.1-13B2026.04 | 100 | 95.8 | 1,211.4 | |
| FlashRTLLM=Llama-3.1-13B2026.04 | 100 | 29.7 | 369.3 | |
| nanoGCG-OPTLLM=Qwen-2.5-7B2026.04 | 100 | 92 | 784.6 | |
| FlashRTLLM=Qwen-2.5-7B2026.04 | 100 | 30.6 | 248 | |
| nanoGCG-OPTLLM=Llama-3.1-8B-Instruct2026.04 | 100 | 85.8 | 1,387 | |
| FlashRTLLM=Llama-3.1-8B-Instruct2026.04 | 100 | 29.8 | 488.7 | |
| FlashRTLLM=Mistral-7B-v0.32026.04 | 96 | 28.8 | 218.5 | |
| nanoGCG-OPTLLM=Mistral-7B-v0.32026.04 | 94 | 95.9 | 766.2 | |
| nanoGCGLLM=Llama-3.1-13B2026.04 | 92 | 86.1 | 1,331 | |
| FlashRTLLM=Llama-3.1-70B2026.04 | 90 | 205.3 | 5,281.5 | |
| nanoGCGLLM=Llama-3.1-8B2026.04 | 88 | 84 | 1,718 | |
| nanoGCGLLM=Llama-3.1-8B-Instruct2026.04 | 88 | 84 | 1,718 | |
| nanoGCGLLM=Qwen-2.5-7B2026.04 | 86 | 87.9 | 900.2 | |
| nanoGCG-OPTLLM=DeepSeek-R1-Distill2026.04 | 86 | 87.6 | 7,627.1 | |
| FlashRTLLM=DeepSeek-R1-Distill2026.04 | 86 | 29.9 | 3,839.2 | |
| nanoGCG-OPTLLM=Qwen-2.5-14B2026.04 | 84 | 151.4 | 4,308.2 | |
| FlashRTLLM=Qwen-2.5-14B2026.04 | 84 | 51.4 | 1,189.5 | |
| nanoGCGLLM=Mistral-7B-v0.32026.04 | 76 | 93 | 2,475.2 | |
| nanoGCGLLM=Qwen-2.5-14B2026.04 | 72 | 143.4 | 2,091.5 | |
| Context ClippingLLM=Llama-3.1-8B-Instruct2026.04 | 66 | 31.8 | 391.8 | |
| Heuristic AttackLLM=Llama-3.1-8B-Instruct2026.04 | 48 | 0 | 0 | |
| nanoGCGLLM=DeepSeek-R1-Distill2026.04 | 4 | 80.4 | 5,535 |