Prompt Injection Attack on GovReport
0Attack Success Rate (ASR)Heuristic
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| HeuristicMem. (GB)=0.0, Time (s)=0.02026.04 | 0 | — | — | |
| HeuristicModel=Meta-SecAlign-70B, Context length=16K tokens2026.04 | 0 | 0 | 0 | |
| Heuristic AttackLLM=Llama-3.1-8B-Instruct2026.04 | 6 | 0 | 0 | |
| nanoGCGMem. (GB)=79.8, Time (s)=4712.52026.04 | 60 | — | — | |
| Context ClippingLLM=Llama-3.1-8B-Instruct2026.04 | 62 | 34.9 | 461.8 | |
| nanoGCG-OPTMem. (GB)=82.6, Time (s)=3882.12026.04 | 74 | — | — | |
| FlashRTMem. (GB)=34.7, Time (s)=2298.32026.04 | 74 | — | — | |
| nanoGCGLLM=Llama-3.1-8B-Instruct2026.04 | 88 | 82.9 | 3,634.6 | |
| FlashRTModel=Meta-SecAlign-70B, Context length=16K tokens2026.04 | 96 | 219.7 | 1,962.7 | |
| nanoGCG-OPTLLM=Llama-3.1-8B-Instruct2026.04 | 100 | 88.3 | 1,132.3 | |
| FlashRTLLM=Llama-3.1-8B-Instruct2026.04 | 100 | 36.3 | 519.6 |