Prompt Injection Attack on Long Code Arena (LCA) 16K context set
80Attack Success Rate (ASR)nanoGCG-OPT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| nanoGCG-OPTTarget LLM=DeepSeek-Coder-6.7B-Instruct, Context length=16,000 tokens2026.04 | 80 | 132.7 | 17,733.6 | |
| FlashRTTarget LLM=DeepSeek-Coder-6.7B-Instruct, Context length=16,000 tokens2026.04 | 80 | 59.1 | 5,265.4 | |
| nanoGCGTarget LLM=DeepSeek-Coder-6.7B-Instruct, Context length=16,000 tokens2026.04 | 52 | 123.2 | 7,564.7 | |
| HeuristicTarget LLM=DeepSeek-Coder-6.7B-Instruct, Context length=16,000 tokens2026.04 | 4 | 0 | 0 |