Tool Selection Attack on ToolBench (test)
91TDRToolFlood
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| ToolFloodAverage injection budget (Avg. B)=145, Poisoning rate (Avg. PR)=1.2%, Retriever=text-embedding-3-small, Top-k=52026.03 | 91 | 94.6 | 95 | 96.1 | |
| PoisonedRAGAverage injection budget (Avg. B)=100, Poisoning rate (Avg. PR)=0.85%, Retriever=text-embedding-3-small, Top-k=52026.03 | 82 | 91.4 | 90.9 | 92 | |
| Random-Sybil InjectionAverage injection budget (Avg. B)=200, Poisoning rate (Avg. PR)=1.7%, Retriever=text-embedding-3-small, Top-k=52026.03 | 0 | 1 | 0.4 | 0.2 |