Tool Retrieval on ToolBench I3 conditional attack setting
70.51Hit@1BM25
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| BM25Attack Status=Attack (SEEM)2025.04 | 70.51 | 89.01 | 93.72 | |
| AdaAttack Status=Attack (SEEM)2025.04 | 59.11 | 84.27 | 96.38 | |
| API-retrieverAttack Status=Attack (SEEM)2025.04 | 45.53 | 81.35 | 93 | |
| AdaAttack Status=Origin2025.04 | 12.89 | 53.39 | 82.29 | |
| API-retrieverAttack Status=Origin2025.04 | 12.44 | 38.64 | 66.33 | |
| BM25Attack Status=Origin2025.04 | 9.93 | 34.11 | 57.04 |