Tool Retrieval on ToolBench I1 (Hit@K)
2.686Hit@1Ada
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| AdaEvaluation Setting=Attack (SEEM), Attack Type=Indiscriminate2025.04 | 2.686 | 5.214 | 7.9 | |
| API-retrieverEvaluation Setting=Attack (SEEM), Attack Type=Indiscriminate2025.04 | 1.814 | 4.122 | 5.628 | |
| BM25Evaluation Setting=Attack (SEEM), Attack Type=Indiscriminate2025.04 | 1.33 | 3.535 | 6.105 | |
| API-retrieverEvaluation Setting=Origin2025.04 | 0.052 | 0.18 | 0.836 | |
| BM25Evaluation Setting=Origin2025.04 | 0 | 0.195 | 0.32 | |
| AdaEvaluation Setting=Origin2025.04 | 0 | 0.008 | 0.231 |