Tool Selection on APIBench (test)
30.64Recall@1L_PORTS
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| L_PORTSEncoder=BGE, Best LLM=LLAMA3-GROQ-8B-Tool-Use2026.07 | 30.64 | 37.2 | 41.06 | 30.64 | 33.9 | 35.2 | 20.18 | 17.26 | |
| L_PORTSEncoder=RoBERTa, Best LLM=LLAMA3-GROQ-8B-Tool-Use2026.07 | 21.5 | 27.4 | 30.53 | 21.5 | 25.22 | 26.78 | 25.94 | 23.5 | |
| L_replugEncoder=BGE, Best LLM=LLAMA3-8B2026.07 | 19.55 | 28.29 | 33.05 | 19.55 | 27.45 | 30.02 | 10.84 | 10.67 | |
| L_replugEncoder=RoBERTa, Best LLM=LLAMA3-8B2026.07 | 8.74 | 12.61 | 15.35 | 8.74 | 12.55 | 14.56 | 10.7 | 10.95 |