Tool Selection on X Octopus out-of-domain v2 (test)
97.5Recall@1L_PORTS
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| L_PORTSEncoder=BGE, Best LLM=LLAMA3-8B2026.07 | 97.5 | 100 | 100 | 97.5 | 100 | 100 | 0.84 | 1.17 | |
| L_PORTSEncoder=RoBERTa, Best LLM=LLAMA3-8B2026.07 | 96 | 100 | 100 | 96 | 98.22 | 98.22 | 23.89 | 24.48 | |
| L_replugEncoder=BGE, Best LLM=LLAMA3-GROQ-8B-Tool-Use2026.07 | 95 | 100 | 100 | 95 | 98 | 98 | 0 | 0 | |
| L_replugEncoder=RoBERTa, Best LLM=LLAMA3-8B2026.07 | 80 | 100 | 100 | 80 | 92.62 | 92.62 | 19.16 | 15.41 |