Tool Selection on Octopus v2 (test)
97.5Recall@1L_PORTS
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| L_PORTSEncoder=BGE, Best LLM=LLAMA3-8B2026.07 | 97.5 | 100 | 100 | 97.5 | 100 | 100 | 1.67 | 2.17 | |
| L_PORTSEncoder=RoBERTa, Best LLM=LLAMA3-8B2026.07 | 95 | 100 | 100 | 95 | 95.25 | 98.25 | 71.66 | 70.16 | |
| L_replugEncoder=BGE, Best LLM=LLAMA3-8B2026.07 | 95 | 100 | 100 | 95 | 98 | 98 | 0.83 | 0.22 | |
| L_replugEncoder=RoBERTa, Best LLM=LLAMA3-8B2026.07 | 87.5 | 97.5 | 100 | 87.5 | 95.06 | 95.06 | 68.33 | 66.54 |