Tool Retrieval on TOOLRET Zero-Shot Code
32nDCG@10TOOLQP
Evaluation results
| Method | Links | ||
|---|---|---|---|
| TOOLQPMethod Category=Fine-tuning, Training Data Size=10k, Backbone Model=1.7B2026.01 | 32 | 41.2 | |
| Q2P/SFTMethod Category=Fine-tuning, Training Data Size=10k, Backbone Model=1.5B/1.7B models2026.01 | 29.4 | 38 | |
| bge-gemmaMethod Category=Re-ranking with cross-encoder2026.01 | 27.7 | 33.3 | |
| Q2E/PRFMethod Category=Prompting, Backbone Model=Qwen3-30B-A3B-Instruct2026.01 | 26.8 | 33.1 | |
| Q2E/ZSMethod Category=Prompting, Backbone Model=Qwen3-30B-A3B-Instruct2026.01 | 26.5 | 34 | |
| gte-Qwen/ContrastiveFTMethod Category=Fine-tuning, Training Data Size=10k, Backbone Model=1.5B/1.7B models2026.01 | 26.4 | 32.9 | |
| Q2D/PRFMethod Category=Prompting, Backbone Model=Qwen3-30B-A3B-Instruct2026.01 | 26.1 | 31.1 | |
| Re-InvokeMethod Category=Prompting, Backbone Model=Qwen3-30B-A3B-Instruct2026.01 | 26 | 33.5 | |
| D2QMethod Category=Prompting, Backbone Model=Qwen3-30B-A3B-Instruct2026.01 | 25.4 | 32 | |
| HyDE/PRFMethod Category=Prompting, Backbone Model=Qwen3-30B-A3B-Instruct2026.01 | 24.8 | 28.6 | |
| bge-m3Method Category=Re-ranking with cross-encoder2026.01 | 24.7 | 31.6 | |
| Base Retriever (gte-Qwen)Method Category=Base Retriever2026.01 | 24.1 | 30.8 | |
| TOOLQP-FORMATMethod Category=Fine-tuning, Training Data Size=10k, Backbone Model=1.7B2026.01 | 23.4 | 30 | |
| Q2D/ZSMethod Category=Prompting, Backbone Model=Qwen3-30B-A3B-Instruct2026.01 | 22.2 | 29.1 | |
| HyDE/ZSMethod Category=Prompting, Backbone Model=Qwen3-30B-A3B-Instruct2026.01 | 13.6 | 18.8 |