Tool Retrieval on GeoPlan-bench (Overall)
67.52R@kBSCTR
Evaluation results
| Method | Links | ||
|---|---|---|---|
| BSCTRRetrieval scale (k)=152026.04 | 67.52 | 63.63 | |
| Query RewritingRetrieval scale (k)=152026.04 | 64.84 | 59.71 | |
| BSCTRRetrieval scale (k)=102026.04 | 50.52 | 58.21 | |
| Graph-basedRetrieval scale (k)=152026.04 | 48.33 | 52.61 | |
| Query RewritingRetrieval scale (k)=102026.04 | 46.6 | 53.12 | |
| Graph-basedRetrieval scale (k)=102026.04 | 44.11 | 54.43 | |
| BSCTRRetrieval scale (k)=52026.04 | 28.97 | 60.53 | |
| Graph-basedRetrieval scale (k)=52026.04 | 27 | 59.9 | |
| Query RewritingRetrieval scale (k)=52026.04 | 26.29 | 54.48 | |
| DenseRetrieval scale (k)=52026.04 | 19.54 | 48.38 | |
| DenseRetrieval scale (k)=102026.04 | 19.54 | 33.26 | |
| DenseRetrieval scale (k)=152026.04 | 19.54 | 30.58 | |
| BM25Retrieval scale (k)=52026.04 | 12.36 | 24.58 | |
| BM25Retrieval scale (k)=102026.04 | 12.36 | 16.68 | |
| BM25Retrieval scale (k)=152026.04 | 12.36 | 15.12 |