Agent Retrieval on ToolE
74.27nDCGAutoMAS (Retriever + re-ranker)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| AutoMAS (Retriever + re-ranker)Re-Ranker=gpt4o, k=5, avg emb=10, filtering=false, Hybrid value=0.92026.05 | 74.27 | 80.58 | 79.19 | |
| AutoMAS (Retriever + re-ranker)Re-Ranker=gpt4o, k=5, avg emb=10, filtering=true, Hybrid value=0.92026.05 | 74.27 | 83.46 | 81.08 | |
| AutoMAS (Retriever + re-ranker)Re-Ranker=gpt4o, k=10, avg emb=10, filtering=false, Hybrid value=0.92026.05 | 74.16 | 81.22 | 79.63 | |
| AutoMAS (Retriever + re-ranker)Re-Ranker=gpt4o, k=10, avg emb=10, filtering=true, Hybrid value=0.92026.05 | 74.16 | 83.98 | 81.73 | |
| Re-Invoke w/ Vertex AIRe-Ranker=text-bison@0012026.05 | 67.16 | 78.21 | 67.15 | |
| Re-Invoke w/ BM25Re-Ranker=gpt-3.5 turbo2026.05 | 52.55 | 63 | 52.55 |