DB Routing on BIRD Route
79.62R@1LLM Re-ranking with Modular Reasoning
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| LLM Re-ranking with Modular ReasoningModular Reasoning=true2026.01 | 79.62 | 81.76 | 84.91 | 0.821 | |
| LLM Reranking with GeminiLLM=Gemini2026.01 | 71.2 | 80.6 | 84.9 | 0.789 | |
| Cosine with gte-Qwen2-7B-instruct embeddingembedding=gte-Qwen2-7B-instruct2026.01 | 62.49 | 78.21 | 83.44 | 0.7471 | |
| LLM Reranking (all-mpnet-base-v2 + Llama 3)embedding=all-mpnet-base-v2, LLM=Llama 32026.01 | 54.29 | 59.71 | 72.86 | 0.6229 | |
| Cosine with all-mpnet-base-v2 embeddingembedding=all-mpnet-base-v22026.01 | 47.47 | 57.33 | 67.74 | 0.5751 |