DB Routing on Spider-Route
78.65R@1LLM Re-ranking with Modular Reasoning
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| LLM Re-ranking with Modular ReasoningModular Reasoning=true2026.01 | 78.65 | 79.42 | 80.86 | 79.64 | |
| LLM Reranking with GeminiLLM=Gemini2026.01 | 67.99 | 71.66 | 76.13 | 71.93 | |
| Cosine with gte-Qwen2-7B-instruct embeddingembedding=gte-Qwen2-7B-instruct2026.01 | 60.33 | 68.35 | 74.71 | 67.8 | |
| LLM Reranking (all-mpnet-base-v2 + Llama 3)embedding=all-mpnet-base-v2, LLM=Llama 32026.01 | 49.41 | 63.25 | 65.12 | 59.26 | |
| Cosine with all-mpnet-base-v2 embeddingembedding=all-mpnet-base-v22026.01 | 43.65 | 51.91 | 62.88 | 52.81 |