Schema Retrieval on Spider
100RecallFull-schema
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Full-schema2026.03 | 100 | 11.94 | 100 | 100 | |
| Gold-Based2026.03 | 100 | 100 | 100 | 100 | |
| Full BD2026.03 | 100 | 8.07 | — | 100 | |
| Gold-based2026.03 | 100 | 100 | 100 | 100 | |
| FGTRBackbone=gpt-4o, Voting=@5, Schema filling=Used2026.03 | 98.32 | 70.72 | 91.2 | 89.32 | |
| FGTRadaptive cell mapping=true2026.03 | 97.78 | 64.75 | 88.73 | 84.67 | |
| FGTRk=52026.03 | 97.73 | 24.31 | 69.93 | 84.43 | |
| RSL-SQLBackbone=gpt-4o, Reproduction source=reproduction2026.03 | 96.59 | 50.31 | 78.58 | 88.44 | |
| FGTRk=32026.03 | 94.98 | 32.74 | 68.82 | 72.73 | |
| CHESSBackbone=gpt-4o2026.03 | 93.82 | 72.86 | 88.72 | 76.29 | |
| TableRAG2026.03 | 92.84 | 8.82 | 31.96 | 63.08 | |
| TableRAGBackbone=gpt-4o, Reproduction source=reproduction2026.03 | 92.48 | 31.14 | 66.39 | 85.62 | |
| FGTRBackbone=Llama3-8b-FT, Voting=@5, Schema filling=Used2026.03 | 91.52 | 72.83 | 87.05 | 80.23 | |
| C3Backbone=gpt-4o2026.03 | 91.39 | 87.82 | 90.65 | 73.74 | |
| FGTRBackbone=Llama3-8b, Voting=@5, Schema filling=Used2026.03 | 89.34 | 64.58 | 82.98 | 70.74 | |
| FGTRBackbone=Llama3-8b, Voting=@52026.03 | 83.23 | 71.44 | 80.57 | 49.57 | |
| FGTRBackbone=Llama3-8b, Voting=@32026.03 | 76.25 | 81.96 | 77.33 | 43.66 | |
| FGTRBackbone=Llama3-8b2026.03 | 74.12 | 80.32 | 75.28 | 39.54 | |
| C3Backbone=Llama3-8b2026.03 | 70.74 | 74.83 | 71.52 | 32.45 |