Schema Retrieval on BIRD
100Recall (R)Full-schema
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Full-schema2026.03 | 100 | 8.87 | 100 | 100 | |
| Gold-Based2026.03 | 100 | 100 | 100 | 100 | |
| RSL-SQLBackbone=gpt-4o, Reproduction source=original2026.03 | 97.69 | — | — | 94.32 | |
| FGTRBackbone=gpt-4o, Voting=@5, Schema filling=Used2026.03 | 97.27 | 72 | 90.89 | 90.73 | |
| RSL-SQLBackbone=gpt-4o, Reproduction source=reproduction2026.03 | 97.13 | 35.01 | 72 | 89.54 | |
| TableRAGBackbone=gpt-4o, Reproduction source=original2026.03 | 95.3 | 31.1 | 67.5 | — | |
| CHESSBackbone=gpt-4o2026.03 | 91.49 | 67.56 | 85.45 | 78.26 | |
| FGTRBackbone=Llama3-8b-FT, Voting=@5, Schema filling=Used2026.03 | 91.47 | 63.94 | 84.25 | 76.82 | |
| TableRAGBackbone=gpt-4o, Reproduction source=reproduction2026.03 | 90.2 | 44.49 | 56.91 | 79.32 | |
| C3Backbone=gpt-4o2026.03 | 89.42 | 85.12 | 88.53 | 69.32 | |
| FGTRBackbone=Llama3-8b, Voting=@5, Schema filling=Used2026.03 | 85.29 | 78.82 | 82.19 | 70.64 | |
| FGTRBackbone=Llama3-8b, Voting=@52026.03 | 77.52 | 73.18 | 76.61 | 46.33 | |
| FGTRBackbone=Llama3-8b, Voting=@32026.03 | 73.55 | 71.97 | 73.23 | 38.79 | |
| FGTRBackbone=Llama3-8b2026.03 | 72.28 | 76.04 | 73 | 35.19 | |
| C3Backbone=Llama3-8b2026.03 | 52 | 75 | 55.4 | 28.34 |