Text-to-SQL on Spider (AVGLEN/SPEEDUP)
1.07AVGLENVanilla SD
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Vanilla SDTarget model=meta-llama / Llama-2-7B-Chat2026.03 | 1.07 | 1 | |
| EAGLETarget model=meta-llama / Llama-2-7B-Chat2026.03 | 1.15 | 1 | |
| Vanilla SDTarget model=lmsys / Vicuna-7B-v1.32026.03 | 1.2 | 1 | |
| EAGLETarget model=lmsys / Vicuna-7B-v1.32026.03 | 1.31 | 1 | |
| OSDTarget model=lmsys / Vicuna-7B-v1.32026.03 | 1.36 | 1.12 | |
| OSDTarget model=meta-llama / Llama-2-7B-Chat2026.03 | 1.47 | 1.22 | |
| HydraTarget model=meta-llama / Llama-2-7B-Chat2026.03 | 1.48 | 1 | |
| OSD-EAGLETarget model=lmsys / Vicuna-7B-v1.32026.03 | 1.53 | 1.21 | |
| Ens-EAGLETarget model=lmsys / Vicuna-7B-v1.32026.03 | 1.6 | 1.32 | |
| EAGLE-3Target model=meta-llama / Llama-2-7B-Chat2026.03 | 1.61 | 1 | |
| OSD-EAGLETarget model=meta-llama / Llama-2-7B-Chat2026.03 | 1.72 | 1.46 | |
| Ens-EAGLETarget model=meta-llama / Llama-2-7B-Chat2026.03 | 1.82 | 1.61 | |
| EAGLE-3Target model=lmsys / Vicuna-7B-v1.32026.03 | 1.85 | 1 | |
| OSD-EAGLE-3Target model=lmsys / Vicuna-7B-v1.32026.03 | 2.1 | 1.07 | |
| Ens-EAGLE-3Target model=lmsys / Vicuna-7B-v1.32026.03 | 2.24 | 1.12 | |
| OSD-EAGLE-3Target model=meta-llama / Llama-2-7B-Chat2026.03 | 2.42 | 1.43 | |
| Ens-EAGLE-3Target model=meta-llama / Llama-2-7B-Chat2026.03 | 2.54 | 1.57 | |
| HydraTarget model=lmsys / Vicuna-7B-v1.32026.03 | 2.65 | 1 | |
| OSD-HydraTarget model=meta-llama / Llama-2-7B-Chat2026.03 | 3.1 | 1.91 | |
| OSD-HydraTarget model=lmsys / Vicuna-7B-v1.32026.03 | 3.11 | 1.11 | |
| Opt-HydraTarget model=lmsys / Vicuna-7B-v1.32026.03 | 3.27 | 1.18 | |
| Opt-HydraTarget model=meta-llama / Llama-2-7B-Chat2026.03 | 3.28 | 2.03 |