Structured Query Instruction Following on StruQ clean
78.89CapabilityCAHL
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| CAHLBase Model=Qwen1.5-7B2025.12 | 78.89 | 38.46 | 44.23 | 36.54 | 59.13 | 44.59 | 59.13 | |
| ISEBase Model=Qwen1.5-7B2025.12 | 74.81 | 34.13 | 52.4 | 40.87 | 86.06 | 53.37 | 86.06 | |
| CAHLBase Model=Llama-2-7B2025.12 | 74.18 | 20.67 | 32.21 | 20.67 | 66.83 | 35.1 | 66.83 | |
| ISEBase Model=Llama-2-7B2025.12 | 74.03 | 22.12 | 30.29 | 19.71 | 80.29 | 38.1 | 80.29 | |
| DelimiterBase Model=Qwen1.5-7B2025.12 | 70.23 | 37.02 | 48.56 | 40.38 | 91.35 | 54.33 | 91.35 | |
| TextBase Model=Qwen1.5-7B2025.12 | 69.02 | 40.38 | 54.8 | 40.87 | 97.12 | 58.29 | 97.12 | |
| DelimiterBase Model=Llama-2-7B2025.12 | 68.33 | 19.23 | 33.17 | 28.37 | 97.6 | 44.59 | 97.6 | |
| TextBase Model=Llama-2-7B2025.12 | 64.19 | 25 | 30.77 | 16.83 | 90.87 | 40.87 | 90.87 |