Conversational SQL on CoSQL
65.83AccuracySwift
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| SwiftMode=Standard Mode2025.06 | 65.83 | 0 | 5.45 | 5.97 | 5.72 | 5.28 | 4.95 | 5.85 | |
| SwiftThinking Mode=true2025.06 | 65 | 96.7 | 4.87 | 5.56 | 5.26 | 4.62 | 4.23 | 5.22 | |
| RefitThinking Mode=true2025.06 | 65 | 99.2 | 4.91 | 5.52 | 5.28 | 4.63 | 4.22 | 5.39 | |
| RefitMode=Standard Mode2025.06 | 62.5 | 0 | 5.16 | 5.64 | 5.47 | 4.99 | 4.72 | 5.52 | |
| STaR-GATEThinking Mode=true2025.06 | 61.67 | 90 | 5.28 | 5.78 | 5.51 | 5.19 | 4.9 | 5.54 | |
| STaR-GATEMode=Standard Mode2025.06 | 60.83 | 0 | 5.34 | 5.81 | 5.65 | 5.26 | 4.99 | 5.57 | |
| StepDPOThinking Mode=true2025.06 | 52.5 | 60 | 4.37 | 4.82 | 4.81 | 4.26 | 4.08 | 4.38 | |
| DPOThinking Mode=true2025.06 | 51.67 | 60 | 4.34 | 4.85 | 4.72 | 4.27 | 4 | 4.29 | |
| STaR-GATE-DThinking Mode=true2025.06 | 49.17 | 57.5 | 3.94 | 4.49 | 4.45 | 3.89 | 3.58 | 3.74 | |
| StepDPOMode=Standard Mode2025.06 | 29.17 | 0 | 4.21 | 4.45 | 4.85 | 4.5 | 4.1 | 3.73 | |
| DPOMode=Standard Mode2025.06 | 28.33 | 0 | 4.19 | 4.37 | 4.79 | 4.49 | 4.13 | 3.69 | |
| STaR-GATE-DMode=Standard Mode2025.06 | 20.83 | 0 | 3.62 | 3.82 | 4.25 | 4.02 | 3.73 | 3.03 | |
| BaseThinking Mode=true2025.06 | 20 | 65.8 | 5.65 | 6.17 | 5.88 | 5.16 | 5.84 | 5.87 | |
| BaseMode=Standard Mode2025.06 | 12.5 | 0 | 5.38 | 5.88 | 5.66 | 4.92 | 5.49 | 5.13 |