SQL Agent on WikiSQL
60.8AccuracyReflection
Evaluation results
| Method | Links | |
|---|---|---|
| ReflectionInference Method=MCTS2026.05 | 60.8 | |
| ReflectionInference Method=Best-of-N (pass@5), Temperature=0.92026.05 | 58.8 | |
| No MemoryInference Method=Best-of-N (pass@5), Temperature=0.92026.05 | 49 | |
| No MemoryInference Method=MCTS2026.05 | 49 | |
| LiTS-FactInference Method=Best-of-N (pass@5), Temperature=0.92026.05 | 47.1 | |
| Raw SiblingInference Method=MCTS2026.05 | 47.1 | |
| LiTS-FactInference Method=MCTS2026.05 | 47.1 | |
| ReActInference Method=Single Trajectory, Temperature=02026.05 | 39.2 | |
| Raw SiblingInference Method=Beam Search2026.05 | 39.2 | |
| No MemoryInference Method=Beam Search2026.05 | 27.5 |