Text-to-Cypher on CypherBench
89.32COGPT-5.5
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| GPT-5.5Mode=zero-shot2026.06 | 89.32 | 88.29 | 92.17 | 79.34 | 88.71 | 96.32 | 87.37 | 88.79 | |
| Claude Opus 4.7Mode=zero-shot2026.06 | 87.57 | 91.79 | 91.72 | 80.02 | 87.97 | 91.68 | 89.32 | 88.58 | |
| CYQUARK-0.8BParameters=0.8B, Training=Fine-tuned with CYQUARK data2026.06 | 83.55 | 79.08 | 88.61 | 76.18 | 88.14 | 89.15 | 83.92 | 84.09 | |
| CYQUARK-4BParameters=4B, Training=Fine-tuned with CYQUARK data2026.06 | 82.85 | 82.8 | 88.59 | 84.1 | 89.81 | 87.33 | 82.18 | 85.38 | |
| Qwen3.6-27BParameters=27B, Mode=zero-shot2026.06 | 54.3 | 65.96 | 75.35 | 64.68 | 61.5 | 76.74 | 53.28 | 64.54 | |
| Qwen3.5-9BParameters=9B, Mode=zero-shot2026.06 | 26.2 | 35.9 | 57.45 | 41.12 | 29.77 | 42.28 | 25.11 | 36.83 | |
| Qwen3.5-4BParameters=4B, Mode=zero-shot2026.06 | 19.48 | 25.94 | 33.91 | 33.49 | 33.65 | 41.72 | 24.51 | 30.39 |