Text-to-Cypher on MindTheQuery (test)
98.17BL ScoreGPT-5.5
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| GPT-5.5Mode=Zero-shot2026.06 | 98.17 | 77.97 | 77.84 | 95.06 | 89.39 | 87.67 | |
| Claude Opus 4.7Mode=Zero-shot2026.06 | 97.72 | 78.87 | 77.05 | 92.86 | 91.01 | 87.5 | |
| Qwen3.6-27BMode=Zero-shot2026.06 | 93.67 | 66.62 | 62.92 | 82.78 | 75.12 | 76.22 | |
| CYQUARK-4BMode=Fine-tuned, Base Model=Qwen3.5-4B2026.06 | 93.18 | 83.91 | 69.04 | 84.31 | 82.64 | 82.62 | |
| CYQUARK-0.8BMode=Fine-tuned, Base Model=Qwen3.5-0.8B2026.06 | 89.3 | 80.4 | 67.84 | 82.96 | 78.34 | 79.77 | |
| Qwen3.5-4BMode=Zero-shot2026.06 | 84.07 | 59.68 | 45.88 | 49.25 | 59.41 | 59.66 | |
| Qwen3.5-9BMode=Zero-shot2026.06 | 80.08 | 60.83 | 49.07 | 61.21 | 51 | 60.44 |