Text-to-Cypher on Text2GQL-Bench (test)
65.61FPCYQUARK-4B
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| CYQUARK-4BMode=Fine-tuned, Backbone=Qwen3.5-4B2026.06 | 65.61 | 63.46 | 60.11 | 54.77 | 64.58 | 45.76 | 59.05 | |
| CYQUARK-0.8BMode=Fine-tuned, Backbone=Qwen3.5-0.8B2026.06 | 59.95 | 57.62 | 56.89 | 48.82 | 60.27 | 43.41 | 54.49 | |
| GPT-5.5Mode=Zero-shot2026.06 | 53.63 | 67.39 | 68.43 | 66.14 | 74.98 | 61.36 | 65.32 | |
| Claude Opus 4.7Mode=Zero-shot2026.06 | 48.43 | 71.09 | 61.9 | 66.18 | 69.18 | 63.21 | 63.33 | |
| Qwen3.6-27BMode=Zero-shot2026.06 | 40.25 | 46.61 | 52.15 | 46.91 | 57.96 | 55.27 | 49.86 | |
| Qwen3.5-9BMode=Zero-shot2026.06 | 29.63 | 30.13 | 43.66 | 29.92 | 45.18 | 34.73 | 35.54 | |
| Qwen3.5-4BMode=Zero-shot2026.06 | 24.12 | 26.93 | 39.75 | 35.8 | 44.14 | 31.84 | 33.76 |