Text2Cypher generation on Healthcare
63Q@1StarCoder2-7B
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| StarCoder2-7BModel Size=7B, Scaling Budget=n=1, n=5, Query Complexity=Averaged (Easy, Medium, Hard)2026.05 | 63 | 17 | 5 | 46 | 58 | |
| Qwen2.5-7BModel Size=7B, Scaling Budget=n=1, n=5, Query Complexity=Averaged (Easy, Medium, Hard)2026.05 | 51 | 14 | 4 | 37 | 47 | |
| CodeLlama-7BModel Size=7B, Scaling Budget=n=1, n=5, Query Complexity=Averaged (Easy, Medium, Hard)2026.05 | 43 | 13 | 5 | 30 | 38 | |
| DeepSeek-6.7BModel Size=6.7B, Scaling Budget=n=1, n=5, Query Complexity=Averaged (Easy, Medium, Hard)2026.05 | 37 | 13 | 4 | 24 | 33 | |
| CodeLlama-13BModel Size=13B, Scaling Budget=n=1, n=5, Query Complexity=Averaged (Easy, Medium, Hard)2026.05 | 32 | 8 | 3 | 24 | 29 |