Text2Cypher generation on Fraud
69Q@1StarCoder2-7B
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| StarCoder2-7BModel Size=7B, Scaling Budget=n=1, n=5, Query Complexity=Averaged (Easy, Medium, Hard)2026.05 | 69 | 20 | 5 | 49 | 64 | |
| Qwen2.5-7BModel Size=7B, Scaling Budget=n=1, n=5, Query Complexity=Averaged (Easy, Medium, Hard)2026.05 | 63 | 19 | 4 | 44 | 59 | |
| CodeLlama-7BModel Size=7B, Scaling Budget=n=1, n=5, Query Complexity=Averaged (Easy, Medium, Hard)2026.05 | 56 | 17 | 6 | 39 | 50 | |
| DeepSeek-6.7BModel Size=6.7B, Scaling Budget=n=1, n=5, Query Complexity=Averaged (Easy, Medium, Hard)2026.05 | 44 | 13 | 5 | 31 | 39 | |
| CodeLlama-13BModel Size=13B, Scaling Budget=n=1, n=5, Query Complexity=Averaged (Easy, Medium, Hard)2026.05 | 38 | 12 | 3 | 26 | 35 |