Text2Cypher on PIPE-Cypher 296-example (local evaluation set)
20.3Execution Accuracy (Zero)neo4j/Gemma-2-9B Text2Cypher LoRA
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| neo4j/Gemma-2-9B Text2Cypher LoRATuning=Text2Cypher LoRA, Family=Text2Cypher LoRA2026.06 | 20.3 | 98.3 | 69.9 | 98.1 | 0.9 | |
| Qwen3.5-9BTuning=general instruction, Family=General instruction2026.06 | 18.9 | 99.3 | 82.8 | 98.6 | 0.7 | |
| Qwen2.5-Coder-7B-InstructTuning=code instruction, Family=Code instruction2026.06 | 0.7 | 98.3 | 66.9 | 97.2 | 0.2 | |
| aigentx/Llama-3.1-8B Cypher LoRATuning=Cypher LoRA, Family=Cypher LoRA2026.06 | 0 | 0 | 0 | 0 | 0 | |
| aigentx/Llama-3.1-8B Cypher mixed LoRATuning=Cypher mixed LoRA, Family=Cypher mixed LoRA2026.06 | 0 | 0 | 0 | 0 | 0 | |
| Azzedde/llama3.1-8b-text2cypherTuning=Text2Cypher fine-tuned, Family=Text2Cypher fine-tuned2026.06 | 0 | 0 | 0 | 0 | 0 | |
| Gemma-2-9B-ITTuning=general instruction, Family=General instruction2026.06 | 0 | 0 | 0 | 0 | 0 | |
| neo4j/Gemma-3-4B Text2CypherTuning=Text2Cypher fine-tuned, Family=Text2Cypher fine-tuned2026.06 | 0 | 0 | 0 | 0 | 0 | |
| projectwilsen/Llama-3.1-8B Text2Cypher LoRATuning=Text2Cypher LoRA, Family=Text2Cypher LoRA2026.06 | 0 | 0 | 0 | 0 | 0 | |
| Saiprasanth15/Llama-3.1-8B Text2Cypher LoRATuning=Text2Cypher LoRA, Family=Text2Cypher LoRA2026.06 | 0 | 0 | 0 | 0 | 0 | |
| tomasonjo/text2cypher-demo-16bitTuning=Text2Cypher fine-tuned, Family=Text2Cypher fine-tuned2026.06 | 0 | 0 | 0 | 0 | 0 |