Graph Reasoning on GraphInstruct (test)
93.1Cycle AccuracySLASH
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| SLASHModel=GraphWiz-LLaMA2-13B2026.05 | 93.1 | 89.4 | 88.3 | 55.4 | 24.9 | 45 | 44.3 | 62 | 75.4 | 64.2 | |
| VanillaModel=GraphWiz-Mistral-7B2026.05 | 92.3 | 89.7 | 72.6 | 20 | 30.6 | 38.9 | 30.6 | 29.1 | 86.3 | 54.4 | |
| SLASHModel=GraphWiz-Mistral-7B2026.05 | 91.4 | 89.1 | 72.6 | 21.1 | 30.6 | 36.9 | 31.1 | 30 | 86.6 | 54.4 | |
| SLASHModel=Qwen3-8B2026.05 | 90.5 | 85.8 | 57 | 0 | 0 | 0 | 6.2 | 31.8 | 58.8 | 36.7 | |
| SLASHModel=GraphWiz-LLaMA2-7B2026.05 | 89.1 | 80.6 | 85.4 | 44.6 | 23.1 | 51.7 | 43.7 | 80.9 | 75.7 | 63.9 | |
| VanillaModel=GraphWiz-LLaMA2-13B2026.05 | 89.1 | 89.1 | 88.3 | 55.4 | 24.6 | 54.6 | 42.3 | 49.4 | 80.9 | 63.7 | |
| VanillaModel=GraphWiz-LLaMA2-7B2026.05 | 87.4 | 81.4 | 85.4 | 47.1 | 23.1 | 52.3 | 43.7 | 81.4 | 75.4 | 64.2 | |
| SLASHModel=Qwen3-14B2026.05 | 74 | 73.3 | 15.5 | 10 | 3.7 | 1.3 | 7 | 24.7 | 58.8 | 29.8 | |
| SLASHModel=Qwen3-4B2026.05 | 69 | 38.8 | 19.5 | 0.3 | 2.5 | 0.3 | 1.5 | 29 | 14.5 | 19.5 | |
| SLASHModel=Llama-3.1-8B2026.05 | 68 | 79.7 | 54.7 | 2.2 | 1.5 | 5.2 | 17.5 | 31.5 | 56 | 35.2 | |
| VanillaModel=Llama-3.1-8B2026.05 | 66 | 73 | 23.5 | 6 | 1.8 | 1.8 | 12.8 | 30.5 | 38.5 | 28.2 | |
| VanillaModel=Qwen3-4B2026.05 | 64.5 | 42 | 4.8 | 0.3 | 1.8 | 0 | 0 | 22.3 | 0.5 | 15.1 | |
| SLASHModel=Llama-3.2-3B2026.05 | 57.3 | 34 | 23.5 | 4.8 | 3 | 4.8 | 11.3 | 27.8 | 26.8 | 21.4 | |
| VanillaModel=Qwen3-14B2026.05 | 54.5 | 21.7 | 15.5 | 1.8 | 2.5 | 1.3 | 6.8 | 19 | 58.8 | 20.2 | |
| VanillaModel=Qwen3-8B2026.05 | 39.5 | 53.7 | 17.7 | 0 | 0 | 0 | 6.2 | 17.7 | 21.5 | 17.4 | |
| VanillaModel=Llama-3.2-3B2026.05 | 18 | 34 | 0.5 | 4.5 | 3 | 0 | 7.5 | 9.2 | 0 | 8.5 |