Graph Reasoning on GRBENCH Academic
0.71QwenScoreGraphScout
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GraphScoutLLM=4B w/ train2026.03 | 0.71 | 73.9 | |
| GraphScoutLLM=8B w/ train2026.03 | 0.685 | 70.2 | |
| GraphCounselorLLM=DeepSeek-Chat2026.03 | 0.657 | 65.9 | |
| GraphCounselorLLM=GPT-4o2026.03 | 0.644 | 60.5 | |
| GraphCounselorLLM=Qwen-Max2026.03 | 0.637 | 63.9 | |
| GraphCoTLLM=GLM-4.62026.03 | 0.629 | 61.4 | |
| GraphCoTLLM=DeepSeek-Chat2026.03 | 0.628 | 54.6 | |
| GraphCoTLLM=Qwen-Max2026.03 | 0.608 | 57 | |
| CypherLLM=GPT-4o2026.03 | 0.605 | 19.7 | |
| GraphCounselorLLM=GLM-4.62026.03 | 0.595 | 58.9 | |
| PolyGLLM=GLM-4.62026.03 | 0.593 | 12.9 | |
| GraphCoTLLM=GPT-4o2026.03 | 0.587 | 54.7 | |
| PolyGLLM=DeepSeek-Chat2026.03 | 0.585 | 14.6 | |
| CypherLLM=DeepSeek-Chat2026.03 | 0.58 | 18.6 | |
| CypherLLM=Qwen-Max2026.03 | 0.572 | 18.1 | |
| CypherLLM=GLM-4.62026.03 | 0.538 | 14.7 | |
| PolyGLLM=GPT-4o2026.03 | 0.516 | 13.8 | |
| PolyGLLM=Qwen-Max2026.03 | 0.499 | 15.3 | |
| GraphScoutLLM=8B w/o train2026.03 | 0.422 | 40.1 | |
| GraphScoutLLM=4B w/o train2026.03 | 0.21 | 22 | |
| GraphRAGLLM=DeepSeek-Chat2026.03 | 0.177 | 16.4 | |
| TextRAGLLM=DeepSeek-Chat2026.03 | 0.146 | 15.8 | |
| BaseLLMLLM=DeepSeek-Chat2026.03 | 0.134 | 14 | |
| GraphRAGLLM=GLM-4.62026.03 | 0.124 | 13.5 | |
| GraphRAGLLM=Qwen-Max2026.03 | 0.114 | 13 | |
| BaseLLMLLM=Qwen-Max2026.03 | 0.112 | 12.8 | |
| GraphRAGLLM=GPT-4o2026.03 | 0.105 | 9.2 | |
| TextRAGLLM=GPT-4o2026.03 | 0.098 | 9 | |
| BaseLLMLLM=GPT-4o2026.03 | 0.097 | 8 | |
| BaseLLMLLM=GLM-4.62026.03 | 0.095 | 11 | |
| TextRAGLLM=GLM-4.62026.03 | 0.092 | 10.5 | |
| TextRAGLLM=Qwen-Max2026.03 | 0.092 | 10.6 |