# Graph Reasoning on GRBENCH Literature Source: [Graph Reasoning on GRBENCH Literature]() Collection index: [llms.txt]() Data updated: 2026-03-04T13:57:33.246Z Evaluation of Graph Reasoning performance on the GRBENCH Literature dataset, reporting QwenScore and F1 metrics. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Graph Reasoning | | Dataset (including any stated split) | GRBENCH Literature | | Metric | QwenScore | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 32 of 32 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [QwenScore](): Higher is better; unit: PERCENT. - [F1 Score](): Higher is better; unit: PERCENT. ## Recorded results | Method | QwenScore | Result date | Report paper | | --- | --- | --- | --- | | GraphScout | 69.6 | Not recorded | 69a66c1d2d603e6de3e3cedf | | GraphScout | 66.3 | Not recorded | 69a66c1d2d603e6de3e3cedf | | GraphCounselor | 62.5 | Not recorded | 69a66c1d2d603e6de3e3cedf | | GraphCounselor | 62.1 | Not recorded | 69a66c1d2d603e6de3e3cedf | | GraphCounselor | 59.2 | Not recorded | 69a66c1d2d603e6de3e3cedf | | Cypher | 58.3 | Not recorded | 69a66c1d2d603e6de3e3cedf | | Cypher | 58.3 | Not recorded | 69a66c1d2d603e6de3e3cedf | | GraphCounselor | 57.9 | Not recorded | 69a66c1d2d603e6de3e3cedf | | GraphCoT | 56.3 | Not recorded | 69a66c1d2d603e6de3e3cedf | | Cypher | 55.8 | Not recorded | 69a66c1d2d603e6de3e3cedf | | Cypher | 53.3 | Not recorded | 69a66c1d2d603e6de3e3cedf | | PolyG | 53.3 | Not recorded | 69a66c1d2d603e6de3e3cedf | | GraphCoT | 50.4 | Not recorded | 69a66c1d2d603e6de3e3cedf | | PolyG | 50.4 | Not recorded | 69a66c1d2d603e6de3e3cedf | | GraphCoT | 47.9 | Not recorded | 69a66c1d2d603e6de3e3cedf | | PolyG | 47.1 | Not recorded | 69a66c1d2d603e6de3e3cedf | | GraphCoT | 46.3 | Not recorded | 69a66c1d2d603e6de3e3cedf | | PolyG | 46.3 | Not recorded | 69a66c1d2d603e6de3e3cedf | | GraphScout | 39.6 | Not recorded | 69a66c1d2d603e6de3e3cedf | | BaseLLM | 22.1 | Not recorded | 69a66c1d2d603e6de3e3cedf | | GraphRAG | 22.1 | Not recorded | 69a66c1d2d603e6de3e3cedf | | GraphRAG | 21.7 | Not recorded | 69a66c1d2d603e6de3e3cedf | | GraphRAG | 21.3 | Not recorded | 69a66c1d2d603e6de3e3cedf | | GraphRAG | 20.8 | Not recorded | 69a66c1d2d603e6de3e3cedf | | TextRAG | 19.6 | Not recorded | 69a66c1d2d603e6de3e3cedf | | BaseLLM | 19.2 | Not recorded | 69a66c1d2d603e6de3e3cedf | | BaseLLM | 17.9 | Not recorded | 69a66c1d2d603e6de3e3cedf | | TextRAG | 17.9 | Not recorded | 69a66c1d2d603e6de3e3cedf | | GraphScout | 17.9 | Not recorded | 69a66c1d2d603e6de3e3cedf | | BaseLLM | 15.8 | Not recorded | 69a66c1d2d603e6de3e3cedf | | TextRAG | 14.6 | Not recorded | 69a66c1d2d603e6de3e3cedf | | TextRAG | 14.2 | Not recorded | 69a66c1d2d603e6de3e3cedf | ### GraphScout QwenScore: 69.6. Result ID: 69a83a4b6dbb7075b94ee221. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM":"4B w/ train"}. This record does not assert independent reproduction. ### GraphScout QwenScore: 66.3. Result ID: 69a83a4b6dbb7075b94ee223. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM":"8B w/ train"}. This record does not assert independent reproduction. ### GraphCounselor QwenScore: 62.5. Result ID: 69a83a4b6dbb7075b94ee21e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"LLM":"Qwen-Max"}. This record does not assert independent reproduction. ### GraphCounselor QwenScore: 62.1. Result ID: 69a83a4b6dbb7075b94ee21f. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"LLM":"DeepSeek-Chat"}. This record does not assert independent reproduction. ### GraphCounselor QwenScore: 59.2. Result ID: 69a83a4b6dbb7075b94ee21c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"LLM":"GPT-4o"}. This record does not assert independent reproduction. ### Cypher QwenScore: 58.3. Result ID: 69a83a4b6dbb7075b94ee211. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM":"GLM-4.6"}. This record does not assert independent reproduction. ### Cypher QwenScore: 58.3. Result ID: 69a83a4b6dbb7075b94ee213. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM":"DeepSeek-Chat"}. This record does not assert independent reproduction. ### GraphCounselor QwenScore: 57.9. Result ID: 69a83a4b6dbb7075b94ee21d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"LLM":"GLM-4.6"}. This record does not assert independent reproduction. ### GraphCoT QwenScore: 56.3. Result ID: 69a83a4b6dbb7075b94ee217. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"LLM":"DeepSeek-Chat"}. This record does not assert independent reproduction. ### Cypher QwenScore: 55.8. Result ID: 69a83a4b6dbb7075b94ee212. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM":"Qwen-Max"}. This record does not assert independent reproduction. ### Cypher QwenScore: 53.3. Result ID: 69a83a4b6dbb7075b94ee210. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM":"GPT-4o"}. This record does not assert independent reproduction. ### PolyG QwenScore: 53.3. Result ID: 69a83a4b6dbb7075b94ee21b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM":"DeepSeek-Chat"}. This record does not assert independent reproduction. ### GraphCoT QwenScore: 50.4. Result ID: 69a83a4b6dbb7075b94ee215. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"LLM":"GLM-4.6"}. This record does not assert independent reproduction. ### PolyG QwenScore: 50.4. Result ID: 69a83a4b6dbb7075b94ee219. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM":"GLM-4.6"}. This record does not assert independent reproduction. ### GraphCoT QwenScore: 47.9. Result ID: 69a83a4b6dbb7075b94ee216. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"LLM":"Qwen-Max"}. This record does not assert independent reproduction. ### PolyG QwenScore: 47.1. Result ID: 69a83a4b6dbb7075b94ee21a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM":"Qwen-Max"}. This record does not assert independent reproduction. ### GraphCoT QwenScore: 46.3. Result ID: 69a83a4b6dbb7075b94ee214. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"LLM":"GPT-4o"}. This record does not assert independent reproduction. ### PolyG QwenScore: 46.3. Result ID: 69a83a4b6dbb7075b94ee218. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM":"GPT-4o"}. This record does not assert independent reproduction. ### GraphScout QwenScore: 39.6. Result ID: 69a83a4b6dbb7075b94ee222. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM":"8B w/o train"}. This record does not assert independent reproduction. ### BaseLLM QwenScore: 22.1. Result ID: 69a83a4b6dbb7075b94ee204. [Reporting paper]() Recorded evaluation configuration: {"LLM":"GPT-4o"}. This record does not assert independent reproduction. ### GraphRAG QwenScore: 22.1. Result ID: 69a83a4b6dbb7075b94ee20f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM":"DeepSeek-Chat"}. This record does not assert independent reproduction. ### GraphRAG QwenScore: 21.7. Result ID: 69a83a4b6dbb7075b94ee20c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM":"GPT-4o"}. This record does not assert independent reproduction. ### GraphRAG QwenScore: 21.3. Result ID: 69a83a4b6dbb7075b94ee20d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM":"GLM-4.6"}. This record does not assert independent reproduction. ### GraphRAG QwenScore: 20.8. Result ID: 69a83a4b6dbb7075b94ee20e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM":"Qwen-Max"}. This record does not assert independent reproduction. ### TextRAG QwenScore: 19.6. Result ID: 69a83a4b6dbb7075b94ee20b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM":"DeepSeek-Chat"}. This record does not assert independent reproduction. ### BaseLLM QwenScore: 19.2. Result ID: 69a83a4b6dbb7075b94ee207. [Reporting paper]() Recorded evaluation configuration: {"LLM":"DeepSeek-Chat"}. This record does not assert independent reproduction. ### BaseLLM QwenScore: 17.9. Result ID: 69a83a4b6dbb7075b94ee205. [Reporting paper]() Recorded evaluation configuration: {"LLM":"GLM-4.6"}. This record does not assert independent reproduction. ### TextRAG QwenScore: 17.9. Result ID: 69a83a4b6dbb7075b94ee208. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM":"GPT-4o"}. This record does not assert independent reproduction. ### GraphScout QwenScore: 17.9. Result ID: 69a83a4b6dbb7075b94ee220. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM":"4B w/o train"}. This record does not assert independent reproduction. ### BaseLLM QwenScore: 15.8. Result ID: 69a83a4b6dbb7075b94ee206. [Reporting paper]() Recorded evaluation configuration: {"LLM":"Qwen-Max"}. This record does not assert independent reproduction. ### TextRAG QwenScore: 14.6. Result ID: 69a83a4b6dbb7075b94ee209. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM":"GLM-4.6"}. This record does not assert independent reproduction. ### TextRAG QwenScore: 14.2. Result ID: 69a83a4b6dbb7075b94ee20a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM":"Qwen-Max"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.