Graph Reasoning on GraphInstruct
92Average PerformanceEGL-SCA (Full)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| EGL-SCA (Full)Base LLM=gpt-5.4-nano2026.05 | 92 | — | — | — | |
| w/o Protocol-Reliability ObjBase LLM=gpt-5.4-nano, Ablation=w/o Protocol-Reliability Obj2026.05 | 89 | — | — | — | |
| w/o Tool GrowthBase LLM=gpt-5.4-nano, Ablation=w/o Tool Growth2026.05 | 88.5 | — | — | — | |
| w/o Instruction Evol.Base LLM=gpt-5.4-nano, Ablation=w/o Instruction Evol.2026.05 | 88.5 | — | — | — | |
| AgentSquareBase LLM=gpt-5.4-nano, Category=Tool-Augmented Agents, Tool Access=Fixed Toolbox2026.05 | 87.5 | — | — | — | |
| w/o SCA RoutingBase LLM=gpt-5.4-nano, Ablation=w/o SCA Routing2026.05 | 87.5 | — | — | — | |
| w/o Tool UseBase LLM=gpt-5.4-nano, Ablation=w/o Tool Use2026.05 | 68.5 | — | — | — | |
| Chain-of-Thought (CoT)Base LLM=gpt-5.4-nano, Category=Prompting & Self-Improvement, Tool Access=No Tools2026.05 | 64.5 | — | — | — | |
| GEPABase LLM=gpt-5.4-nano, Category=Prompting & Self-Improvement, Tool Access=No Tools2026.05 | 64 | — | — | — | |
| FixedSolverBase LLM=gpt-5.4-nano, Category=Tool-Augmented Agents, Tool Access=Fixed Toolbox2026.05 | 57.5 | — | — | — | |
| NPG-Muse-8BParameters=8B2025.08 | 54.4 | 64.9 | 46.3 | 75 | |
| Direct PromptingBase LLM=gpt-5.4-nano, Category=Prompting & Self-Improvement, Tool Access=No Tools2026.05 | 52.5 | — | — | — | |
| Qwen2.5-14B-Instruct-1MBackbone=Qwen2.5, Parameters=14B, Variant=Instruct-1M2025.08 | 40.9 | 60.8 | 18.3 | 81.9 | |
| ReActBase LLM=gpt-5.4-nano, Category=Tool-Augmented Agents, Tool Access=Fixed Toolbox2026.05 | 40.5 | — | — | — | |
| Few-ShotBase LLM=gpt-5.4-nano, Category=Prompting & Self-Improvement, Tool Access=No Tools2026.05 | 40 | — | — | — | |
| ExpeLBase LLM=gpt-5.4-nano, Category=Prompting & Self-Improvement, Tool Access=No Tools2026.05 | 38 | — | — | — | |
| NPG-Muse-7BParameters=7B2025.08 | 36.2 | 51.3 | 17.8 | 64.8 | |
| Qwen2.5-7B-Ins-1MBackbone=Qwen2.5, Parameters=7B, Variant=Instruct-1M2025.08 | 32.9 | 46.8 | 10.6 | 75 | |
| Qwen3-14B-BaseBackbone=Qwen3, Parameters=14B2025.08 | 32.6 | 54.3 | 15.5 | 71.8 | |
| Qwen3-8B-BaseBackbone=Qwen3, Parameters=8B2025.08 | 25.2 | 49.4 | 9.7 | 65 | |
| ReflexionBase LLM=gpt-5.4-nano, Category=Prompting & Self-Improvement, Tool Access=No Tools2026.05 | 17.5 | — | — | — |