Open-World Knowledge Graph Question Answering on ogbn-product
59Exact Match AccuracyGLOW-GN
Evaluation results
| Method | Links | |
|---|---|---|
| GLOW-GNLLM-Model=GPT-4o-mini2026.04 | 59 | |
| GLOW-GNLLM-Model=Qwen3-8B2026.04 | 57 | |
| GLOW-GNLLM-Model=DeepSeek-V32026.04 | 57 | |
| GLOW-GNLLM-Model=Granite-3.3-8B-Instruct2026.04 | 54 | |
| GLOW-NLLM-Model=Granite-3.3-8B-Instruct2026.04 | 52 | |
| GLOW-NLLM-Model=Qwen3-8B2026.04 | 51 | |
| GLOW-GNLLM-Model=DeepSeek-R1-Distill-Qwen-7B2026.04 | 51 | |
| GLOW-NLLM-Model=GPT-4o-mini2026.04 | 51 | |
| GoGLLM-Model=DeepSeek-V32026.04 | 51 | |
| GLOW-NLLM-Model=DeepSeek-V32026.04 | 50 | |
| GoGLLM-Model=GPT-4o-mini2026.04 | 48 | |
| GoGLLM-Model=Granite-3.3-8B-Instruct2026.04 | 47 | |
| GLOW-GLLM-Model=Qwen3-8B2026.04 | 45 | |
| GLOW-GLLM-Model=Granite-3.3-8B-Instruct2026.04 | 45 | |
| GLOW-GLLM-Model=DeepSeek-V32026.04 | 45 | |
| GoGLLM-Model=Qwen3-8B2026.04 | 44 | |
| GoGLLM-Model=DeepSeek-R1-Distill-Qwen-7B2026.04 | 44 | |
| GLOW-NLLM-Model=DeepSeek-R1-Distill-Qwen-7B2026.04 | 43 | |
| GLOW-GLLM-Model=GPT-4o-mini2026.04 | 43 | |
| GLOW-GLLM-Model=DeepSeek-R1-Distill-Qwen-7B2026.04 | 38 | |
| LLM-OnlyLLM-Model=GPT-4o-mini2026.04 | 37 | |
| LLM-OnlyLLM-Model=DeepSeek-V32026.04 | 36 | |
| LLM-OnlyLLM-Model=Qwen3-8B2026.04 | 34 | |
| AskGNNLLM-Model=Granite-3.3-8B-Instruct2026.04 | 30 | |
| AskGNNLLM-Model=Qwen3-8B2026.04 | 29 | |
| LLM-OnlyLLM-Model=DeepSeek-R1-Distill-Qwen-7B2026.04 | 27 | |
| LLM-OnlyLLM-Model=Granite-3.3-8B-Instruct2026.04 | 22 | |
| AskGNNLLM-Model=DeepSeek-R1-Distill-Qwen-7B2026.04 | 19 | |
| GCRLLM-Model=Granite-3.3-8B-Instruct2026.04 | 13 | |
| GCRLLM-Model=DeepSeek-R1-Distill-Qwen-7B2026.04 | 12 | |
| GCRLLM-Model=Qwen3-8B2026.04 | 5 |