List your company
ResearchFormerly WizWand

Knowledge Graph Question Answering on SimpleQA Freebase-based (test)

84.8Hits@1SoG
3.960824.947945.93566.9221Sep 30, 2025Oct 1, 2025Oct 3, 2025Oct 4, 2025Oct 6, 2025Oct 7, 2025Oct 9, 2025
Updated 5mo ago

Evaluation results

MethodLinks
SoGBackbone=GPT-4o2025.1084.8
EffiQABackbone=GPT-42025.1076.5
ReKnoSBackbone=GPT-42025.1069.3
KG-R1Backbone Model=Qwen2.5 3B, Training Dataset=WebQSP, Zero-shot protocol=true, Maximum turn number=H=52025.0969.18
ReknoSBackbone Model=Qwen 2.5-72B, Zero-shot protocol=true, Maximum turn number=H=52025.0968.4
ReknoSBackbone Model=Qwen 3-235B, Zero-shot protocol=true, Maximum turn number=H=52025.0968.01
PoGBackbone Model=Qwen 3-235B, Zero-shot protocol=true, Maximum turn number=H=52025.0967.9
Think-on-GraphBackbone=GPT-42025.1066.7
PoGBackbone Model=Qwen 2.5-7B, Zero-shot protocol=true, Maximum turn number=H=52025.0966.38
PoGBackbone Model=Qwen 2.5-72B, Zero-shot protocol=true, Maximum turn number=H=52025.0965.67
ToGBackbone Model=Qwen 2.5-72B, Zero-shot protocol=true, Maximum turn number=H=52025.0957.83
KG-R1Backbone Model=Qwen2.5 3B, Training Dataset=CWQ, Zero-shot protocol=true, Maximum turn number=H=52025.0957.31
Think-on-GraphBackbone=GPT-4o, Reproduced status=reproduced2025.1057.2
ReknoSBackbone Model=Qwen 2.5-7B, Zero-shot protocol=true, Maximum turn number=H=52025.0956.43
ToGBackbone Model=Qwen 2.5-7B, Zero-shot protocol=true, Maximum turn number=H=52025.0952.37
ToGBackbone Model=Qwen 3-235B, Zero-shot protocol=true, Maximum turn number=H=52025.0941.27
Self-ConsistencyBackbone=GPT-4o2025.1035.1
IO PromptBackbone=GPT-4o2025.1034.3
Chain-of-ThoughtBackbone=GPT-4o2025.1032.6
RoGBackbone Model=Qwen 2.5-72B, Zero-shot protocol=true, Maximum turn number=H=52025.0920.4
RoGBackbone Model=Qwen 3-235B, Zero-shot protocol=true, Maximum turn number=H=52025.0918.93
SCBackbone Model=Qwen 3-235B, Zero-shot protocol=true, Maximum turn number=H=52025.0914.73
CoTBackbone Model=Qwen 3-235B, Zero-shot protocol=true, Maximum turn number=H=52025.0914.4
IOBackbone Model=Qwen 2.5-72B, Zero-shot protocol=true, Maximum turn number=H=52025.0914.33
RoGBackbone Model=Qwen 2.5-7B, Zero-shot protocol=true, Maximum turn number=H=52025.0912.97
SCBackbone Model=Qwen 2.5-72B, Zero-shot protocol=true, Maximum turn number=H=52025.0911.6
IOBackbone Model=Qwen 3-235B, Zero-shot protocol=true, Maximum turn number=H=52025.0911.37
CoTBackbone Model=Qwen 2.5-72B, Zero-shot protocol=true, Maximum turn number=H=52025.0911.07
IOBackbone Model=Qwen 2.5-7B, Zero-shot protocol=true, Maximum turn number=H=52025.0910.3
SCBackbone Model=Qwen 2.5-7B, Zero-shot protocol=true, Maximum turn number=H=52025.098.7
CoTBackbone Model=Qwen 2.5-7B, Zero-shot protocol=true, Maximum turn number=H=52025.097.07