List your company
ResearchFormerly WizWand

Question Answering on WebQSP

96.7Hit@1Paths-over-Graph
37.31652.73368.1583.567Feb 12, 2024Jul 5, 2024Nov 27, 2024Apr 21, 2025Sep 13, 2025Feb 5, 2026Jun 30, 2026
Updated 4mo ago

Evaluation results

MethodLinks
Paths-over-GraphSetting=LLM w/ LLM Retriever, LLM=GPT-42026.0696.7———
DoGSetting=LLM w/ LLM Retriever, LLM=GPT-42026.0691———
Plan-on-GraphSetting=LLM w/ LLM Retriever, LLM=GPT-42026.0687.3———
AGE AMARSetting=Frozen LLM w/ Graph Embedding + PEFT(LoRA), LLM=Llama2-7B2026.0686.5———
EMBRAGType=LLMs+KGs, Backbone=LLaMA2-Chat-7B2026.0286.4———
AGE AMARSetting=Frozen LLM w/ Graph Embedding + PEFT(LoRA), LLM=Llama2-13B2026.0686.2———
ReKnoSSetting=LLM w/ LLM Retriever, LLM=GPT-42026.0684.9———
AMARSetting=Frozen LLM w/ Graph Embedding + PEFT(LoRA), LLM=Llama2-7B2026.0684.3———
AMARSetting=Frozen LLM w/ Graph Embedding + PEFT(LoRA), LLM=Llama2-13B2026.0683.3———
KG-AgentSetting=LLM w/ LLM Retriever, LLM=Llama2-7B2026.0683.3———
ToGBackbone=GPT-4, Reasoning Strategy=ToG2025.1282.6———
SGRBackbone=GPT-4, Reasoning Strategy=SGR2025.1282.680.8——
ToGSetting=LLM w/ LLM Retriever, LLM=GPT-42026.0682.6———
Prior FT SOTAEvaluation Protocol=Fine-tuned2025.1282.1———
AGE G-RetrieverSetting=Frozen LLM w/ Graph Embedding + PEFT(LoRA), LLM=Llama3.1-8B2026.0680.3———
SGRBackbone=ChatGPT, Reasoning Strategy=SGR2025.1280.178.4——
AGE G-RetrieverSetting=Frozen LLM w/ Graph Embedding, LLM=Llama3.1-8B2026.0678.3———
AGE G-RetrieverSetting=Frozen LLM w/ Graph Embedding + PEFT(LoRA), LLM=Llama3.2-3B2026.0677.3———
Qwen3-235BFramework=StructGPT2026.0476.49——22.84
ToGBackbone=ChatGPT, Reasoning Strategy=ToG2025.1276.2———
MixedFramework=StructGPT2026.0475.8——11.79
ChatGPT+CoTType=LLMs2026.0275.6———
Qwen3-235BFramework=Readi2026.0475.17——58.45
SGRBackbone=Cypher LLM, Reasoning Strategy=SGR2025.1274.570.6——
Prior Prompting SOTAEvaluation Protocol=Prompting2025.1274.4———
MixedFramework=Readi2026.0474.31——25.97
Qwen3-235BFramework=ToG2026.0474.27——64.25
G-Retriever w/ LoRASetting=Tuned LLM2024.0273.79———
AGE G-RetrieverSetting=Frozen LLM w/ Graph Embedding, LLM=Llama3.2-3B2026.0673.5———
MixedFramework=ToG2026.0473.2——26.77
StructGPTBackbone=ChatGPT, Reasoning Strategy=StructGPT2025.1272.6———
Qwen2.5-7BFramework=StructGPT2026.0471.76———
TransferNetType=Embedding2026.0271.4———
G-RetrieverSetting=Frozen LLM w/ Graph Embedding + PEFT(LoRA), LLM=Llama3.2-3B2026.0671.4———
G-RetrieverSetting=Frozen LLM w/ Graph Embedding, LLM=Llama3.2-3B2026.0671.3———
G-RetrieverSetting=Frozen LLM w/ PT2024.0270.49———
G-RetrieverSetting=Frozen LLM w/ Graph Embedding + PEFT(LoRA), LLM=Llama2-7B2026.0670.2———
Qwen2.5-7BFramework=Readi2026.0469.83———
AGE G-RetrieverSetting=Frozen LLM w/ Graph Embedding + PEFT(LoRA), LLM=Llama3.2-1B2026.0669.1———
PullNetType=Retrieval2026.0268.1———
G-RetrieverSetting=Frozen LLM w/ Graph Embedding, LLM=Llama2-7B2026.0668.1———
BiNetType=Embedding2026.0267.6———
Qwen2.5-7BFramework=ToG2026.0467.25———
ChatGPTType=LLMs2026.0266.8———
EmbedKGQAType=Embedding2026.0266.6———
GraftNetType=Retrieval2026.0266.4———
LoRASetting=Tuned LLM2024.0266.03———
G-RetrieverSetting=Frozen LLM w/ Graph Embedding + PEFT(LoRA), LLM=Llama3.2-1B2026.0665.3———
IO PromptBackbone=ChatGPT, Reasoning Strategy=IO Prompt2025.1263.358.2——
AGE G-RetrieverSetting=Frozen LLM w/ Graph Embedding, LLM=Llama3.2-1B2026.0662.5———
CoTBackbone=ChatGPT, Reasoning Strategy=CoT2025.1262.257.7——
G-RetrieverSetting=Frozen LLM w/ Graph Embedding, LLM=Llama3.2-1B2026.0660.1———
GraphTokenSetting=Frozen LLM w/ PT2024.0257.05———
KAPINGSetting=Inference-only2024.0252.64———
Zero-CoTSetting=Inference-only2024.0251.3———
Prompt tuningSetting=Frozen LLM w/ PT2024.0248.34———
KV-MemType=Embedding2026.0246.7———
Zero-shotSetting=Inference-only2024.0241.06———
COT-BAGSetting=Inference-only2024.0239.6———
CureLLM2026.06—72.58——
G-retrieverGenerator=Qwen2-7B2025.10—25.7435.45—
G-retrieverGenerator=Llama3-8B2025.10—22.6732.26—
G-retrieverGenerator=Finetuned-7B2025.10—30.3443.49—
G-Retriever2026.06—70.49——
Graph-S^3Generator=Qwen2-7B2025.10—36.2447.88—
Graph-S^3Generator=Llama3-8B2025.10—32.3143.26—
Graph-S^3Generator=Finetuned-7B2025.10—44.2958.45—
GraphToken2026.06—57.05——
KG-AgentGenerator=Qwen2-7B2025.10—29.6638.02—
KG-AgentGenerator=Llama3-8B2025.10—32.0441.99—
KG-AgentGenerator=Finetuned-7B2025.10—42.655.38—
LightRAGGenerator=Qwen2-7B2025.10—18.3931.67—
LightRAGGenerator=Llama3-8B2025.10—15.8536.66—
LightRAGGenerator=Finetuned-7B2025.10—17.3832.59—
MuseGraph2026.06—70.61——
No graphGenerator=Qwen2-7B2025.10—5.168.11—
No graphGenerator=Llama3-8B2025.10—8.9715.69—
No graphGenerator=Finetuned-7B2025.10—9.2114.88—
No retrieverGenerator=Qwen2-7B2025.10—0.251.83—
No retrieverGenerator=Llama3-8B2025.10—0.181.97—
No retrieverGenerator=Finetuned-7B2025.10—0.372.26—
Prompt tuning2026.06—48.34——
RAG/1hopGenerator=Qwen2-7B2025.10—27.8938.57—
RAG/1hopGenerator=Llama3-8B2025.10—24.8235.28—
RAG/1hopGenerator=Finetuned-7B2025.10—28.8741.48—
RAG/2hopGenerator=Qwen2-7B2025.10—14.0724.47—
RAG/2hopGenerator=Llama3-8B2025.10—11.0622.94—
RAG/2hopGenerator=Finetuned-7B2025.10—14.9327.76—
RAG/3hopGenerator=Qwen2-7B2025.10—1.547.94—
RAG/3hopGenerator=Llama3-8B2025.10—1.046.67—
RAG/3hopGenerator=Finetuned-7B2025.10—1.547.81—
ToGGenerator=Qwen2-7B2025.10—6.149.79—
ToGGenerator=Llama3-8B2025.10—8.8514.28—
ToGGenerator=Finetuned-7B2025.10—5.049.43—