Temporal Knowledge Graph Question Answering on MultiTQ
85.5Hits@1 (Overall)TKG-Thinker
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| TKG-ThinkerBackbone=Qwen2.5-7B-Instruct, Training Protocol=SFT+GRPO2026.02 | 85.5 | 72.1 | 91 | 81.4 | 95.5 | — | — | — | — | — | |
| TKG-ThinkerBackbone=Qwen2.5-7B-Instruct, Training Protocol=SFT+PPO2026.02 | 82.4 | 68.3 | 88.1 | 77.4 | 94.5 | — | — | — | — | — | |
| TKG-ThinkerBackbone=Llama3-8B-Instruct, Training Protocol=SFT+GRPO2026.02 | 81 | 65.9 | 87.2 | 75.6 | 94.3 | — | — | — | — | — | |
| TKG-ThinkerBackbone=Qwen3-4B-Instruct, Training Protocol=SFT+GRPO2026.02 | 80.4 | 53.3 | 91.4 | 73.9 | 96.3 | — | — | — | — | — | |
| TKG-ThinkerBackbone=Llama3-8B-Instruct, Training Protocol=SFT+PPO2026.02 | 79.9 | 64.4 | 86.1 | 70.9 | 73.9 | — | — | — | — | — | |
| Prog-TQA2024.04 | 79.7 | 75 | 81.7 | 79 | 81.5 | 93.4 | 91 | 94.4 | 92.2 | 96.3 | |
| TKG-ThinkerBackbone=Qwen3-4B-Instruct, Training Protocol=SFT+PPO2026.02 | 78 | 48 | 90.1 | 70.8 | 95.6 | — | — | — | — | — | |
| Temp-R1Method Category=FineTune-based LLM2026.01 | 78 | 55 | 88.8 | 71.4 | 96.9 | — | — | — | — | — | |
| PoKModel Category=LLM-based Methods2026.02 | 77.9 | 40.9 | 92.9 | 69.6 | 96.2 | — | — | — | — | — | |
| PoKMethod Category=FineTune-based LLM2026.01 | 77.9 | 40.9 | 92.9 | 69.6 | 96.2 | — | — | — | — | — | |
| RTQAModel Category=LLM-based Methods2026.02 | 76.5 | 42.4 | 90.2 | 69.2 | 94.2 | — | — | — | — | — | |
| RTQAMethod Category=Prompt-based LLM2026.01 | 76.5 | 42.4 | 90.2 | 69.2 | 94.2 | — | — | — | — | — | |
| MemoTimeMethod Category=Prompt-based LLM2026.01 | 73 | 45.9 | 82.9 | 67.7 | 84.6 | — | — | — | — | — | |
| TimeRModel Category=LLM-based Methods2026.02 | 72.8 | 33.5 | 88.7 | 63.9 | 94.5 | — | — | — | — | — | |
| TimeR4Method Category=FineTune-based LLM2026.01 | 72.8 | 33.5 | 88.7 | 63.9 | 94.5 | — | — | — | — | — | |
| TempAgentModel Category=LLM-based Methods2026.02 | 70.2 | 31.6 | 85.7 | 62.4 | 87 | — | — | — | — | — | |
| TempAgentMethod Category=Prompt-based LLM2026.01 | 70.2 | 31.6 | 85.7 | 62.4 | 87 | — | — | — | — | — | |
| ReAct RAGModel Category=LLM-based Methods2026.02 | 39.8 | 13 | 50.6 | 24.3 | 73.5 | — | — | — | — | — | |
| ARIModel Category=LLM-based Methods2026.02 | 38 | 21 | 68 | 39.4 | 34.4 | — | — | — | — | — | |
| ARIMethod Category=Prompt-based LLM2026.01 | 38 | 21 | 68 | 39.4 | 34.4 | — | — | — | — | — | |
| Naive RAGModel Category=LLM-based Methods2026.02 | 37.9 | 15.5 | 46.9 | 24.2 | 67.2 | — | — | — | — | — | |
| Search-R1Method Category=FineTune-based LLM2026.01 | 35.2 | 9.4 | 47.4 | 23 | 70.5 | — | — | — | — | — | |
| MultiQA2024.04 | 29.3 | 15.9 | 34.7 | 34.9 | 15.7 | 63.5 | 51.9 | 68.2 | 73.3 | 39.6 | |
| MultiQAModel Category=Embedding-based Methods2026.02 | 29.3 | 15.9 | 34.7 | 34.9 | 15.7 | — | — | — | — | — | |
| MultiQAMethod Category=TKG Embedding-based method2026.01 | 29.3 | 15.9 | 34.7 | 34.9 | 15.7 | — | — | — | — | — | |
| CronKGQA2024.04 | 27.9 | 13.4 | 33.7 | 32.8 | 15.6 | 60.8 | 45.3 | 67.1 | 69.6 | 39.2 | |
| CronKGQAModel Category=Embedding-based Methods2026.02 | 27.9 | 13.4 | 33.7 | 32.8 | 15.6 | — | — | — | — | — | |
| CronKGQAMethod Category=TKG Embedding-based method2026.01 | 27.9 | 13.4 | 33.7 | 32.8 | 15.6 | — | — | — | — | — | |
| EmbedKGQA2024.04 | 20.6 | 13.4 | 23.5 | 29 | 0.1 | 45.9 | 43.9 | 46.7 | 64.8 | 0.1 | |
| EmbedKGQAModel Category=Embedding-based Methods2026.02 | 20.6 | 13.4 | 23.5 | 29 | 0.1 | — | — | — | — | — | |
| EmbedKGQAMethod Category=TKG Embedding-based method2026.01 | 20.6 | 13.4 | 23.5 | 29 | 0.1 | — | — | — | — | — | |
| ALBERTModel Category=PLM-based Methods2026.02 | 10.8 | 8.6 | 11.6 | 13.9 | 3.2 | — | — | — | — | — | |
| BERT2024.04 | 8.3 | 6.1 | 9.2 | 10.1 | 4 | 44.1 | 39.2 | 46.1 | 53.1 | 22.2 | |
| BERTModel Category=PLM-based Methods2026.02 | 8.3 | 6.1 | 9.2 | 10.1 | 4 | — | — | — | — | — | |
| DistillBERTModel Category=PLM-based Methods2026.02 | 8.3 | 7.4 | 8.7 | 10.2 | 3.7 | — | — | — | — | — |