Temporal Knowledge Graph Question Answering on TimeQuestions (test)
71.4Hits@1 (Overall)MemoTime
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| MemoTimeLLM=GPT-4-Turbo2025.10 | 71.4 | 67 | 67.5 | 74.5 | 58.7 | |
| MemoTimeLLM=DeepSeek-V32025.10 | 67.8 | 63.1 | 53.3 | 71.3 | 54.3 | |
| TimeR4Status=Fine-tune2025.10 | 64.8 | 66 | 52.9 | 77.6 | 45.5 | |
| MemoTimeLLM=GPT-4o-mini2025.10 | 60.9 | 60 | 50 | 69.4 | 52.8 | |
| MemoTimeLLM=Qwen3-32B2025.10 | 60.6 | 58.3 | 51.1 | 69.8 | 53.3 | |
| TwiRGCN (average)Edge weighting function variant=average2022.10 | 60.5 | 60.2 | 58.6 | 64.1 | 51.8 | |
| TwiRGCNrepresentation=average2024.02 | 60.5 | 60.2 | 58.6 | 64.1 | 51.8 | |
| TwiRGCN2025.10 | 60.5 | 60.2 | 58.6 | 64.1 | 51.8 | |
| TwiRGCN (interval)Edge weighting function variant=interval2022.10 | 60.3 | 59.9 | 60.3 | 64.6 | 49.4 | |
| TwiRGCNrepresentation=interval2024.02 | 60.3 | 59.9 | 60.3 | 64.6 | 49.4 | |
| GenTKGQA2024.02 | 58.4 | 59.6 | 61.1 | 56.3 | 57.8 | |
| GenTKGQAStatus=Fine-tune2025.10 | 58.4 | 59.6 | 61.1 | 56.3 | 57.8 | |
| EXAQT2022.10 | 57.2 | 56.8 | 51.2 | 64.2 | 42 | |
| EXAQT2025.10 | 57.2 | 56.8 | 51.2 | 64.2 | 42 | |
| Temporal-Aware Heterogeneous Graph Reasoning with Multi-View Fusion2026.02 | 53.9 | 53.4 | 51 | 61.7 | 41.2 | |
| QC-MHM2024.02 | 53.1 | 53.3 | 50.8 | 60.7 | 40.1 | |
| LGQA2025.10 | 52.9 | 53.2 | 50.6 | 60.5 | 40.2 | |
| CTRN2026.02 | 46.6 | 46.9 | 44.6 | 51.2 | 38.2 | |
| CTRN2024.02 | 46.5 | 46.9 | 44.6 | 51.2 | 38.2 | |
| CronKGQA2022.10 | 46.2 | 46.6 | 44.5 | 51.1 | 36.9 | |
| CronKGQA2024.02 | 46.2 | 46.6 | 44.5 | 51.1 | 36.9 | |
| CronKGQA2025.10 | 46.2 | 46.6 | 44.5 | 51.1 | 36.9 | |
| TempoQR2024.02 | 45.9 | 50.3 | 44.2 | 45.8 | 36.7 | |
| ChatGPTLLM=GPT 3.5 Turbo2025.10 | 45.9 | 43.3 | 51.1 | 46.5 | 48.1 | |
| TempoQR2026.02 | 45.9 | 50.3 | 44.2 | 45.8 | 36.7 | |
| GRAFT-Net2022.10 | 45.2 | 44.5 | 42.8 | 51.5 | 32.2 | |
| GRAFT-Net2025.10 | 45.2 | 44.5 | 42.8 | 51.5 | 32.2 | |
| TMA2024.02 | 43.6 | 44.2 | 41.9 | 47.6 | 35.2 | |
| TMA2026.02 | 43.5 | 44.2 | 41.9 | 47.6 | 35.2 | |
| TempoQR2022.10 | 41.6 | 46.5 | 36 | 40 | 34.9 | |
| TempoQR2024.02 | 41.6 | 46.5 | 36 | 40 | 34.9 | |
| TempoQR2025.10 | 41.6 | 46.5 | 3.6 | 40 | 34.9 | |
| CronKGQA2024.02 | 39.3 | 38.8 | 38 | 43.6 | 33.2 | |
| CronKGQA2026.02 | 39.3 | 38.8 | 38 | 43.6 | 33.2 | |
| Uniqorn2022.10 | 33.1 | 31.8 | 31.6 | 39.2 | 20.2 | |
| Uniqorn2025.10 | 33.1 | 31.8 | 31.6 | 39.2 | 20.2 | |
| PullNet2022.10 | 10.5 | 2.2 | 8.1 | 23.4 | 2.9 | |
| PullNet2025.10 | 10.5 | 2.2 | 8.1 | 23.4 | 2.9 |