Temporal Knowledge Graph Reasoning on ICEWS18 (test)
24.34Hits@1RPC
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| RPC2025.05 | 24.34 | — | 38.74 | 55.89 | — | — | |
| GenTKGLearning Strategy=Supervised Fine-tuning2025.05 | 24.25 | — | 37.25 | 42.1 | — | — | |
| CENET2025.05 | 23.47 | — | 34.05 | 47.27 | — | — | |
| DiMNet2025.05 | 23.29 | 34.13 | 38.42 | 55.8 | — | — | |
| RiRGN2025.05 | 23.1 | — | 37.9 | 54.2 | — | — | |
| G2SLearning Strategy=Supervised Fine-tuning2025.05 | 23.04 | — | 35.32 | 46.62 | — | — | |
| G2S2025.05 | 23.04 | — | 35.32 | 46.62 | — | — | |
| TiPNNReasoning Type=Extrapolated TKG Reasoning2025.05 | 22.74 | 32.17 | 36.24 | 50.72 | — | — | |
| DaeMonReasoning Type=Extrapolated TKG Reasoning2025.05 | 22.67 | 31.85 | 35.92 | 49.8 | — | — | |
| IGETR2026.01 | 22.5 | — | 35.7 | 53 | — | — | |
| RE-GCNLearning Strategy=Traditional Method2025.05 | 22.3 | — | 36.7 | 52.5 | — | — | |
| L2TKG2025.05 | 22.15 | — | — | 55.04 | — | — | |
| TITerReasoning Type=Extrapolated TKG Reasoning2025.05 | 22.05 | 29.98 | 33.46 | 44.83 | — | — | |
| RETIA2025.05 | 21.96 | — | 36.18 | 51.95 | — | — | |
| Llama-2-7bProtocol=COH2026.01 | 21.9 | — | 36.1 | 52 | — | — | |
| TiRGN + CoHModel Type=LLMs + Graph, Backbone=TiRGN2024.02 | 21.83 | 32.98 | 37.79 | 54.92 | — | — | |
| RE-GCN + CoHModel Type=LLMs + Graph, Backbone=RE-GCN2024.02 | 21.75 | 32.1 | 36.51 | 53.37 | — | — | |
| GenTKG2026.01 | 21.5 | — | 36.6 | 49.6 | — | — | |
| CENReasoning Type=Extrapolated TKG Reasoning2025.05 | 21.23 | 30.84 | 34.58 | 49.67 | — | — | |
| TITerLearning Strategy=Traditional Method2025.05 | 21.2 | — | 32.5 | 43.9 | — | — | |
| TiRGN + ICLModel Type=LLMs + Graph, Backbone=TiRGN, Reproduced=true2024.02 | 21.07 | 32.18 | 36.98 | 54.04 | — | — | |
| xERTEReasoning Type=Extrapolated TKG Reasoning2025.05 | 21.03 | 29.31 | 33.4 | 45.6 | — | — | |
| RE-GCNReasoning Type=Extrapolated TKG Reasoning2025.05 | 21.01 | 30.58 | 34.34 | 48.75 | — | — | |
| TiRGNModel Type=LLMs + Graph2024.02 | 20.95 | 31.97 | 36.67 | 53.66 | — | — | |
| XERTELearning Strategy=Traditional Method2025.05 | 20.9 | — | 33.5 | 46.2 | — | — | |
| MetaTKGRshot=2-shot2022.10 | 20.8 | 30 | 31.1 | 50 | — | — | |
| CaORG2026.01 | 20.8 | — | 33.5 | 47.9 | — | — | |
| RE-GCN + ICLModel Type=LLMs + Graph, Backbone=RE-GCN, Reproduced=true2024.02 | 20.65 | 31.31 | 35.79 | 52.61 | — | — | |
| xERTE2026.01 | 20.6 | — | 33 | 45.8 | — | — | |
| Vicuna-7bProtocol=COH2026.01 | 20.6 | — | 34.4 | 53.1 | — | — | |
| TLogic2026.01 | 20.5 | — | 33.9 | 48.4 | — | — | |
| RE-GCNModel Type=LLMs + Graph2024.02 | 20.44 | 31.08 | 35.39 | 52.06 | — | — | |
| TLogicLearning Strategy=Traditional Method2025.05 | 20.4 | — | 33.6 | 48 | — | — | |
| TiRGN2026.01 | 20.2 | — | 33.9 | 48.4 | — | — | |
| RE-NET + CoHModel Type=LLMs + Graph, Backbone=RE-NET2024.02 | 19.96 | 29.77 | 34.14 | 49.59 | — | — | |
| G2S_GL(R) w. WIKISetting=Zero-shot, External Knowledge=WIKI, Anonymization=RID2025.05 | 19.71 | — | 31.58 | 43.45 | — | — | |
| G2S_GL(R)Setting=Zero-shot, Anonymization=RID2025.05 | 19.54 | — | 31.34 | 43.29 | — | — | |
| G2S_GL(F)Setting=Zero-shot, Anonymization=FID2025.05 | 19.47 | — | 31.17 | 43.05 | — | — | |
| G2S_GL(F+Map)Setting=Zero-shot, Anonymization=FID + Scenario Mapping2025.05 | 19.43 | — | 31.87 | 44.52 | — | — | |
| TANGO-TuckerReasoning Type=Extrapolated TKG Reasoning2025.05 | 19.35 | 28.68 | 32.17 | 47.04 | — | — | |
| RE-GCN2026.01 | 19.3 | — | 33.1 | 49.4 | — | — | |
| GPT-NeoX-ICLLearning Strategy=In-context Learning2025.05 | 19.2 | — | 31.3 | 41.4 | — | — | |
| GPT-NeoX-ICLSetting=Zero-shot2025.05 | 19.2 | — | 31.3 | 41.4 | — | — | |
| RE-NET2026.01 | 19.2 | — | 32.3 | 48.3 | — | — | |
| HGLS2026.01 | 19.2 | — | 32.3 | 49.4 | — | — | |
| TANGOLearning Strategy=Traditional Method2025.05 | 19.1 | — | 31.8 | 46.2 | — | — | |
| RE-NETReasoning Type=Extrapolated TKG Reasoning2025.05 | 19.05 | 28.81 | 32.44 | 47.51 | — | — | |
| GHTReasoning Type=Extrapolated TKG Reasoning2025.05 | 18.99 | 29.16 | 33.16 | 48.37 | — | — | |
| RE-NET + ICLModel Type=LLMs + Graph, Backbone=RE-NET, Reproduced=true2024.02 | 18.98 | 29.01 | 33.11 | 48.78 | — | — | |
| RE-NETModel Type=LLMs + Graph2024.02 | 18.84 | 28.72 | 32.66 | 48.18 | — | — | |
| MetaDyGNNshot=2-shot2022.10 | 18.4 | 26.9 | 26.7 | 44.1 | — | — | |
| llama3-ICLLearning Strategy=In-context Learning2025.05 | 18.1 | — | 27.2 | 28.8 | — | — | |
| llama3-ICLSetting=Zero-shot2025.05 | 18.1 | — | 27.2 | 28.8 | — | — | |
| TANGO-DistMultReasoning Type=Extrapolated TKG Reasoning2025.05 | 17.92 | 26.65 | 30.08 | 44.09 | — | — | |
| TANGO2026.01 | 17.8 | — | 31.4 | 46 | — | — | |
| GPT-NeoX-20BProtocol=ICL2026.01 | 17.7 | — | 29 | 38.5 | — | — | |
| Llama-2-7bProtocol=ICL2026.01 | 17.7 | — | 29.5 | 36.4 | — | — | |
| Vicuna-7bProtocol=ICL2026.01 | 17.2 | — | 28.8 | 36.4 | — | — | |
| CoHModel Type=LLMs2024.02 | 16.81 | 23.94 | 28.15 | 42.68 | — | — | |
| ConvEReasoning Type=Traditional KG Reasoning2025.05 | 16.23 | 24.51 | 29.25 | 44.51 | — | — | |
| CyGNetReasoning Type=Extrapolated TKG Reasoning2025.05 | 15.9 | 24.93 | 28.28 | 42.61 | — | — | |
| ComplExReasoning Type=Traditional KG Reasoning2025.05 | 15.19 | 22.94 | 27.05 | 42.11 | — | — | |
| ICLModel Type=LLMs, Reproduced=true2024.02 | 14.77 | 21.51 | 26.08 | 40.57 | — | — | |
| FrequencySetting=Zero-shot2025.05 | 14.1 | — | 26.5 | 40.9 | — | — | |
| llama2-ICLLearning Strategy=In-context Learning2025.05 | 13.5 | — | 27.6 | 32.6 | — | — | |
| llama2-ICLSetting=Zero-shot2025.05 | 13.5 | — | 27.6 | 32.6 | — | — | |
| TNTComplExReasoning Type=Interpolated TKG Reasoning2025.05 | 13.28 | 21.23 | 24.02 | 36.91 | — | — | |
| DE-SimplEReasoning Type=Interpolated TKG Reasoning2025.05 | 11.53 | 19.3 | 21.86 | 34.8 | — | — | |
| T-GENshot=2-shot2022.10 | 11.1 | 16.1 | 18.5 | 25.9 | — | — | |
| RE-NETshot=2-shot2022.10 | 10.9 | 20 | 21.4 | 34.1 | — | — | |
| I-GENshot=2-shot2022.10 | 9.2 | 17.7 | 21.2 | 33.7 | — | — | |
| LANshot=2-shot2022.10 | 8.9 | 18.8 | 17.6 | 31.7 | — | — | |
| TA-DistMultReasoning Type=Interpolated TKG Reasoning2025.05 | 8.61 | 16.75 | 18.41 | 33.59 | — | — | |
| DistMultReasoning Type=Traditional KG Reasoning2025.05 | 7.03 | 11.51 | 12.87 | 20.86 | — | — | |
| RotatEshot=2-shot2022.10 | 6.5 | 7 | 6.8 | 9.1 | — | — | |
| TransRshot=2-shot2022.10 | 4.4 | 6 | 5.4 | 9 | — | — | |
| TransEshot=2-shot2022.10 | 4.2 | 5.8 | 5.4 | 8.6 | — | — | |
| RotatEReasoning Type=Traditional KG Reasoning2025.05 | 4.01 | 12.78 | 14.89 | 31.91 | — | — | |
| TTransEReasoning Type=Interpolated TKG Reasoning2025.05 | 1.92 | 8.31 | 8.56 | 21.89 | — | — | |
| DiffuTKG2026.02 | — | — | — | — | 135.8 | — | |
| NADEx2026.02 | — | — | — | — | 96.95 | — | |
| RE-GCN2026.02 | — | — | — | — | 393.67 | — | |
| TiRGN2026.02 | — | — | — | — | 159.9 | — |