Temporal Knowledge Graph reasoning on ICEWS 18
0.627Hits@10DREAM
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| DREAMtask=extrapolation2025.12 | 0.627 | 0.391 | 0.28 | 0.452 | — | |
| EnsembleEvaluation Setting=Original2026.05 | 0.607 | 0.3774 | 0.2619 | 0.4284 | — | |
| NADEx2026.02 | 0.6058 | — | 0.2758 | 0.4512 | — | |
| LogCLEvaluation Setting=Original2026.05 | 0.5804 | 0.3543 | 0.2409 | 0.4022 | — | |
| LogCLtask=extrapolation2025.12 | 0.5774 | 0.3567 | 0.2453 | 0.4032 | — | |
| LLMDAtask=extrapolation2025.12 | 0.57 | 0.357 | 0.255 | 0.403 | — | |
| TPARtask=extrapolation2025.12 | 0.5694 | 0.3576 | 0.2658 | 0.3927 | — | |
| THCNtask=extrapolation2025.12 | 0.5676 | 0.3563 | 0.249 | 0.3926 | — | |
| DynaGentask=extrapolation2025.12 | 0.5606 | 0.4158 | 0.338 | 0.4504 | — | |
| CluSTeRModel Type=Temporal2021.06 | 0.559 | 0.323 | 0.206 | — | — | |
| LLM-DRyear=2025a2026.02 | 0.556 | — | 0.304 | 0.409 | — | |
| DyMemRtask=extrapolation2025.12 | 0.5544 | 0.355 | 0.2529 | 0.399 | — | |
| L2TKGtask=extrapolation2025.12 | 0.5504 | 0.3336 | 0.2215 | — | — | |
| ECEformertask=extrapolation2025.12 | 0.5463 | 0.4013 | 0.3225 | 0.4363 | — | |
| TiRGNEvaluation Setting=Original2026.05 | 0.5438 | 0.3354 | 0.2292 | 0.3809 | — | |
| VicunaPrompting=CoH, year=20242026.02 | 0.536 | — | 0.209 | 0.347 | — | |
| RE-GCNEvaluation Setting=Original2026.05 | 0.5274 | 0.3278 | 0.2254 | 0.3691 | — | |
| RE-GCNtask=extrapolation2025.12 | 0.5268 | 0.3262 | 0.2239 | 0.3679 | — | |
| TempValidtask=extrapolation2025.12 | 0.5233 | 0.335 | 0.2391 | 0.3789 | — | |
| LlamaPrompting=CoH, year=20242026.02 | 0.522 | — | 0.223 | 0.363 | — | |
| CENsetting=offline2022.03 | 0.5059 | 0.315 | 0.217 | 0.3544 | — | |
| EvolveRGCNModel Type=Temporal2021.06 | 0.504 | 0.286 | 0.163 | — | — | |
| EnsembleEvaluation Setting=Striking-aware2026.05 | 0.5015 | 0.2849 | 0.1777 | 0.3231 | 0.2451 | |
| MetaTKGRShot=2-shot2022.10 | 0.5 | 0.301 | — | — | — | |
| LogCLEvaluation Setting=Striking-aware2026.05 | 0.4966 | 0.2835 | 0.1779 | 0.3211 | 0.1998 | |
| MetaTKGRShot=1-shot2022.10 | 0.496 | 0.295 | — | — | — | |
| GenTKGyear=20242026.02 | 0.496 | — | 0.215 | 0.366 | — | |
| RE-GCNsetting=offline2022.03 | 0.4875 | 0.3058 | 0.2101 | 0.3434 | — | |
| TLogicEvaluation Setting=Original2026.05 | 0.4806 | 0.2959 | 0.2042 | 0.336 | — | |
| RE-NETModel Type=Temporal2021.06 | 0.479 | 0.284 | 0.184 | — | — | |
| RE-NETsetting=offline2022.03 | 0.4751 | 0.2881 | 0.1905 | 0.3244 | — | |
| TG-Tuckersetting=offline2022.03 | 0.4704 | 0.2868 | 0.1935 | 0.3217 | — | |
| XERTEsetting=offline2022.03 | 0.4648 | 0.2931 | 0.2103 | 0.3351 | — | |
| RGCRNModel Type=Temporal2021.06 | 0.458 | 0.262 | 0.164 | — | — | |
| CyGNetModel Type=Temporal2021.06 | 0.457 | 0.268 | 0.171 | — | — | |
| TITerEvaluation Setting=Original2026.05 | 0.4498 | 0.2965 | 0.2158 | 0.3306 | — | |
| ConvEModel Type=Static2021.06 | 0.449 | 0.248 | 0.151 | — | — | |
| TITersetting=offline2022.03 | 0.4483 | 0.2998 | 0.2205 | 0.3346 | — | |
| MetaDyGNNShot=2-shot2022.10 | 0.441 | 0.269 | — | — | — | |
| TG-DistMultsetting=offline2022.03 | 0.4409 | 0.2675 | 0.1792 | 0.3008 | — | |
| ICLEvaluation Setting=Original2026.05 | 0.4397 | — | 0.1927 | 0.3135 | — | |
| RecurrencyEvaluation Setting=Original2026.05 | 0.4354 | 0.2866 | 0.2077 | 0.3225 | — | |
| CyGNetsetting=offline2022.03 | 0.4261 | 0.2493 | 0.159 | 0.2828 | — | |
| TiRGNEvaluation Setting=Striking-aware2026.05 | 0.4225 | 0.2359 | 0.1421 | 0.2667 | 0.2967 | |
| RE-GCNEvaluation Setting=Striking-aware2026.05 | 0.4203 | 0.2396 | 0.1487 | 0.2683 | 0.2691 | |
| MetaDyGNNShot=1-shot2022.10 | 0.42 | 0.249 | — | — | — | |
| GenTKGEvaluation Setting=Original2026.05 | 0.4003 | — | 0.2136 | 0.3351 | — | |
| GPT-NeoXyear=20222026.02 | 0.382 | — | 0.177 | 0.29 | — | |
| LlamaPrompting=ICL, year=20232026.02 | 0.364 | — | 0.177 | 0.294 | — | |
| VicunaPrompting=ICL, year=20232026.02 | 0.364 | — | 0.172 | 0.288 | — | |
| RE-GCNShot=2-shot2022.10 | 0.347 | 0.205 | — | — | — | |
| RE-NETShot=2-shot2022.10 | 0.341 | 0.2 | — | — | — | |
| RGCNModel Type=Static2021.06 | 0.34 | 0.17 | 0.087 | — | — | |
| RotatEModel Type=Static2021.06 | 0.339 | 0.155 | 0.07 | — | — | |
| I-GENShot=2-shot2022.10 | 0.337 | 0.177 | — | — | — | |
| MINERVAModel Type=Static2021.06 | 0.33 | 0.21 | 0.153 | — | — | |
| DistMultModel Type=Static2021.06 | 0.326 | 0.175 | 0.101 | — | — | |
| TLogicEvaluation Setting=Striking-aware2026.05 | 0.3205 | 0.173 | 0.1021 | 0.1961 | 0.4153 | |
| I-GENShot=1-shot2022.10 | 0.32 | 0.199 | — | — | — | |
| LANShot=2-shot2022.10 | 0.317 | 0.188 | — | — | — | |
| TITerEvaluation Setting=Striking-aware2026.05 | 0.3132 | 0.186 | 0.121 | 0.2046 | 0.3727 | |
| LANShot=1-shot2022.10 | 0.301 | 0.17 | — | — | — | |
| ICLEvaluation Setting=Striking-aware2026.05 | 0.2858 | — | 0.0942 | 0.1787 | 0.5112 | |
| RecurrencyEvaluation Setting=Striking-aware2026.05 | 0.2683 | 0.1597 | 0.1022 | 0.1805 | 0.4428 | |
| ComplExModel Type=Static2021.06 | 0.268 | 0.188 | 0.111 | — | — | |
| GenTKGEvaluation Setting=Striking-aware2026.05 | 0.2668 | — | 0.1104 | 0.2035 | 0.4831 | |
| T-GENShot=1-shot2022.10 | 0.262 | 0.131 | — | — | — | |
| T-GENShot=2-shot2022.10 | 0.259 | 0.161 | — | — | — | |
| RE-NETShot=1-shot2022.10 | 0.25 | 0.185 | — | — | — | |
| RE-GCNShot=1-shot2022.10 | 0.247 | 0.193 | — | — | — | |
| DyRepModel Type=Temporal2021.06 | 0.163 | 0.078 | 0.036 | — | — | |
| Know-EvolveModel Type=Temporal2021.06 | 0.148 | 0.074 | 0.033 | — | — | |
| RotatEShot=1-shot2022.10 | 0.098 | 0.068 | — | — | — | |
| RotatEShot=2-shot2022.10 | 0.091 | 0.07 | — | — | — | |
| TransRShot=2-shot2022.10 | 0.09 | 0.06 | — | — | — | |
| TransEShot=2-shot2022.10 | 0.086 | 0.058 | — | — | — | |
| TransRShot=1-shot2022.10 | 0.08 | 0.05 | — | — | — | |
| TransEShot=1-shot2022.10 | 0.077 | 0.049 | — | — | — |