Temporal Knowledge Graph Prediction on ICEWS05-15 (test)
39Hits@1InternLM2-7B-ONSEP
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| InternLM2-7B-ONSEPTrain=false, history length (L)=2002024.08 | 39 | — | 55.1 | 66.8 | |
| InternLM2-7B-ONSEPTrain=false, history length (L)=1002024.08 | 38.6 | — | 54.6 | 66.2 | |
| TITerTrain=true2024.08 | 38.3 | — | 52.8 | 64.9 | |
| TiRGN + CoHModel Type=LLMs + Graph, Backbone=TiRGN2024.02 | 38.01 | 49.71 | 56.4 | 71.25 | |
| XERTETrain=true2024.08 | 37.8 | — | 52.3 | 63.9 | |
| RE-GCN + CoHModel Type=LLMs + Graph, Backbone=RE-GCN2024.02 | 37.53 | 47.98 | 54.94 | 70.68 | |
| RE-GCNTrain=true2024.08 | 37.3 | — | 53.9 | 68.5 | |
| TiRGN + ICLModel Type=LLMs + Graph, Backbone=TiRGN, Reproduced=true2024.02 | 37.25 | 49.15 | 55.73 | 70.9 | |
| TiRGNModel Type=LLMs + Graph2024.02 | 36.87 | 48.5 | 55.19 | 70.27 | |
| RE-GCN + ICLModel Type=LLMs + Graph, Backbone=RE-GCN, Reproduced=true2024.02 | 36.16 | 47.87 | 54.24 | 69.43 | |
| InternLM2-7B-ICLTrain=false, history length (L)=2002024.08 | 35.9 | — | 52 | 65.9 | |
| RE-GCNModel Type=LLMs + Graph2024.02 | 35.5 | 46.89 | 53.33 | 68.4 | |
| InternLM2-7B-ICLTrain=false, history length (L)=1002024.08 | 35.3 | — | 50.7 | 64.7 | |
| RE-NET + CoHModel Type=LLMs + Graph, Backbone=RE-NET2024.02 | 34.99 | 46.37 | 53.13 | 67.71 | |
| RE-NET + ICLModel Type=LLMs + Graph, Backbone=RE-NET, Reproduced=true2024.02 | 33.98 | 45.12 | 52.09 | 66.23 | |
| RE-NETTrain=true2024.08 | 33.6 | — | 48.8 | 62.7 | |
| RE-NETModel Type=LLMs + Graph2024.02 | 33.22 | 44.05 | 51.23 | 65.02 | |
| CyGNetTrain=true2024.08 | 29.4 | — | 46.1 | 61.6 | |
| CoHModel Type=LLMs2024.02 | 27.72 | 37.51 | 47.17 | 59.58 | |
| ICLModel Type=LLMs, Reproduced=true2024.02 | 25.18 | 35.34 | 43.92 | 56.24 |