Numerical Reasoning on US-Cities
43.9H@1NumCoKE
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| NumCoKEModel Category=Ours2024.11 | 43.9 | 53.6 | 64 | 119 | 50.8 | |
| RAKGEModel Category=Self-supervised2024.11 | 39.5 | 45.5 | 52.9 | 199 | 44.2 | |
| SimGCLModel Category=Self-supervised2024.11 | 34.4 | 41.5 | 50.2 | 162 | 39.9 | |
| NRNModel Category=Deterministic2024.11 | 29.8 | 32.6 | 43.2 | 155 | 32.3 | |
| LiteralEModel Category=Attributed2024.11 | 24.6 | 30.8 | 40.2 | 228 | 29.9 | |
| KGDMModel Category=Euclidean2024.11 | 23.2 | 27.1 | 35.3 | 329 | 24.6 | |
| R-GCNModel Category=GNNs2024.11 | 21.2 | 27.1 | 35.5 | 314 | 26.3 | |
| DaBRModel Category=Euclidean2024.11 | 20.2 | 25.6 | 33.7 | 352 | 24.1 | |
| NEKGModel Category=Deterministic2024.11 | 19.6 | 23 | 30.4 | 376 | 21.7 | |
| TransEModel Category=Euclidean2024.11 | 18.9 | 24.8 | 32.4 | 367 | 23.9 | |
| BiGIModel Category=Self-supervised2024.11 | 18.5 | 24.9 | 33.1 | 359 | 23.6 | |
| SliCEModel Category=Self-supervised2024.11 | 18.5 | 25 | 33.1 | 359 | 23.7 | |
| LorentzKGModel Category=Hyperbolic2024.11 | 17.9 | 22.1 | 28.6 | 368 | 20.9 | |
| ConvEModel Category=Euclidean2024.11 | 15.8 | 20.2 | 27.4 | 385 | 19.8 | |
| TuckERModel Category=Euclidean2024.11 | 15.6 | 21.2 | 30.8 | 321 | 20.7 | |
| GIEModel Category=Hyperbolic2024.11 | 9.5 | 13.4 | 20.6 | 570 | 13.2 | |
| RuIEModel Category=Euclidean2024.11 | 8.4 | 12.6 | 18.5 | 587 | 12 | |
| MuRPModel Category=Hyperbolic2024.11 | 8.2 | 11.3 | 17.5 | 457 | 11.5 | |
| MT-KGNNModel Category=Attributed2024.11 | 7.1 | 10.9 | 15.6 | 653 | 10.2 | |
| AttHModel Category=Hyperbolic2024.11 | 5.1 | 6.9 | 10.8 | 1,255 | 7.6 | |
| WGCNModel Category=GNNs2024.11 | 2.9 | 5.6 | 10.4 | 968 | 5.7 | |
| ConEModel Category=Hyperbolic2024.11 | 0.9 | 4.2 | 11.4 | 239 | 4.8 | |
| KBLRNModel Category=Attributed2024.11 | 0.6 | 1.8 | 4.6 | 2,164 | 2.1 | |
| HAKEModel Category=Euclidean2024.11 | 0.3 | 2.5 | 6.4 | 981 | 2.4 |