Numerical Reasoning on Credit
74.5Hit Rate @ 1NumCoKE
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| NumCoKEModel Category=Ours2024.11 | 74.5 | 81.8 | 88.8 | 7 | 79.4 | |
| RAKGEModel Category=Self-supervised2024.11 | 64.7 | 73.3 | 82.3 | 12 | 70.8 | |
| NRNModel Category=Deterministic2024.11 | 56 | 63.9 | 74 | 21 | 62 | |
| R-GCNModel Category=GNNs2024.11 | 48 | 57 | 67.5 | 34 | 54.6 | |
| LiteralEModel Category=Attributed2024.11 | 47.5 | 56.2 | 67.6 | 36 | 54.9 | |
| DaBRModel Category=Euclidean2024.11 | 42.5 | 52.6 | 62.1 | 36 | 49.8 | |
| TransEModel Category=Euclidean2024.11 | 42.1 | 52 | 63 | 39 | 49.3 | |
| SliCEModel Category=Self-supervised2024.11 | 42 | 51 | 62.2 | 38 | 49 | |
| KGDMModel Category=Euclidean2024.11 | 41.9 | 53.2 | 62.6 | 39 | 48.2 | |
| BiGIModel Category=Self-supervised2024.11 | 41.8 | 50.7 | 62.2 | 39 | 48.7 | |
| TuckERModel Category=Euclidean2024.11 | 40.5 | 51.2 | 63.8 | 36 | 48.5 | |
| LorentzKGModel Category=Hyperbolic2024.11 | 40.2 | 50.9 | 59.7 | 38 | 48.2 | |
| NEKGModel Category=Deterministic2024.11 | 39.8 | 51.2 | 58.9 | 41 | 47.7 | |
| RuIEModel Category=Euclidean2024.11 | 29.1 | 38.8 | 51.3 | 65 | 36.6 | |
| GIEModel Category=Hyperbolic2024.11 | 28.5 | 38.8 | 51.2 | 76 | 35.9 | |
| MT-KGNNModel Category=Attributed2024.11 | 21.1 | 30.4 | 43.6 | 74 | 28.5 | |
| AttHModel Category=Hyperbolic2024.11 | 17.6 | 26.1 | 39.5 | 101 | 25.1 | |
| ConvEModel Category=Euclidean2024.11 | 17.1 | 28.1 | 43 | 58 | 26.1 | |
| WGCNModel Category=GNNs2024.11 | 17 | 25.6 | 36.9 | 100 | 24.1 | |
| MuRPModel Category=Hyperbolic2024.11 | 15.1 | 24.6 | 43.2 | 80 | 22.8 | |
| HAKEModel Category=Euclidean2024.11 | 5.1 | 15.1 | 27.3 | 128 | 13.4 | |
| KBLRNModel Category=Attributed2024.11 | 0.7 | 2 | 7.9 | 271 | 6.1 | |
| ConEModel Category=Hyperbolic2024.11 | 0.6 | 24.1 | 39.5 | 82 | 15.6 | |
| SimGCLModel Category=Self-supervised2024.11 | 0 | 39.9 | 64.5 | 22 | 23.9 |