Logical Query Answering on FB15k-237
28.1MRR (2-inverse path)BETAE
Evaluation Results
| Method | Links | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| BETAE2020.10 | 28.1 | 24.4 | 39.1 | 24.2 | 20.4 | 39.2 | 10.6 | 19.4 | 22 | 17 | — | — | — | — | — | — | — | — | |
| Q2B2020.10 | 27.5 | 23.6 | 40.3 | 22.8 | 17.5 | 37.9 | 10.5 | 18.5 | 20.5 | 17.4 | — | — | — | — | — | — | — | — | |
| GQE2020.10 | 22 | 19.4 | 35 | 19 | 14.4 | 31.2 | 8.8 | 14.6 | 15 | 14.6 | — | — | — | — | — | — | — | — | |
| ConEnegation=true2021.10 | 5.4 | 5.9 | — | — | — | 8.6 | 7.8 | 4 | — | — | — | 3.6 | — | — | — | — | — | — | |
| BETAEnegation=true2021.10 | 5.1 | 5.4 | — | — | — | 7.9 | 7.4 | 3.6 | — | — | — | 3.4 | — | — | — | — | — | — | |
| MLPMIX2023.05 | 0.468 | — | 0.424 | 0.099 | 0.335 | 0.254 | 0.14 | 0.14 | 0.092 | 0.066 | — | 0.229 | 0.107 | 0.081 | 0.047 | 0.044 | 0.229 | 0.069 | |
| WFRE2023.05 | 0.351 | — | 0.441 | 0.134 | 0.111 | 0.501 | 0.172 | 0.274 | 0.139 | 0.109 | — | 0.043 | 0.069 | 0.112 | 0.085 | 0.05 | 0.248 | 0.072 | |
| GammaE2023.05 | 0.335 | — | 0.432 | 0.132 | 0.11 | 0.479 | 0.159 | 0.272 | 0.139 | 0.103 | — | 0.044 | 0.067 | 0.094 | 0.086 | 0.048 | 0.24 | 0.068 | |
| ConE2023.05 | 0.326 | — | 0.418 | 0.128 | 0.11 | 0.473 | 0.14 | 0.255 | 0.145 | 0.108 | — | 0.036 | 0.054 | 0.086 | 0.078 | 0.04 | 0.234 | 0.059 | |
| Q2BModel type=Box embeddings, Intersection operator=Attention mechanism2020.02 | 0.324 | 0.268 | 0.467 | 0.24 | 0.186 | 0.453 | 0.108 | 0.205 | 0.239 | 0.193 | — | — | — | — | — | — | — | — | |
| Q2P2023.05 | 0.323 | — | 0.391 | 0.114 | 0.101 | 0.477 | 0.143 | 0.24 | 0.087 | 0.091 | — | 0.038 | 0.044 | 0.097 | 0.075 | 0.046 | 0.219 | 0.06 | |
| PERM2021.10 | 0.306 | 0.303 | 0.445 | 0.268 | 0.201 | 0.409 | — | 0.353 | 0.253 | 0.269 | 0.22 | — | — | — | — | — | — | — | |
| CQD2021.10 | 0.299 | 0.292 | 0.439 | 0.27 | 0.206 | 0.381 | — | 0.415 | 0.235 | 0.271 | 0.112 | — | — | — | — | — | — | — | |
| GQE-DOUBLEModel type=Single vector embeddings, embedding dimensionality=doubled, parameters=equal to Q2B2020.02 | 0.298 | 0.23 | 0.405 | 0.213 | 0.153 | 0.411 | 0.085 | 0.182 | 0.167 | 0.16 | — | — | — | — | — | — | — | — | |
| GQEModel type=Single vector embeddings, Intersection operator=Deep sets2020.02 | 0.292 | 0.228 | 0.402 | 0.213 | 0.155 | 0.406 | 0.083 | 0.17 | 0.169 | 0.163 | — | — | — | — | — | — | — | — | |
| BetaE2023.05 | 0.288 | — | 0.39 | 0.109 | 0.1 | 0.425 | 0.126 | 0.224 | 0.124 | 0.097 | — | 0.034 | 0.051 | 0.079 | 0.074 | 0.036 | 0.209 | 0.054 | |
| Query2Box2020.02 | 0.275 | 0.235 | 0.4 | 0.225 | 0.173 | 0.378 | 0.105 | 0.18 | 0.198 | 0.178 | — | — | — | — | — | — | — | — | |
| QUERY2BOX (Q2B)2020.02 | 0.275 | 0.235 | 0.4 | 0.225 | 0.173 | 0.378 | 0.105 | 0.18 | 0.198 | 0.178 | — | — | — | — | — | — | — | — | |
| Q2B2021.10 | 0.275 | 0.235 | 0.4 | 0.225 | 0.173 | 0.378 | — | 0.18 | 0.198 | 0.105 | 0.178 | — | — | — | — | — | — | — | |
| Query2Box-DEEPSETSaggregator=DeepSets2020.02 | 0.264 | 0.23 | 0.395 | 0.224 | 0.172 | 0.372 | 0.101 | 0.168 | 0.194 | 0.176 | — | — | — | — | — | — | — | — | |
| GQE-DOUBLEmodel_size=double2020.02 | 0.258 | 0.205 | 0.346 | 0.191 | 0.144 | 0.361 | 0.087 | 0.164 | 0.144 | 0.149 | — | — | — | — | — | — | — | — | |
| GQE-DOUBLE2020.02 | 0.258 | 0.205 | 0.346 | 0.191 | 0.144 | 0.361 | 0.087 | 0.164 | 0.144 | 0.149 | — | — | — | — | — | — | — | — | |
| GQE2021.10 | 0.258 | 0.205 | 0.346 | 0.191 | 0.144 | 0.361 | — | 0.164 | 0.144 | 0.087 | 0.149 | — | — | — | — | — | — | — | |
| GQE2020.02 | 0.25 | 0.203 | 0.346 | 0.193 | 0.145 | 0.355 | 0.086 | 0.156 | 0.145 | 0.151 | — | — | — | — | — | — | — | — | |
| GQE2020.02 | 0.25 | 0.203 | 0.346 | 0.193 | 0.145 | 0.355 | 0.086 | 0.156 | 0.145 | 0.151 | — | — | — | — | — | — | — | — | |
| Query2Box-AVGaggregator=AVG2020.02 | 0.236 | 0.219 | 0.398 | 0.222 | 0.171 | 0.328 | 0.1 | 0.145 | 0.193 | 0.177 | — | — | — | — | — | — | — | — | |
| BQE2021.10 | 0.228 | 0.203 | 0.39 | 0.109 | 0.1 | 0.425 | — | 0.126 | 0.124 | 0.224 | 0.097 | — | — | — | — | — | — | — | |
| Query2Box-AVG-1P2020.02 | 0.217 | 0.196 | 0.41 | 0.18 | 0.122 | 0.274 | 0.085 | 0.127 | 0.209 | 0.145 | — | — | — | — | — | — | — | — | |
| Query2Box-SHAREDOFFSET2020.02 | 0.207 | 0.18 | 0.328 | 0.18 | 0.131 | 0.289 | 0.083 | 0.136 | 0.135 | 0.132 | — | — | — | — | — | — | — | — |