Logical Query Answering (EPFO) on FB15k-237 (test)
0.0722-Path ErrorGQE
Evaluation results
| Method | Links | |||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| GQE2022.05 | 0.072 | 0.35 | 0.053 | 0.233 | 0.346 | 0.165 | 0.107 | — | — | — | — | 0.163 | — | — | — | — | — | — | — | — | — | — | — | — | 0.082 | 0.057 | — | — | — | — | — | — | — | |
| Q2B2022.05 | 0.094 | 0.406 | 0.068 | 0.295 | 0.423 | 0.212 | 0.126 | — | — | — | — | 0.201 | — | — | — | — | — | — | — | — | — | — | — | — | 0.113 | 0.076 | — | — | — | — | — | — | — | |
| CQD-COinference=continuous optimization2022.05 | 0.095 | 0.467 | 0.063 | 0.312 | 0.406 | 0.236 | 0.16 | — | — | — | — | 0.218 | — | — | — | — | — | — | — | — | — | — | — | — | 0.145 | 0.082 | — | — | — | — | — | — | — | |
| BetaE2022.05 | 0.109 | 0.39 | 0.1 | 0.288 | 0.425 | 0.224 | 0.126 | — | — | — | — | 0.209 | — | — | — | — | — | — | — | — | — | — | — | — | 0.124 | 0.097 | 5.5 | 5.1 | 7.9 | 7.4 | 3.5 | 3.4 | — | |
| CQD-Beaminference=beam search2022.05 | 0.116 | 0.467 | 0.08 | 0.312 | 0.406 | 0.212 | 0.187 | — | — | — | — | 0.223 | — | — | — | — | — | — | — | — | — | — | — | — | 0.146 | 0.084 | — | — | — | — | — | — | — | |
| ConE2022.05 | 0.128 | 0.418 | 0.11 | 0.326 | 0.473 | 0.255 | 0.14 | — | — | — | — | 0.234 | — | — | — | — | — | — | — | — | — | — | — | — | 0.145 | 0.108 | 5.9 | 5.4 | 8.6 | 7.8 | 4 | 3.6 | — | |
| FuzzQE2022.05 | 0.129 | 0.428 | 0.103 | 0.333 | 0.469 | 0.269 | 0.178 | — | — | — | — | 0.24 | — | — | — | — | — | — | — | — | — | — | — | — | 0.146 | 0.103 | 7.8 | 8.5 | 11.6 | 7.8 | 5.2 | 5.8 | — | |
| GNN-QE2022.05 | 0.147 | 0.428 | 0.118 | 0.383 | 0.541 | 0.311 | 0.189 | — | — | — | — | 0.268 | — | — | — | — | — | — | — | — | — | — | — | — | 0.162 | 0.134 | 10.2 | 10 | 16.8 | 9.3 | 7.2 | 7.8 | — | |
| GQEMethod Type=Graph Query Embedding2020.11 | 0.213 | 0.405 | 0.153 | 0.298 | 0.411 | 0.182 | 0.085 | — | — | — | — | 0.23 | — | — | — | — | — | — | — | — | — | — | — | — | 0.167 | 0.16 | — | — | — | — | — | — | — | |
| CQD-COInference Mode=Continuous Optimization2020.11 | 0.213 | 0.512 | 0.131 | 0.352 | 0.457 | 0.222 | 0.146 | — | — | — | — | 0.272 | — | — | — | — | — | — | — | — | — | — | — | — | 0.281 | 0.132 | — | — | — | — | — | — | — | |
| Query2BoxMethod Type=Box Embedding2020.11 | 0.24 | 0.467 | 0.186 | 0.324 | 0.453 | 0.205 | 0.108 | — | — | — | — | 0.268 | — | — | — | — | — | — | — | — | — | — | — | — | 0.239 | 0.193 | — | — | — | — | — | — | — | |
| CQD-BeamInference Mode=Beam Search2020.11 | 0.288 | 0.512 | 0.221 | 0.352 | 0.457 | 0.249 | 0.129 | — | — | — | — | 0.29 | — | — | — | — | — | — | — | — | — | — | — | — | 0.284 | 0.121 | — | — | — | — | — | — | — | |
| GQE2020.10 | 2.8 | 22.4 | 2.1 | 11.7 | 20.9 | 8.4 | 5.7 | 3.3 | — | 2.1 | — | 8.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GQE2022.05 | 2.8 | 22.4 | 2.1 | 11.7 | 20.9 | 8.4 | 5.7 | — | — | — | — | 8.8 | — | — | — | — | — | — | — | — | — | — | — | — | 3.3 | 2.1 | — | — | — | — | — | — | — | |
| Q2B2020.10 | 4.1 | 28.3 | 3 | 17.5 | 29.5 | 12.3 | 7.1 | 5.2 | — | 3.3 | — | 12.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Q2B2022.05 | 4.1 | 28.3 | 3 | 17.5 | 29.5 | 12.3 | 7.1 | — | — | — | — | 12.3 | — | — | — | — | — | — | — | — | — | — | — | — | 5.2 | 3.3 | — | — | — | — | — | — | — | |
| CQDInference Mode=Continuous Optimization (CO)2022.05 | 4.7 | 36.6 | 3 | 20.7 | 29.6 | 15.5 | 9.9 | — | — | — | — | 14.7 | — | — | — | — | — | — | — | — | — | — | — | — | 8.6 | 4 | — | — | — | — | — | — | — | |
| BETAE2020.10 | 5.5 | 28.9 | 4.9 | 18.3 | 31.7 | 14 | 6.7 | 6.3 | 6.1 | 4.6 | 4.8 | 13.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BetaE2022.05 | 5.5 | 28.9 | 4.9 | 18.3 | 31.7 | 14 | 6.7 | — | — | — | — | 13.4 | — | — | — | — | — | — | — | — | — | — | — | — | 6.3 | 4.6 | 2.8 | 1.5 | 7.7 | 3 | 0.9 | 0.9 | — | |
| CQDInference Mode=Beam Search2022.05 | 6.3 | 36.6 | 4.3 | 20.7 | 29.6 | 13.5 | 12.1 | — | — | — | — | 15.1 | — | — | — | — | — | — | — | — | — | — | — | — | 8.7 | 4.3 | — | — | — | — | — | — | — | |
| ConE2022.05 | 6.9 | 31.9 | 5.3 | 21.9 | 36.6 | 17 | 7.8 | — | — | — | — | 15.6 | — | — | — | — | — | — | — | — | — | — | — | — | 8 | 5.3 | 2.2 | 1.8 | 3.7 | 3.4 | 1.3 | 1 | — | |
| GQE2022.12 | 7.2 | — | 5.3 | 23.3 | 34.6 | 16.5 | 10.7 | — | — | — | — | — | 0.163 | — | — | — | — | — | — | — | — | — | — | — | 8.2 | 5.7 | — | — | — | — | — | — | 10.3 | |
| GNN-QE2022.05 | 8.2 | 32.8 | 6.5 | 27.7 | — | 22.4 | 12.3 | — | — | — | — | 19.1 | — | — | — | — | — | — | — | — | — | — | — | — | 9.8 | 7.6 | 4.3 | 4.1 | 8.1 | 4.1 | 2.5 | 2.7 | — | |
| Query2Box2022.12 | 9.4 | — | 6.8 | 29.5 | 42.3 | 21.2 | 12.6 | — | — | — | — | — | 0.201 | — | — | — | — | — | — | — | — | — | — | — | 11.3 | 7.6 | — | — | — | — | — | — | 15.7 | |
| CQD-COReasoning Mode=Continuous Optimization2022.12 | 9.5 | — | 6.3 | 31.2 | 40.6 | 23.6 | 16 | — | — | — | — | — | 0.218 | — | — | — | — | — | — | — | — | — | — | — | 14.5 | 8.2 | — | — | — | — | — | — | 15.6 | |
| BetaE2022.12 | 10.9 | — | 10 | 28.8 | 42.5 | 22.4 | 12.6 | — | — | — | — | — | 0.209 | — | — | — | — | — | — | — | — | — | — | — | 12.4 | 9.7 | 5.5 | 5.1 | 7.9 | 7.4 | 3.5 | 3.4 | 14.3 | |
| CQD-BeamReasoning Mode=Beam Search2022.12 | 11.6 | — | 8 | 31.2 | 40.6 | 21.2 | 18.7 | — | — | — | — | — | 0.223 | — | — | — | — | — | — | — | — | — | — | — | 14.6 | 8.4 | — | — | — | — | — | — | 15.7 | |
| ConE2022.12 | 12.8 | — | 11 | 32.6 | 47.3 | 25.5 | 14 | — | — | — | — | — | 0.234 | — | — | — | — | — | — | — | — | — | — | — | 14.5 | 10.8 | 5.9 | 5.4 | 8.6 | 7.8 | 4 | 3.6 | 16.2 | |
| FuzzQE2022.12 | 12.9 | — | 10.3 | 33.3 | 46.9 | 26.9 | 17.8 | — | — | — | — | — | 0.24 | — | — | — | — | — | — | — | — | — | — | — | 14.6 | 10.3 | 7.8 | 8.5 | 11.6 | 7.8 | 5.2 | 5.8 | 17.4 | |
| GNN-QE2022.12 | 14.7 | — | 11.8 | 38.3 | 54.1 | 31.1 | 18.9 | — | — | — | — | — | 0.268 | — | — | — | — | — | — | — | — | — | — | — | 16.2 | 13.4 | 10.2 | 10 | 16.8 | 9.3 | 7.2 | 7.8 | 19.9 | |
| QTO2022.12 | 21.4 | — | 21.2 | 43.1 | 56.8 | 38.1 | 28 | — | — | — | — | — | 0.335 | — | — | — | — | — | — | — | — | — | — | — | 22.7 | 21.4 | 15.5 | 16.8 | 26.7 | 15.1 | 13.6 | 5.4 | 27.6 | |
| BETAE2020.10 | — | — | — | — | — | — | — | — | — | — | — | — | 39 | 10.9 | 10 | 28.8 | 42.5 | 22.4 | 12.6 | 12.4 | 11.1 | 9.7 | 9.9 | 20.9 | — | — | — | — | — | — | — | — | — | |
| GQE2020.10 | — | — | — | — | — | — | — | — | — | — | — | — | 35 | 7.2 | 5.3 | 23.3 | 34.6 | 16.5 | 10.7 | 8.2 | — | 5.7 | — | 16.3 | — | — | — | — | — | — | — | — | — | |
| Q2B2020.10 | — | — | — | — | — | — | — | — | — | — | — | — | 40.6 | 9.4 | 6.8 | 29.5 | 42.3 | 21.2 | 12.6 | 11.3 | — | 7.6 | — | 20.1 | — | — | — | — | — | — | — | — | — |