Question Answering on RoomKG (train)
37.24Episode-level QA AccuracyDQN temporal-RDF
Evaluation results
| Method | Links | |
|---|---|---|
| DQN temporal-RDFVariant=GCN + Local-STM, Long-term memory capacity=1282026.05 | 37.24 | |
| DQN temporal-RDFVariant=GCN + Local-Full, Long-term memory capacity=1282026.05 | 34.8 | |
| Symbolic temporal-RDFVariant=Novel-Only, Long-term memory capacity=1282026.05 | 32.12 | |
| Symbolic temporal-RDFVariant=Always-Transfer, Long-term memory capacity=1282026.05 | 28.6 | |
| Symbolic temporal-RDFVariant=Random-Transfer (p = 0.5), Long-term memory capacity=1282026.05 | 21.48 | |
| DQN temporal-RDFVariant=GCN + Global-Full, Long-term memory capacity=1282026.05 | 18.24 | |
| End-to-end DQNVariant=Transformer + Always-Transfer, Long-term memory capacity=1282026.05 | 16.8 | |
| DQN temporal-RDFVariant=StarE-GNN + Local-STM, Long-term memory capacity=1282026.05 | 13.68 | |
| DQN temporal-RDFVariant=R-GCN + Local-STM, Long-term memory capacity=1282026.05 | 12.92 | |
| End-to-end DQNVariant=LSTM + Always-Transfer, Long-term memory capacity=1282026.05 | 10.2 | |
| DQN temporal-RDFVariant=GCN + Global-STM, Long-term memory capacity=1282026.05 | 8.88 |