Question Answering on WikiMovies (test)
93.9Hits@1Key-Value Memory Network
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Key-Value Memory NetworkKnowledge Source=KB2016.06 | 93.9 | — | — | |
| (Bordes et al., 2014) QA systemKnowledge Source=KB2016.06 | 93.5 | — | — | |
| Memory NetworkKnowledge Source=KB2016.06 | 78.5 | — | — | |
| Key-Value Memory NetworkKnowledge Source=Doc2016.06 | 76.2 | — | — | |
| Memory NetworkKnowledge Source=Doc2016.06 | 69.9 | — | — | |
| Key-Value Memory NetworkKnowledge Source=IE2016.06 | 68.3 | — | — | |
| Memory NetworkKnowledge Source=IE2016.06 | 63.4 | — | — | |
| (Bordes et al., 2014) QA systemKnowledge Source=IE2016.06 | 56.5 | — | — | |
| Supervised EmbeddingsKnowledge Source=KB2016.06 | 54.4 | — | — | |
| Supervised EmbeddingsKnowledge Source=IE2016.06 | 54.4 | — | — | |
| Supervised EmbeddingsKnowledge Source=Doc2016.06 | 54.4 | — | — | |
| DrQATraining Scheme=SQuAD + Multitask (DS)2017.03 | 36.5 | — | — | |
| DrQATraining Scheme=SQuAD + Fine-tune (DS)2017.03 | 34.3 | — | — | |
| DrQATraining Scheme=SQuAD-only2017.03 | 24.5 | — | — | |
| DrQA2017.08 | — | 34.3 | — | |
| DrQA-MTLAdditional Resources=multiple training datasets2017.08 | — | 36.5 | — | |
| Reinforced Ranker-Reader2017.08 | — | 39.9 | 38.8 | |
| Simple Ranker-Reader2017.08 | — | 39.3 | 38.1 | |
| Single Reader2017.08 | — | 38.8 | 37.7 |