Machine Comprehension on CBT-CN (val)
85.7AccuracyAS Reader (+BookTest, ensemble)
Evaluation results
| Method | Links | |
|---|---|---|
| AS Reader (+BookTest, ensemble)trained_on_large_set=true, ensemble=true2016.06 | 85.7 | |
| AS Reader (+BookTest)trained_on_large_set=true2016.06 | 83.2 | |
| GA Readervariant=GA (+feature, fix L(w))2016.06 | 74.4 | |
| NSE2016.06 | 74.3 | |
| Iterative Alternating Neural Attentionensemble=true2016.06 | 74.1 | |
| Iterative Attentive Readerensemble=true2016.06 | 74.1 | |
| EpiReaderensemble=true2016.06 | 73.6 | |
| EpiReaderensemble=true2016.06 | 73.6 | |
| GA Readervariant=GA (+feature, update L(w))2016.06 | 73 | |
| AS ReaderModel variant=greedy ensemble2016.03 | 72.4 | |
| AoA Reader2016.06 | 72.2 | |
| Iterative Alternating Neural Attention2016.06 | 72.1 | |
| Iterative Attentive Reader2016.06 | 72.1 | |
| GA Readervariant=GA (fix L(w))2016.06 | 71.6 | |
| EpiReader2016.06 | 71.5 | |
| EpiReader2016.06 | 71.5 | |
| AS Readerensemble=true2016.06 | 71.1 | |
| AS ReaderModel variant=avg ensemble2016.03 | 71.1 | |
| AS Readerensemble=true2016.06 | 71.1 | |
| AS Readerensemble=true2016.06 | 71.1 | |
| EpiReader Extractor2016.06 | 69.9 | |
| Iterative Alternating Neural Attentionattention=fixed query attention2016.06 | 69.9 | |
| GA Readervariant=GA (update L(w))2016.06 | 69.8 | |
| GA Readervariant=GA--2016.06 | 69 | |
| AS Reader2016.06 | 68.8 | |
| AS ReaderModel variant=single model2016.03 | 68.8 | |
| AS Reader2016.06 | 68.8 | |
| AS Reader2016.06 | 68.8 | |
| AS ReaderModel variant=avg for top 20%2016.03 | 67.7 | |
| MemNNs2016.06 | 64.2 | |
| MemNNsModel variant=window memory + self-sup.2016.03 | 64.2 | |
| MemNNsconfig=window memory + self-sup.2016.06 | 64.2 | |
| MemNets2016.06 | 64.2 | |
| LSTMscontext + query=true2016.06 | 62.6 | |
| LSTMsInput configuration=context+query2016.03 | 62.6 | |
| LSTMsinput=context+query2016.06 | 62.6 | |
| LSTMS (context + query)2016.06 | 62.6 |