Machine Comprehension on CBT-NE (val)
82.3AccuracyAS Reader (+BookTest, ensemble)
Evaluation Results
| Method | Links | |
|---|---|---|
| AS Reader (+BookTest, ensemble)trained_on_large_set=true, ensemble=true2016.06 | 82.3 | |
| AS Reader (+BookTest)trained_on_large_set=true2016.06 | 80.5 | |
| GA Readervariant=GA (+feature, fix L(w))2016.06 | 78.5 | |
| NSE2016.06 | 78.2 | |
| AoA Reader2016.06 | 77.8 | |
| GA Readervariant=GA (fix L(w))2016.06 | 77.2 | |
| GA Readervariant=GA (+feature, update L(w))2016.06 | 77.2 | |
| Iterative Alternating Neural Attentionensemble=true2016.06 | 76.9 | |
| Iterative Attentive Readerensemble=true2016.06 | 76.9 | |
| GA Readervariant=GA (update L(w))2016.06 | 76.7 | |
| EpiReaderensemble=true2016.06 | 76.6 | |
| EpiReaderensemble=true2016.06 | 76.6 | |
| AS ReaderModel variant=greedy ensemble2016.03 | 76.2 | |
| AS Readerensemble=true2016.06 | 76.2 | |
| EpiReader2016.06 | 75.3 | |
| EpiReader2016.06 | 75.3 | |
| Iterative Alternating Neural Attention2016.06 | 75.2 | |
| Iterative Attentive Reader2016.06 | 75.2 | |
| GA Readervariant=GA--2016.06 | 74.9 | |
| AS Readerensemble=true2016.06 | 74.5 | |
| AS ReaderModel variant=avg ensemble2016.03 | 74.5 | |
| AS Readerensemble=true2016.06 | 74.5 | |
| AS Reader2016.06 | 73.8 | |
| AS ReaderModel variant=single model2016.03 | 73.8 | |
| AS Reader2016.06 | 73.8 | |
| AS Reader2016.06 | 73.8 | |
| AS ReaderModel variant=avg for top 20%2016.03 | 73.3 | |
| Iterative Alternating Neural Attentionattention=fixed query attention2016.06 | 73.3 | |
| EpiReader Extractor2016.06 | 73.2 | |
| MemNNs2016.06 | 70.4 | |
| MemNNsModel variant=window memory + self-sup.2016.03 | 70.4 | |
| MemNNsconfig=window memory + self-sup.2016.06 | 70.4 | |
| MemNets2016.06 | 70.4 | |
| LSTMscontext + query=true2016.06 | 51.2 | |
| LSTMsInput configuration=context+query2016.03 | 51.2 | |
| LSTMsinput=context+query2016.06 | 51.2 | |
| LSTMS (context + query)2016.06 | 51.2 |