Machine Comprehension on CNN (val)
0.779AccuracyGA Reader
Evaluation Results
| Method | Links | |
|---|---|---|
| GA Readervariant=GA (update L(w))2016.06 | 0.779 | |
| GA Readervariant=GA (fix L(w))2016.06 | 0.779 | |
| GA Readervariant=GA (+feature, update L(w))2016.06 | 0.773 | |
| Stanford ARensemble=true2016.11 | 0.772 | |
| Stanford AR (relabeling)ensemble=true2016.06 | 0.772 | |
| GA Readervariant=GA (+feature, fix L(w))2016.06 | 0.767 | |
| GAReaderensemble=true2016.11 | 0.764 | |
| BiDAFensemble=false2016.11 | 0.763 | |
| BIDAF2016.06 | 0.763 | |
| Iterative Alternating Neural AttentionEnsemble=true2016.06 | 0.752 | |
| Iterative Attentive Readerensemble=true2016.06 | 0.752 | |
| Iterative Attentionensemble=true2016.11 | 0.745 | |
| AS ReaderAggregation=greedy ensemble2016.03 | 0.745 | |
| AS Readerensemble=true2016.11 | 0.739 | |
| AS ReaderAggregation=avg ensemble2016.03 | 0.739 | |
| AS ReaderEnsemble=true2016.06 | 0.739 | |
| AS Readerensemble=true2016.06 | 0.739 | |
| Stanford ARensemble=false2016.11 | 0.738 | |
| Stanford AR (relabeling)2016.06 | 0.738 | |
| EpiReader2016.06 | 0.734 | |
| EpiReaderensemble=false2016.11 | 0.734 | |
| EpiReader2016.06 | 0.734 | |
| EpiReader2016.09 | 0.734 | |
| AoA Readerensemble=false2016.11 | 0.731 | |
| AoA Reader2016.06 | 0.731 | |
| AoA Reader2016.09 | 0.731 | |
| GAReaderensemble=false2016.11 | 0.73 | |
| GA Readervariant=GA--2016.06 | 0.73 | |
| GA Reader2016.09 | 0.73 | |
| ReasoNetensemble=false2016.11 | 0.729 | |
| ReasoNet2016.06 | 0.729 | |
| ReasoNetTmax=52016.09 | 0.729 | |
| Iterative Attentionensemble=false2016.11 | 0.726 | |
| Iterative Alternating Neural AttentionEnsemble=false2016.06 | 0.726 | |
| Iterative Attentive Reader2016.06 | 0.726 | |
| Iterative Attention Reader2016.09 | 0.726 | |
| Stanford AR2016.06 | 0.724 | |
| Chen et al. (2016)Model configuration=single model2016.03 | 0.724 | |
| Stanford AREmbeddings=GloVe2016.06 | 0.724 | |
| Stanford AR2016.09 | 0.722 | |
| EpiReader Extractor2016.06 | 0.718 | |
| DER Networkensemble=false2016.11 | 0.713 | |
| Dynamic Entity Repres.Strategy=+ w2v2016.03 | 0.713 | |
| DER Network2016.06 | 0.713 | |
| DER Network2016.09 | 0.713 | |
| Dynamic Entity Repres.Strategy=max-pool2016.03 | 0.712 | |
| Dynamic Entity Repres.Strategy=max-pool + byway2016.03 | 0.708 | |
| AS Reader2016.06 | 0.686 | |
| AS Readerensemble=false2016.11 | 0.686 | |
| AS ReaderModel configuration=single model2016.03 | 0.686 | |
| AS Reader2016.06 | 0.686 | |
| AS Reader2016.06 | 0.686 | |
| AS Reader2016.09 | 0.686 | |
| AS ReaderAggregation=avg for top 20%2016.03 | 0.684 | |
| MemNNensemble=true2016.11 | 0.662 | |
| MemNNsModel configuration=ensemble2016.03 | 0.662 | |
| MemNNsEnsemble=true2016.06 | 0.662 | |
| MemNetsensemble=true2016.06 | 0.662 | |
| MemNNs2016.06 | 0.634 | |
| MemNNensemble=false2016.11 | 0.634 | |
| MemNNsModel configuration=single model2016.03 | 0.634 | |
| MemNNs (window memory + self sup.)2016.06 | 0.634 | |
| MemNets2016.06 | 0.634 | |
| MemNets2016.09 | 0.634 | |
| Impatient Reader2016.06 | 0.618 | |
| Impatient ReaderModel type=single model2016.03 | 0.618 | |
| Impatient Reader2016.06 | 0.618 | |
| Impatient Reader2016.06 | 0.618 | |
| Attentive Reader2016.06 | 0.616 | |
| Attentive Readerensemble=false2016.11 | 0.616 | |
| Attentive ReaderModel type=single model2016.03 | 0.616 | |
| Attentive Reader2016.06 | 0.616 | |
| Attentive Reader2016.06 | 0.616 | |
| Attentive Reader2016.09 | 0.616 | |
| Deep LSTM Reader2016.06 | 0.55 | |
| Deep LSTM Reader2016.06 | 0.55 | |
| Deep LSTM Reader2016.06 | 0.55 | |
| Deep LSTM Reader2016.09 | 0.55 | |
| MemNNs (window memory)2016.06 | 0.508 | |
| Word distance model2016.06 | 0.505 |