Machine Reading Comprehension on Daily Mail (test)
80.9AccuracyGA Reader
Evaluation Results
| Method | Links | |
|---|---|---|
| GA Readervariant=GA (update L(w))2016.06 | 80.9 | |
| GA Readervariant=GA (+feature, update L(w))2016.06 | 80 | |
| BiDAFensemble=false2016.11 | 79.6 | |
| BIDAF2016.06 | 79.6 | |
| GA Readervariant=GA (fix L(w))2016.06 | 79.6 | |
| GA Readervariant=GA (+feature, fix L(w))2016.06 | 79.3 | |
| Stanford ARensemble=true2016.11 | 79.2 | |
| Neural netRelabeling=true, Ensemble=true2016.06 | 79.2 | |
| Stanford AR (relabeling)ensemble=true2016.06 | 79.2 | |
| Neural netEnsemble=true2016.06 | 78.7 | |
| GAReaderensemble=true2016.11 | 78.1 | |
| AS ReaderAggregation=greedy ensemble2016.03 | 77.7 | |
| AS Readerensemble=true2016.11 | 77.7 | |
| AS Readerensemble=true2016.06 | 77.7 | |
| AS ReaderAggregation=avg ensemble2016.03 | 77.1 | |
| Stanford ARensemble=false2016.11 | 76.6 | |
| ReasoNetensemble=false2016.11 | 76.6 | |
| Neural netRelabeling=true2016.06 | 76.6 | |
| Stanford AR (relabeling)2016.06 | 76.6 | |
| ReasoNet2016.06 | 76.6 | |
| ReasoNetTmax=52016.09 | 76.6 | |
| Neural net2016.06 | 76 | |
| Chen et al. (2016)Model configuration=single model2016.03 | 75.8 | |
| Stanford AR2016.09 | 75.8 | |
| GAReaderensemble=false2016.11 | 75.7 | |
| GA Readervariant=GA--2016.06 | 75.7 | |
| GA Reader2016.09 | 75.7 | |
| AS ReaderModel configuration=single model2016.03 | 73.9 | |
| AS Readerensemble=false2016.11 | 73.9 | |
| AS Reader2016.06 | 73.9 | |
| AS Reader2016.09 | 73.9 | |
| AS ReaderAggregation=avg for top 20%2016.03 | 73.5 | |
| Attentive ReaderModel type=single model2016.03 | 69 | |
| Attentive Readerensemble=false2016.11 | 69 | |
| Attentive Reader2016.06 | 69 | |
| Attentive Reader2016.06 | 69 | |
| Attentive Reader2016.09 | 69 | |
| Entity-centric Classifier2016.06 | 68.3 | |
| Impatient ReaderModel type=single model2016.03 | 68 | |
| Impatient Reader2016.06 | 68 | |
| Impatient Reader2016.06 | 68 | |
| Deep LSTM Reader2016.06 | 62.2 | |
| Deep LSTM Reader2016.06 | 62.2 | |
| Deep LSTM Reader2016.09 | 62.2 | |
| Word distance model2016.06 | 55.5 | |
| Frame-semantic model2016.06 | 35.5 |