Machine Reading Comprehension on Daily Mail (val)
81.5AccuracyGA Reader
Evaluation Results
| Method | Links | |
|---|---|---|
| GA Readervariant=GA (update L(w))2016.06 | 81.5 | |
| GA Readervariant=GA (+feature, update L(w))2016.06 | 80.7 | |
| GA Readervariant=GA (fix L(w))2016.06 | 80.4 | |
| BiDAFensemble=false2016.11 | 80.3 | |
| BIDAF2016.06 | 80.3 | |
| Stanford ARensemble=true2016.11 | 80.2 | |
| Stanford AR (relabeling)ensemble=true2016.06 | 80.2 | |
| GA Readervariant=GA (+feature, fix L(w))2016.06 | 80 | |
| GAReaderensemble=true2016.11 | 79.1 | |
| AS ReaderAggregation=greedy ensemble2016.03 | 78.7 | |
| AS Readerensemble=true2016.11 | 78.7 | |
| AS Readerensemble=true2016.06 | 78.7 | |
| AS ReaderAggregation=avg ensemble2016.03 | 78.1 | |
| Stanford ARensemble=false2016.11 | 77.6 | |
| ReasoNetensemble=false2016.11 | 77.6 | |
| Stanford AR (relabeling)2016.06 | 77.6 | |
| ReasoNet2016.06 | 77.6 | |
| ReasoNetTmax=52016.09 | 77.6 | |
| Chen et al. (2016)Model configuration=single model2016.03 | 76.9 | |
| Stanford AR2016.09 | 76.9 | |
| GAReaderensemble=false2016.11 | 76.7 | |
| GA Readervariant=GA--2016.06 | 76.7 | |
| GA Reader2016.09 | 76.7 | |
| AS ReaderModel configuration=single model2016.03 | 75 | |
| AS Readerensemble=false2016.11 | 75 | |
| AS Reader2016.06 | 75 | |
| AS Reader2016.09 | 75 | |
| AS ReaderAggregation=avg for top 20%2016.03 | 74.5 | |
| Attentive ReaderModel type=single model2016.03 | 70.5 | |
| Attentive Readerensemble=false2016.11 | 70.5 | |
| Attentive Reader2016.06 | 70.5 | |
| Attentive Reader2016.09 | 70.5 | |
| Impatient ReaderModel type=single model2016.03 | 69 | |
| Impatient Reader2016.06 | 69 | |
| Deep LSTM Reader2016.06 | 63.3 | |
| Deep LSTM Reader2016.09 | 63.3 |