Question Answering on YahooCQA (test)
75.7P@1sMIM
Evaluation results
| Method | Links | ||
|---|---|---|---|
| sMIMLatent dimension=1024, Pre-training=Everything dataset, Posterior evaluation=mean2020.02 | 75.7 | 86.3 | |
| HyperQA# Params=90.0K, Time=20s2017.07 | 68.3 | 80.1 | |
| HyperQA2020.02 | 68.3 | 80.1 | |
| sMIMLatent dimension=512, Posterior evaluation=mean2020.02 | 68.3 | 81.8 | |
| sMIMLatent dimension=1024, Posterior evaluation=mean2020.02 | 65.1 | 80 | |
| sAELatent dimension=5122020.02 | 57.9 | 81.4 | |
| sAELatent dimension=1024, Pre-training=Everything dataset2020.02 | 57.4 | 81.2 | |
| AP-BiLSTMauthors=Santos et al., # Params=1.80M, Time=640s2017.07 | 56.8 | 73.1 | |
| AP-BiLSTM2020.02 | 56.8 | 73.1 | |
| QA-CNNauthors=Santos et al., # Params=90.9K, Time=60s2017.07 | 56.4 | 72.7 | |
| AP-CNNauthors=Santos et al., # Params=540K, Time=110s2017.07 | 56 | 72.6 | |
| AP-CNN2020.02 | 56 | 72.6 | |
| sMIMLatent dimension=32, Posterior evaluation=mean2020.02 | 55.8 | 73.7 | |
| HD-LSTMauthors=Tay et al.2017.07 | 55.7 | 73.5 | |
| sVAELatent dimension=1024, Posterior evaluation=mean2020.02 | 54.8 | 79 | |
| NTN-LSTMauthors=Tay et al.2017.07 | 54.5 | 73.1 | |
| sVAELatent dimension=32, Posterior evaluation=mean2020.02 | 53.1 | 77.6 | |
| sAELatent dimension=10242020.02 | 51.9 | 76.7 | |
| QA-BILSTMauthors=Santos et al., # Params=1.40M, Time=440s2017.07 | 50.8 | 68.3 | |
| sVAELatent dimension=512, Posterior evaluation=mean2020.02 | 49.4 | 74.7 | |
| CNTNauthors=Qiu et al.2017.07 | 46.5 | 63.2 | |
| LSTM2017.07 | 46.5 | 66.9 | |
| CNN2017.07 | 41.3 | 63.2 | |
| sAELatent dimension=322020.02 | 38.6 | 65.6 | |
| sVAELatent dimension=1024, Pre-training=Everything dataset, Posterior evaluation=mean2020.02 | 33.9 | 61.6 | |
| BM-252017.07 | 22.5 | 49.3 | |
| Random Guess2017.07 | 20 | 45.7 |