Dialog on bAbI dialog 1.0 (OOV)
0.023Avg Error RateQRN
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| QRNNumber of layers=2, Reset gate=true, Hidden state dimension=50, Match feature=true2016.06 | 0.023 | — | — | — | — | — | |
| GMemN2N+Match feature=true2016.06 | 0.103 | — | — | — | — | — | |
| QRNNumber of layers=2, Reset gate=true, Hidden state dimension=50, Match feature=false2016.06 | 0.111 | — | — | — | — | — | |
| QRNNumber of layers=2, Reset gate=true, Hidden state dimension=100, Match feature=false2016.06 | 0.111 | — | — | — | — | — | |
| N2N+Match feature=true2016.06 | 0.112 | — | — | — | — | — | |
| GMemN2NMatch feature=false2016.06 | 0.279 | — | — | — | — | — | |
| N2NMatch feature=false2016.06 | 0.303 | — | — | — | — | — | |
| QRN+layers=2, reset gate=true, hidden state dimension=50, match=true2016.06 | 2.3 | — | — | — | — | — | |
| RMNMatch Feature=With Match2018.01 | 9.4 | 0 | 0 | 25.1 | 0 | 21.7 | |
| GMemN2N+match=true2016.06 | 10.3 | — | — | — | — | — | |
| GMemN2NMatch Feature=With Match2018.01 | 10.3 | 0 | 5.8 | 24.9 | 0 | 20.6 | |
| QRNlayers=2, reset gate=true, hidden state dimension=50, match=false2016.06 | 11.1 | — | — | — | — | — | |
| QRNlayers=2, reset gate=true, hidden state dimension=100, match=false2016.06 | 11.1 | — | — | — | — | — | |
| N2N+match=true2016.06 | 11.2 | — | — | — | — | — | |
| MemN2NMatch Feature=With Match2018.01 | 11.2 | 3.5 | 5.5 | 24.8 | 0 | 22.3 | |
| RN^4Match Feature=With Match2018.01 | 12 | 1.5 | 0 | 29.8 | 0 | 28.4 | |
| RMNMatch Feature=Plain2018.01 | 19.5 | 16.8 | 21.1 | 24.9 | 0 | 34.5 | |
| RN^4Match Feature=Plain2018.01 | 21.3 | 17.8 | 23.2 | 27.2 | 0 | 38.3 | |
| GMemN2Nmatch=false2016.06 | 27.9 | — | — | — | — | — | |
| GMemN2NMatch Feature=Plain2018.01 | 27.9 | 17.6 | 21.1 | 24.7 | 43 | 33.3 | |
| N2Nmatch=false2016.06 | 30.3 | — | — | — | — | — | |
| MemN2NMatch Feature=Plain2018.01 | 30.3 | 27.7 | 21.1 | 25.6 | 42.4 | 34.5 |