Addressee and Response Selection on Ubuntu Multiparty Conversation Corpus v1 (test)
67.3ADR-RESSI-RNN
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| SI-RNNT=15, RES-CAND=22017.09 | 67.3 | 80.47 | 0.8091 | |
| SI-RNNT=10, RES-CAND=22017.09 | 65.63 | 78.76 | 0.8034 | |
| SI-RNN w/o joint selectionT=15, RES-CAND=22017.09 | 63.4 | 77.56 | 0.8038 | |
| SI-RNNT=5, RES-CAND=22017.09 | 60.69 | 74.08 | 0.7814 | |
| SI-RNN w/ shared IGRUsT=15, RES-CAND=22017.09 | 59.47 | 74.2 | 0.7808 | |
| Dynamic-RNNT=15, RES-CAND=22017.09 | 54.88 | 68.54 | 0.7864 | |
| Dynamic-RNNT=10, RES-CAND=22017.09 | 53.85 | 66.94 | 0.7816 | |
| Static-Hier-RNNT=15, RES-CAND=22017.09 | 53.04 | 65.84 | 0.7908 | |
| Static-Hier-RNNT=10, RES-CAND=22017.09 | 51.76 | 64.61 | 0.7828 | |
| Dynamic-RNNT=5, RES-CAND=22017.09 | 49.8 | 63.19 | 0.7607 | |
| Static-Hier-RNNT=5, RES-CAND=22017.09 | 49.38 | 62.2 | 0.767 | |
| Static-RNNT=15, RES-CAND=22017.09 | 49.27 | 61.95 | 0.7814 | |
| Static-RNNT=10, RES-CAND=22017.09 | 48.67 | 60.97 | 0.7775 | |
| Static-RNNT=5, RES-CAND=22017.09 | 46.99 | 60.39 | 0.7507 | |
| Direct-Recent+TF-IDFT=15, RES-CAND=22017.09 | 45.76 | 67.72 | 0.6789 | |
| Recent+TF-IDFT=15, RES-CAND=22017.09 | 37.13 | 55.62 | 0.6789 | |
| SI-RNNT=15, RES-CAND=102017.09 | 35.76 | 78.53 | 0.4083 | |
| SI-RNNT=10, RES-CAND=102017.09 | 34.09 | 77.13 | 0.392 | |
| SI-RNN w/o joint selectionT=15, RES-CAND=102017.09 | 32.53 | 77.61 | 0.3973 | |
| SI-RNNT=5, RES-CAND=102017.09 | 30.71 | 72.59 | 0.3645 | |
| SI-RNN w/ shared IGRUsT=15, RES-CAND=102017.09 | 28.45 | 73.35 | 0.36 | |
| Dynamic-RNNT=15, RES-CAND=102017.09 | 27.19 | 68.41 | 0.3693 | |
| Static-Hier-RNNT=15, RES-CAND=102017.09 | 26.62 | 65.89 | 0.3785 | |
| Dynamic-RNNT=10, RES-CAND=102017.09 | 25.95 | 66.7 | 0.3614 | |
| Static-Hier-RNNT=10, RES-CAND=102017.09 | 25.83 | 64.86 | 0.3694 | |
| Static-Hier-RNNT=5, RES-CAND=102017.09 | 23.75 | 62.24 | 0.3451 | |
| Dynamic-RNNT=5, RES-CAND=102017.09 | 23.72 | 63.28 | 0.3362 | |
| Static-RNNT=15, RES-CAND=102017.09 | 23.49 | 60.98 | 0.3658 | |
| Static-RNNT=10, RES-CAND=102017.09 | 23.31 | 60.66 | 0.3591 | |
| Static-RNNT=5, RES-CAND=102017.09 | 21.98 | 60.26 | 0.3327 | |
| Direct-Recent+TF-IDFT=15, RES-CAND=102017.09 | 19.5 | 67.72 | 0.294 | |
| Recent+TF-IDFT=15, RES-CAND=102017.09 | 15.44 | 55.62 | 0.2919 | |
| ChanceRES-CAND=22017.09 | 0.62 | 1.24 | 0.5 | |
| ChanceRES-CAND=102017.09 | 0.12 | 1.24 | 0.1 |