Response selection on Ubuntu IRC Len-15 (test)
89.7R@2MPC-BERT
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| MPC-BERT2021.06 | 89.7 | 63.64 | |
| MPC-BERT w/o. ISSablation=without Interlocutor-Speaker Signaling2021.06 | 89.58 | 63.51 | |
| MPC-BERT w/o. PCDablation=without Position Context Discovery2021.06 | 89.45 | 63.46 | |
| MPC-BERT w/o. SNDablation=without Same Network Detection2021.06 | 89.27 | 63.34 | |
| MPC-BERT w/o. MSURablation=without Masked Speaker/Utterance Reconstruction2021.06 | 89.25 | 63.2 | |
| MPC-BERT w/o. RURablation=without Reply-to Utterance Recognition2021.06 | 89.07 | 63.24 | |
| SA-BERT2021.06 | 88.34 | 60.42 | |
| BERT2021.06 | 87.19 | 58.92 | |
| SIRNN2021.06 | 80.91 | 40.83 | |
| DRNN2021.06 | 78.64 | 36.93 |