Response Selection on ConvAI2 (dev)
90.3R@1/20Cross-encoder
Evaluation results
| Method | Links | |
|---|---|---|
| Cross-encoderInitialization=This paper, Pre-training corpus=Reddit2019.04 | 90.3 | |
| Poly-encoderm=360, Mechanism=First-m, Initialization=This paper, Pre-training corpus=Reddit2019.04 | 90 | |
| Poly-encoderm=64, Mechanism=First-m, Initialization=This paper, Pre-training corpus=Reddit2019.04 | 89.5 | |
| Poly-encoderm=360, Mechanism=Learnt-m, Initialization=This paper, Pre-training corpus=Reddit2019.04 | 89.2 | |
| Poly-encoderm=16, Mechanism=First-m, Initialization=This paper, Pre-training corpus=Reddit2019.04 | 89 | |
| Poly-encoderm=64, Mechanism=Learnt-m, Initialization=This paper, Pre-training corpus=Reddit2019.04 | 89 | |
| Poly-encoderm=16, Mechanism=Learnt-m, Initialization=This paper, Pre-training corpus=Reddit2019.04 | 88.6 | |
| Cross-encoderInitialization=This paper, Pre-training corpus=Toronto Books + Wikipedia2019.04 | 87.3 | |
| Cross-encoderInitialization=Devlin et al., 2019, Pre-training corpus=Toronto Books + Wikipedia2019.04 | 87.1 | |
| Poly-encoderm=360, Mechanism=First-m, Initialization=This paper, Pre-training corpus=Toronto Books + Wikipedia2019.04 | 86.6 | |
| Bi-encoderInitialization=This paper, Pre-training corpus=Reddit2019.04 | 86.5 | |
| Poly-encoderm=360, Mechanism=First-m, Initialization=Devlin et al., 2019, Pre-training corpus=Toronto Books + Wikipedia2019.04 | 86.3 | |
| Poly-encoderm=64, Mechanism=First-m, Initialization=This paper, Pre-training corpus=Toronto Books + Wikipedia2019.04 | 86.1 | |
| Poly-encoderm=360, Mechanism=Learnt-m, Initialization=This paper, Pre-training corpus=Toronto Books + Wikipedia2019.04 | 86.1 | |
| Poly-encoderm=64, Mechanism=First-m, Initialization=Devlin et al., 2019, Pre-training corpus=Toronto Books + Wikipedia2019.04 | 86 | |
| Poly-encoderm=64, Mechanism=Learnt-m, Initialization=This paper, Pre-training corpus=Toronto Books + Wikipedia2019.04 | 85.6 | |
| Poly-encoderm=16, Mechanism=Learnt-m, Initialization=This paper, Pre-training corpus=Toronto Books + Wikipedia2019.04 | 85.4 | |
| Poly-encoderm=360, Mechanism=Learnt-m, Initialization=Devlin et al., 2019, Pre-training corpus=Toronto Books + Wikipedia2019.04 | 85.3 | |
| Poly-encoderm=16, Mechanism=First-m, Initialization=Devlin et al., 2019, Pre-training corpus=Toronto Books + Wikipedia2019.04 | 85.2 | |
| Poly-encoderm=64, Mechanism=Learnt-m, Initialization=Devlin et al., 2019, Pre-training corpus=Toronto Books + Wikipedia2019.04 | 84.9 | |
| Bi-encoderInitialization=This paper, Pre-training corpus=Toronto Books + Wikipedia2019.04 | 84.6 | |
| Poly-encoderm=16, Mechanism=Learnt-m, Initialization=Devlin et al., 2019, Pre-training corpus=Toronto Books + Wikipedia2019.04 | 84.4 | |
| Poly-encoderm=16, Mechanism=First-m, Initialization=This paper, Pre-training corpus=Toronto Books + Wikipedia2019.04 | 84.1 | |
| Bi-encoderInitialization=Devlin et al., 2019, Pre-training corpus=Toronto Books + Wikipedia2019.04 | 83.3 | |
| Hugging Face2019.04 | 82.1 |