Response Selection on Reddit SC (test)
181.8Perplexity@Top-1Gold
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Gold2021.09 | 181.8 | — | 0.82 | — | |
| CFC-QSMatching Type=Contextual matching2021.09 | 184.3 | 193.1 | 0.883 | 83.4 | |
| CFC-DQSMatching Type=Contextual matching2021.09 | 184.8 | 192.6 | 0.881 | 83.3 | |
| CFC-QCMatching Type=Contextual matching2021.09 | 187.5 | 196.3 | 0.862 | 80.8 | |
| TE-DQSMatching Type=Contextual matching2021.09 | 190.5 | 198.2 | 0.855 | 80.4 | |
| BE-QSMatching Type=Contextual matching2021.09 | 190.9 | 199.8 | 0.853 | 80.6 | |
| BE-QCMatching Type=Contextual matching2021.09 | 194.4 | 203.2 | 0.829 | 78.3 | |
| BE-QRMatching Type=Non-contextual matching2021.09 | 198.1 | 206.5 | 0.782 | 71.4 | |
| BM25-QSMatching Type=Contextual matching2021.09 | 200 | 208.3 | 0.816 | 74.1 | |
| BM25-QRMatching Type=Non-contextual matching2021.09 | 202.8 | 214.5 | 0.704 | 62.7 | |
| BM25-QCMatching Type=Contextual matching2021.09 | 208.3 | 217.5 | 0.606 | 52.1 |