Quote Recommendation on QuoteR English 1.0 (test)
0.572MRRQuoteR
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| QuoteRvariant=Main2022.02 | 0.572 | 0.58 | 1 | 123 | 433 | 50.74 | 69.03 | 83.84 | |
| QuoteR-Sememedescription=QuoteR without sememes2022.02 | 0.568 | 0.574 | 1 | 145 | 492 | 51.05 | 67.07 | 82.34 | |
| Transform2022.02 | 0.561 | 0.568 | 1 | 241 | 749 | 50.11 | 65.88 | 79.98 | |
| QuoteR-SimTraindescription=QuoteR with SimTrain variant2022.02 | 0.529 | 0.532 | 2 | 467 | 1,060 | 49.31 | 58.97 | 69.48 | |
| BERT-SimBackbone=BERT-Base2022.02 | 0.526 | 0.529 | 2 | 487 | 1,064 | 49.38 | 58.05 | 67.75 | |
| top-k RM2022.02 | 0.422 | 0.431 | 6 | 548 | 1,243 | 35.99 | 53.31 | 66.2 | |
| N-QRM2022.02 | 0.365 | 0.368 | 28 | 777 | 1,465 | 32.24 | 44.41 | 58.26 | |
| LSTM2022.02 | 0.321 | 0.32 | 30 | 334 | 727 | 27.23 | 40.78 | 62.47 | |
| NNQR2022.02 | 0.318 | 0.319 | 31 | 359 | 773 | 26.78 | 41.1 | 61.29 | |
| BERT-ClsBackbone=BERT-Base2022.02 | 0.31 | 0.329 | 7 | 134 | 453 | 18.15 | 57.11 | 82.05 | |
| QuoteR-ReTraindescription=QuoteR with retrained quote encoder2022.02 | 0.299 | 0.307 | 12 | 176 | 503 | 20.46 | 47.89 | 75.74 | |
| CRM2022.02 | 0.192 | 0.193 | 599 | 1,169 | 1,408 | 16.51 | 23.66 | 32.78 |