Information Retrieval on LoTTE Forum v1.0 (test)
76.3Success@5 (Writing)ColBERTv2
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| ColBERTv2Zero-shot=true2021.12 | 76.3 | 70.8 | 46.1 | 53.6 | 76.9 | 63.4 | |
| SPLADEv2Zero-shot=true2021.12 | 73 | 67.1 | 43.7 | 50.8 | 74 | 60.1 | |
| RocketQAv2Zero-shot=true2021.12 | 71.5 | 65.7 | 38 | 47.3 | 73.7 | 57.7 | |
| ColBERTZero-shot=true2021.12 | 71 | 65.6 | 41.8 | 48.5 | 73 | 58.2 | |
| ANCEZero-shot=true2021.12 | 68.8 | 63.8 | 36.5 | 46.8 | 73.1 | 55.7 | |
| BM25Zero-shot=true2021.12 | 64 | 55.4 | 37.1 | 39.4 | 60.6 | 47.2 |