Information Retrieval on LoTTE Search v1.0 (test)
80.1Success@5 (Writing)ColBERTv2
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| ColBERTv2Zero-shot=true2021.12 | 80.1 | 72.3 | 56.7 | 66.1 | 84.7 | 71.6 | |
| RocketQAv2Zero-shot=true2021.12 | 78 | 72.1 | 55.3 | 63.4 | 82.1 | 69.8 | |
| SPLADEv2Zero-shot=true2021.12 | 77.1 | 69 | 55.4 | 62.4 | 82.3 | 68.9 | |
| ColBERTZero-shot=true2021.12 | 74.7 | 68.5 | 53.6 | 61.9 | 80.2 | 67.3 | |
| ANCEZero-shot=true2021.12 | 74.4 | 64.7 | 53.6 | 59.6 | 82.3 | 66.4 | |
| BM25Zero-shot=true2021.12 | 60.3 | 56.5 | 32.7 | 41.8 | 63.8 | 48.3 |