Information Retrieval on LoTTE Search 1.0 (dev)
81.7Success@5 (Writing)ColBERTV2
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| ColBERTV2zero-shot=true2021.12 | 81.7 | 76 | 74.2 | 59.3 | 75.8 | 69.3 | |
| RocketQAv2zero-shot=true2021.12 | 79.5 | 73 | 67.7 | 54.3 | 72.4 | 66.4 | |
| SPLADEV2zero-shot=true2021.12 | 78.9 | 70.7 | 73.4 | 56.3 | 71.2 | 67 | |
| ColBERTzero-shot=true2021.12 | 76.3 | 71.8 | 71.7 | 52.8 | 73.1 | 65.4 | |
| ANCEzero-shot=true2021.12 | 75.7 | 66.1 | 66.9 | 55.7 | 69.8 | 63.7 | |
| BM25zero-shot=true2021.12 | 47.3 | 56.3 | 52.2 | 35.8 | 54.4 | 45.6 |