Retrieval on LoTTE Session 8
66.7Success@5CREAM
Evaluation results
| Method | Links | ||
|---|---|---|---|
| CREAMSupervision=Unsupervised2026.01 | 66.7 | 45.4 | |
| MIRSupervision=Supervised2026.01 | 61.1 | 40.1 | |
| GSSSupervision=Supervised2026.01 | 61.1 | 37.5 | |
| OCSSupervision=Supervised2026.01 | 59.4 | 36.1 | |
| ERSupervision=Supervised2026.01 | 58.9 | 35.7 | |
| BM25Supervision=Unsupervised2026.01 | 50 | 27 | |
| L2RSupervision=Supervised2026.01 | 48.3 | 26.2 | |
| ColBERT+Supervision=Supervised2026.01 | 39.4 | 20.9 | |
| ERSupervision=Unsupervised2026.01 | 36.7 | 19.6 | |
| L2RSupervision=Unsupervised2026.01 | 35.6 | 19.6 | |
| OCSSupervision=Unsupervised2026.01 | 33.9 | 16 | |
| MIRSupervision=Unsupervised2026.01 | 32.8 | 14.7 | |
| GSSSupervision=Unsupervised2026.01 | 30.6 | 15.8 | |
| ColBERT+Supervision=Unsupervised2026.01 | 11.1 | 4.6 |