Information Retrieval on LoTTE Forum (test)
79.7IR Score (Lifestyle)SSR
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| SSRMax Sequence Length=1024, Query Type=Forum2026.05 | 79.7 | 47.3 | 81.8 | 74.3 | 55.9 | 67.4 | |
| ColBERTv2Max Sequence Length=1024, Query Type=Forum2026.05 | 77.3 | 45.8 | 78.7 | 71.4 | 53.9 | 63.5 | |
| ColBERT-Att2026.03 | 77.2 | 46.5 | 77.1 | 70.7 | 54.3 | 65.1 | |
| ColBERTv2_PLAID2026.03 | 76.7 | 46.1 | 75.7 | 70.6 | 53.2 | 64.4 | |
| XTRMax Sequence Length=1024, Query Type=Forum2026.05 | 75.8 | 44.2 | 76.4 | 70.9 | 53.4 | 61.7 | |
| RocketQAv22026.03 | 73.7 | 38 | 71.5 | 65.7 | 47.3 | 59.2 | |
| ANCE2026.03 | 73.1 | 36.5 | 68.8 | 63.8 | 46.8 | 57.76 | |
| ColBERT2026.03 | 73 | 41.8 | 71 | 65.6 | 48.5 | 59.94 | |
| BM252026.03 | 60.6 | 37.1 | 64 | 55.4 | 39.4 | 51.27 |