Information Retrieval on Mr. TyDi Japanese v1.1 (test)
32.4MRR@100mContrieverFT
Evaluation Results
| Method | Links | |
|---|---|---|
| mContrieverFTrelevance judgement=true2022.12 | 32.4 | |
| HyDErelevance judgement=false2022.12 | 30.7 | |
| mBERTrelevance judgement=true2022.12 | 27.1 | |
| XLM-Rrelevance judgement=true2022.12 | 24.8 | |
| BM25relevance judgement=false2022.12 | 21.2 | |
| mContrieverrelevance judgement=false2022.12 | 19.5 | |
| mDPRrelevance judgement=true2022.12 | 18.1 |