Multilingual Information Retrieval on MultiEup v2
51.9nDCG@20gte-Qwen2-1.5B-instruct + SHIFT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| gte-Qwen2-1.5B-instruct + SHIFTArchi=decoder, SHIFT=true, Source Query Language=English2026.06 | 51.9 | 45.1 | |
| embeddinggemma-300m + SHIFTArchi=encoder, SHIFT=true, Source Query Language=English2026.06 | 51.1 | 44.3 | |
| gte-Qwen2-1.5B-instructArchi=decoder, SHIFT=false, Source Query Language=English2026.06 | 49.6 | 43 | |
| embeddinggemma-300mArchi=encoder, SHIFT=false, Source Query Language=English2026.06 | 49.5 | 43.3 | |
| Qwen3-Embedding-0.6B + SHIFTArchi=decoder, SHIFT=true, Source Query Language=English2026.06 | 47.6 | 41.1 | |
| Qwen3-Embedding-0.6BArchi=decoder, SHIFT=false, Source Query Language=English2026.06 | 46.8 | 40.3 | |
| bge-m3 + SHIFTArchi=encoder, SHIFT=true, Source Query Language=English2026.06 | 46 | 39.1 | |
| bge-m3Archi=encoder, SHIFT=false, Source Query Language=English2026.06 | 45.5 | 38.7 | |
| multilingual-e5-large + SHIFTArchi=encoder, SHIFT=true, Source Query Language=English2026.06 | 44.2 | 37.5 | |
| multilingual-e5-largeArchi=encoder, SHIFT=false, Source Query Language=English2026.06 | 36.7 | 30.2 | |
| llama-nemotron-embed-1b-v2 + SHIFTArchi=decoder, SHIFT=true, Source Query Language=English2026.06 | 31.2 | 27.3 | |
| llama-nemotron-embed-1b-v2Archi=decoder, SHIFT=false, Source Query Language=English2026.06 | 29.2 | 25.1 |