Multilingual Information Retrieval on MLQA
0.671nDCG@20embeddinggemma-300m + SHIFT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| embeddinggemma-300m + SHIFTArchi=encoder, SHIFT=true, Source Query Language=English2026.06 | 0.671 | 74.8 | |
| embeddinggemma-300mArchi=encoder, SHIFT=false, Source Query Language=English2026.06 | 0.664 | 74 | |
| multilingual-e5-large + SHIFTArchi=encoder, SHIFT=true, Source Query Language=English2026.06 | 0.649 | 72.1 | |
| gte-Qwen2-1.5B-instruct + SHIFTArchi=decoder, SHIFT=true, Source Query Language=English2026.06 | 0.639 | 71.6 | |
| gte-Qwen2-1.5B-instructArchi=decoder, SHIFT=false, Source Query Language=English2026.06 | 0.621 | 69.1 | |
| Qwen3-Embedding-0.6BArchi=decoder, SHIFT=false, Source Query Language=English2026.06 | 0.611 | 68.8 | |
| Qwen3-Embedding-0.6B + SHIFTArchi=decoder, SHIFT=true, Source Query Language=English2026.06 | 0.611 | 68.8 | |
| bge-m3 + SHIFTArchi=encoder, SHIFT=true, Source Query Language=English2026.06 | 0.609 | 68.2 | |
| bge-m3Archi=encoder, SHIFT=false, Source Query Language=English2026.06 | 0.607 | 67.9 | |
| llama-nemotron-embed-1b-v2 + SHIFTArchi=decoder, SHIFT=true, Source Query Language=English2026.06 | 0.527 | 60.9 | |
| llama-nemotron-embed-1b-v2Archi=decoder, SHIFT=false, Source Query Language=English2026.06 | 0.523 | 60.2 | |
| multilingual-e5-largeArchi=encoder, SHIFT=false, Source Query Language=English2026.06 | 0.494 | 52.3 |