Passage Retrieval on Amharic Passage Retrieval Dataset (test)
77.5MRR@10ROBERTa-Base-Amharic-Embed
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| ROBERTa-Base-Amharic-EmbedParams=110M2025.05 | 77.5 | 80.8 | 91.3 | 96.4 | 97.9 | |
| ROBERTa-Medium-Amharic-EmbedParams=42M2025.05 | 73.5 | 77.1 | 88.4 | 95.5 | 97.1 | |
| BERT-Medium-Amharic-EmbedParams=40M2025.05 | 68.2 | 72 | 84.3 | 93.1 | 95.4 | |
| multilingual-e5-large-instructParams=560M2025.05 | 67.2 | 70.9 | 82.5 | 91.1 | 93.1 | |
| snowflake-arctic-embed-l-v2.0Params=568M2025.05 | 65.9 | 70.1 | 83.1 | 92.2 | 94.2 | |
| gte-multilingual-baseParams=305M2025.05 | 60 | 63.8 | 76 | 85.1 | 88.2 | |
| gte-modernbert-baseParams=149M2025.05 | 1.9 | 2.3 | 3.3 | 5.1 | 6.7 |