Dense Retrieval on 2AIRTC (test)
0.905MRR@100multilingual-e5-large-instruct
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| multilingual-e5-large-instructParams=560M2025.05 | 0.905 | 0.808 | 0.853 | 0.911 | |
| gte-multilingual-baseParams=305M2025.05 | 0.879 | 0.749 | 0.79 | 0.865 | |
| snowflake-arctic-embed-1-v2.0Params=568M, Training=Zero-shot2025.05 | 0.876 | 0.781 | 0.83 | 0.897 | |
| snowflake-arctic-embed-l-v2.0-AMTraining=Fine-tuned on AMNEWS2025.05 | 0.865 | 0.795 | 0.856 | 0.923 | |
| RoBERTa-Base-Amharic-embedParams=110M2025.05 | 0.861 | 0.77 | 0.83 | 0.91 | |
| RoBERTa-Medium-Amharic-embedParams=42M2025.05 | 0.853 | 0.735 | 0.798 | 0.878 | |
| BERT-Medium-Amharic-embedParams=40M2025.05 | 0.805 | 0.667 | 0.727 | 0.828 | |
| gte-modernbert-baseParams=149M, Backbone=ModernBERT2025.05 | 0.046 | 0.017 | 0.021 | 0.033 |