INDIC-MARCO
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
INDIC-MARCO Telugu Small (dev)
0.206MRR@10
3
INDIC-MARCO Tamil Small (dev)
20.2MRR@10
3
INDIC-MARCO Punjabi Small (dev)
0.211MRR@10
3
INDIC-MARCO Oriya Small (dev)
0.086MRR@10
3
INDIC-MARCO Marathi Small (dev)
20.7MRR@10
3
INDIC-MARCO Malayalam Small (dev)
19.8MRR@10
3
INDIC-MARCO Kannada Small (dev)
0.219MRR@10
3
INDIC-MARCO Hindi Small (dev)
22.3MRR@10
3
INDIC-MARCO Gujarati Small (dev)
23.2MRR@10
3
INDIC-MARCO Bengali Small (dev)
0.221MRR@10
3
INDIC-MARCO Assamese Small (dev)
0.176MRR@10
3