Question Answering on Tatarstan Toponyms (val)
99.2EM (raw)xlm_roberta_large
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| xlm_roberta_largeBackbone=XLM-RoBERTa large, Fine-tuning=true2026.05 | 99.2 | 99.4 | 0.992 | 0.994 | 22.4 | |
| rule_basedBackbone=rule_based, Fine-tuning=false2026.05 | 49.2 | 49.2 | — | — | 0 | |
| xlm_roberta_baseBackbone=XLM-RoBERTa base, Fine-tuning=false2026.05 | 44 | 57.4 | — | — | 22.4 | |
| rubert_baseBackbone=RuBERT base, Fine-tuning=true2026.05 | 40.2 | 68.4 | 1 | 1 | 6.6 | |
| rubert_largeBackbone=RuBERT large, Fine-tuning=true2026.05 | 39.8 | 67.9 | 1 | 1 | 6.5 | |
| t5_rus_baseBackbone=t5_rus_base, Fine-tuning=false2026.05 | 17.6 | 22 | — | — | 27.2 | |
| rubert_baseBackbone=RuBERT base, Fine-tuning=false2026.05 | 6.8 | 18.7 | — | — | 6.6 |