Romanized Sinhala to Sinhala Transliteration on SinMix2Mono Golden dataset 1.0 (test)
49.7BLEUSwaBhasha-mBART
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SwaBhasha-mBARTEvaluation Protocol=Fine-tuned Models, Finetuning Dataset=SinMix2Mono2025.07 | 49.7 | 78.47 | 81.19 | |
| M2M100Evaluation Protocol=Fine-tuned Models, Finetuning Dataset=SinMix2Mono2025.07 | 45.66 | 75.44 | 81.11 | |
| XLM-REvaluation Protocol=Fine-tuned Models, Finetuning Dataset=SinMix2Mono2025.07 | 42.33 | 71.52 | 76.58 | |
| Gemini 2.5 FlashEvaluation Protocol=Few-shot LLMs2025.07 | 33.43 | 58.07 | 71 | |
| Gemini 2.5 Flash-LiteEvaluation Protocol=Zero-shot LLMs2025.07 | 26.36 | 61.91 | 66 | |
| Sinhala-BERTEvaluation Protocol=Baseline Systems2025.07 | 22.28 | 54.31 | 59 | |
| Sinhala-BERT (finetuned)Evaluation Protocol=Baseline Systems, Fine-tuned=true2025.07 | 21.64 | 54.05 | 59 | |
| Qwen-3 MaxEvaluation Protocol=Few-shot LLMs2025.07 | 20.57 | 58.11 | 62 | |
| Qwen-3 MaxEvaluation Protocol=Zero-shot LLMs2025.07 | 18.47 | 55.87 | 60.03 | |
| SwaBhasha TrigramEvaluation Protocol=Baseline Systems2025.07 | 17.35 | 51.65 | 57 | |
| Rule-BasedEvaluation Protocol=Baseline Systems2025.07 | 4.03 | 37.4 | 40 |