Sanskrit Poetry Generation on Chandomitra (test)
92.12Semantic SimilarityPhi-4-14B
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Phi-4-14BFine-tuning (FT)=false, Standard Constrained Decoding (CD)=false, PINGALA=true2026.03 | 92.12 | — | 11.75 | 23.85 | |
| Phi-4-14B(SLP1)Fine-tuning (FT)=true, Standard Constrained Decoding (CD)=false, PINGALA=false, transliteration=SLP12026.03 | 81.64 | — | 31.18 | 65.73 | |
| NLLB-dist-1.3BFine-tuning (FT)=true, Standard Constrained Decoding (CD)=false, PINGALA=true2026.03 | 78.89 | — | 100 | 100 | |
| Phi-4-14B(SLP1)Fine-tuning (FT)=true, Standard Constrained Decoding (CD)=false, PINGALA=true, transliteration=SLP12026.03 | 76.81 | — | 95.92 | 98.31 | |
| Phi-4-14BFine-tuning (FT)=true, Standard Constrained Decoding (CD)=false, PINGALA=true2026.03 | 76.75 | — | 65.66 | 77.78 | |
| Ground Truth2026.03 | 73.46 | — | — | — | |
| NLLB-dist-1.3B*Fine-tuning (FT)=false, Standard Constrained Decoding (CD)=true, PINGALA=false, Note=Same settings as in Chandomitra2026.03 | 70.75 | — | 82.97 | 90 | |
| PINGALA2026.03 | 69.05 | 2.7 | — | — | |
| NLLB-dist-1.3BFine-tuning (FT)=true, Standard Constrained Decoding (CD)=true, PINGALA=false2026.03 | 69.01 | — | 98.8 | 99.09 | |
| NLLB-dist-1.3B*Fine-tuning (FT)=true, Standard Constrained Decoding (CD)=true, PINGALA=false, Note=Same settings as in Chandomitra2026.03 | 67.99 | — | 99.09 | 99.1 | |
| Phi-4-14BFine-tuning (FT)=true, Standard Constrained Decoding (CD)=false, PINGALA=false2026.03 | 67.29 | — | 57.42 | 75.01 | |
| CDDecoding Strategy=Standard Constrained Decoding2026.03 | 64.96 | 2.13 | — | — | |
| NLLB-dist-1.3BFine-tuning (FT)=false, Standard Constrained Decoding (CD)=false, PINGALA=true2026.03 | 35.62 | — | 0.14 | 0.25 |