Machine Translation on Cultural Fidelity Hindi MT Target Subset
64.4Gender ScorePAR
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| PARSystem=GPT, Intervention=PAR2026.05 | 64.4 | 49.5 | 44 | 54.47 | 84 | |
| SARSystem=Sarvam, Intervention=SAR2026.05 | 61 | 9.7 | 5.3 | 32.47 | 75.5 | |
| PARSystem=Sarvam, Intervention=PAR2026.05 | 59.6 | 27.2 | 45.7 | 49.66 | 83.4 | |
| SARSystem=GPT, Intervention=SAR2026.05 | 59.4 | 9.2 | 1.5 | 30.17 | 75.9 | |
| Sarvam BaselineSystem=Sarvam, Intervention=Baseline2026.05 | 26.7 | 7.8 | 5.7 | 15.99 | 84.5 | |
| Sarvam Prompted L3System=Sarvam, Intervention=Prompted L32026.05 | 26 | 5.6 | 3.9 | 14.63 | 83.3 | |
| GPT BaselineSystem=GPT, Intervention=Baseline2026.05 | 21.1 | 7.2 | 0 | 11.07 | 87.4 |