Quality Estimation on English-Indic QE Tourism domain
0.737QE Score (En-Hi)Open-weight LLMs
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Open-weight LLMsPrompt setting=Few-shot (No Guidelines), Model family=Open2026.03 | 0.737 | 0.687 | — | 0.473 | — | 0.632 | |
| Open-weight LLMsPrompt setting=Zero-shot, Model family=Open2026.03 | 0.613 | 0.689 | — | 0.636 | — | 0.646 | |
| Closed-weight LLMsPrompt setting=Few-shot (No Guidelines), Model family=Closed2026.03 | 0.509 | 0.685 | — | 0.397 | — | 0.53 | |
| Closed-weight LLMsPrompt setting=Few-shot + Guidelines, Model family=Closed2026.03 | 0.502 | 0.679 | — | 0.472 | — | 0.551 | |
| Closed-weight LLMsPrompt setting=Zero-shot, Model family=Closed2026.03 | 0.416 | 0.474 | — | 0.217 | — | 0.369 | |
| Open-weight LLMsPrompt setting=Few-shot + Guidelines, Model family=Open2026.03 | 0.158 | 0.702 | — | 0.583 | — | 0.481 |