Quality Estimation on Healthcare domain English-Indic QE
0.611QE Score (En-Hi)Open-weight LLMs
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Open-weight LLMsPrompt setting=Few-shot (No Guidelines), Model family=Open2026.03 | 0.611 | 0.884 | 0.422 | — | 0.398 | 0.579 | |
| Closed-weight LLMsPrompt setting=Few-shot (No Guidelines), Model family=Closed2026.03 | 0.585 | 0.786 | 0.168 | — | 0.458 | 0.385 | |
| Open-weight LLMsPrompt setting=Zero-shot, Model family=Open2026.03 | 0.569 | 0.389 | 0.603 | — | 0.494 | 0.514 | |
| Open-weight LLMsPrompt setting=Few-shot + Guidelines, Model family=Open2026.03 | 0.447 | 0.884 | 0.411 | — | 0.211 | 0.488 | |
| Closed-weight LLMsPrompt setting=Few-shot + Guidelines, Model family=Closed2026.03 | 0.415 | 0.669 | -0.04 | — | 0.1 | 0.286 | |
| Closed-weight LLMsPrompt setting=Zero-shot, Model family=Closed2026.03 | 0.126 | 0.814 | 0.366 | — | 0.346 | 0.413 |