System-level Quality Estimation Correlation on WMT English → Italian 2025 (test)
88Soft Pairwise AccuracyQwen-ESA
Evaluation Results
| Method | Links | |
|---|---|---|
| Qwen-ESAMetric Category=LLM-based, Scoring Protocol=Explicit Score Assignment (ESA), Model Backbone=Qwen2026.05 | 88 | |
| Gemini1.5-ProMetric Category=LLM-based, Model Backbone=Gemini 1.5 Pro2026.05 | 87 | |
| Gemini1.5_flash-ESAMetric Category=LLM-based, Scoring Protocol=Explicit Score Assignment (ESA), Model Backbone=Gemini 1.5 Flash2026.05 | 87 | |
| GEMBA-v2Metric Category=LLM-based2026.05 | 86 | |
| Gemma-ESAMetric Category=LLM-based, Scoring Protocol=Explicit Score Assignment (ESA), Model Backbone=Gemma2026.05 | 85 | |
| EuroLLM-ESAMetric Category=LLM-based, Scoring Protocol=Explicit Score Assignment (ESA), Model Backbone=EuroLLM2026.05 | 76 | |
| MetricX-24-QEMetric Category=Baseline2026.05 | 73 | |
| COMETKiwi22Metric Category=Baseline2026.05 | 61 |