Translation Preference Prediction on WMT EN -> DE
51.6Pairwise AccDistribution-Calibrated Aggregation
Evaluation results
| Method | Links | |
|---|---|---|
| Distribution-Calibrated Aggregationn=12, Judge LLM=gemini-2.5-flash2025.12 | 51.6 | |
| Distribution-Calibrated Aggregationn=4, Judge LLM=gemini-2.5-flash2025.12 | 51 | |
| Soft-SCn=4, Judge LLM=gemini-2.5-flash2025.12 | 49.6 | |
| Soft-SCn=12, Judge LLM=gemini-2.5-flash2025.12 | 47.7 | |
| CI-SCn=4, Judge LLM=gemini-2.5-flash2025.12 | 47.3 | |
| SCn=12, Judge LLM=gemini-2.5-flash2025.12 | 46.7 | |
| CI-SCn=12, Judge LLM=gemini-2.5-flash2025.12 | 46.5 | |
| GSCn=12, Judge LLM=gemini-2.5-flash2025.12 | 46.3 | |
| GSCn=4, Judge LLM=gemini-2.5-flash2025.12 | 45.2 | |
| USCn=12, Judge LLM=gemini-2.5-flash2025.12 | 44.7 | |
| SCn=4, Judge LLM=gemini-2.5-flash2025.12 | 44.2 | |
| USCn=4, Judge LLM=gemini-2.5-flash2025.12 | 43.6 |