Human Preference Alignment on Out-of-Domain (test)
81.8AgreementAnnotators
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| AnnotatorsType=Human Agreement2026.03 | 81.8 | — | — | |
| RefReward-SR2026.03 | 80.2 | 77 | 73 | |
| NIMAType=NR Metrics2026.03 | 59.5 | 41 | 40 | |
| LPIPSType=FR Metrics2026.03 | 58.8 | 44.5 | 34 | |
| MUSIQType=NR Metrics2026.03 | 57.6 | 38 | 34.5 | |
| CLIPIQAType=NR Metrics2026.03 | 56.9 | 32 | 37.5 | |
| TOPIQ-IAAType=NR Metrics2026.03 | 56.4 | 36 | 33.5 | |
| Q-AlignType=NR Metrics2026.03 | 54.3 | 40.5 | 32 | |
| GPT-5.2Type=MLLMs2026.03 | 49.7 | 38.1 | 29.9 | |
| Gemini 3 ProType=MLLMs2026.03 | 47.9 | 42.6 | 36.6 | |
| VQ-R1Type=NR Metrics2026.03 | 44.1 | 50.5 | 39 | |
| SSIMType=FR Metrics2026.03 | 43.3 | 26 | 19 | |
| Qwen3-VL 32BType=MLLMs, parameters=32B2026.03 | 40.7 | 38.5 | 36 | |
| PSNRType=FR Metrics2026.03 | 35.5 | 25.5 | 8.5 | |
| Qwen3-VL 8BType=MLLMs, parameters=8B2026.03 | 26.1 | 59 | 57 |