In-Image Machine Translation Evaluation on MCiT Overall OOD 1.0
0.558Pearson Correlation (r)Vectra
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| VectraProtocol=No-Reference (Direct Assessment)2026.01 | 0.558 | 0.466 | |
| HCIIT-JudgeProtocol=No-Reference (Direct Assessment)2026.01 | 0.435 | 0.2 | |
| SSIMProtocol=Reference-based (Top-Ranked Candidate as Reference)2026.01 | 0.4 | 0.318 | |
| FIDProtocol=Reference-based (Top-Ranked Candidate as Reference)2026.01 | 0.361 | 0.285 | |
| PSNRProtocol=Reference-based (Top-Ranked Candidate as Reference)2026.01 | 0.264 | 0.224 | |
| LPIPSProtocol=Reference-based (Top-Ranked Candidate as Reference)2026.01 | 0.261 | 0.221 | |
| SAMScoreProtocol=No-Reference (Direct Assessment)2026.01 | 0.256 | 0.195 | |
| E-Commerce VQAProtocol=No-Reference (Direct Assessment)2026.01 | -0.05 | -0.041 |