In-Image Machine Translation Evaluation on MCiT 1.0 (Poster)
0.631Pearson Correlation (r)Vectra
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| VectraProtocol=No-Reference (Direct Assessment)2026.01 | 0.631 | 0.523 | |
| SSIMProtocol=Reference-based (Top-Ranked Candidate as Reference)2026.01 | 0.532 | 0.414 | |
| PSNRProtocol=Reference-based (Top-Ranked Candidate as Reference)2026.01 | 0.501 | 0.422 | |
| SAMScoreProtocol=No-Reference (Direct Assessment)2026.01 | 0.318 | 0.232 | |
| FIDProtocol=Reference-based (Top-Ranked Candidate as Reference)2026.01 | 0.288 | 0.202 | |
| HCIIT-JudgeProtocol=No-Reference (Direct Assessment)2026.01 | 0.278 | 0.067 | |
| LPIPSProtocol=Reference-based (Top-Ranked Candidate as Reference)2026.01 | 0.18 | 0.158 | |
| E-Commerce VQAProtocol=No-Reference (Direct Assessment)2026.01 | -0.094 | -0.083 |