In-Image Machine Translation Evaluation on MCiT Scene 1.0
0.552Pearson Correlation (r)SSIM
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SSIMProtocol=Reference-based (Top-Ranked Candidate as Reference)2026.01 | 0.552 | 0.448 | |
| FIDProtocol=Reference-based (Top-Ranked Candidate as Reference)2026.01 | 0.521 | 0.414 | |
| PSNRProtocol=Reference-based (Top-Ranked Candidate as Reference)2026.01 | 0.508 | 0.406 | |
| VectraProtocol=No-Reference (Direct Assessment)2026.01 | 0.496 | 0.423 | |
| LPIPSProtocol=Reference-based (Top-Ranked Candidate as Reference)2026.01 | 0.448 | 0.383 | |
| HCIIT-JudgeProtocol=No-Reference (Direct Assessment)2026.01 | 0.448 | 0.067 | |
| SAMScoreProtocol=No-Reference (Direct Assessment)2026.01 | 0.315 | 0.241 | |
| E-Commerce VQAProtocol=No-Reference (Direct Assessment)2026.01 | -0.159 | -0.116 |