In-Image Machine Translation Evaluation on MCiT Document 1.0
0.599Pearson Correlation (r)Vectra
Evaluation results
| Method | Links | ||
|---|---|---|---|
| VectraProtocol=No-Reference (Direct Assessment)2026.01 | 0.599 | 0.49 | |
| HCIIT-JudgeProtocol=No-Reference (Direct Assessment)2026.01 | 0.553 | 0.333 | |
| FIDProtocol=Reference-based (Top-Ranked Candidate as Reference)2026.01 | 0.204 | 0.17 | |
| SSIMProtocol=Reference-based (Top-Ranked Candidate as Reference)2026.01 | 0.157 | 0.119 | |
| SAMScoreProtocol=No-Reference (Direct Assessment)2026.01 | 0.156 | 0.122 | |
| LPIPSProtocol=Reference-based (Top-Ranked Candidate as Reference)2026.01 | 0.077 | 0.059 | |
| E-Commerce VQAProtocol=No-Reference (Direct Assessment)2026.01 | -0.043 | -0.036 | |
| PSNRProtocol=Reference-based (Top-Ranked Candidate as Reference)2026.01 | -0.136 | -0.085 |