In-Image Machine Translation Evaluation on Vectra-Bench zh→es 1.0
0.732Pearson RVectra
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| VectraProtocol=No-Reference (Direct Assessment)2026.01 | 0.732 | 0.588 | |
| FIDProtocol=Reference-based (Top-Ranked Candidate as Reference)2026.01 | 0.586 | 0.483 | |
| HCIIT-JudgeProtocol=No-Reference (Direct Assessment)2026.01 | 0.577 | 0.466 | |
| SSIMProtocol=Reference-based (Top-Ranked Candidate as Reference)2026.01 | 0.432 | 0.337 | |
| PSNRProtocol=Reference-based (Top-Ranked Candidate as Reference)2026.01 | 0.374 | 0.298 | |
| LPIPSProtocol=Reference-based (Top-Ranked Candidate as Reference)2026.01 | 0.231 | 0.183 | |
| SAMScoreProtocol=No-Reference (Direct Assessment)2026.01 | 0.122 | 0.096 | |
| E-Commerce VQAProtocol=No-Reference (Direct Assessment)2026.01 | 0.008 | 0.001 |