Question Answering on Visual Tasks (test)
65.44Image F1OTRawAtt
Evaluation results
| Method | Links | |
|---|---|---|
| OTRawAttModel=Qwen2.5-Omni-7B2026.03 | 65.44 | |
| OTAttGradsModel=Qwen2.5-Omni-7B2026.03 | 65.02 | |
| Self-AttributionModel=Qwen2.5-Omni-7B2026.03 | 61.03 | |
| OTAttMeanModel=Qwen2.5-Omni-7B2026.03 | 56.6 | |
| OTRawAttModel=MiniCPM-o 4.5-9B2026.03 | 45.41 | |
| Self-AttributionModel=MiniCPM-o 4.5-9B2026.03 | 39.39 | |
| OTAttMeanModel=MiniCPM-o 4.5-9B2026.03 | 37 | |
| EmbedprocessorModel=Qwen2.5-Omni-7B2026.03 | 36.88 | |
| RandomModel=Qwen2.5-Omni-7B2026.03 | 24.7 | |
| RandomModel=MiniCPM-o 4.5-9B2026.03 | 22.96 | |
| EmbedCLIPModel=Qwen2.5-Omni-7B2026.03 | 6.32 | |
| EmbedprocessorModel=MiniCPM-o 4.5-9B2026.03 | 5.98 | |
| EmbedCLIPModel=MiniCPM-o 4.5-9B2026.03 | 5.32 |