Summarization on Visual Tasks (test)
75.66Text F1OTAttMean
Evaluation results
| Method | Links | ||
|---|---|---|---|
| OTAttMeanModel=Qwen2.5-Omni-7B2026.03 | 75.66 | 76.59 | |
| OTRawAttModel=Qwen2.5-Omni-7B2026.03 | 72.51 | 51.82 | |
| OTAttGradsModel=Qwen2.5-Omni-7B2026.03 | 67.7 | 42.24 | |
| OTRawAttModel=MiniCPM-o 4.5-9B2026.03 | 37.32 | 76.46 | |
| OTAttMeanModel=MiniCPM-o 4.5-9B2026.03 | 30.57 | 75.43 | |
| EmbedprocessorModel=MiniCPM-o 4.5-9B2026.03 | 18.02 | 7.14 | |
| EmbedCLIPModel=MiniCPM-o 4.5-9B2026.03 | 17.98 | 5.55 | |
| EmbedprocessorModel=Qwen2.5-Omni-7B2026.03 | 17.3 | 14.55 | |
| EmbedCLIPModel=Qwen2.5-Omni-7B2026.03 | 17.2 | 3.54 | |
| RandomModel=MiniCPM-o 4.5-9B2026.03 | 12.05 | 10.03 | |
| RandomModel=Qwen2.5-Omni-7B2026.03 | 10.98 | 8.38 | |
| Self-AttributionModel=Qwen2.5-Omni-7B2026.03 | 9.25 | 40.6 | |
| Self-AttributionModel=MiniCPM-o 4.5-9B2026.03 | 9.06 | 66.53 |