Audiovisual Dialogue Description on DiaDemBench Multi-shot
70.9REF Score (All)DiaDem
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| DiaDemSize=7B2026.01 | 70.9 | 84.4 | 76.9 | 87.5 | 75.4 | 86.5 | 65.6 | 83.2 | 42.9 | 56.1 | |
| Gemini-2.5-Pro2026.01 | 69 | 79.6 | 64.5 | 77.3 | 75.6 | 81.7 | 67.8 | 80.3 | 55.4 | 68 | |
| Qwen3-Omni-CaptionerSize=30B-A3B2026.01 | 45.4 | 61.7 | 49.3 | 62.2 | 49.6 | 61.3 | 40.5 | 62.8 | 29.6 | 44.7 |