Audiovisual Dialogue Description on DiaDemBench Single-shot
57.2REF Score (All)DiaDem
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| DiaDemSize=7B2026.01 | 57.2 | 70.3 | 74.2 | 79.1 | 60.6 | 72.4 | 42.4 | 62.2 | 55.7 | 68.3 | |
| Gemini-2.5-Pro2026.01 | 54.2 | 66.6 | 62.3 | 71.1 | 59.4 | 66.7 | 43.8 | 62.6 | 52.8 | 80 | |
| Qwen3-Omni-CaptionerSize=30B-A3B2026.01 | 41 | 53.5 | 56.1 | 60.6 | 38.5 | 51.7 | 32.5 | 49.7 | 43.6 | 63.1 |