Video Captioning on TCA-Bench
71.5Audio Transcription ScoreGemini-3.0-Pro
Evaluation results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Gemini-3.0-Pro2026.07 | 71.5 | 68.9 | 70.2 | 61.5 | 62.8 | 58.5 | 60.9 | 87.3 | 42.8 | 76.8 | 80.9 | 78.3 | 80 | |
| Gemini-2.5-Pro2026.07 | 64.2 | 66.3 | 65.3 | 66 | 69.5 | 63.1 | 66.2 | 82.6 | 47.6 | 74.3 | 78.5 | 76.9 | 78 | |
| Gemini-2.5-Flash2026.07 | 62.2 | 64.6 | 63.4 | 66 | 69.6 | 67.2 | 67.6 | 77.3 | 41.1 | 68.6 | 73.3 | 71.6 | 72.7 | |
| Gemini-3.0-Flash2026.07 | 61.7 | 59.6 | 60.7 | 60 | 63.2 | 50.1 | 57.8 | 81.3 | 34.3 | 70.1 | 72.4 | 71.4 | 72 | |
| TCA-Captioner2026.07 | 61.6 | 60.8 | 61.2 | 59.6 | 68.9 | 62.2 | 63.6 | 82.1 | 44.6 | 73.2 | 76.7 | 77.1 | 76.9 | |
| AVoCaDO2026.07 | 59.2 | 62.3 | 60.8 | 59.3 | 63.9 | 65.2 | 62.8 | 76.7 | 36.8 | 67.2 | 68.8 | 67.3 | 68.3 | |
| UGC-Captioner2026.07 | 39.8 | 48.2 | 44 | 48.7 | 58.8 | 35 | 47.5 | 51.5 | 22.3 | 44.6 | 46.1 | 51 | 47.9 | |
| Qwen3-Omni2026.07 | 35.2 | 42.8 | 39 | 53.3 | 61.7 | 39.2 | 51.4 | 48.8 | 22.2 | 42.5 | 46.7 | 49.9 | 47.9 | |
| Qwen2.5-Omni-7B2026.07 | 33.6 | 37.8 | 35.7 | 51.1 | 54.6 | 29.9 | 45.2 | 39.9 | 18.3 | 34.8 | 37.5 | 43.3 | 39.7 | |
| Qwen2.5-Omni-3B2026.07 | 29.3 | 32.3 | 30.8 | 46.9 | 52.1 | 29.1 | 42.7 | 41.6 | 17.2 | 35.8 | 33.3 | 38 | 35 |