Response Quality on Live Gaming Benchmark Solo Commentary
1.03Time DifferenceGemini 2.5 Pro
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Gemini 2.5 ProModel Category=Offline Models2026.03 | 1.03 | 0.2272 | 0.5902 | |
| LiveCC-7B-InstructModel Category=Real-Time Models2026.03 | 1.04 | 0.1684 | 0.6205 | |
| GPT-4oModel Category=Offline Models2026.03 | 1.16 | 0.2514 | 0.6253 | |
| Proact-VLModel Category=Real-Time Proactive Model2026.03 | 1.2 | 0.2036 | 0.6325 | |
| StreamingVLMModel Category=Real-Time Models2026.03 | 1.35 | 0.0511 | 0.5692 | |
| LiveCC-7B-BaseModel Category=Real-Time Models2026.03 | 8.36 | 0.1634 | 0.4705 | |
| VideoLLM-onlineModel Category=Proactive Models2026.03 | 10.86 | 0.0004 | 0.0702 | |
| MMDuetModel Category=Proactive Models2026.03 | 27.85 | 0 | 0.0005 | |
| LivestarModel Category=Proactive Models2026.03 | 28.24 | 0.1532 | 0.0024 |