Multimodal dialogue understanding on MMDU
0.703GPT-4o ScoreAsymVLM
Evaluation Results
| Method | Links | |
|---|---|---|
| AsymVLMModel=Gemma 3, Text eviction ratio=90%2026.05 | 0.703 | |
| AsymVLMModel=Gemma 3, Text eviction ratio=75%2026.05 | 0.7 | |
| BaselineModel=Gemma 32026.05 | 0.68 | |
| AsymVLMModel=Gemma 3, Text eviction ratio=50%2026.05 | 0.68 | |
| H2OModel=Gemma 3, Text eviction ratio=90%2026.05 | 0.561 | |
| StreamingLLMModel=Gemma 3, Text eviction ratio=90%2026.05 | 0.561 | |
| H2OModel=Gemma 3, Text eviction ratio=75%2026.05 | 0.546 | |
| StreamingLLMModel=Gemma 3, Text eviction ratio=75%2026.05 | 0.524 | |
| H2OModel=Gemma 3, Text eviction ratio=50%2026.05 | 0.502 | |
| StreamingLLMModel=Gemma 3, Text eviction ratio=50%2026.05 | 0.495 |