List your company
ResearchFormerly WizWand

Multimodal dialogue understanding on MMDU

0.703GPT-4o ScoreAsymVLM
0.486680.542840.5990.65516May 28, 2026
Updated 5mo ago

Evaluation results

MethodLinks
AsymVLMModel=Gemma 3, Text eviction ratio=90%2026.050.703
AsymVLMModel=Gemma 3, Text eviction ratio=75%2026.050.7
BaselineModel=Gemma 32026.050.68
AsymVLMModel=Gemma 3, Text eviction ratio=50%2026.050.68
H2OModel=Gemma 3, Text eviction ratio=90%2026.050.561
StreamingLLMModel=Gemma 3, Text eviction ratio=90%2026.050.561
H2OModel=Gemma 3, Text eviction ratio=75%2026.050.546
StreamingLLMModel=Gemma 3, Text eviction ratio=75%2026.050.524
H2OModel=Gemma 3, Text eviction ratio=50%2026.050.502
StreamingLLMModel=Gemma 3, Text eviction ratio=50%2026.050.495