Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

MMRole dataset and benchmarks · SOTA2 Research

Research Datasets

MMRole

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Multimodal Conversation

MMRole OOD

91.6LLM-as-a-Judge Score

20

Multimodal Conversation

MMRole (ID)

95.3LLM-as-a-Judge Score

20

Multimodal Role-playing

MMRole (out-of-domain)

1.164IA

17

Multi-modal Role-playing

MMRole in-domain

1.199IA

17

Popular tasks

Multimodal Conversation Multi-modal Role-playing Multimodal Role-playing

Follow for updates

Join SOTA2 Contact