Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

MRBench dataset and benchmarks · SOTA2 Research

Research Datasets

MRBench

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Role-playing evaluation

MRBench Chinese 1.0

8.85Memory Adherence (SI)

12

Role-playing evaluation

MRBench English 1.0

9.13MA-SI Score

12

Memory-Driven Role-Play

MRBench

8.43MA Score

8

Pedagogical Dialogue Classification

MRBench (test)

91Mistake ID Acc

7

Automated evaluation of tutor responses

MRBench extended (test)

0.646Macro-F1

5

Multi-Grain Retrieval

MRBench

55.5R@5 (q^t -> c^i, COCO*)

3

Popular tasks

Role-playing evaluation Automated evaluation of tutor responses Pedagogical Dialogue Classification Memory-Driven Role-Play Multi-Grain Retrieval

Follow for updates

Join SOTA2 Contact