Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Conversation Evaluation research benchmarks · SOTA2 Research

Conversation Evaluation

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

70.8Accuracy

15

Mar 12, 2026

CRSArena Eval (All)

0.918Pearson Correlation (r)

9

Jun 15, 2026

CRSArena-Eval Dial-level

0.913Pearson r

9

Jun 15, 2026

CRSArena-Eval Turn-level

0.93Pearson Correlation (r)

9

Jun 15, 2026

75.78Human Score (%)

3

May 8, 2026

88.57Human Score

3

May 8, 2026

Online Chinese conversation data 500 multi-turn proprietary dialogues (test)

79.4Win Rate vs GPT4

2

Apr 30, 2026

Popular datasets

CRSArena Braceval Online Chinese conversation data Robot Domain Grocery Domain

Follow for updates

Join SOTA2 Contact