MT-Bench
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MT-Bench
274.32Tokens Per Second
40
MT-bench
5.62Mean Accepted Length
39
MT-Bench
77.1Win Rate
36
MT-bench
5.582Mean Accepted Length (tau)
36
MT-Bench
0.689Pearson's r
36
MT-Bench (test)
8.33Overall Score
35
MT-Bench
8.9GPT-4 Score
34
MT-bench First Turn
0.97Agreement Rate
34
MT-Bench+
90.5Quality Score
32
MT-bench Second Turn
95Agreement
32
MT-Bench
6.93MAT Score
30
MT-Bench
4.13Average Acceptance Length
28
MT-Bench
7.58MT-Bench Score
28
MT-Bench (test)
3.934Speedup Ratio
26
MT-Bench High-Variance (Top 20%)
7.54Reward Score
26
MT-bench
3.82Speedup
25
MT-Bench-101
0.58Success Rate
25
MT-Bench
5.78Acceptance Length (τ)
20
MT-Bench
6.83SAG
20
MT-Bench
270.96Tokens/s
20
MT-Bench
48.36Lexical Diversity Score
20
MT-Bench
8.71Average Response Quality
19
MT-Bench 1.0 (test)
8MT-Bench Score
19
MT-Bench 80 questions
5.18Speed-up Ratio
18
MT-Bench
5.62Fluency
18