HealthBench
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
HealthBench Medical
56.36Score
10
HealthBench
63.3Score
9
HealthBench
43HealthBench Score
9
HealthBench Hard
38.6Score
8
HealthBench
44.83Ratio
8
HealthBench 1K-example (eval)
78.8Score
8
HealthBench
61.35Communication Score
7
HealthBench Professional
62.7Score
7
HealthBench (test)
7.31Medical Chat Annotation Score
6
HealthBench 500
41.16Rubric Score
6
HealthBench
90Coverage
6
HealthBench
10Specificity
6
HealthBench Hard
32.1Accuracy
5
HealthBench Hard
42Score
5
HealthBench-Hard (test)
8.9Accuracy
5
HealthBench
41.45Score
5
HealthBench
41.45Score
5
HealthBench
90.5Actual (per type)
5
HealthBench
47.45Score
5
HealthBench 500-conversation (out-of-domain)
0.649HealthBench Score
5
HealthBench Hard
38.6Score
4
HealthBench
28.1Score
4
Healthbench Hard
40.91Pass Rate
4
HealthBench (All Set)
58.56Overall Score
4
HealthBench normal
65.2Pass@1
4