H-AdminSim
Benchmarks
TaskDatasetSOTA resultTrendResults
H-AdminSim Tertiary Level 1.0
99.6Success Rate
6
H-AdminSim Secondary Level 1.0
99.9Success Rate
6
H-AdminSim Primary Level 1.0
99.8Success Rate
6
H-AdminSim Tertiary Level 1.0
85.3Success Rate
3
H-AdminSim Secondary Level 1.0
81.2Success Rate
3
H-AdminSim Primary Level 1.0
88.9Success Rate
3
H-AdminSim Intake-Task (Human Evaluation)
89Arena Score
3
H-AdminSim Tertiary hospital level 1.0
14.4Department Error Rate
3
H-AdminSim Secondary hospital level 1.0
18.6Department Error Rate
3
H-AdminSim Primary hospital level 1.0
11.2Department Error Rate
3