MEDIC
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MEDIC subset
67.3AA
36
MEDIC (In-Domain)
81.39Top-1 Accuracy (Damage Severity)
12
MEDIC
82.9Accuracy
5
MEDIC
82.2Accuracy
5
MEDIC
88.3Accuracy
5
MEDIC Note Summ
-0.275Kendall's tau_b
3
MEDIC ACI Bench
0.341Kendall's tau_b
3
MEDIC Open-Ended
0.485Kendall's tau_b
3
MEDIC MedSafety
0.552Kendall's tau_b
3
MEDIC HealthBench
0.546Kendall's Tau-b
3
MEDIC OOD Evaluation
80.98Top-1 Accuracy (DS)
2