Medbullets
Benchmarks
TaskDatasetSOTA resultTrendResults
MedBullets
84.2Accuracy
81
MedBullets (test)
82.79Accuracy
24
Medbullets op4 4-option 308
92.2Accuracy
13
MedBullets
80.8Accuracy
13
MedBullets
2,391Token Cost (tokens/question)
11
Medbullets op5
53.9Accuracy
8
Medbullets OOD (out-of-distribution)
63.6Accuracy
7
MedBullets 5-option multiple choice
53.9Accuracy
7
MedBullets 4-option multiple choice
62.3Accuracy
7
Medbullets 5
65.3Accuracy
7
Medbullets
58.44Accuracy
5
Medbullets op5
94.16Pass@1
4
Medbullets op4
95.78Pass@1
4