Structured EHR Reasoning on EHRStruct 1.0 (test)
100D-U1 AccuracyEHRMaster
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| EHRMasterModels=Gemini 1.52025.11 | 100 | 100 | 96 | 96 | 94 | 100 | 100 | 89 | 62.3 | 54 | 54.7 | |
| EHRMasterModels=Gemini 2.52025.11 | 100 | 100 | 97 | 95 | 97 | 100 | 100 | 60 | 59.3 | 55.1 | 69.2 | |
| previous SOTAModels=Gemini 2.52025.11 | 100 | 89 | 94 | 85 | 85 | 100 | 100 | 57 | 66.3 | 61.2 | 58.4 | |
| EHRMasterModels=Gemini 2.02025.11 | 98 | 100 | 91 | 81 | 93 | 80 | 87 | 67 | 65.3 | 64.2 | 56.2 | |
| previous SOTAModels=Gemini 2.02025.11 | 96 | 82 | 81 | 80 | 78 | 90 | 94 | 63 | 64.3 | 62.2 | 58.4 | |
| previous SOTAModels=Gemini 1.52025.11 | 76 | 79 | 80 | 78 | 73 | 85 | 93 | 57 | 61.3 | 56.4 | 54.2 |