Acute Problems on RealICU GOLD
86.7Hit@5ICU-Evo
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| ICU-EvoBackbone=GPT-5.42026.05 | 86.7 | 57 | |
| ICU-EvoBackbone=Gemini-3.1-pro2026.05 | 82.3 | 52.6 | |
| ICU-EvoBackbone=Qwen3-235B2026.05 | 60 | 36.2 | |
| RAGBackbone=GPT-5.42026.05 | 59.9 | 34.9 | |
| RAGBackbone=Gemini-3.1-pro2026.05 | 59.6 | 34.2 | |
| Full-contextBackbone=GPT-5.42026.05 | 51 | 34.8 | |
| Local-windowBackbone=GPT-5.42026.05 | 50 | 29.3 | |
| Full-contextBackbone=Gemini-3.1-pro2026.05 | 48.6 | 30.8 | |
| Local-windowBackbone=Gemini-3.1-pro2026.05 | 45.9 | 25.8 | |
| Full-contextBackbone=Qwen3-235B2026.05 | 38.4 | 22.6 | |
| RAGBackbone=Qwen3-235B2026.05 | 37.9 | 21.1 | |
| Local-windowBackbone=Qwen3-235B2026.05 | 21.3 | 12.6 |