Action Recommendation on RealICU GOLD
67.6Hit Rate@5ICU-Evo
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| ICU-EvoBackbone=Gemini-3.1-pro2026.05 | 67.6 | 53.4 | |
| ICU-EvoBackbone=GPT-5.42026.05 | 67.6 | 53.4 | |
| ICU-EvoBackbone=Qwen3-235B2026.05 | 52.6 | 35.7 | |
| RAGBackbone=Gemini-3.1-pro2026.05 | 49.6 | 31.3 | |
| RAGBackbone=GPT-5.42026.05 | 48 | 39.8 | |
| RAGBackbone=Qwen3-235B2026.05 | 45.3 | 32.4 | |
| Full-contextBackbone=GPT-5.42026.05 | 40.4 | 30 | |
| Local-windowBackbone=Gemini-3.1-pro2026.05 | 39.5 | 26 | |
| Local-windowBackbone=GPT-5.42026.05 | 38 | 28.1 | |
| Local-windowBackbone=Qwen3-235B2026.05 | 35.2 | 24.2 | |
| Full-contextBackbone=Qwen3-235B2026.05 | 32.9 | 22.2 | |
| Full-contextBackbone=Gemini-3.1-pro2026.05 | 25.9 | 15.2 |