Next-visit Procedure (Proc) Prediction on MIMIC-IV
59.4Recall@5GRAIL (+Llama-3.1-8B-Instruct)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GRAIL (+Llama-3.1-8B-Instruct)LLM Backend=Llama-3.1-8B-Instruct2026.02 | 59.4 | 76.4 | 58.9 | |
| GRAIL (+Qwen3-8B)LLM Backend=Qwen3-8B2026.02 | 56.3 | 66.2 | 58.7 | |
| Llama-3.1-70B-InstructZero-shot=True2026.02 | 29.4 | 36 | 30.7 | |
| GRAIL (w.o. LLM backend)LLM Backend=None2026.02 | 26 | 35.7 | 28.3 | |
| Hyperbolic (no stitch)Geometry=Hyperbolic, Temporal Stitching=False2026.02 | 14.9 | 24 | 17.1 | |
| Euclidean GRAILGeometry=Euclidean2026.02 | 14.6 | 23.4 | 16.7 | |
| Euclidean RAGGeometry=Euclidean2026.02 | 13.6 | 22.1 | 15.6 | |
| BEHRTModel Type=Sequential Baseline2026.02 | 12.8 | 20.6 | 14.5 | |
| Transformer (Eucl.)Geometry=Euclidean2026.02 | 12.1 | 19.7 | 13.8 | |
| RETAINModel Type=Sequential Baseline2026.02 | 11.3 | 18.8 | 13.2 | |
| Qwen3-8BZero-shot=True2026.02 | 8.4 | 14.7 | 9.7 | |
| Llama-3.1-8B-InstructZero-shot=True2026.02 | 8.1 | 14.2 | 9.4 |