ICD Coding on MIMIC-III (full)
58.4Micro RecallPLM-ICD
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| PLM-ICDBackbone=RoBERTa, Paradigm=PLM Baselines2026.06 | 58.4 | 61 | 59.7 | 29 | 31.4 | 28.3 | |
| LAATBackbone=Bi-LSTM, Paradigm=PLM Baselines2026.06 | 52.2 | 57.3 | 54.6 | 20.5 | 24.7 | 20.7 | |
| MultiResCNNBackbone=ResNet, Paradigm=PLM Baselines2026.06 | 51.7 | 55.2 | 53.4 | 16.3 | 17.1 | 15.3 | |
| GRPOBackbone=Qwen3-4B, Paradigm=LLM (Post-training)2026.06 | 51.4 | 62.8 | 56.5 | 19.4 | 22.7 | 19.4 | |
| PHIBackbone=Qwen3-4B, Paradigm=LLM (Post-training)2026.06 | 51.4 | 62.9 | 56.6 | 20.5 | 23 | 20 | |
| CAMLBackbone=CNN, Paradigm=PLM Baselines2026.06 | 48.8 | 53.1 | 50.9 | 17.9 | 20.6 | 18 | |
| GRPOBackbone=Qwen2.5-1.5B, Paradigm=LLM (Post-training)2026.06 | 46.4 | 52.1 | 49.1 | 13.8 | 15 | 13 | |
| PHIBackbone=Qwen2.5-1.5B, Paradigm=LLM (Post-training)2026.06 | 45 | 55.7 | 49.8 | 15.9 | 15.2 | 14.1 | |
| GRUBackbone=Bi-GRU, Paradigm=PLM Baselines2026.06 | 42.1 | 49 | 45.3 | 9.1 | 12.1 | 9.4 | |
| CNNBackbone=CNN, Paradigm=PLM Baselines2026.06 | 40.3 | 48.9 | 44.2 | 8.5 | 11.3 | 8.8 | |
| SFTBackbone=Qwen3-4B, Paradigm=LLM (Post-training)2026.06 | 39.3 | 55 | 45.8 | 15.9 | 22.7 | 17.4 | |
| SFTBackbone=Qwen2.5-1.5B, Paradigm=LLM (Post-training)2026.06 | 30.1 | 45.7 | 36.3 | 9.1 | 14.1 | 10.1 | |
| Few-shot+CoTBackbone=Qwen3-4B, Paradigm=LLM (Prompting)2026.06 | 3.2 | 22.9 | 5.7 | 0.3 | 0.8 | 0.3 | |
| Zero-shot+CoTBackbone=Qwen3-4B, Paradigm=LLM (Prompting)2026.06 | 1.9 | 30.8 | 3.5 | 0.2 | 0.6 | 0.2 | |
| Zero-shotBackbone=Qwen3-4B, Paradigm=LLM (Prompting)2026.06 | 1.6 | 24.2 | 3 | 0.2 | 0.4 | 0.2 | |
| Few-shotBackbone=Qwen3-4B, Paradigm=LLM (Prompting)2026.06 | 1.1 | 11.8 | 2 | 0.1 | 0.4 | 0.1 | |
| Few-shot+CoTBackbone=Qwen2.5-1.5B, Paradigm=LLM (Prompting)2026.06 | 0.6 | 6.9 | 1.1 | 0 | 0.1 | 0 | |
| Zero-shotBackbone=Qwen2.5-1.5B, Paradigm=LLM (Prompting)2026.06 | 0.1 | 15.1 | 0.2 | 0 | 0.1 | 0 | |
| Few-shotBackbone=Qwen2.5-1.5B, Paradigm=LLM (Prompting)2026.06 | 0 | 3.9 | 0 | 0 | 0 | 0 | |
| Zero-shot+CoTBackbone=Qwen2.5-1.5B, Paradigm=LLM (Prompting)2026.06 | 0 | 15.1 | 0.1 | 0 | 0.1 | 0 |