Cardiac diagnosis on MIMIC-IV-Ext
54.9F1@3EvidenceRL with GRPO
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| EvidenceRL with GRPOBackbone=Gemma-3-27B2026.03 | 54.9 | 46.2 | 48.4 | 44.4 | 7 | 14.1 | 11.4 | 69 | |
| EvidenceRL with GRPOBackbone=Llama-3.2-3B2026.03 | 54.5 | 77 | 78.7 | 61.6 | 2.4 | 8.6 | 3.4 | 87.5 | |
| EvidenceRL with GRPOBackbone=Llama-3.1-8B2026.03 | 53.9 | 58.9 | 61.1 | 55.3 | 4.3 | 14.2 | 7.2 | 76.1 | |
| Self-RAGBackbone=Gemma-3-27B2026.03 | 53.3 | 25.8 | 27.4 | 34.5 | 9.5 | 17.5 | 17.7 | 54.3 | |
| fDPOBackbone=Gemma-3-27B2026.03 | 53.1 | 62.5 | 64.6 | 48.5 | 4.4 | 11.6 | 7 | 77.7 | |
| Reasoning OnlyBackbone=Gemma-3-27B2026.03 | 52.2 | 37.1 | 39 | 39.1 | 8.5 | 15.5 | 13.7 | 63.1 | |
| Self-RAGBackbone=Llama-3.3-70B2026.03 | 51.6 | 39.9 | 42.1 | 41 | 9 | 16.3 | 11.6 | 66.3 | |
| Reasoning OnlyBackbone=Llama-3.3-70B2026.03 | 51.3 | 46.9 | 49.4 | 43.8 | 8.5 | 14.3 | 9.3 | 71.9 | |
| EvidenceRL with GRPOBackbone=Gemma-3-12B2026.03 | 49.3 | 38 | 40.5 | 38 | 10.6 | 17.2 | 10.3 | 65.9 | |
| SFTBackbone=Llama-3.2-3B2026.03 | 49.1 | 34.8 | 36.5 | 41.3 | 11.5 | 15.5 | 12.2 | 67 | |
| Self ConsistencyBackbone=Gemma-3-27B2026.03 | 48.6 | 45.9 | 48.1 | 39.6 | 8.7 | 13.9 | 10.1 | 68.7 | |
| fDPOBackbone=Gemma-3-12B2026.03 | 47.9 | 37.6 | 39.9 | 37 | 10.2 | 16.5 | 11 | 65.6 | |
| SFTBackbone=GPT-oss-20B2026.03 | 47.7 | 31.8 | 33.1 | 38 | 12.1 | 15.7 | 12.8 | 63.5 | |
| SFTBackbone=Llama-3.1-8B2026.03 | 47.2 | 24.9 | 26.5 | 37.9 | 13.3 | 17.5 | 13.8 | 61.4 | |
| Self-RAGBackbone=Gemma-3-12B2026.03 | 47 | 17.5 | 19 | 29.5 | 14.4 | 19.3 | 16.2 | 52.9 | |
| Self ConsistencyBackbone=Llama-3.3-70B2026.03 | 46.8 | 51.2 | 53.2 | 41.2 | 9.2 | 12.1 | 7.8 | 74.5 | |
| EvidenceRL with GRPOBackbone=Gemma-3-4B2026.03 | 46.8 | 54 | 56 | 42.4 | 7.8 | 13.9 | 6.6 | 76.4 | |
| Reasoning OnlyBackbone=Gemma-3-12B2026.03 | 46.5 | 21.5 | 23.5 | 31 | 14.4 | 19.2 | 14.3 | 56.3 | |
| Self-RAGBackbone=Gemma-3-4B2026.03 | 46.5 | 46.2 | 48.7 | 39.2 | 8.2 | 18.1 | 7.8 | 70.4 | |
| fDPOBackbone=Gemma-3-4B2026.03 | 46.3 | 68.9 | 70.8 | 47.6 | 5.9 | 9.8 | 3.1 | 86.4 | |
| Reasoning OnlyBackbone=GPT-oss-20B2026.03 | 46 | -2.2 | -0.9 | 24.9 | 15.6 | 17.7 | 26 | 40.2 | |
| fDPOBackbone=GPT-oss-20B2026.03 | 46 | 14.5 | 15.7 | 29.9 | 13.1 | 16.5 | 20.8 | 48.4 | |
| Reasoning OnlyBackbone=Gemma-3-4B2026.03 | 44.2 | 34.3 | 36.3 | 35.1 | 13.4 | 19.2 | 8.9 | 66 | |
| Self ConsistencyBackbone=GPT-oss-20B2026.03 | 44 | 0.4 | 1.6 | 26.9 | 16.5 | 15.7 | 24.6 | 43.5 | |
| Reasoning OnlyBackbone=GPT-oss-120B2026.03 | 43.6 | 18.3 | 19.7 | 30.8 | 14.4 | 15.5 | 17.9 | 53.3 | |
| Self ConsistencyBackbone=Gemma-3-4B2026.03 | 41.9 | 48.3 | 50.5 | 37.3 | 10.6 | 14.9 | 6.2 | 75.3 | |
| Self ConsistencyBackbone=GPT-oss-120B2026.03 | 41.2 | 25.1 | 26.7 | 32.3 | 15.2 | 16.1 | 13 | 59.2 | |
| Self ConsistencyBackbone=Gemma-3-12B2026.03 | 41 | 24.4 | 26 | 28.7 | 16.4 | 17 | 12 | 59.7 | |
| SFTBackbone=Gemma-3-4B2026.03 | 39.9 | 2.1 | 1.8 | 28.4 | 18.2 | 18.6 | 21.1 | 47.3 | |
| fDPOBackbone=Llama-3.1-8B2026.03 | 39.7 | 51.4 | 53 | 39.5 | 9 | 11.2 | 7.3 | 76.7 | |
| Self-RAGBackbone=Llama-3.1-8B2026.03 | 39.4 | 30 | 33.1 | 31.5 | 13.6 | 19.9 | 9.6 | 62.7 | |
| Self ConsistencyBackbone=Llama-3.2-3B2026.03 | 39.3 | 48.2 | 50.3 | 33.6 | 10.7 | 15.6 | 5.9 | 71.8 | |
| fDPOBackbone=Llama-3.2-3B2026.03 | 38.7 | 62.4 | 63.6 | 37.9 | 7.9 | 11.4 | 3.6 | 82.2 | |
| Reasoning OnlyBackbone=Llama-3.1-8B2026.03 | 38.2 | 19.4 | 21.3 | 27.4 | 17.7 | 20.2 | 11.5 | 56.6 | |
| Self-RAGBackbone=GPT-oss-120B2026.03 | 37.1 | 11.4 | 12.9 | 29.9 | 15.7 | 16.4 | 18.2 | 52.6 | |
| Reasoning OnlyBackbone=Llama-3.2-3B2026.03 | 37 | 45.3 | 47.6 | 31.8 | 11.6 | 16.5 | 6.2 | 72.5 | |
| SFTBackbone=Gemma-3-27B2026.03 | 36.6 | 1.2 | 1.2 | 27.8 | 18 | 19.7 | 21.5 | 45.7 | |
| Self-RAGBackbone=Llama-3.2-3B2026.03 | 36.5 | 24.4 | 25.6 | 26 | 17.3 | 18.5 | 10.4 | 59.6 | |
| Self-RAGBackbone=GPT-oss-20B2026.03 | 36.5 | 0.2 | 1.7 | 25.7 | 16.3 | 17.6 | 23.7 | 42.7 | |
| SFTBackbone=Llama-3.3-70B2026.03 | 35.2 | 8.9 | 10 | 32.5 | 14.3 | 18.1 | 19.5 | 52.1 | |
| Self ConsistencyBackbone=Llama-3.1-8B2026.03 | 34.8 | 25.8 | 27.6 | 26.8 | 17.6 | 19.7 | 8.7 | 60.7 | |
| SFTBackbone=Gemma-3-12B2026.03 | 33.8 | 0.3 | 0.6 | 28.5 | 16.9 | 18.8 | 23.4 | 45.3 |