Clinical Reasoning Generation on DL3M
0.537CRS (P1)GPT 4.1
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| GPT 4.1Category=Adaptive2025.12 | 0.537 | 0.529 | 0.519 | 0.523 | 0.53 | |
| GPT 4.1 MiniCategory=Adaptive2025.12 | 0.531 | 0.527 | 0.485 | 0.481 | 0.515 | |
| GPT 3.5 turboCategory=Unreliable2025.12 | 0.464 | 0.459 | 0.483 | 0.496 | 0.47 | |
| Gemini 1.5 Flash 8bCategory=Unreliable2025.12 | 0.462 | 0.474 | 0.477 | 0.487 | 0.471 | |
| O3Category=Unreliable2025.12 | 0.462 | 0.462 | 0.459 | 0.471 | 0.462 | |
| Gemini 2.0 FlashCategory=Unreliable2025.12 | 0.454 | 0.472 | 0.482 | 0.454 | 0.465 | |
| Gemini 1.5 ProCategory=Unreliable2025.12 | 0.445 | 0.447 | 0.497 | 0.48 | 0.46 | |
| O4-MiniCategory=Unreliable2025.12 | 0.445 | 0.449 | 0.443 | 0.276 | 0.429 | |
| GPT 4.1 NanoCategory=Unreliable2025.12 | 0.44 | 0.469 | 0.503 | 0.498 | 0.467 | |
| Gemini 1.5 FlashCategory=Unreliable2025.12 | 0.426 | 0.46 | 0.473 | 0.482 | 0.451 | |
| O3-MiniCategory=Unreliable2025.12 | 0.234 | 0.234 | 0.234 | 0.234 | 0.234 |