Pairwise classification on PMR-Synth (Total)
73AccuracyMedGemma-27BSFT
Evaluation Results
| Method | Links | |
|---|---|---|
| MedGemma-27BSFTMethod=UrgentSFT2026.01 | 73 | |
| MedGemma-27bSize=27B2026.01 | 72 | |
| Reward-8BurgentMethod=UrgentReward2026.01 | 71 | |
| Qwen3-32BSFTMethod=UrgentSFT2026.01 | 69 | |
| Reward-8BbaseType=Base2026.01 | 68 | |
| Qwen3-8BSize=8B2026.01 | 67 | |
| Qwen3-4BSFTMethod=UrgentSFT2026.01 | 65 | |
| Qwen3-8BSFTMethod=UrgentSFT2026.01 | 64 | |
| Reward-4BurgentMethod=UrgentReward2026.01 | 64 | |
| Qwen3-32BSize=32B2026.01 | 63 | |
| Qwen3-4BSize=4B2026.01 | 61 | |
| Reward-4BbaseType=Base2026.01 | 61 | |
| GPT-OSSSize=120B2026.01 | 59 | |
| Qwen3-32B-RSize=32B, Reasoning=True2026.01 | 51 |