Medical Question Answering on CMB
78.69AccuracyDoRA r24/alpha48
Evaluation results
| Method | Links | |
|---|---|---|
| DoRA r24/alpha48Family=PEFT, Params=66.87M2026.06 | 78.69 | |
| Rank-wise gate without clinical priorsFamily=Rank-wise control, Params=64.88M2026.06 | 78.36 | |
| BiRG-LoRA r16/top4Family=Single adapter, Params=66.59M2026.06 | 78.26 | |
| BiRG-LoRASetting=Qwen, CMExam train2026.06 | 78.21 | |
| DoRASetting=Qwen, CMExam train2026.06 | 78.16 | |
| LoRA r24/alpha48Family=Fixed LoRA, Params=65.47M2026.06 | 78.09 | |
| MoELoRASetting=Qwen, CMExam train2026.06 | 77.97 | |
| MoELoRA 4e/top2/r8Family=LoRA-MoE, Params=92.60M2026.06 | 77.95 | |
| LoRA r16/alpha32Family=Fixed LoRA, Params=43.65M2026.06 | 77.87 | |
| LoRA r4/alpha8Family=Fixed LoRA, Params=10.91M2026.06 | 77.83 | |
| MedAdapter-style candidate verifierFamily=Adapter library, Params=N/A2026.06 | 77.61 | |
| LoRA-Mixer-style hard-soft routerFamily=Adapter library, Params=N/A2026.06 | 77.03 | |
| Arrow LoRA-weight routerFamily=Adapter library, Params=N/A2026.06 | 76.69 | |
| MeteoRA-style soft MoEFamily=Adapter library, Params=N/A2026.06 | 76.67 | |
| Qwen3-8B, no SFTFamily=Base model, Params=02026.06 | 71.68 | |
| BiRG-LoRASetting=Llama, CMB train2026.06 | 56.76 | |
| MoELoRASetting=Llama, CMB train2026.06 | 55.87 | |
| DoRASetting=Llama, CMB train2026.06 | 55.75 |