Medical Question Answering on PubMedQA (Tau and Speedup)
4.03Kendall's TauEDA (Ours)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| EDA (Ours)Temperature=0, Target Model=Meditron3-Qwen2.5-7B2026.03 | 4.03 | 2.4 | |
| Full-FTTemperature=0, Target Model=Meditron3-Qwen2.5-7B2026.03 | 3.86 | 2.34 | |
| EDA (Base)Temperature=0, Target Model=Meditron3-Qwen2.5-7B2026.03 | 3.85 | 2.32 | |
| LoRATemperature=0, Target Model=Meditron3-Qwen2.5-7B2026.03 | 3.78 | 2.18 | |
| EDA (Ours)Temperature=1, Target Model=Meditron3-Qwen2.5-7B2026.03 | 2.72 | 1.56 | |
| EDA (Base)Temperature=1, Target Model=Meditron3-Qwen2.5-7B2026.03 | 2.3 | 1.35 | |
| Full-FTTemperature=1, Target Model=Meditron3-Qwen2.5-7B2026.03 | 2.28 | 1.35 | |
| LoRATemperature=1, Target Model=Meditron3-Qwen2.5-7B2026.03 | 2.25 | 1.33 | |
| Training-FreeTemperature=0, Target Model=Meditron3-Qwen2.5-7B2026.03 | 1.92 | 1.29 | |
| Training-FreeTemperature=1, Target Model=Meditron3-Qwen2.5-7B2026.03 | 1.38 | 0.82 |