Medical Question Answering on PubMedQA (FA, HS)
95.63Factual Accuracy (FA)SPPFT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SPPFTModel=Llama-3-8B2026.04 | 95.63 | 25.45 | |
| CWACModel=Llama-3-8B2026.04 | 95.52 | 8.65 | |
| SFTModel=Llama-3-8B2026.04 | 95.24 | 53.1 | |
| CWACModel=Gemma-2-9B2026.04 | 95.2 | 12.55 | |
| ASFTModel=Llama-3-8B2026.04 | 95.18 | 10.28 | |
| CWACModel=Llama-2-7B2026.04 | 94.52 | 7.24 | |
| ASFTModel=Gemma-2-9B2026.04 | 94.41 | 11.63 | |
| BEAModel=Llama-2-7B2026.04 | 94.3 | 35.17 | |
| BEAModel=Llama-3-8B2026.04 | 94.27 | 29.12 | |
| BEAModel=Gemma-2-9B2026.04 | 94.18 | 25.31 | |
| SFTModel=Llama-2-7B2026.04 | 93.81 | 46.75 | |
| SFTModel=Gemma-2-9B2026.04 | 93.45 | 48.97 | |
| SPPFTModel=Gemma-2-9B2026.04 | 93.26 | 16.49 | |
| ASFTModel=Llama-2-7B2026.04 | 93.22 | 9.38 | |
| LisaModel=Gemma-2-9B2026.04 | 92.05 | 27.4 | |
| CWACModel=Mistral-7B2026.04 | 90.72 | 15.39 | |
| LisaModel=Llama-2-7B2026.04 | 90.62 | 22.37 | |
| LisaModel=Llama-3-8B2026.04 | 87.6 | 30.41 | |
| SPPFTModel=Llama-2-7B2026.04 | 85.37 | 16.42 | |
| SafeInstrModel=Gemma-2-9B2026.04 | 83.45 | 9.54 | |
| SafeInstrModel=Llama-3-8B2026.04 | 74.05 | 15.37 | |
| SafeInstrModel=Llama-2-7B2026.04 | 70.37 | 12.49 | |
| SFTModel=Mistral-7B2026.04 | 64.53 | 60.72 | |
| BEAModel=Mistral-7B2026.04 | 62.67 | 45.25 | |
| ASFTModel=Mistral-7B2026.04 | 58.15 | 20.31 | |
| LisaModel=Mistral-7B2026.04 | 43.5 | 43.41 | |
| SafeInstrModel=Mistral-7B2026.04 | 43.08 | 45.37 | |
| SPPFTModel=Mistral-7B2026.04 | 30.27 | 29.46 |