Medical Question Answering on Medical TF-QA (test)
85AccuracyPubMedBERT + MA-X
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| PubMedBERT + MA-XArchitecture=Specialised Medical, Activation Steering=MEDASSESS-X2026.01 | 85 | 86 | 9 | 4 | |
| Gemma-3-27B + MA-XArchitecture=Decoder-Only, Activation Steering=MEDASSESS-X2026.01 | 84 | 83 | 11 | 5 | |
| Flan-T5-XL + MA-XArchitecture=Encoder-Decoder, Activation Steering=MEDASSESS-X2026.01 | 83 | 82 | 12 | 5 | |
| BioBERT + MA-XArchitecture=Specialised Medical, Activation Steering=MEDASSESS-X2026.01 | 83 | 84 | 10 | 3 | |
| BioGPT + MA-XArchitecture=Specialised Medical, Activation Steering=MEDASSESS-X2026.01 | 83 | 82 | 11 | 5 | |
| Llama-3-8B-Instruct + MA-XArchitecture=Decoder-Only, Activation Steering=MEDASSESS-X2026.01 | 82 | 81 | 13 | 6 | |
| T5-Large + MA-XArchitecture=Encoder-Decoder, Activation Steering=MEDASSESS-X2026.01 | 81 | 80 | 13 | 5 | |
| PubMedBERTArchitecture=Specialised Medical, Activation Steering=None2026.01 | 81 | 80 | 14 | 0 | |
| Mistral-7B-Instruct-v0.3 + MA-XArchitecture=Decoder-Only, Activation Steering=MEDASSESS-X2026.01 | 80 | 79 | 14 | 5 | |
| BioBERTArchitecture=Specialised Medical, Activation Steering=None2026.01 | 80 | 79 | 15 | 0 | |
| Gemma-3-27BArchitecture=Decoder-Only, Activation Steering=None2026.01 | 79 | 76 | 18 | 0 | |
| DeepSeek-7B + MA-XArchitecture=Decoder-Only, Activation Steering=MEDASSESS-X2026.01 | 78 | 77 | 16 | 5 | |
| Flan-T5-XLArchitecture=Encoder-Decoder, Activation Steering=None2026.01 | 78 | 76 | 19 | 0 | |
| BioGPTArchitecture=Specialised Medical, Activation Steering=None2026.01 | 78 | 75 | 17 | 0 | |
| Llama-3-8B-InstructArchitecture=Decoder-Only, Activation Steering=None2026.01 | 77 | 74 | 21 | 0 | |
| T5-LargeArchitecture=Encoder-Decoder, Activation Steering=None2026.01 | 76 | 74 | 20 | 0 | |
| Mistral-7B-Instruct-v0.3Architecture=Decoder-Only, Activation Steering=None2026.01 | 75 | 72 | 22 | 0 | |
| DeepSeek-7BArchitecture=Decoder-Only, Activation Steering=None2026.01 | 73 | 70 | 24 | 0 |