Question Answering on PubMedQA Zero-Context Setting (test)
64.77AccuracyLlama 3.1 8B Instruct
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Llama 3.1 8B InstructModel=Llama 3.1, Parameters=8B, Type=Instruct2026.04 | 64.77 | 59.74 | |
| Llama 3.2 3B InstructModel=Llama 3.2, Parameters=3B, Type=Instruct2026.04 | 64.41 | 58.97 | |
| Full FT 5ep 16k contextFine-Tuning=Full, Epochs=5, Context Length=16k2026.04 | 60.62 | 57.24 | |
| LoRA FT 2ep 10k contextFine-Tuning=LoRA, Epochs=2, Context Length=10k2026.04 | 58.13 | 57.23 |