Question Answering on BioASQ (T, U, F, Rely)
66T ScoreBinary
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| BinaryBase Model=Llama3.1-8B-Inst2026.04 | 66 | 0 | 34 | 66 | |
| BinaryBase Model=Qwen2.5-7B-Inst2026.04 | 60.7 | 0 | 39.3 | 60.7 | |
| KARLBase Model=Llama3.1-8B-Inst2026.04 | 57.7 | 32.8 | 9.5 | 79.7 | |
| PromptingBase Model=Llama3.1-8B-Inst2026.04 | 55.8 | 0.3 | 43.9 | 56.1 | |
| SFTBase Model=Llama3.1-8B-Inst2026.04 | 53.4 | 0 | 46.6 | 53.4 | |
| SFTBase Model=Qwen2.5-7B-Inst2026.04 | 49.4 | 0 | 50.6 | 49.4 | |
| RLKFBase Model=Llama3.1-8B-Inst2026.04 | 43.3 | 27.6 | 29.1 | 63.3 | |
| PromptingBase Model=Qwen2.5-7B-Inst2026.04 | 43.2 | 21.8 | 35 | 60.2 | |
| KARLBase Model=Qwen2.5-7B-Inst2026.04 | 43 | 35.2 | 21.8 | 65.8 | |
| Ternary (TruthRL)Base Model=Llama3.1-8B-Inst2026.04 | 39 | 57 | 4 | 63.5 | |
| RLKFBase Model=Qwen2.5-7B-Inst2026.04 | 35.3 | 7 | 57.7 | 41.8 | |
| R-TuningBase Model=Llama3.1-8B-Inst2026.04 | 27.9 | 65.6 | 6.5 | 50.5 | |
| Ternary (TruthRL)Base Model=Qwen2.5-7B-Inst2026.04 | 25.2 | 67.8 | 7 | 47 | |
| R-TuningBase Model=Qwen2.5-7B-Inst2026.04 | 22.7 | 75.2 | 2.1 | 41.3 |