Question Answering on NQ (T, U, F, Rely Metrics)
56.3T MetricBinary
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| BinaryBase Model=Llama3.1-8B-Inst2026.04 | 56.3 | 0 | 43.7 | 56.3 | |
| KARLBase Model=Llama3.1-8B-Inst2026.04 | 42.7 | 40.6 | 16.7 | 66.8 | |
| SFTBase Model=Llama3.1-8B-Inst2026.04 | 40 | 0 | 60 | 40 | |
| PromptingBase Model=Llama3.1-8B-Inst2026.04 | 38.7 | 6 | 55.3 | 44.3 | |
| BinaryBase Model=Qwen2.5-7B-Inst2026.04 | 37 | 0 | 63 | 37 | |
| Ternary (TruthRL)Base Model=Llama3.1-8B-Inst2026.04 | 34.9 | 53.6 | 11.5 | 59.8 | |
| SFTBase Model=Qwen2.5-7B-Inst2026.04 | 30.1 | 0 | 69.9 | 30.1 | |
| RLKFBase Model=Llama3.1-8B-Inst2026.04 | 28.7 | 30.7 | 40.6 | 50 | |
| KARLBase Model=Qwen2.5-7B-Inst2026.04 | 26.3 | 49.5 | 24.2 | 51.3 | |
| RLKFBase Model=Qwen2.5-7B-Inst2026.04 | 24.9 | 43.2 | 31.9 | 49.4 | |
| R-TuningBase Model=Llama3.1-8B-Inst2026.04 | 24.8 | 56.8 | 18.4 | 49.3 | |
| PromptingBase Model=Qwen2.5-7B-Inst2026.04 | 23 | 32.5 | 44.5 | 44.9 | |
| Ternary (TruthRL)Base Model=Qwen2.5-7B-Inst2026.04 | 11.9 | 83 | 5.1 | 26 | |
| R-TuningBase Model=Qwen2.5-7B-Inst2026.04 | 9.3 | 87.4 | 3.3 | 20.3 |