Fact Verification on 5PILS (test)
79.6AccuracyDesign A rescue
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Design A rescueModel=Qwen3-14B2026.06 | 79.6 | 64.4 | 0.6 | 56.9 | 0.1 | |
| SIFTModel=Qwen3-14B2026.06 | 79.2 | 63.8 | — | 56.8 | — | |
| Design A 2-sidedModel=Qwen3-14B2026.06 | 77.4 | 65.4 | 1.6 | 56.2 | -0.7 | |
| Design BModel=Qwen3-14B2026.06 | 77.4 | 69.6 | 5.8 | 58.5 | 1.7 | |
| Design A 2-sidedModel=Gemma2-9B2026.06 | 77 | 63.6 | 8 | 53.7 | 2.8 | |
| DirectModel=Llama3.1-8B2026.06 | 76.5 | 33.2 | — | — | — | |
| DirectModel=Gemma2-9B2026.06 | 75.3 | 43.9 | — | — | — | |
| Design A rescueModel=Qwen3-4B2026.06 | 75 | 56.2 | 0.7 | 46.1 | 0.1 | |
| Design A 2-sidedModel=Qwen3-4B2026.06 | 74 | 72.5 | 17 | 60.1 | 14.1 | |
| SIFTModel=Qwen3-4B2026.06 | 73.9 | 55.5 | — | 46 | — | |
| Design BModel=Qwen3-4B2026.06 | 73.9 | 77.5 | 22 | 61.5 | 15.5 | |
| Design BModel=Llama3.1-8B2026.06 | 73.7 | 86.6 | 20.7 | 70.6 | 13.2 | |
| Design BModel=Gemma2-9B2026.06 | 72.8 | 71.4 | 15.8 | 60.7 | 9.8 | |
| DirectModel=Qwen3-4B2026.06 | 71.5 | 46.7 | — | — | — | |
| Design A rescueModel=Llama3.1-8B2026.06 | 71.5 | 66.2 | 0.3 | 57.4 | 0 | |
| Design A rescueModel=Gemma2-9B2026.06 | 71 | 56 | 0.4 | 51.1 | 0.2 | |
| DirectModel=Qwen3-14B2026.06 | 70.7 | 46 | — | — | — | |
| SIFTModel=Llama3.1-8B2026.06 | 70.5 | 65.9 | — | 57.4 | — | |
| SIFTModel=Gemma2-9B2026.06 | 70.4 | 55.6 | — | 50.9 | — | |
| Design A 2-sidedModel=Llama3.1-8B2026.06 | 68 | 79.3 | 13.4 | 57.5 | 0.1 | |
| NLI-as-judge (DeBERTa)2026.06 | 63.9 | — | — | — | — |