Fact Verification on DP (test)
69AccuracyDesign A rescue
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Design A rescueModel=Qwen3-14B2026.06 | 69 | 60.6 | 1.5 | 56.9 | 0.1 | |
| Design A 2-sidedModel=Gemma2-9B2026.06 | 68.5 | 52.7 | 3.9 | 50.8 | 3.1 | |
| Design A rescueModel=Gemma2-9B2026.06 | 67.8 | 48.6 | -0.2 | 47.5 | -0.1 | |
| DirectModel=Llama3.1-8B2026.06 | 67.5 | 28.9 | — | — | — | |
| SIFTModel=Gemma2-9B2026.06 | 67.5 | 48.8 | — | 47.7 | — | |
| SIFTModel=Qwen3-14B2026.06 | 67.5 | 60.3 | — | 56.8 | — | |
| Design BModel=Qwen3-14B2026.06 | 66.8 | 62.1 | 1.8 | 57.3 | 0.5 | |
| Design A 2-sidedModel=Qwen3-14B2026.06 | 66.6 | 61.6 | 1.3 | 56.8 | 0 | |
| Design BModel=Gemma2-9B2026.06 | 63.7 | 68 | 19.2 | 64.5 | 16.8 | |
| DirectModel=Gemma2-9B2026.06 | 61.1 | 34.9 | — | — | — | |
| Design A rescueModel=Qwen3-4B2026.06 | 58.7 | 51 | 8.3 | 43.2 | 5.2 | |
| Design A 2-sidedModel=Qwen3-4B2026.06 | 57.9 | 61.1 | 18.4 | 52.4 | 14.4 | |
| Design BModel=Llama3.1-8B2026.06 | 57.7 | 81.5 | 13.9 | 71.2 | 11.3 | |
| DirectModel=Qwen3-4B2026.06 | 56.5 | 43.2 | — | — | — | |
| Design BModel=Qwen3-4B2026.06 | 56.5 | 63.7 | 21 | 52.2 | 14.2 | |
| DirectModel=Qwen3-14B2026.06 | 56 | 34.2 | — | — | — | |
| Design A rescueModel=Llama3.1-8B2026.06 | 54.8 | 69.4 | 1.8 | 60.1 | 0.3 | |
| NLI-as-judge (DeBERTa)2026.06 | 53.6 | — | — | — | — | |
| SIFTModel=Qwen3-4B2026.06 | 52.9 | 42.7 | — | 38 | — | |
| SIFTModel=Llama3.1-8B2026.06 | 52.9 | 67.6 | — | 59.9 | — | |
| Design A 2-sidedModel=Llama3.1-8B2026.06 | 50.7 | 79.6 | 12 | 60.1 | 0.3 |