Fact Verification on AVeriTeC (dev)
46.08METEOR (Q-only)ProFact
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| ProFactLLMs=Qwen2-1.5B2026.06 | 46.08 | 30.11 | 69.6 | 46.2 | |
| ProFactLLMs=Qwen2-7B2026.06 | 46.05 | 30.02 | 70.28 | 46.4 | |
| ProFactLLMs=Qwen2.5-3B2026.06 | 46.01 | 31.14 | 68.8 | 47.8 | |
| ProFactLLMs=Qwen2.5-7B2026.06 | 45.26 | 30.36 | 70.2 | 48 | |
| HerOLLMs=Qwen2.5-3B2026.06 | 44.29 | 30.54 | 61 | 43.4 | |
| HerOLLMs=Qwen2.5-7B2026.06 | 44.29 | 30.54 | 67.8 | 42.8 | |
| HerOLLMs=Qwen2-1.5B2026.06 | 44.29 | 30.54 | 68.2 | 43.6 | |
| HerOLLMs=Qwen2-7B2026.06 | 44.29 | 30.54 | 69.2 | 44.4 | |
| w/o PRLLMs=Qwen2-7B2026.06 | 40.29 | 27.26 | 64.2 | 35.4 | |
| InFactLLMs=Qwen2-1.5B2026.06 | 40.09 | 29.12 | 56.91 | 45.29 | |
| w/o PRLLMs=Qwen2-1.5B2026.06 | 39.23 | 27.88 | 66 | 39 | |
| w/o PRLLMs=Qwen2.5-3B2026.06 | 38.98 | 27.2 | 64.6 | 34.4 | |
| InFactLLMs=Qwen2.5-3B2026.06 | 37.23 | 27.99 | 14.83 | 8.54 | |
| InFactLLMs=Qwen2-7B2026.06 | 35.54 | 26.27 | 55.07 | 31.5 | |
| w/o PRLLMs=Qwen2.5-7B2026.06 | 33.79 | 25.67 | 62.8 | 31 | |
| InFactLLMs=Qwen2.5-7B2026.06 | 33.74 | 26.79 | 37.72 | 23.71 | |
| ConsistencyLLMs=Qwen2.5-3B2026.06 | 29.65 | 23.86 | 29.6 | 15.6 | |
| ConsistencyLLMs=Qwen2.5-7B2026.06 | 29.65 | 23.86 | 41 | 20.6 | |
| ConsistencyLLMs=Qwen2-1.5B2026.06 | 29.65 | 23.86 | 51 | 21.4 | |
| ConsistencyLLMs=Qwen2-7B2026.06 | 29.65 | 23.86 | 45.6 | 22.4 |