Fact-claim Decomposition on ClaimDecompBench 1.0 (test)
84.2Semantic F1CREDENCE-base
Evaluation Results
| Method | Links | |
|---|---|---|
| CREDENCE-baseModel=Qwen3-8B2026.06 | 84.2 | |
| CREDENCE-allModel=Qwen3-8B2026.06 | 83.9 | |
| CREDENCE-baseModel=Gemma-3-12b2026.06 | 83.9 | |
| CREDENCE-allModel=Gemma-3-12b2026.06 | 83.9 | |
| CREDENCE-baseModel=Phi-3-mini2026.06 | 82.6 | |
| CREDENCE-allModel=Phi-3-mini2026.06 | 82.6 | |
| CREDENCE-allModel=Gemini Flash2026.06 | 81.8 | |
| SpaCy-senterModel=Phi-3-mini2026.06 | 81.4 | |
| SpaCy-senterModel=Qwen3-8B2026.06 | 81.4 | |
| SpaCy-senterModel=Gemma-3-12b2026.06 | 81.4 | |
| SpaCy-senterModel=Gemini Flash2026.06 | 81.4 | |
| FActScore-promptModel=Qwen3-8B2026.06 | 81.2 | |
| CREDENCE-baseModel=Gemini Flash2026.06 | 81.1 | |
| FActScore-promptModel=Gemini Flash2026.06 | 79 | |
| FActScore-promptModel=Phi-3-mini2026.06 | 77.8 | |
| FActScore-promptModel=Gemma-3-12b2026.06 | 77.5 |