Claim Verification on AmbiguousSnopes
39PrecisionCO-FACTCHECKER
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| CO-FACTCHECKERSystem Category=Simulated Human-AI Collaboration, Oracle Simulation=Using an Oracle2026.04 | 39 | 27 | 25 | 19 | 87 | 32 | |
| Multi-Turn DialogueSystem Category=Simulated Human-AI Collaboration, Oracle Simulation=Using an Oracle2026.04 | 37 | 24 | 23 | 16 | 84 | 24 | |
| CO-FACTCHECKER - w/o reward modelSystem Category=Simulated Human-AI Collaboration, Oracle Simulation=Using an Oracle, Ablation Setting=w/o reward model2026.04 | 37 | 25 | 23 | 17 | 87 | 30 | |
| CO-FACTCHECKER - w/o remove / modifySystem Category=Simulated Human-AI Collaboration, Oracle Simulation=Using an Oracle, Ablation Setting=w/o remove / modify2026.04 | 37 | 24 | 23 | 18 | 86 | 28 | |
| VerifierSystem Category=Autonomous2026.04 | 35 | 26 | 21 | 18 | 86 | 27 | |
| Verifier - best-of-NSystem Category=Autonomous, Search/Refinement Strategy=best-of-N2026.04 | 35 | 27 | 21 | 18 | 86 | 28 | |
| Verifier - self-refineSystem Category=Autonomous, Search/Refinement Strategy=self-refine2026.04 | 35 | 24 | 21 | 17 | 85 | 23 | |
| Verifier - MCTSSystem Category=Autonomous, Search/Refinement Strategy=MCTS2026.04 | 35 | 25 | 23 | 19 | 86 | 29 | |
| Choose OneSystem Category=Simulated Human-AI Collaboration, Oracle Simulation=Using an Oracle2026.04 | 35 | 26 | 21 | 19 | 86 | 27 | |
| CO-FACTCHECKER - w/o guidance tokensSystem Category=Simulated Human-AI Collaboration, Oracle Simulation=Using an Oracle, Ablation Setting=w/o guidance tokens2026.04 | 33 | 24 | 23 | 17 | 86 | 31 | |
| FIRESystem Category=Autonomous2026.04 | 31 | 26 | 18 | 18 | 86 | 26 | |
| SAFESystem Category=Autonomous2026.04 | 31 | 27 | 18 | 19 | 86 | 26 | |
| Deep ResearchSystem Category=Autonomous2026.04 | 26 | 29 | 19 | 14 | 83 | — | |
| FactCheckGPTSystem Category=Autonomous2026.04 | 25 | 18 | 15 | 18 | 87 | 26 |