# Claim Verification on AVeriTeC Retrieved (I) (dev) Source: [Claim Verification on AVeriTeC Retrieved (I) (dev)]() Collection index: [llms.txt]() Data updated: 2026-04-06T07:09:15.253Z Evaluation of model performance on the development split of the AVeriTeC Retrieved (I) dataset for Claim Verification, reporting Accuracy and AVeriTeC Score. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Claim Verification | | Dataset (including any stated split) | AVeriTeC Retrieved (I) (dev) | | Metric | Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 28 of 28 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy](): Higher is better; unit: PERCENT. - [AVeriTeC Score](): Higher is better; unit: SCALAR. ## Recorded results | Method | Accuracy | Result date | Report paper | | --- | --- | --- | --- | | DebateCV | 73.6 | Not recorded | 68fa7a391e209131cea81e62 | | DebateCV | 72.4 | Not recorded | 68fa7a391e209131cea81e62 | | w/o Ccorrect | 71.6 | Not recorded | 68fa7a391e209131cea81e62 | | w/o Ccorrect | 71.2 | Not recorded | 68fa7a391e209131cea81e62 | | InFact | 68.8 | Not recorded | 68fa7a391e209131cea81e62 | | Cooperation | 68.4 | Not recorded | 68fa7a391e209131cea81e62 | | w/o Cerror | 68.2 | Not recorded | 68fa7a391e209131cea81e62 | | HerO | 67.8 | Not recorded | 68fa7a391e209131cea81e62 | | InFact | 67.4 | Not recorded | 68fa7a391e209131cea81e62 | | Majority | 67.2 | Not recorded | 68fa7a391e209131cea81e62 | | HerO | 66.8 | Not recorded | 68fa7a391e209131cea81e62 | | CoT | 66.6 | Not recorded | 68fa7a391e209131cea81e62 | | w/o Cerror | 66.4 | Not recorded | 68fa7a391e209131cea81e62 | | Majority | 66.2 | Not recorded | 68fa7a391e209131cea81e62 | | Cooperation | 66.2 | Not recorded | 68fa7a391e209131cea81e62 | | w/o Debate-SFT | 66.2 | Not recorded | 68fa7a391e209131cea81e62 | | CoT | 65.8 | Not recorded | 68fa7a391e209131cea81e62 | | CoT | 65.4 | Not recorded | 68fa7a391e209131cea81e62 | | InFact | 65.4 | Not recorded | 68fa7a391e209131cea81e62 | | Majority | 65.4 | Not recorded | 68fa7a391e209131cea81e62 | | InFact | 65.2 | Not recorded | 68fa7a391e209131cea81e62 | | Majority | 65.2 | Not recorded | 68fa7a391e209131cea81e62 | | CoT | 65 | Not recorded | 68fa7a391e209131cea81e62 | | Cooperation | 64.8 | Not recorded | 68fa7a391e209131cea81e62 | | Cooperation | 64.4 | Not recorded | 68fa7a391e209131cea81e62 | | w/o Debate-SFT | 61.2 | Not recorded | 68fa7a391e209131cea81e62 | | w/o Debate-SFT | 56.2 | Not recorded | 68fa7a391e209131cea81e62 | | w/o Debate-SFT | 56 | Not recorded | 68fa7a391e209131cea81e62 | ### DebateCV Accuracy: 73.6. Result ID: 69d35bfd47f34ce924baaf86. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLMs":"Llama-3.1-8B"}. This record does not assert independent reproduction. ### DebateCV Accuracy: 72.4. Result ID: 69d35bfd47f34ce924baaf87. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLMs":"Qwen-2.5-7B"}. This record does not assert independent reproduction. ### w/o Ccorrect Accuracy: 71.6. Result ID: 69d35bfd47f34ce924baaf8a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLMs":"Llama-3.1-8B"}. This record does not assert independent reproduction. ### w/o Ccorrect Accuracy: 71.2. Result ID: 69d35bfd47f34ce924baaf8b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLMs":"Qwen-2.5-7B"}. This record does not assert independent reproduction. ### InFact Accuracy: 68.8. Result ID: 69d35bfd47f34ce924baaf78. [Reporting paper]() Recorded evaluation configuration: {"LLMs":"GPT-4o"}. This record does not assert independent reproduction. ### Cooperation Accuracy: 68.4. Result ID: 69d35bfd47f34ce924baaf82. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLMs":"GPT-4o"}. This record does not assert independent reproduction. ### w/o Cerror Accuracy: 68.2. Result ID: 69d35bfd47f34ce924baaf88. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLMs":"Llama-3.1-8B"}. This record does not assert independent reproduction. ### HerO Accuracy: 67.8. Result ID: 69d35bfd47f34ce924baaf7c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"LLMs":"Llama-3.1-8B"}. This record does not assert independent reproduction. ### InFact Accuracy: 67.4. Result ID: 69d35bfd47f34ce924baaf79. [Reporting paper]() Recorded evaluation configuration: {"LLMs":"GPT-4o-Mini"}. This record does not assert independent reproduction. ### Majority Accuracy: 67.2. Result ID: 69d35bfd47f34ce924baaf7e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLMs":"GPT-4o"}. This record does not assert independent reproduction. ### HerO Accuracy: 66.8. Result ID: 69d35bfd47f34ce924baaf7d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"LLMs":"Qwen-2.5-7B"}. This record does not assert independent reproduction. ### CoT Accuracy: 66.6. Result ID: 69d35bfd47f34ce924baaf74. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLMs":"GPT-4o"}. This record does not assert independent reproduction. ### w/o Cerror Accuracy: 66.4. Result ID: 69d35bfd47f34ce924baaf89. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLMs":"Qwen-2.5-7B"}. This record does not assert independent reproduction. ### Majority Accuracy: 66.2. Result ID: 69d35bfd47f34ce924baaf7f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLMs":"GPT-4o-Mini"}. This record does not assert independent reproduction. ### Cooperation Accuracy: 66.2. Result ID: 69d35bfd47f34ce924baaf83. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLMs":"GPT-4o-Mini"}. This record does not assert independent reproduction. ### w/o Debate-SFT Accuracy: 66.2. Result ID: 69d35bfd47f34ce924baaf8c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLMs":"GPT-4o"}. This record does not assert independent reproduction. ### CoT Accuracy: 65.8. Result ID: 69d35bfd47f34ce924baaf75. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLMs":"GPT-4o-Mini"}. This record does not assert independent reproduction. ### CoT Accuracy: 65.4. Result ID: 69d35bfd47f34ce924baaf77. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLMs":"Qwen-2.5-7B"}. This record does not assert independent reproduction. ### InFact Accuracy: 65.4. Result ID: 69d35bfd47f34ce924baaf7b. [Reporting paper]() Recorded evaluation configuration: {"LLMs":"Qwen-2.5-7B"}. This record does not assert independent reproduction. ### Majority Accuracy: 65.4. Result ID: 69d35bfd47f34ce924baaf81. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLMs":"Qwen-2.5-7B"}. This record does not assert independent reproduction. ### InFact Accuracy: 65.2. Result ID: 69d35bfd47f34ce924baaf7a. [Reporting paper]() Recorded evaluation configuration: {"LLMs":"Llama-3.1-8B"}. This record does not assert independent reproduction. ### Majority Accuracy: 65.2. Result ID: 69d35bfd47f34ce924baaf80. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLMs":"Llama-3.1-8B"}. This record does not assert independent reproduction. ### CoT Accuracy: 65. Result ID: 69d35bfd47f34ce924baaf76. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLMs":"Llama-3.1-8B"}. This record does not assert independent reproduction. ### Cooperation Accuracy: 64.8. Result ID: 69d35bfd47f34ce924baaf84. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLMs":"Llama-3.1-8B"}. This record does not assert independent reproduction. ### Cooperation Accuracy: 64.4. Result ID: 69d35bfd47f34ce924baaf85. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLMs":"Qwen-2.5-7B"}. This record does not assert independent reproduction. ### w/o Debate-SFT Accuracy: 61.2. Result ID: 69d35bfd47f34ce924baaf8d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLMs":"GPT-4o-Mini"}. This record does not assert independent reproduction. ### w/o Debate-SFT Accuracy: 56.2. Result ID: 69d35bfd47f34ce924baaf8e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLMs":"Llama-3.1-8B"}. This record does not assert independent reproduction. ### w/o Debate-SFT Accuracy: 56. Result ID: 69d35bfd47f34ce924baaf8f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLMs":"Qwen-2.5-7B"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.