Claim Verification on SciTab-OD
77Macro F1Llama-400B
Evaluation results
| Method | Links | |
|---|---|---|
| Llama-400BReasoning=w COT2026.04 | 77 | |
| MACEBackbone=Qw-235B, Configuration=Pm + Em + Vm2026.04 | 76 | |
| Llama-70BReasoning=w COT2026.04 | 74 | |
| Qwen-235BReasoning=w COT2026.04 | 74 | |
| DeepSeek-V3.1Reasoning=w COT2026.04 | 74 | |
| DeepSeek-70BReasoning=wo COT2026.04 | 73 | |
| Llama-400BReasoning=wo COT2026.04 | 73 | |
| DeepSeek-70BReasoning=w COT2026.04 | 72 | |
| Qwen-72BReasoning=w COT2026.04 | 72 | |
| GPT-4oReasoning=w COT2026.04 | 71 | |
| Claude-3.5-SonnetReasoning=w COT2026.04 | 71 | |
| Claude-3.5-SonnetReasoning=wo COT2026.04 | 71 | |
| MACEBackbone=Qw-72B, Configuration=Pm + Em + Vm2026.04 | 71 | |
| Qwen-72BReasoning=wo COT2026.04 | 69 | |
| Gemma-12BReasoning=w COT2026.04 | 68 | |
| Qwen-235BReasoning=wo COT2026.04 | 68 | |
| MACEBackbone=Ll-8B, Configuration=Pm + Em + Vm'2026.04 | 66 | |
| Mistral-7BReasoning=w COT2026.04 | 65 | |
| Llama-70BReasoning=wo COT2026.04 | 65 | |
| Gemma-12BReasoning=wo COT2026.04 | 64 | |
| GPT-4oReasoning=wo COT2026.04 | 60 | |
| MACEBackbone=Mt-7B, Configuration=Pm + Em + Vm'2026.04 | 60 | |
| Llama-8BReasoning=wo COT2026.04 | 59 | |
| Mistral-7BReasoning=wo COT2026.04 | 58 | |
| Llama-3BReasoning=w COT2026.04 | 57 | |
| Llama-8BReasoning=w COT2026.04 | 56 | |
| DeepSeek-V3.1Reasoning=wo COT2026.04 | 56 | |
| Llama-3BReasoning=wo COT2026.04 | 37 |