Claim Verification on FinDVer mini (test)
76AccuracyQwen-2.5
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen-2.5Parameters=72B2026.04 | 76 | |
| MACEBackbone=Qw-235B, Components=Pm + Em2026.04 | 76 | |
| Llama-3.1Parameters=70B2026.04 | 75 | |
| Mistral-LargeParameters=123B2026.04 | 75 | |
| GPT-4o2026.04 | 75 | |
| MACEBackbone=Qw-72B, Components=Pm + Em + Vm2026.04 | 75 | |
| Claude-3.5-Sonnet2026.04 | 73 | |
| Qwen-2.52026.04 | 72 | |
| Gemini-1.5-Pro2026.04 | 71 | |
| MACEBackbone=Ll-8B, Components=Pm + Em + Vm'2026.04 | 68 | |
| MACEBackbone=Mt-7B, Components=Pm + Em + Vm'2026.04 | 64 | |
| DeepSeek-V2-Lite2026.04 | 60 |