Verification on SCI-Bench
89.7Mean@3 AccuracyCoSineVerifier-Tool-4B
Evaluation results
| Method | Links | |
|---|---|---|
| CoSineVerifier-Tool-4BVerifier Type=CoT Verifier, Model Access Category=Open-source2025.12 | 89.7 | |
| o3Verifier Type=CoT Verifier, Model Access Category=Closed-source2025.12 | 87.5 | |
| CoSineVerifier-32BVerifier Type=Labeling Verifier2025.12 | 86.4 | |
| GPT-4oVerifier Type=CoT Verifier, Model Access Category=Closed-source2025.12 | 86 | |
| Gemini2.5-FlashVerifier Type=CoT Verifier, Model Access Category=Closed-source2025.12 | 85.9 | |
| CoSineVerifier-4BVerifier Type=Labeling Verifier2025.12 | 85.9 | |
| CompassVerifier-7BVerifier Type=Labeling Verifier2025.12 | 85.7 | |
| CompassVerifier-32B (CoT)Verifier Type=CoT Verifier, Model Access Category=Open-source2025.12 | 85.5 | |
| CompassVerifier-32BVerifier Type=Labeling Verifier2025.12 | 85.3 | |
| GPT-oss-20BVerifier Type=CoT Verifier, Model Access Category=Open-source2025.12 | 85 | |
| LLaMA3.3-70B-InstructVerifier Type=CoT Verifier, Model Access Category=Open-source2025.12 | 84.8 | |
| CompassVerifier-7B (CoT)Verifier Type=CoT Verifier, Model Access Category=Open-source2025.12 | 84.2 | |
| Qwen3-8BVerifier Type=CoT Verifier, Model Access Category=Open-source2025.12 | 83.9 | |
| Qwen3-32BVerifier Type=CoT Verifier, Model Access Category=Open-source2025.12 | 83.5 | |
| Qwen3-235B-A22B-2507Verifier Type=CoT Verifier, Model Access Category=Open-source2025.12 | 82.6 | |
| Qwen3-4B-Instruct-2507Verifier Type=CoT Verifier, Model Access Category=Open-source2025.12 | 82.4 | |
| Qwen3-4BVerifier Type=CoT Verifier, Model Access Category=Open-source2025.12 | 82 | |
| XVerify-8B-IVerifier Type=Labeling Verifier2025.12 | 78.1 |