Error Correction on 300 False Premises
99Isolated CRClaude Sonnet 4.5
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Claude Sonnet 4.52026.05 | 99 | 68.3 | 31 | 92 | |
| Qwen3.5-Plus2026.05 | 98.7 | 79.7 | 19.3 | 57 | |
| Qwen3.5-9B2026.05 | 97 | 52.3 | 46 | 134 | |
| GPT-5.12026.05 | 96.3 | 10 | 89.6 | 259 | |
| LLaMA3.1-8B2026.05 | 96.3 | 50.7 | 47.4 | 137 | |
| DeepSeek-V3.22026.05 | 93.7 | 15 | 84 | 236 | |
| Grok 4.1 Fast2026.05 | 92 | 17.3 | 81.2 | 224 | |
| Gemini 3 Flash2026.05 | 80 | 13.7 | 82.9 | 199 |