Binary decision on COMMON2SENSE
95.1AccuracyIDEA
Evaluation results
| Method | Links | |
|---|---|---|
| IDEAModel=Qwen-3-32B2026.04 | 95.1 | |
| CoTModel=GPT-5.22026.04 | 95 | |
| IDEAModel=Qwen-3-8B2026.04 | 94.8 | |
| IDEA w/o MCModel=Qwen-3-32B2026.04 | 94.7 | |
| CoTModel=Qwen-3-4B2026.04 | 94.2 | |
| CoTModel=Qwen-3-8B2026.04 | 93.9 | |
| IDEA w/o EMModel=Qwen-3-32B2026.04 | 93.5 | |
| IDEAModel=Qwen-3-4B2026.04 | 93.1 | |
| IDEA w/o InterModel=Qwen-3-4B2026.04 | 93 | |
| IDEA w/o InterModel=Qwen-3-8B2026.04 | 93 | |
| VanillaModel=Qwen-3-32B2026.04 | 93 | |
| IDEA w/o InterModel=Qwen-3-32B2026.04 | 92.4 | |
| VanillaModel=Qwen-3-8B2026.04 | 91.9 | |
| IDEA w/o EMModel=Qwen-3-4B2026.04 | 91.8 | |
| VanillaModel=Qwen-3-4B2026.04 | 91.7 | |
| BIRDModel=Qwen-3-32B2026.04 | 91.7 | |
| LogitModel=Qwen-3-32B2026.04 | 91.5 | |
| LogitModel=Qwen-3-8B2026.04 | 91.3 | |
| BIRDModel=Qwen-3-8B2026.04 | 91.3 | |
| CoTModel=Qwen-3-32B2026.04 | 90.3 | |
| IDEA w/o EMModel=Qwen-3-8B2026.04 | 89.4 | |
| IDEA w/o MCModel=Qwen-3-8B2026.04 | 89.2 | |
| LogitModel=Qwen-3-4B2026.04 | 88.8 | |
| CoTModel=DeepSeek R12026.04 | 88.7 | |
| IDEA w/o MCModel=Qwen-3-4B2026.04 | 88.7 | |
| BIRDModel=Qwen-3-4B2026.04 | 88 | |
| RandomModel=N/A2026.04 | 50 |