Binary decision on TODAY
75.8AccuracyCoT
Evaluation results
| Method | Links | |
|---|---|---|
| CoTModel=GPT-5.22026.04 | 75.8 | |
| IDEAModel=Qwen-3-32B2026.04 | 75 | |
| IDEA w/o EMModel=Qwen-3-32B2026.04 | 74.2 | |
| IDEA w/o InterModel=Qwen-3-32B2026.04 | 73.5 | |
| BIRDModel=Qwen-3-8B2026.04 | 72.4 | |
| BIRDModel=Qwen-3-4B2026.04 | 71.4 | |
| IDEAModel=Qwen-3-8B2026.04 | 71.4 | |
| BIRDModel=Qwen-3-32B2026.04 | 71 | |
| IDEAModel=Qwen-3-4B2026.04 | 70.7 | |
| VanillaModel=Qwen-3-8B2026.04 | 70.7 | |
| IDEA w/o InterModel=Qwen-3-8B2026.04 | 70.6 | |
| VanillaModel=Qwen-3-4B2026.04 | 70.4 | |
| VanillaModel=Qwen-3-32B2026.04 | 70.3 | |
| LogitModel=Qwen-3-4B2026.04 | 70.2 | |
| LogitModel=Qwen-3-8B2026.04 | 70.2 | |
| IDEA w/o MCModel=Qwen-3-8B2026.04 | 69.4 | |
| LogitModel=Qwen-3-32B2026.04 | 69.4 | |
| IDEA w/o MCModel=Qwen-3-32B2026.04 | 68.8 | |
| IDEA w/o InterModel=Qwen-3-4B2026.04 | 68.6 | |
| IDEA w/o MCModel=Qwen-3-4B2026.04 | 68.5 | |
| IDEA w/o EMModel=Qwen-3-8B2026.04 | 68.3 | |
| CoTModel=Qwen-3-4B2026.04 | 68.1 | |
| IDEA w/o EMModel=Qwen-3-4B2026.04 | 68.1 | |
| CoTModel=DeepSeek R12026.04 | 67.7 | |
| CoTModel=Qwen-3-32B2026.04 | 67.3 | |
| CoTModel=Qwen-3-8B2026.04 | 66.8 | |
| RandomModel=N/A2026.04 | 50 |