Logical Reasoning on KK easy
90AccuracyRL w/ SIE
Evaluation Results
| Method | Links | |
|---|---|---|
| RL w/ SIEModel=Qwen3-8B2025.09 | 90 | |
| CoTModel=Qwen3-8B2025.09 | 79.5 | |
| RL w/ SIEModel=Qwen2.5-7B2025.09 | 52 | |
| RL w/ SIEModel=Qwen2.5-7B-Instruct2025.09 | 49.5 | |
| CoTModel=Qwen2.5-7B-Instruct2025.09 | 42 | |
| CoTModel=Qwen2.5-7B2025.09 | 37.5 | |
| RL w/ SIEModel=Llama3.1-8B-Instruct2025.09 | 37 | |
| CoTModel=Llama3.1-8B-Instruct2025.09 | 20.5 |