Logical Reasoning on BIG-Bench Hard Boolean Expression (OOD)
72.4AccuracyCoT-Decoding
Evaluation results
| Method | Links | |
|---|---|---|
| CoT-DecodingBackbone=mistral-7b2026.05 | 72.4 | |
| LOVERBackbone=mistral-7b2026.05 | 72.4 | |
| Majority VotingBackbone=mistral-7b2026.05 | 61.6 |
| Method | Links | |
|---|---|---|
| CoT-DecodingBackbone=mistral-7b2026.05 | 72.4 | |
| LOVERBackbone=mistral-7b2026.05 | 72.4 | |
| Majority VotingBackbone=mistral-7b2026.05 | 61.6 |