Logical Reasoning on BIG-Bench Hard Web of Lies (OOD)
44.8AccuracyLOVER
Evaluation Results
| Method | Links | |
|---|---|---|
| LOVERBackbone=mistral-7b2026.05 | 44.8 | |
| CoT-DecodingBackbone=mistral-7b2026.05 | 39.6 | |
| Majority VotingBackbone=mistral-7b2026.05 | 25.6 |
Loading the SOTA2 catalog…