Spatial Reasoning on BIG-Bench Hard Navigate (OOD)
57.6AccuracyLOVER
Evaluation Results
| Method | Links | |
|---|---|---|
| LOVERBackbone=mistral-7b2026.05 | 57.6 | |
| CoT-DecodingBackbone=mistral-7b2026.05 | 57.2 | |
| Majority VotingBackbone=mistral-7b2026.05 | 49.6 |
Loading the SOTA2 catalog…