Spatial Reasoning on COCO 2017 (val)
83Alignment AccuracyLLaVA (Group 1 Baseline)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| LLaVA (Group 1 Baseline)Model Scale=1.5-13B2026.01 | 83 | 14 | 31 | |
| LLaVA (Group 2 Baseline)Model Scale=1.5-13B2026.01 | 80 | 14 | 29 | |
| Rotation TextProtocol=Direct2026.01 | 80 | 89 | 87 | |
| Emb. TextProtocol=Direct2026.01 | 75 | 83 | 81 | |
| Rotation TextProtocol=CoT2026.01 | 70 | 86 | 82 | |
| Rotation TokensProtocol=Direct2026.01 | 70 | 89 | 84 | |
| Emb. TextProtocol=CoT2026.01 | 67 | 94 | 88 | |
| Rotation TokensProtocol=CoT2026.01 | 60 | 94 | 87 | |
| Emb. Tokens (COCO)Protocol=Direct2026.01 | 58 | 81 | 75 | |
| Emb. Tokens (COCO)Protocol=CoT2026.01 | 58 | 92 | 83 | |
| Emb. Tokens (ViTPose)Protocol=Direct2026.01 | 58 | 86 | 79 | |
| Emb. Tokens (ViTPose)Protocol=CoT2026.01 | 58 | 83 | 77 |