Spatial Reasoning on bAbI Task 1 qa1 50 samples
19AccuracyCoS
Evaluation results
| Method | Links | |
|---|---|---|
| CoSfeature=symbolic state tracking2026.02 | 19 | |
| Self-Consistencytemperature=0.7, k=52026.02 | 11.5 | |
| Directtemperature=02026.02 | 11 | |
| Chain-of-Thoughttemperature=02026.02 | 10 | |
| Structured CoTtemperature=02026.02 | 10 |