Tracking Shuffled Objects on Tracking Shuffled Objects 5 objects (test)
94.1Accuracy (TSO 5-obj)TextReg
Evaluation results
| Method | Links | |
|---|---|---|
| TextRegTest Engine=Phi-3.5-Mini-Instruct2026.05 | 94.1 | |
| CoTTest Engine=Phi-3.5-Mini-Instruct2026.05 | 89.6 | |
| REVOLVETest Engine=Phi-3.5-Mini-Instruct2026.05 | 86.8 | |
| TextGradTest Engine=Phi-3.5-Mini-Instruct2026.05 | 83.6 | |
| TextRegTest Engine=Llama-3.1-8B-Instruct2026.05 | 79.7 | |
| REVOLVETest Engine=Llama-3.1-8B-Instruct2026.05 | 76 | |
| TextGradTest Engine=Llama-3.1-8B-Instruct2026.05 | 69.7 | |
| CoTTest Engine=Llama-3.1-8B-Instruct2026.05 | 58.8 | |
| TextRegTest Engine=Llama-3-8B-Instruct2026.05 | 54.3 | |
| REVOLVETest Engine=Llama-3-8B-Instruct2026.05 | 46.1 | |
| TextGradTest Engine=Llama-3-8B-Instruct2026.05 | 45.9 | |
| TextRegTest Engine=Qwen2-7B-Instruct2026.05 | 45.4 | |
| CoTTest Engine=Qwen2-7B-Instruct2026.05 | 42 | |
| REVOLVETest Engine=Qwen2-7B-Instruct2026.05 | 40.3 | |
| TextGradTest Engine=Qwen2-7B-Instruct2026.05 | 38.2 | |
| CoTTest Engine=Llama-3-8B-Instruct2026.05 | 35.6 |