Constrained Path Planning on Textualized Gridworld Long targets (test)
8.4Success RateSAE-opt
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SAE-optModel=Qwen3-4B-Instruct2026.05 | 8.4 | 21.6 | |
| SAE-SSVModel=Qwen3-4B-Instruct2026.05 | 8.2 | 24.4 | |
| Dense-optModel=Qwen3-4B-Instruct2026.05 | 7.8 | 24.7 | |
| SAE-opt-anchModel=Qwen3-4B-Instruct2026.05 | 7.4 | 18.9 | |
| ITIModel=Qwen3-4B-Instruct2026.05 | 6.5 | 19.2 | |
| SAE-optModel=LLaMA3.1-8B-Instruct2026.05 | 5.9 | 42.2 | |
| CAAModel=Qwen3-4B-Instruct2026.05 | 5.6 | 19.9 | |
| SAE-optModel=Phi-3-Mini-4K-Instruct2026.05 | 5.2 | 52.2 | |
| Dense-optModel=LLaMA3.1-8B-Instruct2026.05 | 5 | 48.8 | |
| CAAModel=Phi-3-Mini-4K-Instruct2026.05 | 4.9 | 38.2 | |
| SAE-SSVModel=Phi-3-Mini-4K-Instruct2026.05 | 4.9 | 55.8 | |
| Dense-optModel=Phi-3-Mini-4K-Instruct2026.05 | 4.9 | 55.6 | |
| SAE-opt-anchModel=LLaMA3.1-8B-Instruct2026.05 | 4.9 | 47 | |
| SAE-SSVModel=LLaMA3.1-8B-Instruct2026.05 | 4.8 | 48.8 | |
| CAAModel=LLaMA3.1-8B-Instruct2026.05 | 4.1 | 33.9 | |
| ITIModel=LLaMA3.1-8B-Instruct2026.05 | 4 | 43.7 | |
| SAE-opt-anchModel=Phi-3-Mini-4K-Instruct2026.05 | 4 | 55.5 | |
| ITIModel=Phi-3-Mini-4K-Instruct2026.05 | 3.3 | 40.3 | |
| ICLModel=Qwen3-4B-Instruct2026.05 | 3.2 | 76 | |
| ICLModel=LLaMA3.1-8B-Instruct2026.05 | 3.2 | 62.2 | |
| ICLModel=Phi-3-Mini-4K-Instruct2026.05 | 2.9 | 89.1 |