Constrained Path Planning on Textualized Gridworld Safe targets (test)
15.2Success RateSAE-opt
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SAE-optModel=Qwen3-4B-Instruct2026.05 | 15.2 | 20.1 | |
| Dense-optModel=Qwen3-4B-Instruct2026.05 | 14.8 | 23.5 | |
| SAE-opt-anchModel=Qwen3-4B-Instruct2026.05 | 14.5 | 27 | |
| SAE-SSVModel=Qwen3-4B-Instruct2026.05 | 14.2 | 23.4 | |
| SAE-optModel=Phi-3-Mini-4K-Instruct2026.05 | 10.4 | 52.3 | |
| SAE-SSVModel=Phi-3-Mini-4K-Instruct2026.05 | 9.6 | 55.8 | |
| SAE-optModel=LLaMA3.1-8B-Instruct2026.05 | 9.6 | 43 | |
| Dense-optModel=Phi-3-Mini-4K-Instruct2026.05 | 9.4 | 55 | |
| Dense-optModel=LLaMA3.1-8B-Instruct2026.05 | 9.3 | 45.8 | |
| ITIModel=Qwen3-4B-Instruct2026.05 | 9.2 | 18.3 | |
| SAE-opt-anchModel=Phi-3-Mini-4K-Instruct2026.05 | 9.1 | 57 | |
| CAAModel=Phi-3-Mini-4K-Instruct2026.05 | 8.7 | 38.9 | |
| SAE-SSVModel=LLaMA3.1-8B-Instruct2026.05 | 7.9 | 47.5 | |
| SAE-opt-anchModel=LLaMA3.1-8B-Instruct2026.05 | 7.1 | 47.4 | |
| ITIModel=LLaMA3.1-8B-Instruct2026.05 | 6.4 | 65.9 | |
| ITIModel=Phi-3-Mini-4K-Instruct2026.05 | 4.7 | 48.5 | |
| CAAModel=Qwen3-4B-Instruct2026.05 | 4.2 | 39.6 | |
| CAAModel=LLaMA3.1-8B-Instruct2026.05 | 4.2 | 39.6 | |
| ICLModel=Qwen3-4B-Instruct2026.05 | 3.7 | 55.5 | |
| ICLModel=Phi-3-Mini-4K-Instruct2026.05 | 3.3 | 76 | |
| ICLModel=LLaMA3.1-8B-Instruct2026.05 | 2.7 | 51.2 |