Embodied Multi-step Decision-making and Interactive Control on ALFWorld
90.9Success RateCloud-only
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Cloud-onlyCloud model=Qwen-Max2026.05 | 90.9 | 11.7 | 174.1 | |
| HeraRouting method=Dynamic routing, Backbone=Qwen2.5-0.5B2026.05 | 86.1 | 4 | 105.5 | |
| FrugalGPTRouting method=Dynamic routing2026.05 | 83.7 | 8.7 | 203.7 | |
| RouteLLMRouting method=Dynamic routing2026.05 | 83.6 | 9 | 156.7 | |
| EagleRouting method=Dynamic routing2026.05 | 80.3 | 8.5 | 178.5 | |
| Hybrid LLMRouting method=Dynamic routing2026.05 | 79.3 | 7.9 | 130.2 | |
| Rand. (0.5)Routing method=Stochastic step-level routing, Routing probability=0.52026.05 | 79.1 | 8.9 | 169.5 | |
| Rand. (0.4)Routing method=Stochastic step-level routing, Routing probability=0.42026.05 | 77.9 | 7.2 | 148.1 | |
| Rand. (0.3)Routing method=Stochastic step-level routing, Routing probability=0.32026.05 | 72.1 | 6.1 | 157.6 | |
| Device-onlyOn-device model=Qwen2.5-7B-Instruct2026.05 | 48.6 | 0 | 123 |