Embodied Task on Embodied
100AccuracyLlama-3.2-1B-Instruct
Evaluation results
| Method | Links | |
|---|---|---|
| Llama-3.2-1B-InstructInput Type=Clean, Execution Mode=Eager, Backend=Inductor2026.05 | 100 | |
| Llama-3.2-1B-InstructInput Type=Clean, Execution Mode=Compiled, Backend=Inductor2026.05 | 100 | |
| Llama-3.2-3B-InstructInput Type=Clean, Execution Mode=Eager, Backend=Inductor2026.05 | 100 | |
| Llama-3.2-3B-InstructInput Type=Clean, Execution Mode=Compiled, Backend=Inductor2026.05 | 100 | |
| Llama-3.2-3B-InstructInput Type=Trigger, Execution Mode=Eager, Backend=Inductor2026.05 | 100 | |
| Qwen2.5-1.5B-InstructInput Type=Clean, Execution Mode=Eager, Backend=Inductor2026.05 | 100 | |
| Qwen2.5-1.5B-InstructInput Type=Clean, Execution Mode=Compiled, Backend=Inductor2026.05 | 100 | |
| Qwen2.5-3B-InstructInput Type=Clean, Execution Mode=Eager, Backend=Inductor2026.05 | 100 | |
| Qwen2.5-3B-InstructInput Type=Clean, Execution Mode=Compiled, Backend=Inductor2026.05 | 100 | |
| Qwen2.5-3B-InstructInput Type=Trigger, Execution Mode=Eager, Backend=Inductor2026.05 | 100 | |
| Llama-3.2-1B-InstructInput Type=Trigger, Execution Mode=Compiled, Backend=Inductor2026.05 | 98.8 | |
| Qwen2.5-1.5B-InstructInput Type=Trigger, Execution Mode=Eager, Backend=Inductor2026.05 | 96.3 | |
| Llama-3.2-1B-InstructInput Type=Trigger, Execution Mode=Eager, Backend=Inductor2026.05 | 93.8 | |
| Llama-3.2-3B-InstructInput Type=Trigger, Execution Mode=Compiled, Backend=Inductor2026.05 | 92.5 | |
| Qwen2.5-3B-InstructInput Type=Trigger, Execution Mode=Compiled, Backend=Inductor2026.05 | 91.2 | |
| Qwen2.5-1.5B-InstructInput Type=Trigger, Execution Mode=Compiled, Backend=Inductor2026.05 | 86.3 |