UAV Code Generation on PX4 controller in Gazebo
93.3SRSemantic
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SemanticLLM Model=o4-mini2025.12 | 93.3 | 98.6 | |
| LLM-driven corrective robot operation code generation frameworkLLM Model=o4-mini2025.12 | 93.3 | 96.9 | |
| SemanticLLM Model=o3-mini2025.12 | 88.3 | 98.3 | |
| LLM-driven corrective robot operation code generation frameworkLLM Model=o3-mini2025.12 | 86.7 | 97.7 | |
| NumericalLLM Model=o4-mini2025.12 | 86.7 | 96.9 | |
| NumericalLLM Model=o3-mini2025.12 | 83.3 | 97.1 | |
| DirectLLM Model=o3-mini2025.12 | 55 | 77.5 | |
| DirectLLM Model=o4-mini2025.12 | 25 | 50.9 |