Code Generation on Truck CAN signal (Dynamics)
96.4Pass@1GPT-4o + DomRetriever
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-4o + DomRetrieverBackbone=GPT-4o, Method Configuration=+DomRetriever (Qwen2.5-7B)2026.03 | 96.4 | |
| DomAgentBackbone=Qwen2.5-7B, Method Configuration=DomAgent2026.03 | 91.4 | |
| GPT-4oBackbone=GPT-4o, Method Configuration=Vanilla2026.03 | 75.5 | |
| Qwen2.5-7BBackbone=Qwen2.5-7B, Method Configuration=Vanilla2026.03 | 39.8 |