Code Generation on Truck CAN signal Connected systems
97.8Pass@1DomAgent
Evaluation results
| Method | Links | |
|---|---|---|
| DomAgentBackbone=Qwen2.5-7B, Method Configuration=DomAgent2026.03 | 97.8 | |
| GPT-4o + DomRetrieverBackbone=GPT-4o, Method Configuration=+DomRetriever (Qwen2.5-7B)2026.03 | 97.4 | |
| GPT-4oBackbone=GPT-4o, Method Configuration=Vanilla2026.03 | 73.4 | |
| Qwen2.5-7BBackbone=Qwen2.5-7B, Method Configuration=Vanilla2026.03 | 46.8 |