Compiler Optimization on cbench
0.3519I_O3ECCO
Evaluation results
| Method | Links | |
|---|---|---|
| ECCOBackbone=Qwen2.5-7B, Sampling Strategy=Best-of-322026.01 | 0.3519 | |
| GRACESearch Strategy=Traditional Search Heuristic2026.01 | 0.3408 | |
| PDCATSearch Strategy=Traditional Search Heuristic2026.01 | 0.3175 | |
| OpenTunerSearch Strategy=Traditional Search Heuristic2026.01 | 0.3168 | |
| CompTunerSearch Strategy=Traditional Search Heuristic2026.01 | 0.3157 | |
| CFASTSearch Strategy=Traditional Search Heuristic2026.01 | 0.3108 | |
| RIOSearch Strategy=Traditional Search Heuristic2026.01 | 0.3056 | |
| GASearch Strategy=Traditional Search Heuristic2026.01 | 0.303 | |
| TPESearch Strategy=Traditional Search Heuristic2026.01 | 0.286 | |
| DeepSeek-V3.2Search Strategy=Direct LLM Prompting, Sampling Strategy=Best-of-322026.01 | 0.2816 | |
| Qwen3-CoderSearch Strategy=Direct LLM Prompting, Sampling Strategy=Best-of-322026.01 | 0.2711 | |
| GPT5-chatSearch Strategy=Direct LLM Prompting, Sampling Strategy=Best-of-322026.01 | 0.263 | |
| Kimi-K2Search Strategy=Direct LLM Prompting, Sampling Strategy=Best-of-322026.01 | 0.249 |