Compiler Optimization on chstone
35.5I_O3ECCO
Evaluation Results
| Method | Links | |
|---|---|---|
| ECCOBackbone=Qwen2.5-7B, Sampling Strategy=Best-of-322026.01 | 35.5 | |
| GRACESearch Strategy=Traditional Search Heuristic2026.01 | 32.95 | |
| DeepSeek-V3.2Search Strategy=Direct LLM Prompting, Sampling Strategy=Best-of-322026.01 | 29.7 | |
| CFASTSearch Strategy=Traditional Search Heuristic2026.01 | 28.87 | |
| Kimi-K2Search Strategy=Direct LLM Prompting, Sampling Strategy=Best-of-322026.01 | 28.85 | |
| Qwen3-CoderSearch Strategy=Direct LLM Prompting, Sampling Strategy=Best-of-322026.01 | 27.88 | |
| CompTunerSearch Strategy=Traditional Search Heuristic2026.01 | 27.87 | |
| PDCATSearch Strategy=Traditional Search Heuristic2026.01 | 27.84 | |
| GPT5-chatSearch Strategy=Direct LLM Prompting, Sampling Strategy=Best-of-322026.01 | 27.61 | |
| RIOSearch Strategy=Traditional Search Heuristic2026.01 | 27.07 | |
| GASearch Strategy=Traditional Search Heuristic2026.01 | 27.07 | |
| OpenTunerSearch Strategy=Traditional Search Heuristic2026.01 | 27.03 | |
| TPESearch Strategy=Traditional Search Heuristic2026.01 | 26.07 |