Kernel Tuning on UnixBench
3,331.5CPU ScoreTuneAgent-7B
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| TuneAgent-7BParameters=7B2025.08 | 3,331.5 | 326.2 | 1,209.3 | 505.7 | 1,044.5 | 209.2 | 199.6 | 662.2 | |
| Qwen2.5-7B-InstructParameters=7B, Type=Instruct2025.08 | 3,318.8 | 329.2 | 1,185.8 | 494.1 | 1,044.9 | 207.9 | 190.5 | 619.6 | |
| AutoOS2025.08 | 3,315.7 | 290.8 | 1,166.5 | 439.4 | 1,022.4 | 208.3 | 193.8 | 638.8 | |
| TuneAgent-3BParameters=3B2025.08 | 3,296.9 | 328.8 | 1,184.2 | 489 | 1,036.5 | 204.3 | 188.2 | 643.8 | |
| GPT-4o2025.08 | 3,264.1 | 326 | 1,201.8 | 512.3 | 1,051.7 | 194.6 | 201.1 | 632.9 | |
| o3-mini2025.08 | 3,213.4 | 333.9 | 1,176.1 | 471.5 | 789.2 | 179.5 | 189.3 | 598.3 | |
| Qwen2.5-3B-InstructParameters=3B, Type=Instruct2025.08 | 3,211.7 | 317.7 | 1,143.6 | 457.7 | 1,011 | 189 | 183.8 | 615.4 | |
| DeepSeek-R12025.08 | 3,200.3 | 337.1 | 1,047.2 | 464.9 | 1,083.9 | 256.6 | 189 | 650.5 | |
| GPT-4o-mini2025.08 | 3,147.9 | 323.1 | 1,173.5 | 509.9 | 1,036.9 | 190.4 | 182.4 | 631.8 | |
| Heuristic (Default)Mode=Default2025.08 | 3,074.4 | 316.5 | 1,123.9 | 427.9 | 1,091.5 | 178.8 | 187.3 | 627.2 |