Code Generation on LiveCodeBench v5 (Pass@1)
61.5Pass@1ESamp
Evaluation Results
| Method | Links | |
|---|---|---|
| ESampModel=GPT-OSS-20B, Context Length=163842026.04 | 61.5 | |
| OverRIDEModel=GPT-OSS-20B, Context Length=163842026.04 | 57.6 | |
| Min-pModel=GPT-OSS-20B, Context Length=163842026.04 | 52.5 | |
| VanillaModel=GPT-OSS-20B, Context Length=163842026.04 | 52.2 | |
| ESampModel=GPT-OSS-20B, Context Length=40962026.04 | 51.8 | |
| FIREModel=GPT-OSS-20B, Context Length=163842026.04 | 51.2 | |
| Min-pModel=GPT-OSS-20B, Context Length=40962026.04 | 45.4 | |
| FIREModel=GPT-OSS-20B, Context Length=40962026.04 | 45.2 | |
| OverRIDEModel=GPT-OSS-20B, Context Length=40962026.04 | 44.6 | |
| VanillaModel=GPT-OSS-20B, Context Length=40962026.04 | 43.4 | |
| PriFT-massBackbone=Qwen3-4B-Instruct2026.06 | 39.89 | |
| PriFT-probBackbone=Qwen3-4B-Instruct2026.06 | 39.32 | |
| OriginalBackbone=Qwen3-4B-Instruct2026.06 | 30.45 | |
| ASFTBackbone=Qwen3-4B-Instruct2026.06 | 28.64 | |
| IDFTBackbone=Qwen3-4B-Instruct2026.06 | 26.14 | |
| TALRBackbone=Qwen3-4B-Instruct2026.06 | 25 | |
| DFTBackbone=Qwen3-4B-Instruct2026.06 | 24.32 | |
| EAFTBackbone=Qwen3-4B-Instruct2026.06 | 23.86 | |
| ESampModel=Qwen3-8B, Context Length=163842026.04 | 22.6 | |
| SFTBackbone=Qwen3-4B-Instruct2026.06 | 22.39 | |
| OverRIDEModel=Qwen3-8B, Context Length=163842026.04 | 20.7 | |
| Min-pModel=Qwen3-8B, Context Length=163842026.04 | 19.3 | |
| VanillaModel=Qwen3-8B, Context Length=163842026.04 | 19.2 | |
| FIREModel=Qwen3-8B, Context Length=163842026.04 | 18.3 | |
| OverRIDEModel=Qwen2.5-7B, Context Length=163842026.04 | 13.6 | |
| OverRIDEModel=Qwen2.5-7B, Context Length=40962026.04 | 13.6 | |
| Min-pModel=Qwen2.5-7B, Context Length=163842026.04 | 13.5 | |
| Min-pModel=Qwen2.5-7B, Context Length=40962026.04 | 13.5 | |
| ESampModel=Qwen2.5-7B, Context Length=163842026.04 | 13.1 | |
| ESampModel=Qwen2.5-7B, Context Length=40962026.04 | 13.1 | |
| VanillaModel=Qwen2.5-7B, Context Length=163842026.04 | 13 | |
| VanillaModel=Qwen2.5-7B, Context Length=40962026.04 | 13 | |
| FIREModel=Qwen2.5-7B, Context Length=163842026.04 | 12.9 | |
| FIREModel=Qwen2.5-7B, Context Length=40962026.04 | 12.9 | |
| ESampModel=Qwen3-8B, Context Length=40962026.04 | 12 | |
| FIREModel=Qwen3-8B, Context Length=40962026.04 | 11 | |
| OverRIDEModel=Qwen3-8B, Context Length=40962026.04 | 10.3 | |
| VanillaModel=Qwen3-8B, Context Length=40962026.04 | 10 | |
| Min-pModel=Qwen3-8B, Context Length=40962026.04 | 10 |