Code Generation on HumanEval (Generic Score)
91.56ScoreEAPO
Evaluation Results
| Method | Links | |
|---|---|---|
| EAPO2025.09 | 91.56 | |
| Self-Exploratory RL2025.09 | 89.34 | |
| Base Model2025.09 | 86.79 | |
| Entropy-Cut MHModel=Qwen3-8B-Base2026.05 | 79.3 | |
| SMCModel=Qwen3-8B-Base2026.05 | 76.7 | |
| Uniform-Cut MHModel=Qwen3-8B-Base2026.05 | 75.8 | |
| TMCModel=Qwen3-8B-Base2026.05 | 75.2 | |
| Low-TemperatureModel=Qwen3-8B-Base2026.05 | 73.7 | |
| Entropy-Cut MHModel=Qwen2.5-7B2026.05 | 68.9 | |
| Entropy-Cut MHModel=Phi-4-mini-instruct2026.05 | 68.4 | |
| Uniform-Cut MHModel=Phi-4-mini-instruct2026.05 | 67.9 | |
| Uniform-Cut MHModel=Qwen2.5-7B2026.05 | 66.8 | |
| SMCModel=Phi-4-mini-instruct2026.05 | 66.7 | |
| TMCModel=Qwen2.5-7B2026.05 | 66.2 | |
| TMCModel=Phi-4-mini-instruct2026.05 | 66.1 | |
| TMCModel=Phi-3.5-mini-instruct2026.05 | 65.6 | |
| Entropy-Cut MHModel=Phi-3.5-mini-instruct2026.05 | 65.6 | |
| Low-TemperatureModel=Phi-4-mini-instruct2026.05 | 65.5 | |
| Task ArithmeticModel Scale=Llama-3.1-8B, Quantization Bit-width=Full-precision, Merging Algorithm=Task Arithmetic2026.05 | 65.24 | |
| SMCModel=Phi-3.5-mini-instruct2026.05 | 65.2 | |
| SMCModel=Qwen2.5-7B2026.05 | 64.9 | |
| Uniform-Cut MHModel=Phi-3.5-mini-instruct2026.05 | 64.9 | |
| Low-TemperatureModel=Qwen2.5-7B2026.05 | 64.3 | |
| OriginalBlock length B=642026.06 | 62.8 | |
| RainbowPaddingBlock length B=642026.06 | 62.8 | |
| Low-TemperatureModel=Phi-3.5-mini-instruct2026.05 | 62.2 | |
| DreamEnsemble Type=Single Model2026.06 | 61.59 | |
| TRACE-CSBackbone=LLaMA3-8B2026.05 | 61 | |
| E-PMQModel Scale=Llama-3.1-8B, Quantization Bit-width=4-bit, Merging Algorithm=Task Arithmetic2026.05 | 60.98 | |
| OriginalBlock length B=1282026.06 | 60.37 | |
| RainbowPaddingBlock length B=1282026.06 | 60.37 | |
| VoidPaddingBlock length B=5122026.06 | 60.37 | |
| Entropy-Cut MHModel=Qwen2.5-Math-7B2026.05 | 59.9 | |
| Uniform-Cut MHModel=Qwen2.5-Math-7B2026.05 | 59.8 | |
| VoidPaddingBlock length B=642026.06 | 59.76 | |
| VoidPaddingMean=Mean2026.06 | 59.76 | |
| VoidPaddingBlock length B=1282026.06 | 59.15 | |
| AWQModel Scale=Llama-3.1-8B, Quantization Bit-width=4-bit, Merging Algorithm=Task Arithmetic2026.05 | 58.54 | |
| GPTQModel Scale=Llama-3.1-8B, Quantization Bit-width=4-bit, Merging Algorithm=Task Arithmetic2026.05 | 58.54 | |
| LLaDA + DreamEnsemble Type=Intermediate-generation Ensemble, Scoring Function=Entropy2026.06 | 57.93 | |
| RainbowPaddingMean=Mean2026.06 | 57.72 | |
| LLaDA + DreamEnsemble Type=Intermediate-generation Ensemble, Scoring Function=Top-1 probability2026.06 | 57.32 | |
| LLaDA + DreamEnsemble Type=Intermediate-generation Ensemble, Scoring Function=Probability margin2026.06 | 57.32 | |
| Low-TemperatureModel=Qwen2.5-Math-7B2026.05 | 55.8 | |
| LLaDA + DreamEnsemble Type=Post-generation Ensemble2026.06 | 55.49 | |
| SMCModel=Qwen2.5-Math-7B2026.05 | 55.2 | |
| LLaDA + DreamEnsemble Type=Intermediate-generation Ensemble, Scoring Function=Token change count2026.06 | 54.27 | |
| TRACE-LFBackbone=LLaMA3-8B2026.05 | 53.7 | |
| Task ArithmeticModel Scale=Llama-3.1-3B, Quantization Bit-width=Full-precision, Merging Algorithm=Task Arithmetic2026.05 | 53.66 | |
| GPTQModel Scale=Llama-3.1-3B, Quantization Bit-width=4-bit, Merging Algorithm=Task Arithmetic2026.05 | 51.83 | |
| E-PMQModel Scale=Llama-3.1-3B, Quantization Bit-width=4-bit, Merging Algorithm=Task Arithmetic2026.05 | 51.83 | |
| AWQModel Scale=Llama-3.1-3B, Quantization Bit-width=4-bit, Merging Algorithm=Task Arithmetic2026.05 | 51.22 | |
| TMCModel=Qwen2.5-Math-7B2026.05 | 51.2 | |
| RainbowPaddingBlock length B=5122026.06 | 50 | |
| TIDE-SharedPipeline=Cross-Tokenizer2026.04 | 49.39 | |
| TIDE-SharedPipeline=Shared-Tokenizer2026.04 | 48.78 | |
| TIDE-CrossPipeline=Cross-Tokenizer2026.04 | 48.17 | |
| StandardModel=Qwen3-8B-Base2026.05 | 47.6 | |
| OriginalMean=Mean2026.06 | 47.36 | |
| Sequential LoRABackbone=LLaMA3-8B2026.05 | 47 | |
| BD3LMPipeline=Qwen3-0.6B2026.04 | 46.34 | |
| LLaDAEnsemble Type=Single Model2026.06 | 45.73 | |
| CALMPipeline=Cross-Tokenizer2026.04 | 43.9 | |
| TIDE-CrossPipeline=Shared-Tokenizer2026.04 | 42.68 | |
| KLPipeline=Shared-Tokenizer2026.04 | 41.46 | |
| StandardModel=Phi-3.5-mini-instruct2026.05 | 40.5 | |
| StandardModel=Phi-4-mini-instruct2026.05 | 39.9 | |
| dLLM-CacheModel=LLaDA Instruct, TPS=44.77, Speed=4.24×, Memory=16.652025.05 | 39.02 | |
| LLaDA InstructModel=LLaDA Instruct, TPS=10.57, Speed=1.00×, Memory=15.392025.05 | 38.71 | |
| dKV-CacheModel=LLaDA Instruct, TPS=14.40, Speed=1.36×, Memory=17.172025.05 | 37.2 | |
| Fast-dLLMModel=LLaDA Instruct, TPS=21.50, Speed=2.03×, Memory=16.602025.05 | 36.59 | |
| StandardModel=Qwen2.5-7B2026.05 | 33 | |
| ARPipeline=Qwen3-0.6B2026.04 | 32.3 | |
| StandardModel=Qwen2.5-Math-7B2026.05 | 31 | |
| OriginalBlock length B=5122026.06 | 18.9 | |
| Joint Fine-tuningBackbone=LLaMA3-8B2026.05 | 18.3 | |
| DMTBackbone=LLaMA3-8B2026.05 | 14 | |
| Sequential Fine-tuningBackbone=LLaMA3-8B2026.05 | 12.2 |