Code Generation on LiveCodeBench v1 (test)
34.9AccuracyMarginal Sharpening
Evaluation Results
| Method | Links | |
|---|---|---|
| Marginal SharpeningModel=Qwen3-8B, K=4, S=82026.05 | 34.9 | |
| Marginal SharpeningModel=Qwen3-8B, K=32, S=12026.05 | 34.3 | |
| vanilla token dropoutBackbone=Qwen-0.6B2025.12 | 31.9 | |
| Marginal SharpeningModel=Qwen3-4B, K=4, S=82026.05 | 30.9 | |
| Majority VotingModel=Qwen3-8B, k=322026.05 | 30.9 | |
| EntroDropBackbone=Qwen-0.6B2025.12 | 30.5 | |
| Power SamplingModel=Qwen3-4B2026.05 | 30.3 | |
| Marginal SharpeningModel=Qwen3-4B, K=32, S=12026.05 | 30.3 | |
| Temperature SamplingModel=Qwen3-8B2026.05 | 29.6 | |
| Marginal SharpeningModel=Qwen3-1.7B, K=32, S=12026.05 | 28 | |
| Majority VotingModel=Qwen3-4B, k=322026.05 | 27.4 | |
| Marginal SharpeningModel=Qwen3-1.7B, K=4, S=82026.05 | 26.9 | |
| Qwen2-7BInstruction-tuned=true2024.07 | 26.6 | |
| Temperature SamplingModel=Qwen3-4B2026.05 | 26.6 | |
| NEFTuneBackbone=Qwen-0.6B2025.12 | 26.3 | |
| weight decayBackbone=Qwen-0.6B2025.12 | 25.2 | |
| Power SamplingModel=Qwen3-1.7B2026.05 | 23.4 | |
| hidden dropoutBackbone=Qwen-0.6B2025.12 | 23 | |
| Majority VotingModel=Qwen3-1.7B, k=322026.05 | 22.9 | |
| baselineBackbone=Qwen-0.6B2025.12 | 22.7 | |
| Temperature SamplingModel=Qwen3-1.7B2026.05 | 22.7 | |
| Llama-3-8BInstruction-tuned=true2024.07 | 17.3 | |
| Qwen1.5-7BInstruction-tuned=true2024.07 | 6 |