Code generation on MBPP (Acceptance length (τ))
2.032Acceptance Length (τ)Qwen3-8B
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen3-8Bγ (loss-decay constant)=None, αf (first-error focal coefficient)=0, αc (chain-loss coefficient)=02026.06 | 2.032 | |
| Qwen3-8Bγ (loss-decay constant)=10, αf (first-error focal coefficient)=0, αc (chain-loss coefficient)=02026.06 | 2.241 | |
| Llama-3-8Bγ (loss-decay constant)=None, αf (first-error focal coefficient)=0, αc (chain-loss coefficient)=02026.06 | 2.298 | |
| Qwen3-8Bγ (loss-decay constant)=10, αf (first-error focal coefficient)=0.3, αc (chain-loss coefficient)=02026.06 | 2.306 | |
| Qwen3-4Bγ (loss-decay constant)=None, αf (first-error focal coefficient)=0, αc (chain-loss coefficient)=02026.06 | 2.396 | |
| Llama-3-8Bγ (loss-decay constant)=10, αf (first-error focal coefficient)=0, αc (chain-loss coefficient)=02026.06 | 2.412 | |
| Qwen3-8Bγ (loss-decay constant)=10, αf (first-error focal coefficient)=0.3, αc (chain-loss coefficient)=402026.06 | 2.466 | |
| Qwen3-4Bγ (loss-decay constant)=10, αf (first-error focal coefficient)=0, αc (chain-loss coefficient)=02026.06 | 2.596 | |
| Qwen3-4Bγ (loss-decay constant)=10, αf (first-error focal coefficient)=0.3, αc (chain-loss coefficient)=02026.06 | 2.618 | |
| Llama-3-8Bγ (loss-decay constant)=10, αf (first-error focal coefficient)=0.3, αc (chain-loss coefficient)=02026.06 | 2.72 | |
| Qwen3-4Bγ (loss-decay constant)=10, αf (first-error focal coefficient)=0.3, αc (chain-loss coefficient)=402026.06 | 2.958 | |
| Llama-3-8Bγ (loss-decay constant)=10, αf (first-error focal coefficient)=0.3, αc (chain-loss coefficient)=402026.06 | 3.088 | |
| Llama 3.2-3Bγ (loss-decay constant)=None, αf (first-error focal coefficient)=0, αc (chain-loss coefficient)=02026.06 | 3.11 | |
| Llama 3.2-3Bγ (loss-decay constant)=10, αf (first-error focal coefficient)=0, αc (chain-loss coefficient)=02026.06 | 3.3 | |
| Llama 3.2-3Bγ (loss-decay constant)=10, αf (first-error focal coefficient)=0.3, αc (chain-loss coefficient)=02026.06 | 3.382 | |
| Llama 3.2-3Bγ (loss-decay constant)=10, αf (first-error focal coefficient)=0.3, αc (chain-loss coefficient)=402026.06 | 3.933 |