Code Generation on LiveCode (Acceptance length (τ))
2.975Acceptance Length (τ)Llama 3.2-3B
Evaluation results
| Method | Links | |
|---|---|---|
| Llama 3.2-3Bγ (loss-decay constant)=10, αf (first-error focal coefficient)=0.3, αc (chain-loss coefficient)=402026.06 | 2.975 | |
| Llama-3-8Bγ (loss-decay constant)=10, αf (first-error focal coefficient)=0.3, αc (chain-loss coefficient)=402026.06 | 2.922 | |
| Qwen3-4Bγ (loss-decay constant)=10, αf (first-error focal coefficient)=0.3, αc (chain-loss coefficient)=402026.06 | 2.713 | |
| Llama 3.2-3Bγ (loss-decay constant)=10, αf (first-error focal coefficient)=0.3, αc (chain-loss coefficient)=02026.06 | 2.681 | |
| Llama-3-8Bγ (loss-decay constant)=10, αf (first-error focal coefficient)=0.3, αc (chain-loss coefficient)=02026.06 | 2.668 | |
| Qwen3-8Bγ (loss-decay constant)=10, αf (first-error focal coefficient)=0.3, αc (chain-loss coefficient)=402026.06 | 2.665 | |
| Llama 3.2-3Bγ (loss-decay constant)=10, αf (first-error focal coefficient)=0, αc (chain-loss coefficient)=02026.06 | 2.636 | |
| Llama 3.2-3Bγ (loss-decay constant)=None, αf (first-error focal coefficient)=0, αc (chain-loss coefficient)=02026.06 | 2.546 | |
| Qwen3-4Bγ (loss-decay constant)=10, αf (first-error focal coefficient)=0.3, αc (chain-loss coefficient)=02026.06 | 2.481 | |
| Qwen3-8Bγ (loss-decay constant)=10, αf (first-error focal coefficient)=0.3, αc (chain-loss coefficient)=02026.06 | 2.42 | |
| Qwen3-4Bγ (loss-decay constant)=10, αf (first-error focal coefficient)=0, αc (chain-loss coefficient)=02026.06 | 2.387 | |
| Llama-3-8Bγ (loss-decay constant)=10, αf (first-error focal coefficient)=0, αc (chain-loss coefficient)=02026.06 | 2.317 | |
| Qwen3-8Bγ (loss-decay constant)=10, αf (first-error focal coefficient)=0, αc (chain-loss coefficient)=02026.06 | 2.315 | |
| Qwen3-4Bγ (loss-decay constant)=None, αf (first-error focal coefficient)=0, αc (chain-loss coefficient)=02026.06 | 2.265 | |
| Llama-3-8Bγ (loss-decay constant)=None, αf (first-error focal coefficient)=0, αc (chain-loss coefficient)=02026.06 | 2.241 | |
| Qwen3-8Bγ (loss-decay constant)=None, αf (first-error focal coefficient)=0, αc (chain-loss coefficient)=02026.06 | 2.144 |