LLM Inference on LiveCodeBench
2.81SpeedupDART
Evaluation results
| Method | Links | |
|---|---|---|
| DARTModel=L2 7B, Temperature=02026.01 | 2.81 | |
| DARTModel=Qwen14B, Temperature=02026.01 | 2.69 | |
| DARTModel=Qwen8B, Temperature=02026.01 | 2.64 | |
| HydraModel=L2 7B, Temperature=02026.01 | 2.59 | |
| DARTModel=Qwen4B, Temperature=02026.01 | 2.57 | |
| DARTModel=Qwen32B, Temperature=02026.01 | 2.42 | |
| DARTModel=Qwen14B, Temperature=12026.01 | 2.37 | |
| MedusaModel=L2 7B, Temperature=02026.01 | 2.31 | |
| DARTModel=Qwen1.7B, Temperature=02026.01 | 2.28 | |
| EAGLE3Model=Qwen32B, Temperature=02026.01 | 2.15 | |
| DARTModel=Qwen32B, Temperature=12026.01 | 2.13 | |
| EAGLE3Model=Qwen8B, Temperature=02026.01 | 2.11 | |
| EAGLE3Model=Qwen14B, Temperature=02026.01 | 2.08 | |
| EAGLE3Model=Qwen1.7B, Temperature=02026.01 | 2.06 | |
| EAGLE3Model=Qwen32B, Temperature=12026.01 | 1.97 | |
| EAGLE3Model=Qwen4B, Temperature=02026.01 | 1.95 | |
| PLDModel=L2 7B, Temperature=02026.01 | 1.94 | |
| EAGLE3Model=Qwen14B, Temperature=12026.01 | 1.92 | |
| LookaheadModel=L2 7B, Temperature=02026.01 | 1.59 | |
| SPSModel=Qwen32B, Temperature=02026.01 | 1.06 | |
| SPSModel=Qwen14B, Temperature=02026.01 | 0.94 |