Code Generation on HumanEval (100 examples)
6.17Speed-upEAGLE-3
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| EAGLE-3Model=Vicuna-13B, Attack Status=Clean2026.05 | 6.17 | 7.08 | — | — | |
| EAGLE-2Model=Vicuna-13B, Attack Status=Clean2026.05 | 5.06 | 5.42 | — | — | |
| HydraModel=Vicuna-7B, Attack Status=Clean2026.05 | 5.01 | 3.52 | — | — | |
| HydraModel=Vicuna-13B, Attack Status=Clean2026.05 | 4.2 | 3.8 | — | — | |
| EAGLE-2Model=Vicuna-7B, Attack Status=Clean2026.05 | 4.15 | 5.17 | — | — | |
| EAGLEModel=Vicuna-7B, Attack Status=Clean2026.05 | 3.96 | 3.92 | — | — | |
| EAGLEModel=Vicuna-13B, Attack Status=Clean2026.05 | 3.86 | 4.32 | — | — | |
| MedusaModel=Vicuna-7B, Attack Status=Clean2026.05 | 3.75 | 2.69 | — | — | |
| MedusaModel=Vicuna-13B, Attack Status=Clean2026.05 | 3.42 | 2.83 | — | — | |
| EAGLE-2Model=Vicuna-7B, Attack Status=Attacked (MISTLETOE)2026.05 | 3.16 | 3.03 | — | — | |
| EAGLE-3Model=Vicuna-13B, Attack Status=Attacked (MISTLETOE)2026.05 | 2.77 | 3.99 | — | — | |
| MedusaModel=Vicuna-7B, Attack Status=Attacked (MISTLETOE)2026.05 | 2.77 | 2.16 | — | — | |
| EAGLE-2Model=Vicuna-13B, Attack Status=Attacked (MISTLETOE)2026.05 | 2.41 | 3.55 | — | — | |
| EAGLEModel=Vicuna-7B, Attack Status=Attacked (MISTLETOE)2026.05 | 2.1 | 3.19 | — | — | |
| HydraModel=Vicuna-7B, Attack Status=Attacked (MISTLETOE)2026.05 | 2.08 | 2.7 | — | — | |
| HydraModel=Vicuna-13B, Attack Status=Attacked (MISTLETOE)2026.05 | 2.03 | 3.1 | — | — | |
| EAGLEModel=Vicuna-13B, Attack Status=Attacked (MISTLETOE)2026.05 | 1.79 | 3.95 | — | — | |
| MedusaModel=Vicuna-13B, Attack Status=Attacked (MISTLETOE)2026.05 | 1.42 | 2.16 | — | — |