Code Generation Inference Acceleration on MBPP Code Llama
3.08MATTR
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| TRParameters=13B2024.08 | 3.08 | 93.42 | 2.26 | |
| TRParameters=33B2024.08 | 3.05 | 45.43 | 2.34 | |
| TRParameters=7B2024.08 | 2.93 | 131.2 | 2.34 | |
| RESTParameters=33B2024.08 | 2.1 | 36.85 | 1.9 | |
| RESTParameters=7B2024.08 | 2.08 | 87.08 | 1.55 | |
| RESTParameters=13B2024.08 | 2.05 | 70.13 | 1.7 | |
| LadeParameters=13B2024.08 | 1.73 | 56.87 | 1.38 | |
| LadeParameters=33B2024.08 | 1.7 | 29.22 | 1.5 | |
| LadeParameters=7B2024.08 | 1.66 | 79.16 | 1.41 | |
| PLDParameters=13B2024.08 | 1.48 | 52.2 | 1.26 | |
| PLDParameters=33B2024.08 | 1.41 | 25.89 | 1.33 | |
| PLDParameters=7B2024.08 | 1.39 | 66.65 | 1.19 | |
| ARParameters=7B2024.08 | 1 | 56.15 | 1 | |
| ARParameters=13B2024.08 | 1 | 41.31 | 1 | |
| ARParameters=33B2024.08 | 1 | 19.44 | 1 |