Code Completion on LCC LongBench
18.15Edit DistanceInnerQHybrid
Evaluation results
| Method | Links | |
|---|---|---|
| InnerQHybridModel=Llama 3.2-1B2026.02 | 18.15 | |
| InnerQBaseModel=Llama 3.2-1B2026.02 | 18.29 | |
| InnerQSmallModel=Llama 3.2-1B2026.02 | 18.53 | |
| KIVISinkModel=Llama 3.2-1B2026.02 | 18.7 | |
| KIVIModel=Llama 3.2-1B2026.02 | 19.17 | |
| BaselineModel=Llama 3.2-1B2026.02 | 19.29 | |
| InnerQBaseModel=Llama 3.2-3B2026.02 | 30.2 | |
| InnerQHybridModel=Llama 3.2-3B2026.02 | 30.98 | |
| KIVISinkModel=Llama 3.2-3B2026.02 | 31.01 | |
| KIVIModel=Llama 3.2-3B2026.02 | 31.27 | |
| InnerQSmallModel=Llama 3.2-3B2026.02 | 31.63 | |
| BaselineModel=Llama 3.2-3B2026.02 | 31.65 | |
| InnerQSmallModel=Llama 2-7B2026.02 | 40.41 | |
| KIVISinkModel=Llama 3.1-8B2026.02 | 42.66 | |
| InnerQHybridModel=Llama 3.1-8B2026.02 | 42.76 | |
| InnerQSmallModel=Llama 3.1-8B2026.02 | 42.84 | |
| KIVIModel=Llama 3.1-8B2026.02 | 42.85 | |
| InnerQBaseModel=Llama 3.1-8B2026.02 | 42.97 | |
| BaselineModel=Llama 3.1-8B2026.02 | 43.02 | |
| InnerQSmallModel=Llama 2-13B2026.02 | 46.45 | |
| KIVIModel=Llama 2-13B2026.02 | 47.31 | |
| InnerQBaseModel=Llama 2-13B2026.02 | 48.04 | |
| BaselineModel=Llama 2-13B2026.02 | 48.22 | |
| KIVISinkModel=Llama 2-13B2026.02 | 48.51 | |
| InnerQHybridModel=Llama 2-13B2026.02 | 49.5 | |
| KIVIModel=Llama 2-7B2026.02 | 57.79 | |
| InnerQHybridModel=Llama 2-7B2026.02 | 57.8 | |
| KIVISinkModel=Llama 2-7B2026.02 | 58.12 | |
| BaselineModel=Llama 2-7B2026.02 | 58.29 | |
| InnerQBaseModel=Llama 2-7B2026.02 | 58.41 |