Code Generation on RepoBench P
15.04ScoreDCS
Evaluation results
| Method | Links | |
|---|---|---|
| DCSbackbone=Llama-3-8B-Instruct, variant=with DCS2025.06 | 15.04 | |
| Llama-3-8B-Instructbackbone=Llama-3-8B-Instruct2025.06 | 14.17 | |
| Streamingbackbone=Llama-3-8B-Instruct, variant=with Streaming2025.06 | 12.16 | |
| LM-infinitebackbone=Llama-3-8B-Instruct, variant=with LM-infinite2025.06 | 11.73 | |
| Infilmbackbone=Llama-3-8B-Instruct, variant=with Infilm2025.06 | 11.63 |