Code Editing on CodeEditorBench
3.04Debug Success RateAdaPLD
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| AdaPLDModel=Qwen3-8B, Temperature=1, Decoding=sampling-based2026.06 | 3.04 | 5.65 | 1.92 | 4.5 | 3.78 | — | |
| AdaPLDModel=Vicuna-33B, Temperature=1, Decoding=sampling-based2026.06 | 2.9 | 2.37 | 1.78 | 3.3 | 2.59 | — | |
| LogitspecModel=Qwen3-8B, Temperature=1, Decoding=sampling-based2026.06 | 2.87 | 4.68 | 1.91 | 3.82 | 3.32 | — | |
| AdaPLDBackbone=Vicuna-33B2026.06 | 2.77 | 2.99 | 1.84 | 4.83 | 3.1 | 93.04 | |
| TRModel=Qwen3-8B, Temperature=1, Decoding=sampling-based2026.06 | 2.67 | 2.69 | 2.65 | 2.55 | 2.64 | — | |
| PLD+Model=Qwen3-8B, Temperature=1, Decoding=sampling-based2026.06 | 2.66 | 5.51 | 1.71 | 4.02 | 3.48 | — | |
| SAMDModel=Qwen3-8B, Temperature=1, Decoding=sampling-based2026.06 | 2.58 | 4.54 | 1.67 | 3.74 | 3.13 | — | |
| PLD+Model=Vicuna-33B, Temperature=1, Decoding=sampling-based2026.06 | 2.56 | 2.63 | 1.65 | 3.3 | 2.54 | — | |
| SAMDModel=Vicuna-33B, Temperature=1, Decoding=sampling-based2026.06 | 2.55 | 2.12 | 1.57 | 3 | 2.31 | — | |
| SAMDBackbone=Vicuna-33B2026.06 | 2.47 | 2.82 | 1.63 | 4.47 | 2.85 | 85.32 | |
| PLD+Backbone=Vicuna-33B2026.06 | 2.44 | 2.79 | 1.68 | 4.73 | 2.9 | 87.05 | |
| AdaPLDBackbone=Vicuna-13B2026.06 | 2.28 | 2.34 | 1.7 | 4.51 | 2.71 | 138.1 | |
| LogitspecBackbone=Vicuna-7B2026.06 | 2.17 | 2.22 | 1.7 | 2.22 | 2.08 | 133.49 | |
| PLDModel=Qwen3-8B, Temperature=1, Decoding=sampling-based2026.06 | 2.16 | 3.37 | 1.4 | 2.56 | 2.37 | — | |
| AdaPLDBackbone=Vicuna-7B2026.06 | 2.07 | 2.04 | 1.7 | 2.18 | 2 | 128.3 | |
| TRBackbone=Vicuna-7B2026.06 | 2.03 | 2.01 | 2.06 | 2.05 | 2.04 | 131.03 | |
| SAMDBackbone=Vicuna-13B2026.06 | 2 | 2.18 | 1.51 | 4.38 | 2.52 | 128.36 | |
| PLD+Backbone=Vicuna-13B2026.06 | 1.99 | 2.04 | 1.48 | 4.15 | 2.41 | 123.07 | |
| LogitspecBackbone=Vicuna-33B2026.06 | 1.97 | 2.17 | 1.43 | 3.01 | 2.14 | 64.27 | |
| PLDModel=Vicuna-33B, Temperature=1, Decoding=sampling-based2026.06 | 1.95 | 1.93 | 1.33 | 2.43 | 1.91 | — | |
| LogitspecModel=Vicuna-33B, Temperature=1, Decoding=sampling-based2026.06 | 1.94 | 2.14 | 1.42 | 3.12 | 2.16 | — | |
| SAMDBackbone=Vicuna-7B2026.06 | 1.94 | 1.92 | 1.53 | 2.05 | 1.87 | 120.23 | |
| PLD+Backbone=Vicuna-7B2026.06 | 1.94 | 1.93 | 1.55 | 2.04 | 1.87 | 119.96 | |
| LogitspecBackbone=Vicuna-13B2026.06 | 1.89 | 2.12 | 1.52 | 3.31 | 2.21 | 112.62 | |
| PLDBackbone=Vicuna-33B2026.06 | 1.88 | 2.08 | 1.37 | 3.12 | 2.11 | 63.3 | |
| PLDBackbone=Vicuna-7B2026.06 | 1.6 | 1.63 | 1.31 | 1.7 | 1.56 | 100.23 | |
| PLDBackbone=Vicuna-13B2026.06 | 1.57 | 1.64 | 1.24 | 2.68 | 1.78 | 90.82 | |
| TRBackbone=Vicuna-13B2026.06 | 1.53 | 1.53 | 1.52 | 1.57 | 1.54 | 78.59 | |
| TRModel=Vicuna-33B, Temperature=1, Decoding=sampling-based2026.06 | 1.35 | 1.27 | 1.38 | 1.33 | 1.33 | — | |
| TRBackbone=Vicuna-33B2026.06 | 1.33 | 1.32 | 1.39 | 1.37 | 1.35 | 40.57 | |
| ARBackbone=Vicuna-7B2026.06 | 1 | 1 | 1 | 1 | 1 | 64.17 | |
| ARBackbone=Vicuna-13B2026.06 | 1 | 1 | 1 | 1 | 1 | 51.03 | |
| ARBackbone=Vicuna-33B2026.06 | 1 | 1 | 1 | 1 | 1 | 29.97 |