Bug Localization on InfiniteBench-CodeDebug, DebugBench, and LongCodeQA
21InfiniteBench ScoreNo Comp.
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| No Comp.Model=Qwen3-8B, Retention Budget (Cap.)=1.02026.04 | 21 | 87 | 67 | 100 | 58 | |
| CodeCompModel=Qwen3-8B, Retention Budget (Cap.)=0.62026.04 | 21 | 79 | 58 | 77 | 53 | |
| No Comp.Model=Llama3-8B, Retention Budget (Cap.)=1.02026.04 | 20 | 74 | 59 | 100 | 51 | |
| CodeCompModel=Llama3-8B, Retention Budget (Cap.)=0.62026.04 | 18 | 49 | 54 | 75 | 40 | |
| SnapKVModel=Qwen3-8B, Retention Budget (Cap.)=0.42026.04 | 17 | 71 | 69 | 36 | 52 | |
| SnapKVModel=Qwen3-8B, Retention Budget (Cap.)=0.62026.04 | 17 | 66 | 68 | 57 | 50 | |
| CodeCompModel=Qwen3-8B, Retention Budget (Cap.)=0.42026.04 | 16 | 72 | 64 | 56 | 51 | |
| CodeCompModel=Llama3-8B, Retention Budget (Cap.)=0.42026.04 | 14 | 43 | 52 | 54 | 36 | |
| SnapKVModel=Llama3-8B, Retention Budget (Cap.)=0.62026.04 | 12 | 44 | 56 | 57 | 37 | |
| ParallelCompModel=Llama3-8B, Retention Budget (Cap.)=0.62026.04 | 11 | 17 | 31 | 58 | 20 | |
| SnapKVModel=Llama3-8B, Retention Budget (Cap.)=0.42026.04 | 10 | 41 | 48 | 36 | 33 | |
| ParallelCompModel=Llama3-8B, Retention Budget (Cap.)=0.42026.04 | 10 | 3 | 38 | 35 | 17 | |
| ParallelCompModel=Qwen3-8B, Retention Budget (Cap.)=0.42026.04 | 10 | 25 | 13 | 33 | 16 | |
| ParallelCompModel=Qwen3-8B, Retention Budget (Cap.)=0.62026.04 | 5 | 48 | 17 | 52 | 23 |