Code Understanding on RepoQA and CodeQueries (zero-shot)
65.6AccuracyText
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| TextCompression Rate=5x2026.05 | 65.6 | — | — | |
| TextCompression Rate=10x2026.05 | 65.6 | — | — | |
| TextCompression Rate=15x2026.05 | 65.6 | — | — | |
| LensVLMCompression Rate=5x2026.05 | 38.1 | 3.2 | 55.5 | |
| GlyphCompression Rate=5x2026.05 | 31.8 | — | — | |
| Comp. ImageCompression Rate=5x2026.05 | 26.7 | — | — | |
| LensVLMCompression Rate=10x2026.05 | 26.1 | 6.3 | 43.5 | |
| LensVLMCompression Rate=15x2026.05 | 20 | 8.2 | 31.7 | |
| GlyphCompression Rate=10x2026.05 | 9.7 | — | — | |
| GlyphCompression Rate=15x2026.05 | 7 | — | — | |
| Comp. ImageCompression Rate=10x2026.05 | 6.1 | — | — | |
| Comp. ImageCompression Rate=15x2026.05 | 3.2 | — | — |