List your company
ResearchFormerly WizWand

Code Completion on RepoBench-P

0.7305SimilarityCoA
0.1696280.3152390.460850.606461Jun 4, 2024Oct 1, 2024Jan 29, 2025May 28, 2025Sep 25, 2025Jan 22, 2026May 22, 2026
Updated 5mo ago

Evaluation results

MethodLinks
CoABackbone=gemini-ultra, Context Window=8k2024.060.7305
VanillaBackbone=gemini-ultra, Context Window=32k2024.060.7304
RAGBackbone=gemini-ultra, Context Window=8k2024.060.7294
CoABackbone=text-unicorn, Context Window=8k2024.060.6039
CoABackbone=text-bison, Context Window=8k2024.060.5825
VanillaBackbone=text-bison, Context Window=8k2024.060.563
RAGBackbone=text-bison, Context Window=8k2024.060.5563
VanillaBackbone=text-unicorn, Context Window=8k2024.060.5387
RAGBackbone=text-unicorn, Context Window=8k2024.060.5049
VanillaBackbone=gemini-ultra, Context Window=8k2024.060.4909
AMS-ExpectedKV Compression=Enabled2026.050.2744
StreamingLLMKV Compression=Enabled2026.050.2692
PyramidKVKV Compression=Enabled2026.050.241
Full KVKV Compression=Disabled2026.050.2404
AMS-TOVAKV Compression=Enabled2026.050.2364
TOVAKV Compression=Enabled2026.050.224
AdaKV-ExpE2KV Compression=Enabled2026.050.1912