Novel Object Captioning on NoCaps (NC)
1.08NC ScoreLightKV
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| LightKVBackbone=LLaVA-v1.5-13B, Compression Timing=During prefill, FLOPs (Tera)=12.6, Memory (GB)=0.37, TTFT (sec)=0.098, Vision Token Retention=55%2026.05 | 1.08 | 99.94 | |
| LightKVBackbone=LLaVA-v1.5-7B, Compression Timing=During prefill, FLOPs (Tera)=6.6, Memory (GB)=0.23, TTFT (sec)=0.065, Vision Token Retention=55%2026.05 | 1.03 | 99.79 |