Line Retrieval on Line Retrieval 400 lines
98AccuracyFP16
Evaluation Results
| Method | Links | |
|---|---|---|
| FP16Model=Qwen3-4B, K/V=16/16, bits/elem=16.0, Uniform Precision=true2026.06 | 98 | |
| HadamardModel=Qwen3-4B, K/V=2/2, bits/elem=2.3, Uniform Precision=true2026.06 | 98 | |
| FP16Model=Phi-4-14B, K/V=16/16, bits/elem=16.0, Uniform Precision=true2026.06 | 98 | |
| KVarNModel=Qwen3-4B, K/V=2/2, bits/elem=2.3, Uniform Precision=true2026.06 | 97 | |
| HadamardModel=Phi-4-14B, K/V=2/2, bits/elem=2.3, Uniform Precision=true2026.06 | 97 | |
| PolarQuantModel=Phi-4-14B, K/V=4/2, bits/elem=3.3, Uniform Precision=true2026.06 | 97 | |
| KVarNModel=Phi-4-14B, K/V=2/2, bits/elem=2.3, Uniform Precision=true2026.06 | 97 | |
| FP16Model=Llama-3.1-8B, K/V=16/16, bits/elem=16.0, Uniform Precision=true2026.06 | 96 | |
| TurboQuantModel=Qwen3-4B, K/V=3/3, bits/elem=4.6, Uniform Precision=true, Implementation=vLLM2026.06 | 95 | |
| KVarNModel=Llama-3.1-8B, K/V=2/2, bits/elem=2.3, Uniform Precision=true2026.06 | 95 | |
| KittyModel=Qwen3-4B, K/V=2/2, bits/elem=2.4, Uniform Precision=false2026.06 | 94 | |
| KittyModel=Phi-4-14B, K/V=2/2, bits/elem=2.4, Uniform Precision=false2026.06 | 93 | |
| PolarQuantModel=Qwen3-4B, K/V=4/2, bits/elem=3.3, Uniform Precision=true2026.06 | 91 | |
| HadamardModel=Llama-3.1-8B, K/V=2/2, bits/elem=2.3, Uniform Precision=true2026.06 | 90 | |
| TurboQuantModel=Llama-3.1-8B, K/V=3/3, bits/elem=4.8, Uniform Precision=true, Implementation=vLLM2026.06 | 88 | |
| KIVIModel=Phi-4-14B, K/V=2/2, bits/elem=2.3, Uniform Precision=true2026.06 | 88 | |
| KittyModel=Llama-3.1-8B, K/V=2/2, bits/elem=2.4, Uniform Precision=false2026.06 | 87 | |
| KIVIModel=Qwen3-4B, K/V=2/2, bits/elem=2.3, Uniform Precision=true2026.06 | 84 | |
| KIVIModel=Llama-3.1-8B, K/V=2/2, bits/elem=2.3, Uniform Precision=true2026.06 | 84 | |
| KVQuant-1%Model=Phi-4-14B, K/V=2/2, bits/elem=2.4, Uniform Precision=false2026.06 | 82 | |
| PolarQuantModel=Llama-3.1-8B, K/V=4/2, bits/elem=3.3, Uniform Precision=true2026.06 | 77 | |
| KVQuant-1%Model=Qwen3-4B, K/V=2/2, bits/elem=2.4, Uniform Precision=false2026.06 | 69 | |
| KVQuant-1%Model=Llama-3.1-8B, K/V=2/2, bits/elem=2.4, Uniform Precision=false2026.06 | 68 | |
| TurboQuantModel=Phi-4-14B, K/V=3/3, bits/elem=4.5, Uniform Precision=true, Implementation=vLLM2026.06 | 53 |