KV cache reconstruction on Isotropic Gaussian keys/queries d=128 averaged over 64 seeds (synthetic)
0.9965Cosine SimilarityOCTOPUS
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| OCTOPUSbits=42026.05 | 0.9965 | 0.0071 | 0.753 | |
| OCTOPUS-QJLbits=42026.05 | 0.9965 | 0.0071 | 0.565 | |
| TurboQuant-MSEbits=42026.05 | 0.9954 | 0.0094 | 0.866 | |
| PolarQuantbits=42026.05 | 0.9928 | 0.0145 | 1.079 | |
| OCTOPUSbits=32026.05 | 0.9871 | 0.026 | 1.444 | |
| OCTOPUS-QJLbits=32026.05 | 0.9871 | 0.026 | 1.084 | |
| TurboQuant-MSEbits=32026.05 | 0.9831 | 0.034 | 1.65 | |
| TurboQuant-QJLbits=42026.05 | 0.9831 | 0.034 | 1.66 | |
| PolarQuantbits=32026.05 | 0.9715 | 0.0571 | 2.142 | |
| OCTOPUSbits=22026.05 | 0.9547 | 0.0897 | 2.682 | |
| OCTOPUS-QJLbits=22026.05 | 0.9547 | 0.0897 | 2.015 | |
| TurboQuant-MSEbits=22026.05 | 0.9406 | 0.1161 | 3.054 | |
| TurboQuant-QJLbits=32026.05 | 0.9406 | 0.1161 | 3.072 | |
| PolarQuantbits=22026.05 | 0.8902 | 0.2197 | 4.2 | |
| TurboQuant-QJLbits=22026.05 | 0.7994 | 0.361 | 5.427 |