Vector Quantization on FB-ssnpp1M D = 256 (test)
6.53MSERQ-MoE
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| RQ-MoECodebook Budget=16 bytes, Training Set Size=10M2026.05 | 6.53 | 6.5 | 17 | 36.1 | |
| LSQCodebook Budget=16 bytes, Training Set Size=10M2026.05 | 6.56 | 6.3 | 16 | 34.7 | |
| QINCoCodebook Budget=16 bytes, Training Set Size=10M2026.05 | 6.58 | 6.4 | 16.8 | 35.6 | |
| LSQCodebook Budget=16 bytes, Training Set Size=500K2026.05 | 6.63 | 6.2 | 14.8 | 32.3 | |
| RQ-MoECodebook Budget=16 bytes, Training Set Size=500K2026.05 | 6.82 | 6 | 14.8 | 32.1 | |
| QINCoCodebook Budget=16 bytes, Training Set Size=500K2026.05 | 6.88 | 5.7 | 14.4 | 31.6 | |
| RQCodebook Budget=16 bytes, Training Set Size=10M2026.05 | 6.99 | 5.4 | 13 | 29.7 | |
| RQCodebook Budget=16 bytes, Training Set Size=500K2026.05 | 7.01 | 5.4 | 13 | 29 | |
| OPQCodebook Budget=16 bytes, Training Set Size=500K2026.05 | 7.25 | 5 | 11.8 | 25.9 | |
| OPQCodebook Budget=16 bytes, Training Set Size=10M2026.05 | 7.25 | 5.1 | 12.3 | 27.3 | |
| RQ-MoECodebook Budget=8 bytes, Training Set Size=10M2026.05 | 8.64 | 3.6 | 9 | 20.9 | |
| QINCoCodebook Budget=8 bytes, Training Set Size=10M2026.05 | 8.67 | 3.6 | 8.9 | 20.7 | |
| LSQCodebook Budget=8 bytes, Training Set Size=10M2026.05 | 8.82 | 3.4 | 8 | 18 | |
| RQ-MoECodebook Budget=8 bytes, Training Set Size=500K2026.05 | 8.85 | 3.4 | 7.9 | 17.6 | |
| LSQCodebook Budget=8 bytes, Training Set Size=500K2026.05 | 8.87 | 3.3 | 7.5 | 17.3 | |
| QINCoCodebook Budget=8 bytes, Training Set Size=500K2026.05 | 9.01 | 2.9 | 7.5 | 16.8 | |
| RQCodebook Budget=8 bytes, Training Set Size=10M2026.05 | 9.18 | 2.7 | 5.9 | 14.4 | |
| RQCodebook Budget=8 bytes, Training Set Size=500K2026.05 | 9.2 | 2.7 | 6.1 | 13.7 | |
| OPQCodebook Budget=8 bytes, Training Set Size=10M2026.05 | 9.51 | 2.5 | 5 | 11.3 | |
| OPQCodebook Budget=8 bytes, Training Set Size=500K2026.05 | 9.52 | 2.5 | 5.1 | 11 |