Vector Quantization on Contriever1M D = 768 (test)
1.08MSERQ-MoE
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| RQ-MoECodebook Budget=16 bytes, Training Set Size=10M2026.05 | 1.08 | 31.4 | 62.5 | 87.2 | |
| QINCoCodebook Budget=16 bytes, Training Set Size=10M2026.05 | 1.1 | 31 | 61.7 | 85.4 | |
| RQ-MoECodebook Budget=16 bytes, Training Set Size=500K2026.05 | 1.26 | 27.1 | 55.2 | 80.2 | |
| QINCoCodebook Budget=16 bytes, Training Set Size=500K2026.05 | 1.3 | 26.5 | 54.3 | 79.5 | |
| LSQCodebook Budget=16 bytes, Training Set Size=10M2026.05 | 1.32 | 25.7 | 54.6 | 79.8 | |
| LSQCodebook Budget=16 bytes, Training Set Size=500K2026.05 | 1.35 | 25.6 | 53.8 | 78.6 | |
| RQ-MoECodebook Budget=8 bytes, Training Set Size=10M2026.05 | 1.38 | 21.6 | 48.9 | 76.2 | |
| QINCoCodebook Budget=8 bytes, Training Set Size=10M2026.05 | 1.42 | 20.4 | 47.1 | 74.5 | |
| RQ-MoECodebook Budget=8 bytes, Training Set Size=500K2026.05 | 1.52 | 16 | 41.3 | 67.4 | |
| QINCoCodebook Budget=8 bytes, Training Set Size=500K2026.05 | 1.6 | 15.1 | 36.7 | 63.5 | |
| LSQCodebook Budget=8 bytes, Training Set Size=10M2026.05 | 1.64 | 13.3 | 35.1 | 62.9 | |
| LSQCodebook Budget=8 bytes, Training Set Size=500K2026.05 | 1.65 | 13.1 | 33.9 | 62.7 | |
| RQCodebook Budget=16 bytes, Training Set Size=500K2026.05 | 1.65 | 20.2 | 43.5 | 68.2 | |
| RQCodebook Budget=16 bytes, Training Set Size=10M2026.05 | 1.65 | 19.9 | 43.6 | 68.4 | |
| OPQCodebook Budget=16 bytes, Training Set Size=500K2026.05 | 1.71 | 18.3 | 40.9 | 65.4 | |
| OPQCodebook Budget=16 bytes, Training Set Size=10M2026.05 | 1.71 | 18 | 40.8 | 98.9 | |
| RQCodebook Budget=8 bytes, Training Set Size=10M2026.05 | 1.81 | 9.8 | 27.4 | 53.1 | |
| RQCodebook Budget=8 bytes, Training Set Size=500K2026.05 | 1.82 | 10.4 | 27 | 52.8 | |
| OPQCodebook Budget=8 bytes, Training Set Size=500K2026.05 | 1.87 | 8.1 | 24.5 | 50.9 | |
| OPQCodebook Budget=8 bytes, Training Set Size=10M2026.05 | 1.87 | 8.5 | 24.4 | 50.6 |