Embedding Reconstruction on CLIP vision embeddings CC3M and ImageNet
60L0 ErrorTopK
Evaluation results
| Method | Links | ||
|---|---|---|---|
| TopKk=602026.05 | 60 | 86.3 | |
| Batch TopKk=602026.05 | 61.906 | 86.7 | |
| SoftSAEk=602026.05 | 62.562 | 86.5 | |
| Matryoshkak=602026.05 | 66.42 | 85 | |
| TopKk=1002026.05 | 100 | 90.4 | |
| SoftSAEk=1002026.05 | 104.15 | 90.6 | |
| BatchTopKk=1002026.05 | 108.314 | 91.2 | |
| Matryoshkak=1002026.05 | 112.275 | 89.6 | |
| TopKk=1402026.05 | 140 | 93.3 | |
| SoftSAEk=1402026.05 | 149.3 | 93.5 | |
| Batch TopKk=1402026.05 | 152.77 | 94.3 | |
| Matryoshkak=1402026.05 | 155.405 | 92.6 | |
| TopKk=1802026.05 | 180 | 95.5 | |
| SoftSAEk=1802026.05 | 187.24 | 95.4 | |
| Batch TopKk=1802026.05 | 195.747 | 96.3 | |
| Matryoshkak=1802026.05 | 198.477 | 94.7 | |
| TopKk=2202026.05 | 220 | 97 | |
| SoftSAEk=2202026.05 | 223.459 | 96.8 | |
| Batch TopKk=2202026.05 | 235.186 | 97.7 | |
| Matryoshkak=2202026.05 | 238.797 | 96 | |
| TopKk=2602026.05 | 260 | 98 | |
| SoftSAEk=2602026.05 | 268.338 | 97.8 | |
| Batch TopKk=2602026.05 | 274.274 | 98.5 | |
| Matryoshkak=2602026.05 | 278.693 | 96.8 |