Semantic Coherence Evaluation on Color
99.9HMS_medMatryoshka SAE
Evaluation results
| Method | Links | |
|---|---|---|
| Matryoshka SAEMLLM=Qwen32026.06 | 99.9 | |
| CSAEMLLM=Qwen32026.06 | 99.9 | |
| CSAEMLLM=Gemma-32026.06 | 99.4 | |
| Matryoshka SAEMLLM=Gemma-32026.06 | 98.5 | |
| CSAEMLLM=LLaVA2026.06 | 94.8 | |
| Matryoshka SAEMLLM=LLaVA2026.06 | 93.8 | |
| Stacked SAEMLLM=LLaVA2026.06 | 67.9 | |
| Stacked SAEMLLM=Gemma-32026.06 | 66.1 | |
| P-AnnealingMLLM=Gemma-32026.06 | 65.8 | |
| BatchTopKMLLM=Gemma-32026.06 | 64.1 | |
| Stacked SAEMLLM=Qwen32026.06 | 62.8 | |
| Gated SAEMLLM=Gemma-32026.06 | 61.2 | |
| P-AnnealingMLLM=Qwen32026.06 | 54.5 | |
| Gated SAEMLLM=Qwen32026.06 | 52 | |
| BatchTopKMLLM=Qwen32026.06 | 42 | |
| TopK SAEMLLM=Gemma-32026.06 | 38.9 | |
| Gated SAEMLLM=LLaVA2026.06 | 35.3 | |
| P-AnnealingMLLM=LLaVA2026.06 | 32.5 | |
| BatchTopKMLLM=LLaVA2026.06 | 32.2 | |
| JumpReLUMLLM=LLaVA2026.06 | 30.9 | |
| ReLU SAEMLLM=LLaVA2026.06 | 24.8 | |
| TopK SAEMLLM=LLaVA2026.06 | 24 | |
| ReLU SAEMLLM=Gemma-32026.06 | 22.4 | |
| ReLU SAEMLLM=Qwen32026.06 | 21.3 | |
| JumpReLUMLLM=Gemma-32026.06 | 13 | |
| JumpReLUMLLM=Qwen32026.06 | 12.7 | |
| TopK SAEMLLM=Qwen32026.06 | 10.8 |