General Knowledge Utility on MMLU (Drop in Utility)
-17.6Drop in UtilityLatent Similarity
Evaluation results
| Method | Links | |
|---|---|---|
| Latent SimilaritySelection Criterion=Latent Similarity, Layer=Best Layer2026.04 | -17.6 | |
| PerplexitySelection Criterion=Perplexity2026.04 | -1.7 | |
| RandomSelection Criterion=Random2026.04 | 1 | |
| Self CertaintySelection Criterion=Self Certainty2026.04 | 5.8 | |
| Latent SimilaritySelection Criterion=Latent Similarity, Layer=122026.04 | 11.4 | |
| KLSelection Criterion=KL2026.04 | 36.4 |