LLM Similarity Measurement on Unstructured Pruning
1Similarity ScoreLogits
Evaluation Results
| Method | Links | |
|---|---|---|
| LogitsPruning Ratio=30%2026.07 | 1 | |
| LogitsPruning Ratio=50%2026.07 | 1 | |
| PCSPruning Ratio=30%2026.07 | 0.99 | |
| REEFPruning Ratio=30%2026.07 | 0.99 | |
| GhostSpecPruning Ratio=30%2026.07 | 0.99 | |
| LogitsPruning Ratio=70%2026.07 | 0.99 | |
| REEFPruning Ratio=50%2026.07 | 0.98 | |
| REEFPruning Ratio=70%2026.07 | 0.98 | |
| PCSPruning Ratio=50%2026.07 | 0.9 | |
| Spectral SignaturePruning Ratio=30%2026.07 | 0.89 | |
| GhostSpecPruning Ratio=50%2026.07 | 0.89 | |
| Spectral SignaturePruning Ratio=50%2026.07 | 0.89 | |
| PCSPruning Ratio=70%2026.07 | 0.78 | |
| GhostSpecPruning Ratio=70%2026.07 | 0.7 | |
| Spectral SignaturePruning Ratio=70%2026.07 | 0.4 |