Long-context understanding on LongEval
79ScoreFP
Evaluation results
| Method | Links | |
|---|---|---|
| FPModel=Qwen2.5-32B, Compression Ratio=1.02026.02 | 79 | |
| SAES-SVDModel=Qwen2.5-32B, Compression Ratio=0.22026.02 | 76 | |
| SVD-LLMModel=Qwen2.5-32B, Compression Ratio=0.22026.02 | 73 | |
| ASVDModel=Qwen2.5-32B, Compression Ratio=0.22026.02 | 61 | |
| FPModel=Qwen2.5-7B, Compression Ratio=1.02026.02 | 58 | |
| SAES-SVDModel=Qwen2.5-7B, Compression Ratio=0.22026.02 | 57 | |
| SVD-LLMModel=Qwen2.5-7B, Compression Ratio=0.22026.02 | 55 | |
| FPModel=LLaMA3.1-70B, Compression Ratio=1.02026.02 | 49 | |
| ASVDModel=Qwen2.5-7B, Compression Ratio=0.22026.02 | 49 | |
| SAES-SVDModel=LLaMA3.1-70B, Compression Ratio=0.22026.02 | 48 | |
| SVD-LLMModel=LLaMA3.1-70B, Compression Ratio=0.22026.02 | 45 | |
| FPModel=LLaMA3.1-8B, Compression Ratio=1.02026.02 | 41 | |
| SAES-SVDModel=LLaMA3.1-8B, Compression Ratio=0.22026.02 | 39 | |
| ASVDModel=LLaMA3.1-70B, Compression Ratio=0.22026.02 | 39 | |
| SVD-LLMModel=LLaMA3.1-8B, Compression Ratio=0.22026.02 | 37 | |
| ASVDModel=LLaMA3.1-8B, Compression Ratio=0.22026.02 | 33 |