List your company
ResearchFormerly WizWand

Language Modeling on WikiText2 2016 (test)

3.32PerplexityDense
2.80726.26869.7313.1914Dec 28, 2025
Updated 8mo ago

Evaluation results

MethodLinks
DenseModel=LLaMA2-70B, Sparsity=0%2025.123.32
SoBPModel=LLaMA2-70B, Sparsity=20%2025.123.88
OBCModel=LLaMA2-70B, Sparsity=20%2025.123.95
O-FANGModel=LLaMA2-70B, Sparsity=20%2025.123.97
F-FANGModel=LLaMA2-70B, Sparsity=20%2025.123.98
FLAPModel=LLaMA2-70B, Sparsity=20%2025.124.12
SoBPModel=LLaMA2-70B, Sparsity=30%2025.124.36
OBCModel=LLaMA2-70B, Sparsity=30%2025.124.4
SliceGPTModel=LLaMA2-70B, Sparsity=20%2025.124.46
F-FANGModel=LLaMA2-70B, Sparsity=30%2025.124.46
O-FANGModel=LLaMA2-70B, Sparsity=30%2025.124.46
SVD-LLMModel=LLaMA2-70B, Sparsity=20%2025.124.66
FLAPModel=LLaMA2-70B, Sparsity=30%2025.124.82
OBCModel=LLaMA2-70B, Sparsity=40%2025.124.87
DenseModel=LLaMA2-13B, Sparsity=0%2025.124.88
SoBPModel=LLaMA2-70B, Sparsity=40%2025.124.96
O-FANGModel=LLaMA2-70B, Sparsity=40%2025.125.01
F-FANGModel=LLaMA2-70B, Sparsity=40%2025.125.06
SliceGPTModel=LLaMA2-70B, Sparsity=30%2025.125.41
SVD-LLMModel=LLaMA2-70B, Sparsity=30%2025.125.44
DenseModel=LLaMA2-7B, Sparsity=0%2025.125.47
OBCModel=LLaMA2-13B, Sparsity=20%2025.125.53
O-FANGModel=LLaMA2-13B, Sparsity=20%2025.125.57
SoBPModel=LLaMA2-13B, Sparsity=20%2025.125.62
DenseModel=LLaMA1-7B, Sparsity=0%2025.125.68
F-FANGModel=LLaMA2-13B, Sparsity=20%2025.125.82
SliceGPTModel=LLaMA2-13B, Sparsity=20%2025.126.06
O-FANGModel=LLaMA2-13B, Sparsity=30%2025.126.17
FLAPModel=LLaMA2-70B, Sparsity=40%2025.126.24
SoBPModel=LLaMA2-13B, Sparsity=30%2025.126.27
OBCModel=LLaMA2-7B, Sparsity=20%2025.126.3
O-FANGModel=LLaMA2-7B, Sparsity=20%2025.126.31
FLAPModel=LLaMA2-13B, Sparsity=20%2025.126.31
O-FANGModel=LLaMA1-7B, Sparsity=20%2025.126.43
SoBPModel=LLaMA2-7B, Sparsity=20%2025.126.53
F-FANGModel=LLaMA2-13B, Sparsity=30%2025.126.53
OBCModel=LLaMA1-7B, Sparsity=20%2025.126.61
F-FANGModel=LLaMA2-7B, Sparsity=20%2025.126.63
SVD-LLMModel=LLaMA2-13B, Sparsity=20%2025.126.66
F-FANGModel=LLaMA1-7B, Sparsity=20%2025.126.7
SoBPModel=LLaMA1-7B, Sparsity=20%2025.126.78
SVD-LLMModel=LLaMA2-70B, Sparsity=40%2025.126.83
SliceGPTModel=LLaMA2-7B, Sparsity=20%2025.126.84
FLAPModel=LLaMA1-7B, Sparsity=20%2025.126.89
SliceGPTModel=LLaMA1-7B, Sparsity=20%2025.126.99
O-FANGModel=LLaMA2-13B, Sparsity=40%2025.127.04
SliceGPTModel=LLaMA2-70B, Sparsity=40%2025.127.08
FLAPModel=LLaMA2-7B, Sparsity=20%2025.127.16
O-FANGModel=LLaMA1-7B, Sparsity=30%2025.127.23
O-FANGModel=LLaMA2-7B, Sparsity=30%2025.127.23
OBCModel=LLaMA2-7B, Sparsity=30%2025.127.34
OBCModel=LLaMA1-7B, Sparsity=30%2025.127.38
SoBPModel=LLaMA2-13B, Sparsity=40%2025.127.39
SliceGPTModel=LLaMA2-13B, Sparsity=30%2025.127.44
SoBPModel=LLaMA1-7B, Sparsity=30%2025.127.57
FLAPModel=LLaMA2-13B, Sparsity=30%2025.127.57
SoBPModel=LLaMA2-7B, Sparsity=30%2025.127.58
OBCModel=LLaMA2-13B, Sparsity=30%2025.127.72
F-FANGModel=LLaMA2-7B, Sparsity=30%2025.127.78
F-FANGModel=LLaMA2-13B, Sparsity=40%2025.127.84
SVD-LLMModel=LLaMA1-7B, Sparsity=20%2025.127.89
F-FANGModel=LLaMA1-7B, Sparsity=30%2025.127.94
SVD-LLMModel=LLaMA2-13B, Sparsity=30%2025.128
FLAPModel=LLaMA1-7B, Sparsity=30%2025.128.23
SVD-LLMModel=LLaMA2-7B, Sparsity=20%2025.128.38
O-FANGModel=LLaMA1-7B, Sparsity=40%2025.128.56
SliceGPTModel=LLaMA2-7B, Sparsity=30%2025.128.64
O-FANGModel=LLaMA2-7B, Sparsity=40%2025.128.67
SliceGPTModel=LLaMA1-7B, Sparsity=30%2025.128.69
FLAPModel=LLaMA2-7B, Sparsity=30%2025.128.85
OBCModel=LLaMA1-7B, Sparsity=40%2025.128.85
FLAPModel=LLaMA2-13B, Sparsity=40%2025.129.07
SoBPModel=LLaMA1-7B, Sparsity=40%2025.129.09
OBCModel=LLaMA2-7B, Sparsity=40%2025.129.13
SoBPModel=LLaMA2-7B, Sparsity=40%2025.129.28
SVD-LLMModel=LLaMA1-7B, Sparsity=30%2025.129.52
FLAPModel=LLaMA1-7B, Sparsity=40%2025.1210.16
F-FANGModel=LLaMA1-7B, Sparsity=40%2025.1210.31
F-FANGModel=LLaMA2-7B, Sparsity=40%2025.1210.34
SliceGPTModel=LLaMA2-13B, Sparsity=40%2025.1210.6
SVD-LLMModel=LLaMA2-7B, Sparsity=30%2025.1210.66
SVD-LLMModel=LLaMA2-13B, Sparsity=40%2025.1210.79
FLAPModel=LLaMA2-7B, Sparsity=40%2025.1211.49
OBCModel=LLaMA2-13B, Sparsity=40%2025.1211.67
SliceGPTModel=LLaMA2-7B, Sparsity=40%2025.1212.8
SVD-LLMModel=LLaMA1-7B, Sparsity=40%2025.1213.85
SliceGPTModel=LLaMA1-7B, Sparsity=40%2025.1215.94
SVD-LLMModel=LLaMA2-7B, Sparsity=40%2025.1216.14