List your company
ResearchFormerly WizWand

Language Model Performance Evaluation on LLM Evaluation Benchmark

92.27PerformanceOracleTopP
27.717244.476161.23577.9939Oct 7, 2025
Updated 5mo ago

Evaluation results

MethodLinks
OracleTopPModel=Qwen3-30B-A3B-Instruct-2507, Density=2%2025.1092.27
OracleTopPModel=Qwen3-30B-A3B-Instruct-2507, Density=5%2025.1091.75
PQCacheModel=Qwen3-30B-A3B-Instruct-2507, Density=10%2025.1091.52
OracleTopKModel=Qwen3-30B-A3B-Instruct-2507, Density=10%2025.1091.41
OracleTopPModel=Qwen3-30B-A3B-Instruct-2507, Density=10%2025.1091.33
OracleTopPModel=Qwen3-30B-A3B-Instruct-2507, Density=20%2025.1091.33
PQCacheModel=Qwen3-30B-A3B-Instruct-2507, Density=20%2025.1091.17
OracleTopKModel=Qwen3-30B-A3B-Instruct-2507, Density=5%2025.1091.11
OracleTopKModel=Qwen3-30B-A3B-Instruct-2507, Density=20%2025.1091.08
denseModel=Qwen3-30B-A3B-Instruct-2507, Density=100%2025.1091.02
PQCacheModel=Qwen3-30B-A3B-Instruct-2507, Density=5%2025.1090.94
PQCacheModel=Qwen3-30B-A3B-Instruct-2507, Density=2%2025.1090.91
vAttention(OracleTopK)Model=Qwen3-30B-A3B-Instruct-2507, Density=2%2025.1090.89
vAttention(OracleTopK)Model=Qwen3-30B-A3B-Instruct-2507, Density=5%2025.1090.89
vAttention(OracleTopK)Model=Qwen3-30B-A3B-Instruct-2507, Density=10%2025.1090.8
vAttention(OracleTopK)Model=Qwen3-30B-A3B-Instruct-2507, Density=20%2025.1090.63
OracleTopKModel=Qwen3-30B-A3B-Instruct-2507, Density=2%2025.1090.58
OracleTopPModel=Qwen3-4B-Instruct-2507, Density=2%2025.1088.83
denseModel=Qwen3-4B-Instruct-2507, Density=100%2025.1088.67
OracleTopPModel=Qwen3-4B-Instruct-2507, Density=10%2025.1088.33
OracleTopKModel=Qwen3-4B-Instruct-2507, Density=20%2025.1088.22
vAttention(OracleTopK)Model=Qwen3-4B-Instruct-2507, Density=20%2025.1088.22
vAttention(OracleTopK)Model=Qwen3-4B-Instruct-2507, Density=5%2025.1088.17
vAttention(OracleTopK)Model=Llama-3.1-8B-Instruct, Density=20%2025.1088.11
OracleTopPModel=Qwen3-4B-Instruct-2507, Density=5%2025.1088.06
denseModel=Llama-3.1-8B-Instruct, Density=100%2025.1087.89
OracleTopPModel=Qwen3-4B-Instruct-2507, Density=20%2025.1087.72
PQCacheModel=Qwen3-4B-Instruct-2507, Density=10%2025.1087.67
PQCacheModel=Qwen3-4B-Instruct-2507, Density=20%2025.1087.67
OracleTopPModel=Llama-3.1-8B-Instruct, Density=20%2025.1087.62
vAttention(OracleTopK)Model=Qwen3-4B-Instruct-2507, Density=2%2025.1087.61
OracleTopKModel=Qwen3-4B-Instruct-2507, Density=10%2025.1087.61
PQCacheModel=Qwen3-4B-Instruct-2507, Density=5%2025.1087.56
vAttention(OracleTopK)Model=Llama-3.1-8B-Instruct, Density=10%2025.1087.5
OracleTopPModel=Llama-3.1-8B-Instruct, Density=10%2025.1087.45
OracleTopKModel=Qwen3-4B-Instruct-2507, Density=5%2025.1087.44
vAttention(OracleTopK)Model=Llama-3.1-8B-Instruct, Density=2%2025.1087.18
OracleTopPModel=Llama-3.1-8B-Instruct, Density=5%2025.1087.01
PQCacheModel=Llama-3.1-8B-Instruct, Density=20%2025.1086.98
vAttention(OracleTopK)Model=Qwen3-4B-Instruct-2507, Density=10%2025.1086.94
OracleTopKModel=Llama-3.1-8B-Instruct, Density=20%2025.1086.9
vAttention(OracleTopK)Model=Llama-3.1-8B-Instruct, Density=5%2025.1086.72
OracleTopKModel=Llama-3.1-8B-Instruct, Density=10%2025.1086.37
OracleTopKModel=Qwen3-4B-Instruct-2507, Density=2%2025.1086.33
PQCacheModel=Llama-3.1-8B-Instruct, Density=10%2025.1086.29
OracleTopPModel=Llama-3.1-8B-Instruct, Density=2%2025.1086.07
PQCacheModel=Qwen3-4B-Instruct-2507, Density=2%2025.1085.8
OracleTopKModel=Llama-3.1-8B-Instruct, Density=5%2025.1083.83
DoubleSparsityModel=Llama-3.1-8B-Instruct, Density=20%2025.1083.4
PQCacheModel=Llama-3.1-8B-Instruct, Density=5%2025.1083.14
MagicPigModel=Qwen3-4B-Instruct-2507, Density=20%2025.1076.37
DoubleSparsityModel=Llama-3.1-8B-Instruct, Density=10%2025.1074.75
OracleTopKModel=Llama-3.1-8B-Instruct, Density=2%2025.1074.1
MagicPigModel=Qwen3-30B-A3B-Instruct-2507, Density=20%2025.1069.25
PQCacheModel=Llama-3.1-8B-Instruct, Density=2%2025.1068.95
denseModel=Llama-3.2-3B-Instruct, Density=100%2025.1066.25
vAttention(OracleTopK)Model=Llama-3.2-3B-Instruct, Density=20%2025.1065.95
vAttention(OracleTopK)Model=Llama-3.2-3B-Instruct, Density=5%2025.1065.45
vAttention(OracleTopK)Model=Llama-3.2-3B-Instruct, Density=10%2025.1065.09
OracleTopPModel=Llama-3.2-3B-Instruct, Density=20%2025.1062.15
DoubleSparsityModel=Qwen3-30B-A3B-Instruct-2507, Density=20%2025.1059.57
OracleTopPModel=Llama-3.2-3B-Instruct, Density=10%2025.1059.34
vAttention(OracleTopK)Model=Llama-3.2-3B-Instruct, Density=2%2025.1059.25
PQCacheModel=Llama-3.2-3B-Instruct, Density=20%2025.1059.25
OracleTopKModel=Llama-3.2-3B-Instruct, Density=20%2025.1059
OracleTopPModel=Llama-3.2-3B-Instruct, Density=5%2025.1056.41
OracleTopKModel=Llama-3.2-3B-Instruct, Density=10%2025.1053.33
DoubleSparsityModel=Llama-3.1-8B-Instruct, Density=5%2025.1052.83
PQCacheModel=Llama-3.2-3B-Instruct, Density=10%2025.1051.72
OracleTopPModel=Llama-3.2-3B-Instruct, Density=2%2025.1051.19
DoubleSparsityModel=Qwen3-4B-Instruct-2507, Density=20%2025.1047.5
OracleTopKModel=Llama-3.2-3B-Instruct, Density=5%2025.1047.32
PQCacheModel=Llama-3.2-3B-Instruct, Density=5%2025.1046.32
MagicPigModel=Llama-3.1-8B-Instruct, Density=20%2025.1044.08
OracleTopKModel=Llama-3.2-3B-Instruct, Density=2%2025.1041.57
DoubleSparsityModel=Llama-3.2-3B-Instruct, Density=20%2025.1040.26
MagicPigModel=Qwen3-4B-Instruct-2507, Density=10%2025.1039.63
PQCacheModel=Llama-3.2-3B-Instruct, Density=2%2025.1039.3
MagicPigModel=Qwen3-30B-A3B-Instruct-2507, Density=10%2025.1038.43
vAttention(OracleTopK)Model=Llama-3.2-1B-Instruct, Density=10%2025.1037.83
vAttention(OracleTopK)Model=Llama-3.2-1B-Instruct, Density=5%2025.1037.8
vAttention(OracleTopK)Model=Llama-3.2-1B-Instruct, Density=20%2025.1037.51
denseModel=Llama-3.2-1B-Instruct, Density=100%2025.1037.47
vAttention(OracleTopK)Model=Llama-3.2-1B-Instruct, Density=2%2025.1036.78
DoubleSparsityModel=Qwen3-30B-A3B-Instruct-2507, Density=10%2025.1036.2
MagicPigModel=Llama-3.2-3B-Instruct, Density=20%2025.1036.19
PQCacheModel=Llama-3.2-1B-Instruct, Density=10%2025.1036.18
OracleTopPModel=Llama-3.2-1B-Instruct, Density=20%2025.1036
PQCacheModel=Llama-3.2-1B-Instruct, Density=20%2025.1035.97
OracleTopKModel=Llama-3.2-1B-Instruct, Density=20%2025.1035.89
OracleTopPModel=Llama-3.2-1B-Instruct, Density=10%2025.1035.81
OracleTopKModel=Llama-3.2-1B-Instruct, Density=10%2025.1035.22
DoubleSparsityModel=Llama-3.1-8B-Instruct, Density=2%2025.1034.9
OracleTopPModel=Llama-3.2-1B-Instruct, Density=5%2025.1034.74
OracleTopKModel=Llama-3.2-1B-Instruct, Density=5%2025.1032.66
MagicPigModel=Qwen3-30B-A3B-Instruct-2507, Density=5%2025.1032.5
OracleTopPModel=Llama-3.2-1B-Instruct, Density=2%2025.1031.3
DoubleSparsityModel=Llama-3.2-3B-Instruct, Density=10%2025.1030.77
PQCacheModel=Llama-3.2-1B-Instruct, Density=5%2025.1030.47
MagicPigModel=Llama-3.1-8B-Instruct, Density=10%2025.1030.2