List your company
ResearchFormerly WizWand

Large Language Model Evaluation on 10 tasks average

70.56Avg AccuracyDeltaLoss-only
57.8261.127564.43567.7425Dec 4, 2025
Updated 8mo ago

Evaluation results

MethodLinks
DeltaLoss-onlyAvg. Bits=6, Model=Llama3.1-70B-I2025.1270.56100.8
SignRoundV2Avg. Bits=6, Model=Llama3.1-70B-I2025.1270.5100.71
SignRoundV2Avg. Bits=5, Model=Llama3.1-70B-I2025.1270.31100.45
DeltaLoss-onlyAvg. Bits=5, Model=Llama3.1-70B-I2025.1270.1100.15
16bitsAvg. Bits=16, Model=Llama3.1-70B-I2025.1270—
SignRoundV2Avg. Bits=4.5, Model=Llama3.1-70B-I2025.1269.9699.95
DeltaLoss-onlyAvg. Bits=4.5, Model=Llama3.1-70B-I2025.1269.7899.7
SignRoundV2Avg. Bits=4, Model=Llama3.1-70B-I2025.1269.3299.04
SignRoundV1Avg. Bits=4, Model=Llama3.1-70B-I2025.1269.0198.6
RTNAvg. Bits=4, Model=Llama3.1-70B-I2025.1268.7198.16
SignRoundV2Avg. Bits=6, Model=Qwen3-32B2025.1267.21100.32
SignRoundV2Avg. Bits=5, Model=Qwen3-32B2025.1267.17100.25
16bitsAvg. Bits=16, Model=Qwen3-32B2025.1267—
SignRoundV1Avg. Bits=4, Model=Qwen3-32B2025.1266.9299.88
SignRoundV2Avg. Bits=4.5, Model=Qwen3-32B2025.1266.8999.83
SignRoundV2Avg. Bits=4, Model=Qwen3-32B2025.1266.8699.79
DeltaLoss-onlyAvg. Bits=6, Model=Qwen3-32B2025.1266.6199.42
DeltaLoss-onlyAvg. Bits=4.5, Model=Qwen3-32B2025.1266.0598.58
DeltaLoss-onlyAvg. Bits=5, Model=Qwen3-32B2025.126698.51
16bitsAvg. Bits=16, Model=Qwen2.5-7B-I2025.1265.67—
DeltaLoss-onlyAvg. Bits=6, Model=Qwen2.5-7B-I2025.1265.4599.67
SignRoundV2Avg. Bits=6, Model=Qwen2.5-7B-I2025.1265.399.43
RTNAvg. Bits=4, Model=Qwen3-32B2025.1265.0797.12
SignRoundV2Avg. Bits=5, Model=Qwen2.5-7B-I2025.1265.0499.03
SignRoundV2Avg. Bits=4.5, Model=Qwen2.5-7B-I2025.1264.5198.24
16bitsAvg. Bits=16, Model=Llama3.1-8B-I2025.1264.16—
SignRoundV2Avg. Bits=6, Model=Llama3.1-8B-I2025.1264.1299.93
SignRoundV1Avg. Bits=4, Model=Qwen2.5-7B-I2025.1264.0697.55
DeltaLoss-onlyAvg. Bits=5, Model=Qwen2.5-7B-I2025.1264.0497.52
DeltaLoss-onlyAvg. Bits=6, Model=Llama3.1-8B-I2025.1263.6499.18
SignRoundV2Avg. Bits=4, Model=Qwen2.5-7B-I2025.1263.3796.5
16bitsAvg. Bits=16, Model=Qwen3-8B2025.1263.24—
SignRoundV2Avg. Bits=5, Model=Llama3.1-8B-I2025.1263.1998.49
DeltaLoss-onlyAvg. Bits=4.5, Model=Qwen2.5-7B-I2025.1263.1396.13
DeltaLoss-onlyAvg. Bits=5, Model=Llama3.1-8B-I2025.1262.5797.51
SignRoundV2Avg. Bits=5, Model=Qwen3-8B2025.1262.5498.89
SignRoundV2Avg. Bits=4.5, Model=Llama3.1-8B-I2025.1262.3397.14
SignRoundV2Avg. Bits=4.5, Model=Qwen3-8B2025.1262.2898.49
SignRoundV2Avg. Bits=6, Model=Qwen3-8B2025.1262.1998.34
DeltaLoss-onlyAvg. Bits=6, Model=Qwen3-8B2025.126298.04
SignRoundV2Avg. Bits=4, Model=Qwen3-8B2025.1261.8997.87
DeltaLoss-onlyAvg. Bits=5, Model=Qwen3-8B2025.1261.4597.18
SignRoundV2Avg. Bits=4, Model=Llama3.1-8B-I2025.1261.3495.59
SignRoundV1Avg. Bits=4, Model=Llama3.1-8B-I2025.1260.7294.64
DeltaLoss-onlyAvg. Bits=4.5, Model=Llama3.1-8B-I2025.1260.6494.5
RTNAvg. Bits=4, Model=Qwen2.5-7B-I2025.1260.6292.32
SignRoundV1Avg. Bits=4, Model=Qwen3-8B2025.1260.2595.28
DeltaLoss-onlyAvg. Bits=4.5, Model=Qwen3-8B2025.1259.8194.58
RTNAvg. Bits=4, Model=Qwen3-8B2025.1258.5492.57
RTNAvg. Bits=4, Model=Llama3.1-8B-I2025.1258.3190.88