List your company
ResearchFormerly WizWand

Language Modeling on WT2, PTB, and C4 Macro Average (test)

13.1PerplexityAWQ
12.3217.58522.8528.115Mar 11, 2026
Updated 7mo ago

Evaluation results

MethodLinks
AWQModel=OPT-6.7B, Quantization (bits)=5 bits, Calibration Dataset=WT2, Groupsize=32, Calibration tokens=2^172026.0313.1
AWQModel=OPT-6.7B, Quantization (bits)=5 bits, Calibration Dataset=PTB, Groupsize=32, Calibration tokens=2^172026.0313.1
AWQModel=OPT-6.7B, Quantization (bits)=5 bits, Calibration Dataset=C4, Groupsize=32, Calibration tokens=2^172026.0313.1
TTQModel=OPT-6.7B, Quantization (bits)=5 bits, Rank (r)=0, Groupsize=322026.0313.1
TTQModel=OPT-6.7B, Quantization (bits)=4 bits, Rank (r)=16, Groupsize=322026.0313.1
TTQModel=OPT-6.7B, Quantization (bits)=5 bits, Rank (r)=16, Groupsize=322026.0313.1
RTNModel=OPT-6.7B, Quantization (bits)=5 bits, Groupsize=322026.0313.2
AWQModel=OPT-6.7B, Quantization (bits)=4 bits, Calibration Dataset=WT2, Groupsize=32, Calibration tokens=2^172026.0313.2
AWQModel=OPT-6.7B, Quantization (bits)=4 bits, Calibration Dataset=PTB, Groupsize=32, Calibration tokens=2^172026.0313.2
AWQModel=OPT-6.7B, Quantization (bits)=4 bits, Calibration Dataset=C4, Groupsize=32, Calibration tokens=2^172026.0313.2
TTQModel=OPT-6.7B, Quantization (bits)=4 bits, Rank (r)=0, Groupsize=322026.0313.2
TTQModel=OPT-6.7B, Quantization (bits)=3 bits, Rank (r)=16, Groupsize=322026.0313.4
AWQModel=OPT-6.7B, Quantization (bits)=3 bits, Calibration Dataset=WT2, Groupsize=32, Calibration tokens=2^172026.0313.5
AWQModel=OPT-6.7B, Quantization (bits)=3 bits, Calibration Dataset=PTB, Groupsize=32, Calibration tokens=2^172026.0313.6
AWQModel=OPT-6.7B, Quantization (bits)=3 bits, Calibration Dataset=C4, Groupsize=32, Calibration tokens=2^172026.0313.6
TTQModel=OPT-6.7B, Quantization (bits)=3 bits, Rank (r)=0, Groupsize=322026.0313.6
RTNModel=OPT-6.7B, Quantization (bits)=4 bits, Groupsize=322026.0313.7
TTQModel=OPT-2.7B, Quantization (bits)=5 bits, Rank (r)=0, Groupsize=322026.0314.9
TTQModel=OPT-2.7B, Quantization (bits)=5 bits, Rank (r)=16, Groupsize=322026.0314.9
RTNModel=OPT-2.7B, Quantization (bits)=5 bits, Groupsize=322026.0315
AWQModel=OPT-2.7B, Quantization (bits)=5 bits, Calibration Dataset=WT2, Groupsize=32, Calibration tokens=2^172026.0315
AWQModel=OPT-2.7B, Quantization (bits)=4 bits, Calibration Dataset=PTB, Groupsize=32, Calibration tokens=2^172026.0315
AWQModel=OPT-2.7B, Quantization (bits)=5 bits, Calibration Dataset=PTB, Groupsize=32, Calibration tokens=2^172026.0315
AWQModel=OPT-2.7B, Quantization (bits)=4 bits, Calibration Dataset=C4, Groupsize=32, Calibration tokens=2^172026.0315
AWQModel=OPT-2.7B, Quantization (bits)=5 bits, Calibration Dataset=C4, Groupsize=32, Calibration tokens=2^172026.0315
TTQModel=OPT-2.7B, Quantization (bits)=4 bits, Rank (r)=0, Groupsize=322026.0315
TTQModel=OPT-2.7B, Quantization (bits)=4 bits, Rank (r)=16, Groupsize=322026.0315
AWQModel=OPT-2.7B, Quantization (bits)=4 bits, Calibration Dataset=WT2, Groupsize=32, Calibration tokens=2^172026.0315.1
TTQModel=OPT-2.7B, Quantization (bits)=3 bits, Rank (r)=16, Groupsize=322026.0315.5
RTNModel=OPT-2.7B, Quantization (bits)=4 bits, Groupsize=322026.0315.7
AWQModel=OPT-2.7B, Quantization (bits)=3 bits, Calibration Dataset=WT2, Groupsize=32, Calibration tokens=2^172026.0315.7
AWQModel=OPT-2.7B, Quantization (bits)=3 bits, Calibration Dataset=PTB, Groupsize=32, Calibration tokens=2^172026.0315.7
AWQModel=OPT-2.7B, Quantization (bits)=3 bits, Calibration Dataset=C4, Groupsize=32, Calibration tokens=2^172026.0315.7
TTQModel=OPT-2.7B, Quantization (bits)=3 bits, Rank (r)=0, Groupsize=322026.0315.7
TTQModel=OPT-6.7B, Quantization (bits)=2 bits, Rank (r)=16, Groupsize=322026.0316.3
AWQModel=OPT-6.7B, Quantization (bits)=2 bits, Calibration Dataset=C4, Groupsize=32, Calibration tokens=2^172026.0316.9
AWQModel=OPT-1.3B, Quantization (bits)=5 bits, Calibration Dataset=WT2, Groupsize=32, Calibration tokens=2^172026.0317
AWQModel=OPT-1.3B, Quantization (bits)=5 bits, Calibration Dataset=PTB, Groupsize=32, Calibration tokens=2^172026.0317
AWQModel=OPT-1.3B, Quantization (bits)=5 bits, Calibration Dataset=C4, Groupsize=32, Calibration tokens=2^172026.0317
TTQModel=OPT-1.3B, Quantization (bits)=5 bits, Rank (r)=0, Groupsize=322026.0317
TTQModel=OPT-1.3B, Quantization (bits)=5 bits, Rank (r)=16, Groupsize=322026.0317
TTQModel=OPT-1.3B, Quantization (bits)=4 bits, Rank (r)=16, Groupsize=322026.0317.1
AWQModel=OPT-6.7B, Quantization (bits)=2 bits, Calibration Dataset=PTB, Groupsize=32, Calibration tokens=2^172026.0317.1
RTNModel=OPT-1.3B, Quantization (bits)=5 bits, Groupsize=322026.0317.2
AWQModel=OPT-1.3B, Quantization (bits)=4 bits, Calibration Dataset=C4, Groupsize=32, Calibration tokens=2^172026.0317.2
TTQModel=OPT-1.3B, Quantization (bits)=4 bits, Rank (r)=0, Groupsize=322026.0317.2
AWQModel=OPT-6.7B, Quantization (bits)=2 bits, Calibration Dataset=WT2, Groupsize=32, Calibration tokens=2^172026.0317.2
TTQModel=OPT-6.7B, Quantization (bits)=2 bits, Rank (r)=0, Groupsize=322026.0317.2
AWQModel=OPT-1.3B, Quantization (bits)=4 bits, Calibration Dataset=WT2, Groupsize=32, Calibration tokens=2^172026.0317.3
AWQModel=OPT-1.3B, Quantization (bits)=4 bits, Calibration Dataset=PTB, Groupsize=32, Calibration tokens=2^172026.0317.3
TTQModel=OPT-1.3B, Quantization (bits)=3 bits, Rank (r)=16, Groupsize=322026.0317.9
AWQModel=OPT-1.3B, Quantization (bits)=3 bits, Calibration Dataset=WT2, Groupsize=32, Calibration tokens=2^172026.0318
AWQModel=OPT-1.3B, Quantization (bits)=3 bits, Calibration Dataset=C4, Groupsize=32, Calibration tokens=2^172026.0318
RTNModel=OPT-1.3B, Quantization (bits)=4 bits, Groupsize=322026.0318.1
AWQModel=OPT-1.3B, Quantization (bits)=3 bits, Calibration Dataset=PTB, Groupsize=32, Calibration tokens=2^172026.0318.1
TTQModel=OPT-1.3B, Quantization (bits)=3 bits, Rank (r)=0, Groupsize=322026.0318.2
TTQModel=OPT-2.7B, Quantization (bits)=2 bits, Rank (r)=16, Groupsize=322026.0321.2
AWQModel=OPT-2.7B, Quantization (bits)=2 bits, Calibration Dataset=C4, Groupsize=32, Calibration tokens=2^172026.0322.9
AWQModel=OPT-2.7B, Quantization (bits)=2 bits, Calibration Dataset=WT2, Groupsize=32, Calibration tokens=2^172026.0323.1
AWQModel=OPT-2.7B, Quantization (bits)=2 bits, Calibration Dataset=PTB, Groupsize=32, Calibration tokens=2^172026.0323.2
TTQModel=OPT-2.7B, Quantization (bits)=2 bits, Rank (r)=0, Groupsize=322026.0323.7
TTQModel=Qwen3-1.7B, Quantization (bits)=5 bits, Rank (r)=16, Groupsize=322026.0324.1
TTQModel=Qwen3-1.7B, Quantization (bits)=5 bits, Rank (r)=0, Groupsize=322026.0324.3
TTQModel=Qwen3-1.7B, Quantization (bits)=4 bits, Rank (r)=16, Groupsize=322026.0324.3
AWQModel=Qwen3-1.7B, Quantization (bits)=5 bits, Calibration Dataset=WT2, Groupsize=32, Calibration tokens=2^172026.0324.4
AWQModel=Qwen3-1.7B, Quantization (bits)=5 bits, Calibration Dataset=C4, Groupsize=32, Calibration tokens=2^172026.0324.4
TTQModel=Qwen3-1.7B, Quantization (bits)=4 bits, Rank (r)=0, Groupsize=322026.0324.4
AWQModel=Qwen3-1.7B, Quantization (bits)=4 bits, Calibration Dataset=WT2, Groupsize=32, Calibration tokens=2^172026.0324.5
AWQModel=Qwen3-1.7B, Quantization (bits)=5 bits, Calibration Dataset=PTB, Groupsize=32, Calibration tokens=2^172026.0324.5
AWQModel=Qwen3-1.7B, Quantization (bits)=4 bits, Calibration Dataset=PTB, Groupsize=32, Calibration tokens=2^172026.0324.7
AWQModel=Qwen3-1.7B, Quantization (bits)=4 bits, Calibration Dataset=C4, Groupsize=32, Calibration tokens=2^172026.0324.9
RTNModel=Qwen3-1.7B, Quantization (bits)=5 bits, Groupsize=322026.0326.1
RTNModel=OPT-6.7B, Quantization (bits)=3 bits, Groupsize=322026.0326.2
TTQModel=Qwen3-1.7B, Quantization (bits)=3 bits, Rank (r)=16, Groupsize=322026.0326.4
RTNModel=OPT-1.3B, Quantization (bits)=3 bits, Groupsize=322026.0327.2
TTQModel=OPT-1.3B, Quantization (bits)=2 bits, Rank (r)=16, Groupsize=322026.0327.2
TTQModel=Qwen3-1.7B, Quantization (bits)=3 bits, Rank (r)=0, Groupsize=322026.0327.3
AWQModel=Qwen3-1.7B, Quantization (bits)=3 bits, Calibration Dataset=C4, Groupsize=32, Calibration tokens=2^172026.0328.2
AWQModel=Qwen3-1.7B, Quantization (bits)=3 bits, Calibration Dataset=PTB, Groupsize=32, Calibration tokens=2^172026.0329.8
AWQModel=Qwen3-1.7B, Quantization (bits)=3 bits, Calibration Dataset=WT2, Groupsize=32, Calibration tokens=2^172026.0330
RTNModel=Qwen3-1.7B, Quantization (bits)=4 bits, Groupsize=322026.0330.6
TTQModel=OPT-125M, Quantization (bits)=5 bits, Rank (r)=16, Groupsize=322026.0331.1
TTQModel=OPT-125M, Quantization (bits)=5 bits, Rank (r)=0, Groupsize=322026.0331.2
AWQModel=OPT-125M, Quantization (bits)=5 bits, Calibration Dataset=PTB, Groupsize=32, Calibration tokens=2^172026.0331.3
AWQModel=OPT-125M, Quantization (bits)=5 bits, Calibration Dataset=C4, Groupsize=32, Calibration tokens=2^172026.0331.3
AWQModel=OPT-125M, Quantization (bits)=5 bits, Calibration Dataset=WT2, Groupsize=32, Calibration tokens=2^172026.0331.4
AWQModel=OPT-1.3B, Quantization (bits)=2 bits, Calibration Dataset=C4, Groupsize=32, Calibration tokens=2^172026.0331.7
RTNModel=OPT-125M, Quantization (bits)=5 bits, Groupsize=322026.0331.8
TTQModel=OPT-125M, Quantization (bits)=4 bits, Rank (r)=16, Groupsize=322026.0331.8
TTQModel=OPT-125M, Quantization (bits)=4 bits, Rank (r)=0, Groupsize=322026.0331.9
TTQModel=Qwen3-0.6B, Quantization (bits)=5 bits, Rank (r)=0, Groupsize=322026.0331.9
TTQModel=Qwen3-0.6B, Quantization (bits)=5 bits, Rank (r)=16, Groupsize=322026.0331.9
AWQModel=Qwen3-0.6B, Quantization (bits)=5 bits, Calibration Dataset=PTB, Groupsize=32, Calibration tokens=2^172026.0332
AWQModel=Qwen3-0.6B, Quantization (bits)=5 bits, Calibration Dataset=C4, Groupsize=32, Calibration tokens=2^172026.0332.1
AWQModel=OPT-125M, Quantization (bits)=4 bits, Calibration Dataset=PTB, Groupsize=32, Calibration tokens=2^172026.0332.2
TTQModel=OPT-1.3B, Quantization (bits)=2 bits, Rank (r)=0, Groupsize=322026.0332.2
AWQModel=OPT-125M, Quantization (bits)=4 bits, Calibration Dataset=WT2, Groupsize=32, Calibration tokens=2^172026.0332.3
AWQModel=OPT-1.3B, Quantization (bits)=2 bits, Calibration Dataset=WT2, Groupsize=32, Calibration tokens=2^172026.0332.4
AWQModel=Qwen3-0.6B, Quantization (bits)=5 bits, Calibration Dataset=WT2, Groupsize=32, Calibration tokens=2^172026.0332.4
AWQModel=OPT-125M, Quantization (bits)=4 bits, Calibration Dataset=C4, Groupsize=32, Calibration tokens=2^172026.0332.6