List your company
ResearchFormerly WizWand

Fused CUDA kernel latency evaluation on normalized synthetic vectors

6.1Latency (µs)IsoQuant-Fast
4.22816.86429.542.136Mar 30, 2026
Updated 7mo ago

Evaluation results

MethodLinks
IsoQuant-Fastdtype=fp16, bits=3, dim=128, batch size=81922026.036.16
IsoQuant-Fulldtype=fp16, bits=3, dim=128, batch size=81922026.036.25.92
IsoQuant-2Ddtype=fp16, bits=3, dim=128, batch size=81922026.036.25.92
IsoQuant-Fulldtype=fp32, bits=3, dim=128, batch size=81922026.036.95.07
IsoQuant-2Ddtype=fp32, bits=3, dim=256, batch size=81922026.036.95.47
IsoQuant-2Ddtype=fp32, bits=2, dim=128, batch size=81922026.0374.77
IsoQuant-Fastdtype=fp32, bits=3, dim=256, batch size=81922026.0375.45
IsoQuant-Fastdtype=fp32, bits=2, dim=128, batch size=81922026.037.14.68
IsoQuant-2Ddtype=fp32, bits=3, dim=128, batch size=81922026.037.14.91
IsoQuant-Fastdtype=fp32, bits=2, dim=256, batch size=81922026.037.24.66
IsoQuant-2Ddtype=fp32, bits=2, dim=256, batch size=81922026.037.24.66
IsoQuant-Fulldtype=fp32, bits=3, dim=256, batch size=81922026.037.25.29
IsoQuant-Fulldtype=fp32, bits=2, dim=128, batch size=81922026.037.34.6
IsoQuant-Fulldtype=fp32, bits=2, dim=256, batch size=81922026.037.44.59
IsoQuant-Fastdtype=fp16, bits=4, dim=256, batch size=81922026.037.56.24
IsoQuant-2Ddtype=fp16, bits=4, dim=256, batch size=81922026.037.56.2
IsoQuant-2Ddtype=fp32, bits=4, dim=256, batch size=81922026.037.56.39
IsoQuant-Fastdtype=fp32, bits=3, dim=128, batch size=81922026.037.64.59
IsoQuant-Fastdtype=fp32, bits=4, dim=256, batch size=81922026.037.66.31
IsoQuant-Fulldtype=fp16, bits=4, dim=256, batch size=81922026.038.15.76
IsoQuant-Fulldtype=fp32, bits=4, dim=256, batch size=81922026.038.15.92
IsoQuant-Fastdtype=fp16, bits=2, dim=128, batch size=81922026.038.23.98
IsoQuant-Fulldtype=fp32, bits=4, dim=128, batch size=81922026.038.25.49
IsoQuant-Fastdtype=fp32, bits=4, dim=128, batch size=81922026.038.25.48
IsoQuant-Fastdtype=fp16, bits=2, dim=256, batch size=81922026.038.33.92
IsoQuant-2Ddtype=fp16, bits=2, dim=512, batch size=81922026.038.34.31
IsoQuant-2Ddtype=fp32, bits=4, dim=128, batch size=81922026.038.35.4
IsoQuant-2Ddtype=fp16, bits=2, dim=256, batch size=81922026.038.43.89
IsoQuant-Fulldtype=fp16, bits=2, dim=512, batch size=81922026.038.44.27
IsoQuant-Fastdtype=fp16, bits=3, dim=512, batch size=81922026.038.44.73
IsoQuant-Fulldtype=fp16, bits=2, dim=128, batch size=81922026.038.53.86
IsoQuant-2Ddtype=fp16, bits=2, dim=128, batch size=81922026.038.53.85
IsoQuant-Fastdtype=fp16, bits=2, dim=512, batch size=81922026.038.54.23
IsoQuant-Fulldtype=fp16, bits=2, dim=256, batch size=81922026.038.83.72
IsoQuant-2Ddtype=fp16, bits=3, dim=256, batch size=81922026.039.23.99
IsoQuant-Fastdtype=fp16, bits=4, dim=128, batch size=81922026.039.44.71
IsoQuant-2Ddtype=fp16, bits=4, dim=128, batch size=81922026.039.44.7
IsoQuant-Fastdtype=fp16, bits=3, dim=256, batch size=81922026.039.53.88
IsoQuant-Fulldtype=fp16, bits=4, dim=128, batch size=81922026.039.64.62
IsoQuant-2Ddtype=fp16, bits=3, dim=512, batch size=81922026.039.64.15
IsoQuant-Fulldtype=fp16, bits=3, dim=256, batch size=81922026.039.73.8
IsoQuant-Fulldtype=fp16, bits=3, dim=512, batch size=81922026.039.94.05
IsoQuant-2Ddtype=fp32, bits=2, dim=512, batch size=81922026.0310.53.6
IsoQuant-2Ddtype=fp32, bits=3, dim=512, batch size=81922026.03114.02
IsoQuant-Fastdtype=fp32, bits=2, dim=512, batch size=81922026.0311.43.32
IsoQuant-Fastdtype=fp32, bits=3, dim=512, batch size=81922026.0311.53.85
IsoQuant-Fulldtype=fp32, bits=2, dim=512, batch size=81922026.0312.13.11
IsoQuant-Fastdtype=fp16, bits=4, dim=512, batch size=81922026.0312.54.02
IsoQuant-Fulldtype=fp32, bits=3, dim=512, batch size=81922026.0312.53.54
IsoQuant-2Ddtype=fp16, bits=4, dim=512, batch size=81922026.0313.43.77
IsoQuant-Fastdtype=fp32, bits=4, dim=512, batch size=81922026.0313.53.91
IsoQuant-Fulldtype=fp16, bits=4, dim=512, batch size=81922026.0313.93.63
IsoQuant-2Ddtype=fp32, bits=4, dim=512, batch size=81922026.0313.93.79
IsoQuant-Fulldtype=fp32, bits=4, dim=512, batch size=81922026.0314.83.56
RotorQuantdtype=fp16, bits=2, dim=256, batch size=81922026.0332.6—
RotorQuantdtype=fp16, bits=2, dim=128, batch size=81922026.0332.7—
RotorQuantdtype=fp32, bits=2, dim=128, batch size=81922026.0333.4—
RotorQuantdtype=fp32, bits=2, dim=256, batch size=81922026.0333.8—
RotorQuantdtype=fp32, bits=3, dim=128, batch size=81922026.0335.1—
RotorQuantdtype=fp16, bits=2, dim=512, batch size=81922026.0336—
RotorQuantdtype=fp16, bits=3, dim=128, batch size=81922026.0336.4—
RotorQuantdtype=fp16, bits=3, dim=256, batch size=81922026.0336.8—
RotorQuantdtype=fp32, bits=2, dim=512, batch size=81922026.0337.8—
RotorQuantdtype=fp32, bits=3, dim=256, batch size=81922026.0337.9—
RotorQuantdtype=fp16, bits=3, dim=512, batch size=81922026.0339.9—
RotorQuantdtype=fp32, bits=3, dim=512, batch size=81922026.0344.1—
RotorQuantdtype=fp16, bits=4, dim=128, batch size=81922026.0344.2—
RotorQuantdtype=fp32, bits=4, dim=128, batch size=81922026.0344.7—
RotorQuantdtype=fp16, bits=4, dim=256, batch size=81922026.0346.7—
RotorQuantdtype=fp32, bits=4, dim=256, batch size=81922026.0347.9—
RotorQuantdtype=fp16, bits=4, dim=512, batch size=81922026.0350.4—
RotorQuantdtype=fp32, bits=4, dim=512, batch size=81922026.0352.9—